CN109669637A - For providing system, the method and apparatus of container service - Google Patents

For providing system, the method and apparatus of container service Download PDF

Info

Publication number
CN109669637A
CN109669637A CN201811574613.0A CN201811574613A CN109669637A CN 109669637 A CN109669637 A CN 109669637A CN 201811574613 A CN201811574613 A CN 201811574613A CN 109669637 A CN109669637 A CN 109669637A
Authority
CN
China
Prior art keywords
disk
instruction
working node
response
creation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811574613.0A
Other languages
Chinese (zh)
Other versions
CN109669637B (en
Inventor
蔡卫东
杨金锋
王辉
叶子超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201811574613.0A priority Critical patent/CN109669637B/en
Publication of CN109669637A publication Critical patent/CN109669637A/en
Application granted granted Critical
Publication of CN109669637B publication Critical patent/CN109669637B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062—Securing storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/52—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems during program execution, e.g. stack integrity ; Preventing unwanted data erasure; Buffer overflow
    • G06F21/53—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems during program execution, e.g. stack integrity ; Preventing unwanted data erasure; Buffer overflow by executing in a restricted environment, e.g. sandbox or secure virtual machine
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0674—Disk device
    • G06F3/0676—Magnetic disk device

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Hardware Design (AREA)
  • Stored Programmes (AREA)

Abstract

The embodiment of the present application discloses system, method and apparatus for providing container service.One specific embodiment of the system includes: including management server cluster and at least one working node, the system in working node by realizing that quick carry and solution to storage equipment are hung, its technical effect can include but is not limited to: improving the flexibility of deployment, and improves safety.

Description

For providing system, the method and apparatus of container service
Technical field
The invention relates to field of computer technology, and in particular to for provide the system of container service, method and Device.
Background technique
In Kubernetes (abbreviation K8S), (Pod is minimum/simplest base of Kubernetes creation or deployment to Pod Our unit, a Pod represent a process being currently running on cluster) it can be rolled up by book (Volume) or persistently The mode of (PV, Persistent Volume) uses disk.Wherein Volume is usually destroyed with the destruction of Pod, is not suitable for In stateful service.PV then overcomes this problem well, and generally by means of external storage, the lasting of data may be implemented Change.However, there are a set thresholds by current third party storage system access k8s, it can totally be divided into in-tree and out-tree two Kind mode.
In-tree, which refers to, is integrated in kubernetes internal system, is close coupling relationship with kubernetes.Currently, in- The mode of tree is mainly by way of cloud-provider.
Out-tree refers to be run in a manner of plug-in unit independently of each other with kubenetes, is loose coupling with kubernetes Relationship.For example, in such a way that flex-vloume is another realization disk carry as the out-tree mode of representative, still Flex-volume depends on host, needs to develop binary program while supporting several operation systems.In addition, flex- Volume can may also have safety issue because it directly runs on host.
Summary of the invention
The embodiment of the present application is proposed for providing the method and apparatus of container service.
In a first aspect, the embodiment of the present application provide it is a kind of for providing the system of container service, including management server Cluster and at least one working node, wherein working node is configured to: it is instructed in response to receiving disk creation/deletion, wound Build/delete network disk corresponding with the disk creation/deletion instruction received；It, will in response to receiving disk load instruction Network disk indicated by disk to be loaded mark in disk load instruction is loaded into the working node；In response to receiving magnetic Disk unloading command, the network disk indicated from the disk to be unloaded mark in working node unloading disk unloading command；It rings Ying Yu receives disk mounting instructions, and the network disk indicated to carry disk mark in disk mounting instructions is mounted to The specified path of the working node；Instruction is hung in response to receiving disk solution, the disk solution of the working node carry is hung into instruction In the indicated network disk of suspended network disk to be solved mark hung from the specified path solution of the working node.
Second aspect, the embodiment of the present application provide it is a kind of for providing the method for container service, applied to for providing Working node in the system of container service, wherein the system for providing container service includes management server cluster and extremely A few working node, this method comprises: being instructed in response to receiving disk creation/deletion, creation/deletion and the magnetic received Disk creation/deletion instructs corresponding network disk；It, will be to be added in disk load instruction in response to receiving disk load instruction It carries the indicated network disk of disk mark and is loaded into the working node；In response to receiving disk unloading command, from the work Node unloads the indicated network disk of the disk to be unloaded mark in disk unloading command；Refer in response to receiving disk carry It enables, the network disk indicated to carry disk mark in disk mounting instructions is mounted to the specified circuit of the working node Diameter；Instruction is hung in response to receiving disk solution, the disk solution of the working node carry is hung into suspended network disk mark to be solved in instruction Know indicated network disk to hang from the specified path solution of the working node.
The third aspect, the embodiment of the present application provide it is a kind of for providing the device of container service, applied to for providing Working node in the system of container service, wherein the system for providing container service includes management server cluster and extremely A few working node, which includes: creation/deletion unit, is configured in response to receive disk creation/deletion and refers to It enables, creation/deletion network disk corresponding with the disk creation/deletion instruction received；Loading unit is configured in response to Disk load instruction is received, the indicated network disk of the disk to be loaded mark in disk load instruction is loaded into the work Make node；Unloading unit is configured in response to receive disk unloading command, unloads disk unloading command from the working node In the indicated network disk of disk to be unloaded mark；First carry unit is configured in response to receive disk carry The network disk indicated to carry disk mark in disk mounting instructions is mounted to the specified circuit of the working node by instruction Diameter；First de-linked unit is configured in response to receive the extension instruction of disk solution, the disk solution extension of the working node carry is referred to The indicated network disk of suspended network disk mark to be solved is hung from the specified path solution of the working node in order.
Fourth aspect, the embodiment of the present application provide a kind of electronic equipment, comprising: one or more processors；Storage dress It sets, is stored thereon with one or more programs, when said one or multiple programs are executed by said one or multiple processors, So that said one or multiple processors realize the method as described in implementation any in second aspect.
5th aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey Sequence, wherein realized when the computer program is executed by one or more processors such as implementation description any in second aspect Method.
It is provided by the embodiments of the present application to be used to provide system, the method and apparatus of container service, by being provided for The system of container service, including management server cluster and at least one working node, wherein working node is configured to: it rings Ying Yu receives disk creation/deletion instruction, creation/deletion network magnetic corresponding with the disk creation/deletion instruction received Disk；In response to receiving disk load instruction, by the indicated network disk of the disk to be loaded mark in disk load instruction It is loaded into the working node；In response to receiving disk unloading command, from the working node unloading disk unloading command in Unload the indicated network disk of disk mark；In response to receiving disk mounting instructions, by disk mounting instructions wait hang Carry the specified path that the indicated network disk of disk mark is mounted to the working node；Refer in response to receiving disk solution extension It enables, suspended network disk to be solved in the disk solution extension instruction of the working node carry is identified into indicated network disk from the work The specified path solution of node is hung.
It is provided by the embodiments of the present application to be used to provide system, the method and apparatus of container service, by working node It realizes and the quick carry and solution of storage equipment is hung, technical effect can include but is not limited to:
First, the dependence in traditional approach to physical environment is relieved, therefore improve the flexibility of deployment.
Second, it does not need all to expose away the file system of physical machine, reduces a possibility that being attacked, therefore, mention High safety.
Detailed description of the invention
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the application's is other Feature, objects and advantages will become more apparent upon:
Fig. 1 is that one embodiment of the application can be applied to exemplary system architecture figure therein；
Fig. 2 is the timing diagram according to one embodiment of the system for providing container service of the application；
Fig. 3 A and Fig. 3 B are the timing diagrams according to another embodiment of the system for providing container service of the application；
Fig. 4 is the flow chart according to one embodiment of the method for providing container service of the application；
Fig. 5 is the schematic diagram according to an application scenario diagram of the method for providing container service of the application；
Fig. 6 is the structural schematic diagram according to one embodiment of the device for providing container service of the application；
Fig. 7 is adapted for the structural schematic diagram for the computer system for realizing the electronic equipment of the embodiment of the present application.
Specific embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to Convenient for description, part relevant to related invention is illustrated only in attached drawing.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 is shown can be using the exemplary system frame of the embodiment of the system for providing container service of the application Structure 100.
As shown in Figure 1, system architecture 100 may include management server cluster 101, network 102 and working node 103, 104,105.Network 102 between management server cluster 101 and working node 103,104,105 to provide communication link Medium.Network 102 may include various connection types, such as wired, wireless communication link or fiber optic cables etc..
The distributed clothes of multiple server compositions may be implemented into management server cluster (master cluster) 101 Business device cluster, also may be implemented into individual server, is the common cluster of all users, provide container scheduling, working node The functions such as (Work Node) management.
It is understood that may include in management server cluster to realize Kubernetes cluster Various Master components in Kubernetes component, including but not limited to following Master component: kube-apiserver, ETCD, kube-controller-manager, cloud-controller-manager, kube-scheduler, plug-in unit Addons, DNS, user interface, container monitoring resource and Cluster-level Logging.And may include in working node Various node (Node) components, including but not limited to following Node component: kubelet, kube-proxy, docker, RKT, supervisord、fluentd。
It should be noted that for providing the method for container service generally by working node provided by the embodiment of the present application 103, it 104,105 executes, correspondingly, the device for providing container service is generally positioned in working node 103,104,105.
Working node 103,104,105 can be hardware (for example, physical machine), be also possible to software (for example, virtual machine). When working node 103,104,105 is hardware, the distributed server collection of multiple servers composition may be implemented into, it can also be with It is implemented as individual server.When above-mentioned working node 103,104,105 is software, multiple softwares or software mould may be implemented into Block (such as providing Distributed Services), also may be implemented into single software or software module.It is not specifically limited herein.
It should be understood that the number of management server cluster, network and working node in Fig. 1 is only schematical.Root It factually now needs, can have any number of management server cluster, network and working node.
With continued reference to Fig. 2, it illustrates according to one embodiment of the system for providing container service of the application Timing 200.
The system for providing container service in the embodiment of the present application may include management server cluster and at least one A working node.
As shown in Fig. 2, the timing 200 of one embodiment of the system according to the application for providing container service can be with The following steps are included:
Step 201, working node is instructed in response to receiving disk creation/deletion, creation/deletion and the disk received Creation/deletion instructs corresponding network disk.
In the present embodiment, the working node in the system for providing container service can refer to receiving disk creation In the case where order, network disk corresponding with the disk creation instruction received is created, deletes the feelings instructed receiving disk Under condition, network disk corresponding with the disk deletion instruction received is deleted.
In some optional implementations of the present embodiment, working node can receive management server collection pocket transmission Disk creation/deletion instruction.It may include api-server component in management server cluster in practice, and working node The component of the included out-tree implementation of k8s: external-attacher, external- can be installed Provisioner and provisioner-controller.In this way, working node can be installed in using the working node Provison-controller component listen to the api-server component in management server cluster transmission disk wound Build/delete instruction in the case where, using external-provisioner component creation/deletion with received disk creation/ It deletes and instructs corresponding network disk.
And wherein, the api-server component in management server cluster can be in the Pod creation for receiving user's transmission The case where request, persistently volume request to create or persistently volume application (PVC, Persistent Volume Claim) request to create Under, generate disk creation instruction.Api-server component in management server cluster can receive user's transmission, In the case where Pod removal request, persistently volume removal request or persistently volume application removal request, generates disk and delete instruction.
Step 202, working node is in response to receiving disk load instruction, by the disk to be loaded in disk load instruction The indicated network disk of mark is loaded into the working node.
In the present embodiment, working node can be in the case where receiving disk load (attach) instruction, by disk It loads the indicated network disk of the disk to be loaded mark in instruction and loads (attach) to the working node.
In some optional implementations of the present embodiment, working node can receive management server collection pocket transmission Disk load instruction.It may include api-server component in management server cluster in practice, and working node can also pacify Equipped with k8s carry out-tree implementation component: external-attacher, external-provisioner with And provisioner-controller.In this way, the external- that working node can be installed in using the working node In the case that attacher component listens to the disk load instruction of the transmission of the api-server component in management server cluster, Disk is loaded into the indicated network disk of the disk to be loaded mark in instruction and loads (attach) to the working node.
And wherein, the api-server component in management server cluster can be in the Pod creation for receiving user's transmission In the case where request, persistently volume request to create or persistently volume application request to create, disk load instruction is generated.
Step 203, working node unloads disk unloading command from the working node in response to receiving disk unloading command In the indicated network disk of disk to be unloaded mark.
In the present embodiment, working node can be in the case where receiving disk unloading (detach) instruction, from the work Make network disk indicated by the disk to be unloaded mark in node unloading disk unloading command.
In some optional implementations of the present embodiment, working node can receive management server collection pocket transmission Disk unloading command.It may include api-server component in management server cluster in practice, and working node can also pacify Equipped with k8s carry out-tree implementation component: external-attacher, external-provisioner with And provisioner-controller.In this way, the external- that working node can be installed in using the working node In the case that attacher component listens to the disk unloading command of the transmission of the api-server component in management server cluster, The network disk indicated from the disk to be unloaded mark in working node unloading (detach) disk unloading command.
And wherein, the api-server component in management server cluster can be deleted in the Pod for receiving user's transmission In the case where request, persistently volume removal request or persistently volume application removal request, disk unloading command is generated.
Step 204, working node is in response to receiving disk mounting instructions, by disk mounting instructions to carry disk The indicated network disk of mark is mounted to the specified path of the working node.
In the present embodiment, working node can hang disk in the case where receiving disk carry (mount) instruction Carry the specified path that the network disk carry (mount) indicated to carry disk mark in instruction arrives the working node.
In some optional implementations of the present embodiment, working node can receive management server collection pocket transmission Disk mounting instructions.It may include api-server component in management server cluster in practice, and working node can also pacify The Node component carried equipped with k8s: Kubelet component.In this way, what working node can be installed in using the working node In the case that Kubelet component listens to the disk mounting instructions of the transmission of the api-server component in management server cluster, The network disk indicated to carry disk mark in disk mounting instructions is mounted to the specified path of the working node.
And wherein, the api-server component in management server cluster can be in the Pod creation for receiving user's transmission In the case where request, persistently volume request to create or persistently volume application request to create, disk mounting instructions are generated.
Step 205, working node hangs instruction in response to receiving disk solution, and the disk solution extension of the working node carry is referred to The indicated network disk of suspended network disk mark to be solved is hung from the specified path solution of the working node in order.
In the present embodiment, working node can be in the case where receiving disk carry (unmount) instruction, by the work The disk solution for making node carry hangs the finger of suspended network disk to be solved mark is indicated in instruction network disk from the working node Determine path solution and hangs (unmount).
In some optional implementations of the present embodiment, working node can receive management server collection pocket transmission Disk solution hangs instruction.It may include api-server component in management server cluster in practice, and working node can also pacify The Node component carried equipped with k8s: Kubelet component.In this way, what working node can be installed in using the working node In the case that the disk solution that Kubelet component listens to the transmission of the api-server component in management server cluster hangs instruction, Suspended network disk to be solved in the disk solution extension instruction of the working node carry is identified into indicated network disk from the work section The specified path solution of point is hung.
And wherein, the api-server component in management server cluster can be deleted in the Pod for receiving user's transmission In the case where request, persistently volume removal request or persistently volume application removal request, generates disk solution and hang instruction.
The application's is provided by the above embodiment for providing the system of container service, passes through the realization pair in working node The quick carry and solution for storing equipment are hung, and technical effect can include but is not limited to: improve the flexibility of deployment, Yi Jiti High safety.
With further reference to Fig. 3 A and Fig. 3 B, it illustrates according to the another of the system for providing container service of the application The timing 300 of a embodiment.
The system for providing container service in the embodiment of the present application may include management server cluster and at least one A working node.Wherein, management server cluster includes api-server component, and working node includes the included Node group of k8s Part: the component for the out-tree implementation that Kubelet component and k8s are carried: external-attacher component, External-provisioner component and provisioner-controller component and memory card, here, storage are inserted Part is the container in the container arranging system for operate in working node.
As shown in Figure 3A, according to the timing 300 of another embodiment of the system for providing container service of the application It may comprise steps of:
Step 301, working node is instructed in response to receiving disk creation/deletion using memory card, is inserted using storage Part creation/deletion network disk corresponding with the disk creation/deletion instruction received.
In the present embodiment, the working node in the system for providing container service can be received using memory card In the case where disk creation instruction, memory card creation network disk corresponding with the disk creation instruction received is utilized； And it in the case where receiving disk deletion instruction using memory card, is deleted using memory card and is deleted with the disk received Except the corresponding network disk of instruction.
In some optional implementations of the present embodiment, working node can use memory card and receive management service The disk creation of device collection pocket transmission/deletion instruction.The provison- that working node can be installed in using the working node Controller component listens to disk creation/deletion instruction of the transmission of the api-server component in management server cluster In the case of, the disk listened to creation/deletion is instructed by the provison-controller component installed in the working node It is sent to the external-provisioner component installed in the working node, finally again by installing in the working node External-provisioner component inserts the storage that the disk received creation/deletion instruction is sent in the working node Part, then working node can use memory card and receive disk creation/deletion instruction that management server cluster is sent.
And wherein, the api-server component in management server cluster can be in the Pod creation for receiving user's transmission The case where request, persistently volume request to create or persistently volume application (PVC, Persistent Volume Claim) request to create Under, generate disk creation instruction.Api-server component in management server cluster can be in the Pod for receiving user's transmission In the case where removal request, persistently volume removal request or persistently volume application removal request, generates disk and delete instruction.
Step 302, working node is in response to receiving disk load instruction using memory card, using memory card by magnetic Network disk indicated by disk to be loaded mark in disk load instruction is loaded into the working node.
In the present embodiment, working node can be in the feelings for receiving disk load (attach) instruction using memory card Under condition, the disk to be loaded in disk load instruction is identified into indicated network disk using memory card and loads (attach) To the working node.
In some optional implementations of the present embodiment, working node can use memory card and receive management service The disk of device collection pocket transmission loads instruction.The external- that working node can be installed in using the working node In the case that attacher component listens to the disk load instruction of the transmission of the api-server component in management server cluster, The disk listened to load instruction is sent to memory card by the external-attacher component of the working node, then Working node can use memory card and receive the disk load instruction that management server cluster is sent.
And wherein, the api-server component in management server cluster can be in the Pod creation for receiving user's transmission In the case where request, persistently volume request to create or persistently volume application request to create, disk load instruction is generated.
Step 303, working node is in response to receiving disk unloading command using memory card, using memory card from this Working node unloads the indicated network disk of the disk to be unloaded mark in disk unloading command.
In the present embodiment, working node can be in the feelings for receiving disk unloading (detach) instruction using memory card Under condition, indicated network magnetic is identified from the disk to be unloaded in working node unloading disk unloading command using memory card Disk.
In some optional implementations of the present embodiment, working node can use memory card and receive management service The disk unloading command of device collection pocket transmission.The external- that working node can be installed in using the working node In the case that attacher component listens to the disk unloading command of the transmission of the api-server component in management server cluster, The disk unloading command listened to is sent to memory card by the external-attacher component of the working node, then Working node can use memory card and receive the disk unloading command that management server cluster is sent.
And wherein, the api-server component in management server cluster can be deleted in the Pod for receiving user's transmission In the case where request, persistently volume removal request or persistently volume application removal request, disk unloading command is generated.
Step 304, working node is in response to receiving disk mounting instructions using memory card, using memory card by magnetic The network disk indicated to carry disk mark in disk mounting instructions is mounted to the specified path of the working node.
In the present embodiment, working node can be in the feelings for receiving disk carry (mount) instruction using memory card Under condition, indicated network disk carry (mount) will be identified to carry disk in disk mounting instructions using memory card To the specified path of the working node.
In some optional implementations of the present embodiment, working node can use memory card and receive management service The disk mounting instructions of device collection pocket transmission.The Kubelet component that working node can be installed in using the working node is monitored In the case where the disk mounting instructions sent to the api-server component in management server cluster, by the working node The disk mounting instructions listened to are sent to memory card by Kubelet component, and then working node can use memory card Receive the disk mounting instructions that management server cluster is sent.
And wherein, the api-server component in management server cluster can be in the Pod creation for receiving user's transmission In the case where request, persistently volume request to create or persistently volume application request to create, disk mounting instructions are generated.
Step 305, working node hangs instruction in response to receiving disk solution using memory card, should using memory card The disk solution of working node carry hangs suspended network disk mark to be solved is indicated in instruction network disk from the working node Specified path solution is hung.
In the present embodiment, working node can receive disk carry (unmount) instruction using memory card In the case of, using memory card that suspended network disk mark to be solved in the disk solution extension instruction of the working node carry is indicated Network disk hangs (unmount) from the specified path solution of the working node.
In some optional implementations of the present embodiment, working node can use memory card and receive management service The disk solution of device collection pocket transmission hangs instruction.The Kubelet component that working node can be installed in using the working node is monitored In the case that the disk solution sent to the api-server component in management server cluster hangs instruction, by the working node The disk solution listened to is hung instruction and is sent to memory card by Kubelet component, and then working node can use memory card It receives the disk solution that management server cluster is sent and hangs instruction.
And wherein, the api-server component in management server cluster can be deleted in the Pod for receiving user's transmission In the case where request, persistently volume removal request or persistently volume application removal request, generates disk solution and hang instruction.
Step 306, working node in response to receive plug-in registration instruction, using memory card by plug-in unit to be registered according to Plug-in unit mark and plug-in version are registered to the api-server component of management server cluster.
In the present embodiment, working node can be in the case where receiving plug-in registration instruction, and here, plug-in registration refers to Order may include plug-in unit, plug-in unit mark and plug-in version to be registered, be identified plug-in unit to be registered according to plug-in unit using memory card The api-server component of management server cluster is registered to plug-in version.
It limits, is continued with reference to Fig. 3 B since the page is shown, it should be noted that the process of Fig. 3 B is in addition to including Fig. 3 B Shown in outside each step, can also include each step shown in Fig. 3 A.In addition, it is necessary to illustrate, institute in Fig. 3 B The management server cluster and working node shown can also be performed in Fig. 3 A other than it can execute corresponding steps shown in Fig. 3 B Shown in the corresponding steps that can execute of management server cluster and working node.
Step 307, management server cluster is in response to receiving container creation instruction, it is determined whether exists and is received Container creation instructs corresponding lasting volume.
In the present embodiment, the management server cluster in the system for providing container service can receive user In the case where the container creation instruction that using terminal equipment is sent, determine in system for providing container service with the presence or absence of with The container creation received instructs corresponding lasting volume.The container that may include in practice, in container creation instruction and created The corresponding relevant information persistently rolled up, such as relevant information may include the amount of capacity information persistently rolled up, in this way, management service Device cluster can be created according to container in the determining system for providing container service of the relevant information persistently rolled up in instruction It is no to there is lasting volume corresponding with the container creation instruction received.
Step 308, management server cluster is not present in response to determination, determines and is received at least one working node The container creation arrived instructs corresponding first object working node, and generates and create that instruction is corresponding to hold with the container received The instruction of volume creation long.
In the present embodiment, management server cluster can determine that there is no create with the container received in step 307 In the case where building the corresponding lasting volume of instruction, determines and received at least one working node for providing container service Container creation instruct corresponding first object working node, and generate it is corresponding with the container creation instruction received lasting Volume creation instruction.Here, first object working node meets creation and the container that is received and creates that instruction is corresponding persistently to roll up It is required that, that is, first object working node can create lasting volume corresponding with the container creation instruction received.
Step 309, management server cluster sends received container creation instruction and institute to first object working node The lasting volume generated creates instruction.
In the present embodiment, the container received in step 308 can be created instruction and given birth to by management server cluster At lasting volume creation instruction be sent to identified first object working node in step 308.
Step 310, management server cluster exists in response to determining, will create holding for instructions match with the container received Volume is determined as lasting volume corresponding with the container creation instruction received long, corresponding persistently to the container creation instruction received Working node where volume sends received container and creates instruction.
In the present embodiment, management server cluster can determine in step refers in the presence of with the container creation received In the case where enabling corresponding lasting volume, will with received in step 307 container creation instructions match it is lasting volume be determined as and The container creation received in step 307 instructs corresponding lasting volume, and the container creation instruction received into step 307 The container creation instruction received in working node sending step 307 where corresponding lasting volume.
Step 311, working node creates instruction, creation and institute in response to receiving the container of management server collection pocket transmission The container creation received instructs corresponding container.
Step 312, working node using the provisioner-controller component of the working node in response to being monitored Lasting volume to management server collection pocket transmission creates instruction, generates disk corresponding with the lasting volume creation instruction received and creates Instruction, disk load instruction and disk mounting instructions are built to call using the external-attacher component of the working node Memory card executes disk creation instruction, disk load instruction and disk mounting instructions generated, with the magnetic for creating and receiving Disk creation instructs corresponding network disk, and loads and be mounted to the working node for the network disk created.
In the present embodiment, working node can be in the provisioner-controller component using the working node In the case where the lasting volume creation instruction for listening to management server collection pocket transmission, firstly generates and created with the lasting volume received Corresponding disk creation (create) instruction, disk load (attach) instruction and disk carry (mount) instruction are instructed, then Using the external-attacher component of the working node, calls memory card to execute disk generated and create instruction, magnetic Disk load instruction and disk mounting instructions with the corresponding network disk of disk creation instruction for creating with receiving, and will be created The network disk built loads and is mounted to the working node.
Step 312 is arrived by step 307, may be implemented to create container in the system for providing container service.
Step 313, management server cluster deletes instruction in response to receiving container, determines that received container deletion refers to The second target operation node where container to be deleted in order, and generate lasting volume corresponding with container deletion instruction and delete Instruction.
In the present embodiment, management server cluster can be deleted in the container for receiving the transmission of user's using terminal equipment In the case where instruction, determine that received container deletes the second target operation node where the container to be deleted in instruction, with And it generates lasting volume corresponding with container deletion instruction and deletes instruction.
Step 314, the container received is deleted instruction by management server cluster and lasting volume generated deletes instruction It is sent to the second target operation node.
In the present embodiment, the container received in step 313 can be deleted instruction and given birth to by management server cluster At lasting volume delete instruction be sent to the second target operation node.In this way, the second destination node can execute in step 315 Cell therefor deletes instruction.
Step 315, working node deletes instruction, deletion and institute in response to receiving the container of management server collection pocket transmission The container received, which is deleted, instructs corresponding container.
In the present embodiment, working node can delete the feelings instructed in the container for receiving management server collection pocket transmission Under condition, container corresponding with the container deletion instruction received is deleted.
Step 316, working node using the provisioner-controller component of the working node in response to being monitored Lasting volume to management server collection pocket transmission deletes instruction, generates disk solution corresponding with the lasting volume deletion instruction received Instruction and disk unloading command are hung, using the external-attacher component of the working node, memory card is called to execute institute The disk solution of generation hangs instruction and disk unloading command, will network disk corresponding with the lasting volume deletion instruction received from The working node solution is hung and unloading.
In the present embodiment, working node can be in the provisioner-controller component using the working node In the case where the lasting volume deletion instruction for listening to management server collection pocket transmission, generates and delete instruction with the lasting volume received Corresponding disk solution hangs instruction and disk unloading command, then recycles the external-attacher component of the working node, It calls memory card to execute above-mentioned disk solution generated and hangs instruction and disk unloading command, will be deleted with the lasting volume received Except the corresponding network disk of instruction hangs (unmount) and unloading (detach) from the working node solution.
Wherein, management server can be the case where receiving the lasting volume removal request of user's using terminal equipment transmission Under, it generates lasting volume corresponding with the lasting volume generation request received and deletes instruction, and lasting volume deletion generated is referred to Enable the working node being sent to where the lasting volume that persistently volume deletion instruction to be deleted.
Step 317, working node deletes network disk corresponding with the lasting volume deletion instruction received in response to determining, It generates disk corresponding with the lasting volume deletion instruction received and deletes instruction, utilize the external- of the working node Attacher component calls memory card to execute disk generated and deletes instruction, deleted with deleting with the lasting volume received Instruct corresponding network disk.
In the present embodiment, working node can be after step 316, it is determined whether deletes and deletes with the lasting volume received Except the corresponding network disk of instruction.In practice, here, working node can be in the provisioner- using the working node After the lasting volume that controller component listens to management server collection pocket transmission deletes instruction, the lasting volume listened to is parsed Instruction is deleted, and obtains whether deleting corresponding network disk after deleting persistently volume, and whether after deleting persistently volume Corresponding network disk is deleted, usually can be persistently to be rolled up in using terminal equipment to the pocket transmission of management server collection from user and delete It is specified when except request.If it is determined that deleting network disk corresponding with the lasting volume deletion instruction received, then work Node can firstly generate disk corresponding with the lasting volume deletion instruction received and delete instruction, then can use the work The external-attacher component of node calls memory card to execute disk generated and deletes instruction, to delete and be received The lasting volume arrived, which is deleted, instructs corresponding network disk.
By step 313 arrive step 317, may be implemented in the system for providing container service delete container and/or Persistently volume.
From figure 3, it can be seen that being used to provide container service in the present embodiment compared with the corresponding embodiment of Fig. 2 The process 300 of system highlights creation, deletion, load, the unloading, carry, solution extension that network disk is realized using memory card, with And the step of having had more plug-in registration.The storage in system described as a result, relative to the plug-in unit in legacy system, the present embodiment Plug-in unit can dynamically support creation/deletion disk, expand the function of memory card (i.e. container).
With further reference to Fig. 4, it illustrates the processes 400 of one embodiment of the method for providing container service, answer For the working node in the system for providing container service, wherein the system for providing container service may include pipe Manage server cluster and at least one working node.This is used to provide the process 400 of the method for container service, including following step It is rapid:
Step 401, it is instructed in response to receiving disk creation/deletion, creation/deletion is created with the disk received/is deleted Except the corresponding network disk of instruction.
Step 402, in response to receiving disk load instruction, the disk to be loaded in disk load instruction is identified signified The network disk shown is loaded into the working node.
Step 403, in response to receiving disk unloading command, from the working node unloading disk unloading command in wait unload Carry the indicated network disk of disk mark.
Step 404, in response to receiving disk mounting instructions, meaning will be identified to carry disk in disk mounting instructions The network disk shown is mounted to the specified path of the working node.
Step 405, instruction is hung in response to receiving disk solution, the disk solution of the working node carry is hung in instruction wait solve The indicated network disk of suspended network disk mark is hung from the specified path solution of the working node.
In the present embodiment, the concrete operations of step 401, step 402, step 403, step 404 and step 405 and Fig. 2 Shown in step 201 in embodiment, step 202, step 203, the operation of step 204 and step 205 it is essentially identical, herein no longer It repeats.
In some optional implementations of the present embodiment, which can With following optional implementation:
Optional implementation (one): the management server cluster in system for providing container service may include api- Server component, the working node in system for providing container service may include Kubelet component, external- Attacher component, external-provisioner component, provisioner-controller component and memory card, this In, memory card is the container in the container arranging system for operate in working node.
Based on above-mentioned optional implementation (one), in some optional implementations of the present embodiment, step 401 can be with It is following to carry out: to be instructed in response to receiving disk creation/deletion using memory card, utilize memory card creation/deletion and institute The disk creation received/deletion instructs corresponding network disk.
Here, the concrete operations of the optional implementation and the concrete operations with reference to step 301 in embodiment shown in Fig. 3 Essentially identical, details are not described herein.
Based on above-mentioned optional implementation (one), in some optional implementations of the present embodiment, step 402 can be with It is following to carry out:
In response to using memory card receive disk load instruction, using memory card by disk load instruction in The indicated network disk of load disk mark is loaded into the working node.
Here, the concrete operations of the optional implementation and the concrete operations with reference to step 302 in embodiment shown in Fig. 3 Essentially identical, details are not described herein.
Based on above-mentioned optional implementation (one), in some optional implementations of the present embodiment, step 403 can be with It is following to carry out:
In response to receiving disk unloading command using memory card, disk is unloaded from the working node using memory card Network disk indicated by disk to be unloaded mark in unloading command.
Here, the concrete operations of the optional implementation and the concrete operations with reference to step 303 in embodiment shown in Fig. 3 Essentially identical, details are not described herein.
Based on above-mentioned optional implementation (one), in some optional implementations of the present embodiment, step 404 can be with It is following to carry out:
In response to receiving disk mounting instructions using memory card, using memory card by disk mounting instructions to The indicated network disk of carry disk mark is mounted to the specified path of the working node.
Here, the concrete operations of the optional implementation and the concrete operations with reference to step 304 in embodiment shown in Fig. 4 Essentially identical, details are not described herein.
Based on above-mentioned optional implementation (one), in some optional implementations of the present embodiment, step 405 can be with It is following to carry out:
Instruction is hung in response to receiving disk solution using memory card, using memory card by the magnetic of the working node carry Disk solution is hung the network disk that suspended network disk mark to be solved is indicated in instruction and is hung from the specified path solution of the working node.
Here, the concrete operations of the optional implementation and the concrete operations with reference to step 305 in embodiment shown in Fig. 3 Essentially identical, details are not described herein.
In some optional implementations of the present embodiment, this is used to provide the process 400 of the method for container service also It can be with following steps 406:
Step 406, in response to receiving plug-in registration instruction, plug-in unit to be registered is identified according to plug-in unit using memory card The api-server component of management server cluster is registered to plug-in version.
Here, the concrete operations of step 406 and the basic phase of concrete operations with reference to step 306 in embodiment shown in Fig. 3 Together, details are not described herein.
In some optional implementations of the present embodiment, this is used to provide the process 400 of the method for container service also It can be with following steps 407 and step 408:
Step 407, instruction, creation and the appearance received are created in response to receiving the container of management server collection pocket transmission Device creation instructs corresponding container.
Step 408, in response to listening to management service using the provisioner-controller component of working node The lasting volume of device collection pocket transmission creates instruction, determines disk creation instruction corresponding with the lasting volume creation instruction received, magnetic Disk load instruction and disk mounting instructions call memory card to hold using the external-attacher component of the working node Row disk creation instruction generated, disk load instruction and disk mounting instructions, with the disk creation instruction for creating and receiving Corresponding network disk, and the network disk created is loaded and is mounted to the working node.
Here, the concrete operations of step 407 and step 408 and step 311 and step in reference embodiment shown in Fig. 3 312 concrete operations are essentially identical, and details are not described herein.
In some optional implementations of the present embodiment, this is used to provide the process 400 of the method for container service also It can be with following steps 409 and step 410:
Step 409, instruction is deleted in response to receiving the container of management server collection pocket transmission, the appearance deleted and received Device, which is deleted, instructs corresponding container.
Step 410, management clothes are listened in response to the provisioner-controller component using the working node The be engaged in lasting volume of device collection pocket transmission deletes instruction, generate instructed with the lasting volume deletion instruction corresponding disk solution extension received and Disk unloading command calls memory card to execute magnetic generated using the external-attacher component of the working node Disk solution hangs instruction and disk unloading command, will be with the lasting volume corresponding network disk of deletion instruction that is received from the work section Point solution is hung and unloading；Network disk corresponding with the lasting volume deletion instruction received is deleted in response to determining, generates and is received The lasting volume arrived, which is deleted, instructs corresponding disk to delete instruction, using the external-attacher component of the working node, adjusts Disk generated is executed with memory card and deletes instruction, with deletion network magnetic corresponding with the lasting volume deletion instruction received Disk.
Here, the concrete operations of step 409 and step 410 and step 315 and step in reference embodiment shown in Fig. 3 316 concrete operations are essentially identical, and details are not described herein.
It is provided by the embodiments of the present application to be used to provide the method for container service, applied to for providing the system of container service In working node, by realizing that quick carry and solution to storage equipment are hung in working node, technical effect be can wrap It includes but is not limited to: improving the flexibility of deployment, and improve safety.
It is one of the application scenarios of the method according to the present embodiment for providing container service below with reference to Fig. 5, Fig. 5 Schematic diagram.In the application scenarios of Fig. 5, the system for providing container service includes management server cluster 501, working node 502.Include api-server component 5011 in management server cluster 501, includes the Node that k8s is carried in working node 502 Component: the component for the out-tree implementation that Kubelet component 5021 and k8s are carried: external-attacher group Part 5022, external-provisioner component 5023 and provisioner-controller component 5024, and storage Plug-in unit 5025.User can be used terminal device 503 and send container creation instruction 504 to management server cluster 501, then, Management server cluster 501 receives container creation instruction 504, determines that there is no corresponding with the container creation instruction received Persistently volume, and determining with container creation 504 corresponding first object working nodes of instruction is working node 502, and generate and The corresponding lasting volume creation instruction 505 of container creation instruction 504.Management server cluster 501 sends container to working node 502 Creation instruction 504 and persistently volume creation instruction 505.Working node 502 receives the container creation of the transmission of management server cluster 501 Instruction 504 creates container 506 corresponding with the container creation instruction received.The provisioner- of working node 502 Controller component 5024 listens to the lasting volume creation instruction 505 of the transmission of management server cluster 501, generates and is received The creation of lasting volume instruct corresponding disk creation instruction 507, disk load instruction 508 and disk mounting instructions 509, utilize this The external-attacher component 5022 of working node, call memory card 5025 execute disk generated creation instruction, Disk load instruction and disk mounting instructions, with the corresponding network disk of disk creation instruction for creating with receiving, and by institute The network disk of creation loads and is mounted to working node 502.
With further reference to Fig. 6, as the realization to method shown in above-mentioned each figure, this application provides one kind for providing appearance One embodiment of the device of device service, applied to the working node in the system for providing container service, wherein above-mentioned use In provide container service system include management server cluster and at least one working node.The Installation practice and Fig. 4 institute The embodiment of the method shown is corresponding, which specifically can be applied in various electronic equipments.
As shown in fig. 6, the device 600 for providing container service of the present embodiment includes: creation/deletion unit 601, adds Carrier unit 602, unloading unit 603, the first carry unit 604 and the first de-linked unit 605.Wherein, creation/deletion unit 601, It is configured in response to receive disk creation/deletion instruction, creation/deletion and the disk creation/deletion instruction pair received The network disk answered；Loading unit 602 is configured in response to receive disk load instruction, above-mentioned disk is loaded and is instructed In the indicated network disk of disk to be loaded mark be loaded into the working node；Unloading unit 603, is configured in response to Disk unloading command is received, is unloaded indicated by the mark of the disk to be unloaded in above-mentioned disk unloading command from the working node Network disk；First carry unit 604 is configured in response to receive disk mounting instructions, by above-mentioned disk mounting instructions In the network disk indicated to carry disk mark be mounted to the specified path of the working node；First de-linked unit 605, It is configured in response to receive the extension instruction of disk solution, the above-mentioned disk solution of the working node carry is hung into linked network to be solved in instruction The indicated network disk of network disk mark is hung from the specified path solution of the working node.
In the present embodiment, for provide creation/deletion unit 601 of the device 600 of container service, loading unit 602, Unloading unit 603, the specific processing of the first carry unit 604 and the first de-linked unit 605 and its brought technical effect can Step 401, step 402, step 403, the related description of step 404 and step 405 in Fig. 4 corresponding embodiment are referred to respectively, This is repeated no more.
In some optional implementations of the present embodiment, above-mentioned management server cluster may include api-server Component, working node may include Kubelet component, external-attacher component, external-provisioner group Part, provisioner-controller component and memory card, above-mentioned memory card are the container volume for operating in working node Container in heat-extraction system.
Above-mentioned creation/deletion unit 601 can be further configured to: in response to receiving magnetic using above-mentioned memory card Disk creation/deletion instruction, utilizes above-mentioned memory card creation/deletion net corresponding with the disk creation/deletion instruction received Network disk；And above-mentioned loading unit 602 can be further configured to: in response to receiving disk using above-mentioned memory card Disk to be loaded in the load instruction of above-mentioned disk is identified indicated network disk using above-mentioned memory card by load instruction It is loaded into the working node.
In some optional implementations of the present embodiment, above-mentioned unloading unit 603 can be further configured to: be rung Ying Yu receives disk unloading command using above-mentioned memory card, unloads above-mentioned magnetic from the working node using above-mentioned memory card Network disk indicated by disk to be unloaded mark in disk unloading command；And above-mentioned carry unit 604 can further by It is configured to: in response to receiving disk mounting instructions using above-mentioned memory card, being hung above-mentioned disk using above-mentioned memory card Carry the specified path that the network disk indicated to carry disk mark in instruction is mounted to the working node.
In some optional implementations of the present embodiment, above-mentioned de-linked unit 604 can be further configured to: be rung Ying Yu receives disk solution using above-mentioned memory card and hangs instruction, using above-mentioned memory card by the above-mentioned of the working node carry Disk solution is hung the network disk that suspended network disk mark to be solved is indicated in instruction and is hung from the specified path solution of the working node.
In some optional implementations of the present embodiment, above-mentioned apparatus 600 can also include: plug-in registration unit 606, it is configured in response to receive plug-in registration instruction, above-mentioned plug-in registration instruction includes plug-in unit to be registered, plug-in unit mark And plug-in version, above-mentioned plug-in unit to be registered is registered according to above-mentioned plug-in unit mark and above-mentioned plug-in version using above-mentioned memory card To the api-server component of above-mentioned management server cluster.
In some optional implementations of the present embodiment, above-mentioned apparatus 600 can also include: container creating unit 607, it is configured in response to receive the container creation instruction of above-mentioned management server collection pocket transmission, creation and the appearance received Device creation instructs corresponding container；And the second carry unit 608, it is configured in response to utilize above-mentioned working node Provisioner-controller component listen to above-mentioned management server collection pocket transmission lasting volume creation instruction, generate with The lasting volume creation received instructs corresponding disk creation instruction, disk load instruction and disk mounting instructions, utilizes the work The external-attacher component for making node, calling above-mentioned memory card to execute, disk creation generated instructs, disk adds Instruction and disk mounting instructions are carried, with the corresponding network disk of disk creation instruction for creating with receiving, and will be created Network disk loads and is mounted to the working node.
In some optional implementations of the present embodiment, above-mentioned apparatus 600 can also include: that container deletes unit 609, the container for being configured in response to receive above-mentioned management server collection pocket transmission deletes instruction, the appearance deleted and received Device, which is deleted, instructs corresponding container；And second de-linked unit 610, it is configured in response to utilize the working node Provisioner-controller component listen to above-mentioned management server collection pocket transmission lasting volume delete instruction, generate with The lasting volume received, which is deleted, instructs corresponding disk solution to hang instruction and disk unloading command, utilizes the working node External-attacher component calls above-mentioned memory card to execute disk solution generated and hangs instruction and disk unloading command, To hang and unload network disk corresponding with the lasting volume deletion instruction received from the working node solution；It is deleted in response to determination Except network disk corresponding with the lasting volume deletion instruction received, magnetic corresponding with the lasting volume deletion instruction received is generated Disk deletes instruction, using the external-attacher component of the working node, calls above-mentioned memory card to execute generated Disk deletes instruction, with deletion network disk corresponding with the lasting volume deletion instruction received.
It should be noted that the realization of each unit is thin in the device provided by the embodiments of the present application for providing container service Section and technical effect can be with reference to the explanations of other embodiments in the application, and details are not described herein.
Below with reference to Fig. 7, it illustrates the computer systems 700 for the electronic equipment for being suitable for being used to realize the embodiment of the present application Structural schematic diagram.Electronic equipment shown in Fig. 7 is only an example, function to the embodiment of the present application and should not use model Shroud carrys out any restrictions.
As shown in fig. 7, computer system 700 includes central processing unit (CPU, Central Processing Unit) 701, it can be according to the program being stored in read-only memory (ROM, Read Only Memory) 702 or from storage section 708 programs being loaded into random access storage device (RAM, Random Access Memory) 703 and execute various appropriate Movement and processing.In RAM 703, also it is stored with system 700 and operates required various programs and data.CPU 701,ROM 702 and RAM 703 is connected with each other by bus 704.Input/output (I/O, Input/Output) interface 705 is also connected to Bus 704.
I/O interface 705 is connected to lower component: the importation 706 including keyboard, mouse etc.；It is penetrated including such as cathode Spool (CRT, Cathode Ray Tube), liquid crystal display (LCD, Liquid Crystal Display) etc. and loudspeaker Deng output par, c 707；Storage section 708 including hard disk etc.；And including such as LAN (local area network, Local Area Network) the communications portion 709 of the network interface card of card, modem etc..Communications portion 709 is via such as internet Network executes communication process.Driver 710 is also connected to I/O interface 705 as needed.Detachable media 711, such as disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 710, in order to from the calculating read thereon Machine program is mounted into storage section 708 as needed.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes the program code for method shown in execution flow chart.In such reality It applies in example, which can be downloaded and installed from network by communications portion 709, and/or from detachable media 711 are mounted.When the computer program is executed by central processing unit (CPU) 701, limited in execution the present processes Above-mentioned function.It should be noted that computer-readable medium described herein can be computer-readable signal media or Computer readable storage medium either the two any combination.Computer readable storage medium for example can be --- but Be not limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination. The more specific example of computer readable storage medium can include but is not limited to: have one or more conducting wires electrical connection, Portable computer diskette, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only deposit Reservoir (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory Part or above-mentioned any appropriate combination.In this application, computer readable storage medium, which can be, any include or stores The tangible medium of program, the program can be commanded execution system, device or device use or in connection.And In the application, computer-readable signal media may include in a base band or the data as the propagation of carrier wave a part are believed Number, wherein carrying computer-readable program code.The data-signal of this propagation can take various forms, including but not It is limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer Any computer-readable medium other than readable storage medium storing program for executing, the computer-readable medium can send, propagate or transmit use In by the use of instruction execution system, device or device or program in connection.Include on computer-readable medium Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc., Huo Zheshang Any appropriate combination stated.
The calculating of the operation for executing the application can be write with one or more programming languages or combinations thereof Machine program code, described program design language include object oriented program language-such as Java, Smalltalk, C+ +, it further include conventional procedural programming language-such as " C " language or similar programming language.Program code can Fully to execute, partly execute on the user computer on the user computer, be executed as an independent software package, Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part. In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN) Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet service Provider is connected by internet).
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the application, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction Combination realize.
Being described in unit involved in the embodiment of the present application can be realized by way of software, can also be by hard The mode of part is realized.Described unit also can be set in the processor, for example, can be described as: a kind of processor packet Include creation/deletion unit, loading unit, unloading unit, the first carry unit and the first de-linked unit.Wherein, these units Title does not constitute the restriction to the unit itself under certain conditions, for example, carry unit is also described as " for hanging Carry the unit of network disk ".
As on the other hand, present invention also provides a kind of computer-readable medium, which be can be Included in device described in above-described embodiment；It is also possible to individualism, and without in the supplying device.Above-mentioned calculating Machine readable medium carries one or more program, when said one or multiple programs are executed by the device, so that should Device: it is instructed in response to receiving disk creation/deletion, creation/deletion is corresponding with the disk creation/deletion instruction received Network disk；In response to receiving disk load instruction, by the indicated net of the disk to be loaded mark in disk load instruction Network disk is loaded into the working node；In response to receiving disk unloading command, disk unloading command is unloaded from the working node In the indicated network disk of disk to be unloaded mark；It, will be in disk mounting instructions in response to receiving disk mounting instructions The network disk indicated to carry disk mark be mounted to the specified path of the working node；In response to receiving disk solution Hang instruction, by the disk solution of the working node carry hang suspended network disk mark to be solved is indicated in instruction network disk from this The specified path solution of working node is hung.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.Those skilled in the art Member is it should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from foregoing invention design, it is carried out by above-mentioned technical characteristic or its equivalent feature Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed herein Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (26)

1. a kind of for providing the system of container service, including management server cluster and at least one working node, wherein work It is configured to as node:
In response to receiving disk creation/deletion instruction, creation/deletion is corresponding with the disk creation/deletion instruction received Network disk；
In response to receiving disk load instruction, by the indicated network of the disk to be loaded mark in disk load instruction Disk is loaded into the working node；
In response to receiving disk unloading command, the disk mark to be unloaded in the disk unloading command is unloaded from the working node Know indicated network disk；
In response to receiving disk mounting instructions, by the network indicated to carry disk mark in the disk mounting instructions Disk is mounted to the specified path of the working node；
Instruction is hung in response to receiving disk solution, the disk solution of the working node carry is hung into suspended network magnetic to be solved in instruction Network disk indicated by disc identifier is hung from the specified path solution of the working node.
2. system according to claim 1, wherein the management server cluster includes api-server component, work Node include Kubelet component, external-attacher component, external-provisioner component, Provisioner-controller component and memory card, the memory card are the container layout system for operating in working node Container in system.
3. system according to claim 2, wherein the working node be configured in response to receive disk creation/ Delete instruction, creation/deletion network disk corresponding with the disk creation/deletion instruction received, comprising:
The working node is configured to: being instructed in response to receiving disk creation/deletion using the memory card, is utilized institute Network disk corresponding with the disk creation/deletion instruction received of stating memory card creation/deletion；And
The working node is configured to:, will be to be added in disk load instruction in response to receiving disk load instruction It carries the indicated network disk of disk mark and is loaded into the working node, comprising:
The working node is configured to: in response to receiving disk load instruction using the memory card, being deposited using described The indicated network disk of disk to be loaded mark in disk load instruction is loaded into the working node by storage plug-in unit.
4. system according to claim 3, wherein the working node is configured to: in response to receiving disk unloading Instruction unloads the indicated network disk of the mark of the disk to be unloaded in the disk unloading command from the working node, comprising:
The working node is configured to: in response to receiving disk unloading command using the memory card, being deposited using described Storage plug-in unit unloads the indicated network disk of the mark of the disk to be unloaded in the disk unloading command from the working node；And
The working node is configured to: in response to receiving disk mounting instructions, by the disk mounting instructions wait hang Carry the specified path that the indicated network disk of disk mark is mounted to the working node, comprising:
The working node is configured to: in response to receiving disk mounting instructions using the memory card, being deposited using described The network disk indicated to carry disk mark in the disk mounting instructions is mounted to the working node by storage plug-in unit Specified path.
5. system according to claim 4, wherein the working node is configured to: being hung in response to receiving disk solution Instruction, by the disk solution of the working node carry hang suspended network disk mark to be solved is indicated in instruction network disk from The specified path solution of the working node is hung, comprising:
The working node is configured to: being hung instruction in response to receiving disk solution using the memory card, is deposited using described It stores up plug-in unit and the disk solution of the working node carry is hung into the network disk that suspended network disk mark to be solved is indicated in instruction It is hung from the specified path solution of the working node.
6. system according to claim 5, wherein the working node is further configured to:
In response to receiving plug-in registration instruction, the plug-in registration instruction includes plug-in unit to be registered, plug-in unit mark and plug-in unit version This, is registered to the pipe according to plug-in unit mark and the plug-in version for the plug-in unit to be registered using the memory card Manage the api-server component of server cluster.
7. system according to claim 6, in which:
The management server cluster is configured to:
In response to receiving container creation instruction, it is determined whether there is lasting volume corresponding with the container creation instruction received； It is not present in response to determination, is determined at least one described working node and create instruction corresponding first with the container received Target operation node, and generate lasting volume creation corresponding with the container creation instruction received and instruct；To first mesh It marks working node and sends received container creation instruction and lasting volume creation instruction generated；And it is deposited in response to determination , by and the lasting volume of container creation instructions match that is received be determined as it is corresponding with the container creation instruction received lasting Volume, the working node where instructing corresponding lasting volume to the container creation received send received container creation instruction；
Working node is further configured to:
Container in response to receiving the management server collection pocket transmission creates instruction, creates and refers to the container creation received Enable corresponding container；And
The management server cluster is listened in response to the provisioner-controller component using the working node The lasting volume sent creates instruction, generates disk creation instruction corresponding with the lasting volume creation instruction received, disk loads Instruction and disk mounting instructions call the memory card to execute using the external-attacher component of the working node Disk creation instruction, disk load instruction and disk mounting instructions generated, with the disk creation instruction pair for creating and receiving The network disk answered, and the network disk created is loaded and is mounted to the working node.
8. system according to claim 7, in which:
The management server cluster is configured to:
Instruction is deleted in response to receiving container, determines that received container deletes second where the container to be deleted in instruction Target operation node, and generate lasting volume corresponding with container deletion instruction and delete instruction；The container received is deleted Instruction, which is deleted, except instruction and lasting volume generated is sent to the second target operation node；And
Working node is further configured to:
Container in response to receiving the management server collection pocket transmission deletes instruction, deletes and refers to the container deletion received Enable corresponding container；And
The management server cluster is listened in response to the provisioner-controller component using the working node The lasting volume sent deletes instruction, and generation disk solution corresponding with the lasting volume deletion instruction received hangs instruction and disk unloads Instruction calls the memory card to execute disk solution generated using the external-attacher component of the working node Instruction and disk unloading command are hung, it will be with the lasting volume corresponding network disk of deletion instruction that is received from the working node solution It hangs and unloads；Network disk corresponding with the lasting volume deletion instruction received is deleted in response to determining, generates and is received Persistently volume, which is deleted, instructs corresponding disk to delete instruction, using the external-attacher component of the working node, calls institute It states memory card and executes disk deletion instruction generated, with deletion network magnetic corresponding with the lasting volume deletion instruction received Disk.
9. a kind of for providing the method for container service, applied to the working node in the system for providing container service, In, the system for providing container service includes management server cluster and at least one working node, the method packet It includes:
In response to receiving disk creation/deletion instruction, creation/deletion is corresponding with the disk creation/deletion instruction received Network disk；
In response to receiving disk load instruction, by the indicated network of the disk to be loaded mark in disk load instruction Disk is loaded into the working node；
In response to receiving disk unloading command, the disk mark to be unloaded in the disk unloading command is unloaded from the working node Know indicated network disk；
In response to receiving disk mounting instructions, by the network indicated to carry disk mark in the disk mounting instructions Disk is mounted to the specified path of the working node；
Instruction is hung in response to receiving disk solution, the disk solution of the working node carry is hung into suspended network magnetic to be solved in instruction Network disk indicated by disc identifier is hung from the specified path solution of the working node.
10. working according to the method described in claim 9, wherein, the management server cluster includes api-server component Node include Kubelet component, external-attacher component, external-provisioner component, Provisioner-controller component and memory card, the memory card are the container layout system for operating in working node Container in system.
11. it is described to be instructed in response to receiving disk creation/deletion according to the method described in claim 10, wherein, creation/ Delete network disk corresponding with the disk creation/deletion instruction received, comprising:
Instructed in response to receiving disk creation/deletion using the memory card, using the memory card creation/deletion with The disk creation received/deletion instructs corresponding network disk；And
It is described to be instructed in response to receiving disk load, the disk to be loaded mark in disk load instruction is indicated Network disk is loaded into the working node, comprising:
In response to receiving disk load instruction using the memory card, disk load is referred to using the memory card Network disk indicated by disk to be loaded mark in order is loaded into the working node.
12. according to the method for claim 11, wherein it is described in response to receiving disk unloading command, from the work section Point unloads the indicated network disk of the disk to be unloaded mark in the disk unloading command, comprising:
In response to receiving disk unloading command using the memory card, unloaded using the memory card from the working node Network disk indicated by disk to be unloaded mark in the disk unloading command；And
It is described in response to receiving disk mounting instructions, will be indicated to carry disk mark in the disk mounting instructions Network disk is mounted to the specified path of the working node, comprising:
In response to receiving disk mounting instructions using the memory card, the disk carry is referred to using the memory card The network disk indicated to carry disk mark in order is mounted to the specified path of the working node.
13. according to the method for claim 12, wherein it is described to hang instruction in response to receiving disk solution, by the work section Finger of the indicated network disk of suspended network disk mark to be solved from the working node in the disk solution extension instruction of point carry Determine path solution to hang, comprising:
Instruction is hung in response to receiving disk solution using the memory card, using the memory card by the working node carry The disk solution hang the specified path of suspended network disk to be solved mark is indicated in instruction network disk from the working node Solution is hung.
14. according to the method for claim 13, wherein the method also includes:
In response to receiving plug-in registration instruction, the plug-in registration instruction includes plug-in unit to be registered, plug-in unit mark and plug-in unit version This, is registered to the pipe according to plug-in unit mark and the plug-in version for the plug-in unit to be registered using the memory card Manage the api-server component of server cluster.
15. according to the method for claim 14, wherein the method also includes:
Container in response to receiving the management server collection pocket transmission creates instruction, creates and refers to the container creation received Enable corresponding container；And
The management server collection is listened in response to the provisioner-controller component using the working node The lasting volume of pocket transmission creates instruction, generates disk creation instruction corresponding with the lasting volume creation instruction received, disk adds It carries instruction and disk mounting instructions and calls the memory card to hold using the external-attacher component of the working node Row disk creation instruction generated, disk load instruction and disk mounting instructions, with the disk creation instruction for creating and receiving Corresponding network disk, and the network disk created is loaded and is mounted to the working node.
16. according to the method for claim 15, wherein the method also includes:
Container in response to receiving the management server collection pocket transmission deletes instruction, deletes and refers to the container deletion received Enable corresponding container；And
The management server cluster is listened in response to the provisioner-controller component using the working node The lasting volume sent deletes instruction, and generation disk solution corresponding with the lasting volume deletion instruction received hangs instruction and disk unloads Instruction calls the memory card to execute disk solution generated using the external-attacher component of the working node Instruction and disk unloading command are hung, it will be with the lasting volume corresponding network disk of deletion instruction that is received from the working node solution It hangs and unloads；Network disk corresponding with the lasting volume deletion instruction received is deleted in response to determining, generates and is received Persistently volume, which is deleted, instructs corresponding disk to delete instruction, using the external-attacher component of the working node, calls institute It states memory card and executes disk deletion instruction generated, with deletion network magnetic corresponding with the lasting volume deletion instruction received Disk.
17. a kind of for providing the device of container service, applied to the working node in the system for providing container service, In, the system for providing container service includes management server cluster and at least one working node, described device packet It includes:
Creation/deletion unit is configured in response to receive disk creation/deletion instruction, creation/deletion and magnetic received Disk creation/deletion instructs corresponding network disk；
Loading unit is configured in response to receive disk load instruction, by the magnetic to be loaded in disk load instruction Network disk indicated by disc identifier is loaded into the working node；
Unloading unit is configured in response to receive disk unloading command, unloads the disk unloading from the working node and refers to Network disk indicated by disk to be unloaded mark in order；
First carry unit is configured in response to receive disk mounting instructions, by the disk mounting instructions wait hang Carry the specified path that the indicated network disk of disk mark is mounted to the working node；
First de-linked unit is configured in response to receive the extension instruction of disk solution, by the disk of the working node carry Solution is hung the network disk that suspended network disk mark to be solved is indicated in instruction and is hung from the specified path solution of the working node.
18. device according to claim 17, wherein the management server cluster includes api-server component, work As node include Kubelet component, external-attacher component, external-provisioner component, Provisioner-controller component and memory card, the memory card are the container layout system for operating in working node Container in system.
19. device according to claim 18, wherein the creation/deletion unit is further configured to:
Instructed in response to receiving disk creation/deletion using the memory card, using the memory card creation/deletion with The disk creation received/deletion instructs corresponding network disk；And
The loading unit is further configured to:
In response to receiving disk load instruction using the memory card, disk load is referred to using the memory card Network disk indicated by disk to be loaded mark in order is loaded into the working node.
20. device according to claim 19, wherein the unloading unit is further configured to:
In response to receiving disk unloading command using the memory card, unloaded using the memory card from the working node Network disk indicated by disk to be unloaded mark in the disk unloading command；And
The carry unit is further configured to:
In response to receiving disk mounting instructions using the memory card, the disk carry is referred to using the memory card The network disk indicated to carry disk mark in order is mounted to the specified path of the working node.
21. device according to claim 20, wherein the de-linked unit is further configured to:
Instruction is hung in response to receiving disk solution using the memory card, using the memory card by the working node carry The disk solution hang the specified path of suspended network disk to be solved mark is indicated in instruction network disk from the working node Solution is hung.
22. device according to claim 21, wherein described device further include:
Plug-in registration unit is configured in response to receive plug-in registration instruction, and the plug-in registration instruction includes to be registered Plug-in unit, plug-in unit mark and plug-in version are identified the plug-in unit to be registered and institute using the memory card according to the plug-in unit State the api-server component that plug-in version is registered to the management server cluster.
23. device according to claim 22, wherein described device further include:
Container creating unit is configured in response to receive the container creation instruction of the management server collection pocket transmission, wound Build container corresponding with the container creation instruction received；And
Second carry unit is configured in response to supervise using the provisioner-controller component of the working node The lasting volume creation instruction for hearing the management server collection pocket transmission, generates corresponding with the lasting volume creation instruction received Disk creation instruction, disk load instruction and disk mounting instructions, utilize the external-attacher group of the working node Part calls the memory card to execute disk creation instruction, disk load instruction and disk mounting instructions generated, with creation Network disk corresponding with the disk creation instruction received, and the network disk created is loaded and is mounted to the work Node.
24. device according to claim 23, wherein described device further include:
Container deletes unit, and the container for being configured in response to receive the management server collection pocket transmission deletes instruction, deletes Except container corresponding with the container deletion instruction received；And
Second de-linked unit is configured in response to monitor using the provisioner-controller component of the working node Lasting volume to the management server collection pocket transmission deletes instruction, generates magnetic corresponding with the lasting volume deletion instruction received Disk solution hangs instruction and disk unloading command, using the external-attacher component of the working node, the storage is called to insert Part executes disk solution generated and hangs instruction and disk unloading command, will net corresponding with the lasting volume deletion instruction received Network disk is hung and is unloaded from the working node solution；Network corresponding with the lasting volume deletion instruction received is deleted in response to determining Disk generates disk corresponding with the lasting volume deletion instruction received and deletes instruction, utilizes the external- of the working node Attacher component calls the memory card to execute disk generated and deletes instruction, with the lasting volume deleted with received It deletes and instructs corresponding network disk.
25. a kind of electronic equipment, comprising:
One or more processors；
Storage device is stored thereon with one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors Realize such as method described in any one of claims 1-8.
26. a kind of computer readable storage medium, is stored thereon with computer program, wherein the computer program is by one Or multiple processors realize such as method described in any one of claims 1-8 when executing.
CN201811574613.0A 2018-12-21 2018-12-21 System, method and apparatus for providing container services Active CN109669637B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811574613.0A CN109669637B (en) 2018-12-21 2018-12-21 System, method and apparatus for providing container services

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811574613.0A CN109669637B (en) 2018-12-21 2018-12-21 System, method and apparatus for providing container services

Publications (2)

Publication Number Publication Date
CN109669637A true CN109669637A (en) 2019-04-23
CN109669637B CN109669637B (en) 2022-09-16

Family

ID=66147064

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811574613.0A Active CN109669637B (en) 2018-12-21 2018-12-21 System, method and apparatus for providing container services

Country Status (1)

Country Link
CN (1) CN109669637B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851082A (en) * 2019-11-08 2020-02-28 浪潮云信息技术有限公司 Container butt joint optical fiber network storage method
CN111722879A (en) * 2020-06-19 2020-09-29 浪潮电子信息产业股份有限公司 USB flash disk identification method, Linux system, Linux equipment and readable storage medium
CN111866206A (en) * 2020-06-24 2020-10-30 北京金山云网络技术有限公司 Distributed domain name resolution method, device and equipment
CN113672436A (en) * 2021-07-30 2021-11-19 济南浪潮数据技术有限公司 Disaster recovery backup method, device, equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106027643A (en) * 2016-05-18 2016-10-12 无锡华云数据技术服务有限公司 Resource scheduling method based on Kubernetes container cluster management system
CN106888254A (en) * 2017-01-20 2017-06-23 华南理工大学 A kind of exchange method between container cloud framework based on Kubernetes and its each module
CN108039975A (en) * 2017-12-21 2018-05-15 北京搜狐新媒体信息技术有限公司 Container cluster management system and its application process

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106027643A (en) * 2016-05-18 2016-10-12 无锡华云数据技术服务有限公司 Resource scheduling method based on Kubernetes container cluster management system
CN106888254A (en) * 2017-01-20 2017-06-23 华南理工大学 A kind of exchange method between container cloud framework based on Kubernetes and its each module
CN108039975A (en) * 2017-12-21 2018-05-15 北京搜狐新媒体信息技术有限公司 Container cluster management system and its application process

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈金光: "基于阿里云的Kubernetes容器云平台的设计与实现", 《万方数据库》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851082A (en) * 2019-11-08 2020-02-28 浪潮云信息技术有限公司 Container butt joint optical fiber network storage method
CN110851082B (en) * 2019-11-08 2023-09-19 浪潮云信息技术股份公司 Method for storing container butt-jointed optical fiber network
CN111722879A (en) * 2020-06-19 2020-09-29 浪潮电子信息产业股份有限公司 USB flash disk identification method, Linux system, Linux equipment and readable storage medium
CN111866206A (en) * 2020-06-24 2020-10-30 北京金山云网络技术有限公司 Distributed domain name resolution method, device and equipment
CN113672436A (en) * 2021-07-30 2021-11-19 济南浪潮数据技术有限公司 Disaster recovery backup method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN109669637B (en) 2022-09-16

Similar Documents

Publication Publication Date Title
CN109669637A (en) For providing system, the method and apparatus of container service
CN110881007B (en) Container cluster network access method and device
CN110417842A (en) Fault handling method and device for gateway server
CN109936635A (en) Load-balancing method and device
CN110019080A (en) Data access method and device
CN112035216B (en) Communication method for Kubernetes cluster network and OpenStack network
CN109558246A (en) A kind of load-balancing method, device, electronic equipment and storage medium
CN108962244A (en) Method and apparatus for sending information
CN113709810B (en) Method, equipment and medium for configuring network service quality
CN107247629A (en) Cloud computing system and cloud computing method and device for controlling server
CN110391938A (en) Method and apparatus for deployment services
CN112988394A (en) Business service publishing method, device, medium and equipment based on cloud native container
CN110221877A (en) A kind of operation method of application program, device, electronic equipment and storage medium
CN109918381A (en) Method and apparatus for storing data
CN109683992A (en) Method and apparatus for managing object
CN116489024A (en) Method, device, equipment and medium for improving application performance of K8S cluster container
CN113595887B (en) Flow control method and device in mail system
CN109783409A (en) Method and apparatus for handling data
CN108696557A (en) Information processing system, method and apparatus
CN109660573A (en) Data transmission method and device
CN113760487B (en) Service processing method and device
CN113556370A (en) Service calling method and device
CN109542646A (en) Method and apparatus for calling application programming interface
CN107885461B (en) Data local storage method and device
CN113805879A (en) Application program running method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant