CN105760214B - A kind of equipment state and resource information monitoring method, relevant device and system - Google Patents
A kind of equipment state and resource information monitoring method, relevant device and system Download PDFInfo
- Publication number
- CN105760214B CN105760214B CN201610243244.1A CN201610243244A CN105760214B CN 105760214 B CN105760214 B CN 105760214B CN 201610243244 A CN201610243244 A CN 201610243244A CN 105760214 B CN105760214 B CN 105760214B
- Authority
- CN
- China
- Prior art keywords
- container
- virtual machine
- monitoring
- vnf
- nfvi
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Debugging And Monitoring (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Computer And Data Communications (AREA)
Abstract
The embodiment of the invention discloses a kind of equipment state and resource information monitoring methods, this method comprises: network function virtualized infrastructure NFVI receives the subscription message that virtual network function VNF is sent；NFVI reports the virtual machine of deployment VNF or the equipment state and monitoring resource information of container by network function virtualized infrastructure interface according to message is subscribed to VNF.Using the embodiment of the present invention, it can be for the multiple virtual machines or container of deployment VNF, the unified equipment state and resource information that virtual machine or container are monitored using NFVI, it avoids each virtual machine or container from having caused by the equipment state and monitoring resource mechanism of oneself to repeat monitoring, to reduce the monitoring resource expense of network function virtualization system.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of equipment states and resource information monitoring method, correlation
Equipment and system.
Background technique
Traditional telecommunication system is set by various dedicated hardware device compositions, different applications using different hardware
It is standby.With the growth of network size, system becomes increasingly complex, and brings many challenges, the exploitation including Added Business is online,
O&M, resource utilization of system etc..In order to cope with these challenges and utilize the virtualization technology and cloud computing technology of IT industry circle,
In " SDN and OpenFlow World Congress " meeting that on October 22nd, 2012 holds, main 13 of the whole world
Telecom operators, which combine, has issued NFV white paper, and announces to set up NFV ISG in ETSI, formulates the demand and technology frame of NFV
Frame pushes the development of NFV.
Network function virtualization (Network Function Virtualization, NFV) technology can simply understand
For the function of each network element used in telecommunication network is produced from current specialized hardware platform migration to general commercial shelf
On product (COTS, Commercial-off-the-shelf) server.By NFV technology by each net used in telecommunication network
Member is transformed into independent application, can be with flexible deployment in other equipment such as measured server, storage and interchangers
On the unified Infrastructure platform of building, and by virtualization technology, to infra structure hardware facility resource pool and virtualization,
Virtual resource is provided to upper layer application, for example, virtual network function (Virtual Network Function, VNF) is disposed
Into virtual machine or container, realizes application and the decoupling between hardware, answered so that virtual resource feed speed greatly increases realization
With the decoupling of, hardware, so that each application can quickly increase virtual resource to realize the purpose of Quick Extended power system capacity.So
And found in practice, each virtual machine or container have the equipment state and monitoring resource module of oneself, if on a server
Dispose thousands of a virtual machines or container, it will there are thousands of a monitoring resource modules, cause resource overhead excessive.
Summary of the invention
The embodiment of the invention discloses a kind of equipment state and resource information monitoring methods, relevant device and system, can
Removal repeats monitoring, and reduces monitoring resource expense.
The embodiment of the invention discloses a kind of equipment state and resource information monitoring methods, this method comprises: network function
Virtualized infrastructure NFVI receives the subscription message that virtual network function VNF is sent；Wherein, the subscription message is for obtaining
The virtual machine of the deployment VNF creation of NFVI monitoring or the equipment state and monitoring resource information of container；Virtual machine or container are set
Standby state includes distributing to the state of the physical processor of virtual machine or container, physical memory, network interface card and disk；Virtual machine or appearance
The monitoring resource information of device includes distributing to the utilization of the physical processor of virtual machine or container, physical memory, network interface card and disk
Rate；The virtual machine that NFVI reports deployment VNF to create by network function virtualized infrastructure interface according to message is subscribed to VNF
Or the equipment state and monitoring resource information of container.Using the embodiment of the present invention, the multiple void that can be created for deployment VNF
Quasi- device or container, the unified equipment state and monitoring resource information that virtual machine or container are monitored using NFVI, avoid each void
Quasi- machine or container have to be repeated monitoring caused by the equipment state and monitoring resource mechanism of oneself, thus, reduce network function
The monitoring resource expense of virtualization system.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to needed in the embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is the system architecture diagram of network function virtualization NFV disclosed by the embodiments of the present invention a kind of；
Fig. 2 is the flow diagram of a kind of equipment state and resource information monitoring method disclosed by the embodiments of the present invention；
Fig. 3 is a kind of structural schematic diagram of network function virtualized infrastructure disclosed by the embodiments of the present invention；
Fig. 4 is a kind of configuration diagram of equipment state and resource information monitoring system disclosed by the embodiments of the present invention；
Fig. 5 is another structural schematic diagram of network function virtualized infrastructure disclosed by the embodiments of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that the described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on this
Embodiment in invention, every other reality obtained by those of ordinary skill in the art without making creative efforts
Example is applied, shall fall within the protection scope of the present invention.
Embodiment in order to better understand the present invention first virtualizes NFV to the network function of the embodiment of the present invention below
The system architecture diagram of (Network Function Virtualization, network function virtualization, abbreviation NFV) is described.
As shown in Figure 1, Fig. 1 is the architecture diagram of NFV system, NFV system 100 can use in a variety of different network environments, such as:
One data center network, carrier network or local area network are realized.NFV system 100 includes a network function virtualization pipe
Reason and arranging system (NFV-Management and Orchestration, NFV-MANO) 101, network function virtualization basis
It is facility (NFV Infrastructure, NFVI) 130, multiple NE managements (Element Management, EM) 122, multiple
Virtual network function (Virtual Network Function, VNF) 108, network service, VNF and infrastructure describe 126
(Network Service, VNF and Infrastructure Description) and Operation Support System/business support
System (Operation-Support System/Business Support System, OSS/BSS) 124.Wherein, network function
Can virtualize layout and management system 101 include network function virtualization composer (NFV Orchestrator, NFVO) 102,
One or more virtual network function managers (VNF Manager, VNFM) 104 and virtualized infrastructure manager
(Virtualized Infrastructure Manager, VIM) 106.Network function virtualized infrastructure 130 includes hardware
Resource layer, virtualization layer and virtual resource layer, hardware resource layer include computing hardware 112, storage hardware 114 and the network hardware
116, virtual resource layer includes virtual computing 110, virtual memory 118 and virtual network 120.Network service, VNF and infrastructure
Description 126 and Operation Support System/business support system 124 have further in ETSI GS NFV 002V1.1.1 standard
It discusses.
NFV management and arranging system 101 are for executing to virtual network function 108 and network function virtualized infrastructure
130 monitoring and management.Network function virtualization composer 102 may be implemented on network function virtualized infrastructure 130
Network service (such as L2 and L3VPN service), the money from one or more virtual network function managers 104 can also be executed
Source association requests send configuration information to virtual network function manager 104, and collect the state letter of virtual network function 108
Breath.In addition, network function virtualization composer 102 can be communicated with Virtual base infrastructure manager 106, to realize point of resource
Match and/or reserve and exchange the configuration and status information of virtualization hardware resource.Virtual network function manager 104 can manage
Manage one or more virtual network functions 108.Virtual network function manager 104 can execute various management functions, such as in fact
Exampleization, update, inquiry, scaling and/or termination virtual network function 108 etc..Virtual base infrastructure manager 106 can execute money
The function of source control, such as the distribution (such as increasing resource to container) and operating function (such as collection of management infrastructure resource
Network function virtualized infrastructure fault message).Virtual network function manager 104 and Virtual base infrastructure manager 106
The configuration and status information for carrying out resource allocation and exchanging virtualization hardware resource can be in communication with each other.
Network function virtualized infrastructure 130 includes that the combination of hardware resource, software resource or both is virtual to complete
Change the deployment of environment.In other words, hardware resource and virtualization layer are used to provide the resource of virtualization, for example, as virtual machine with
The container of other forms, for installing virtual network function 108.Hardware resource includes computing hardware 112,114 and of storage hardware
The network hardware 116.Computing hardware 112 can be ready-made in the market hardware and/or customized hardware, for providing processing
And computing resource.Storage hardware 114 can be the memory capacity provided in network or the storage for residing in storage hardware 114 itself
Capacity (local storage in server).In one possible implementation, computing hardware 112 and storage hardware
114 can be brought together.The network hardware 116 can be interchanger, router and/or be configured to have appointing for function of exchange
What his network equipment.The network hardware 116 can be across multiple domains, and may include multiple by one or more transmission
The network of network interconnection.
The virtualization layer of network function virtualized infrastructure 130 can be abstracted hardware resource from physical layer and decoupling is virtual
Network function 108, to provide virtualization resource to virtual network function 108.Virtual resource layer includes virtual computing 110, void
Quasi- storage 118 and virtual network 120.Virtual computing 110 and virtual memory 118 can be with the shapes of virtual machine and/or other containers
Formula is supplied to virtual network function 108.Such as: one or more virtual network function 108 can be deployed in a void
On quasi- machine (Virtual Machine).Virtualization layer abstract network hardware 116 forms virtual network 120, and virtual network 120 can
To include virtual switch (Virtual Switch), virtual switch is used to provide the connection between virtual machine.In addition, network
Transmission network in hardware 116 can use centerized fusion plane and an individual Forwarding plane (such as software defined network
Network, SDN) virtualization.
Come as shown in Figure 1, virtual network function manager 104 can be interacted with virtual network function 108 and NE management 122
The life cycle of virtual network function 108 is managed and is exchanged configuration and status information.Virtual network function 108 can be with
It is configured as the virtualization of at least one network function executed by a physical network device.For example, a realization side
In case, virtual network function 108 can provide IMS (IP Multimedia Subsystem, IP multimedia by configuration
System, abbreviation IMS) function that has of the different network elements in network, such as P-CSCF (Proxy-Call Session Control
Funtion, Proxy Call Session Control Function, abbreviation P-CSCF), S-CSCF (Serving-Call Session Control
Funtion, service call conversation control function, abbreviation PSCSCF)) or HSS (Home Subscriber Server, ownership label
About client server, abbreviation HSS) network function etc..NE management 122 is by configuration to one or more virtual
Network function 108 is managed.
In existing NFV system, virtual network function 108 can be deployed in container or virtual machine, to realize to void
The monitoring of the equipment state and resource information of quasi- machine or container, each virtual machine or container have oneself independent equipment state and
Monitoring resource module, if disposing thousands of a virtual machines or container on a server, it will have thousands of a equipment states and resource
Monitoring modular causes resource overhead excessive, results in waste of resources.
Referring to Fig. 2, Fig. 2 is the process of a kind of equipment state and resource information monitoring method disclosed by the embodiments of the present invention
Schematic diagram the described method comprises the following steps in embodiments of the present invention:
S201, network function virtualized infrastructure NFVI receive the subscription message that virtual network function VNF is sent.
Specifically, VNF is deployed in virtual machine or container, VNF needs to obtain the equipment state and money of virtual machine or container
It when the monitoring information of source, is sent to NFVI and subscribes to message, NFVI receives the subscription message that VNF is sent, and equipment state expression is distributed to
The hardware resource of virtual machine or container is normal condition or malfunction, and virtual machine or container are distributed in the expression of monitoring resource information
Hardware resource operating parameter, such as: utilization rate, idleness, packet loss, runing time or fault time etc..
S202, the NFVI pass through network function virtualized infrastructure interface to the VNF according to the subscription message
It reports and disposes the virtual machine of the VNF or the equipment state of container and monitoring resource information.
Specifically, the virtual machine of NFVI monitoring deployment VNF or the equipment state and monitoring resource information of container, for example,
Increase equipment state and monitoring resource module on Host OS where the physical server that NFVI is distributed on virtualization layer, if
Standby state and monitoring resource module are used to monitor the virtual machine of deployment VNF or the equipment state and monitoring resource information of container, when
When disposing multiple VNF, the virtual machine or container of multiple VNF shares an equipment state and monitoring resource module, NFVI and will monitor
To equipment state and monitoring resource information by network function virtualized infrastructure interface to being reported to VNF.
Optionally, the subscription that the network function virtualized infrastructure NFVI receives that virtual network function VNF is sent disappears
Before breath, the method also includes:
The NFVI receives the deployment request message for being used to create virtual machine or container that the VIM is sent；
The NFVI disposes the virtual machine or container of the VNF according to the deployment request message creation；
When the NFVI determines that the value of monitoring resource field in the deployment request message is true, in host operating system
Start the monitoring function of monitoring modular in Host OS, and the monitoring modular is presented to described in deployment in a manner of virtual unit
The virtual machine or container of VNF.
Specifically, increase in Host OS where the physical server that NFVI is distributed on virtualization layer equipment state and
Monitoring resource module, equipment state and monitoring resource module be used for detect dispose VNF virtual machine or container equipment state and
Monitoring resource information, when needing the monitoring function of starting device state and monitoring resource module, VIM sends deployment to NFVI and asks
Message is sought, deployment request message is used to create the virtual machine or container of installation VNF, disposes and carry monitoring resource word in request message
Section, monitoring resource field are data of enumeration type, indicate the equipment state and operation of distributing to the hardware resource of virtual machine or container
Parameter, NFVI is according to the virtual machine of deployment request message creation VNF or the monitoring mark of container and resolving resource monitoring field
The value of position, when NFVI determines that the value of the monitoring flag bit in monitoring resource field is true, such as: the value for monitoring flag bit is 1
When, it indicates the monitoring function for opening equipment state and monitoring resource module, when the value for monitoring flag bit is 0, indicates pass hull closure
The monitoring function of state and monitoring resource module, NFVI determine the monitoring function for needing to open equipment state and monitoring resource module
When, the monitoring that equipment state and monitoring resource module are opened in the Host OS where physical server is distributed on virtualization layer
Function, and equipment state and monitoring resource module are presented to the virtual machine or container for disposing VNF in a manner of virtual unit, at this time
Equipment state and monitoring resource module are a virtual unit for virtual machine or container, open equipment state and resource prison
After surveying the monitoring function of module, equipment state and monitoring resource module monitors are used to dispose the virtual machine of VNF or the equipment of container
State and monitoring resource information.
Optionally, the method also includes:
When the NFVI monitors that preset failure occur in the virtual machine for disposing the VNF or container, the NFVI is by institute
The fault message for stating preset failure is sent to virtual network infrastructure manager VIM, by the VIM according to the fault message
Handle the preset failure.
Specifically, preset failure can be can not network, disk read-write error, software can not unsuccessfully wait failures, NFVI prison
When measuring virtual machine or container preset failure occur, can by the corresponding fault code of preset failure and failure-description information,
In, the corresponding fault code of each type of failure, failure-description information indicates application program, the fortune of equipment to break down
Row parameter (CPU usage, disk remaining space, memory usage etc.) will include the event of fault code and failure-description information
Hinder information reporting to VIM, the fault message that VIM is reported according to NFVI carries out the hardware device that positioning is broken down.
Optionally, the virtual machine or container subscribed to message and be used to obtain the deployment VNF of NFVI monitoring
Equipment state and resource information；The equipment state of the virtual machine or container includes distributing to the physics of the virtual machine or container
At least one of processor, physical memory, network interface card and state of disk；The monitoring resource packet of the virtual machine or container
Include at least one of the utilization rate of the physical processor for distributing to the virtual machine or container, physical memory, network interface card and disk.
Specifically, equipment state indicates that the hardware resource for distributing to virtual machine or container is normal condition or malfunction,
Hardware resource includes at least one of physical processor, physical memory, network interface card machine disk；The expression of monitoring resource information is distributed to
The operating parameter of the hardware resource of virtual machine or container, such as: monitoring resource information includes physical processor, physical memory, net
At least one of card and the utilization rate of disk.
Optionally, the monitoring resource field include the virtual machine of enumeration type or the field of tankage state and piece
Lift the virtual machine of type or the field of container resource information；
The virtual machine of the enumeration type or the field of tankage state distribute to virtual machine or container for monitoring
The state of physical processor, physical memory, network interface card and disk；The virtual machine of the enumeration type or the word of container resource information
Section, for monitoring the physical processor of virtual machine or container, the utilization rate of physical memory, network interface card and disk.
Using the embodiment of the present invention, the multiple virtual machines or container that can be created for deployment VNF are unified to utilize NFVI
It monitors the equipment state and monitoring resource information of virtual machine or container, each virtual machine or container is avoided to have the equipment of oneself
It is repeated monitoring caused by state and monitoring resource mechanism, to reduce the monitoring resource expense of network function virtualization system.
Referring to Fig. 3, Fig. 3 is a kind of structural representation of network function virtualized infrastructure disclosed by the embodiments of the present invention
Figure, in embodiments of the present invention, network function virtualized infrastructure includes receiving module 301 and reporting module 302.
Receiving module 301, for receiving the subscription message of virtual network function VNF transmission.
Specifically, VNF is deployed in virtual machine or container, VNF needs to obtain the equipment state and money of virtual machine or container
It when the monitoring information of source, is sent to NFVI and subscribes to message, the receiving module 301 of NFVI receives the subscription message that VNF is sent.Equipment shape
State indicates that distributing to virtual machine or the hardware resource of container is normal condition or malfunction, and the expression of monitoring resource information is distributed to
The operating parameter of the hardware resource of virtual machine or container, such as: when operating parameter is including the use of rate, idleness, packet loss, operation
Between or fault time etc..
Reporting module 302, for passing through network function virtualized infrastructure interface to described according to the subscriptions message
VNF, which is reported, disposes the virtual machine of the VNF or the equipment state of container and monitoring resource information.
Specifically, reporting module 302 obtains the virtual machine of deployment VNF or the equipment state and monitoring resource information of container,
For example, increase equipment state and monitoring resource module on Host OS where the physical server distributed on virtualization layer, if
The equipment state and monitoring resource information of the virtual machine or container of standby state and monitoring resource module monitors deployment VNF, report mould
Block 302 obtains the equipment state and monitoring resource information that equipment state and monitoring resource module monitors arrive, and is reported to VNF.Wherein,
When disposing multiple VNF, the virtual machine or container of multiple VNF shares an equipment state and monitoring resource module, reporting module
302 equipment states that will acquire and monitoring resource information are by network function virtualized infrastructure interface to being reported to VNF.
Optionally, in some embodiments of the invention, the receiving module is also used to receiving virtual network function VNF
Before the subscription message of transmission, the deployment request message for being used to create virtual machine or container that the VIM is sent is received；
The NFVI further include:
Creation module, for disposing the virtual machine or container of the VNF according to the deployment request message creation；
Starting module, when for determining that the monitoring flag bit of monitoring resource field in the deployment request message is true,
The monitoring function of starting device state and monitoring resource module in host operating system Host OS；
The equipment state and monitoring resource module, for monitoring the equipment shape of the virtual machine or container of disposing the VNF
State and monitoring resource information；Wherein, the equipment state and monitoring resource module are presented to described in deployment in a manner of virtual unit
The virtual machine or container of VNF.
Specifically, increase in Host OS where the physical server that NFVI is distributed on virtualization layer equipment state and
Monitoring resource module, equipment state and monitoring resource module be used for detect dispose VNF virtual machine or container equipment state and
Monitoring resource information, when needing the monitoring function of starting device state and monitoring resource module, VIM sends deployment to NFVI and asks
Message is sought, deployment request message is used to create the virtual machine or container of installation VNF, disposes and carry monitoring resource word in request message
Section, monitoring resource field are data of enumeration type, indicate the equipment state and operation of distributing to the hardware resource of virtual machine or container
Parameter, virtual machine or container of the creation module of NFVI according to deployment request message creation VNF, the monitoring of starting module resolving resource
The value of the monitoring flag bit of field, starts when it is true for determining the value of the monitoring flag bit in monitoring resource field, such as: monitoring
When the value of flag bit is 1, the monitoring function for opening equipment state and monitoring resource module is indicated, when the value for monitoring flag bit is 0,
Indicate the monitoring function of pass hull closure state and monitoring resource module, starting module, which determines, needs to open equipment state and resource prison
When surveying the monitoring function of module, equipment state and money are opened in the Host OS on virtualization layer where distribution physical server
The monitoring function of source monitoring modular, and equipment state and monitoring resource module are presented to deployment VNF's in a manner of virtual unit
Virtual machine or container, equipment state and monitoring resource module are a virtual unit for virtual machine or container at this time, are opened
After the monitoring function for opening equipment state and monitoring resource module, equipment state and monitoring resource module monitors are for disposing VNF's
The equipment state and monitoring resource information of virtual machine or container.
Optionally, in some embodiments of the invention, the NFVI further include:
Sending module, for when the NFVI monitors that preset failure occur in the virtual machine for disposing the VNF or container,
The fault message of the preset failure is sent to virtual network infrastructure manager VIM, by the VIM according to the failure
Preset failure described in information processing.
Specifically, preset failure can be can not network, disk read-write error, software can not unsuccessfully wait failures, NFVI prison
When measuring virtual machine or container preset failure occur, can by the corresponding fault code of preset failure and failure-description information,
In, the corresponding fault code of each type of failure, failure-description information indicates application program, the fortune of equipment to break down
Row parameter (such as: CPU usage, disk remaining space, memory usage etc.), sending module will include fault code and failure
To VIM, the fault message that VIM is reported according to NFVI carries out the hardware that positioning is broken down and sets the fault information reporting of description information
It is standby.
Optionally, in some embodiments of the invention, the deployment subscribed to message and be used to obtain the NFVI monitoring
The virtual machine of the VNF or the equipment state of container and resource information；The equipment state of the virtual machine or container includes distribution
To at least one of the physical processor of the virtual machine or container, physical memory, network interface card and state of disk；It is described virtual
The monitoring resource information of machine or container include distribute to the physical processor of the virtual machine or container, physical memory, network interface card and
At least one of utilization rate of disk.
Specifically, equipment state indicates that the hardware resource for distributing to virtual machine or container is normal condition or malfunction,
Hardware resource includes at least one of physical processor, physical memory, network interface card machine disk；The expression of monitoring resource information is distributed to
The operating parameter of the hardware resource of virtual machine or container, such as: monitoring resource information includes physical processor, physical memory, net
At least one of card and the utilization rate of disk.
Optionally, in some embodiments of the invention, the monitoring resource field include enumeration type virtual machine or
The field of the field of tankage state and the virtual machine of enumeration type or container resource information；
The virtual machine of the enumeration type or the field of tankage state distribute to virtual machine for monitoring or container are set
The state of standby physical processor, physical memory, network interface card and disk；The virtual machine of the enumeration type or container resource information
Field, for monitoring the physical processor of virtual machine or container, the utilization rate of physical memory, network interface card and disk.
The embodiment of the present invention and embodiment of the method one are based on same design, and bring technical effect is also identical, specific mistake
Journey can refer to the description of embodiment of the method.
Referring to Fig. 4, Fig. 4 is a kind of framework of equipment state and resource information monitoring system disclosed by the embodiments of the present invention
Schematic diagram, equipment state and resource information monitoring system include network function virtualized infrastructure NFVI130, virtual network function
It can VNF108, Virtual base infrastructure manager VIM106 and virtualization network function manager VNFM104.The embodiment and figure
1 compares, the 131 deployment facility state of virtualization layer and monitoring resource module in network function virtualization infrastructure device 130
121, when needing to monitor the equipment state and monitoring resource information of the virtual machine or container for disposing virtual network function 108,
Virtual network function manager increases monitoring resource field and configuration monitoring resource field, monitoring resource in business description file
Field includes the field of the virtual machine of enumeration type or the equipment state of container and the virtual machine of enumeration type or container resource
The field of information, equipment state indicate that equipment is normal condition or malfunction, and resource information indicates the operating parameter of equipment, example
The utilization rate operating parameter of such as CPU, memory, hard disk or network further include monitoring flag bit, monitoring mark in monitoring resource field
Will position indicates to open or close the monitoring function of equipment state and monitoring resource module, for example, table when the value of monitoring flag bit is 1
Show the monitoring function for opening equipment state and monitoring resource module, the value for monitoring flag bit indicated when being 0 pass hull closure state and
The monitoring function of monitoring resource module；Virtual network function manager 104 sends to Virtual base infrastructure manager 106 and carries money
Source monitors the deployment request message of field, and Virtual base infrastructure manager 106 receives deployment request message, is disappeared according to deployment request
The resource for creating virtual machine or container is applied in breath instruction, is determined specific deployment node, is created for disposing virtual network
The virtual machine or container of function 108, Virtual base infrastructure manager 106 is to network function virtualized infrastructure after creating successfully
130 send the deployment request message for carrying monitoring resource field；Network function virtualized infrastructure 130 determines that deployment request disappears
When the monitoring flag bit of monitoring resource field is true in breath, starting device state and resource in host operating system Host OS
The monitoring function of monitoring modular, and equipment state and monitoring resource module 121 are presented to deployment virtually in a manner of virtual unit
The virtual machine or container of network function 108, it should be noted that equipment state and monitoring resource module 121 can monitor more simultaneously
The virtual machine or container of a virtual network function, with for example, equipment state and monitoring resource module monitor virtual simultaneously in scheming
The equipment state and monitoring resource of network function 1, virtual network function 2 and the respective virtual machine of virtual network function 3 or container
Information；Network function virtualized infrastructure 130 receives ordering for virtual network function 108 (such as virtual network function 1) transmission
Read message, the equipment state or money of the virtual machine or container of equipment state and monitoring module monitors deployment virtual network function 108
Source monitoring information, network function virtualized infrastructure obtain the equipment shape that equipment state and monitoring resource module 121 monitor
State and monitoring resource information report deployment virtual by network function virtualized infrastructure interface to virtual network function 108
The virtual machine of network function 108 or the equipment state of container and monitoring resource information.Wherein, the equipment shape in virtualization layer 131
State and monitoring resource module 121 are presented to virtual network function 108 in a manner of virtual unit, at this time equipment state and monitoring resource
Module 121 is a virtual unit for virtual network function 108, and Host OS can also be by the equipment of the virtual unit
State and occupation condition are sent to Virtual base infrastructure manager 106, other virtual network functions can be to Virtual base
Infrastructure manager 106 subscribes to the equipment state and occupation condition of the virtual unit, and occupation condition indicates that this virtually sets
The operating parameter of at least one of standby CPU, memory, disk and network interface card, to realize the fault location to virtual unit.
Referring to Fig. 5, Fig. 5 is another structural representation of network function virtualized infrastructure disclosed by the embodiments of the present invention
Figure, in embodiments of the present invention, NFVI5 includes processor 501, memory 502 and transceiver 503.Transceiver 503 be used for it is outer
Sending and receiving data between portion's equipment.The quantity of processor 501 in NFVI5 can be one or more.Some implementations of the invention
In example, processor 501, memory 502 and transceiver 503 can be connected by bus system or other modes.NFVI5 can be used for
Execute method shown in Fig. 2.About the meaning and citing of the term that the present embodiment is related to, the corresponding implementation of Fig. 2 can be referred to
Example.Details are not described herein again.
Wherein, program code is stored in memory 502.Processor 501 is for calling the program generation stored in memory 502
Code, for performing the following operations:
Receive the subscription message that virtual network function VNF is sent；
It is reported described in deployment by network function virtualized infrastructure interface to the VNF according to the subscription message
The virtual machine of VNF or the equipment state of container and monitoring resource information.
In some embodiments of the invention, processor 501 executes the subscription that the reception virtual network function VNF is sent
Before message, the method also includes:
Receive the deployment request message for being used to create virtual machine or container that the VIM is sent；
The virtual machine or container of the VNF are disposed according to the deployment request message creation；
When determining that the monitoring flag bit of monitoring resource field in the deployment request message is true, in host operating system
The monitoring function of starting device state and monitoring resource module in Host OS, and by the equipment state and monitoring resource module
The virtual machine or container for disposing the VNF are presented in a manner of virtual unit.
In some embodiments of the invention, processor 501 is also used to execute:
When preset failure occur in the virtual machine or container that monitor to dispose the VNF, by the failure of the preset failure
Information is sent to virtual network infrastructure manager VIM, and event is preset according to the faulted-phase judgment as the VIM
Barrier.
In some embodiments of the invention, the deployment VNF for subscribing to message and being used to obtain the NFVI monitoring
Virtual machine or container equipment state and resource information；The equipment state of the virtual machine or container includes distributing to the void
Quasi- at least one of machine or physical processor, physical memory, network interface card and the state of disk of container；The virtual machine or container
Monitoring resource information include distributing to the benefit of the physical processor of the virtual machine or container, physical memory, network interface card and disk
With at least one of rate.
In some embodiments of the invention, the monitoring resource field includes the virtual machine or tankage of enumeration type
The field of the field of state and the virtual machine of enumeration type or container resource information；
The virtual machine of the enumeration type or the field of tankage state distribute to virtual machine for monitoring or container are set
The state of standby physical processor, physical memory, network interface card and disk；The virtual machine of the enumeration type or container resource information
Field, for monitoring the physical processor of virtual machine or container, the utilization rate of physical memory, network interface card and disk.
Above to a kind of equipment state disclosed by the embodiments of the present invention and resource information monitoring method, relevant device and system
It is described in detail, used herein a specific example illustrates the principle and implementation of the invention, the above reality
The explanation for applying example is merely used to help understand method and its core concept of the invention；Meanwhile for the general technology of this field
Personnel, according to the thought of the present invention, there will be changes in the specific implementation manner and application range, in conclusion this theory
Bright book content should not be construed as limiting the invention.
Claims (11)
1. a kind of equipment state and resource information monitoring method characterized by comprising
Network function virtualized infrastructure NFVI receives the subscription message that virtual network function VNF is sent；
The NFVI reports deployment institute to the VNF by network function virtualized infrastructure interface according to the subscription message
State the virtual machine of VNF or the equipment state of container and monitoring resource information.
2. the method according to claim 1, wherein the network function virtualized infrastructure NFVI receives void
Before the subscription message that quasi- network function VNF is sent, the method also includes:
The NFVI receives the deployment request message for being used to create virtual machine or container that VIM is sent；
The NFVI disposes the virtual machine or container of the VNF according to the deployment request message creation；
When the NFVI determines that the monitoring flag bit of monitoring resource field in the deployment request message is true, in host service function system
It unites the monitoring function of starting device state and monitoring resource module in Host OS, and by the equipment state and monitoring resource mould
Block is presented to the virtual machine or container for disposing the VNF in a manner of virtual unit.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
When the NFVI monitors that preset failure occur in the virtual machine for disposing the VNF or container, the NFVI will be described pre-
If the fault message of failure is sent to virtual network infrastructure manager VIM, by the VIM according to the faulted-phase judgment
The preset failure.
4. method according to any one of claims 1 to 3, which is characterized in that the subscription message is described for obtaining
The virtual machine of the deployment VNF of NFVI monitoring or the equipment state and resource information of container；The virtual machine or container are set
Standby state include in the state for distribute to the physical processor of the virtual machine or container, physical memory, network interface card and disk extremely
It is one few；The monitoring resource information of the virtual machine or container include distribute to the physical processor of the virtual machine or container,
At least one of physical memory, network interface card and utilization rate of disk.
5. according to the method described in claim 2, it is characterized in that, the monitoring resource field includes the virtual machine of enumeration type
Tankage state field and enumeration type virtual machine or container resource information field；
The virtual machine of the enumeration type or the field of tankage state distribute to virtual machine or tankage for monitoring
The state of physical processor, physical memory, network interface card and disk；The virtual machine of the enumeration type or the word of container resource information
Section, for monitoring the physical processor of virtual machine or container, the utilization rate of physical memory, network interface card and disk.
6. a kind of network function virtualized infrastructure NFVI characterized by comprising
Receiving module, for receiving the subscription message of virtual network function VNF transmission；
Reporting module, for being reported by network function virtualized infrastructure interface to the VNF according to the subscription message
Dispose the virtual machine of the VNF or the equipment state of container and monitoring resource information.
7. NFVI according to claim 6, which is characterized in that the receiving module is also used to receiving virtual network function
Before the subscription message that VNF is sent, the deployment request message for being used to create virtual machine or container that VIM is sent is received；
The NFVI further include:
Creation module, for the virtual machine or container according to the deployment request message creation deployment VNF；
Starting module, when for determining that the monitoring flag bit of monitoring resource field in the deployment request message is true, in host
The monitoring function of starting device state and monitoring resource module in operating system Host OS；
The equipment state and monitoring resource module, for monitor dispose the VNF virtual machine or container equipment state and
Monitoring resource information；Wherein, the equipment state and monitoring resource module are presented to the deployment VNF's in a manner of virtual unit
Virtual machine or container.
8. NFVI according to claim 7, which is characterized in that the NFVI further include:
Sending module, for when the NFVI monitors that preset failure occur in the virtual machine for disposing the VNF or container, by institute
The fault message for stating preset failure is sent to virtual network infrastructure manager VIM, by the VIM according to the fault message
Handle the preset failure.
9. according to the described in any item NFVI of claim 6 to 8, which is characterized in that the subscription message is described for obtaining
The virtual machine of the deployment VNF of NFVI monitoring or the equipment state and resource information of container；The virtual machine or container are set
Standby state include in the state for distribute to the physical processor of the virtual machine or container, physical memory, network interface card and disk extremely
It is one few；The monitoring resource information of the virtual machine or container include distribute to the physical processor of the virtual machine or container,
At least one of physical memory, network interface card and utilization rate of disk.
10. NFVI according to claim 7, which is characterized in that the monitoring resource field includes the virtual of enumeration type
The virtual machine of the field and enumeration type of machine or tankage state or the field of container resource information；
The virtual machine of the enumeration type or the field of tankage state, for monitoring the physics for distributing to virtual machine or container
The state of processor, physical memory, network interface card and disk；The virtual machine of the enumeration type or the field of container resource information are used
In the utilization rate of the physical processor of monitoring virtual machine or container, physical memory, network interface card and disk.
11. a kind of equipment state and resource information monitor system characterized by comprising network function virtualized infrastructure
NFVI, virtual network function VNF, virtual network infrastructure manager VIM and virtualization network function manager VNFM,
Wherein, the VNFM increases monitoring resource field in each example of the VNF, and is wanted according to each example
The setting monitoring resource field is sought, Xiang Suoshu VIM sends the deployment request message for creating virtual machine or container；The portion
The monitoring resource field is carried in administration's request message；
The deployment request message is sent to the NFVI by the VIM；
The NFVI receives the deployment request message, and the virtual machine of the VNF is disposed according to the deployment request message creation
Or container, when determining that the monitoring flag bit of monitoring resource field in the deployment request message is true, in host operating system
The monitoring function of starting device state and monitoring resource module in Host OS, and by the equipment state and monitoring resource module
The virtual machine or container for disposing the VNF are presented in a manner of virtual unit；
The VNF is sent to the NFVI subscribes to message, and the message of subscribing to is used to obtain described in the deployment of the NFVI monitoring
The virtual machine of VNF or the equipment state of container and resource information；The equipment state of the virtual machine or container includes distributing to institute
State at least one of physical processor, physical memory, network interface card and the state of disk of virtual machine or container；The virtual machine or
The monitoring resource information of container includes distributing to the physical processor of the virtual machine or container, physical memory, network interface card and disk
At least one of utilization rate；
The NFVI reports deployment institute to the VNF by network function virtualized infrastructure interface according to the subscription message
State the virtual machine of VNF or the equipment state of container and monitoring resource information.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610243244.1A CN105760214B (en) | 2016-04-19 | 2016-04-19 | A kind of equipment state and resource information monitoring method, relevant device and system |
| PCT/CN2017/080111 WO2017181876A1 (en) | 2016-04-19 | 2017-04-11 | Device state and resource information monitoring method, related device, and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610243244.1A CN105760214B (en) | 2016-04-19 | 2016-04-19 | A kind of equipment state and resource information monitoring method, relevant device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105760214A CN105760214A (en) | 2016-07-13 |
| CN105760214B true CN105760214B (en) | 2019-02-26 |
Family
ID=56335322
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610243244.1A Active CN105760214B (en) | 2016-04-19 | 2016-04-19 | A kind of equipment state and resource information monitoring method, relevant device and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105760214B (en) |
| WO (1) | WO2017181876A1 (en) |
Families Citing this family (33)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105760214B (en) * | 2016-04-19 | 2019-02-26 | 华为技术有限公司 | A kind of equipment state and resource information monitoring method, relevant device and system |
| CN106487633B (en) * | 2016-10-11 | 2019-12-06 | 中国银联股份有限公司 | method and device for monitoring abnormity of virtual machine |
| CN106452925B (en) | 2016-12-02 | 2021-01-05 | 华为技术有限公司 | Method, device and system for detecting fault in NFV system |
| EP3568951A1 (en) * | 2017-01-14 | 2019-11-20 | Telefonaktiebolaget LM Ericsson (PUBL) | Scalable application level monitoring for sdn networks |
| US10523550B2 (en) | 2017-04-27 | 2019-12-31 | Huawei Technologies Co., Ltd. | Scout functions |
| CN107689953B (en) * | 2017-08-18 | 2020-10-27 | 中国科学院信息工程研究所 | Multi-tenant cloud computing-oriented container security monitoring method and system |
| CN107678836B (en) * | 2017-10-12 | 2021-09-03 | 新华三大数据技术有限公司 | Cluster test data acquisition method and device |
| CN110166503B (en) * | 2018-02-11 | 2021-11-19 | 中国移动通信有限公司研究院 | Information interaction method, information interaction equipment and computer readable storage medium |
| CN110275756B (en) * | 2018-03-13 | 2023-04-18 | 华为技术有限公司 | Method and device for deploying virtualized network element |
| CN110311798B (en) * | 2018-03-20 | 2021-02-12 | 华为技术有限公司 | Method and device for managing virtual resources |
| CN110569101B (en) * | 2018-06-05 | 2022-05-31 | 华为技术有限公司 | Method and device for managing container service |
| CN110618884A (en) * | 2018-06-19 | 2019-12-27 | 中国电信股份有限公司 | Fault monitoring method, virtualized network function module manager and storage medium |
| CN110673981B (en) * | 2018-07-03 | 2022-06-17 | 中国电信股份有限公司 | Fault recovery method, device and system |
| CN109218071B (en) * | 2018-07-17 | 2020-09-29 | 华为技术有限公司 | Dial testing method and device under NFV environment |
| CN111221620B (en) * | 2018-11-27 | 2024-02-09 | 华为技术有限公司 | Storage method, device and storage medium |
| US10880370B2 (en) | 2018-11-27 | 2020-12-29 | At&T Intellectual Property I, L.P. | Virtual network manager system |
| CN111443984B (en) * | 2019-01-17 | 2023-03-31 | 中国移动通信有限公司研究院 | Container deployment method and device of network function virtualization NVF system |
| CN111698112B (en) * | 2019-03-15 | 2021-09-14 | 华为技术有限公司 | Resource management method and device for VNF (virtual network function) |
| CN111835684B (en) * | 2019-04-19 | 2023-01-20 | 厦门网宿有限公司 | Network isolation monitoring method and system for haproxy equipment |
| CN111835685B (en) * | 2019-04-19 | 2022-10-28 | 厦门网宿有限公司 | Method and server for monitoring running state of Nginx network isolation space |
| CN111953503B (en) * | 2019-05-14 | 2023-04-07 | 中国电信股份有限公司 | NFV resource deployment arrangement method and network function virtualization orchestrator |
| CN110134519A (en) * | 2019-05-21 | 2019-08-16 | 中国太平洋保险（集团）股份有限公司 | A kind of control method and device for realizing portal management based on container platform |
| US11296975B2 (en) | 2019-06-25 | 2022-04-05 | Vmware, Inc. | Systems and methods for implementing multi-part virtual network functions |
| US10931507B2 (en) * | 2019-06-25 | 2021-02-23 | Vmware, Inc. | Systems and methods for selectively implementing services on virtual machines and containers |
| CN112395152B (en) * | 2019-08-19 | 2022-04-12 | 阿里巴巴集团控股有限公司 | Server resource acquisition method and acquisition system |
| CN110740121B (en) * | 2019-09-09 | 2023-04-07 | 西安万像电子科技有限公司 | Resource subscription system and method |
| CN111130925B (en) * | 2019-11-29 | 2022-08-26 | 广州文远知行科技有限公司 | Resource monitoring method and device, computer equipment and storage medium |
| CN111130953B (en) * | 2019-12-31 | 2022-04-15 | 奇安信科技集团股份有限公司 | VNF availability monitoring method, device and medium |
| CN113342456A (en) * | 2020-03-02 | 2021-09-03 | 中兴通讯股份有限公司 | Connection method, device, equipment and storage medium |
| CN111597032B (en) * | 2020-05-26 | 2024-03-26 | 北京明略昭辉科技有限公司 | Task scheduling management method and device and electronic equipment |
| CN112214281A (en) * | 2020-09-24 | 2021-01-12 | 明辰智航(北京)测试技术有限公司 | Method and system for monitoring virtual data |
| CN114374609B (en) * | 2021-12-06 | 2023-09-15 | 东云睿连(武汉)计算技术有限公司 | Deep learning job operation method and system based on RDMA equipment |
| CN114157585A (en) * | 2021-12-09 | 2022-03-08 | 京东科技信息技术有限公司 | Method and device for monitoring service resources |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186450A (en) * | 2011-12-28 | 2013-07-03 | 英业达集团(天津)电子技术有限公司 | Method and system for monitoring virtual resource consumption |
| CN104050045A (en) * | 2014-06-27 | 2014-09-17 | 华为技术有限公司 | Method and device for distributing virtual resources based on disk IO |
| CN104170323A (en) * | 2014-04-09 | 2014-11-26 | 华为技术有限公司 | Fault handling method, device and system based on network function virtualization |
| CN104869023A (en) * | 2015-05-29 | 2015-08-26 | 华为技术有限公司 | Method, device and system for time correction |
| CN105049293A (en) * | 2015-08-21 | 2015-11-11 | 中国联合网络通信集团有限公司 | Monitoring method and device |
| CN105119736A (en) * | 2015-07-15 | 2015-12-02 | 华为技术有限公司 | Data check method and device in network function virtualization architecture |
| CN105187249A (en) * | 2015-09-22 | 2015-12-23 | 华为技术有限公司 | Fault recovery method and device |
| CN105247826A (en) * | 2013-01-11 | 2016-01-13 | 华为技术有限公司 | Network function virtualization for a network device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9973375B2 (en) * | 2013-04-22 | 2018-05-15 | Cisco Technology, Inc. | App store portal providing point-and-click deployment of third-party virtualized network functions |
| WO2016026129A1 (en) * | 2014-08-22 | 2016-02-25 | Nokia Technologies Oy | A security and trust framework for virtualized networks |
| CN105490846B (en) * | 2015-12-07 | 2019-11-05 | 中国电子科技集团公司第三十二研究所 | Server virtualization management system and method |
| CN105760214B (en) * | 2016-04-19 | 2019-02-26 | 华为技术有限公司 | A kind of equipment state and resource information monitoring method, relevant device and system |
-
2016
- 2016-04-19 CN CN201610243244.1A patent/CN105760214B/en active Active
-
2017
- 2017-04-11 WO PCT/CN2017/080111 patent/WO2017181876A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186450A (en) * | 2011-12-28 | 2013-07-03 | 英业达集团(天津)电子技术有限公司 | Method and system for monitoring virtual resource consumption |
| CN105247826A (en) * | 2013-01-11 | 2016-01-13 | 华为技术有限公司 | Network function virtualization for a network device |
| CN104170323A (en) * | 2014-04-09 | 2014-11-26 | 华为技术有限公司 | Fault handling method, device and system based on network function virtualization |
| CN104050045A (en) * | 2014-06-27 | 2014-09-17 | 华为技术有限公司 | Method and device for distributing virtual resources based on disk IO |
| CN104869023A (en) * | 2015-05-29 | 2015-08-26 | 华为技术有限公司 | Method, device and system for time correction |
| CN105119736A (en) * | 2015-07-15 | 2015-12-02 | 华为技术有限公司 | Data check method and device in network function virtualization architecture |
| CN105049293A (en) * | 2015-08-21 | 2015-11-11 | 中国联合网络通信集团有限公司 | Monitoring method and device |
| CN105187249A (en) * | 2015-09-22 | 2015-12-23 | 华为技术有限公司 | Fault recovery method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017181876A1 (en) | 2017-10-26 |
| CN105760214A (en) | 2016-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105760214B (en) | A kind of equipment state and resource information monitoring method, relevant device and system | |
| EP3455728B1 (en) | Orchestrator for a virtual network platform as a service (vnpaas) | |
| WO2021017301A1 (en) | Management method and apparatus based on kubernetes cluster, and computer-readable storage medium | |
| CN103703724B (en) | Resource payment method | |
| CN103270507B (en) | According to the physical location of blade, realize the automatic supply of blade and the integrated software of configuration and hardware system | |
| US20200162345A1 (en) | Method, system and options for multi-operator service life cycle management | |
| CN108400998B (en) | VNF deployment method and system | |
| CN106664216B (en) | VNF switching method and device | |
| EP3447965B1 (en) | Network function instance management method and relevant device | |
| US9071508B2 (en) | Distributed fabric management protocol | |
| CN110661641B (en) | Virtual network function VNF deployment method and device | |
| CN103368768A (en) | Automatically scaled network overlay with heuristic monitoring in hybrid cloud environment | |
| US8468228B2 (en) | System architecture method and computer program product for managing telecommunication networks | |
| CN108632067A (en) | Disaster tolerance dispositions method, apparatus and system | |
| EP3574674B1 (en) | A network monitoring entity, method, system and computer program for a communication network implementing network slices | |
| CN108062231A (en) | A kind of cloud application automatic configuration method based on correlation analysis | |
| CN108199860A (en) | A kind of alert processing method and the network equipment | |
| CN102375894B (en) | Method for managing different types of file systems | |
| CN109842526A (en) | A kind of disaster recovery method and device | |
| CN103067476B (en) | A kind of dynamic network reconstruction method based on virtual machine | |
| CN112087311B (en) | Virtual network function VNF deployment method and device | |
| Haensge et al. | Cloud-native 5g service delivery platform | |
| CN108737144A (en) | The method and apparatus of resource management | |
| CN113760447A (en) | Service management method, device, equipment, storage medium and program product | |
| CN109286513A (en) | Calculation resource disposition method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |