WO2022101378A1 - Method and system for predicting a network characteristic - Google Patents

Method and system for predicting a network characteristic Download PDF

Info

Publication number
WO2022101378A1
WO2022101378A1 PCT/EP2021/081460 EP2021081460W WO2022101378A1 WO 2022101378 A1 WO2022101378 A1 WO 2022101378A1 EP 2021081460 W EP2021081460 W EP 2021081460W WO 2022101378 A1 WO2022101378 A1 WO 2022101378A1
Authority
WO
WIPO (PCT)
Prior art keywords
network
upf
path
states
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2021/081460
Other languages
French (fr)
Inventor
Loick BONNIOT
Christoph Neumann
Francois Schnitzler
François TAÏANI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital CE Patent Holdings SAS
Original Assignee
InterDigital CE Patent Holdings SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by InterDigital CE Patent Holdings SAS filed Critical InterDigital CE Patent Holdings SAS
Publication of WO2022101378A1 publication Critical patent/WO2022101378A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/16Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using machine learning or artificial intelligence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • H04L41/147Network analysis or design for predicting network behaviour
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • H04L41/149Network analysis or design for prediction of maintenance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • H04L41/0823Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/12Discovery or management of network topologies
    • H04L41/122Discovery or management of network topologies of virtualised topologies, e.g. software-defined networks [SDN] or network function virtualisation [NFV]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays

Definitions

  • the present disclosure relates generally to networks and in particular to network analysis.
  • Networks such as communication networks or electricity networks, can be complex distributed systems for which every configuration parameter (e.g. network routes, priority policies, and offloading policies) and the topology of the network itself can have an important impact on the network’s performance.
  • every configuration parameter e.g. network routes, priority policies, and offloading policies
  • the routing policy and the priority policies will largely affect the resulting latency of traffic flows.
  • decisions to route electricity into certain parts of the network have a large impact on the overall capacity of the network. It is therefore typically a complicated task to take adequate and informed decisions (e.g. where to route a traffic flow or where to produce electricity), in particular if the network topology evolves (e.g. a new node or link is added or removed due to failure or decision).
  • machine learning models could be used to either predict performance for a given network and configuration, or to evaluate what-if scenarios (e.g. what is the performance if a link is removed or if the routing configuration is X or Y).
  • the present principles are directed to a method comprising obtaining a network model for predicting a characteristic of a network, the network model comprising three bipartite graphs corresponding to a topology of the network, wherein a first bipartite graph connects each path in the network to links the path uses in the network, a second bipartite graph connects each link in the network to nodes that define the link, and a third bipartite graph connects each path in the network to the nodes that define the path, wherein each vertex of the bipartite graphs contains a state, injecting parameters of the network and load in the network into the network model, performing T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices, combining the state of every path to obtain a prediction of the characteristic, and outputting the prediction of the characteristic.
  • the present principles are directed to an apparatus comprising memory and a processor configured to obtain a network model for predicting a characteristic of a network, the network model comprising three bipartite graphs corresponding to a topology of the network, wherein a first bipartite graph connects each path in the network to links the path uses in the network, a second bipartite graph connects each link in the network to nodes that define the link, and a third bipartite graph connects each path in the network to the nodes that define the path, wherein each vertex of the bipartite graphs contains a state, inject parameters of the network and load in the network into the network model, perform T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices, combine the state of every path to obtain a prediction of the characteristic, and output the prediction of the characteristic.
  • the present principles are directed to a computer program product which is stored on a non-transitory computer readable medium and includes program code instructions executable by a processor for implementing the steps of a method according to any embodiment of the first aspect.
  • FIG. 1 illustrates the present principles generally; Error! Reference source not found. illustrates an example of input network topology for use with the present principles;
  • FIG. 3 illustrates a bipartite graph Gp,l from paths to links for the input network topology illustrated in FIG.2;
  • FIG. 4 illustrates the bipartite graph Gl,n from links to nodes for the input network topology illustrated in FIG.2;
  • FIG. 5 illustrates the bipartite graph Gp,n from paths to nodes for the input network topology illustrated in FIG.2;
  • FIG.6 illustrates a typical example of the prediction that can be made and the type of input that can be used for the prediction according to the present principles;
  • FIG. 3 illustrates a bipartite graph Gp,l from paths to links for the input network topology illustrated in FIG.2
  • FIG. 4 illustrates the bipartite graph Gl,n from links to nodes for the input network topology illustrated in FIG.2
  • FIG. 5 illustrates the bipartite graph Gp
  • FIG. 7 illustrates an analysis system according to an embodiment of the present principles
  • FIG.8 illustrates a method in a 5G network according to the present principles.
  • DESCRIPTION OF EMBODIMENTS It will be appreciated that it desirable to provide a solution that adequately can estimate performance metrics given a network snapshot (e.g. a network topology, a network configuration which includes routing and priority configuration).
  • a network snapshot e.g. a network topology, a network configuration which includes routing and priority configuration.
  • the present principles generally illustrated in Error! Reference source not found., should be able to predict performance metrics given: (i) a network topology, (ii) a network configuration or more generally properties of the physical/target network, and (iii) a description of the workload (e.g. network or electricity flows) carried on the physical/target network.
  • the present principles may predict the resulting per-source- destination mean per-packet delay (or other metrics such as throughput, packet loss etc.) given: (i) a network topology, (ii) a network configuration (routing, queue scheduling), and (iii) a source-destination traffic matrix.
  • the present principles use a graph neural network that relies on three bipartite graphs, Gp,l, Gl,n, Gp,n, where paths (a path is defined by a source and destination node and the path traverses a series of nodes), nodes and links of the physical network are represented as vertices: ⁇ Gp,l connects each path to the links it is made up of, ⁇ Gl,n connects each link to the two nodes that define the link, and ⁇ G p,n connects each path to the nodes it traverses.
  • Each vertex of the above graphs has a hidden state (also called ‘embedding,’ the terms can be used interchangedly).
  • the hidden state is learned during a training phase using message passing convolutions between vertices.
  • Message passing convolutions between the vertices is used during inference: the current network topology (real, i.e. physical, or modelled) defines the topology of the graphs G p,l , G l,n , G p,n ; the network parameters and load are injected into the above graphs and each vertex updates the parameters using its hidden state and passes the result to its neighbours (each neighbour aggregating the received messages).
  • the final prediction combines the resulting outputs using a fully connected layer.
  • the present principles can be applied to communication networks using Software Defined Networking (SDN), in particular to predict per-source-destination mean per-packet delay.
  • SDN Software Defined Networking
  • 3GPP communication networks in particular to predict network performance within the Network Data Analytics Function (NWDAF).
  • NWDAAF Network Data Analytics Function
  • a Session Management Function (SMF) may reconfigure the 3GPP network (e.g. by allocating resources or reconfiguring PDU-session) according to the predicted network performance.
  • SMF Session Management Function
  • the system can test different network topologies and network configurations to execute what-if scenarios. The system can choose the best result and configure the network accordingly.
  • each node of the physical network hosts vertices of the graphs Gp,l, Gl,n, Gp,n.
  • a node transmits on the physical network a message containing the messages of the machine-learning message-passing algorithm.
  • Deep learning model The present principles are based on a deep learning model capable of estimating per-path performances for arbitrary network topologies. First will be described how to model problem inputs in a way suitable for deep learning (and more specifically graph neural networks), then the full model architecture will be detailed and finally how embeddings are aggregated.
  • Modelization Problem inputs are modelled using three entities: nodes (vertices of the network), links (edges of the network) and finally paths (extracted from routing configuration and network topology for each source-destination pairs of nodes).
  • the network can be a real, physical network or a model of a network (a.k.a. “target network”), such as a future network or a network resulting from a what-if scenario.
  • Three bipartite graphs are constructed for the network: ⁇ Gp,l uses paths and links as vertices. There is one edge between path ⁇ and link ⁇ if and only if ⁇ passes through link .
  • ⁇ G l,n uses links and nodes as vertices.
  • ⁇ G p,n uses paths and nodes as vertices. There is one edge between path ⁇ and node ⁇ if and only if ⁇ passes through node . Start and end nodes are included for each path.
  • Reference source not found. illustrates an example of input network topology (the physical network, such as a communication network or a power grid) with nodes A, B, C and links 1 to 4. Paths from X to Y are denoted XY (in this example path BC is constructed by following links 2 and 3 via A). Error!
  • FIG. 3 illustrates the bipartite graph G p,l from paths to links
  • FIG.4 illustrates the bipartite graph G l,n from links to nodes
  • FIG.5 illustrates the bipartite graph Gp,n from paths to nodes.
  • the neighbours of i, N ST (I) are defined as the indices j of vertices where (j, i) is an edge in GS,T.
  • N ST (I) is defined as the indices j of vertices where (ij) is an edge in GS,T.
  • Initialization a. p i is defined as the initial hidden state of path i b. l t is defined as the initial hidden state of link i c. n i is defined as the initial hidden state of node i
  • aggregation When updating hidden states, the present principles use “aggregation” and “combination” as generic functions. Examples of “aggregation” operations suitable for deep learning are provided hereinafter in “Hidden state aggregation”. In neural networks, “combination” is typically a single fully-connected layer, but multiple fully- connected layers can be chained with non-linear activation functions between them.
  • every step in 2. a and step 2.b is a convolution operation, aggregating hidden states from multiples edges in the invention’s bipartite graphs to return updated hidden states.
  • a training phase is required to learn a set of functions and parameters.
  • the same architecture is used during training and inference; during training the functions “aggregation” and “combination” are learnt and require access to input and output parameters.
  • the system requires the value of the performance metric to be predicted, a network topology, a network configuration or more generally properties of the physical or target network, and a description of the workload (e.g. network or electricity flows) carried on the physical or target network
  • the present principles can be used with any suitable kind of aggregation function, as long as the said function accepts a variable number of arguments.
  • the “Global Sum” function is largely used.
  • the aggregation operation in 2. a. i can be:
  • Min, Max, Average and Standard deviation functions can also be used in the aggregation. It is also possible to use several of these functions and concatenate their results. However, a drawback of these functions is that changing the order of the inputs does not change the result (i.e. information about input order is lost).
  • recurrent neural networks can be used as aggregation functions when the order of input conveys important information.
  • paths can be defined as ordered lists of links and/or ordered lists of nodes.
  • a recurrent neural network e.g. containing Long Short-Term Memory, LSTM, or Gated Recurrent Unit, GRU, layers
  • step 2.b the same logic applies to step 2.b.
  • SDN Software-Defined Networks
  • a centralized control plane using e.g. a central controller
  • An SDN controller can for example be used to define the routes to be used for a given traffic flow based on observed packet delays and packet loss.
  • the observed metrics e.g. packet delay and packet loss
  • FIG. 6 illustrates a typical example of the prediction that can be made and the type of input that can be used for the prediction according to the present principles.
  • the neural network model takes as input a network topology, a traffic matrix and network configuration and outputs a per-source-destination mean delay for the network.
  • the graph neural network predictive model already described is implemented in a SDN network controller.
  • the SDN controller has knowledge of the topology of the network it controls, i.e. the SDN controller stores or has access to information regarding the set of networking routers and the possible networking links between these routers. The SDN controller also knows the configured routes of the routers.
  • Such information can be provided via manual configuration by an administrator, but it is also possible to use automatic means to provide the information to the SDN controller, such as letting the routers send messages to the SDN controller in order to inform the SDN controller of their presence.
  • the routers may also announce the neighbouring routers to the SDN controller, thereby providing link information to the SDN controller.
  • the routers may also announce their configured routes to the SDN controller, thereby providing a complete routing matrix to the SDN controller.
  • Each router may have parameters regarding its configuration which may be reported to the SDN central controller by the routers, such as:
  • queueSizes queue sizes (in number of packets) for each output queue of the node, where values are separated by commas and where each value is associated with a QoS queue,
  • schedulingPolicy policy used to serve the QoS queues, the policy may be one of: ‘FIFO’ (First-In, First-Out), ‘SP’ (Strict Priority), ‘WFQ’ (Weighted Fair Queuing), and ‘DRR’ (Deficit Round Robin); if not specified, a ‘FIFO’ policy is considered by default, and
  • schedulingWeights list of weights separated by commas associated with each QoS queue; used only for the WFQ and DRR scheduling policies.
  • Each link may have parameters regarding its configuration or capacity to be collected by the SDN controller, such as:
  • bandwidth link bandwidth (bits/time unit).
  • n connects each path to the nodes it traverses.
  • the SDN controller can further collect measurements from the network infrastructure regarding traffic and network load. Routers may inform the SDN controller of existing network traffic and flows. Mechanisms and protocols such as netflow may for instance be used to this end.
  • a traffic flow is characterized by source and destination (and a set of routers it traverses). Further, a flow may be characterized by bandwidth used, packet size distribution, etc.
  • the SDN controller can for instance collect at least some of the following flow- related information for each flow between a source node and a destination node:
  • TimeDis inter-packet arrival time distribution.
  • TimeDistParams dictionary with parameters of the specific inter-packet arrival time distribution: o EqLambda: average bitrate per time unit (bits/time unit). o AvgPktsLambda: average number of packets of average size generated per time unit (packets/time unit). o MinPktLambda: minimum number of packets generated per time unit (packets/time unit). o MaxPktLambda: maximum number of packets generated per time unit (packets/time unit). o StdDev: Standard deviation of the interarrival time (used in the normal distribution).
  • o PktsLambdaOn Average packets per time unit generated during the ON period (packets/time unit).
  • o ExpMaxFactor Factor used to define an upper bound for exponential distributions. The upper bound is defined as: ExpMaxFactor * lambda of the exponential.
  • o BurstGenLambda Burst generation rate of the flow (bursts/time unit).
  • o Bitrate Bitrate during a burst: (bits/time unit).
  • o ParetoMinSize Minimum number of bits in the burst (bits).
  • o ParetoMaxSize Maximum number of bits in the burst (bits).
  • o ParetoAlfa Shape parameter (a) used in the Pareto distribution.
  • SizeDist packet size distribution used for the flow.
  • SizeDistParams dictionary with the parameters of the specific size distribution: o AvgPktSize: Average packet size (bits). o MinSize: Minimum packet size (bits). o MaxSize: Maximum packet size (bits). o PktSizel : First packet size option (bits). o PktSize2: Second packet size option (bits). o NumCandidates: Number of different packets size considered. o SizeJ: Size of the candidate packet i (bits). o ProbJ: Probability to select candidate packet i (bits).
  • AvgBw average bandwidth for this flow (bits/time unit).
  • PktsGen packets generated by this flow per time unit (packets/time unit).
  • ToS Type of Service associated to this flow defined as an integer.
  • the SDN controller can also collect aggregated information regarding traffic measurements for a specific source and destination pair, for example:
  • AvgBw average bandwidth from node src to node dst (bits/time unit).
  • PktsGen packets generated from node src to node dst per time unit (packets/time unit).
  • the SDN controller can predict network metrics by using the described machine learning model, trained either on the same network and topology or on another network and topology.
  • the SDN controller initializes each vertex of the graphs G p ,i, Gi, n , G p , n with the metrics and parameters collected by the SDN controller for each of the corresponding router, link or path.
  • the model employs message passing convolutions (i.e. passing the result of a vertex to its neighbors, each aggregating the received messages).
  • the final prediction combines the resulting outputs using a fully connected layer.
  • the SDN controller may predict different kind of metrics, for example:
  • PktsDrop packets dropped per time unit over a path defined by a source and destination pair.
  • AvgDelay average per-packet delay over the packets transmitted on path defined by a source and destination pair.
  • the SDN controller tests different paths using the prediction model. This can for example be done to simulate node failure, and different node or link characteristics.
  • the SDN controller may for instance test different routing matrices, constructing multiple versions of the graphs Gi, n and G P , n and provide a network metric prediction for each routing matrix. By comparing the different prediction results, the SDN controller can pick the best result (e.g. the lowest latency) and reconfigure the communication network accordingly.
  • the SDN controller may for instance test different router configurations, e.g. by changing one or more of the parameters in the prediction model, such as levelsQoS, queueSizes, schedulingPolicy and schedulingWeights. This can be achieved by initiating the hidden states with the tested values. Doing so, the SDN controller can generate predictions for each configuration and choose the configuration that provided the best prediction (e.g. lowest latency, lowest packet drop, smallest jitter). Based on this prediction, the SDN controller can reconfigure the routers accordingly.
  • the parameters in the prediction model such as levelsQoS, queueSizes, schedulingPolicy and schedulingWeights. This can be achieved by initiating the hidden states with the tested values. Doing so, the SDN controller can generate predictions for each configuration and choose the configuration that provided the best prediction (e.g. lowest latency, lowest packet drop, smallest jitter). Based on this prediction, the SDN controller can reconfigure the routers accordingly.
  • FIG. 7 illustrates a network analysis system according to an embodiment of the present principles.
  • the system 700 is centralized and includes a computing device 710 and a display 720 for displaying results.
  • the computing device 710 includes a user interface 711 (that can be implemented with the display 720 as a touchscreen) configured to receive user input, at least one hardware processor 712 configured to perform calculations described herein, memory 713 configured to store program code, (intermediate) results, etc. and an input/output (I/O) interface 714 configured for communication with external devices, for example network nodes.
  • I/O input/output
  • Also illustrated is a non-transitory computer-readable storage medium storing instructions that, when executed, cause the at least one hardware processor to perform at least one method of the present principles.
  • the graph neural network predictive model already described is implemented in the Network Data Analytics Function (NWDAF).
  • the NWDAF has knowledge of the topology of the 3GPP network (e.g. the set of User Plane Functions (UPFs) of a 3GPP core network), i.e. the NWDAF controller stores or has access to information regarding the set of UPFs and the possible networking links between these UPFs.
  • the NWDAF also knows the configured routes of the UPFs (e.g. the set of configured and used Protocol Data Unit (PDU) sessions).
  • PDU Protocol Data Unit
  • Such information may be provided by the Session Management Function (SMF), as it is the SMF defines and configures the PDU-session therefore defining routing policy.
  • SMF Session Management Function
  • the UPFs may also announce the neighbouring UPFs to the NWDAF, thereby providing link information to the NWDAF.
  • the UPFs may also announce their configured routes to the NWDAF, thereby providing a complete routing matrix to the NWDAF.
  • such information may alternatively also be provided via manual configuration by an administrator.
  • Each UPF may have parameters regarding its configuration and load which may be reported to the NWDAF by the UPF, such as:
  • queueSizes queue sizes (in number of packets) for each output queue of the node, where values are separated by commas and where each value is associated with a QoS queue,
  • schedulingPolicy policy used to serve the QoS queues, the policy may be one of: ‘FIFO’ (First-In, First-Out), ‘SP’ (Strict Priority), ‘WFQ’ (Weighted Fair Queuing), and ‘DRR’ (Deficit Round Robin); if not specified, a ‘FIFO’ policy is considered by default,
  • schedulingWeights list of weights separated by commas associated with each QoS queue; used only for the WFQ and DRR scheduling policies, and
  • traffic usage report report of user plane traffic in the UPF for the accumulated usage of network resources (see TS 29.244 [17])
  • Each link may have parameters regarding its configuration or capacity to be collected by the NWDAF, such as:
  • bandwidth link bandwidth (bits/time unit).
  • the NWDAF can construct the three graphs:
  • n connects each path to the nodes it traverses.
  • the NWDAF can further collect measurements from the network infrastructure regarding traffic and network load. UPFs may inform the NWDAF of existing network traffic and flows.
  • the NWDAF may expose a specific API for this purpose.
  • a traffic flow is characterized by source and destination (and a set of routers it traverses). Further, a flow may be characterized by bandwidth used, packet size distribution, etc.
  • the NWDAF can for instance collect at least some of the following flow-related information for each flow between a source node and a destination node:
  • QoS parameters per flow according to 5G QoS Identifier (5QI): o Resource Type (Guaranteed Bit Rate (GBR), Delay critical GBR or Non- GBR); o Priority level; o Packet Delay Budget; o Packet Error Rate; o Averaging window (for GBR and Delay-critical GBR resource type only); o Maximum Data Burst Volume (for Delay-critical GBR resource type only).
  • Flow bitrates o Guaranteed Flow Bit Rate (GFBR) - Uplink (UL) and Downlink (DL); o Maximum Flow Bit Rate (MFBR) - UL and DL.
  • GBR Guaranteed Flow Bit Rate
  • UL Uplink
  • DL Downlink
  • MFBR Maximum Flow Bit Rate
  • the NWDAF may also collect at least some of the following flow related information:
  • the NWDAF can predict network metrics by using the described machine learning model, trained either on the same network and topology or on another network and topology.
  • the NWDAF initializes each vertex of the graphs G P ,i, Gi.n, G P , n with the metrics and parameters collected by the NWDAF for each of the corresponding router, link or path.
  • the model employs message passing convolutions (i.e. passing the result of a vertex to its neighbors, each aggregating the received messages).
  • the final prediction combines the resulting outputs using a fully connected layer.
  • the NWDAF may predict different kind of metrics, for example:
  • PktsDrop packets dropped per time unit over a path defined by a source and destination pair.
  • AvgDelay average per-packet delay over the packets transmitted on a path defined by a source and destination pair.
  • p10, p20, p50, p80, and p90 percentiles (10, 20, 50, 80, and 90) of the per-packet delay distribution on a path defined by a source and destination pair.
  • Jitter Variance of the per-packet delay over the packets transmitted on a path defined by a source and destination pair.
  • FIG. 8 illustrates a method in a 5G network according to the present principles.
  • a SMF 801 provides network configuration information to a NWDAF 803.
  • the network configuration information can relate to the currently deployed network or to a non-existent network to be tested.
  • the network configuration information can for example include links, routes, PDU session, load information and router configurations.
  • a UPF 805 provides network information to the NWDAF 803.
  • the network information can for example include information about the UPF 805, configurations, links, neighboring UPF and network load information.
  • step S830 the NWDAF uses the received information to generate a model, for example a GNN model, as explained.
  • step S840 the SMF 801 sends a request for a performance prediction to the NWDAF 803.
  • the request can for example relate to delays in the network.
  • step S850 the NWDAF 803 predicts, based on information received in for example step S810 and/or step S820, a performance of the network to answer the request.
  • step S860 the NWDAF 803 sends a corresponding prediction result to the SMF 801.
  • step S870 acting on the prediction result, the SMF 801 can, change or request changes of the UPF configuration based on the prediction result. What-if scenarios
  • a networking function (e.g. the SMF) tests different paths using the prediction service exposed by the NWDAF. This can for example be done to simulate different choices before assigning a PDU-session to one or another UPF.
  • the SMF submits a prediction request to the NWDAF with at least one configuration (e.g. terminating a PDU-session on UPF A).
  • the NWDAF response with a prediction of a network performance metric. Based on this response the SMF decides to apply this configuration, to test another configuration or to do nothing.
  • each computing architecture can be implemented essentially like the system illustrated in FIG. 7.
  • link embeddings I link embeddings I
  • node embeddings n node embeddings n
  • path embeddings p path embeddings
  • each resource c t is responsible for the update of the embeddings and for the transmission of the updated embeddings to a central processing architecture a and to other relevant computing resources.
  • the distributed implementation can work as follows:
  • Each resource q is attributed the embedding n t of the associated topological node.
  • Each link embedding lj is attributed to a resource c t among the resources that have been associated to the source and/or the destination of the link.
  • Parameters of the graph neural network are sent to the resources (e.g. the trained model, hyperparameters etc).
  • Each resource q stores, for each embeddings it is responsible for, the resources to which q should send an updated value of the embedding. i. For node embedding, these are all resources responsible for links originating or ending in that node (iterative process) ii.
  • link embedding these are all computing resources that are responsible for a node in that link and/or a path containing that link (iterative process) iii.
  • path embedding these are all computing resources that are responsible fora link in that path (iterative process) and all nodes contained in that path (final computation)
  • step 1 .a if any topological node does not have an associated computing resource, this node is associated with another computing resource. This can for example be performed directly by the central processing architecture, based on node proximity etc.
  • step 1.b link embedding attribution can either be performed directly by the central processing architecture; by a specific rule, for example the resource responsible for the source (alternatively, the destination) of a link is responsible for the embedding of that link; by communication and agreement between the nodes; or by any other appropriate method.
  • Step 1 .c These parameters may for example be loaded from memory or may be broadcasted by the central computing resource a.
  • Step 1.d corresponds to the distribution of the structure of the three bipartite graphs.
  • Step 2 a can be done synchronously: the main algorithm moves to the next step only when all embeddings of a given type have been updated. It can also be done asynchronously: as soon as a resource q has received all (alternatively, some) values (of other embeddings) necessary to update one embedding it is responsible for, it computes this embedding and sends it to the appropriate computing resources.
  • Each resource c t is attributed the embedding n t of the associated topological node.
  • Each link embedding lj is attributed to a resource q among the resources that have been associated to the source and/or the destination of the link.
  • Each path embedding p k is attributed to a resource q among the resources that have been associated to at least one node or link in the path.
  • Parameters of the graph neural network are loaded by the resources.
  • Each resource q stores, for each of the embeddings it is responsible for, the resources to which q must send an updated value of the embedding. i.
  • node embedding these are all resources responsible for links originating or ending in that node (iterative process).
  • link embedding these are all computing resources that are responsible for a node in that link and/or a path containing that link (iterative process).
  • path embedding these are all computing resources that are responsible for a link in that path (iterative process) and all nodes contained in that path (final computation).
  • Step 1 .ccan for example be performed according to a specific rule, for example the resource responsible for the largest number of nodes or links in the path is responsible for the embedding of the path; resource responsible for similar paths are more likely to be responsible for a path; or by any other appropriate method.
  • any switches shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software.
  • the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared.
  • explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, read only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage. Other hardware, conventional and/or custom, may also be included.
  • any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
  • any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function.
  • the disclosure as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

A graph neural network with three bipartite graphs based on a topology of a network, Gp,l connecting paths in a network to their links, Gl,n connecting links to nodes defining the links, and Gp,n connecting paths to nodes, wherein each vertex of the bipartite graphs has a hidden state to be passed to its neighbours during iterated message passing convolutions, the graph neural network is injected network parameters and load are injected into the above graphs. A network characteristic combines the resulting outputs using a fully connected layer.

Description

METHOD AND SYSTEM FOR PREDICTING A NETWORK CHARACTERISTIC
TECHNICAL FIELD
The present disclosure relates generally to networks and in particular to network analysis.
BACKGROUND
This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present disclosure that are described and/or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
Networks, such as communication networks or electricity networks, can be complex distributed systems for which every configuration parameter (e.g. network routes, priority policies, and offloading policies) and the topology of the network itself can have an important impact on the network’s performance. For example, in a communication network the routing policy and the priority policies will largely affect the resulting latency of traffic flows. Similarly, in an electricity network, decisions to route electricity into certain parts of the network have a large impact on the overall capacity of the network. It is therefore typically a complicated task to take adequate and informed decisions (e.g. where to route a traffic flow or where to produce electricity), in particular if the network topology evolves (e.g. a new node or link is added or removed due to failure or decision). In order to help in this context, machine learning models could be used to either predict performance for a given network and configuration, or to evaluate what-if scenarios (e.g. what is the performance if a link is removed or if the routing configuration is X or Y).
It will thus be appreciated that there is a desire for a solution for network analysis. The present principles provide such a solution.
SUMMARY OF DISCLOSURE
In a first aspect, the present principles are directed to a method comprising obtaining a network model for predicting a characteristic of a network, the network model comprising three bipartite graphs corresponding to a topology of the network, wherein a first bipartite graph connects each path in the network to links the path uses in the network, a second bipartite graph connects each link in the network to nodes that define the link, and a third bipartite graph connects each path in the network to the nodes that define the path, wherein each vertex of the bipartite graphs contains a state, injecting parameters of the network and load in the network into the network model, performing T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices, combining the state of every path to obtain a prediction of the characteristic, and outputting the prediction of the characteristic.
In a second aspect, the present principles are directed to an apparatus comprising memory and a processor configured to obtain a network model for predicting a characteristic of a network, the network model comprising three bipartite graphs corresponding to a topology of the network, wherein a first bipartite graph connects each path in the network to links the path uses in the network, a second bipartite graph connects each link in the network to nodes that define the link, and a third bipartite graph connects each path in the network to the nodes that define the path, wherein each vertex of the bipartite graphs contains a state, inject parameters of the network and load in the network into the network model, perform T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices, combine the state of every path to obtain a prediction of the characteristic, and output the prediction of the characteristic.
In a third aspect, the present principles are directed to a computer program product which is stored on a non-transitory computer readable medium and includes program code instructions executable by a processor for implementing the steps of a method according to any embodiment of the first aspect.
BRIEF DESCRIPTION OF DRAWINGS
Features of the present principles will now be described, by way of non-limiting example, with reference to the accompanying drawings, in which:
FIG. 1 illustrates the present principles generally; Error! Reference source not found. illustrates an example of input network topology for use with the present principles; FIG. 3 illustrates a bipartite graph Gp,l from paths to links for the input network topology illustrated in FIG.2; FIG. 4 illustrates the bipartite graph Gl,n from links to nodes for the input network topology illustrated in FIG.2; FIG. 5 illustrates the bipartite graph Gp,n from paths to nodes for the input network topology illustrated in FIG.2; FIG.6 illustrates a typical example of the prediction that can be made and the type of input that can be used for the prediction according to the present principles; FIG. 7 illustrates an analysis system according to an embodiment of the present principles; and FIG.8 illustrates a method in a 5G network according to the present principles. DESCRIPTION OF EMBODIMENTS It will be appreciated that it desirable to provide a solution that adequately can estimate performance metrics given a network snapshot (e.g. a network topology, a network configuration which includes routing and priority configuration). In general terms, the present principles, generally illustrated in Error! Reference source not found., should be able to predict performance metrics given: (i) a network topology, (ii) a network configuration or more generally properties of the physical/target network, and (iii) a description of the workload (e.g. network or electricity flows) carried on the physical/target network. For example, in the case of a communication network, the present principles, illustrated in FIG. 6, may predict the resulting per-source- destination mean per-packet delay (or other metrics such as throughput, packet loss etc.) given: (i) a network topology, (ii) a network configuration (routing, queue scheduling), and (iii) a source-destination traffic matrix. Generally speaking, the present principles use a graph neural network that relies on three bipartite graphs, Gp,l, Gl,n, Gp,n, where paths (a path is defined by a source and destination node and the path traverses a series of nodes), nodes and links of the physical network are represented as vertices: ● Gp,l connects each path to the links it is made up of, ● Gl,n connects each link to the two nodes that define the link, and ● Gp,n connects each path to the nodes it traverses. Each vertex of the above graphs has a hidden state (also called ‘embedding,’ the terms can be used interchangedly). As will be described, the hidden state is learned during a training phase using message passing convolutions between vertices. Message passing convolutions between the vertices is used during inference: the current network topology (real, i.e. physical, or modelled) defines the topology of the graphs Gp,l, Gl,n, Gp,n; the network parameters and load are injected into the above graphs and each vertex updates the parameters using its hidden state and passes the result to its neighbours (each neighbour aggregating the received messages). The final prediction combines the resulting outputs using a fully connected layer. As will also be described, the present principles can be applied to communication networks using Software Defined Networking (SDN), in particular to predict per-source-destination mean per-packet delay. As will also be described, the present principles can be applied to 3GPP communication networks, in particular to predict network performance within the Network Data Analytics Function (NWDAF). A Session Management Function (SMF) may reconfigure the 3GPP network (e.g. by allocating resources or reconfiguring PDU-session) according to the predicted network performance. In a variant of the present principles, during interference the system can test different network topologies and network configurations to execute what-if scenarios. The system can choose the best result and configure the network accordingly. In another variant of the present principles, each node of the physical network hosts vertices of the graphs Gp,l, Gl,n, Gp,n. During inference a node transmits on the physical network a message containing the messages of the machine-learning message-passing algorithm. Deep learning model The present principles are based on a deep learning model capable of estimating per-path performances for arbitrary network topologies. First will be described how to model problem inputs in a way suitable for deep learning (and more specifically graph neural networks), then the full model architecture will be detailed and finally how embeddings are aggregated. Modelization Problem inputs are modelled using three entities: nodes (vertices of the network), links (edges of the network) and finally paths (extracted from routing configuration and network topology for each source-destination pairs of nodes). It is noted that the network can be a real, physical network or a model of a network (a.k.a. “target network”), such as a future network or a network resulting from a what-if scenario. Three bipartite graphs are constructed for the network: ● Gp,l uses paths and links as vertices. There is one edge between path ^ and link ^ if and only if ^ passes through link . ● Gl,n uses links and nodes as vertices. For every link, there is one edge to the node that is at one side of the link, and another edge to the node that is at the other side of the link. ● Gp,n uses paths and nodes as vertices. There is one edge between path ^ and node ^ if and only if ^ passes through node . Start and end nodes are included for each path. Error! Reference source not found. illustrates an example of input network topology (the physical network, such as a communication network or a power grid) with nodes A, B, C and links 1 to 4. Paths from X to Y are denoted XY (in this example path BC is constructed by following links 2 and 3 via A). Error! Reference source not found., 4 and 5 depict the three bipartite graphs constructed from the example network topology in Error! Reference source not found.: FIG. 3 illustrates the bipartite graph Gp,l from paths to links, FIG.4 illustrates the bipartite graph Gl,n from links to nodes, and FIG.5 illustrates the bipartite graph Gp,n from paths to nodes. For a bipartite graph, the neighbours of i, NST(I) are defined as the indices j of vertices where (j, i) is an edge in GS,T. Conversely, NST(I) is defined as the indices j of vertices where (ij) is an edge in GS,T. For instance, the following equalities arise from FIG. 4:
• The neighbours of link 1 are nodes A and B, i.e Ni, n(1) = {A; B]
• The neighbours of node A are links 1 to 4, i.e
Figure imgf000007_0002
Model architecture
Paths, links and nodes all have a hidden state (“embedding”), updated in the model by an iterative process (repeated a configurable number of times, T). From the hidden state, it is possible to extract the final per-path predictions. The general architecture of the model is described as follows:
1. Initialization a. pi is defined as the initial hidden state of path i b. lt is defined as the initial hidden state of link i c. ni is defined as the initial hidden state of node i
2. Computation a. Repeat T times: i. For every link update as a combination of its current value
Figure imgf000007_0014
Figure imgf000007_0013
and the aggregation of every such that j
Figure imgf000007_0001
This
Figure imgf000007_0012
corresponds to one “message passing” where p7 is the message being passed. ii. For every node i, update nt as a combination of its current value and the aggregation of every such that This
Figure imgf000007_0011
Figure imgf000007_0003
corresponds to one “message passing” where is the message
Figure imgf000007_0004
being passed. iii. For every link
Figure imgf000007_0008
update as a combination of its current value
Figure imgf000007_0009
and the aggregation of every such that This
Figure imgf000007_0010
Figure imgf000007_0005
corresponds to one “message passing” where n7 is the message being passed. iv. For every path i, update pt as a combination of its current value and the aggregation of every such that This
Figure imgf000007_0006
Figure imgf000007_0007
corresponds to one “message passing” where lj is the message being passed. b. For every path i, update pt as a combination of this current value and the aggregation of every nt such that
Figure imgf000008_0002
c. Combine every path’s hidden state pt to the desired predictions yt
When updating hidden states, the present principles use “aggregation” and “combination” as generic functions. Examples of “aggregation” operations suitable for deep learning are provided hereinafter in “Hidden state aggregation”. In neural networks, “combination” is typically a single fully-connected layer, but multiple fully- connected layers can be chained with non-linear activation functions between them.
In the parlance of graph neural networks, every step in 2. a and step 2.b is a convolution operation, aggregating hidden states from multiples edges in the invention’s bipartite graphs to return updated hidden states.
As in every machine learning model, a training phase is required to learn a set of functions and parameters. According to the present principles, the same architecture is used during training and inference; during training the functions “aggregation” and “combination” are learnt and require access to input and output parameters. In other words, in order to train a model, the system requires the value of the performance metric to be predicted, a network topology, a network configuration or more generally properties of the physical or target network, and a description of the workload (e.g. network or electricity flows) carried on the physical or target network
Hidden state aggregation
The present principles can be used with any suitable kind of aggregation function, as long as the said function accepts a variable number of arguments. In the literature of graph neural network convolutions, the “Global Sum” function is largely used. For instance, the aggregation operation in 2. a. i can be:
Figure imgf000008_0001
Min, Max, Average and Standard deviation functions can also be used in the aggregation. It is also possible to use several of these functions and concatenate their results. However, a drawback of these functions is that changing the order of the inputs does not change the result (i.e. information about input order is lost).
As another example, recurrent neural networks can be used as aggregation functions when the order of input conveys important information. In the present principles, paths can be defined as ordered lists of links and/or ordered lists of nodes. When aggregating links hidden states in 2.a.iv, it is possible to feed the hidden states to a recurrent neural network (e.g. containing Long Short-Term Memory, LSTM, or Gated Recurrent Unit, GRU, layers) in the order defined by the path. Taking the example of path BC in FIG. 2, this means first feeding link 2 and then link 3 to the recurrent neural network. The same logic applies to step 2.b.
Application to communication networks
Software-Defined Networks (SDN) is the concept of orchestrating and controlling communication networks using software/controller nodes. With SDN, networking tasks such as routing, policy decisions etc. are orchestrated from a centralized control plane (using e.g. a central controller), which may leverage the network information (including the network topology, the network state such as the current traffic workload and other performance metrics) in order to operate networks efficiently and dynamically adapt to changes in the network. An SDN controller can for example be used to define the routes to be used for a given traffic flow based on observed packet delays and packet loss. However, if such decisions are solely based on the observed metrics (e.g. packet delay and packet loss) the decisions often come too late. Therefore, it is desirable to predict some network metrics (such as the packet delay and the packet loss) using a predictive model and based on the prediction take actions that would improve (e.g. reduce) the packet loss or the packet delay.
FIG. 6 illustrates a typical example of the prediction that can be made and the type of input that can be used for the prediction according to the present principles. In the example, the neural network model takes as input a network topology, a traffic matrix and network configuration and outputs a per-source-destination mean delay for the network. In a variant of the present principles consists, the graph neural network predictive model already described is implemented in a SDN network controller. In this variant, the SDN controller has knowledge of the topology of the network it controls, i.e. the SDN controller stores or has access to information regarding the set of networking routers and the possible networking links between these routers. The SDN controller also knows the configured routes of the routers. Such information can be provided via manual configuration by an administrator, but it is also possible to use automatic means to provide the information to the SDN controller, such as letting the routers send messages to the SDN controller in order to inform the SDN controller of their presence. The routers may also announce the neighbouring routers to the SDN controller, thereby providing link information to the SDN controller. The routers may also announce their configured routes to the SDN controller, thereby providing a complete routing matrix to the SDN controller.
Each router may have parameters regarding its configuration which may be reported to the SDN central controller by the routers, such as:
• levelsQoS: number of supported QoS classes,
• queueSizes: queue sizes (in number of packets) for each output queue of the node, where values are separated by commas and where each value is associated with a QoS queue,
• schedulingPolicy: policy used to serve the QoS queues, the policy may be one of: ‘FIFO’ (First-In, First-Out), ‘SP’ (Strict Priority), ‘WFQ’ (Weighted Fair Queuing), and ‘DRR’ (Deficit Round Robin); if not specified, a ‘FIFO’ policy is considered by default, and
• schedulingWeights: list of weights separated by commas associated with each QoS queue; used only for the WFQ and DRR scheduling policies.
Each link may have parameters regarding its configuration or capacity to be collected by the SDN controller, such as:
• port: port number of the source node that links with destination node, and
• bandwidth: link bandwidth (bits/time unit). Based on the information on routers (equivalent to “nodes”), links between routers (equivalent to “links”) and the routing matrix (equivalent to “path”) the SDN controller can construct the three graphs:
• Gp,i connects each path to the links it uses,
• Gi,n connects each link to the two nodes that define the link, and
• Gp,n connects each path to the nodes it traverses.
The SDN controller can further collect measurements from the network infrastructure regarding traffic and network load. Routers may inform the SDN controller of existing network traffic and flows. Mechanisms and protocols such as netflow may for instance be used to this end. A traffic flow is characterized by source and destination (and a set of routers it traverses). Further, a flow may be characterized by bandwidth used, packet size distribution, etc.
The SDN controller can for instance collect at least some of the following flow- related information for each flow between a source node and a destination node:
• TimeDis: inter-packet arrival time distribution.
• TimeDistParams: dictionary with parameters of the specific inter-packet arrival time distribution: o EqLambda: average bitrate per time unit (bits/time unit). o AvgPktsLambda: average number of packets of average size generated per time unit (packets/time unit). o MinPktLambda: minimum number of packets generated per time unit (packets/time unit). o MaxPktLambda: maximum number of packets generated per time unit (packets/time unit). o StdDev: Standard deviation of the interarrival time (used in the normal distribution). o PktsLambdaOn: Average packets per time unit generated during the ON period (packets/time unit). o AvgTOff: Average duration of the OFF period. The duration of every OFF period is modeled with an exponential distribution of average = AvgTOff. o AvgTOn: Average duration of the ON period. The duration of every ON period is modeled with an exponential distribution of average = AvgTOn. o ExpMaxFactor: Factor used to define an upper bound for exponential distributions. The upper bound is defined as: ExpMaxFactor * lambda of the exponential. o BurstGenLambda: Burst generation rate of the flow (bursts/time unit). o Bitrate: Bitrate during a burst: (bits/time unit). o ParetoMinSize: Minimum number of bits in the burst (bits). o ParetoMaxSize: Maximum number of bits in the burst (bits). o ParetoAlfa: Shape parameter (a) used in the Pareto distribution.
• SizeDist: packet size distribution used for the flow.
• SizeDistParams: dictionary with the parameters of the specific size distribution: o AvgPktSize: Average packet size (bits). o MinSize: Minimum packet size (bits). o MaxSize: Maximum packet size (bits). o PktSizel : First packet size option (bits). o PktSize2: Second packet size option (bits). o NumCandidates: Number of different packets size considered. o SizeJ: Size of the candidate packet i (bits). o ProbJ: Probability to select candidate packet i (bits).
• AvgBw: average bandwidth for this flow (bits/time unit).
• PktsGen: packets generated by this flow per time unit (packets/time unit).
• ToS: Type of Service associated to this flow defined as an integer.
The SDN controller can also collect aggregated information regarding traffic measurements for a specific source and destination pair, for example:
• AvgBw: average bandwidth from node src to node dst (bits/time unit).
• PktsGen: packets generated from node src to node dst per time unit (packets/time unit). The SDN controller can predict network metrics by using the described machine learning model, trained either on the same network and topology or on another network and topology.
For the network metric prediction, the SDN controller initializes each vertex of the graphs Gp,i, Gi,n, Gp,n with the metrics and parameters collected by the SDN controller for each of the corresponding router, link or path. As has been described, the model employs message passing convolutions (i.e. passing the result of a vertex to its neighbors, each aggregating the received messages). The final prediction combines the resulting outputs using a fully connected layer.
The SDN controller may predict different kind of metrics, for example:
• PktsDrop: packets dropped per time unit over a path defined by a source and destination pair.
• AvgDelay: average per-packet delay over the packets transmitted on path defined by a source and destination pair.
• p10, p20, p50, p80, and p90: percentiles (10, 20, 50, 80, and 90) of the per- packet delay distribution on path defined by a source and destination pair.
• Jitter: Variance of the per-packet delay over the packets transmitted on path defined by a source and destination pair.
What-if scenarios
In a variant of the present principles, the SDN controller tests different paths using the prediction model. This can for example be done to simulate node failure, and different node or link characteristics.
The SDN controller may for instance test different routing matrices, constructing multiple versions of the graphs Gi,n and GP,n and provide a network metric prediction for each routing matrix. By comparing the different prediction results, the SDN controller can pick the best result (e.g. the lowest latency) and reconfigure the communication network accordingly.
The SDN controller may for instance test different router configurations, e.g. by changing one or more of the parameters in the prediction model, such as levelsQoS, queueSizes, schedulingPolicy and schedulingWeights. This can be achieved by initiating the hidden states with the tested values. Doing so, the SDN controller can generate predictions for each configuration and choose the configuration that provided the best prediction (e.g. lowest latency, lowest packet drop, smallest jitter). Based on this prediction, the SDN controller can reconfigure the routers accordingly.
FIG. 7 illustrates a network analysis system according to an embodiment of the present principles. In the embodiment, the system 700 is centralized and includes a computing device 710 and a display 720 for displaying results. The computing device 710 includes a user interface 711 (that can be implemented with the display 720 as a touchscreen) configured to receive user input, at least one hardware processor 712 configured to perform calculations described herein, memory 713 configured to store program code, (intermediate) results, etc. and an input/output (I/O) interface 714 configured for communication with external devices, for example network nodes. Also illustrated is a non-transitory computer-readable storage medium storing instructions that, when executed, cause the at least one hardware processor to perform at least one method of the present principles.
Application to 3GPP communication networks
In a variant of the present principles, the graph neural network predictive model already described is implemented in the Network Data Analytics Function (NWDAF). In this variant, the NWDAF has knowledge of the topology of the 3GPP network (e.g. the set of User Plane Functions (UPFs) of a 3GPP core network), i.e. the NWDAF controller stores or has access to information regarding the set of UPFs and the possible networking links between these UPFs. The NWDAF also knows the configured routes of the UPFs (e.g. the set of configured and used Protocol Data Unit (PDU) sessions). Such information (e.g. the configured routes) may be provided by the Session Management Function (SMF), as it is the SMF defines and configures the PDU-session therefore defining routing policy.
It is also possible to use other automatic means to provide the information to the NWDAF, such as letting the UPF send messages to the NWDAF in order to inform the NWDAF of its presence. The UPFs may also announce the neighbouring UPFs to the NWDAF, thereby providing link information to the NWDAF. The UPFs may also announce their configured routes to the NWDAF, thereby providing a complete routing matrix to the NWDAF. Finally, such information may alternatively also be provided via manual configuration by an administrator.
Each UPF may have parameters regarding its configuration and load which may be reported to the NWDAF by the UPF, such as:
• number of flows handled,
• QoS Enforcement Rules (QER) applied by the UPF,
• UPF specific configuration rules (which may be vendor specific),
• queueSizes: queue sizes (in number of packets) for each output queue of the node, where values are separated by commas and where each value is associated with a QoS queue,
• schedulingPolicy: policy used to serve the QoS queues, the policy may be one of: ‘FIFO’ (First-In, First-Out), ‘SP’ (Strict Priority), ‘WFQ’ (Weighted Fair Queuing), and ‘DRR’ (Deficit Round Robin); if not specified, a ‘FIFO’ policy is considered by default,
• schedulingWeights: list of weights separated by commas associated with each QoS queue; used only for the WFQ and DRR scheduling policies, and
• traffic usage report (report of user plane traffic in the UPF for the accumulated usage of network resources (see TS 29.244 [17]))
Each link may have parameters regarding its configuration or capacity to be collected by the NWDAF, such as:
• port: port number of the source node that links with the destination node, and
• bandwidth: link bandwidth (bits/time unit).
Based on the information on UPFs (equivalent to “nodes”), links between UPFs (equivalent to “links”) and the routing matrix (equivalent to “path”) the NWDAF can construct the three graphs:
• Gp,i connects each path to the links it uses,
• Gi,n connects each link to the two nodes that define the link, and
• Gp,n connects each path to the nodes it traverses.
The NWDAF can further collect measurements from the network infrastructure regarding traffic and network load. UPFs may inform the NWDAF of existing network traffic and flows. The NWDAF may expose a specific API for this purpose. A traffic flow is characterized by source and destination (and a set of routers it traverses). Further, a flow may be characterized by bandwidth used, packet size distribution, etc.
The NWDAF can for instance collect at least some of the following flow-related information for each flow between a source node and a destination node:
• QoS parameters per flow according to 5G QoS Identifier (5QI): o Resource Type (Guaranteed Bit Rate (GBR), Delay critical GBR or Non- GBR); o Priority level; o Packet Delay Budget; o Packet Error Rate; o Averaging window (for GBR and Delay-critical GBR resource type only); o Maximum Data Burst Volume (for Delay-critical GBR resource type only). • Flow bitrates: o Guaranteed Flow Bit Rate (GFBR) - Uplink (UL) and Downlink (DL); o Maximum Flow Bit Rate (MFBR) - UL and DL.
• The NWDAF may also collect at least some of the following flow related information:
Figure imgf000017_0001
The NWDAF can predict network metrics by using the described machine learning model, trained either on the same network and topology or on another network and topology.
For the network metric prediction, the NWDAF initializes each vertex of the graphs GP,i, Gi.n, GP,n with the metrics and parameters collected by the NWDAF for each of the corresponding router, link or path. As has been described, the model employs message passing convolutions (i.e. passing the result of a vertex to its neighbors, each aggregating the received messages). The final prediction combines the resulting outputs using a fully connected layer. The NWDAF may predict different kind of metrics, for example:
• PktsDrop: packets dropped per time unit over a path defined by a source and destination pair.
• AvgDelay: average per-packet delay over the packets transmitted on a path defined by a source and destination pair. • p10, p20, p50, p80, and p90: percentiles (10, 20, 50, 80, and 90) of the per-packet delay distribution on a path defined by a source and destination pair.
• Jitter: Variance of the per-packet delay over the packets transmitted on a path defined by a source and destination pair.
FIG. 8 illustrates a method in a 5G network according to the present principles.
In step S810, a SMF 801 provides network configuration information to a NWDAF 803. The network configuration information can relate to the currently deployed network or to a non-existent network to be tested. As explained, the network configuration information can for example include links, routes, PDU session, load information and router configurations.
In alternate or complementary step S820, a UPF 805 provides network information to the NWDAF 803. As explained, the network information can for example include information about the UPF 805, configurations, links, neighboring UPF and network load information.
In step S830, the NWDAF uses the received information to generate a model, for example a GNN model, as explained.
In step S840, the SMF 801 sends a request for a performance prediction to the NWDAF 803. The request can for example relate to delays in the network.
In step S850, the NWDAF 803 predicts, based on information received in for example step S810 and/or step S820, a performance of the network to answer the request.
In step S860, the NWDAF 803 sends a corresponding prediction result to the SMF 801.
In step S870, acting on the prediction result, the SMF 801 can, change or request changes of the UPF configuration based on the prediction result. What-if scenarios
In a variant of the present principles, a networking function (e.g. the SMF) tests different paths using the prediction service exposed by the NWDAF. This can for example be done to simulate different choices before assigning a PDU-session to one or another UPF.
The SMF submits a prediction request to the NWDAF with at least one configuration (e.g. terminating a PDU-session on UPF A). The NWDAF response with a prediction of a network performance metric. Based on this response the SMF decides to apply this configuration, to test another configuration or to do nothing.
Distributed implementation
So far, the present principles have been described for a centralized implementation, that is, an implementation where a single computing architecture (e.g. computing device such as a computer) performs the computations. In practice, the invention may be fully or partially implemented directly in the physical network/topology, in a distributed setting. Possible advantages of this include a reduced the number of messages transmitted by the network (e.g. to provide network metrics or configurations) and removal of the need for a potentially large bandwidth at the central server. A distributed implementation may also be desirable if the invention is applied to an infrastructure owned by multiple operators, as this would limit information shared between competing operators. It will be appreciated that in a distributed implementation, each computing architecture can be implemented essentially like the system illustrated in FIG. 7.
To illustrate this, two possible implementations will be described: a partially distributed one, and a completely distributed one.
Three embeddings are computed: link embeddings I, node embeddings n and path embeddings p.
Partially distributed implementation
In this implementation, only link and node embeddings are distributed over the computing resources c located in the nodes of the physical/target network. Different embeddings can be allocated to each computing resource. Then, each resource ct is responsible for the update of the embeddings and for the transmission of the updated embeddings to a central processing architecture a and to other relevant computing resources.
The distributed implementation can work as follows:
1. Initialization: a. Each resource q is attributed the embedding nt of the associated topological node. b. Each link embedding lj is attributed to a resource ct among the resources that have been associated to the source and/or the destination of the link. c. Parameters of the graph neural network are sent to the resources (e.g. the trained model, hyperparameters etc). d. Each resource q stores, for each embeddings it is responsible for, the resources to which q should send an updated value of the embedding. i. For node embedding, these are all resources responsible for links originating or ending in that node (iterative process) ii. For link embedding, these are all computing resources that are responsible for a node in that link and/or a path containing that link (iterative process) iii. For path embedding, these are all computing resources that are responsible fora link in that path (iterative process) and all nodes contained in that path (final computation)
2. Computation: a. The described inference algorithm. Every step in the algorithm that consists in the computation of an embedding is extended as follows. After an embedding has been computed by a resource q, the value of this embedding is sent to the appropriate computing resources. Before computing an embedding, a resource q waits to receive the necessary values.
For step 1 .a: if any topological node does not have an associated computing resource, this node is associated with another computing resource. This can for example be performed directly by the central processing architecture, based on node proximity etc. In step 1.b: link embedding attribution can either be performed directly by the central processing architecture; by a specific rule, for example the resource responsible for the source (alternatively, the destination) of a link is responsible for the embedding of that link; by communication and agreement between the nodes; or by any other appropriate method.
Step 1 .c: These parameters may for example be loaded from memory or may be broadcasted by the central computing resource a.
Step 1.d corresponds to the distribution of the structure of the three bipartite graphs.
Step 2. a can be done synchronously: the main algorithm moves to the next step only when all embeddings of a given type have been updated. It can also be done asynchronously: as soon as a resource q has received all (alternatively, some) values (of other embeddings) necessary to update one embedding it is responsible for, it computes this embedding and sends it to the appropriate computing resources.
Fully distributed implementation
In this implementation, the computation of the embeddings is distributed. The distributed implementation could work as follows:
1. Initialization: a. Each resource ct is attributed the embedding nt of the associated topological node. b. Each link embedding lj is attributed to a resource q among the resources that have been associated to the source and/or the destination of the link. c. Each path embedding pk is attributed to a resource q among the resources that have been associated to at least one node or link in the path. d. Parameters of the graph neural network are loaded by the resources. e. Each resource q stores, for each of the embeddings it is responsible for, the resources to which q must send an updated value of the embedding. i. For node embedding, these are all resources responsible for links originating or ending in that node (iterative process). ii. For link embedding, these are all computing resources that are responsible for a node in that link and/or a path containing that link (iterative process). iii. For path embedding, these are all computing resources that are responsible for a link in that path (iterative process) and all nodes contained in that path (final computation).
2. Computation: a. The described inference algorithm. Every step in the algorithm that consists in the computation of an embedding is extended as follows. After an embedding has been computed by a resource q, the value of this embedding is sent to the appropriate computing resources. Before computing an embedding, a resource ct waits to receive the necessary values.
Step 1 .ccan for example be performed according to a specific rule, for example the resource responsible for the largest number of nodes or links in the path is responsible for the embedding of the path; resource responsible for similar paths are more likely to be responsible for a path; or by any other appropriate method.
It will thus be appreciated that the present principles can be used to provide solutions for network analysis that, for example, can predict performance or evaluate what-if scenarios.
It should be understood that the elements shown in the figures may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces. The present description illustrates the principles of the present disclosure. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the disclosure and are included within its scope.
All examples and conditional language recited herein are intended for educational purposes to aid the reader in understanding the principles of the disclosure and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions.
Moreover, all statements herein reciting principles, aspects, and embodiments of the disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e. , any elements developed that perform the same function, regardless of structure.
Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative circuitry embodying the principles of the disclosure. Similarly, it will be appreciated that any flow charts, flow diagrams, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, read only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage. Other hardware, conventional and/or custom, may also be included. Similarly, any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
In the claims hereof, any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function. The disclosure as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.

Claims

1 . A method comprising: obtaining a network model for predicting a characteristic of a network, the network model comprising three bipartite graphs corresponding to a topology of the network, wherein a first bipartite graph connects each path in the network to links the path uses in the network, a second bipartite graph connects each link in the network to nodes that define the link, and a third bipartite graph connects each path in the network to the nodes that define the path, wherein each vertex of the bipartite graphs contains a state; injecting parameters of the network and load in the network into the network model; performing T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices; combining the state of every path to obtain a prediction of the characteristic; and outputting the prediction of the characteristic.
2. The method of claim 1 , wherein performing T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices comprises: updating the state of every link in the first bipartite graph as a combination of its current state and an aggregation of states of its neighbouring paths; updating the state of every node in the second bipartite graph as a combination of its current state and an aggregation of states of its neighbouring links; updating the state of every link in the second bipartite graph as a combination of its current state and an aggregation of states of its neighbouring nodes; and updating the state of every path in the first bipartite graph as a combination of its current state and an aggregation of states of its neighbouring links; and wherein combining the state of every path comprises, after the T iterations, updating the state of every path in the third bipartite graph as a combination of its current state and an aggregation of states of its neighbouring nodes.
3. The method of claim 1 , wherein the network model is a graph neural network.
4. The method of claim 3, wherein the graph neural network is implemented in a data analytics function of a telecommunication network, wherein the graph neural network represents a topology of the telecommunication network.
5. The method of claim 4, wherein the data analytics function is a NWDAF in a 3GPP network.
6. The method of claim 4, wherein a node in the graph neural network corresponds to a User Plane Function, UPF, in the telecommunication network.
7. The method of claim 6, wherein the data analytics function stores information about possible links between the UPFs.
8. The method of claim 6, wherein the data analytics function receives reports from UPFs, a report comprising at least one of, number of flows handled by the UPF, Quality of Service Enforcement Rules applied by the UPF, UPF configuration rules, queue sizes for each output queue of the UPF, a policy used to serve Quality of Service queues of the UPF, user plane traffic in the UPF.
9. The method of claim 6, wherein the data analytics function receives, from a Session Management Function, SMF, at least one report concerning a UPF, the report comprising at least one of: a number of flows handled by the UPF, Quality of Service Enforcement Rules applied by the UPF, UPF configuration rules, queue sizes for each output queue of the UPF, a policy used to serve Quality of Service queues of the UPF, user plane traffic in the UPF.
10. The method of claim 4, wherein a characteristic is one of packets dropped per time unit over a path defined by a source and destination pair, average per-packet delay over the packets transmitted on path defined by a source and destination pair, percentiles of per-packet delay distribution on a path defined by a source and destination pair, variance of per-packet delay over packets transmitted on a path defined by a source and destination pair.
11. The method of claim 1 , wherein the network model corresponds to an existing network.
12. An apparatus comprising memory and a processor configured to: obtain a network model for predicting a characteristic of a network, the network model comprising three bipartite graphs corresponding to a topology of the network, wherein a first bipartite graph connects each path in the network to links the path uses in the network, a second bipartite graph connects each link in the network to nodes that define the link, and a third bipartite graph connects each path in the network to the nodes that define the path, wherein each vertex of the bipartite graphs contains a state; inject parameters of the network and load in the network into the network model; perform T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices; combine the state of every path to obtain a prediction of the characteristic; and output the prediction of the characteristic.
13. The apparatus of claim 12, wherein being configured to perform T iterations of updating the states of at least some of the vertices based on current states of the vertices and states of neighbour vertices comprises being configured to: update the state of every link in the first bipartite graph as a combination of its current state and an aggregation of states of its neighbouring paths; update the state of every node in the second bipartite graph as a combination of its current state and an aggregation of states of its neighbouring links; update the state of every link in the second bipartite graph as a combination of its current state and an aggregation of states of its neighbouring nodes; and update the state of every path in the first bipartite graph as a combination of its current state and an aggregation of states of its neighbouring links; and wherein being configured to combine the state of every path comprises, after the T iterations, comprises being configured to update the state of every path in the third bipartite graph as a combination of its current state and an aggregation of states of its neighbouring nodes.
14. The apparatus of claim 12, wherein the network model is a graph neural network.
15. The apparatus of claim 14, wherein the apparatus is a data analytics function of a telecommunication network, wherein the graph neural network represents a topology of the telecommunication network.
16. The apparatus of claim 15, wherein the data analytics function is a NWDAF in a 3GPP network.
17. The apparatus of claim 15, wherein a node in the graph neural network corresponds to a User Plane Function, UPF, in the telecommunication network.
18. The apparatus of claim 17, wherein the data analytics function stores information about possible links between the UPFs.
19. The apparatus of claim 17, wherein the data analytics function receives reports from UPFs, a report comprising at least one of, number of flows handled by the UPF, Quality of Service Enforcement Rules applied by the UPF, UPF configuration rules, queue sizes for each output queue of the UPF, a policy used to serve Quality of Service queues of the UPF, user plane traffic in the UPF.
20. The apparatus of claim 17, wherein the data analytics function receives, from a Session Management Function, SMF, at least one report concerning a UPF, the report comprising at least one of: a number of flows handled by the UPF, Quality of Service Enforcement Rules applied by the UPF, UPF configuration rules, queue sizes for each output queue of the UPF, a policy used to serve Quality of Service queues of the UPF, user plane traffic in the UPF.
21 . The apparatus of claim 15, wherein a characteristic is one of packets dropped per time unit over a path defined by a source and destination pair, average per-packet delay over the packets transmitted on path defined by a source and destination pair, percentiles of per-packet delay distribution on a path defined by a source and destination pair, variance of per-packet delay over packets transmitted on a path defined by a source and destination pair.
22. The apparatus of claim 12, wherein the network model corresponds to an existing network.
23. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one hardware processor to perform a method of claim 1.
PCT/EP2021/081460 2020-11-16 2021-11-12 Method and system for predicting a network characteristic Ceased WO2022101378A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP20306390.4 2020-11-16
EP20306390 2020-11-16

Publications (1)

Publication Number Publication Date
WO2022101378A1 true WO2022101378A1 (en) 2022-05-19

Family

ID=73554403

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2021/081460 Ceased WO2022101378A1 (en) 2020-11-16 2021-11-12 Method and system for predicting a network characteristic

Country Status (1)

Country Link
WO (1) WO2022101378A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115865762A (en) * 2023-03-03 2023-03-28 上海人工智能网络系统工程技术研究中心有限公司 Spatial information network flow prediction method and scheduling system based on SDN framework
CN116827658A (en) * 2023-07-17 2023-09-29 青岛启弘信息科技有限公司 AI intelligent application security situation awareness prediction system and method
WO2024096775A1 (en) * 2022-11-02 2024-05-10 Telefonaktiebolaget Lm Ericsson (Publ) Methods and apparatuses for training and using a graph neural network
CN121486266A (en) * 2025-11-18 2026-02-06 西安电子科技大学 A video routing optimization method and apparatus based on graph neural networks

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140317033A1 (en) * 2013-04-23 2014-10-23 International Business Machines Corporation Predictive and descriptive analysis on relations graphs with heterogeneous entities
US20190349287A1 (en) * 2018-05-10 2019-11-14 Dell Products L. P. System and method to learn and prescribe optimal network path for sdn
CN111314171A (en) * 2020-01-17 2020-06-19 深圳供电局有限公司 Method, device and medium for predicting and optimizing SDN routing performance

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140317033A1 (en) * 2013-04-23 2014-10-23 International Business Machines Corporation Predictive and descriptive analysis on relations graphs with heterogeneous entities
US20190349287A1 (en) * 2018-05-10 2019-11-14 Dell Products L. P. System and method to learn and prescribe optimal network path for sdn
CN111314171A (en) * 2020-01-17 2020-06-19 深圳供电局有限公司 Method, device and medium for predicting and optimizing SDN routing performance

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
KRZYSZTOF RUSEK ET AL: "Unveiling the potential of Graph Neural Networks for network modeling and optimization in SDN", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 28 October 2019 (2019-10-28), XP081932165, DOI: 10.1145/3314148.3314357 *
MING GAO ET AL: "Learning Vertex Representations for Bipartite Networks", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 16 January 2019 (2019-01-16), XP081626090 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024096775A1 (en) * 2022-11-02 2024-05-10 Telefonaktiebolaget Lm Ericsson (Publ) Methods and apparatuses for training and using a graph neural network
CN115865762A (en) * 2023-03-03 2023-03-28 上海人工智能网络系统工程技术研究中心有限公司 Spatial information network flow prediction method and scheduling system based on SDN framework
CN116827658A (en) * 2023-07-17 2023-09-29 青岛启弘信息科技有限公司 AI intelligent application security situation awareness prediction system and method
CN116827658B (en) * 2023-07-17 2024-01-16 青岛启弘信息科技有限公司 AI intelligent application security situation awareness prediction system and method
CN121486266A (en) * 2025-11-18 2026-02-06 西安电子科技大学 A video routing optimization method and apparatus based on graph neural networks
CN121486266B (en) * 2025-11-18 2026-05-01 西安电子科技大学 Video route optimization method and device based on graph neural network

Similar Documents

Publication Publication Date Title
US11082290B2 (en) Method and apparatus for optimizing a software defined network configuration
US10091093B2 (en) Multi-controller control traffic balancing in software defined networks
EP3047609B1 (en) Systems and method for reconfiguration of routes
KR101864239B1 (en) Framework for traffic engineering in software defined networking
US8879393B2 (en) Quality of service (QoS) configuration for network devices with multiple queues
Paris et al. Controlling flow reconfigurations in SDN
Buyakar et al. Resource allocation with admission control for GBR and delay QoS in 5G network slices
CN109768940A (en) Traffic distribution method and device for multi-service SDN network
Al-Sadi et al. Routing algorithm optimization for software defined network WAN
Lei et al. Deploying QoS-assured service function chains with stochastic prediction models on VNF latency
Happ et al. Exploring the limitations of current graph neural networks for network modeling
Tang et al. Constructing a DRL decision making scheme for multi-path routing in all-IP access network
Choudhary et al. Multi-objective dijkstra algorithm for enhancing qos in sdn through balanced routing
CN119544605B (en) Network adjustment method, device, electronic equipment and storage medium
US20240195690A1 (en) Managing internal configuration of a communication node
Messaoudi et al. Gnn-based sdn admission control in beyond 5g networks
WO2022073583A1 (en) Distributed traffic engineering at edge devices in a computer network
CN114547832A (en) Network performance influence factor evaluation method and device based on simulation software
Angi et al. ROAR: Routing packets in P4 switches with multi-agent decisions logic
Kattepur et al. Automated Configuration of Router Port Queues via Model-Based Reinforcement Learning
Zhang et al. Towards automated network management: Learning the optimal protocol selection
Alhachem et al. A Multi-Agent Deep Reinforcement Learning Approach for Traffic Management in Complex Communication Networks
US20260067708A1 (en) Digital twin of a network
Chahlaoui et al. Towards QoS-enabled SDN networks
Lin Deep Reinforcement Learning-Based QoS Service Routing in Software-Defined Networks

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21811285

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21811285

Country of ref document: EP

Kind code of ref document: A1