WO2023213413A1 - Continuité de traçage et de retour arrière en cours de transfert d'id d'analytique et de mobilité d'ue - Google Patents

Continuité de traçage et de retour arrière en cours de transfert d'id d'analytique et de mobilité d'ue Download PDF

Info

Publication number
WO2023213413A1
WO2023213413A1 PCT/EP2022/062361 EP2022062361W WO2023213413A1 WO 2023213413 A1 WO2023213413 A1 WO 2023213413A1 EP 2022062361 W EP2022062361 W EP 2022062361W WO 2023213413 A1 WO2023213413 A1 WO 2023213413A1
Authority
WO
WIPO (PCT)
Prior art keywords
analytics
entity
network
rollback
tracing
Prior art date
Application number
PCT/EP2022/062361
Other languages
English (en)
Inventor
Apostolos KOUSARIDAS
Clarissa Marquezan
Riccardo Trivisonno
Original Assignee
Huawei Technologies Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co., Ltd. filed Critical Huawei Technologies Co., Ltd.
Priority to PCT/EP2022/062361 priority Critical patent/WO2023213413A1/fr
Publication of WO2023213413A1 publication Critical patent/WO2023213413A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08—Configuration management of networks or network elements
    • H04L41/085—Retrieval of network configuration; Tracking network configuration history
    • H04L41/0859—Retrieval of network configuration; Tracking network configuration history by keeping history of different configuration generations or by rolling back to previous configuration versions
    • H04L41/0863—Retrieval of network configuration; Tracking network configuration history by keeping history of different configuration generations or by rolling back to previous configuration versions by rolling back to previous configuration versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08—Configuration management of networks or network elements
    • H04L41/0895—Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14—Network analysis or design
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/16—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using machine learning or artificial intelligence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/34—Signalling channels for network management communication
    • H04L41/342—Signalling channels for network management communication between virtual entities, e.g. orchestrators, SDN or NFV entities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/20—Arrangements for monitoring or testing data switching networks the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV

Definitions

  • the present disclosure relates to a new generation mobile network, e.g., to a 5 th generation (5G) mobile network, and to the generation of analytics information in the mobile network.
  • the disclosure is concerned with tracing an analytics identifier (ID) or one or more analytics outputs for the analytics ID, and with performing a rollback action in case on an unstable analytics ID or at least one unstable analytics output for the analytics ID.
  • the disclosure is especially concerned with a continuity of the tracing and the rollback action, if the analytics ID is transferred from one network analytics entity to the other and/or in case of mobility of a user equipment (UE) that is associated with the analytics ID.
  • UE user equipment
  • this disclosure presents a first network analytics entity, a second network analytics entity, a network data analytics consumer entity, a network repository entity, and corresponding methods.
  • a network analytics entity like the Network Data Analytics Function (NWDAF) provides various analytics functions, which can be used by several Network Functions (NF) in the mobile network to make or improve decisions.
  • analytics information may be provided by the NWDAF to support the NFs to assist on Radio Access Technology (RAT) selection, Universal Software Radio Peripheral (USRP) update, determining a back-off timer provided to UEs etc.).
  • RAT Radio Access Technology
  • USRP Universal Software Radio Peripheral
  • Each NWDAF has its own identifier (ID), which any NF function can use to indicate the analytics output that it requests by the NWDAF.
  • the NWDAF mainly consists of two functionalities that can be part of the same NWDAF instance or can be placed at different NWDAF instances: (a) a network analytics inference entity, which is configured to provide analytics and/predictions, for instance, using trained machine learning models; (b) a network analytics training entity, which is configured to generate the machine learning models using collected data and/or a training data set.
  • the quality of the NWDAF analytics output is affected by various factors, e.g., the quality and amount of the collected data to train the model, the configuration of the machine learning model, etc. Consequently, the quality of a NWDAF machine learning model can affect the network performance or status, according to the usage of the NWDAF analytics output.
  • a successful (or an efficient, or reliable) analytics ID can lead or maintain a stable network status, while a less successful (or an inefficient, or unreliable, or unstable) analytics ID can lead to or create an unstable network status.
  • the system key performance indicators (KPIs) and/or metrics are kept within the expected pattern of usage (or improve).
  • KPIs/metrics of the system load remain at expected patterns, but KPIs indicating specific situations are unstable (or decrease from expected pattern).
  • the monitoring results can, for example, be provided from an analytics monitoring entity to other entities (e.g., an analytics tracing entity), where the indication of the quality of usage of the analytics can be evaluated (e.g., via Analytics ID Grade Information (AidGI), or indications about Unstable Analytics ID Information (UAiDI), etc.).
  • An analytics monitoring entity e.g., an analytics tracing entity
  • the indication of the quality of usage of the analytics can be evaluated (e.g., via Analytics ID Grade Information (AidGI), or indications about Unstable Analytics ID Information (UAiDI), etc.).
  • the analytics tracing entity can determine if there is a need for the update of the analytics ID (e.g., via a retraining), or also for an analytics rollback action according to the obtained analytics ID tracing activation (e.g., a low performance analytics ID, an unstable analytics ID etc.).
  • An analytics rollback action may allow a network data analytics consumer entity to receive an adequate quality of the respective NWDAF analytics output during, e.g., the retraining of the model of the analytics ID.
  • the analytics rollback action may be executed by the network analytics inference entity and/or network analytics training entity of the NWDAF.
  • a problem is that the tracing and/or rollback of an analytics ID may be interrupted, when the analytics ID is transferred from one NWDAF to a different NWDAF. Moreover, triggering multiple tracing processes for the exact same analytics ID may occur, when an analytics service is transferred from one NWDAF to a different NWDAF, and this may waste signaling.
  • an analytics ID transfer for one or more analytics subscriptions from one NWDAF to another NWDAF (or NWDAF instance) can happen due to internal triggers (e.g., NWDAF load balancing, graceful shutdown) or due to external triggers (e.g., UE mobility of a UE associated with the analytics ID, wherein the mobility causes the handover from one NWDAF to another NWDAF).
  • the subscriptions to analytics IDs with “target of Analytics Information” per UE basis can be transferred from a source NWDAF to a target NWDAF according to the definition in TS 23.288 V17.1.0 Clause 6. IB.2.
  • NFs subscribe to the NWDAF requesting analytics with “Target of Analytics Information” set to one or more specific UE (identified by their Subscription Permanent Identifier (SUPI)).
  • SUPI Subscription Permanent Identifier
  • NFs analytics consumers
  • PCF Policy Control Function
  • AMF Access and Mobility Management Function
  • SMF Session Management Function
  • SMF Session Management Function
  • this disclosure aims to provide a solution for tracing and rollback continuity in case of a transfer of an analytics ID and/or in case of UE mobility associated with the analytics ID.
  • An objective is to extend an existing analytics transfer mechanism from one network analytics entity to another network analytics entity (e.g., from a provider or source NWDAF to a consumer or target NWDAF) to support tracing and rollback.
  • Another objective is to introduce parameters for indicating analytics monitoring structures and analytics rollback structures, in order to enable the continuous usage of the tracing and rollback mechanisms for the analytics ID, which is transferred.
  • a first aspect of this disclosure provides a first network analytics entity, configured to: provide analytics tracing information to a second network analytics entity; wherein the first network analytics entity is configured to, based on the analytics tracing information, at least one of the following: trace one or more analytics outputs for an analytics identifier, ID, and/or trace the analytics ID; determine at least one unstable analytics output for the analytics ID and/or determine that the analytics ID is unstable; and determine and/or execute an inference rollback action and/or a training rollback action for the at least one unstable analytics output for the analytics ID and/or for the unstable analytics ID.
  • the analytics tracing information can be sent directly to the second network analytics entity or via another network entity (e.g., an analytics model repository entity or an analytics data repository function).
  • the analytics tracing information enables the second network analytics entity to continue the tracing and/or rollback performed by the first network analytics entity.
  • continuity in case of a transfer of the analytics ID and/or in case of UE mobility associated with the analytics ID can be provided.
  • the solution is compatible with existing analytics transfer mechanism from one network analytics entity to another network analytics entity.
  • the analytics tracing information is associated with the one or more analytics outputs for the analytics ID and/or is associated with the analytics ID.
  • the second network analytics entity may ensure continuity of tracing and/or rollback with respect to this analytics ID.
  • the analytics tracing information enables the second network analytics entity to at least one of the following: trace the one or more analytics outputs for the analytics ID and/or the analytics ID; determine at least one unstable analytics output for the analytics ID and/or the analytics ID; and determine and/or execute an inference rollback action and/or a training rollback action for the at least one unstable analytics output for the analytics ID and/or for the analytics ID.
  • the continuity of tracing and performing rollback actions at the second network analytics entity is ensured, in case the analytics ID is transferred from the first to the second network analytics entity.
  • the first network analytics entity is configured to provide to the second network entity the analytics tracing information included in an analytics subscription transfer message or in an analytics context information transfer message.
  • the first network analytics entity is configured to: receive an analytics tracing information request or an analytics context transfer request from the second network analytics entity, and provide the analytics tracing information to the second network analytics entity in response to the analytics tracing information request or the analytics context transfer request; and/or provide an analytics subscription transfer with the analytics tracing information to the second network analytics entity and receive a response of the analytics subscription transfer.
  • the analytics ID is associated with one or more user equipments, UEs; and the first network analytics entity is configured to provide the analytics tracing information to the second network analytics entity, when at least one of the one or more UEs is allocated from the first network analytics entity to the second network analytics entity.
  • the analytics ID output is associated with one or more network functions, NF; and the first network analytics entity is configured to provide the analytics tracing information to the second network analytics entity, when at least one of the one or more NFs is allocated from the first network analytics entity to the second network analytics entity.
  • the first network analytics entity and the second network analytics entity are respectively associated with a first NWDAF and a second NWDAF.
  • the inference rollback action is an action for changing an inference configuration about the at least one unstable analytics output and/or about the analytics ID at a network analytics inference entity; and the training rollback action is an action for changing a training configuration about the at least one unstable analytics output and/or about the analytics ID at a network analytics training entity.
  • the rollback action may allow reaching a stable analytics ID or analytics output for the analytics ID.
  • the first network analytics entity is further configured to provide a rollback notification related to the analytics ID based on the analytics tracing information, wherein the rollback notification comprises one or more of the at least one unstable analytics output for the analytics ID and/or the analytics ID, wherein the rollback notification is provided to a network analytics consumer entity, a network analytics inference entity, or a network analytics training entity; the inference rollback action for the at least one unstable analytics output for the analytics ID and/or for the analytics ID, wherein the rollback notification is provided to the network analytics inference entity; the training rollback action for the at least one unstable analytics output for the analytics ID and/or for the analytics ID, wherein the rollback notification is provided to the network analytics training entity.
  • the first network analytics entity is further configured to receive a rollback status notification comprising at least one of a status of the inference rollback action executed by the network analytics inference entity and a status of the training rollback action executed by the network analytics training entity.
  • the first network analytics entity may have one or both roles of the network analytics inference entity and the network analytics training entity.
  • the analytics tracing information further comprises at least one of a tracing capability of the first network analytics entity related to the analytics ID; a rollback capability of the first network analytics entity related to the analytics ID; an analytics monitoring capability of the first network analytics entity related to the analytics ID.
  • the second network analytics entity may check if/whether it can support any of provided capabilities and provide a response whether the indicated capabilities can be supported or not.
  • the analytics tracing information comprises at least one of the analytics ID; an association of the analytics ID to the one or more analytics outputs for the analytics ID; one or more quality indications about at least one of the one or more analytics outputs for the analytics ID and the analytics ID; an inference configuration about the analytics ID and/or about the one or more analytics outputs for the analytics ID; a training configuration about the analytics ID and/or about the one or more analytics outputs for the analytics ID.
  • the analytics tracing information may further comprise: a performance of the one of the one or more analytics outputs for the analytics ID and the analytics ID; and/or an accuracy of the one of the one or more analytics outputs for the analytics ID and the analytics ID.
  • the analytics tracing information further comprises at least one of an Analytics ID tracing data structure; analytics ID inference configuration information; analytics ID training configuration information; an inference rollback notification; a training rollback notification; an unstable notification.
  • the first network analytics entity is further configured to provide to the second network analytics entity analytics monitoring information comprising at least one of analytics ID performance information; analytics ID grade information; unstable analytics ID information.
  • the analytics tracing information further comprises location information and an association of the location information to at least one of: the training configuration about at least one of the one or more analytics outputs for the analytics ID and/or the analytics ID; the inference configuration about at least one of the one or more analytics outputs for the analytics ID and/or the analytics ID; the one or more quality indications about at least one of the one or more analytics outputs for the analytics ID and/or the analytics ID.
  • the location information comprises at least one of: a layered description of an environment, where a specific training and/or inference configuration has been applied and respective quality indications of analytics performance; geographical map; information about one or more parameters that describe the network configuration and UE configuration where a specific training and/or inference configuration has been applied.
  • the layered description of the environment may include static, semi-static and/or dynamic information (e.g., of different types) of the physical and communication related environment.
  • it may comprise a geographical map, e.g., with a physical location or terrain, road, sensor information, the time of the day, UE capabilities, network entities capabilities, etc.
  • the analytics tracing information further comprises at least one of a status of the inference rollback action; a status of the training rollback action; statistics of a rollback action, or an inference configuration, or a training configuration; one or more inference rollback actions, and/or one or more training rollback actions associated with the analytics ID and/or associated with one or more analytics outputs for the analytics ID; one or more inputs for the analytics ID and/or corresponding analytics outputs, for at least one of a rollback action, an inference configuration, and a training configuration.
  • the analytics tracing information further comprises an association of the analytics ID and/or of the one or more analytics outputs for the analytics ID to at least one of a timestamp; an identification of a network analytics inference entity; an identification of a network analytics training entity; an identification of a network analytics consumer entity; an identification of the one or more analytics outputs for the analytics ID; an identification of a reason that the analytics ID and/or of the one or more analytics outputs for the analytics ID are used by a network analytics consumer entity.
  • the first network analytics entity is further configured to discover the second network analytics entity based on at least one of the following: a tracing capability of the second network analytics entity related to the analytics ID; a rollback capability of the second network analytics entity related to the analytics ID; an analytics monitoring capability of the second network analytics entity related to the analytics ID.
  • the first network analytics is configured to discover the second network analytics entity by sending a discovery request, indicating the required tracing and/or rollback and/or analytics monitoring capability related to the analytics ID, to a network repository entity.
  • the first network analytics entity is configured to send a registration request, indicating the tracing and/or rollback and/or analytics monitoring capability of the first network analytics entity related to one or more analytics IDs, to a network repository entity.
  • a second aspect of this disclosure provides a second network analytics entity, configured to receive analytics tracing information from a first network analytics entity; wherein the second network analytics entity is configured to, based on the analytics tracing information, at least one of the following: trace one or more analytics outputs for an analytics identifier, ID, and/or trace the analytics ID; determine at least one unstable analytics output for the analytics ID and/or determine that the analytics ID is unstable; and determine and/or execute an inference rollback action and/or a training rollback action for the at least one unstable analytics output for the analytics ID and/or for the unstable analytics ID.
  • the analytics tracing information enables the second network analytics entity to continue the tracing and/or rollback performed by the first network analytics entity.
  • continuity in case of a transfer of the analytics ID and/or in case of UE mobility associated with the analytics ID can be provided.
  • the solution is compatible with existing analytics transfer mechanism from one network analytics entity to another network analytics entity.
  • the analytics tracing information is associated with the one or more analytics outputs for the analytics ID and/or is associated with the analytics ID.
  • the second network analytics entity is configured to receive from the first network entity the analytics tracing information included in an analytics subscription transfer message or in an analytics context information transfer message.
  • the second network analytics entity is configured to: provide an analytics tracing information request or an analytics context transfer request to the first network analytics entity, and receive the analytics tracing information from the first network analytics entity in response to the analytics tracing information request or the analytics context transfer request; and/or receive an analytics subscription transfer with the analytics tracing information from the first network analytics entity and receive a response of the analytics subscription transfer.
  • the analytics ID is associated with one or more user equipments, UEs; and the second network analytics entity is configured to receive the analytics tracing information from the first network analytics entity, when at least one of the one or more UEs is allocated from the first network analytics entity to the second network analytics entity.
  • the analytics ID output is associated with one or more network functions, NF; and the second network analytics entity is configured to receive the analytics tracing information from the first network analytics entity, when at least one of the one or more NFs is allocated from the first network analytics entity to the second network analytics entity.
  • the first network analytics entity and the second network analytics entity are respectively associated with a first NWDAF and a second NWDAF.
  • the inference rollback action is an action for changing an inference configuration about the at least one unstable analytics output and/or about the analytics ID at a network analytics inference entity; and the training rollback action is an action for changing a training configuration about the at least one unstable analytics output and/or about the analytics ID at a network analytics training entity.
  • the analytics tracing information further comprises at least one of: a tracing capability of the first network analytics entity related to the analytics ID; a rollback capability of the first network analytics entity related to the analytics ID; an analytics monitoring capability of the first network analytics entity related to the analytics ID.
  • the analytics tracing information comprises at least one of the analytics ID; an association of the analytics ID to the one or more analytics outputs for the analytics ID; one or more quality indications about at least one of the one or more analytics outputs for the analytics ID and the analytics ID; an inference configuration about the analytics ID and/or about the one or more analytics outputs for the analytics ID; a training configuration about the analytics ID and/or about the one or more analytics outputs for the analytics ID.
  • the analytics tracing information further comprises at least one of an Analytics ID tracing data structure; analytics ID inference configuration information; analytics ID training configuration information; an inference rollback notification; a training rollback notification; an unstable notification.
  • the second network analytics entity is further configured to receive from the first network analytics entity analytics monitoring information comprising at least one of analytics ID performance information; analytics ID grade information; unstable analytics ID information.
  • the analytics tracing information further comprises location information and an association of the location information to at least one of: the training configuration about at least one of the one or more analytics outputs for the analytics ID and/or the analytics ID; the inference configuration about at least one of the one or more analytics outputs for the analytics ID and/or the analytics ID; the one or more quality indications about at least one of the one or more analytics outputs for the analytics ID and/or the analytics ID.
  • the location information comprises at least one of a layered description of an environment, where a specific training and/or inference configuration has been applied and respective quality indications of analytics performance; geographical map; information about one or more parameters that describe the network configuration and UE configuration where a specific training and/or inference configuration has been applied.
  • the analytics tracing information further comprises at least one of a status of the inference rollback action; a status of the training rollback action; statistics of a rollback action, or an inference configuration, or a training configuration; one or more inference rollback actions, and/or one or more training rollback actions associated with the analytics ID and/or associated with one or more analytics outputs for the analytics ID; one or more inputs for the analytics ID and/or corresponding analytics outputs, for at least one of a rollback action, an inference configuration, and a training configuration.
  • the analytics tracing information further comprises an association of the analytics ID and/or of the one or more analytics outputs for the analytics ID to at least one of a timestamp; an identification of a network analytics inference entity; an identification of a network analytics training entity; an identification of a network analytics consumer entity; an identification of the one or more analytics outputs for the analytics ID; an identification of a reason that the analytics ID and/or of the one or more analytics outputs for the analytics ID are used by a network analytics consumer entity.
  • the implementation forms of the second network analytics entity provide the same advantages as described above for the implementation forms of the first network analytics entity.
  • a third aspect of this disclosure provides a network data analytics consumer entity, configured to: provide, to a first network analytics entity, an indication with information to activate an analytics tracing and/or a rollback of one or more analytics outputs for an analytics ID and/or of the analytics ID; and receive, from a second network analytics entity, an indication that the analytics tracing and/or the rollback are supported.
  • the network analytics consumer entity can receive a continuous service of tracing and/or rollback, even if the analytics ID is transferred from the first network analytics entity to the second network analytics entity, or in case of mobility of the network analytics consumer entity (e.g. UE).
  • the network analytics consumer entity e.g. UE
  • a fourth aspect of this disclosure provides a network repository entity, configured to store a profile of each of one or more network analytics entities, wherein the profile of each network analytics entity comprises at least one of the following: tracing capability of network analytics entity related to one or more analytics IDs; rollback capability of the network analytics entity related to the one or more analytics ID; an analytics monitoring capability of the network analytics entity related to the one or more analytics ID.
  • the network repository entity allows the first network analytics entity to select the second network analytics entity, from multiple network analytics entities, in view of a desired continuity of the tracing and rollback support for an analytics ID. In this way, the network repository entity supports the continuity.
  • the network repository entity is further configured to: receive a discovery request, indicating a required tracing and/or rollback and/or analytics monitoring capability related to an analytics ID, from a first network analytics entity or a network data analytics consumer entity; and provide a profile of at least one of one or more network analytics entities to the first network analytics entity or the network data analytics consumer entity in response.
  • the network repository entity is further configured to: receive a registration request, indicating a tracing and/or rollback and/or analytics monitoring capability of a first network analytics entity related to one or more analytics IDs, from the first network analytics entity; and store a profile for the first network analytics entity based on the capabilities in the registration request.
  • a fifth aspect of this disclosure provides a method for a first network analytics entity, the method comprising providing analytics tracing information to a second network analytics entity; wherein the method further comprises, based on the analytics tracing information, at least one of the following: tracing one or more analytics outputs for an analytics ID and/or tracing the analytics ID; determining at least one unstable analytics output for the analytics ID and/or determining that the analytics ID is unstable; and determining and/or executing an inference rollback action and/or a training rollback action for the at least one unstable analytics output for the analytics ID and/or for the unstable analytics ID.
  • the method of the fifth aspect may have implementation forms that correspond to the implementation forms of the first network analytics entity of the first aspect.
  • the method of the fifth aspect provides the same advantages as described for the first network analytics entity of the first aspect.
  • a sixth aspect of this disclosure provides a method for a second network analytics entity, the method comprising: receiving analytics tracing information from a first network analytics entity; wherein the method further comprises, based on the analytics tracing information, at least one of the following: tracing one or more analytics outputs for an analytics ID, and/or tracing the analytics ID; determining at least one unstable analytics output for the analytics ID and/or determining that the analytics ID is unstable; and determining and/or execute an inference rollback action and/or a training rollback action for the at least one unstable analytics output for the analytics ID and/or for the unstable analytics ID.
  • the method of the sixth aspect may have implementation forms that correspond to the implementation forms of the second network analytics entity of the second aspect.
  • the method of the sixth aspect provides the same advantages as described for the second network analytics entity of the second aspect.
  • a seventh aspect of this disclosure provides a method for a network data analytics consumer entity, the method comprising: providing, to a first network analytics entity, an indication with information to activate an analytics tracing and/or a rollback of one or more analytics outputs for an analytics ID and/or of the analytics ID; and receiving, from a second network analytics entity, an indication that the analytics tracing and/or the rollback are supported.
  • the method of the seventh aspect may have implementation forms that correspond to the implementation forms of the network data analytics consumer entity of the third aspect.
  • the method of the seventh aspect provides the same advantages as described for the network data analytics consumer entity of the third aspect.
  • An eighth aspect of this disclosure provides a method for a network repository entity, the method comprising storing a profile of each of one or more network analytics entities, wherein the profile of each network analytics entity comprises at least one of the following: tracing capability of network analytics entity related to one or more analytics IDs; rollback capability of the network analytics entity related to the one or more analytics ID; an analytics monitoring capability of the network analytics entity related to the one or more analytics ID.
  • the method of the eighth aspect may have implementation forms that correspond to the implementation forms of the network repository entity of the fourth aspect.
  • the method of the eighth aspect provides the same advantages as described for the network repository entity of the fourth aspect.
  • a ninth aspect of this disclosure provides a computer program comprising instructions which, when the program is executed by a computer, cause the computer to perform the method according to one of the fifth, sixth, seventh, or eighth aspect, or any implementation form thereof.
  • a ninth aspect of this disclosure provides a storage medium storing executable program code which, when executed by a processor, causes the method according to one of the fifth, sixth, seventh, or eighth aspect, or any implementation form thereof to be performed.
  • this disclosure proposes a first network data analytics entity (e.g., source NWDAF) transfers developed and/or stored tracing and rollback information of one or more analytics ID to a second network data analytics entity (e.g., target NWDAF) during, for instance, a UEs mobility with NWDAF reallocation.
  • a first network data analytics entity e.g., source NWDAF
  • a second network data analytics entity e.g., target NWDAF
  • An Analytics Subscription Transfer extension may indicate the tracing and/or rollback and/or analytics capability for the source NWDAF to the target NWDAF.
  • An Analytics Context Information Transfer extension with new parameters may indicate the analytics monitoring structures and analytics rollback structures provided from the source NWDAF to the Target NWDAF.
  • An Analytics Context Information may be extended to support tracing and rollback triggering and execution in the target NWDAF.
  • FIG. 1 shows a first network analytics entity, a second network analytics entity, and a network data analytics consumer entity, according to this disclosure.
  • FIG. 2 shows a network repository entity according to this disclosure.
  • FIG. 3 shows an example extension on the Analytics Subscription Transfer initiated by a first analytics network entity according to this disclosure, with rollback and tracing capability enabled.
  • FIG. 4 shows an example of a flow analytics context information exchange with tracing, monitoring and rollback information.
  • FIG. 5 shows an exemplary method at a second network analytics entity of this disclosure, to check an analytics rollback action indication received by the first network analytics entity.
  • FIG. 6 shows an example of a visualization of analytics context with analytics tracing and rollback information.
  • FIG. 7 shows an example for the retrieval of the description of an active rollback action and/or configuration by another entity (not the first network analytics entity).
  • FIG. 8 shows an example for the retrieval of the description of an active rollback action and/or configuration by another entity.
  • FIG. 9 shows a method for a first network analytics entity according to this disclosure.
  • FIG. 10 shows a method for a second network analytics entity according to this disclosure.
  • FIG. 11 shows a method for a network data analytics consumer entity according to this disclosure.
  • FIG. 1 shows a first network analytics entity 100 according to an embodiment of this disclosure, a second network analytics entity 110 according to an embodiment of this disclosure, and a network data analytics consumer entity 120 according to an embodiment of this disclosure.
  • the network analytics entities 100, 110 may be NWDAFs, e.g., respectively a source NWDAF 100 and a target NWDAF 110.
  • the network data analytics consumer entity 120 may be a UE or NF.
  • the first network analytics entity 100 is configured to provide analytics tracing information 101 to the second network analytics entity 110, which is accordingly configured to receive the analytics tracing information 101 from the first network analytics entity 100.
  • Both the first network analytics entity 100 and the second network analytics entity 110 are configured to, based on the analytics tracing information 101, perform at least one of the following steps: (i) tracing one or more analytics outputs for an analytics ID and/or tracing the analytics ID; (ii) determining at least one unstable analytics output for the analytics ID and/or determining that the analytics ID is unstable; (iii) determining and/or executing an inference rollback action and/or a training rollback action for the at least one unstable analytics output for the analytics ID and/or for the unstable analytics ID.
  • each network analytics entity 100, 110 is configured to perform the tracing step, the determining step, and/or the executing step by using the analytics tracing information 101. In this way, continuity of performing these steps is ensured at the second network analytics entity 110, even in case of an analytics ID transfer or UE or NF mobility.
  • the analytics ID may be associated with one or more UEs or one or more NFs, for instance, with the network data analytics consumer entity 120 shown in FIG. 1.
  • the first network analytics entity 100 may be configured to provide the analytics tracing information 101 to the second network analytics entity 110, particularly, when at least one UE or NF of the one or more UEs or NFs, for instance, the network data analytics consumer entity 120, is allocated from the first network analytics entity 100 to the second network analytics entity 110.
  • the analytics ID associated with the network data analytics consumer entity 120 may be transferred from the first network analytics entity to the second network analytics entity.
  • the network data analytics consumer entity 120 is configured to provide, to the first network analytics entity 100, an indication 121 with information to activate an analytics tracing and/or a rollback of one or more analytics outputs for an analytics ID and/or of the analytics ID. Further, the network data analytics consumer entity 120 is configured to receive, from the second network analytics entity 110, an indication 122 that the analytics tracing and/or the rollback are supported. The second network analytics entity 110 may be able to provide the indication 122 based on the analytics tracing information 101, which it received from the first network analytics entity 100.
  • the first network analytics entity 100 may be configured to select the second network analytics entity 110 as a recipient of the analytics tracing information 101 based on a tracing capability of the second network analytics entity 110 related to the analytics ID, and/or based on a rollback capability of the second network analytics entity 110 related to the analytics ID, and/or based on an analytics monitoring capability of the second network analytics entity 110 related to the analytics ID.
  • the tracing and rollback continuity in case of a transfer of the analytics ID from the first network analytics entity 100 to the second network analytics entity 110 and/or in case of mobility of the network data analytics consumer entity 120 associated with the analytics ID.
  • FIG. 2 shows a network repository entity 200 according to an embodiment of this disclosure.
  • the network repository entity 200 may be a network repository function (NRF).
  • the network repository entity 200 is configured to store a profile 201, 202 of each of one or more network analytics entities 100, 110, for example, a first profile 201 of the first network analytics entity 100 and a second profile 202 of the second network analytics entity 110.
  • the profile 201, 202 of each respective network analytics entity 100, 110 comprises at least one of the following: the tracing capability of the respective network analytics entity 100, 110 related to one or more analytics IDs; the rollback capability of the respective network analytics entity 100, 110 related to the one or more analytics ID; and the analytics monitoring capability of the respective network analytics entity 100, 110 related to the one or more analytics ID.
  • the profiles 201, 202 allow, for example, the first network analytics entity 100 to select the second network analytics entity 110 as the recipient of the analytics tracing information 101 based on at least one of the tracing capability, the rollback capability, and the analytics monitoring capability of the second network analytics entity 110 related to the analytics ID. This may ensure the tracing and rollback continuity.
  • the network repository entity 200 may receive a discovery request 203 from the first network analytics entity 100 (or from a network data analytics consumer entity 120), wherein the discovery request 203 indicates a required tracing and/or rollback and/or analytics monitoring capability related to the analytics ID.
  • the network repository entity 200 may then provide the profile 202 of the second network analytics entity 110 to the first network analytics entity 100 in response, in particular, if the second network analytics entity 110 meets the required tracing and/or rollback and/or analytics monitoring capability related to the analytics ID.
  • the processing circuitry may comprise hardware and/or the processing circuitry may be controlled by software.
  • the hardware may comprise analog circuitry or digital circuitry, or both analog and digital circuitry.
  • the digital circuitry may comprise components such as application-specific integrated circuits (ASICs), field-programmable arrays (FPGAs), digital signal processors (DSPs), or multipurpose processors.
  • ASICs application-specific integrated circuits
  • FPGAs field-programmable arrays
  • DSPs digital signal processors
  • Each entity 100, 110, 120, 200 may further comprise memory circuitry, which stores one or more instruction(s) that can be executed by the processor or by the processing circuitry, in particular under control of the software.
  • the memory circuitry may comprise a non-transitory storage medium storing executable software code which, when executed by the processor or the processing circuitry, causes the various operations of the entity 100, 110, 120, 200 to be performed.
  • the processing circuitry comprises one or more processors and a non-transitory memory connected to the one or more processors.
  • the non-transitory memory may carry executable program code which, when executed by the one or more processors, causes the entity 100, 110, 120, 200 to perform, conduct or initiate the operations or methods described herein.
  • FIG. 3 shows an example for an extension of the Analytics Subscription Transfer, which may be initiated by a first network analytics entity 100 (here a provider NWDAF, or, as in the following, source NWDAF) to a second network analytics entity 110 (here a consumer NWDAF, or, as in the following, a target NWDAF)) according to this disclosure, with rollback and tracing capability enabled (“Analytics Tracing and Rollback Support”).
  • the first network analytics entity 100 is configured to provide, to the second network analytics entity 110, the analytics tracing information 101 included in an analytics subscription transfer message 301.
  • the target NWDAF 110 may use the transferred analytics tracing information 101 to continue the tracing over time of the analytics ID grade (extending Analytics ID Tracing Data Structure of the previous NWDAF(s)) and/or to apply to the inference (or a ML model) an active rollback configuration, which may be decided at the source NWDAF 100.
  • the target NWDAF 110 may also become aware of a last known stable network state, in case this is needed to be applied.
  • the source NWDAF 100, with the Analytics Subscription Transfer to the target NWDAF 110 may indicate whether the tracing and rollback is needed by the target NWDAF 110, for example, by providing:
  • the source NWDAF(s) 100 and/or a network data analytics consumer entity 120 can also trigger the target NWDAF 110 to check, if the tracing and rollback capability for a specific analytics ID is supported.
  • the source NWDAF 100 after a decision to request an analytics subscription transfer and after selecting the target NWDAF 110, may firstly provide an indication about its analytics tracing and/or rollback, i.e., the analytics tracing information 101, via the NWDAF AnalyticsSubscription Transfer message 301 (message number 4 in FIG. 3) to the target NWDAF 110.
  • NWDAF AnalyticsSubscription Transfer message 301 messages number 4 in FIG. 3
  • the target NWDAF 110 may take over the Analytics Subscription and may check and enable analytics tracing and rollback Support, based on the analytics tracing information 101 provided by the source NWDAF 100, and based, e.g., on its own capabilities (i.e., target NWDAF capabilities).
  • the target NWDAF 110 can also (optionally) notify the network analytics consumer entity 120 (e.g., NF Consumer) whether or not the analytics tracing and rollback will be continued to be provided via the NWDAF_AnalyticsSubscription_Notify message 302 (message number 6 in FIG. 3), which may include the indication 122 shown in FIG. 1, that the analytics tracing and/or the rollback are supported.
  • More information for the analytics monitoring, tracing and/or analytics rollback configurations or rollback actions may be provided from the source NWDAF 100 to the target NWDAF 110 in the context of procedure number 7 of FIG. 3 (more details about the content is provided below).
  • the target NWDAF 110 can inform the source NWDAF 100 whether analytics tracing and rollback are supported or enabled, via the message NWDAF AnalyticsSubscription Transfer response 303 (message number 9 in FIG. 3).
  • the target NWDAF 110 may also provide a NWDAF_Analytics Sub scri ption JSiotify message 304 to the NF Consumer 120 including information about the analytics subscription, e.g., an analytics output of a analytics ID.
  • FIG. 4 shows an example of a flow analytics context information exchange with tracing, monitoring and rollback information.
  • the target NWDAF 110 may request analytics context information, which may include a list of analytics context identified s), a set of SUPI and associated analytics ID for UE related analytics or an analytics ID for NF related analytics. Thereby, the target NWDAF 110 can indicate if tracing, monitoring and rollback information is needed by the source NWDAF 100. For example, as shown in FIG. 4, the source NWDAF 100 may receive an analytics context transfer request 401 from the target NWDAF 110 with this indication.
  • the source NWDAF 100 may respond with analytics context information to the consumer target NWDAF 1100, for example, by adding to its response message 402 the analytics tracing information 101. That is, the source NWDAF 100 may provide the analytics tracing information 101 to the target NWDAF 110 in response to the analytics context transfer request 401. For instance, the source NWDAF 100 may add one or more of the following contextual information (CI) for the analytics monitoring and analytics rollback:
  • CI contextual information
  • API Analytics ID Performance Information
  • the Analytics Monitoring Information may be used by the target NWDAF 110 to continue consistent monitoring the effect of an analytics ID consumption in the changes of network status (stable, unstable analytics ID).
  • TRN Training Rollback Notification
  • the analytics tracing information may be used by the target NWDAF 110 to continue consistent tracing analytics ID grade taking into the inference engine and/or ML training model configurations. And to inform the target NWDAF 110 about last known stable network state for an analytics ID output and its associated configurations (inference and/or training configurations).
  • CI3 Indication about the active rollback configuration, in case a rollback action has been applied by the source NWDAF 100.
  • CI4 Layered Description of the environment, where a specific configuration has been applied and the respective network quality indications has been received:
  • ⁇ LI geographical map: one-dimensional or multi-dimensional (e.g., to represent a physical location or terrain, road)
  • ⁇ L2: map can include or be described by additional dimensions (not only geographical dimensions) to provide information about other parameters that may describe the situation where a configuration has been used (e.g., sensor information, the time of the day, UE capabilities etc.).
  • CI5 Statistics of a Rollback Action/Configuration (active or not).
  • CI6 NFs that consume an analytics ID and reason the analytics used (e.g., URSP update). This may be used by the target NWDAF 110 to assess if rollback should be enabled for a specific NF ID and/or reason (i.e. action supported by analytics ID) or applied to all cases. This may help to saves signaling and resources.
  • CI7 (optional) Inputs for Analytics ID and corresponding analytics outputs, for each identified rollback configuration (state)
  • FIG. 5 shows how the above described contextual information CI1-CI8 may be used at the target NWDAF 110.
  • the target NWDAF 110 may check, if a rollback configuration is enabled using CI3. If “No”, it may use a current ML configuration. If “Yes”, the target NWDAF 110 may check if the same ML model type is used. If “No”, it may use the current ML configuration or may deactivate. If “Yes”, the target NWDAF 110 may verify whether to trust a source ML using CI7. If “Yes”, it may further check a similarity of (network) environment descriptors and impact of rollback to one or more analytics using CI4, CI5, and CI6. In case of an adequate similarity, it may enable an active rollback configuration (inference and/or training) using CI3, CI1, and CI2. In case of a low similarity, it may use another rollback configuration provided by the source NWDAF 100 or may keep a default configuration of the ML model or deactivate by using CI1 and CI2.
  • FIG. 6 An example structure of analytics context with analytics tracing and rollback Support, is presented in FIG. 6.
  • FIG. 7 shows an example for the retrieval of the description of an active rollback action/configuration by another entity (not the first network analytics entity).
  • the indication about the currently active rollback configuration (CI3) in case rollback has been activated by the source NWDAF 100, and is provided from the source NWDAF 100 to the target NWDAF 110 to which the UE will be transferred.
  • Option 1 Send from the source NWDAF 100 to the target NWDAF 110 an “Explicit Description of the Rollback Configuration”.
  • the configuration can include: parameters related to the ML mode (e.g., type of algorithm, gradients, weights, architecture information about the mode, ...), parameters related to the requested analytics ID to be trained or modeled, other parameters e.g., interval of data collection for generating the analytics, whether pre-processing of collected data for analytics generation has been applied, type of collected data for generating the analytics etc.
  • parameters related to the ML mode e.g., type of algorithm, gradients, weights, architecture information about the mode, .
  • parameters related to the requested analytics ID to be trained or modeled e.g., interval of data collection for generating the analytics, whether pre-processing of collected data for analytics generation has been applied, type of collected data for generating the analytics etc.
  • the above information can be part of the NWDAF AnalyticsInfo ContextTransfer response message.
  • the source NWDAF 100 provides to the target NWDAF 110 an indication (e.g., via a flag parameter) that a rollback configuration has been activated at the source NWDAF 100 as well as an identifier of the Activated Rollback Configuration (e.g., ID number).
  • an indication e.g., via a flag parameter
  • an identifier of the Activated Rollback Configuration e.g., ID number.
  • the above information can be part of the NWDAF AnalyticsInfo ContextTransfer response message.
  • the target NWDAF 110 can request and receive the detailed or explicit description of the rollback configuration, using the provided identifier of the Activated Rollback Configuration (e.g., Rollback Configuration lD), by contacting an entity that associates the identifier of the Activated Rollback Configuration with the explicit description of the rollback configuration and/or the ML model.
  • the network repository entity 200 (called here Model Configuration Repository) that keeps this information (i.e., the association) can be another NF e.g., Training NF, Training Model Training logical function (MTLF), NWDAF, Analytics Data Repository Function (ADRF), Models repository etc.).
  • the source NWDAF 100 or any other NWDAF can provide the detailed or explicit description of a rollback configuration to this NF.
  • An example flow chart is provide in FIG. 7.
  • each rollback configuration can be associated with statistics that provide an indication or a value of the success rate of a specific rollback configuration (or rollback action) on the performance of an analytics ID.
  • the success rate can be understood in terms of the impact of an analytics ID on the decision that is made by an analytics consumer (e.g., NF decision, AF decision etc.), receiving the respective analytics ID outputs. For example, whether the analytics ID output(s) leads to successful or accurate decision by the analytics consumer, or even whether the analytics ID outputs are accurate enough comparing e.g., with the ground truth (e.g., analytics ID prediction accuracy).
  • the SMF may use Session Management Congestion Control Experience analytics provided by the NWDAF, to determine back-off timer provided to UEs, to support DNN based congestion control (according to 23.501 TS).
  • the “success rate of a specific analytics ID configuration” could be identified by the impact of the SMF decision, based on received analytics to the NAS level congestion criterion.
  • the network data analytics consumer entity 120 can report to the NWDAF 100, 110 information about the impact (or performance) of the usage of an analytics ID, according to the defined criteria per analytics consumer or analytics ID. Based on this information the NWDAF 100, 110 that is aware of the used rollback configuration or rollback action can calculate the statistics e.g., success rate of a specific “Rollback Configuration of the per analytics ID.
  • the Nnwdaf AnalyticsSubscription Transfer message (as shown in FIG. 3) or the Nnwdaf AnalyticsSubscription Transfer Request message may be used to request the target NWDAF 110 to transfer analytics subscription(s) from the source NWDAF 100.
  • this may be indicated via the Nnwdaf AnalyticsSubscription Transfer (or Nnwdaf AnalyticsSubscription Transfer Request) message with information about tracing and rollback capability, including one or more of the following information:
  • the target NWDAF 110 can check to takes over Analytics Subscription and whether and how to enable Analytics Tracing and Rollback Support.
  • the target NWDAF 110 In the response from the target NWDAF 110 to the source NWDAF 100 (e.g., Nnwdaf AnalyticsSubscription Transfer Response message) it may be indicated whether the indicated capabilities can be supported or not.
  • Nnwdaf AnalyticsSubscription Transfer Response message e.g., Nnwdaf AnalyticsSubscription Transfer Response message
  • FIG. 8 shows an example for the retrieval of the description of an active rollback action/configuration by another entity.
  • the source (provider) NWDAF 100 may have to discover and select the target NWDAF 110.
  • the source NWDAF 100 may have to discover NWDAFs with tracing and rollback capabilities in case the latter has been enabled.
  • NWDAF Network Repository Function
  • NRF Network Repository Function
  • the NRF discovery service extended with new parameters to discover the tracing, rollback and analytics monitoring capabilities.
  • the NWDAF NF profile 201, 202 should also include one or more of the following information:
  • the network repository entity 200 may receiver a registration of NWDAF profile enhanced with any of the following information:
  • NWDAF with rollback and/or tracing and/or analytics monitoring support as well as the selection of an NWDAF based on tracing and/or rollback and/or analytics monitoring support could be initiated by a NF consumer (e.g., any NF, AF etc.) and or another NWDAF.
  • a NF consumer e.g., any NF, AF etc.
  • NF consumers 120 or another NWDAF may select the NWDAFs based on the discovery NWDAF profiles 201, 202 with the enhanced required capabilities (i.e., tracing and/or rollback and/or analytics monitoring).
  • the NF consumers subscribe to NRF to be notified on changes of the tracing and/or rollback and/or monitoring capabilities of associated to an NWDAF, or associated to the analytics IDs supported by an NWDAF, or associated with specific analytics IDs supported by an NWDAF.
  • the NF consumers use the notifications from NRF about the changes in the tracing and/or rollback and/or monitoring capabilities to re-select an NWDAF.
  • extension of the NRF services such as Nnrf_NFManagement_NFRegister, Nnrf_NFDiscovery_Request, Nnrf_NFManagement_NFStatusSubscribe can be may by including one more of the following parameters: Tracing capability for all analytics IDs or per analytics IDs, Rollback capability for all analytics IDs or per analytics IDs, Analytics Monitoring capability for all analytics IDs or per analytics IDs.
  • FIG. 9 shows a method 900 for a first network analytics entity 100 according to this disclosure.
  • the method 900 comprises a step 901 of providing analytics tracing information 101 to a second network analytics entity 110.
  • the method 900 further comprises, based on the analytics tracing information 101, at least one of the following steps 902, 903 and 904.
  • FIG. 10 shows a method 1000 for a second network analytics entity 110 according to this disclosure.
  • the method 1000 comprises a step 1001 of receiving analytics tracing information 101 from a first network analytics entity 100.
  • the method 1000 further comprises, based on the analytics tracing information 101, at least one of the following steps 1002, 1003 and 1004.
  • FIG. 11 shows a method 1100 for a network data analytics consumer entity 120 according to this disclosure.
  • the method 1100 comprises a step 1101 of providing, to a first network analytics entity, an indication 121 with information to activate an analytics tracing and/or a rollback of one or more analytics outputs for an analytics ID and/or of the analytics ID. Further, the method 1100 comprises a step 1102 of receiving, from a second network analytics entity 110, an indication 122 that the analytics tracing and/or the rollback are supported.
  • Advantages of the entities 100, 110, 120, 200, and of the methods 900, 1000, 1100 of this disclosure are as follows: • Avoid interruption on the tracing of an analytics status if the target NWDAF 110 is not aware about the need for supporting tracing and rollback for the transferred analytics ID especially.
  • ⁇ Change of NWDAF can happen due to UEs mobility that could also include change of the NF consumer (e.g., AMF).
  • AMF the NF consumer
  • the source NWDAF 100 might use a complete different set of configurations and ML model.
  • ⁇ Determine (e.g., reselect) a new ML model and/or model to be used for the generation of the analytics (ID and/or output(s)), where the determination relates to the interaction between Inference NF and Training NF in order to obtain a new ML model and/or model for the analytics (ID and/or output(s));
  • a request for ML model and/or model selection (and/or reselection) with information about the reason for the reselection e.g., unstable analytics ID
  • AICI Analytics Inference Configuration Information
  • ⁇ Receive a message from other entity (e.g., Analytics Tracing Entity, Inference NF, training NF) with the analytics rollback actions.
  • entity e.g., Analytics Tracing Entity, Inference NF, training NF
  • the messages can be: Unstable Analytics Notification, Training Rollback Notification
  • ⁇ Identify the ML model and/or model associated with the analytics (ID and/or output(s)) of the new obtained ATCI, select this new ML model and/or model and its associated ATCI to be used by consumers of ML model and/or model for the analytics (ID and/or output(s)); ⁇ Determine the new ATCI to be used for the ML model and/or model associated with the analytics (ID and/or output(s)) via training or model tuning;
  • Optional Obtain from another entity (e.g., Inference NF, Training NF) an indication of the reason for re-training related to an unstable analytics ID, where the indication can be a request for ML model and/or model training (and/or re-training) with information about the reason for the retraining (e.g., unstable analytics ID)
  • entity e.g., Inference NF, Training NF
  • the indication can be a request for ML model and/or model training (and/or re-training) with information about the reason for the retraining (e.g., unstable analytics ID)
  • ⁇ compose or assemble the ATDS record by combining any of the following information:
  • AICI Analytics Inference Configuration Information
  • API Analytics Performance Information
  • ⁇ a configuration from a Management Entity; ⁇ combination of configuration from a Management Entity and receiving a message from another entity comprising the specific analytics (ID and/or output(s)) and/or analytics consumer that should be associated with the configured API
  • ⁇ a message received from other entity (e.g., Analytics Tracing Entity, , Inference NF, Training NF) comprising the API, the specific analytics (ID and/or output(s)) and/or analytics consumer
  • entity e.g., Analytics Tracing Entity, , Inference NF, Training NF
  • Unstable Analytics ID One or more outputs of an Analytics ID (e.g., an analytics type) and/or an Analytics ID that are associated with unstable network status. Synonyms of the term unstable analytics ID are: unstable analytics output, inefficient analytics output (or ID, or type), unreliable analytics output (or ID, or type), low performance analytics outputs (or ID, or type).
  • the one or more outputs of an analytics ID and/or analytics ID that is considered unstable analytics ID are associated with indications of low network performance. Examples of these indications are: feedback from an NF consumer (NF Feedback), Analytics ID grades, notification about analytics ID grade that deviates from defined/configured/expected threshold values.
  • Stable Analytics ID One or more output of an Analytics ID (e.g., an analytics type) and/or analytics ID that leads to (e.g., that is related to or associated with) stable network status.
  • Synonyms of the term stable analytics ID are: stable analytics output, efficient analytics output (or ID, or type), reliable analytics output (or ID, or type), high performance analytics outputs (or ID, or type).
  • Network Status Is the set of information that quantify the network performance. Examples of information that can be used for representing the network status are: KPIs and/or metrics associated with a network.
  • Stable Network Status Defines a network status where the KPIs and/or metrics related to the network are kept within the expected pattern of usage (or improve).
  • Unstable Network Status Defines the network status where KPIs and/or metrics related to the overall performance of the network remain at expected patterns but specific KPIs and/or metrics indicating specific situations are oscillating out of expected pattern or decrease from expected pattern. Examples of overall performance metrics are: total number of accepted PDU sessions, average link throughput, total number of UE registrations per slice. Examples of specific KPIs or metrics that are specific are: number of rejected sessions per type of application; link usage per group of UEs. KPIs or metrics related to overall performance of the network can be generally related to performance information that can be obtained from OAM, Management Entities. While the specific KPIs and/or metrics can be generally related to performance information that can be obtained from Control Plane Entities (e.g., SMF, PCF, AMF).
  • Control Plane Entities e.g., SMF, PCF, AMF
  • Information about unstable analytics ID Defines the set of data and/or parameters and/or properties, and/or configurations of an analytics ID (e.g., analytics type, analytics output(s)) at inference and/or at training where this set is associated with an unstable analytics ID.
  • an analytics ID e.g., analytics type, analytics output(s)
  • Information on how to repair an unstable analytics ID Defines the set of data and/or parameters and/or properties, and/or configurations of an analytics ID (e.g., analytics type, analytics output(s)) at inference and/or training associated with a last known stable network state in the mobile system.
  • an analytics ID e.g., analytics type, analytics output(s)
  • Tracing of an analytics ID Denotes the process executed for associating an analytics ID to analytics output(s), an indication of the quality of usage of the analytics (ID and/or output(s)) in the mobile network, and the configuration at inference and/or training for such analytics ID.
  • Indication for analytics ID tracing activation A message that contains the analytics ID tracing activation.
  • Analytics ID tracing activation One or more parameters or information that denotes the tracing of an analytics ID needs to be started. Examples of these parameters are: a flag (e.g., tracing flag or rollback flag), a tuple with analytics ID and flag.
  • Indication of inference tracing activation One or more parameters or information that denotes the tracing of inference configurations for an analytics (ID and/or output(s) needs to be started. For instance, this one or more parameter indicates to the Inference NF that it needs to create AICI information for the indicated analytics and provide such information to the Analytics Tracing Entity.
  • Indication of training tracing activation One or more parameters or information that denotes the tracing of training configurations for an analytics (ID and/or output(s) needs to be started. For instance, this one or more parameter indicates to the training NF that it needs to create ATCI information for the indicated analytics and provide such information to the Analytics Tracing Entity.
  • Configuration of analytics ID tracing activation Is the set of information provided by a Management Entity (e.g., OAM) that defines the tracing of an analytics ID needs to be started.
  • OAM Management Entity
  • Analytics output Is the set of information that denotes the result of a generated, calculated, predicted instance of an analytics ID or type.
  • Different analytics IDs have a different set of information denoting the analytics output.
  • analytics ID such as “Observed Service experience information” as defined in 3GPP TS 23.288 Release 17 defines that the output for such analytics ID is the set of the following information: S-NSSAI, Slice instance service experiences (O...max), and for each of the NSI IDs related to an S-NSSAI there are other information such as: NSI ID, Slice instance service experiences (O...max) penetrate SUPI List, (O..SUPImax), Estimated percentage of UEs with similar service experience, etc.
  • Analytics ID or Analytics Type Is a type of an analytics that can be generated by an Inference NF (e.g., NWDAF).
  • NWDAF Inference NF
  • 3GPP TS 23.288 Release 17 defines the Observed Service experience information, Slice Load level information, Network Performance information, etc.
  • ATDS record defines a network state at a given point in time when using a given analytics (e.g., analytics ID or analytics type or analytics output(s)).
  • ATDS record is a tuple that has the mapping in a given point in time of an analytics ID to: one or more analytics output identifications and/or one or more analytics output, an indication of the quality of usage of the analytics (ID and/or output(s)) in the mobile network (e.g., Analytics ID Grade Information (AidGI) or unstable analytics ID information (UAiDI) for analytics output instance(s) or a Network Function (NF) feedback), and inference and/or training configuration information (e.g., AICI and/or ATCI) for the analytics output(s) or analytics IDs.
  • the ATDS record can also include the rollback status and the analytics rollback actions.
  • Last known stable network state Is a network state (e.g., ATDS record) at a given point in time when using a given analytics (e.g., analytics ID or analytics type or analytics output(s)) with the most appropriated Analytics Inference Configuration Information (AICI) and/or Analytics Training Configuration Information (ATCI) for analytics (ID and/or output(s)).
  • AICI Analytics Inference Configuration Information
  • ACI Analytics Training Configuration Information
  • Analytics Rollback Actions Is the set of one or more information that define the possible actions that can be taken in order to change, revert, and/or reconfigure the configuration associated with an analytics (e.g., analytics output(s) or analytics ID, or analytics type). This action or actions can help to improve the performance of analytics ID. Examples of this information and how they denote an action are described as follows:
  • One set of information is related to the old/current configuration, parameters, properties associated with an analytics (ID and/or output(s)) and a second set of information is related to the new possible configuration, parameters, properties associated with an analytics (ID and/or output(s)). This two sets of information defines that an action of replacing the old information with the new information should be executed.
  • Rollback Status Notification Is the set of information describing the results of performing Analytics Rollback Actions. Examples of the set of information describing the results of the actions are the following:
  • Unsuccessful rollback optionally indicating whether the indications of actions and/or configurations included in the Inference Rollback Notification or Training Rollback Notification have not been implemented (e.g. suggested configuration was not able to be used).
  • Analytics Status Notification is the information defining an analytics (ID and/or analytics output(s)) is considered as Stable Analytics ID, which means that there is no problem with the analytics, or that the analytics is not anymore considered Unstable Analytics ID, which means there is problem with the analytics.
  • Indication of the quality of usage of the analytics Is the information that defines the quality of an analytics ID (or analytics type) and/or analytics output(s) in relationship to the network of such analytics (analytics ID or analytics type, and/or analytics output(s)).
  • API Analytics ID Performance Information: Is a data structure that comprises the KPIs, metrics to be monitored and associated with a consumed analytics (ID and/or analytics output(s)), optionally for a specific consumer of such analytics (e.g., Analytics Consumer).
  • ID and/or analytics output(s) optionally for a specific consumer of such analytics (e.g., Analytics Consumer).
  • the API serves as input for the AidGI calculation and support the identification of the effect of an analytics ID consumption in the changes of network status.
  • Analytics ID Grade Information Set of information that quantifies, e.g., in the format of a grade the effects of a consumed analytics (ID and/or output(s) on the changes in network status after the consumption of analytics ID.
  • Examples of the set of information comprising the AidGI are any of the following:
  • Identification of Analytics ID type the type analytics ID for which a grade has to be calculated • (List of) Identification of analytics ID output: identification of the one or more analytics output information for the analytics ID that were consumed in the interval of time for the grade calculation
  • Grade Value a single value that represents how the APIs monitored for the consumed analytics ID diverge from the expected pattern of network status. For instance:
  • ⁇ Grade value can be a real number between 1 and -1, where
  • ⁇ 1 indicates that the consumption of the analytics ID had significant positive effect in the expected network status pattern (e.g., improved the pattern of the KPIs)
  • ⁇ -1 indicates that the consumption of the analytics ID had significant negative effect in the expected network status pattern (e.g., degraded the pattern of the KPIs)
  • Unstable Analytics ID Information Is the set of information that identifies the grade associated with a consumed analytics (ID and/or outputs) crossing, deviating thresholds that denote an analytics has been identified as leading to unstable network status. Examples of information comprising the UAidl are any of the following:
  • Identification of analytics ID output identification of the one or more analytics output information for the analytics ID that were consumed in the interval of time for the grade calculation
  • NF Feedback Is the information that qualifies the consumption of an analytics (ID and/or output(s)) in the perspective of the consumer of such analytics.
  • NF feedback information can be any of the following: • NF Feedback can be a set of information equivalent to the Analytics ID Grade Information (AidGI), where the NF (e.g., Analytics Consumer) based on its internal information defines a grade for the consumed analytics (ID and/or output(s))
  • AuGI Analytics ID Grade Information
  • NF Feedback can be a set of information equivalent to the Unstable Analytics ID Information (UAidl), where the NF (e.g., Analytics Consumer) based on its internal information identifies grades for the consumed analytics (ID and/or output(s)) and thresholds being crossed indicating problems with the analytics.
  • Uidl Unstable Analytics ID Information
  • NF Feedback can be a tuple with the information about the analytics (ID and/or output(s)) and a flag indicating problems with the analytics.
  • ATDS Analytics Tracing Data Structure
  • An analytics e.g., analytics ID, analytics type, analytics output(s)
  • ATDS is a historical set of ADTS records that have the association of an analytics ID to analytics output(s), an indication of the quality of usage of the analytics in the mobile network, and the configuration at inference and/or training for the analytics (which can mean analytics output(s) or analytics IDs or analytics types), and optionally the analytics rollback actions and/or rollback status.
  • an analytics ID grade value (AidGI) and/or UAidl alerts and/or NF feedbacks
  • the information of the inference and/or training configurations e.g., AICI and/or ATCI
  • the analytics ID grade values (AidGI) and/or UAidl alerts are examples of indication of the quality of usage the analytics ID in the mobile network.
  • AICI Analytics ID Inference Configuration Information
  • Configurations are: interval of data collection for generating the analytics; whether preprocessing of collected data for analytics generation has been applied; type of collected data for generating the analytics; mappings of Access Network properties (such as TAs, Cells, Radio Type, Radio Frequency) to Core Network entities (e.g., associated TAs to AMFs ) or properties (e.g., restricted or unrestricted S-NSSAIs per TAs); geographical aggregation level (e.g., per UEs, per Aol), temporal aggregation (i.e., per minute, per hour).
  • Access Network properties such as TAs, Cells, Radio Type, Radio Frequency
  • Core Network entities e.g., associated TAs to AMFs
  • properties e.g., restricted or unrestricted S-NSSAIs per TAs
  • geographical aggregation level e.g., per UEs, per Aol
  • temporal aggregation i.e., per minute,
  • Parametrization are related to the Analytics Filter Information and Analytics Reporting Information (as defined in 3 GPP TS 23.288 Release 17) for the generation of an analytics, or related to the Data Specification or Format and Processing (as defined in 3GPP TS 23.288 Release 17) definitions when collecting the data for the generation of an analytics
  • ATCI Analytics ID Training Configuration Information: Set of Information related to configuration and/or parametrization for a Machine Learning (ML) Model or simply Model (e.g., optimization model) used by for an analytics (ID and/or output(s)) in a given point in time.
  • An ATCI comprises any of the examples of information listed below:
  • Configurations are: interval of data collection for training the ML model or model for the analytics; whether pre-processing of collected data for analytics training has been applied; type of collected data for training the analytics; mappings of Access Network properties (such as TAs, Cells, Radio Type, Radio Frequency) to Core Network entities (e.g., associated TAs to AMFs ) or properties (e.g., restricted or unrestricted S-NSSAIs per TAs), geographical aggregation level (e.g., per UEs, per Aol), temporal aggregation (i.e., per minute, per hour).
  • Access Network properties such as TAs, Cells, Radio Type, Radio Frequency
  • Core Network entities e.g., associated TAs to AMFs
  • properties e.g., restricted or unrestricted S-NSSAIs per TAs
  • geographical aggregation level e.g., per UEs, per Aol
  • temporal aggregation i.
  • IRN Inference Rollback Notification
  • An Inference Rollback Notification is to have parameter such as tuple with the identification of analytics ID and/or analytics output and a flag, where this flag denotes that there is a problem (or an error) with the analytics (ID and/or output(s)).
  • flags that can be used are: unstable analytics, halt analytics usage, invalid analytics, temporary invalid analytics, trigger inference rollback.
  • Training Rollback Notification Is the set of information, possibly enclosed in a message, related the rollback actions related to an existing analytics (ID and/or output(s)) that can be enforced by a Training NF.
  • the Training Rollback Notification can be for instance:
  • ATCI training information
  • a Training Rollback Notification is to have parameter such as tuple with the identification of analytics ID and/or analytics output and a flag, where this flag denotes that there is a problem (or an error) with the analytics (ID and/or output(s)).
  • flags that can be used are: unstable analytics, halt analytics usage, invalid analytics, temporary invalid analytics, trigger training rollback.
  • Unstable Analytics Notification Is the set of information that identifies an analytics ID and/or analytics output(s) as Unstable Analytics ID, i.e., an analytics (ID and/or output(s)) that are related to problems in the network status.
  • Unstable Analytics Notification comprises any of the information listed as examples below:
  • a parameter such as tuple with the identification of analytics ID and/or analytics output and a flag, where this flag denotes that there is a problem (or an error) with the analytics (ID and/or output(s)). Examples of flags that can be used are: unstable analytics, halt analytics usage, invalid analytics, temporary invalid analytics.
  • Indication for re-selection Is the set of information that relates an ML model and/or model to an analytics ID and/or analytics output(s) that is considered Unstable Analytics ID, i.e., an analytics (ID and/or output(s)) that are related to problems in the network status.
  • Indication for re-training Is the set of information that relates the need (e.g., request) for ML model and/or model training (and/or retraining) to an analytics ID and/or analytics output(s) that is considered Unstable Analytics ID, i.e., an analytics (ID and/or output(s)) that are related to problems in the network status.
  • Unstable Analytics ID i.e., an analytics (ID and/or output(s)
  • Training Rollback Information Is the set of information that indicates a change in the ML model and/or model related to an analytics ID and/or analytics output(s) due to the ML model and/or model has been identified as associated with an Unstable Analytics ID, i.e., an analytics (ID and/or output(s)) that are related to problems in the network status.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

La présente divulgation concerne la génération d'informations d'analytique dans un réseau mobile. La divulgation concerne le suivi d'un identifiant d'analytique (ID) ou d'une ou plusieurs sorties d'analytique pour l'ID d'analytique, et avec une action de retour arrière pour un ID d'analytique instable ou pour au moins une sortie d'analytique instable pour l'ID d'analytique La divulgation concerne en particulier la continuité du traçage et de l'action de retour arrière, dans le cas où l'ID d'analytique est transféré et/ou en cas de mobilité d'un équipement utilisateur UE associé à l'ID d'analytique. À cette fin, la divulgation présente une première entité de traçage d'analytique de réseau, une seconde entité de traçage d'analytique de réseau, une entité de consommateur de réseau, une entité de référentiel de réseau et des procédés correspondants.
PCT/EP2022/062361 2022-05-06 2022-05-06 Continuité de traçage et de retour arrière en cours de transfert d'id d'analytique et de mobilité d'ue WO2023213413A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/EP2022/062361 WO2023213413A1 (fr) 2022-05-06 2022-05-06 Continuité de traçage et de retour arrière en cours de transfert d'id d'analytique et de mobilité d'ue

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2022/062361 WO2023213413A1 (fr) 2022-05-06 2022-05-06 Continuité de traçage et de retour arrière en cours de transfert d'id d'analytique et de mobilité d'ue

Publications (1)

Publication Number Publication Date
WO2023213413A1 true WO2023213413A1 (fr) 2023-11-09

Family

ID=81940982

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2022/062361 WO2023213413A1 (fr) 2022-05-06 2022-05-06 Continuité de traçage et de retour arrière en cours de transfert d'id d'analytique et de mobilité d'ue

Country Status (1)

Country Link
WO (1) WO2023213413A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021164847A1 (fr) * 2020-02-17 2021-08-26 Huawei Technologies Co., Ltd. Suivi et exposition de données utilisées pour générer des analyses
CN114339821A (zh) * 2020-09-30 2022-04-12 英特尔公司 用于分布式nwdaf之间的机器学习模型共享的方法和装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021164847A1 (fr) * 2020-02-17 2021-08-26 Huawei Technologies Co., Ltd. Suivi et exposition de données utilisées pour générer des analyses
CN114339821A (zh) * 2020-09-30 2022-04-12 英特尔公司 用于分布式nwdaf之间的机器学习模型共享的方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
3GPP: "TS 23.288 V17.4.0. Technical Specification Group Services and System Aspects;Architecture enhancements for 5G System (5GS) to support network data analytics services (Release 17)", 23 March 2022 (2022-03-23), pages 1 - 205, XP002808186, Retrieved from the Internet <URL:https://www.3gpp.org/ftp/Specs/archive/23_series/23.288/23288-h40.zip> [retrieved on 20221207] *

Similar Documents

Publication Publication Date Title
US11140048B2 (en) Sharable storage method and system for network data analytics
US20220321423A1 (en) Methods, apparatus and machine-readable media relating to machine-learning in a communication network
EP4014171A1 (fr) Procédés, appareil et supports lisibles par machine se rapportant à un apprentissage automatique dans un réseau de communication
CN112512058A (zh) 网络优化方法、服务器、客户端设备、网络设备和介质
US20230281071A1 (en) Using User Equipment Data Clusters and Spatial Temporal Graphs of Abnormalities for Root Cause Analysis
US20220122183A1 (en) Intelligent user interface monitoring and alert
WO2021032496A1 (fr) Procédés, appareils et support lisible par machine se rapportant à un apprentissage machine dans un réseau de communication
US10862738B2 (en) System and method for alarm correlation and root cause determination
WO2023213413A1 (fr) Continuité de traçage et de retour arrière en cours de transfert d&#39;id d&#39;analytique et de mobilité d&#39;ue
WO2023093431A1 (fr) Procédé et appareil de formation de modèle, support de stockage et produit de programme
WO2022188670A1 (fr) Procédé et appareil de transfert d&#39;analyse de réseau, et entité de fonction de réseau
WO2019165841A1 (fr) Procédé et appareil d&#39;appariement maîtres et de secours pour élément de réseau
US20240171472A1 (en) Network analytics tracing, and rollback for stable consumption of analytics output
CN114266288A (zh) 一种网元检测方法及相关装置
US20240235953A1 (en) Method of using analytics feedback information for analytics accuracy of network data and apparatuses for performing the same
EP4391472A1 (fr) Procédé d&#39;apprentissage d&#39;un modèle d&#39;apprentissage automatique
US20240080245A1 (en) Network data analysis method and system based on federated learning
WO2023213246A1 (fr) Procédé et appareil de sélection de modèle, et dispositif côté réseau
US20090313307A1 (en) Manipulation of network management information
EP4218205B1 (fr) Configuration automatisée de fonctions d&#39;automatisation de réseau multiniveau et multidomaine
US20240119369A1 (en) Contextual learning at the edge
EP4084372A1 (fr) Procédé et appareil pour systèmes de communication comportant des fonctions d&#39;analyse de données de gestion
US20230396496A1 (en) Automated rule generation for network functions
KR20230156656A (ko) 다중 분석 출력 기반 네트워크 기능의 행동 결정 방법 및 이를 수행하는 장치
WO2024052924A1 (fr) Identification de chemin de cause racine par raisonnement machine

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22728170

Country of ref document: EP

Kind code of ref document: A1