WO2024028041A1 - Minimisation basée sur ran de techniques de test de conduite (mdt) permettant de collecter des données pour des modèles d'ia/ml - Google Patents

Minimisation basée sur ran de techniques de test de conduite (mdt) permettant de collecter des données pour des modèles d'ia/ml Download PDF

Info

Publication number
WO2024028041A1
WO2024028041A1 PCT/EP2023/068911 EP2023068911W WO2024028041A1 WO 2024028041 A1 WO2024028041 A1 WO 2024028041A1 EP 2023068911 W EP2023068911 W EP 2023068911W WO 2024028041 A1 WO2024028041 A1 WO 2024028041A1
Authority
WO
WIPO (PCT)
Prior art keywords
ran
measurements
node
ues
data
Prior art date
Application number
PCT/EP2023/068911
Other languages
English (en)
Inventor
Panagiotis Saltsidis
Angelo Centonza
Luca LUNARDI
Philipp BRUHN
Pablo SOLDATI
Germán BASSI
Original Assignee
Telefonaktiebolaget Lm Ericsson (Publ)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget Lm Ericsson (Publ) filed Critical Telefonaktiebolaget Lm Ericsson (Publ)
Publication of WO2024028041A1 publication Critical patent/WO2024028041A1/fr

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/02Arrangements for optimising operational condition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/06Generation of reports
    • H04L43/065Generation of reports related to network devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • H04L41/145Network analysis or design involving simulating, designing, planning or modelling of a network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/16Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using machine learning or artificial intelligence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/02Capturing of monitoring data
    • H04L43/022Capturing of monitoring data by sampling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/08Testing, supervising or monitoring using real traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/10Scheduling measurement reports ; Arrangements for measurement reports

Definitions

  • the present disclosure relates generally to wireless networks, and more specifically to techniques for collecting data in a radio access network (RAN) for training and/or monitoring of artificial intel ligence/machi ne learning (AI/ML) models used for intelligent RAN operation.
  • RAN radio access network
  • AI/ML artificial intel ligence/machi ne learning
  • NR fifth generation
  • eMBB enhanced mobile broadband
  • MTC machine type communications
  • URLLC ultra-reliable low latency communications
  • D2D side-link device-to-device
  • FIG. 1 illustrates a high-level view of an exemplary 5G network architecture, consisting of a Next Generation Radio Access Network (NG-RAN, 199) and a 5G Core (5GC, 198).
  • the NG-RAN can include one or more gNodeB's (gNBs) connected to the 5GC via one or more NG interfaces, such as gNBs (100, 150) connected via respective interfaces (102, 152). More specifically, the gNBs can be connected to one or more Access and Mobility Management Functions (AMFs) in the 5GC via respective NG-C interfaces and to one or more User Plane Functions (UPFs) in 5GC via respective NG-U interfaces.
  • the 5GC can include various other network functions (NFs), such as Session Management Function(s) (SMF).
  • NFs Session Management Function(s) (SMF).
  • the 5GC can be replaced by an Evolved Packet Core (EPC, 198), which conventionally has been used together with a Long-Term Evolution (LTE) Evolved UMTS RAN (E-UTRAN).
  • EPC Evolved Packet Core
  • gNBs e.g., 100, 150
  • MMEs Mobility Management Entities
  • SGWs Serving Gateways
  • each of the gNBs can support frequency division duplexing (FDD), time division duplexing (TDD), or a combination thereof.
  • FDD frequency division duplexing
  • TDD time division duplexing
  • Each of the gNBs can serve a geographic coverage area including one or more cells and, in some cases, can also use various directional beams to provide coverage in the respective cells.
  • DL downlink
  • beam is a coverage area of a network-transmitted reference signal (RS) that may be measured or monitored by a UE.
  • the NG-RAN is layered into a Radio Network Layer (RNL) and a Transport Network Layer (TNL).
  • RNL Radio Network Layer
  • TNL Transport Network Layer
  • NG, Xn, F1 For each NG-RAN interface (NG, Xn, F1) the related TNL protocol and the functionality are specified.
  • the TNL provides services for user plane transport and signaling transport.
  • NG RAN logical nodes include a Central Unit (CU or gNB-CU, e.g., 110) and one or more Distributed Units (DU or gNB-DU, e.g., 120, 130).
  • CUs are logical nodes that host higher-layer protocols and perform various gNB functions such controlling the operation of DUs.
  • DUs are decentralized logical nodes that host lower layer protocols and can include, depending on the functional split option, various subsets of the gNB functions.
  • Each CU and DU can include various circuitry needed to perform their respective functions, including processing circuitry, communication interface circuitry ⁇ e.g., transceivers), and power supply circuitry.
  • a gNB-CU connects to one or more gNB-DUs over respective F1 logical interfaces (e.g., 122 and 132 shown in Figure 1).
  • F1 logical interfaces e.g., 122 and 132 shown in Figure 1.
  • a gNB-DU can be connected to only a single gNB-CU.
  • the gNB-CU and its connected gNB- DU(s) are only visible to other gNBs and the 5GC as a gNB. In other words, the F1 interface is not visible beyond gNB- CU.
  • Centralized control plane protocols ⁇ e.g., PDCP-C and RRC
  • PDCP-U centralized user plane protocols
  • a gNB-CU can be divided logically into a CU-CP function (including RRC and PDCP for signaling radio bearers) and CU-UP function (including PDCP for UP).
  • a single CU-CP can be associated with multiple CU-UPs in a gNB.
  • the CU-CP and CU-UP communicate with each other using the E1-AP protocol over the E1 interface.
  • the F1 interface between CU and DU (see Figure 1) is functionally split into F1-C between DU and CU-CP and F1-U between DU and CU-UP.
  • Three deployment scenarios for the split gNB architecture shown in Figure 1 are CU-CP and CU-UP centralized, CU-CP distributed/CU-UP centralized, and CU-CP centralized/CU-UP distributed.
  • UEs and RAN nodes can be configured to perform and report measurements to support minimization of drive testing (MDT), which is intended to reduce and/or minimize the requirements for manual testing of network performance by driving around the geographic coverage of the network.
  • MDT minimization of drive testing
  • the MDT feature was first studied in Long-Term Evolution (LTE) Rel-9 (e.g., 3GPP TR 36.805 v9.0.0), first standardized for LTE in Rel-10, and is also supported for 5G/NR.
  • MDT can address various network performance improvements such as coverage optimization, capacity optimization, mobility optimization, quality-of-service (QoS) verification, and parameterization for common channels (e.g., PDSCH).
  • MDT measurements can be management-based or signaling-based, and are supported for dual connectivity (DC) and the split node architecture shown in Figure 1.
  • Machine learning is a type of artificial intelligence (Al) that focuses on the use of data and algorithms to imitate the way that humans learn, gradually improving its performance.
  • ML algorithms build models based on sample (or "training”) data, with the models being used subsequently to make predictions or decisions.
  • ML algorithms can be used in a wide variety of applications (e.g., medicine, email filtering, speech recognition, etc.) in which it is difficult or unfeasible to develop conventional algorithms to perform the needed tasks.
  • AI/ML can be used to enhance the performance of a RAN, such as the NG-RAN shown in Figure 1 .
  • 3GPP TR 37.817 (v17.0.0) describes a study on enhancement for data collection for NR and EN-DC (EUTRAN-NGRAN dual connectivity).
  • This study describes a functional framework for RAN intelligence enabled by further data collection through use cases, examples etc., and identifies potential standardization impacts on current NG-RAN nodes and interfaces.
  • the study also describes some high-level principles for RAN intelligence enabled by Al .
  • Existing techniques for MDT activation and data collection are suitable and cost-effective for their original purposes, but are not suitable for data collection for the AI/ML framework described in 3GPP TR 37.817 (v17.0.0).
  • existing signaling-based MDT techniques target specific UEs that are pre-selected by the 5GC without considering up-to-date information available at the RAN node.
  • existing management-based MDT techniques are activated on a per-cell granularity, which provides only RAN control based on UEs that are currently present in a cell of interest.
  • existing MDT techniques lack capabilities for RAN-based selection of UEs, which is needed to obtain the desired training and/or inference data needed for proper operation of AI/ML models used for RAN intelligence and/or operations.
  • An object of embodiments of the present disclosure is to improve data collection to support AI/ML models used for RAN intelligence and/or operations, such as by providing, enabling, and/or facilitating solutions to exemplary problems summarized above and described in more detail below.
  • Embodiments include methods ⁇ e.g., procedures) performed by a RAN node for collecting data to be used with AI/ML models.
  • These exemplary methods can include receiving, from a network node or function (NNF) outside of the RAN, a first request to activate a trace session for measurements by one or more UEs in the RAN.
  • the first request includes information indicating that the measurements are associated with one or more AI/ML models.
  • These exemplary methods can include, based on the information received with the first request, selecting one or more UEs served by the RAN node to perform the requested measurements.
  • These exemplary methods can include sending, to the selected UEs, respective second requests to perform the measurements for the trace session.
  • These exemplary methods can include receiving, from the selected UEs, respective measurement reports comprising results of the measurements performed in accordance with the respective second requests.
  • the information received with the first request includes one or more of the following:
  • these exemplary methods can include performing at least one operation on the one or more AI/ML models based on the results of the measurements.
  • one of the following operations is performed for each of the AI/ML model based on the results of the measurements: model training, model re-training, continued model training based on a partially trained model received from the network node, model modification, model inference, model performance evaluation, model performance monitoring, input collection, and feedback collection.
  • these exemplary methods can include receiving, from a core network node, a plurality of service requests associated with a corresponding plurality of UEs. Each service request includes one or more AI/ML- related indicators relevant for selection of the corresponding UE to perform measurements associated with AI/ML models. These exemplary methods can also include storing the one or more Al/M L-rel ated indicators for the respective UEs. In some of these embodiments, the one or more AI/ML-related indicators are stored in or with respective UE contexts.
  • each UE served by the RAN node is associated with one or more AI/ML-related indicators relevant for selection of the UE to perform measurements associated with AI/ML models.
  • selecting one or more UEs based on the information received with the first request includes selecting, from a plurality of UEs served by the RAN node, UEs with associated AI/ML-related indicators that match or correspond to one or more of the following: at least one of the identifiers of the AI/ML models, at least one scope configuration parameter that differentiates the respective AI/ML models, and at least one output feedback identifier.
  • the measurements are MDT measurements
  • the NNF outside of the RAN is a network management system (e.g., OAM)
  • the core network node is an AMF
  • each service request is an initial context setup request or a handover request.
  • these exemplary methods can include sending to a TOE a trace record comprising the results of the measurements performed by the one or more UEs.
  • the trace record also includes an indication that the results of the measurements were collected for one or more of the following: use of AI/ML in the RAN, one or more specific AI/ML use cases, one or more specific AI/ML models, and one or more specific AI/ML model types.
  • the trace record is also sent to one or more of the following: a network management system (e.g., OAM), a core network node (e.g., AMF), and one or more other RAN nodes (e.g., neighbor RAN nodes).
  • these exemplary methods can also include the following operations:
  • the trace record sent to the TCE also includes the results of the measurements performed by the one or more RAN nodes.
  • these exemplary methods can include sending, to the NNF outside of the RAN, a further request to activate the trace session for measurements associated with one or more AI/ML models.
  • the first request is received as a permission or a positive acknowledgement in response to the further request.
  • the further request includes a list of one or more UE identifiers for which user consent is required for the activation of the trace session, and the first request includes an indication of user consent to activate the trace session for the one or more UE identifiers.
  • RAN nodes e.g., base stations, eNBs, gNBs, ng-eNBs, etc. or unit/function thereof
  • Other embodiments include non-transitory, computer-readable media storing program instructions that, when executed by processing circuitry, configure such RAN nodes to perform operations corresponding to any of the exemplary methods described herein.
  • embodiments described herein can facilitate the use of conventional MDT/Trace functionality for collection of training data, input data, and feedback information for AI/ML models.
  • embodiments can leverage the existing MDT framework for new purposes and/or applications related to AI/ML.
  • Embodiments also facilitate a granular selection of AI/ML related data for collection by OAM and/or RAN.
  • embodiments facilitate intelligent RAN implementations based on AI/ML, as well as improved RAN performance.
  • Figures 1-2 illustrate two high-level views of an exemplary 5G network architecture.
  • Figure 3 shows a signaling diagram for 5GS management activation.
  • Figure 4 shows an NG-RAN trace start procedure for file-based trace reporting.
  • Figure 5A-B shows an NG-RAN trace start procedure for streaming trace reporting.
  • Figure 6 shows an exemplary signaling-based MDT activation procedure after a UE attaches to 5GC via NG- RAN.
  • Figure 7 shows an exemplary procedure for management-based MDT activation in NG-RAN for the case of non-split RAN node architecture.
  • Figure 8 is a block diagram of an exemplary framework for RAN intelligence based on AI/ML models.
  • Figure 9 shows an exemplary procedure for configuration and activation of RAN-based MDT with 5GC, according to various embodiments of the present disclosure.
  • Figure 10 shows a flow diagram of an exemplary method (e.g., procedure) for a RAN node (e.g., base station, eNB, g N B, ng-eNB, etc.), according to various embodiments of the present disclosure.
  • a RAN node e.g., base station, eNB, g N B, ng-eNB, etc.
  • Figure 11 shows a communication system according to various embodiments of the present disclosure.
  • Figure 12 shows a network node according to various embodiments of the present disclosure.
  • Figure 13 is a block diagram of a virtualization environment in which functions implemented by some embodiments of the present disclosure may be virtualized.
  • Figure 14 illustrates communication between a host computing system, a network node, and a UE via multiple connections, at least one of which is wireless, according to various embodiments of the present disclosure.
  • Radio Access Node As used herein, a “radio access node” (or equivalently “radio network node,” “radio access network node,” or “RAN node”) can be any node in a radio access network (RAN) that operates to wirelessly transmit and/or receive signals.
  • RAN radio access network
  • a radio access node examples include, but are not limited to, a base station (e.g., gNB in a 3GPP 5G/NR network or an enhanced or eNB in a 3GPP LTE network), base station distributed components (e.g., CU and DU), a high-power or macro base station, a low-power base station (e.g., micro, pico, femto, or home base station, or the like), an integrated access backhaul (IAB) node, a transmission point (TP), a transmission reception point (TRP), a remote radio unit (RRU or RRH), and a relay node.
  • a base station e.g., gNB in a 3GPP 5G/NR network or an enhanced or eNB in a 3GPP LTE network
  • base station distributed components e.g., CU and DU
  • a high-power or macro base station e.g., a low-power base station (e.g., micro
  • a "core network node” is any type of node in a core network.
  • Some examples of a core network node include, e.g., a Mobility Management Entity (MME), a serving gateway (SGW), a PDN Gateway (P-GW), a Policy and Charging Rules Function (PCRF), an access and mobility management function (AMF), a session management function (SMF), a user plane function (UPF), a Charging Function (CHF), a Policy Control Function (PCF), an Authentication Server Function (AUSF), a location management function (LMF), or the like.
  • MME Mobility Management Entity
  • SGW serving gateway
  • P-GW PDN Gateway
  • PCRF Policy and Charging Rules Function
  • AMF access and mobility management function
  • SMF session management function
  • UPF user plane function
  • Charging Function CHF
  • PCF Policy Control Function
  • AUSF Authentication Server Function
  • LMF location management function
  • Wireless Device As used herein, a “wireless device” (or “WD” for short) is any type of device that is capable, configured, arranged and/or operable to communicate wirelessly with network nodes and/or other wireless devices. Communicating wirelessly can involve transmitting and/or receiving wireless signals using electromagnetic waves, radio waves, infrared waves, and/or other types of signals suitable for conveying information through air. Unless otherwise noted, the term “wireless device” is used interchangeably herein with the term “user equipment” (or “UE” for short), with both terms having a different meaning than the term “network node”.
  • Radio Node As used herein, a "radio node” can be either a “radio access node” (or equivalent term) or a "wireless device.”
  • Network Node is any node that is either part of the radio access network ⁇ e.g., a radio access node or equivalent term) or of the core network ⁇ e.g., a core network node discussed above) of a cellular communications network.
  • a network node is equipment capable, configured, arranged, and/or operable to communicate directly or indirectly with a wireless device and/or with other network nodes or equipment in the cellular communications network, to enable and/or provide wireless access to the wireless device, and/or to perform other functions ⁇ e.g., administration) in the cellular communications network.
  • node can be any type of node that can in or with a wireless network (including RAN and/or core network), including a radio access node (or equivalent term), core network node, or wireless device.
  • a wireless network including RAN and/or core network
  • radio access node or equivalent term
  • core network node or wireless device.
  • node may be limited to a particular type (e.g., radio access node, IAB node) based on its specific characteristics in any given context.
  • Figure 2 shows another high-level view of an exemplary 5G network architecture, including an NG-RAN (299) and a 5GC (298).
  • the NG-RAN can include gNBs ⁇ e.g., 210a, b) and ng-eNBs ⁇ e.g., 220a, b) that are interconnected with each other via respective Xn interfaces.
  • the gNBs and ng-eNBs are also connected via the NG interfaces to the 5GC, more specifically to Access and Mobility Management Functions (AMFs, e.g., 230a, b) via respective NG-C interfaces and to User Plane Functions (UPFs, e.g., 240a, b) via respective NG-U interfaces.
  • AMFs Access and Mobility Management Functions
  • UPFs User Plane Functions
  • the AMFs can communicate with Policy Control Functions (PCFs, e.g., 250a, b) and Network Exposure Functions (NEFs, e.g., 260a, b).
  • PCFs Policy Control Functions
  • NEFs Network Exposure Functions
  • Each of the gNBs can support the NR radio interface including frequency division duplexing (FDD), time division duplexing (TDD), or a combination thereof.
  • Each of ng-eNBs can support the fourth generation (4G) Long- Term Evolution (LTE) radio interface. Unlike conventional LTE eNBs, however, ng-eNBs connect to the 5GC via the NG interface.
  • Each of the gNBs and ng-eNBs can serve a geographic coverage area including one or more cells (e.g., 211 a-b, 221 a-b).
  • a UE (205) can communicate with the gNB or ng-eNB serving that cell via the NR or LTE radio interface, respectively.
  • Figure 2 shows gNBs and ng-eNBs separately, it is also possible that a single NG-RAN node provides both types of functionality.
  • NR networks In addition to providing coverage via cells as in LTE, NR networks also provide coverage via "beams.”
  • a downlink (DL, i.e., network to UE) "beam” is a coverage area of a network-transmitted reference signal (RS) that may be measured or monitored by a UE.
  • RS can include any of the following: synchronization signal/PBCH block (SSB), channel state information RS (CSI -RS), tertiary reference signals (or any other sync signal), positioning RS (PRS), demodulation RS (DMRS), phase-tracking reference signals (PTRS), etc.
  • SSB is available to all UEs regardless of the state of their connection with the network, while other RS ⁇ e.g., CSI-RS, DM-RS, PTRS) are associated with specific UEs that have a network connection.
  • the radio resource control (RRC) protocol controls communications between UE and gNB at the radio interface as well as mobility of a UE between cells in the NG-RAN.
  • RRC also broadcasts system information (SI) and performs establishment, configuration, maintenance, and release of data radio bearers (DRBs) and signaling radio bearers (SRBs) used by UEs. Additionally, RRC controls addition, modification, and release of carrier aggregation (CA) and dual-connectivity (DC) configurations for UEs.
  • RRC also performs various security functions such as key management.
  • a UE After a UE is powered ON it will be in the RRCJDLE state until an RRC connection is established with the network, at which time the UE will transition to RRCJDONNECTED state ⁇ e.g., where data transfer can occur).
  • the UE returns to RRCJDLE after the connection with the network is released, in RRCJDLE state, the UE’s radio is active on a discontinuous reception (DRX) schedule configured by upper layers.
  • DRX discontinuous reception
  • an RRCJDLE UE receives SI broadcast in the ceil where the UE is camping, performs measurements of neighbor cells to support cell reselection, and monitors a paging channel on PDCCH for pages from 5GC via gNB.
  • An NR UE in RRCJDLE state is not known to the gNB serving the cell where the UE is camping.
  • NR RRC includes an RRCJNACTIVE state in which a UE is known (e.g., via UE context) by the serving gNB.
  • RRCJNACTIVE has some properties similar to a "suspended” condition used in LTE.
  • UEs and RAN nodes can be configured to perform and report measurements to support minimization of drive testing (MDT), which is intended to reduce and/or minimize the requirements for manual testing of network performance by driving around the geographic coverage of the network.
  • MDT was previously specified for LTE and is being specified for NR in Rel-16.
  • a UE in RRCJDLE state can be configured (e.g., via a LoggedMeasurement-Configuration RRC message from the network) to perform logged MDT measurements.
  • An MDT configuration can include logginginterval and loggingduration.
  • the UE starts a timer (T330) set to loggingduration (e.g., 10-120 min) upon receiving the configuration, and perform periodic MDT logging every logginginterval (1.28-61.44 s) within the loggingduration while the UE is in RRCJDLE state.
  • the UE collects DL reference signal received strength and quality (i.e., RSRP, RSRQ) based on existing measurements required for cell reselection purposes.
  • the UE reports the collected/logged information to the network when the UE returns to RRC_CONNECTED state.
  • a UE can also be configured to perform and report immediate MDT measurements while in RRC_CONNECTED state.
  • immediate MDT measurements are based on existing UE and/or network measurements performed while a UE is in RRC_CONNECTED state, and can include any of the following measurement quantities:
  • M1 DL signal quantities measurement results for the serving cell and for intra-frequency/lnter- frequency/inter-RAT neighbor cells, including cell/beam level measurement for NR cells only.
  • M4 PDCP SDU Data Volume measurement separately for DL and UL, per DRB per UE.
  • M5 Average UE throughput measurement separately for DL and UL, per DRB per UE and per UE for the DL, per DRB per UE and per UE for the UL, by gNB.
  • M6 Packet Delay measurement separately for DL and UL, per DRB per UE.
  • M7 Packet loss rate measurement separately for DL and UL, per DRB per UE.
  • M8 RSSI measurement by UE (for WLAN/Bluetooth measurement).
  • the reporting of M1 measurements can be event-triggered according to existing RRM configuration for any of events A1 -A6 or B1-B2.
  • M1 reporting can be periodic, A2 event-triggered, or A2 event-triggered periodic according to an MDT-specific measurement configuration.
  • the reporting of M2 measurements can be based on reception of Power Headroom Report (PHR), while reporting for M3-M9 can be triggered by the expiration of a measurement collection period.
  • PHR Power Headroom Report
  • the MDT framework provides two ways of activating MDT and collecting data from the UEs.
  • managementbased MDT data is collected from UEs in a specified area defined as a list of cells or as a list of tracking/routing/location areas.
  • Management-based MDT is an enhancement of management-based trace functionality and can be used with either logged or immediate MDT.
  • signaling-based MDT data is collected from a specific UE as specified by an IMEI(SV) or an IMSI.
  • Signaling-based MDT is an enhancement of signaling-based subscriber and equipment trace functionality and can be used with either logged or immediate MDT.
  • a Network Element (NE, specified according to 3GPP TS 32.422 (v17.7.1) section 5.4) is configured with Trace Control and Configuration parameters via interaction between a Provisioning management service (MnS) consumer and a Provisioning MnS producer.
  • MnS Provisioning management service
  • Figure 3 shows a signaling diagram for 5GS management activation where the role of Provisioning MnS producer is played by the NE and the role of Provisioning MnS consumer is played by the Management System.
  • the configured NE shall not propagate the received Trace Control and Configuration parameters to any other NE's - regardless of whether the NE is involved in the actual data collection for the call.
  • the NG-RAN Cell Traffic trace functionality can be used for Management Based Trace Activation.
  • Trace Session Activation is done to one or more (e.g., a list of) cells provided by an NG-RAN node.
  • the following trace control and configuration parameters of the Trace Session are received by NG-RAN node in the trace session activation message from the Management System:
  • TCE Trace Collection Entity
  • the NG-RAN node When the NG-RAN node receives the Trace Session Activation message from the management system, the NG-RAN node starts a Trace Session for the given cell or a list of cells.
  • the NG-RAN node After the Cell Traffic Trace has been activated in the monitored cell(s), the NG-RAN node starts Trace Recording Sessions for new and existing calls/sessions, although events for existing calls/sessions are not required to be recorded prior to the activation of the Cell Traffic Trace.
  • the NG-RAN node When the NG-RAN node starts a Trace Recording Session it allocates a Trace Recording Session Reference (TRSR) for that session.
  • TRSR Trace Recording Session Reference
  • the NG-RAN node sends the allocated TRSR, the TR, and the TCE IP Address in a CELL TRAFFIC TRACE message to the AMF via the NG connection.
  • Figure 4 shows an NG-RAN trace start procedure for file-based trace reporting.
  • the NG-RAN node For streaming trace reporting, the NG-RAN node sends the allocated TRSR, the TR, and the URI of the Trace Reporting MnS consumer in a CELL TRAFFIC TRACE message to the AMF via the NG connection.
  • Figure 5A-B shows an NG-RAN trace start procedure for streaming trace reporting.
  • AMF when the CELL TRAFFIC TRACE message, it obtains the SUPI/IMEI(SV) of the given call from its database and sends the obtained SUPI/IMEI (SV) numbers together with the TSRS and TR to the TCE (for file-based trace reporting) or to the Trace Reporting MnS consumer (for streaming trace reporting).
  • the NG-RAN supports several public land mobile networks (PLMNs)
  • PLMNs public land mobile networks
  • the NG-RAN node only selects UEs that provide a selectedPLMN-ldentity (e.g., in an RRCConnectionSetup message) that matches a pLMNTarget.
  • an NG-RAN node For management-based MDT activation, an NG-RAN node starts a trace recording session in a given cell for either immediate or logged MDT measurements for each selected UE that satisfies the MDT UE selection criteria or capability condition (e.g., logged MDT capable UE), provided that the management system previously activated a relevant cell trace session for that cell.
  • the NG-RAN node configures each of the selected UEs with corresponding MDT RRC measurements.
  • the NG-RAN supports several PLMNs, the NG-RAN node only selects UEs that provide a selectedPLMN-ldentity (e.g., in an RRCConnectionSetup message) that matches a pLMNTarget.
  • activation of UE measurements extends the 5GC trace activation procedure.
  • configuration parameters of MDT are added into the message.
  • an activation request for UE performance measurements is propagated to a selected UE. This mechanism works for any of following input parameters:
  • the AMF forwards the MDT configurations to the RAN node. If area information is specified, the AMF only forwards the MDT configuration to the RAN node when the UE satisfies the area information.
  • the RAN node can determine whether the selected IMSI/IMEI(SV)/SUPI satisfies criteria for initiating MDT data collection. If the area information is not satisfied, the RAN node retains the MDT configuration and propagates it during handover of the selected IMSI/IMEI (SV)/SUPI, as further specified in 3GPP TS 32.422 (v17.7.1 ) section 4.4.
  • the RAN node For immediate MDT, there is no need to do MDT criteria checking by the UE.
  • the RAN node For logged MDT, after receiving the MDT configuration, the RAN node will forward it to the selected IMSI/I MEI (SV)/SUPI in an RRCReconfiguration message. After the UE receives the MDT configuration from the RAN node, it detects whether it is within the specified area information. If so, the UE will perform the measurement job specified by the MDT configuration. Otherwise, the UE will refrain from performing the measurement job and occasionally re-check whether it is within the specified area information.
  • IMSI/I MEI SV
  • RRCReconfiguration message After the UE receives the MDT configuration from the RAN node, it detects whether it is within the specified area information. If so, the UE will perform the measurement job specified by the MDT configuration. Otherwise, the UE will refrain from performing the measurement job and occasionally re-check whether it is within the specified area information.
  • the UE's trace session context is preserved in the network when the UE enters RRCJDLE or RRCJNACTIVE.
  • the trace session context is preserved in the UE until the trace session duration expires, even during state transitions between RRCJDLE/RRCJNACTIVE and RRC_CONNECTED and vice versa.
  • the UE's logged MDT trace session context is stored in the network while the trace session is active, including when the UE is in RRC_CONNECTED.
  • a RAN node stores/retains an MDT configuration for a selected UE that is in RRCJNACTIVE when the RAN node receives the MDT configuration. When the UE moves to a cell served by a second RAN node, the RAN node forwards this information to the second RAN node during UE context retrieval.
  • the MDT activation procedure after UE attachment is the same whether the UE attaches to 5GC or EPC.
  • Figure 6 shows an exemplary MDT activation procedure after a UE attaches to 5GC via NG-RAN.
  • the unified data management function After receiving the Trace Session Activation command with the MDT configuration, the unified data management function (UDM) stores the relevant information and sends a message to the AMF to activate the trace for the MDT job.
  • This message includes the following configuration parameters:
  • TRSR Trace Recording Session Reference
  • Events List for Event-Triggered Measurement (logged MDT only), e.g., Event Threshold, Hysteresis, Time to Trigger (present only if L1 event is configured for logged MDT).
  • the AMF is not required to initiate paging of the UE to send the configuration.
  • the Management System initiating MDT activation shall validate that PLMNs specified in the MDT PLMN List are supported by all the cells specified in the area scope.
  • a RAN node ignores any received requests for which none of the PLMNs in the MDT PLMN List match any PLMN that the RAN node is associated with.
  • the RAN node sends the AMF a TRACE FAILURE INDICATION message when the RAN node could not configure the UE during a handover to a target cell. Subsequently, the AMF shall try to reactivate MDT in the target cell if the target cell scope meets the MDT criteria.
  • the AMF When the UE re-enters a PLMN specified in the MDT PLMN List, the AMF shall be responsible for restarting the immediate MDT activation. If the re-entry is a result of an Xn handover, then one option is for AMF to use the path switch request as trigger. However, this re-starting "requirement” is only for best effort, since there can be cases where AMF may not be able to restart the MDT when the UE re-enters the PLMN specified in the MDT PLMN List. For example, the AMF may not be able to restart MDT when the UE performs intra-RAN node handover where path switch request is not necessarily sent.
  • Figure 7 shows an exemplary procedure for management-based MDT activation in NG-RAN for the case of non-split RAN node architecture.
  • UE selection can be done in the RAN node (e.g., gNB) based on input information received from management system and the user consent information stored in the RAN node.
  • This mechanism works for Area Information GAM input parameter.
  • a description of this procedure is given in 3GPP TS 32.422 (v17.7.1) section 4.1.1.9.2, with the most relevant parts repeated below.
  • the Management based MDT PLMM List in an Initial Context Setup Request or in a Handover Request message, it stores it for possible later usage. This is shown as operation 0, occurring at two possible places in the flow.
  • the management system sends a Trace Session activation request to the RAN node.
  • This request includes one or more of the following parameters for configuring UE measurements (as described further in 3GPP TS 32.422 (v17.7.1) section 5):
  • Events List for Event-Triggered Measurement (logged MDT only), e.g., Event Threshold, Hysteresis, Time to Trigger (present only if L1 event is configured for logged MDT).
  • the RAN node when the RAN node receives the Trace Session activation request from its management system, it starts a Trace Session and saves the parameters associated with the Trace Session.
  • the RAN node selects suitable UEs for MDT data collection. The selection is based on the area received from the management system, the areas where UEs are located, and user consent information received from the 5GC in the Management based MDT PLMN List. If a user is not in the specified area or if the Management based MDT PLMN List IE is not present in the UE context, the RAN node does not select the UE for MDT data collection.
  • the RAN node also considers UE MDT capability when it selects UE for logged MDT configuration and does not select a UE that does not support logged MDT. If M4 or M5 measurements are requested in the MDT configuration, the RAN node starts measurement according to the received configuration.
  • the RAN node activates the MDT functionality to the selected UEs.
  • the RAN node selects a UE, it considers availability of Management based MDT PLMN List in the associated user context and the area scope parameter received in MDT configuration (Trace Session activation). Detailed description about user consent handling and how it is provided to the RAN node is described in 3GPP TS 32.422 (v17.7.1 ) section 4.9.2. If there is no Management based MDT PLMN List in the user context or the user is outside the area scope defined in the MDT configuration, the RAN node does not select the UE for MDT data collection.
  • the RAN node assigns a Trace Recording Session Reference (TRSR) to each selected UE.
  • TRSR Trace Recording Session Reference
  • the RAN node For logged MDT, the RAN node sends at least the following configuration information to the UE:
  • TCE Id e.g., value signaled as IP address of TCE from the EM is mapped to a TCE Id, using a configured mapping in the RAN
  • Area Scope where the UE measurements should be collected e.g., cell list or tracking area
  • the RAN node cannot send the logged MDT configuration to UEs currently camping in the cell in RRCJDLE/RRCJNACTIVE. These UEs may be configured when they next initiate some activity (e.g., Service Request or Tracking Area Update) that causes them to transition to RRC_CONNECTED.
  • some activity e.g., Service Request or Tracking Area Update
  • the RAN node For immediate MDT, the RAN node sends one or more of the following parameters to the UE: List of Measurements, Reporting Trigger, Report Interval, Report Amount, and Event Threshold.
  • the RAN node performs necessary actions specified in TS 38.305 [52] according to the value of Positioning Method (e.g., activating GNSS module of the UE) received in the Trace configuration.
  • the RAN node captures location information and/or positioning measurements in the MDT trace record. If the Reporting Trigger parameter indicates that all configured RRM measurement triggers should be reported in MDT, the RAN node requests the UE to provide "best effort" location information together with the measurement reporting by setting the includeLocationlnfo IE in all RRC measurement reporting configurations.
  • the RAN node When UE receives the MDT activation, it starts MDT functionality based on the received configuration parameters.
  • the RAN node can retrieve the MDT report from the UE, via RRC message. However, the RAN node shall not retrieve MDT report from the UE if UE's registered PLMN (rPLMN) does not match the PLMN where TCE used to collect MDT data resides (e.g., RAN node's primary PLMN).
  • rPLMN UE's registered PLMN
  • the RAN node For immediate MDT, when the RAN node receives the MDT report from the UE in the RRC message the RAN node stores the UE's serving cell CGI together with the MDT report from the UE in the trace record.
  • a UE configured to perform logged MDT measurements in RRCJDLE or RRCJNACTIVE indicates the availability of MDT measurements by means of a one-bit indicator, in RRCConnectionSetupComplete message during connection establishment as specified in 3GPP TS 32.422 (v17.7.1).
  • the RAN node can decide to retrieve the logged measurements based on this indication by sending the UElnformationRequest message to the UE.
  • the UE can answer with the collected MDT logs in UElnformationResponse message.
  • the RAN node When the RAN node receives the MDT report from UE, the RAN node obtains TRSR, TR, and TCE Id from the report and compare the Trace PLMN (i.e., PLMN portion of TR) with the PLMN where TCE used to collect MDT data resides (e.g., its primary PLMN). The RAN node discards the MDT report in case of a mismatch but otherwise saves the UE measurements from the report to MDT records in operation 6.
  • the Trace PLMN i.e., PLMN portion of TR
  • TCE used to collect MDT data resides e.g., its primary PLMN
  • the RAN node checks whether MDT anonymization requires the IMEI-TAC in the MDT record. If so, in operation 8 the RAN node sends TRSR, TR, serving cell CGI, and TCE IP Address in the CELL TRAFFIC TRACE message to the AMF via the NG connection. When the AMF receives this NG signaling message from the RAN node, it checks the Privacy Indicator (set to Logged MDT or Immediate MDT depending on configured Job Type). For logged MDT, the AMF sends the IMEI-TAC together with TRSR and TR to TCE as shown in Figure 7.
  • the AMF looks up the subscriber identities (IMEI(SV)) of the given call from its database and includes that information in the message sent in operation 9.
  • IMEI(SV) subscriber identities
  • TRSR may be duplicated among different RAN nodes when multiple cells are selected as the area scope for the same MDT job. In this case, the combination of TRSR and the UE's serving cell CGI in the MDT report can uniquely identify one trace recording session.
  • the RAN node forwards the trace records to the TCE.
  • the TCE Id indicated in the MDT report is translated to the actual IP address of the TCE by the RAN node before it forwards the measurement records, using configured mapping in the RAN node.
  • the IP address of the TCE is indicated for the RAN node in the trace configuration.
  • An Immediate MDT measurement configuration is deleted in the UE together with the RRC context when entering idle or inactive mode.
  • a Logged MDT trace session is preserved in the UE until the duration time of the trace session expires, including also multiple idle or inactive periods interrupted by various state transitions between RRCJDLE and RRC_CONNECTED.
  • the TCE combines the MDT record received in operation 10 with TAG received in operation 9 (for logged MDT) based on TR and TRSR included in both.
  • the Management system validates that mobile country code (MCC) and mobile network code (MNC) specified TR is the same as the PLMN supported by all the cells specified in the area scope. If the RAN node receives a request with a PLMN in TR that does not match any PLMN in its list, it shall ignore the request.
  • MCC mobile country code
  • MNC mobile network code
  • AI/ML can be used to enhance the performance of a RAN, such as NG-RAN.
  • 3GPP TR 37.817 (v17.0.0) describes a study on enhancement for data collection for NR and EN -DC. This study describes a functional framework for RAN intelligence enabled by further data collection through use cases, examples, etc., and identifies potential standardization impacts on current NG-RAN nodes and interfaces. The study also describes some high-level principles to be applied for RAN intelligence enabled by Al.
  • 3GPP TR 37.817 also includes Figure 8, which is a block diagram of an exemplary framework for RAN intelligence based on AI/ML models.
  • an AI/ML model is a data driven algorithm that applies AI/ML techniques to generate a set of outputs based on a set of inputs.
  • 3GPP TR 37.817 (v17.0.0) describes the following high-level principles in the context of Figure 8:
  • Model Training and Model Inference functions should be able to request, if needed, specific information to be used to train or execute the AI/ML algorithm and to avoid reception of unnecessary information. The nature of such information depends on the use case and on the AI/ML algorithm .
  • Model Inference function should signal the outputs of the model only to nodes that have explicitly requested them (e.g., via subscription), or nodes that take actions based on the output from Model Inference.
  • the Data Collection block in Figure 8 is a function that provides input data to Model Training and Model Inference functions (described below).
  • training data is used by the Model Training function while “inference data” is used by the Model Inference function.
  • AI/ML algorithm-specific data preparation e.g., data preprocessing and cleaning, formatting, and transformation
  • Examples of input data include measurements from UEs or different network entities, feedback from the Actor block (described below), and output from an AI/ML model.
  • the Model Training block in Figure 8 is a function that performs the AI/ML model training, validation, and testing.
  • training involves learning the input/output relationship for an AI/ML model in a data-driven manner, so the trained AI/ML Model can be used for inference.
  • the testing may generate model performance metrics.
  • the Model Training function is also responsible for data preparation (e.g., data pre-processing and cleaning, formatting, and transformation) based on Training Data provided by the Data Collection function, if required.
  • the Model Training block includes a Model Deployment/Update procedure that is used to initially deploy a trained, validated, and tested AI/ML model to the Model Inference function , as well as to provide model updates to the Model Inference function. Details of the Model Deployment/Update procedure and the use case-specific AI/ML models transferred via this procedure are out of scope of the Rel-17 study item (SI). The feasibility of single-vendor or multi-vendor environment has not been studied in the Rel-17 SI.
  • the Model Inference block in Figure 8 is a function that provides AI/ML model outputs such as predictions or decisions.
  • inference involves using a trained AI/ML model to produce a set of outputs based on a set of inputs.
  • the Model Inference function may provide model performance feedback to the Model Training function, when applicable.
  • the Model Inference function is also responsible for data preparation (e.g. , data pre-processing and cleaning, formatting, and transformation) based on the Inference Data provided by the Data Collection function, if required. Details of the inference outputs and the model performance feedback are out of scope of the Rel-17 SI.
  • the Actor block in Figure 8 is a function that receives the output from the Model inference function and triggers or performs corresponding actions.
  • the Actor may trigger actions directed to itself or to other entities.
  • the Actor can also provide Feedback Information that may be needed to derive the Training Data, the Inference Data, or to monitor the performance of the AI/ML Model and its impact to the network through updating of key performance indicators (KPIs) and performance counters.
  • KPIs key performance indicators
  • 3GPP TR 37.817 (v17.0.0) also identifies three use cases for RAN Intelligence: network energy savings, load balancing, and mobility optimization. 3GPP TR 37.817 (v17.0.0) describes that the following solutions can be used to support these three use cases:
  • AI/ML Model Training function is deployed in GAM, while the Model Inference function resides within the RAN node (e.g., gNB).
  • RAN node e.g., gNB
  • Both the AI/ML Model Training function and the AI/ML Model Inference function reside within the RAN node (e.g., gNB).
  • • gNB can continue Model Training based on AI/ML model trained in the 0AM.
  • AI/ML-based network energy saving 1) AI/ML Model Training is in the 0AM and AI/ML Model Inference is in the gNB-CU; or 2) AI/ML Model Training and Model Inference are both located in the gNB-CU.
  • AI/ML Model Training is in CU-CP or 0AM
  • AI/ML Model Inference function is in CU-CP
  • AI/ML-based Load Balancing 1) AI/ML Model Training is in the CAM and AI/ML Model Inference is in the gNB-CU; or 2) AI/ML Model Training and Model Inference are both located in the gNB-CU.
  • Existing techniques for MDT activation and data collection are suitable and cost- effective for their original purposes, but are not suitable for data collection for the AI/ML framework described in 3GPP TR 37.817 (v17.0.0).
  • existing signaling-based MDT techniques target specific UEs that are preselected by the 5GC without considering up-to-date information available at the RAN node.
  • existing management-based MDT techniques are activated on a per-cell granularity, which provides only RAN control based on UEs that are currently present in a cell of interest.
  • existing MDT techniques lack capabilities for RAN- based selection of UEs, which is needed to obtain the desired training and/or inference data needed for proper operation of AI/ML models used for RAN intelligence and/or operations.
  • the Model Training function is located at the 0AM and the Model Inference function is located at the RAN.
  • the 0AM needs data such as UE performance feedback to train/retrain the AI/ML model and/or to monitor AI/ML model performance, which may then trigger re-training and/or modification of the AI/ML model by the 0AM.
  • the Model Inference function is located at the RAN, the 0AM cannot know which UEs are involved in or affected by AI/ML-based optimization/control (including conventional optimization/control enhanced by AI/ML predictions). 0AM is thus at risk of selecting incorrect UE(s) as data source(s), limiting its abilities to improve the AI/ML model or even monitor the AI/ML model performance.
  • a RAN node can select relevant UEs for performing the requested measurements and reporting the requested information based on up-to-date RAN information and/or conditions, potentially combined with further relevant information received from CN (e.g., 5GC), management system, or other RAN nodes.
  • CN e.g., 5GC
  • the RAN node can base this selection on additional information such as current UE location, measured UE traffic, predicted UE traffic, etc.
  • a RAN node can configure and/or activate MDT functionality in selected UE(s) independently, e.g., without receiving (or receiving only partial) MDT activation and/or configuration from CN or management system.
  • the RAN node can perform one or more of the following operations in various embodiments:
  • the OAM may host the Model Inference function and the OAM collects input data via MDT from the RAN and from UEs served by the RAN.
  • Various embodiments may also facilitate OAM collection of feedback data to evaluate performance of an AI/ML model and make decisions about updating, replacing, removing, etc. the AI/ML model.
  • the OAM may host the Model Inference function or the OAM is in responsible for monitoring performance of an AI/ML model and instructing other parts of the system on actions that depend on the impact of the AI/ML model on the overall system performance.
  • RAN-based MDT enables the RAN node to collect data for training/retraining an AI/ML model without receiving an MDT activation message from a management system. This makes it possible for the RAN node to reuse MDT to collect data (e.g., UE performance feedback) that is or will be available via MDT.
  • Embodiments can provide various benefits, advantages, and/or solutions to problems described herein. For example, embodiments facilitate the use of conventional MDT/Trace framework for the collection of training data, input data, and feedback information for AI/ML models by enhancing and/or addressing problems with the existing framework. At the same time, embodiments can leverage the MDT framework - which was designed to convey data from RAN to OAM in an efficient way - for new purposes and/or applications related to AI/ML. Embodiments also facilitate a granular selection of AI/ML related data for collection by OAM and/or RAN, such as required input data from correct UE(s) for AI/ML model inference at the RAN, and new training data (including feedback data) for AI/ML model training at the RAN. At a high level, embodiments facilitate intelligent RAN implementations based on AI/ML.
  • embodiments disclosed herein are applicable to any type of AI/ML algorithm, model, and/or technique used in a RAN.
  • Non-limiting examples include supervised learning, deep learning, reinforcement learning, contextual multi-armed bandit algorithms, autoregression algorithms, etc. or combinations thereof .
  • Such algorithms may exploit functional approximation models, also referred to as AI/ML models, including feedforward neural networks, deep neural networks, recurrent neural networks, convolutional neural networks, etc.
  • reinforcement learning algorithms include deep reinforcement learning algorithms such as deep Q-network (DQN), proximal policy optimization (PPO), double Q -learning, policy gradient algorithms, off-policy learning algorithms, actor-critic algorithms, and advantage actor-critic algorithms (e.g., A2C, A3C, actorcritic with experience replay, etc.).
  • DQN deep Q-network
  • PPO proximal policy optimization
  • double Q -learning policy gradient algorithms
  • off-policy learning algorithms e.g., off-policy learning algorithms
  • actor-critic algorithms e.g., A2C, A3C, actorcritic with experience replay, etc.
  • advantage actor-critic algorithms e.g., A2C, A3C, actorcritic with experience replay, etc.
  • UE selection can be performed by a RAN node (e.g., a gNB) based on AI/ML-related indicators received from a management system node, a CN node, another RAN node, or a UE.
  • a RAN node e.g., a gNB
  • the RAN can also use these AI/ML-related indicators to identify which RAN-related measurements are relevant for AI/ML purposes.
  • the AI/ML-related indicators can be included in a message that activates the MDT configuration at the RAN (e.g., trace activation message over the NG interface).
  • the receiving RAN node extracts the AI/ML-related indicators from the received message, stores them, and uses them to determine which data are to be collected from UEs and/or from the RAN and how to execute the data collection process.
  • the AI/ML-related indicators may include one or more of the following:
  • AI/ML Model ID or another identification that allows the RAN to deduce the data needed by the OAM for AI/ML purposes
  • AI/ML use cases such as Network Energy Saving, Power Saving, Load Balancing Optimization, Mobility Optimization, Link Adaptation, QoS Optimization, QoE Optimization, Coverage and Capacity Optimization, MIMO Layer Optimization, CSI Prediction, Beam management, Positioning, Channel Coding, Reference Signal Enhancements, Interference Optimization;
  • data collection areas e.g., cells, PLMNs, tracking areas, RAN nodes, geographical areas, geolocations, public network identifiers, non-public networks identifiers, etc.;
  • the list of data to be collected for AI/ML processes can include one or more of the following needed from the RAN node serving the UEs involved in the measurements:
  • the list of data to be collected for AI/ML processes can include one or more of the following needed from the UEs involved in the measurements:
  • UE location information e.g., coordinates, serving cell ID, moving velocity
  • UE measurement report e.g., RSRP, RSRQ, SI NR, etc.
  • the list of data to be collected for AI/ML processes can include one or more of the following needed from neighbor RAN nodes:
  • the information related to the data to be collected can include one or more of the following:
  • number of data samples e.g., fixed amount, continuously until a stop signal, etc.
  • a fixed number of samples can be specified by a number of UEs, a number of events (e.g., RLF, successful HO), a number of actions (e.g., HO, cell deactivation), or any combination thereof.
  • time period where to collect the data e.g., next 30 minutes, during 8:00AM-9:00AM, on Mondays, continuously, etc.
  • type of data traffic e.g., web browsing, video call, video streaming.
  • o minimum time interval between samples o minimum distance between sample locations (e.g., due to the involved UEs, location of events, etc.), which can be specified geographically or based on transmission channel characteristics (e.g., SI NR) o differences in hardware/software characteristics of involved nodes (e.g., RAN nodes, UEs).
  • transmission channel characteristics e.g., SI NR
  • o differences in hardware/software characteristics of involved nodes e.g., RAN nodes, UEs.
  • all the samples should come from UEs with chipset vendor X, at least 50% of samples should come from non-5G-capable UEs, samples should only include 5G-capable UEs handed-over to RAN nodes of vendor Y, etc.
  • load/resource utilization at RAN node For example, only sample when there is 100% PRB utilization, samples should be nearly uniformly distributed over a range of 30%-70% of PRB utilization, etc.
  • Figure 9 shows an exemplary procedure for configuration and activation of RAN -based MDT with 5GC, according to various embodiments of the present disclosure .
  • the RAN can be NG-RAN, E-UTRAN (for LTE), UTRAN (for UMTS), etc.
  • E-UTRAN for LTE
  • UTRAN for UMTS
  • Operation 0 can be considered a pre-requisite or pre-condition.
  • a RAN node (940) receives AI/ML- related indicators that can be used for selecting a UE (950) or group of UEs for collection of data for AI/ML purposes, the RAN node stores the AI/ML-related indicators with the respective UE contexts for possible later usage. For example, the RAN node can receive such information for each UE in an Initial Context Setup Request message, a Handover Request message, or in any other relevant message from the CN (e.g., from AMF 920).
  • the UE selection process can also involve user consent indicators, UE capabilities, etc., from the CN as well as UE presence, UE traffic predictions, and other more dynamic RAN-based information (discussed in more detail below).
  • the UE selection process can also include an initial default group.
  • the management system (910) sends a trace session activation request (or similar message) to the RAN node.
  • this request can also include one or more of the following parameters:
  • Type of operation related to the AI/ML model e.g., training, re-training, modification, inference, performance evaluation, performance monitoring, input collection, feedback collection).
  • AI/ML Model ID for the AI/ML model for which the measurements should be collected.
  • AI/ML model differentiators can include model version, model vendor, and scope configuration parameters targeted by the AI/ML model.
  • Some example scope configuration parameters include:
  • AI/ML use case(s) e.g., Network Energy Saving, Mobility Optimization, Load Balancing, Link Adaptation, QoS Optimization, QoE Optimization, Coverage and Capacity Optimization, Ml MO Layer Optimization, CSI estimation, beam management, positioning accuracy enhancements, Channel Coding, Reference Signal Enhancements, Interference Optimization, etc.;
  • the criteria for which parameters are present can depend on one or more of the AI/ML model differentiators and other indication concerning the AI/ML model, such as the exact use case(s) to which the AI/ML model is applicable, the type of operation related to the AI/ML model, etc.
  • the RAN may collect AI/ML information only for the specified AI/ML model and/or only for AI/ML models related to the specified AI/ML use cases. Likewise, the RAN may select UEs that are affected by the specified AI/ML model and/or by AI/ML models related to the specified AI/ML use cases. Similarly, the RAN node may collect only the information requested in the message and may select UEs based on the requested information.
  • the TR parameter can also be used to communicate some of the above-listed information that can be included in the message of operation 1 , such as the AI/ML model, relevant AI/ML use case, etc. For example, a subset of available TR values can be used to identify AI/ML specific measurement collection processes.
  • the RAN may perform various actions (e.g., optimizations) based on outputs of an AI/ML model.
  • actions e.g., optimizations
  • information about these actions can be collected and provided to the AI/ML Model Training function.
  • the collected information can include feedback associated with the actions and/or feedback associated with outputs of the AI/ML model (i.e., th at triggered the actions).
  • Embodiments described herein can be utilized for collecting such information.
  • the message in operation 1 can include one or more output feedback identifiers, each of which uniquely identifies an output of an AI/ML model or an action taken by a RAN node based on an output of an AI/ML model.
  • Each output feedback identifier may include and/or identify one or more of the following:
  • AI/ML model(s) relevant to the output or action taken e.g., specified by AI/ML Model ID and optionally version;
  • time relevant to the output or action taken e.g., at which hour, day, month, and/or year, at which hour of the day, day of the week, etc.
  • area scope for the output or action taken e.g., in which cell, RAN node, tracking area, RAN-based notification area, PLMN, etc.;
  • the RAN node does not need to know which of the above information that an output feedback identifier includes.
  • the RAN node can/should consider the included output feedback identifiers (along with other information in the message) when selecting UEs for collecting data (e.g., UE feedback) for AI/ML purposes in operation 3.
  • the RAN node selects suitable UEs for MDT data collection for the specific AI/ML model and/or use case parameters. UE selection is based on the relevant information received from the management system, the area where UE is located, and information from the core network and/or other RAN nodes that are relevant for AI/ML model and/or use cases.
  • RAN node selects a UE, it considers requirements on mandatory parameters for the relevant set of AI/ML model differentiators (e.g., relevant AI/ML use case) as well as UE capability (e.g., MDT capability).
  • UEs that do not satisfy required attributes and/or conditions are not selected for MDT data collection.
  • the RAN node should select all UEs involved in and/or affected by AI/ML-based actions associated with or identified by the one or more output feedback identifiers received. If the identified action was performed by a second RAN node, the RAN node should receive the output feedback identifier from the second RAN node, e.g., as part of a handover preparation procedure or another procedure between the two RAN nodes.
  • a RAN node can activate the MDT functionality in selected UE(s) without receiving a fully specified trace session activation request from the management system (as stated above).
  • the RAN node receives an MDT activation indication having a minimum set of information and conditions for MDT configurations, enabling the RAN node to configure UEs for MDT data collection as needed, e.g., for AI/ML purposes.
  • the RAN node receives a partially specified trace session activation request from the management system, allowing the RAN node to decide on the remaining parts of MDT configuration for the selected UEs. For example, certain MDT configuration parameters (or lEs) in a trace session activation request can be marked as "configurable by RAN node” or in a similar way.
  • the management system sends the RAN node a trace session activation request that includes the TCE IP address but specifies only a minimum set of feedback information needed to evaluate and monitor the AI/ML model performance. This allows the RAN node to configure UE(s) to perform additional MDT measurements and/or report additional MDT data, if required for RAN-based AI/ML model inference and/or retraining.
  • the RAN node activates the MDT functionality to the selected UE or identified group of UEs.
  • the RAN node assigns a TRSR corresponding to the selected UE, with the same TRSR being assigned to all UEs of a UE group for the relevant MDT data collection.
  • the MDT activation sent in operation 4 can include any of the same information described above in relation to Figure 7 operation 4 for logged and immediate MDT cases.
  • the RAN node cannot send the logged MDT configuration to UEs currently camping in the cell in RRCJDLE/RRCJNACTIVE. These UEs may be configured when they next initiate some activity (e.g., Service Request or Tracking Area Update) that causes them to transition to RRC_CONNECTED.
  • some activity e.g., Service Request or Tracking Area Update
  • the TRSR sent in operation 4 can include or relate to an output feedback identifier, such as discussed above. If the action was performed (or output produced) by a RAN node other than the RAN node configuring UEs for MDT measurements, the configuring RAN node receives such an identifier from the performing RAN node, e.g., as part of handover signaling when the output/action leads to a handover of the one or more UEs.
  • the output feedback identifier defines a group of UEs that are assigned the same TRSR.
  • the UE when the UE receives the MDT activation it starts the MDT functionality based on the received configuration parameters and can start MDT reporting using methods relevant to the use case. This can be done in a similar way as Figure 7 operation 5, described above.
  • the RAN node shall not retrieve MDT report from the UE if UE's registered PLMN (rPLMN) does not match the PLMN where TCE (960) used to collect MDT data resides (e.g., RAN node's primary PLMN).
  • the RAN node When the RAN node receives the MDT report from UE, the RAN node obtains TRSR, TR, and TCE Id from the report and compare the Trace PLMN (i.e., PLMN portion of TR) with the PLMN where TCE used to collect MDT data resides (e.g., its primary PLMN). The RAN node discards the MDT report in case of a mismatch.
  • the Trace PLMN i.e., PLMN portion of TR
  • TCE used to collect MDT data resides e.g., its primary PLMN
  • the RAN node may receive MDT reporting from other RAN nodes (930) via Xn interface (or other interface used between nodes in a different RAN).
  • the RAN node can use the information therein to update its records about UE indexed information such as actual UE location, actual UE traffic, predicted UE location, predicted UE traffic, etc.
  • the RAN node performs AI/ML model training (using Model Training function). If training criteria are not satisfied, the RAN node repeats operations 3-6 until the training criteria are satisfied, after which the RAN node and other network entities shown perform operations 7-11 described above in relation to Figure 7.
  • the TCE can be a RAN node, such that MDT reports can also be forwarded to a neighbor RAN node. This is useful for the case where AI/ML based actions lead to mobility /handover of UEs between RAN nodes and the source RAN node (taking the action) needs certain UE information (e.g., feedback) from the target RAN node.
  • UE information e.g., feedback
  • a RAN node e.g., gNB
  • the RAN node determines to activate the MDT functionality independently from a Management System node or a CN node.
  • a RAN node hosting a Model Inference and/or a Model Training function for the specific AI/ML model may make such a determination to activate the MDT functionality.
  • the RAN node may send a first message to inform a second node (e.g., a Management System node or a CN node) about the independent activation of the MDT data collection functionality for the specific AI/ML model.
  • the RAN node may also send the second node a configuration (or related information) used for the independently activated MDT data collection functionality. Examples of information provided to the second node can include one or more of the following:
  • the RAN node may request permission from the second node to activate MDT functionality in association with data collection in one or more selected UEs for a specific AI/ML model, prior to activation. Once permission is given, however, the RAN node performs activation without a trace session activation request from the management system or CN.
  • the RAN node receives a second message from the second node (e.g., a Management System node or a CN node) including one or more of the following:
  • the second node e.g., a Management System node or a CN node
  • assistance information for the requested activation of the MDT functionality such as additional configuration information described above in relation to various embodiments;
  • the RAN node may transmit a third message to the second node to report data collected by one or more selected UEs for a specific AI/ML model, after activation of the MDT functionality.
  • a network node that is not part of the RAN sends to one or more RAN nodes an MDT configuration for the purpose of collecting data relevant for AI/ML used in the RAN.
  • an OAM node sends to RAN nodes an MDT configuration comprising one or more or a combination of the following:
  • AI/ML models • information associated with one or more relevant AI/ML models (e.g., model ID, model vendor, model type, model version, etc.)
  • the MDT configuration in question can be signaling-based, management-based, or any kind of MDT configuration.
  • a RAN node reporting data collected according to any of the techniques described above can send MDT reports that include one or more of the following:
  • radio- or application-layer “measurements” may include not only measured values but also predicted values (i.e., predictions).
  • Figure 10 shows an exemplary method ⁇ e.g., procedures) performed by a RAN node for collecting data to be used with AI/ML models, according to various embodiments of the present disclosure.
  • Figure 10 shows specific blocks in a particular order, the operations of the exemplary method can be performed in a different order than shown and can be combined and/or divided into blocks having different functionality than shown. Optional blocks or operations are indicated by dashed lines.
  • the exemplary method can be performed by a RAN node ⁇ e.g., base station, eNB, gNB, ng-eNB, etc. or unit/function thereof) such as described elsewhere herein.
  • the exemplary method can include the operations of one or more (e.g., some or all) of blocks 1030-1060.
  • the RAN node can receive, from a network node or function (NNF) outside of the RAN, a first request to activate a trace session for measurements by one or more UEs in the RAN.
  • the first request includes information indicating that the measurements are associated with one or more AI/ML models.
  • the RAN node can select one or more UEs served by the RAN node to perform the requested measurements.
  • the RAN node can send to the selected UEs respective second requests to perform the measurements for the trace session.
  • the RAN node can receive, from the selected UEs, respective measurement reports comprising results of the measurements performed in accordance with the respective second requests.
  • the exemplary method can also include the operations of block 1080, where the RAN node can perform at least one operation on the one or more AI/ML models based on the results of the measurements.
  • the RAN node can perform at least one operation on the one or more AI/ML models based on the results of the measurements.
  • one of the following operations is performed for each of the AI/ML model based on the results of the measurements: model training, model re-training, continued model training based on a partially trained model received from the NNF, model modification, model inference, model performance evaluation, model performance monitoring, input collection, and feedback collection.
  • the measurements include radio-layer measurements and/or application-layer measurements.
  • the exemplary method can also include the operations of blocks 1010-1015.
  • the RAN node can receive, from a core network node, a plurality of service requests associated with a corresponding plurality of UEs. Each service request includes one or more AI/ML-related indicators relevant for selection of the corresponding UE to perform measurements associated with AI/ML models.
  • the RAN node can store the one or more AI/ML-related indicators for the respective UEs. In some of these embodiments, the one or more AI/ML-related indicators are stored in or with respective UE contexts.
  • the measurements are MDT measurements
  • the NNF outside of the RAN is a network management system (e.g., OAM)
  • the core network node is an AMF
  • each service request is an initial context setup request or a handover request.
  • the MDT measurements are logged MDT measurements, and the first request and each second request include or indicate the same one or more of the following information:
  • the MDT measurements are immediate MDT measurements
  • the first request and each second request include or indicate the same one or more of the following information: a list of measurements, a reporting trigger, a reporting interval, a reporting amount, and an event threshold.
  • the information received with the first request includes one or more of the following:
  • each output feedback identifier identifies one or more of the following:
  • the other information that differentiates the respective AI/ML models includes one or more of the following: model version, model vendor, and one or more scope configuration parameters.
  • the one or more scope configuration parameters include one or more of the following:
  • the configuration for data collection and reporting includes one or more of the following:
  • the data requested from UEs includes one or more of the following:
  • the data requested from RAN nodes includes one or more of the following:
  • the AI/ML use cases include one or more of the following: network energy savings, mobility optimization, load balancing, link adaptation, quality-of-service (QoS) optimization, quality-of-experience (QoE) optimization, coverage and capacity optimization (CCO), multi-input multi-output (MIMO) layer optimization, channel state information (CSI) estimation, beam management, positioning accuracy enhancement, channel coding, reference signal enhancements, and interference optimization.
  • QoS quality-of-service
  • QoE quality-of-experience
  • CCO coverage and capacity optimization
  • MIMO multi-input multi-output
  • CSI channel state information
  • each UE served by the RAN node is associated with one or more AI/ML- related indicators relevant for selection of the UE to perform measurements associated with AI/ML models.
  • selecting one or more UEs based on the information received with the first request in block 1040 includes the operations of sub-block 1041, where the RAN node select, from a plurality of UEs served by the RAN node, UEs with associated AI/ML-related indicators that match or correspond to one or more of the following: at least one of the identifiers of the AI/ML models, at least one scope configuration parameter that differentiates the respective AI/ML models, and at least one output feedback identifier.
  • the indicated operation to be performed is one of the following: training, re-training, modification, inference, performance evaluation, performance monitoring, input collection, and feedback collection.
  • selecting the one or more UEs in block 1040 is further based on one or more of the following: UE MDT capability, UE location, user consent indicators, and predicted UE traffic.
  • the exemplary method can also include the operations of block 1090, where the RAN node can send to a TCE a trace record comprising the results of the measurements performed by the one or more UEs.
  • the trace record also includes an indication that the results of the measurements were collected for one or more of the following: use of AI/ML in the RAN, one or more specific AI/ML use cases, one or more specific AI/ML models, and one or more specific AI/ML model types.
  • the trace record is also sent to one or more of the following: a network management system (e.g., OAM), a core network node (e.g., AMF), and one or more other RAN nodes (e.g., neighbor RAN nodes).
  • a network management system e.g., OAM
  • a core network node e.g., AMF
  • RAN nodes e.g., neighbor RAN nodes
  • the exemplary method can also include the following operations, labelled with corresponding block numbers in parentheses:
  • the trace record sent to the TCE in block 1090 also includes the results of the measurements performed by the one or more RAN nodes.
  • the exemplary method can also include the operations of block 1020, where the RAN node can send, to the NNF outside of the RAN, a further request to activate the trace session for measurements associated with one or more AI/ML models.
  • the first request is received (e.g., in block 1030) as a permission or a positive acknowledgement in response to the further request.
  • the further request includes a list of one or more UE identifiers for which user consent is required for the activation of the trace session, and the first request includes an indication of user consent to activate the trace session for the one or more UE identifiers.
  • FIG 11 shows an example of a communication system 1100 in accordance with some embodiments.
  • communication system 1100 includes a telecommunication network 1102 that includes an access network 1104 (e.g., RAN) and a core network 1106, which includes one or more core network nodes 1108.
  • telecommunication network 1102 can also include one or more Network Management (NM) nodes 1018, which can be part of an operation support system (OSS), a business support system (BSS), or an operations/administration/maintenance (OAM) system.
  • NM nodes 1018 can monitor operations of other nodes in access network 1004 and core network 1006.
  • OSS operation support system
  • BSS business support system
  • OAM operations/administration/maintenance
  • Access network 1104 includes one or more access network nodes, such as network nodes 1110a-b (one or more of which may be generally referred to as network nodes 1110), or any other similar 3GPP access node or non- 3GPP access point.
  • Network nodes 1110 facilitate direct or indirect connection of UEs, such as by connecting UEs 1112a-d (one or more of which may be generally referred to as UEs 1112) to core network 1106 over one or more wireless connections.
  • Example wireless communications over a wireless connection include transmitting and/or receiving wireless signals using electromagnetic waves, radio waves, infrared waves, and/or other types of signals suitable for conveying information without the use of wires, cables, or other material conductors.
  • communication system 1100 may include any number of wired or wireless networks, network nodes, UEs, and/or any other components or systems that may facilitate or participate in the communication of data and/or signals whether via wired or wireless connections.
  • Communication system 1100 may include and/or interface with any type of communication, telecommunication, data, cellular, radio network, and/or other similar type of system.
  • UEs 1112 may be any of a wide variety of communication devices, including wireless devices arranged, configured, and/or operable to communicate wirelessly with network nodes 1110 and other communication devices.
  • network nodes 1110 are arranged, capable, configured, and/or operable to communicate directly or indirectly with UEs 1112 and/or with other network nodes or equipment in telecommunication network 1102 to enable and/or provide network access, such as wireless network access, and/or to perform other functions, such as administration in telecommunication network 1102.
  • core network 1106 connects network nodes 1110 to one or more hosts, such as host 1116. These connections may be direct or indirect via one or more intermediary networks or devices. In other examples, network nodes may be directly coupled to hosts.
  • Core network 1106 includes one or more core network nodes (e.g., 1108) that are structured with hardware and software components. Features of these components may be substantially similar to those described with respect to the UEs, network nodes, and/or hosts, such that the descriptions thereof are generally applicable to the corresponding components of the core network node 1108.
  • Example core network nodes include functions of one or more of a Mobile Switching Center (MSC), Mobility Management Entity (MME), Home Subscriber Server (HSS), Access and Mobility Management Function (AMF), Session Management Function (SMF), Authentication Server Function (AUSF), Subscription Identifier De-concealing function (SIDF), Unified Data Management (UDM), Security Edge Protection Proxy (SEPP), Network Exposure Function (NEF), and/or a User Plane Function (UPF).
  • MSC Mobile Switching Center
  • MME Mobility Management Entity
  • HSS Home Subscriber Server
  • AMF Access and Mobility Management Function
  • SMF Session Management Function
  • AUSF Authentication Server Function
  • SIDF Subscription Identifier De-concealing function
  • UDM Unified Data Management
  • SEPP Security Edge Protection Proxy
  • NEF Network Exposure Function
  • UPF User Plane Function
  • Host 1116 may be under the ownership or control of a service provider other than an operator or provider of access network 1104 and/or telecommunication network 1102, and may be operated by the service provider or on behalf of the service provider.
  • Host 1116 may host a variety of applications to provide one or more service. Examples of such applications include live and pre-recorded audio/video content, data collection services such as retrieving and compiling data on various ambient conditions detected by a plurality of UEs, analytics functionality, social media, functions for controlling or otherwise interacting with remote devices, functions for an alarm and surveillance center, or any other such function performed by a server.
  • communication system 1100 of Figure 11 enables connectivity between the UEs, network nodes, and hosts.
  • the communication system may be configured to operate according to predefined rules or procedures, such as specific standards that include, but are not limited to: Global System for Mobile Communications (GSM); Universal Mobile Telecommunications System (UMTS); Long Term Evolution (LTE); New Radio (NR); and/or other suitable 2G, 3G, 4G, 5G standards, or any applicable future generation standard (e.g., 6G); wireless local area network (WLAN) standards, such as the Institute of Electrical and Electronics Engineers (IEEE) 802.11 standards (WiFi); and/or any other appropriate wireless communication standard, such as the Worldwide Interoperability for Microwave Access (WiMax), Bluetooth, Z-Wave, Near Field Communication (NFC) Zig Bee, LiFi, and/or any low-power wide-area network (LPWAN) standards such as LoRa and Sigfox.
  • GSM Global System for Mobile Communications
  • UMTS Universal Mobile Telecommunications System
  • LTE Long
  • telecommunication network 1102 is a cellular network that implements 3GPP standardized features. Accordingly, telecommunication network 1102 may support network slicing to provide different logical networks to different devices that are connected to telecommunication network 1102. For example, telecommunication network 1102 may provide Ultra Reliable Low Latency Communication (URLLC) services to some UEs, while providing Enhanced Mobile Broadband (eMBB) services to other UEs, and/or Massive Machine Type Communication (mMTC)ZMassive loT services to yet further UEs.
  • URLLC Ultra Reliable Low Latency Communication
  • eMBB Enhanced Mobile Broadband
  • mMTC Massive Machine Type Communication
  • UEs 1112 are configured to transmit and/or receive information without direct human interaction.
  • a UE may be designed to transmit information to access network 1104 on a predetermined schedule, when triggered by an internal or external event, or in response to requests from access network 1104.
  • a UE may be configured for operating in single- or multi-RAT or multi-standard mode.
  • a UE may operate with any one or combination of Wi-Fi, NR (New Radio) and LTE, i.e., being configured for multi-radio dual connectivity (MR-DC), such as E-UTRAN (Evolved-UMTS Terrestrial Radio Access Network) New Radio - Dual Connectivity (EN-DC).
  • MR-DC multi-radio dual connectivity
  • hub 1114 communicates with access network 1104 to facilitate indirect communication between one or more UEs (e.g., 1112c and/or 1112d) and network nodes (e.g., 1110b).
  • hub 1114 may be a controller, router, content source and analytics, or any of the other communication devices described herein regarding UEs.
  • hub 1114 may be a broadband router enabling access to core network 1106 for the UEs.
  • hub 1114 may be a controller that sends commands or instructions to one or more actuators in the UEs. Commands or instructions may be received from the UEs, network nodes 1110, or by executable code, script, process, or other instructions in hub 1114.
  • hub 1114 may be a data collector that acts as temporary storage for UE data and, in some embodiments, may perform analysis or other processing of the data.
  • hub 1114 may be a content source. For example, for a UE that is a VR headset, display, loudspeaker or other media delivery device, hub 1114 may retrieve VR assets, video, audio, or other media or data related to sensory information via a network node, which hub 1114 then provides to the UE either directly, after performing local processing, and/or after adding additional local content.
  • hub 1114 acts as a proxy server or orchestrator for the UEs, in particular if one or more of the UEs are low energy loT devices.
  • Hub 1114 may have a constant/persistent or intermittent connection to the network node 1110b. Hub 1114 may also allow for a different communication scheme and/or schedule between hub 1114 and UEs (e.g., 1112c and/or 1112d), and between hub 1114 and core network 1106. In other examples, hub 1114 is connected to core network 1106 and/or one or more UEs via a wired connection. Moreover, hub 1114 may be configured to connect to an M2M service provider over access network 1104 and/or to another UE over a direct connection. In some scenarios, UEs may establish a wireless connection with network nodes 1110 while still connected via hub 1114 via a wired or wireless connection.
  • UEs may establish a wireless connection with network nodes 1110 while still connected via hub 1114 via a wired or wireless connection.
  • hub 1114 may be a dedicated hub - that is, a hub whose primary function is to route communications to/from the UEs from/to the network node 1110b.
  • hub 1114 may be a non-dedicated hub - that is, a device which can route communications between the UEs and network node 1110b, but which is additionally capable of operating as a communication start and/or end point for certain data channels.
  • Figure 12 shows a network node 1200 in accordance with some embodiments.
  • network nodes include, but are not limited to, access points (e.g., radio access points) and base stations (e.g., radio base stations, Node Bs, eNBs, gNBs).
  • access points e.g., radio access points
  • base stations e.g., radio base stations, Node Bs, eNBs, gNBs.
  • Base stations may be categorized based on the amount of coverage they provide (or, stated differently, their transmit power level) and so, depending on the provided amount of coverage, may be referred to as femto base stations, pico base stations, micro base stations, or macro base stations.
  • a base station may be a relay node or a relay donor node controlling a relay.
  • a network node may also include one or more (or all) parts of a distributed radio base station such as centralized digital units and/or remote radio units (RRUs), sometimes referred to as Remote Radio Heads (RRHs). Such remote radio units may or may not be integrated with an antenna as an antenna integrated radio.
  • RRUs remote radio units
  • RRHs Remote Radio Heads
  • Such remote radio units may or may not be integrated with an antenna as an antenna integrated radio.
  • Parts of a distributed radio base station may also be referred to as nodes in a distributed antenna system (DAS).
  • DAS distributed antenna system
  • network nodes include multiple transmission point (multi-TRP) 5G access nodes, multistandard radio (MSR) equipment such as MSR BSs, network controllers such as radio network controllers (RNCs) or base station controllers (BSCs), base transceiver stations (BTSs), transmission points, transmission nodes, multi- cell/multicast coordination entities (MCEs), Operation and Maintenance (O&M) nodes, Operations Support System (OSS) nodes, Self-Organizing Network (SON) nodes, positioning nodes (e.g., Evolved Serving Mobile Location Centers (E-SMLCs)), and/or Minimization of Drive Tests (MDTs).
  • MSR multistandard radio
  • RNCs radio network controllers
  • BSCs base station controllers
  • BTSs base transceiver stations
  • OFDM Operation and Maintenance
  • OSS Operations Support System
  • SON Self-Organizing Network
  • positioning nodes e.g., Evolved Serving Mobile Location Centers (E-SMLCs)
  • Network node 1200 includes processing circuitry 1202, memory 1204, communication interface 1206, and power source 1208.
  • Network node 1200 may be composed of multiple physically separate components (e.g., a NodeB component and a RNC component, or a BTS component and a BSC component, etc.), which may each have their own respective components.
  • network node 1200 comprises multiple separate components (e.g., BTS and BSC components)
  • one or more of the separate components may be shared among several network nodes.
  • a single RNC may control multiple NodeBs.
  • each unique NodeB and RNC pair may in some instances be considered a single separate network node.
  • network node 1200 may be configured to support multiple radio access technologies (RATs).
  • RATs radio access technologies
  • Network node 1200 may also include multiple sets of the various illustrated components for different wireless technologies integrated into network node 1200, for example GSM, WCDMA, LTE, NR, WiFi, Zigbee, Z-wave, LoRaWAN, Radio Frequency Identification (RFID) or Bluetooth wireless technologies. These wireless technologies may be integrated into the same or different chip or set of chips and other components within network node 1200.
  • wireless technologies for example GSM, WCDMA, LTE, NR, WiFi, Zigbee, Z-wave, LoRaWAN, Radio Frequency Identification (RFID) or Bluetooth wireless technologies. These wireless technologies may be integrated into the same or different chip or set of chips and other components within network node 1200.
  • RFID Radio Frequency Identification
  • Processing circuitry 1202 may comprise a combination of one or more of a microprocessor, controller, microcontroller, central processing unit, digital signal processor, application-specific integrated circuit, field programmable gate array, or any other suitable computing device, resource, or combination of hardware, software and/or encoded logic operable to provide, either alone or in conjunction with other network node 1200 components, such as memory 1204, to provide network node 1200 functionality.
  • processing circuitry 1202 includes a system on a chip (SOC).
  • processing circuitry 1202 includes radio frequency (RF) transceiver circuitry 1212 and/or baseband processing circuitry 1214.
  • RF transceiver circuitry 1212 and/or baseband processing circuitry 1214 may be on separate chips (or sets of chips), boards, or units, such as radio units and digital units.
  • part or all of RF transceiver circuitry 1212 and/or baseband processing circuitry 1214 may be on the same chip or set of chips, boards, or units.
  • Memory 1204 may comprise any form of volatile or non-volatile computer-readable memory including, without limitation, persistent storage, solid-state memory, remotely mounted memory, magnetic media, optical media, random access memory (RAM), read-only memory (ROM), mass storage media (for example, a hard disk), removable storage media (for example, a flash drive, a Compact Disk (CD) or a Digital Video Disk (DVD)), and/or any other volatile or non-volatile, non-transitory device-readable and/or computer-executable memory devices that store information, data, and/or instructions that may be used by processing circuitry 1202.
  • volatile or non-volatile computer-readable memory including, without limitation, persistent storage, solid-state memory, remotely mounted memory, magnetic media, optical media, random access memory (RAM), read-only memory (ROM), mass storage media (for example, a hard disk), removable storage media (for example, a flash drive, a Compact Disk (CD) or a Digital Video Disk (DVD)), and/or any other volatile or non-vola
  • Memory 1204 may store any suitable instructions, data, or information, including a computer program, software, an application including one or more of logic, rules, code, tables, and/or other instructions (collectively denoted computer program product 1204a) capable of being executed by processing circuitry 1202 and utilized by network node 1200. Memory 1204 may be used to store any calculations made by processing circuitry 1202 and/or any data received via communication interface 1206. In some embodiments, processing circuitry 1202 and memory 1204 is integrated.
  • Communication interface 1206 is used in wired or wireless communication of signaling and/or data between a network node, access network, and/or UE. As illustrated, communication interface 1206 comprises port(s)/terminal(s) 1216 to send and receive data, for example to and from a network over a wired connection. Communication interface 1206 also includes radio front-end circuitry 1218 that may be coupled to, or in certain embodiments a part of, antenna 1210. Radio front-end circuitry 1218 comprises filters 1220 and amplifiers 1222. Radio front-end circuitry 1218 may be connected to an antenna 1210 and processing circuitry 1202. The radio front-end circuitry may be configured to condition signals communicated between antenna 1210 and processing circuitry 1202.
  • radio front-end circuitry 1218 may receive digital data that is to be sent out to other network nodes or UEs via a wireless connection, radio front-end circuitry 1218 may convert the digital data into a radio signal having the appropriate channel and bandwidth parameters using a combination of filters 1220 and/or amplifiers 1222. The radio signal may then be transmitted via antenna 1210. Similarly, when receiving data, antenna 1210 may collect radio signals which are then converted into digital data by radio front-end circuitry 1218. The digital data may be passed to processing circuitry 1202.
  • the communication interface may comprise different components and/or different combinations of components.
  • network node 1200 does not include separate radio front-end circuitry 1218, instead, processing circuitry 1202 includes radio front-end circuitry and is connected to antenna 1210. Similarly, in some embodiments, all or some of RF transceiver circuitry 1212 is part of communication interface 1206. In still other embodiments, communication interface 1206 includes one or more ports or terminals 1216, radio front-end circuitry 1218, and RF transceiver circuitry 1212, as part of a radio unit (not shown), and communication interface 1206 communicates with baseband processing circuitry 1214, which is part of a digital unit (not shown).
  • Antenna 1210 may include one or more antennas, or antenna arrays, configured to send and/or receive wireless signals. Antenna 1210 may be coupled to radio front-end circuitry 1218 and may be any type of antenna capable of transmitting and receiving data and/or signals wirelessly. In certain embodiments, antenna 1210 is separate from network node 1200 and connectable to network node 1200 through an interface or port.
  • Antenna 1210, communication interface 1206, and/or processing circuitry 1202 may be configured to perform any receiving operations and/or certain obtaining operations described herein as being performed by the network node. Any information, data and/or signals may be received from a UE, another network node and/or any other network equipment. Similarly, antenna 1210, communication interface 1206, and/or processing circuitry 1202 may be configured to perform any transmitting operations described herein as being performed by the network node. Any information, data and/or signals may be transmitted to a UE, another network node and/or any other network equipment.
  • Power source 1208 provides power to the various components of network node 1200 in a form suitable for the respective components (e.g., at a voltage and current level needed for each respective component). Power source 1208 may further comprise, or be coupled to, power management circuitry to supply the components of network node 1200 with power for performing the functionality described herein.
  • network node 1200 may be connectable to an external power source (e.g., the power grid, an electricity outlet) via an input circuitry or interface such as an electrical cable, whereby the external power source supplies power to power circuitry of power source 1208.
  • power source 1208 may comprise a source of power in the form of a battery or battery pack which is connected to, or integrated in, power circuitry. The battery may provide backup power should the external power source fail.
  • Embodiments of network node 1200 may include additional components beyond those shown in Figure 12 for providing certain aspects of the network node's functionality, including any of the functionality described herein and/or any functionality necessary to support the subject matter described herein.
  • network node 1200 may include user interface equipment to allow input of information into network node 1200 and to allow output of information from network node 1200. This may allow a user to perform diagnostic, maintenance, repair, and other administrative functions for network node 1200.
  • FIG. 13 is a block diagram illustrating a virtualization environment 1300 in which functions implemented by some embodiments may be virtualized.
  • virtualizing means creating virtual versions of apparatuses or devices which may include virtualizing hardware platforms, storage devices and networking resources.
  • virtualization can be applied to any device described herein, or components thereof, and relates to an implementation in which at least a portion of the functionality is implemented as one or more virtual components.
  • Some or all of the functions described herein may be implemented as virtual components executed by one or more virtual machines (VMs) implemented in one or more virtual environments 1300 hosted by one or more of hardware nodes, such as a hardware computing device that operates as a network node, UE, core network node, or host.
  • VMs virtual machines
  • the virtual node does not require radio connectivity (e.g., a core network node or host)
  • the node may be entirely virtualized.
  • Applications 1302 (which may alternatively be called software instances, virtual appliances, network functions, virtual nodes, virtual network functions, etc.) are run in virtualization environment 1300 to implement some of the features, functions, and/or benefits of some of the embodiments disclosed herein.
  • Hardware 1304 includes processing circuitry, memory that stores software and/or instructions (collectively denoted computer program product 1304a) executable by hardware processing circuitry, and/or other hardware devices as described herein, such as a network interface, input/output interface, and so forth.
  • Software may be executed by the processing circuitry to instantiate one or more virtualization layers 1306 (also referred to as hypervisors or virtual machine monitors (VMMs)), provide VMs 1308a and 1308b (one or more of which may be generally referred to as VMs 1308), and/or perform any of the functions, features and/or benefits described in relation with some embodiments described herein.
  • the virtualization layer 1306 may present a virtual operating platform that appears like networking hardware to VMs 1308.
  • VMs 1308 comprise virtual processing, virtual memory, virtual networking or interface and virtual storage, and may be run by a corresponding virtualization layer 1306.
  • VMs 1308 may be implemented on one or more of VMs 1308, and the implementations may be made in different ways.
  • Virtualization of the hardware is in some contexts referred to as network function virtualization (NFV). NFV may be used to consolidate many network equipment types onto industry standard high volume server hardware, physical switches, and physical storage, which can be located in data centers, and customer premise equipment.
  • NFV network function virtualization
  • each VM 1308 may be a software implementation of a physical machine that runs programs as if they were executing on a physical, non-virtualized machine.
  • Each VM 1308, and that part of hardware 1304 that executes that VM be it hardware dedicated to that VM and/or hardware shared by that VM with others of the VMs, forms separate virtual network elements.
  • a virtual network function is responsible for handling specific network functions that run in one or more VMs 1308 on top of hardware 1304 and corresponds to application 1302.
  • Hardware 1304 may be implemented in a standalone network node with generic or specific components. Hardware 1304 may implement some functions via virtualization. Alternatively, hardware 1304 may be part of a larger cluster of hardware (e.g., such as in a data center or CPE) where many hardware nodes work together and are managed via management and orchestration 1310, which, among others, oversees lifecycle management of applications 1302.
  • hardware 1304 is coupled to one or more radio units that each include one or more transmitters and one or more receivers that may be coupled to one or more antennas. Radio units may communicate directly with other hardware nodes via one or more appropriate network interfaces and may be used in combination with the virtual components to provide a virtual node with radio capabilities, such as a radio access node or a base station.
  • some signaling can be provided with the use of a control system 1312 which may alternatively be used for communication between hardware nodes and radio units.
  • Figure 14 shows a communication diagram of a host 1402 communicating via a network node 1404 with a UE 1406 over a partially wireless connection in accordance with some embodiments.
  • Example implementations, in accordance with various embodiments, of the UE (such as a UE 1112a of Figure 11), network node (such as network node 1110a of Figure 11), and host (such as host 1116 of Figure 11) discussed in the preceding paragraphs will now be described with reference to Figure 14.
  • Embodiments of host 1402 include hardware, such as a communication interface, processing circuitry, and memory.
  • Host 1402 also includes software, which is stored in or accessible by host 1402 and executable by the processing circuitry.
  • the software includes a host application that may be operable to provide a service to a remote user, such as UE 1406 connecting via an over-the-top (OTT) connection 1450 extending between UE 1406 and host 1402.
  • OTT over-the-top
  • Network node 1404 includes hardware enabling it to communicate with host 1402 and UE 1406.
  • Connection 1460 may be direct or pass through a core network (like core network 1106 of Figure 11) and/or one or more other intermediate networks, such as one or more public, private, or hosted networks.
  • an intermediate network may be a backbone network or the Internet.
  • UE 1406 includes hardware and software, which is stored in or accessible by UE 1406 and executable by the UE's processing circuitry.
  • the software includes a client application, such as a web browser or operator-specific "app” that may be operable to provide a service to a human or non-human user via UE 1406 with the support of host 1402.
  • client application such as a web browser or operator-specific "app” that may be operable to provide a service to a human or non-human user via UE 1406 with the support of host 1402.
  • an executing host application may communicate with the executing client application via OTT connection 1450 terminating at UE 1406 and host 1402.
  • the UE's client application may receive request data from the host's host application and provide user data in response to the request data.
  • OTT connection 1450 may transfer both the request data and the user data.
  • the UE's client application may interact with the user to generate the user data that it provides to the host application through OTT connection 1450.
  • OTT connection 1450 may extend via a connection 1460 between host 1402 and network node 1404 and via wireless connection 1470 between network node 1404 and UE 1406 to provide the connection between host 1402 and UE 1406.
  • Connection 1460 and wireless connection 1470, over which OTT connection 1450 may be provided, have been drawn abstractly to illustrate the communication between host 1402 and UE 1406 via network node 1404, without explicit reference to any intermediary devices and the precise routing of messages via these devices.
  • host 1402 provides user data, which may be performed by executing a host application.
  • the user data is associated with a particular human user interacting with UE 1406.
  • the user data is associated with a UE 1406 that shares data with host 1402 without explicit human interaction.
  • host 1402 initiates a transmission carrying the user data towards UE 1406.
  • Host 1402 may initiate the transmission responsive to a request transmitted by UE 1406. The request may be caused by human interaction with UE 1406 or by operation of the client application executing on UE 1406.
  • the transmission may pass via network node 1404, in accordance with the teachings of the embodiments described throughout this disclosure.
  • network node 1404 transmits to UE 1406 the user data that was carried in the transmission that host 1402 initiated, in accordance with the teachings of the embodiments described throughout this disclosure.
  • UE 1406 receives the user data carried in the transmission, which may be performed by a client application executed on UE 1406 associated with the host application executed by host 1402.
  • UE 1406 executes a client application which provides user data to host 1402.
  • the user data may be provided in reaction or response to the data received from host 1402.
  • UE 1406 may provide user data, which may be performed by executing the client application.
  • the client application may further consider user input received from the user via an input/output interface of UE 1406.
  • UE 1406 initiates, in step 1418, transmission of the user data towards host 1402 via network node 1404.
  • network node 1404 receives user data from UE 1406 and initiates transmission of the received user data towards host 1402.
  • host 1402 receives the user data carried in the transmission initiated by UE 1406.
  • One or more of the various embodiments improve the performance of OTT services provided to UE 1406 using OTT connection 1450, in which wireless connection 1470 forms the last segment. More precisely, embodiments can facilitate use of conventional MDT/Trace functionality for collection of training data, input data, and feedback information for AI/ML models. At a high level, embodiments facilitate intell igent RAN implementations based on AI/ML, thereby improving RAN performance. As such, OTT services delivered via RANs improved in this manner become more valuable to both end users and service providers.
  • factory status information may be collected and analyzed by host 1402.
  • host 1402 may process audio and video data which may have been retrieved from a UE for use in creating maps.
  • host 1402 may collect and analyze real-time data to assist in controlling vehicle congestion (e.g., controlling traffic lights).
  • host 1402 may store surveillance video uploaded by a UE.
  • host 1402 may store or control access to media content such as video, audio, VR or AR which it can broadcast, multicast or unicast to UEs.
  • host 1402 may be used for energy pricing, remote control of non-time critical electrical load to balance power generation needs, location services, presentation services (such as compiling diagrams etc. from data collected from remote devices), or any other function of collecting, retrieving, storing, analyzing and/or transmitting data.
  • a measurement procedure may be provided for the purpose of monitoring data rate, latency, and other factors on which the one or more embodiments improve.
  • the measurement procedure and/or the network functionality for reconfiguring the OTT connection may be implemented in software and hardware of host 1402 and/or UE 1406.
  • sensors (not shown) may be deployed in or in association with other devices through which OTT connection 1450 passes; the sensors may participate in the measurement procedure by supplying values of the monitored quantities exemplified above, or supplying values of other physical quantities from which software may compute or estimate the monitored quantities.
  • the reconfiguring of OTT connection 1450 may include message format, retransmission settings, preferred routing etc.; the reconfiguring need not directly alter the operation of network node 1404. Such procedures and functionalities may be known and practiced in the art.
  • measurements may involve proprietary UE signaling that facilitates measurements of throughput, propagation times, latency and the like, by host 1402.
  • the measurements may be implemented in that software causes messages to be transmitted, in particular empty or 'dummy' messages, using OTT connection 1450 while monitoring propagation times, errors, etc.
  • the term unit can have conventional meaning in the field of electronics, electrical devices and/or electronic devices and can include, for example, electrical and/or electronic circuitry, devices, modules, processors, memories, logic solid state and/or discrete devices, computer programs or instructions for carrying out respective tasks, procedures, computations, outputs, and/or displaying functions, and so on, as such as those that are described herein.
  • any appropriate steps, methods, features, functions, or benefits disclosed herein may be performed through one or more functional units or modules of one or more virtual apparatuses.
  • Each virtual apparatus may comprise a number of these functional units.
  • These functional units may be implemented via processing circuitry, which may include one or more microprocessor or microcontrollers, as well as other digital hardware, which may include Digital Signal Processor (DSPs), special-purpose digital logic, and the like.
  • the processing circuitry may be configured to execute program code stored in memory, which may include one or several types of memory such as Read Only Memory (ROM), Random Access Memory (RAM), cache memory, flash memory devices, optical storage devices, etc.
  • Program code stored in memory includes program instructions for executing one or more telecommunications and/or data communications protocols as well as instructions for carrying out one or more of the techniques described herein.
  • the processing circuitry may be used to cause the respective functional unit to perform corresponding functions according to one or more embodiments of the present disclosure.
  • device and/or apparatus can be represented by a semiconductor chip, a chipset, or a (hardware) module comprising such chip or chipset; this, however, does not exclude the possibility that a functionality of a device or apparatus, instead of being hardware implemented, be implemented as a software module such as a computer program or a computer program product comprising executable software code portions for execution or being run on a processor.
  • functionality of a device or apparatus can be implemented by any combination of hardware and software.
  • a device or apparatus can also be regarded as an assembly of multiple devices and/or apparatuses, whether functionally in cooperation with or independently of each other.
  • devices and apparatuses can be implemented in a distributed fashion throughout a system, so long as the functionality of the device or apparatus is preserved. Such and similar principles are considered as known to a skilled person.
  • Embodiments of the techniques and apparatus described herein also include, but are not limited to, the following enumerated examples:
  • a method performed by radio access network (RAN) node for collecting data to be used with artificial intel ligence/machine learning (AI/ML) models comprising one or more of the following: receiving (1030), from a network node or function (NNF) outside of the RAN, a first request to activate a trace session for measurements by one or more user equipment (UEs) in the RAN, wherein the first request includes information indicating that the measurements are associated with one or more AI/ML models; based on the information received with the first request, selecting (1040) one or more UEs served by the RAN node to perform the requested measurements; sending (1050), to the selected UEs, respective second requests to perform the measurements for the trace session; receiving (1060), from the selected UEs, respective measurement reports comprising results of the measurements performed in accordance with the respective second requests.
  • RAN radio access network
  • AI/ML artificial intel ligence/machine learning
  • A1 a The method of embodiment A1 , further comprising performing (1080) at least one operation on the one or more AI/ML models based on the results of the measurements.
  • A1 b The method of embodiment A1 a, wherein one of the following operations is performed for each of the AI/ML model based on the results of the measurements: model training, model re-training, continued model training based on a partially trained model received from the network node, model performance evaluation, model performance monitoring, model inference, model modification, input collection, and feedback collection.
  • A1c The method of any of embodiments A1-A1 b, wherein the measurements include one or more of the following: radio-layer measurements, and application-layer measurements.
  • A2 The method of any of embodiments A1-A1 c, further comprising : receiving (1010), from a core network node, a plurality of service requests associated with a corresponding plurality of UEs, wherein each service request includes one or more AI/ML-related indicators relevant for selection of the corresponding UE to perform measurements associated with AI/ML models; and storing (1015) a plurality of UE contexts that include the one or more AI/ML-related indicators for the respective UEs.
  • the measurements are minimization of drive testing (MDT) measurements
  • the NNF outside of the RAN is a network management system
  • the core network node is an access and mobility management function (AMF)
  • each service request is one of the following: an initial context setup request, or a handover request.
  • A2b The method of embodiment A2a, wherein the MDT measurements are logged MDT measurements, and the first request and each second request includes or indicates the same one or more of the following information: a trace reference; an area scope where UE measurements should be collected; a logging interval; a logging duration; an address or identifier of a trace collection entity (TCE); and a list of public land mobile networks (PLMNs) for which measurements are requested.
  • a trace reference an area scope where UE measurements should be collected
  • a logging interval a logging duration
  • an address or identifier of a trace collection entity TCE
  • PLMNs public land mobile networks
  • A2c The method of embodiment A2a, wherein the MDT measurements are immediate MDT measurements, and the first request and each second request includes or indicates the same one or more of the following information: a list of measurements, a reporting trigger, a reporting interval, a reporting amount, and an event threshold.
  • A3 The method of any of embodiments A2-A2c, wherein the one or more UEs are selected from the plurality of UEs based on the one or more AI/ML-related indicators included in the respective UE contexts.
  • the information received with the first request includes one or more of the following: an indication that the requested measurements are for one or more operations to be performed on the one or more AI/ML models; an indication of the one or more operations to be performed; respective identifiers of the AI/ML models; other information that differentiates the respective AI/ML models; an indication of whether the requested measurements are UE measurements, RAN node measurements, or both; one or more indications or commands for controlling the requested measurements; and one or more output feedback identifiers, each of which uniquely identifies an AI/ML-based output or action taken therefrom, for which feedback is requested.
  • A4a The method of embodiment A4, wherein the other information that differentiates the respective AI/ML models includes one or more of the following: model version, model vendor, and one or more scope configuration parameters.
  • A4b The method of embodiment A4a, wherein the one or more scope configuration parameters include one or more of the following: one or more AI/ML use cases;
  • AI/ML model type intended use of the requested measurements are information with respect to the AI/ML model; data requested from UEs; priorities or relative weights between data requested from UEs; data requested from RAN nodes; priorities or relative weights between data requested from RAN nodes; and configuration for data collection and/or reporting.
  • A4c The method of embodiment A4b, wherein the configuration for data collection and reporting includes one or more of the following: number of data samples to be collected; time period during which the data samples are to be collected; one or more types of user data sessions for which the data samples are to be collected; a minimum time interval between collected data samples; a minimum distance between locations associated with collected data sample locations; hardware and/or software characteristics of UEs and/or RAN nodes from which the data samples are to be collected; and characteristics of load and/or resource utilization of RAN nodes from which the data samples are to be collected.
  • A4d The method of any of embodiments A4b-A4c, wherein the requested UE data for the AI/ML model include one or more of the following:
  • UE cell or beam measurements current and/or predicted UE energy efficiency; and current and/or predicted UE energy consumption.
  • the requested RAN node data for the AI/ML model include one or more of the following: current and/or predicted values of one or more of the following for the RAN node and/or for one or more neighbor RAN nodes: resource status, energy efficiency, energy consumption; current and/or predicted values of one or more of the following for one or more cells provided by the RAN node and/or by one or more neighbor RAN nodes: resource status, energy efficiency, energy consumption; current and/or predicted values of one or more of the following for one or more beams provided by the RAN node and/or by one or more neighbor RAN nodes: resource status, energy efficiency, energy consumption; predicted path or trajectory for one or more UEs served by the RAN node; and current and/or predicted traffic for one or more UEs served by the RAN node.
  • A4f The method of any of embodiments A4b-A4e, wherein the one or more AI/ML use cases include one or more of the following: network energy savings, mobility optimization, load balancing, link adaptation, quality-of- service (QoS) optimization, quality-of-experience (QoE) optimization, coverage and capacity optimization (CCO), multi-input multi-output (Ml MO) layer optimization, channel state information (CSI) estimation, beam management, positioning accuracy enhancement, channel coding, reference signal enhancements, and interference optimization.
  • QoS quality-of- service
  • QoE quality-of-experience
  • CCO coverage and capacity optimization
  • Ml MO multi-input multi-output
  • CSI channel state information
  • each output feedback identifier also identifies one or more of the following associated with the output or action taken therefrom: one or more AI/ML models; one or more AI/ML use cases; a time; an area scope; one or more RAN nodes; and one or more network slices.
  • A4h The method of any of embodiments A4-A4g, wherein for each AI/ML model, the indicated operation to be performed is one of the following: training, re-training, modification, inference, performance evaluation, performance monitoring, input collection, and feedback collection.
  • A5 The method of any of embodiments A1-A4h, further comprising sending (1090) to a trace collection entity (TCE) a trace record comprising the results of the measurements performed by the one or more UEs.
  • TCE trace collection entity
  • the trace record also includes an indication that the results of the measurements were collected for one or more of the following: use of AI/ML in the RAN, one or more specific AI/ML use cases, one or more specific AI/ML models, and one or more specific AI/ML model types.
  • A6a The method of any of embodiments A5-A6, wherein the trace record is also sent to one or more of the following: a network management system, a core network node, and one or more other RAN nodes.
  • A7 The method of any of embodiments A6-A6a, further comprising: based on the information received with the first request, selecting (1065) one or more other RAN nodes to perform the requested measurements; sending (1070), to the selected RAN nodes, respective third requests to perform the measurements for the trace session; receiving (1075), from the selected RAN nodes, respective measurement reports comprising results of the measurements performed in accordance with the respective third requests, wherein the trace record sent to the TCE also includes the results of the measurements performed by the one or more RAN nodes.
  • A8 The method of any of embodiments A1-A7, further comprising sending (1020), to the NNF outside of the RAN, a further request to activate the trace session for measurements associated with one or more AI/ML models, wherein the first request is received as a permission or a positive acknowledgement in response to the further request.
  • a radio access network (RAN) node (100, 150, 210, 220, 940, 1110, 1200, 1302 1404) configured to collect data to be used with artificial intelligence/machine learning (AI/ML) models, the RAN node comprising: communication interface circuitry(1206, 1304) configured to communicate with UEs, with other RAN nodes, and with one or more network nodes or functions (NNFs) outside of the RAN; and processing circuitry (1202, 1304) operatively coupled to the communication interface circuitry, whereby the processing circuitry and the communication interface circuitry are configured to perform operations corresponding to any of the methods of embodiments A1-A9.
  • RAN radio access network
  • a radio access network (RAN) node (100, 150, 210, 220, 940, 1110, 1200, 1302 1404) configured to collect data to be used with artificial intelligence/machine learning (AI/ML) models, the RAN node being configured to perform operations corresponding to any of the methods of embodiments A1-A9.
  • a non-transitory, computer-readable medium (1204, 1304) storing computer-executable instructions that, when executed by processing circuitry (1202, 1304) associated with a radio access network (RAN) node configured to collect data to be used with artificial intelligence/machine learning (AI/ML) models, configure the RAN node to perform operations corresponding to any of the methods of embodiments A1-A9.
  • a computer program product (1204a, 1304a) comprising computer-executable instructions that, when executed by processing circuitry (1202, 1304) associated with a radio access network (RAN) node configured to collect data to be used with artificial intelligence/machine learning (AI/ML) models, configure the RAN node to perform operations corresponding to any of the methods of embodiments A1-A9.
  • RAN radio access network
  • AI/ML artificial intelligence/machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

Des modes de réalisation concernent des procédés mis en œuvre par un nœud de réseau d'accès radio (RAN) pour collecter les données à utiliser avec des modèles d'intelligence artificielle/apprentissage automatique (IA/ML). De tels procédés peuvent consister à recevoir, d'un nœud ou d'une fonction réseau (NNF) à l'extérieur du RAN, une première demande d'activation d'une session de trace pour des mesures effectuées par un ou plusieurs équipements utilisateur (UE) dans le RAN. La première demande comprend des informations indiquant que les mesures sont associées à un ou plusieurs modèles IA/ML. De tels procédés peuvent consister à sélectionner, d'après les informations reçues avec la première demande, un ou plusieurs UE desservis par le nœud RAN pour effectuer les mesures demandées. De tels procédés peuvent consister à envoyer, aux UE sélectionnés, des secondes demandes respectives afin d'effectuer les mesures pour la session de trace, ainsi qu'à recevoir, des UE sélectionnés, des rapports de mesure respectifs comprenant les résultats des mesures effectuées conformément aux secondes demandes respectives.
PCT/EP2023/068911 2022-08-05 2023-07-07 Minimisation basée sur ran de techniques de test de conduite (mdt) permettant de collecter des données pour des modèles d'ia/ml WO2024028041A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GR20220100647 2022-08-05
GR20220100647 2022-08-05

Publications (1)

Publication Number Publication Date
WO2024028041A1 true WO2024028041A1 (fr) 2024-02-08

Family

ID=87202008

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2023/068911 WO2024028041A1 (fr) 2022-08-05 2023-07-07 Minimisation basée sur ran de techniques de test de conduite (mdt) permettant de collecter des données pour des modèles d'ia/ml

Country Status (1)

Country Link
WO (1) WO2024028041A1 (fr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220030454A1 (en) * 2018-09-27 2022-01-27 Samsung Electronics Co., Ltd. Apparatus and a method for configurating and reporting of minimization of drive tests measurement and access network device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220030454A1 (en) * 2018-09-27 2022-01-27 Samsung Electronics Co., Ltd. Apparatus and a method for configurating and reporting of minimization of drive tests measurement and access network device

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
"3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Telecommunication management; Subscriber and equipment trace; Trace control and configuration management (Release 17)", 22 June 2022 (2022-06-22), XP052201760, Retrieved from the Internet <URL:https://ftp.3gpp.org/3guInternal/3GPP_ultimate_versions_to_be_transposed/sentToDpc/32422-h71.zip 32422-h71.doc> [retrieved on 20220622] *
3GPP TR 36.805
3GPP TR 37.817
3GPP TS 32.422
ERICSSON: "(TP for MDT BL CR for TS 38.401): In-device coexistence "pollution" on MDT measurements Discussion", vol. RAN WG3, no. Online; 20210125 - 20210204, 5 February 2021 (2021-02-05), XP051978576, Retrieved from the Internet <URL:https://ftp.3gpp.org/tsg_ran/WG3_Iu/TSGR3_111-e/Docs/R3-211301.zip R3-211301_wasR3-210687 - IDC pollution on MDT measurements Discussion_V01.docx> [retrieved on 20210205] *
INTEL CORPORATION: "High level principle and Functional Framework of AI/ML enabled NG-RAN Network", vol. RAN WG3, no. Electronic meeting; 20210816 - 20210826, 6 August 2021 (2021-08-06), XP052035296, Retrieved from the Internet <URL:https://ftp.3gpp.org/tsg_ran/WG3_Iu/TSGR3_113-e/Docs/R3-213468.zip R3-213468-High level principle and Functional Framework of AIML enabled NG-RAN Network.docx> [retrieved on 20210806] *
QUALCOMM: "Email discussion summary for [RAN-R18-WS-crossFunc-Qualcomm]", vol. TSG RAN, no. Electronic Meeting; 20210628 - 20210702, 25 June 2021 (2021-06-25), XP052029085, Retrieved from the Internet <URL:https://ftp.3gpp.org/tsg_ran/TSG_RAN/TSGR_AHs/2021_06_RAN_Rel18_WS/Docs/RWS-210637.zip RWS-210637 Email discussion summary for [RAN-R18-WS-crossFunc-Qualcomm].docx> [retrieved on 20210625] *

Similar Documents

Publication Publication Date Title
US11943164B2 (en) Minimization of driving test (MDT) logs reporting method and device, MDT logs reporting control method and device, storage medium, and electronic device
CN112512059A (zh) 网络优化方法、服务器、网络侧设备、系统和存储介质
CN114402654A (zh) 用于无线电接入网数据收集的装置
US11265729B2 (en) Minimisation of drive test in a telecommunication network
US20220272587A1 (en) Handling of Logged Minimization Drive Test Configurations in Dual Connectivity Scenario
CN113455030B (zh) 5g核心网络(5gc)中的组数据管理
JP2022105306A (ja) オープン無線アクセスネットワーク(o-ran)環境でハンドオーバ(ho)手順を開始するための方法及び装置
KR20240053659A (ko) 핸드오버 실패에 대한 무선 링크 실패 리포트 개선
WO2024028041A1 (fr) Minimisation basée sur ran de techniques de test de conduite (mdt) permettant de collecter des données pour des modèles d&#39;ia/ml
US20240172074A1 (en) Handling of User Equipment (UE) Context Information after Inter-System Handover
WO2023148010A1 (fr) Gestion réseau-centrique du cycle de vie des modèles ai/ml déployés dans un équipement utilisateur (ue)
US20220201703A1 (en) Handling of multiple minimization of drive test contexts in multiple radio resource controller states
WO2023211356A1 (fr) Surveillance de fonctionnalité d&#39;apprentissage automatique d&#39;équipement utilisateur
WO2023148009A1 (fr) Gestion de cycle de vie centrée sur l&#39;utilisateur de modèles ai/ml déployés dans un équipement utilisateur (ue)
WO2024094868A1 (fr) Procédés de rapport de rétroaction associée à des événements d&#39;ai/ml
WO2024005702A1 (fr) Mesures de couche radio et de couche application alignées dans le temps pour connectivité double
WO2023095037A1 (fr) Rapport mdt journalisé faisant intervenir une mobilité inter-rat
TW202341794A (zh) 在執行雙主動協定堆疊交接時存錄及報告多重隨機存取程序資訊
WO2023136764A1 (fr) Procédés de gestion de journalisation de différents types de mesures dans des rapports son
WO2023132782A1 (fr) Temporisateurs de supervision pour rapport de transfert intercellulaire réussi
WO2023075657A1 (fr) Gestion d&#39;une configuration de rapport de transfert intercellulaire (shr) réussie au niveau d&#39;un équipement utilisateur (ue) et d&#39;un réseau
WO2023163630A1 (fr) Adaptation de puissance de transmission de réseau économe en énergie
EP4331255A1 (fr) Procédés, dispositifs et produits programmes d&#39;ordinateur pour exploiter des prédictions pour une optimisation de capacité et de couverture
WO2024027980A1 (fr) Configuration d&#39;un contexte d&#39;ue survivant lors d&#39;une opération ia/ml
WO2023047255A1 (fr) Améliorations apportées à un rapport mdt journalisé

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23739557

Country of ref document: EP

Kind code of ref document: A1