WO2023078549A1

WO2023078549A1 - Uplink exploration coordination

Info

Publication number: WO2023078549A1
Application number: PCT/EP2021/080580
Authority: WO
Inventors: Teemu Mikael VEIJALAINEN; Kalle Petteri Kela; Hans Thomas HÖHNE
Original assignee: Nokia Solutions And Networks Oy
Priority date: 2021-11-04
Filing date: 2021-11-04
Publication date: 2023-05-11

Abstract

Various example embodiments relate to a solution for wireless communication. A first network device may obtain state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied. The first network device may also transmit a resource request comprising the state data to at least one second network device for the at least one second network device to schedule, according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device. Devices, methods, and computer programs are disclosed.

Description

UPLINK EXPLORATION COORDINATION

TECHNICAL FIELD

Various example embodiments generally relate to the field of wireless communications . In particular, some example embodiments relate to a solution for uplink exploration coordination .

BACKGROUND

A base station providing wireless communication provides a cell for a plurality of user devices , and the cell has a certain coverage . At a cell edge , a user device may use a higher transmi ssion power compared to a situation in which the user device is located closed to the base station . As each cell has a limited geographical coverage , cells need to be arranged so that the user device is able to move between di f ferent cells . In practice , cells of di f ferent base stations may slightly overlap .

Further, a user device connected to a first base station may experience interference from a user device connected to a second base station . This may especial ly exist when the user device connected to the second base station is transmitting on an edge of the cell provided by the second base station .

Certain interference conditions cannot be explored for uplink i f the second base station does not have connected user devices . Moreover, an interesting situation for a first base station is when user devices of the second base station are transmitting on a cell edge . A challenge there is how to organi ze uplink exploration for the first base station when the second base station has cell edge user devices present . SUMMARY

This summary is provided to introduce a selection of concepts in a simpli fied form that are further described below in the detailed description . This summary is not intended to identi fy key features or essential features of the claimed subj ect matter, nor is it intended to be used to limit the scope of the claimed subj ect matter .

Example embodiments may provide a solution for uplink exploration coordinating between two or more network devices , for example , base stations . This benefit may be achieved by the features of the independent claims . Further implementation forms are provided in the dependent claims , the description, and the drawings .

According to a first aspect , a first network device for wireless communication comprises at least one processor, and at least one memory including computer program code . The at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : obtain state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied; and transmit a request comprising the state data to at least one second network device for the at least one second network device to schedule , according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : determine the resource configuration and the state data ; and include the resource configuration and the state data in the resource request .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : receive the resource configuration and the state data from a network manager ; and include the resource configuration and the state data in the resource request .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to receive the resource configuration from a network manager, determine the state data and include the resource configuration and the state data in the resource request .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to determine the state data .

In an example embodiment , the resource comprises one or more resource elements in a time and frequency domain .

In an example embodiment , the resource configuration defines one or more of the following : a pattern of the one or more resource elements in a time and frequency domain; on and of f periods of the one or more resource elements in the time and frequency domain; probabilities of the on and of f periods of the one or more resource elements in the time and frequency domain; and one-time timing for using the one or more resource elements in the time and frequency domain . In an example embodiment , the resource request comprises a time window for the at least one second network device to search seek user devices matching with the state data .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : receive a first response from the at least one second network device , the response indicating that at least one user device matching with the state data is available for exploration .

In an example embodiment , the first response comprises a timer indicating how long the at least one user device is kept connected or expected to match with the state data .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : receive a first response from the at least one second network device , the first response providing an indication to wait until at least one user device matching with the state data is available for exploration .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : receive a second response from the at least one second network device indicating that at least one user device matching with the state data is available for exploration .

In an example embodiment , the first response comprises a subset of the resource configuration that can be allocated by the at least one second network device . In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : transmit a triggering message to the second network device to initiate scheduling of uplink transmissions with at least one available user device , wherein the triggering message comprises an indication of one or more resource elements in the time and frequency domain on which to transmit .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : receive a reply from at least one second network device indicating that one or more resource elements in the time and frequency domain cannot be allocated .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : select one or more resource elements in the time and frequency domain on which to schedule at least one exploration transmission; schedule the at least one exploration transmission for at least one user device on the selected one or more resource elements in the time and frequency domain; and estimate at least one parameter during the at least one exploration transmission .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : instruct the at least one user device to transmit duplicated data on the selected one or more resource elements in the time and frequency domain . In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : train a machine learning model associated with radio resource management with the at least one parameter .

In an example embodiment , the at least one parameter comprises one or more of the following : a block error probability; and an uplink signal to interference plus noise ratio .

In an example embodiment , the resource comprises an exploration resource .

In an example embodiment , the first network device comprises a base station, a central unit ( CU) or a distributed unit ( DU) .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : receive a coordination request from a third network device ; and transmit the resource request in response to the coordination request .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the first network device at least to : transmit a resource confirmation to a third network device , the resource confirmation triggering to initiate exploration at the third network device .

In an example embodiment , the first network device comprises a network managing entity .

According to a second aspect , a second network device for wireless communication comprises at least one processor, and at least one memory including computer program code . The at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to : receive , from a first network device , a resource request comprising state data defining at least one parameter associated with a user device for which a configuration associated with a resource is to be applied, the resource request instructing the second network device to schedule , according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to obtain the resource configuration from a network managing entity .

In an example embodiment , the resource request comprises the resource configuration .

In an example embodiment , the resource configuration defines one or more of the following : a pattern of the one or more resource elements in the time and frequency domain; on and of f periods of the one or more resource elements in the time and frequency domain; probabilities of on and of f periods of the one or more resource elements in the time and frequency domain; and one-time timing for using the one or more resource elements in the time and frequency domain .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to : determine that at least one user device matching with the state data connected to the second network device is available for exploration ; and transmit a first response to the first network device , the first response indicating that at least one user device matching with the state data is available for exploration .

In an example embodiment , the first response comprises a timer indicating how long a user device is kept connected or expected to match with the state data .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to : transmit a first response to the first network device , the first response providing an indication to wait until at least one user device matching with the state data is available for exploration .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to : determine that at least one user device matching with the state data is available for exploration; and transmit a second response to the first network device , the response indicating that at least one user device is available for exploration .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to : transmit information comprising the state data to at least one user device ; receive at least one response from at least one user device , the response indicating a match with the state data ; and transmit a second response to the first network device , the response indicating that at least one user device is available for exploration .

In an example embodiment , the first response comprises a subset of the resource configuration that can be allocated by the second network device .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to : receive a triggering message from the first network device to initiate scheduling of uplink transmissions with at least one available user device , wherein the triggering message comprises an indication of one or more resource elements in the time and frequency domain on which to transmit .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to transmit a reply to the first network device indicating that one or more resource elements in the time and frequency domain cannot be allocated .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to schedule , based on the indication, uplink transmissions for at least one available user device .

In an example embodiment , the at least one memory and the computer program code are configured to , with the at least one processor, cause the second network device at least to instruct the at least one available user device to transmit duplicated data on the indicated one or more resource elements in the time and frequency domain . In an example embodiment , the resource comprises an exploration resource .

According to a third aspect , a method for wireless communication comprises obtaining, by a first network device , state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied; and transmitting, by the first network device , a resource request comprising the state data to at least one second network device for the at least one second network device to schedule , according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device .

According to a fourth aspect , a method for wireless communication comprises receiving, by a second network device from a first network device , a resource request comprising state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied, the resource request instructing the second network device to schedule , according to the resource configuration, transmissions with at least one user device , associated with the second network device , matching with the state data for providing interference conditions for at least one other user device .

According to a fi fth aspect , there is provided a computer program compri sing instructions for causing an apparatus to perform at least the following : obtaining, by a first network device , state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied; and transmitting, by the first network device , a resource request compris ing the state data to at least one second network device for the at least one second network device to schedule , according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device .

According to a sixth aspect , there is provided a computer program compri sing instructions for causing an apparatus to perform at least the following : receiving, by a second network device from a first network device , a resource request compri sing state data defining at least one parameter associated with a user device for which a configuration associated with a resource is to be applied, the resource request instructing the second network device to schedule , according to the resource configuration, transmissions with at least one user device , associated with the second network device , matching with the state data for providing interference conditions for at least one other user device .

According to a seventh aspect , a first network device for wireless communication may comprise means for : obtaining state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied; and transmitting a resource request comprising the state data to at least one second network device for the at least one second network device to schedule , according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device .

According to an eighth aspect , a second network device for wireless communication may comprise means for : receiving from a first network device a resource request comprising state data defining at least one parameter associated with a user device for which a configuration associated with a resource is to be applied, the resource request instructing the second network device to schedule , according to the resource configuration, transmissions with at least one user device , associated with the second network device , matching with the state data for providing interference conditions for at least one other user device .

Many of the attendant features will be more readily appreciated as they become better understood by reference to the following detailed description considered in connection with the accompanying drawings .

DESCRIPTION OF THE DRAWINGS

The accompanying drawings , which are included to provide a further understanding of the example embodiments and constitute a part of this speci fication, illustrate example embodiments and together with the description help to understand the example embodiments . In the drawings :

FIG . 1 illustrates an uplink exploration problem between two network devices .

FIG . 2A illustrates an example of a method for wireless communication according to an example embodiment .

FIG . 2B illustrates an example of a method for wireless communication according to an example embodiment .

FIG . 3A illustrates a signaling diagram for uplink exploration coordination according to an example embodiment . FIG . 3B illustrates a signaling diagram for upl ink exploration coordination according to an example embodiment .

FIG . 3C illustrates a signaling diagram for upl ink exploration coordination according to an example embodiment .

FIG . 4 illustrates an example of an apparatus configured to practice one or more example embodiments .

FIG . 5 illustrates an example of an apparatus configured to practice one or more example embodiments .

FIG . 6 illustrates an example of an apparatus configured to practice one or more example embodiments .

Like references are used to designate like parts in the accompanying drawings .

DETAILED DESCRIPTION

Reference will now be made in detail to example embodiments , examples of which are illustrated in the accompanying drawings . The detailed description provided below in connection with the appended drawings is intended as a description of the present examples and is not intended to represent the only forms , in which the present example may be constructed or utili zed . The description sets forth the functions of the example and the sequence of steps for constructing and operating the example . However, the same or equivalent functions and sequences may be accomplished by di f ferent examples .

Some example embodiments of the present disclosure have been described in a speci fic data communication environment , for example , 3GPP mobile communication network environment . The present disclosure can, however, be applied in any existing or coming wireless communication environment . FIG. 1 illustrates an uplink exploration problem between two network devices, for example, base stations. A user device 108, 304 is associated with a first network node 100, for example, a base station, and a user device 4110, 308 is associated with a second network node 102, for example, a base station. The first network node 100 is configured to implement uplink exploration with the user device 108, 304, while the user device 110, 308 causes interference to the first network device 100. However, certain interference conditions cannot be explored for uplink if the second network device 102 not have connected user devices.

Reinforcement learning (RL) is a field of machine learning where an agent learns by trial and error a policy to maximize a given performance objective. The agent selects an action based on the current state of the environment. The action influences on the environment and leads to a new state and reward (goodness of the action in the given state) is received. An objective of the agent is to learn which actions with given state leads to highest cumulative future reward.

The purpose of a trial-and-error is to gain knowledge about what is working and what is not. This includes a concept of exploration versus exploitation. The exploration refers to occasional random actions, while the exploitation means that the agent exploits a learned policy. In practice RL algorithms have to balance between the exploration and the exploitation. Typically, before converging to a good policy, the RL algorithms start by exploring with high probability and decreases the probability of the exploration as the agent starts to learn. A challenge in the example illustrated in FIG. 1 is how to organize uplink exploration for the first base station when the second base station has cell edge user devices present .

FIG . 2A illustrates an example of a method for wireless communication according to an example embodiment . The method may be performed by a network device , for example , a base station, a central unit ( CU) or a distributed unit ( DU or a gNB, when it needs to coordinate exploration of learning based radio resource management (RRM) algorithms between one or more other base stations or gNBs .

A step 100 comprises obtaining state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied . In an example embodiment , the resource may be an exploration resource . The state data may define characteristics of the user device that shall use one or more resource elements in a time and frequency domain . The characteristics may comprise one or more o f the following : a reference signal received power (RSRP ) di f ference to a neighbour, a geolocation, an azimuth/a direction of a beam of its serving cell , a UE type , a maximum transmission power, a configured bandwidth, RSRQ (Reference Signal Received Quality) , RSS I (Received Signal Strength Indicator ) , CS I ( Channel State Information) , beam related measurements , an altitude etc . The resource may comprise one or more resource elements in a time and frequency domain . The exploration resource configuration may define one or more of the following : a pattern of the one or more resource elements in a time and frequency domain; on and of f periods of the one or more resource elements in a time and frequency domain; probabilities of the on and of f periods of the one or more resource elements in a time and frequency domain; and one-time timing for using the one or more resource elements in a time and frequency domain .

A step 102 may comprise transmitting a resource request comprising the state data to at least one second network device for the at least one second network device to schedule , according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device . The at least one other user device may be connected to the first network device .

FIG . 2B illustrates an example of a method for wireless communication according to an example embodiment . The method may be performed by a second network device , for example , a base station, a central unit ( CU) or a distributed unit ( DU) or a gNB, when it receives exploration coordination instructions from a first network device , for example , base station or gNB .

A step 204 comprises receiving, from the first network device , a resource request comprising state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied, the resource request instructing the second network device to schedule , according to the resource configuration, uplink transmissions with at least one user device matching with the state data for providing interference conditions for at least one other user device . In an example embodiment , the resource may be an exploration resource .

FIG . 3A illustrates a signaling diagram for uplink exploration coordination according to an example embodiment . The system illustrated in FIG . 3A comprises a network manager 300 , a first gNB 302 , a first user equipment 304 , a second gNB 306 and a second user equipment .

At 310 , the network manager 300 may configure an exploration resource (ER) . The exploration resource may refer to one or more resource elements in a time and frequency domain, for example , certain predefined symbols and subcarriers or resource blocks . An exploration resource configuration may def ine a pattern of the one or more resource elements in the time and frequency domain . For example , a resource block (RB ) index i every nth slot . In an example embodiment , the exploration resource configuration may also determine on and of f periods of the one or more resource elements in the time and frequency domain . During the on period the second gNB or a UE of the second gNB is to generate interference . In other words , the second gNB may be configured to schedule the UE to generate uplink interference . During the of f period the second gNB is to keep the radio resources silent . In an example embodiment , the exploration resource configuration may include a probability for the on and of f periods , in which the second gNB decides transmi ssion based on the given probabilities . In an example embodiment , the exploration resource configuration may define a one-time timing for using for using the one or more resource elements in the time and frequency domain .

In an example embodiment , the exploration resource configuration may be determined by higher layers ( for example , by operation and maintenance ) . This may mean that the exploration resources may be allocated for exploration purpose for cells receiving the exploration resource configuration . This may be useful , for example , when a network is new and thus more exploration or data- collection is required by the RRM algorithms before they converge . This may be also useful with high reliable industrial networks where continuous training and validation are needed . The predefined exploration resources may provide an error free space to continuously train and validate the algorithms , parallel to normal transmissions .

In an example embodiment , the network manager may coordinate between more than one neighbour to the first gNB ( i . e . between, for example , three gNBs ) to use exploration resource configuration . Multi-gNB coordination may be necessary when the uplink interference is determined by several gNBs . It may be also helpful i f many exploration events are necessary, and resources cannot be easily found .

At 312 and 314 the network manager 300 may transmit the ER configuration to the first gNB 304 and the second gNB 306 . In an example embodiment , the ER conf iguration may define one or more of the following : a pattern of the one or more resource elements in a time and frequency domain; on and of f periods of the one or more resource elements in a time and frequency domain; probabilities of the on and of f periods of the one or more resource elements in a time and frequency domain; and one-time timing for using the one or more resource elements in a time and frequency domain .

At 316 , when the first gNB 302 wishes to train its RRM algorithm, the first gNB 304 sends an ER request to the second gNB 306 . The ER request may comprise state data defining at least one parameter associated with the user device 304 for which exploration is to be applied . The state data may define characteristics of the first user device 304 that shall use the ER' s . The characteristics may comprise one or more of the following : an RSRP di f ference to a neighbour, a geolocation, an azimuth/a direction of a beam of its serving cell . In an example embodiment , the first gNB 304 may have detected that high signal to interference plus noise ratio ( S INR) variation is a likely reason for errors . The first gNB 304 may then request the second gNB 306 to create interference with cell edge users to learn how to adapt to the variations .

In an example embodiment , the request may include a validity timer defining a time window for searching users in the predefined state . After the timer expires , the second gNB 306 stops searching user devices .

At 318 , the second gNB 306 may reply with an acknowledgement/negative acknowledgement to indicate i f the second gNB 306 is will ing to explore . I f the second gNB 306 has already one or more user devices available for exploration, it may additionally reply with message at 324 , and steps 320 and 322 may be omitted . I f the second gNB 306 does not have one or more user devices available for exploration, the second gNB 306 may reply with an acknowledgement and an indication that the first gNB 302 needs to wait while one or more user devices matching with the state data are available for exploration .

At 320 the second gNB 306 may find user devices matching with the state data . In an example embodiment , the second gNB 306 may search idle user devices in a relevant state by broadcasting a new system Information block where the state data is included ( for example , a RSRP di f ference ) . Then, user devices then in that state and willing to explore , will reply to second gNB 306 and inform their willingness to explore . In another example embodiment , the second gNB 306 may use existing measurements to determine whether any of its served user devices meet the ER request by the first gNB 302 . For example , the second gNB 306 may configure a user node or nodes ) with additional measurement events , such as an existing A3 , to inform when the RSRP di f ference is below the given threshold between the first gNB 302 and the second gNB 306 .

At 324 the second gNB 306 may inform with an ER response message the first gNB 302 that one or more user devices are available for exploration . I f a user device was available already after the step 316 , the step 318 may be omitted and the second gNB 306 may reply with the message as indicated in the step 324 . In an example embodiment , the ER response message may comprise a timer indicating how long a user device is kept connected or expected to match with the state data . For example , i f a user device is moving, its time of stay in a wanted area can be estimated . In an example embodiment , the second gNB 306 may reply in the ER response with a subset of ERs that can be allocated for exploration . This may allow the second gNB 306 to prioriti ze user-plane traf fic in case of a high load .

At 326 the first gNB 302 may trigger exploration with the second gNB 306 by sending a triggering message , for example , an exploration resource triggering message . In an example embodiment , exploration resource triggering message may comprise an indication on which exploration resources the second gNB 306 should transmit or be silent with the found user device . In an example embodiment , there may be a predef ined pattern associated with the exploration resources . In another example embodiment , the first gNB 302 may signal on demand, for example , over the Xn interface the exact on/of f periods during the ER pattern . In an example embodiment , the second gNB 306 may reply i f one or more of the explorations resources cannot be allocated for exploration .

At 328 coordinated exploration may be initiated at the first gNB 302 at the same time with interference generation at the second gNB 306 . The illustrated solution may be used with any RRM function that wants to implement a method that benefits from arranging arbitrary interference conditions .

In an example embodiment , the first gNB 302 may be running uplink link adaptation ( LA) or power control algorithms that are calibrated during the worst-case interference periods . In an example embodiment , the worst-case interference periods may be created by the first gNB 302 by requesting the second gNB 306 to create interference on the exploration resources with UEs on the cell edge . This may be beneficial especially when the algorithm' s ability to react to changing interference is slower than periodicity of interference patterns . Therefore , the algorithm can adj ust their parameters when they know that the worst-case situations occurs .

In an example embodiment , during the exploration, the second gNB 306 may schedule normal user plane data on the exploration resources i f the user device has data on its buf fers on those periods . In an example embodiment , the second gNB 306 may schedule user nodes to transmit dummy exploration data on the uplink .

In an example embodiment , in order to guarantee a reliability of live data transmission during the exploration on the exploration resources , the f irst gNB 302 may instruct an explored user device to transmit duplicated data on the exploration resource . Then, for example , randomly performed exploration will not cause transmission errors or intolerable delays for live data transmissions. When the exploration is over (for example, due to a converged learning algorithm) duplicated data transmissions may be discontinued and the first gNB 302 may utilize learned data for the user devices future transmissions on non-ER resources. In an example embodiment, the duplicated data aspect may be applied also by the second gNB 306. If a user device has user plane data to be scheduled, and the second gNB 306 has a requirement to transmit on ER, the second gNB 306 may instruct the user device to duplicate the data on the ER, for example, by signalling the request on medium access control element (MAC CE) or part of uplink scheduling information. This may, for example, improve the reliability of the link.

FIG. 3B illustrates a signaling diagram for uplink exploration coordination according to an example embodiment. The example illustrated in FIG. 3B is identical with the example illustrated in FIG. 3A with the exception that in FIG. 3B, the first gNB 302 may dynamically determine at 332 the radio resources for the ER(s) . This may be suitable, for example, when the first gNB 302 has already trained its RRM algorithms, but after some time it detects that the performance is getting worse. Therefore, the first gNB 302 may temporarily coordinate exploration on the ER(s) to collect training data on certain situations.

FIG. 3C illustrates a signaling diagram for uplink exploration coordination according to an example embodiment. The example illustrated in FIG. 3C is similar with the example illustrated in FIG. 3A with the exception that in FIG. 3C, the network manager 300 acts as a coordinating entity for the first gNB 302 and the second network node 306. Steps 334, 336, 338 and 340 are identical with the steps 316 , 318 , 324 and 326 . The di f ference is that in the example of FIG . 3C the communication is performed between the network manager 300 and the second gNB 306 . In other words , in the example of FIG . 3C, the first gNB 302 and the second gNB 306 are not in direct communication with each other . Instead, the network manager 300 acts a coordinating entity .

In an example embodiment of FIG . 3C, the network manager 300 may receive an ER coordination request from the first gNB 302 . With the ER coordination request , the network manager 300 may be able to initiate the ER coordination .

In an example embodiment of FIG . 3C, at 342 the network manager 300 may send an ER confirmation to the first gNB 302 . Thi s may be used to confirm the exploration execution to the first gNB 302 . In an example embodiment , this step may be optional and the first gNBl 302 may assume after sending the ER coordination request and in absence of a negative response or acknowledgement from the network manager 300 that the exploration execution can be initiated .

In an example embodiment of any of FIGS . 3A-3C, the first gNB 302 may train a machine learning model associated with radio resource management with the at least one parameter, for example , a block error probability or an uplink signal to interference plus noise ratio .

In an example embodiment of any of FIGS . 3A-3C, the above illustrated solution may be applied in reinforcement learning (RL ) based UL LA at the first gNB 302 . An example RL that may be utili zed is Deep Deterministic Policy Gradient . In another example embodiment , the RL approach may be any standard deep reinforcement learning approach, such as Deep Q-Learnmg (DQN) or Actor-Critic.

The UL LA algorithm at the first gNB 302 may aim to satisfy certain BLEP_target while maximising spectral efficiency. The fist gNB 302 may send an exploration request to its neighbouring gNB(s) to explore with users that have an RSRP difference to the first gNB 302 RSRP less than a threshold. Once the second gNB 306 informs that a user device or devices have been found for UL exploration, the first gNB 302 may trigger the exploration by indicating during which ER(s) the second gNB 306 should schedule UL transmission with the user device (s) . During these ER(s) , the first gNB 302 may schedule one or more exploration transmissions from which training data is collected to train a machine learning (ML) model.

During the exploration, the first gNB 302 may estimate UL SINR which may then be used as an input for the ML model. An additional input may be size of the data that is being scheduled, as that allows more accurate adaptation since it is well known that linklevel block error probability (BLER) is a function of a signal-to-noise ratio (SNR) , a transport block (TB) size and a modulation and coding scheme (MCS) . An output of the ML model may be an MSC that may be selected for the transmission. In a Deep Deterministic Policy Gradient (DDPG) algorithm, the exploration is done implicitly. In other words, the exploration or exploitation is not directly selected, but noise is added to the neural network output (for example, normally distributed noise) that will slightly vary the MCS selection.

In an example embodiment of any of FIGS. 3A-3C, the first gNB 302 may estimate the BLEP of the scheduled transmissions during the exploration. The estimate may then be used with a reward function that outcomes a reward that is used to train the neural network . For example , an example reward may be a so called RB-reward where the policy is reinforced i f BLEP_estimate at the gNB is smaller or equal to BLEP_target . Moreover, the reward may be inversely proportional to the number of used resource blocks N_RBs which will steer the MSC towards most spectrally ef ficient MCS as long BLEP_estimate is below the target . I f the error probability estimate is higher than the target , the reward wil l get a negative value that will steer the policy away from the decision that resulted in this performance .

else Reward = — 1

After the exploration transmissions , the first gNB 302 has collected, for example , the following training data that is used to train the algorithm : state = S INR and data si ze , action = selected MCS , reward = RB-reward . This data may then be used to train the algorithm according to the DDPG principle .

A benefit of this approach may be that , since the data is collected from worst-case interference situations , the function that the LA algorithm is learning, f(SINR, N_bits\w) = MCS, has a more learnable shape since the interference remains more or less constant and does not lead to noisy rewards , and thus , the algorithm will converge faster . Moreover, since the model is trained with the worst-case interference data, it may act as i f there would be maximum interference present , and it is not disturbed by occasional high S INR periods when there happens to be no interference .

In an example embodiment of any of FIGS . 3A-3C, the ER may allow the first gNB 302 to measure a desired ( for example , a worst case ) UL interference even when the first gNB 302 is not performing the exploration . Thus , an UL S INR estimate matching to desired interference situation can be obtained by measuring the reference signal received power (RSRP ) and adding pre-measured typical interference and noise components measured on the ER . This is possible because a receiver end experiencing the interference is the same for all the user devices . This may also allow selecting a pre-learned ML model for a new connecting user device after first signal received power measurements have been carried out .

One or more of the above discussed examples and embodiments may enable a solution for coordinating exploration of learning based RRM algorithms between two or more gNBs . This coordination may be needed to create certain interference conditions , which then allows the learning algorithms to converge on the specific interference situations . Further, one or more of the above discussed examples and embodiments may enable a solution in which a base station is able to collect data which then allows to train the RRM algorithms from unseen di f ficult interference situations . Therefore , base station may be able to enhance its RRM algorithms to cope with these situations before they actually occur .

The illustrates solution can be used as a predeployed solution or an online solution . Especially with private ultra-reliable low-latency communication (URLLC ) networks , before setting the network online , the above illustrated coordination may be used to pre-train the RRM algorithms for the most demanding situations. On the other hand, the above illustrated solution may be used also in live networks, where a network probes occasionally additional information by using the illustrated solution.

FIG. 4 illustrates an example of an apparatus 400 configured to practice one or more example embodiments. The apparatus 400 may comprise a first network device, a first base station or a first gNB of a wireless communication network. In another example embodiment, the apparatus 400 may comprise a central unit (CU) or a distributed unit (DU) . The apparatus 400 may comprise at least one processor 402. The at least one processor 402 may comprise, for example, one or more of various processing devices or processor circuitry, such as, for example, a co-processor, a microprocessor, a controller, a digital signal processor (DSP) , a processing circuitry with or without an accompanying DSP, or various other processing devices including integrated circuits such as, for example, an application specific integrated circuit (ASIC) , a field programmable gate array (FPGA) , a microcontroller unit (MCU) , a hardware accelerator, a special-purpose computer chip, or the like.

The apparatus 400 may further comprise at least one memory 404. The at least one memory 404 may be configured to store, for example, computer program code or the like, for example, operating system software and application software. The at least one memory 404 may comprise one or more volatile memory devices, one or more non-volatile memory devices, and/or a combination thereof. For example, the at least one memory 404 may be embodied as magnetic storage devices (such as hard disk drives, floppy disks, magnetic tapes, etc.) , optical magnetic storage devices, or semiconductor memories (such as mask ROM, PROM (programmable ROM) , EPROM ( erasable PROM) , flash ROM, RAM ( random access memory) , etc . ) .

The apparatus 400 may further comprise a communication interface 408 configured to enable apparatus 400 to transmit and/or receive information to/ from other devices . In one example , the apparatus 400 may use the communication interface 408 to transmit or receive signaling information and data in accordance with at least one data communication or cellular communication protocol . The communication interface 408 may be configured to provide at least one wireless radio connection, such as , for example , a 3GPP mobile broadband connection ( e . g . 3G, 4G, 5G, 6G etc . ) . In another example embodiment , the communication interface 408 may be configured to provide one or more other type o f connections , for example a wireless local area network (WLAN) connection such as for example standardi zed by IEEE 802 . 11 series or Wi-Fi alliance ; a short range wireless network connection such as for example a Bluetooth, NFC (near- field communication) , or RFID connection; a wired connection, for example , a local area network ( LAN) connection, a universal serial bus (USB ) connection or an optical network connection, or the like ; or a wired Internet connection . The communication interface 408 may comprise , or be configured to be coupled to , at least one antenna to transmit and/or receive radio frequency signals . One or more of the various types of connections may be also implemented as separate communication interfaces , which may be coupled or configured to be coupled to one or more of a plurality of antennas .

When the apparatus 400 is configured to implement some functionality, some component and/or components of the apparatus 400 , for example, the at least one processor 402 and/or the at least one memory 404, may be configured to implement this functionality. Furthermore, when the at least one processor 402 is configured to implement some functionality, this functionality may be implemented using the program code 406 comprised, for example, in the at least one memory 404.

The functionality described herein may be performed, at least in part, by one or more computer program product components such as software components. According to an embodiment, the apparatus may comprise a processor or processor circuitry, for example, a microcontroller, configured by the program code when executed to execute the embodiments of the operations and functionality described. Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs) , application-specific Integrated Circuits (ASICs) , application-specific Standard Products (ASSPs) , System- on-a-chip systems (SOCs) , Complex Programmable Logic Devices (CPLDs) , and Graphics Processing Units (GPUs) .

The apparatus 400 may comprise means for performing at least one method described herein. In an example embodiment, the means may comprise the at least one processor 402, the at least one memory 404 including program code 406 configured to, when executed by the at least one processor, cause the apparatus 400 to perform the method.

Although the apparatus 400 is illustrated as a single device it is appreciated that, wherever applicable, functions of the apparatus 400 may be distributed to a plurality of devices. An apparatus, for example, a device such as a network device, a network node a base station or a gNB, may be configured to perform or cause performance of any aspect of the method (s) described herein. Further, a computer program may comprise instructions for causing, when executed, an apparatus to perform any aspect of the method (s) described herein. Further, an apparatus may comprise means for performing any aspect of the method (s) described herein. According to an example embodiment, the means comprises at least one processor, and at least one memory including program code, the at least one processor, and program code configured to, when executed by the at least one processor, cause performance of any aspect of the method (s) .

FIG. 5 illustrates an example of an apparatus 400 configured to practice one or more example embodiments. The apparatus 500 may comprise a second network device, a second base station or a second gNB of a wireless communication network. In another example embodiment, the apparatus 400 may comprise a central unit (CU) or a distributed unit (DU) . The apparatus 500 may comprise at least one processor 502. The at least one processor 502 may comprise, for example, one or more of various processing devices or processor circuitry, such as, for example, a co-processor, a microprocessor, a controller, a digital signal processor (DSP) , a processing circuitry with or without an accompanying DSP, or various other processing devices including integrated circuits such as, for example, an application specific integrated circuit (ASIC) , a field programmable gate array (FPGA) , a microcontroller unit (MCU) , a hardware accelerator, a special-purpose computer chip, or the like.

The apparatus 500 may further comprise at least one memory 504. The at least one memory 504 may be configured to store, for example, computer program code or the like for example, operating system software and application software. The at least one memory 504 may comprise one or more volatile memory devices, one or more non-volatile memory devices, and/or a combination thereof. For example, the at least one memory 504 may be embodied as magnetic storage devices (such as hard disk drives, floppy disks, magnetic tapes, etc.) , optical magnetic storage devices, or semiconductor memories (such as mask ROM, PROM (programmable ROM) , EPROM (erasable PROM) , flash ROM, RAM (random access memory) , etc.) .

The apparatus 500 may further comprise a communication interface 508 configured to enable apparatus 500 to transmit and/or receive information to/from other devices. In one example, the apparatus 500 may use the communication interface 508 to transmit or receive signaling information and data in accordance with at least one data communication or cellular communication protocol. The communication interface 508 may be configured to provide at least one wireless radio connection, such as, for example, a 3GPP mobile broadband connection (e.g. 3G, 4G, 5G, 6G etc.) . In another example embodiment, the communication interface 508 may be configured to provide one or more other type of connections, for example a wireless local area network (WLAN) connection such as for example standardized by IEEE 802.11 series or Wi-Fi alliance; a short range wireless network connection such as for example a Bluetooth, NFC (near-field communication) , or RFID connection; a wired connection, for example, a local area network (LAN) connection, a universal serial bus (USB) connection or an optical network connection, or the like; or a wired Internet connection. The communication interface 508 may comprise, or be configured to be coupled to, at least one antenna to transmit and/or receive radio frequency signals. One or more of the various types of connections may be also implemented as separate communication interfaces, which may be coupled or configured to be coupled to one or more of a plurality of antennas.

When the apparatus 500 is configured to implement some functionality, some component and/or components of the apparatus 500, for example, the at least one processor 502 and/or the at least one memory 504, may be configured to implement this functionality. Furthermore, when the at least one processor 502 is configured to implement some functionality, this functionality may be implemented using the program code 506 comprised, for example, in the at least one memory 504.

The apparatus 500 may comprise means for performing at least one method described herein. In an example embodiment , the means may comprise the at least one processor 502 , the at least one memory 505 including program code 506 configured to , when executed by the at least one processor, cause the apparatus 500 to perform the method .

Although the apparatus 500 is illustrated as a single device it is appreciated that , wherever applicable , functions of the apparatus 500 may be distributed to a plurality of devices .

An apparatus , for example , a device such as a network device , a network node a base station or a gNB, may be configured to perform or cause performance of any aspect of the method ( s ) described herein . Further, a computer program may comprise instructions for causing, when executed, an apparatus to perform any aspect of the method ( s ) described herein . The computer program may be stored on a computer-readable medium . Further, an apparatus may comprise means for performing any aspect of the method ( s ) described herein . According to an example embodiment , the means comprises at least one processor, and at least one memory including program code , the at least one proces sor, and program code configured to , when executed by the at least one processor, cause performance of any aspect of the method ( s ) .

FIG . 6 illustrates an example of an apparatus 600 configured to practice one or more example embodiments . The apparatus 600 may comprise a network device , a network manager, a network managing entity or a cloud entity . The apparatus 600 may comprise at least one processor 602 . The at least one processor 602 may comprise , for example , one or more of various processing devices or processor circuitry, such as , for example , a co-processor, a microprocessor, a controller, a digital signal processor (DSP) , a processing circuitry with or without an accompanying DSP, or various other processing devices including integrated circuits such as, for example, an application specific integrated circuit (ASIC) , a field programmable gate array (FPGA) , a microcontroller unit (MCU) , a hardware accelerator, a special-purpose computer chip, or the like.

The apparatus 600 may further comprise at least one memory 604. The at least one memory 604 may be configured to store, for example, computer program code or the like, for example, operating system software and application software. The at least one memory 604 may comprise one or more volatile memory devices, one or more non-volatile memory devices, and/or a combination thereof. For example, the at least one memory 604 may be embodied as magnetic storage devices (such as hard disk drives, floppy disks, magnetic tapes, etc.) , optical magnetic storage devices, or semiconductor memories (such as mask ROM, PROM (programmable ROM) , EPROM (erasable PROM) , flash ROM, RAM (random access memory) , etc.) .

The apparatus 600 may further comprise a communication interface 608 configured to enable apparatus 600 to transmit and/or receive information to/from other devices. In one example, the apparatus 600 may use the communication interface 608 to transmit or receive signaling information and data in accordance with at least one data communication or cellular communication protocol. The communication interface 608 may be configured to provide at least one wireless radio connection, such as, for example, a 3GPP mobile broadband connection (e.g. 3G, 4G, 5G, 6G etc.) . In another example embodiment, the communication interface 608 may be configured to provide one or more other type of connections, for example a wireless local area network (WLAN) connection such as for example standardi zed by IEEE 802 . 11 series or Wi-Fi alliance ; a wired connection, for example , a local area network ( LAN) connection, a universal serial bus (USB ) connection or an optical network connection, or the like ; or a wired Internet connection . The communication interface 608 may comprise , or be configured to be coupled to , at least one antenna to transmit and/or receive radio frequency signals . One or more of the various types of connections may be also implemented as separate communication interfaces , which may be coupled or configured to be coupled to one or more of a plurality of antennas .

When the apparatus 600 is configured to implement some functionality, some component and/or components of the apparatus 600 , for example , the at least one processor 602 and/or the at least one memory 604 , may be configured to implement this functionality . Furthermore , when the at least one processor 602 is configured to implement some functionality, this functionality may be implemented using the program code 606 comprised, for example , in the at least one memory 604 .

The functionality described herein may be performed, at least in part , by one or more computer program product components such as software components . According to an embodiment , the apparatus may comprise a processor or processor circuitry, for example , a microcontroller, configured by the program code when executed to execute the embodiments of the operations and functionality described . Alternatively, or in addition, the functionality described herein can be performed, at least in part , by one or more hardware logic components . For example , and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays ( FPGAs ) , application-specific Integrated Circuits (ASICs) , application-specific Standard Products (ASSPs) , System- on-a-chip systems (SOCs) , Complex Programmable Logic Devices (CPLDs) , and Graphics Processing Units (GPUs) .

The apparatus 600 may comprise means for performing at least one method described herein. In an example embodiment, the means may comprise the at least one processor 602, the at least one memory 604 including program code 606 configured to, when executed by the at least one processor, cause the apparatus 600 to perform the method.

Although the apparatus 600 is illustrated as a single device it is appreciated that, wherever applicable, functions of the apparatus 600 may be distributed to a plurality of devices.

An apparatus, for example, a device such as a network device, network manager, a network entity or a cloud entity, may be configured to perform or cause performance of any aspect of the method (s) described herein. Further, a computer program may comprise instructions for causing, when executed, an apparatus to perform any aspect of the method (s) described herein. Further, an apparatus may comprise means for performing any aspect of the method (s) described herein. According to an example embodiment, the means comprises at least one processor, and at least one memory including program code, the at least one processor, and program code configured to, when executed by the at least one processor, cause performance of any aspect of the method ( s ) .

Any range or device value given herein may be extended or altered without losing the effect sought. Also, any embodiment may be combined with another embodiment unless explicitly disallowed. Although the subj ect matter has been described m language speci fic to structural features and/or acts , it is to be understood that the subj ect matter defined in the appended claims is not necessarily limited to the speci fic features or acts described above . Rather, the speci fic features and acts described above are disclosed as examples of implementing the claims and other equivalent features and acts are intended to be within the scope of the claims .

It will be understood that the benefits and advantages described above may relate to one embodiment or may relate to several embodiments . The embodiments are not limited to those that solve any or all of the stated problems or those that have any or al l of the stated benefits and advantages . It will further be understood that reference to ' an ' item may refer to one or more of those items .

The steps or operations of the methods described herein may be carried out in any suitable order, or simultaneously where appropriate . Additionally, individual blocks may be deleted from any of the methods without departing from the scope of the subj ect matter described herein . Aspects of any of the embodiments described above may be combined with aspects of any of the other embodiments described to form further embodiments without losing the ef fect sought .

The term ' comprising ' is used herein to mean including the method, blocks , or elements identified, but that such blocks or elements do not comprise an exclusive list and a method or apparatus may contain additional blocks or elements .

As used in this application, the term ' circuitry' may refer to one or more or all of the following : ( a ) hardware-only circuit implementations ( such as implementations in only analog and/or digital circuitry) and (b) combinations of hardware circuits and software, such as (as applicable) : (i) a combination of analog and/or digital hardware circuit (s) with software/ firmware and (ii) any portions of hardware processor (s) with software (including digital signal processor ( s ) ) , software, and memory (ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions) and (c) hardware circuit (s) and or processor ( s ) , such as a microprocessor ( s ) or a portion of a microprocessor ( s ) , that requires software (e.g., firmware) for operation, but the software may not be present when it is not needed for operation. This definition of circuitry applies to all uses of this term in this application, including in any claims.

As a further example, as used in this application, the term circuitry also covers an implementation of merely a hardware circuit or processor (or multiple processors) or portion of a hardware circuit or processor and its (or their) accompanying software and/or firmware. The term circuitry also covers, for example and if applicable to the particular claim element, a baseband integrated circuit or processor integrated circuit for a mobile device or a similar integrated circuit in server, a cellular network device, or other computing or network device.

It will be understood that the above description is given by way of example only and that various modifications may be made by those skilled in the art. The above specification, examples and data provide a complete description of the structure and use of exemplary embodiments. Although various embodiments have been described above with a certain degree of particularity, or with reference to one or more individual embodiments , those skilled in the art could make numerous alterations to the disclosed embodiments without departing from scope of this speci fication .

Claims

CLAIMS l. A first network device (100, 300, 302, 400, 600) for wireless communication, comprising: at least one processor (402) ; and at least one memory (404) including computer program code (406) , the at least one memory (404) and the computer program code (406) configured to, with the at least one processor (402) , cause the first network device (400) at least to: obtain state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied; and transmit a resource request comprising the state data to at least one second network device (102, 306, 500) for the at least one second network device (102, 306, 500) to schedule, according to the resource configuration, uplink transmissions with at least one user device (110, 308) matching with the state data for providing interference conditions for at least one other user device (108, 304) .

2. The first network device (100, 300, 302, 400, 600) according to claim 1, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to : determine the resource configuration and the state data; and include the resource configuration and the state data in the resource request.

3. The first network device (100, 302, 400) according to claim 1, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to: receive the resource configuration and the state data from a network manager (300) ; and include the resource configuration and the state data in the resource request.

4. The first network device (100, 302, 400) according to claim 1, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to: receive the resource configuration from a network manager ( 300 ) ; determine the state data; and include the resource configuration and the state data in the resource request.

5. The first network device (100, 302, 400) according to claim 1, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to: determine the state data.

6. The first network device (100, 300, 302, 400,

600) according to any of claims 1 - 5, wherein the resource comprises one or more resource elements in a time and frequency domain.

7. The first network device (100, 300, 302, 400, 600) according to any of claims 1 - 6, wherein the resource configuration defines one or more of the following : a pattern of the one or more resource elements in a time and frequency domain; on and off periods of the one or more resource elements in a time and frequency domain; probabilities of the on and off periods of the one or more resource elements in a time and frequency domain; and one-time timing for using the one or more resource elements in a time and frequency domain.

8. The first network device (100, 300, 302, 400, 600) according to any of claims 1 - 7, wherein the resource request comprises a time window for the at least one second network device (102, 306, 500) to search user devices (110, 308) matching with the state data.

9. The first network device (100, 300, 302, 400, 600) according to any of claims 1 - 8, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to: receive a first response from the at least one second network device (102, 306, 500) , the response indicating that at least one user device (110, 308) matching with the state data is available for exploration .

10. The first network device (100, 300, 302, 400,

600) according to claim 9, wherein the first response comprises a timer indicating how long the at least one user device (110, 308) is kept connected or expected to match with the state data.

11. The first network device (100, 300, 302, 400, 600) according to any of claims 1 - 8, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to: receive a first response from the at least one second network device (102, 306, 500) , the first response providing an indication to wait until at least one user device (110, 308) matching with the state data is available for exploration.

12. The first network device (100, 300, 302, 400, 600) according to claim 11, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to : receive a second response from the at least one second network device (102, 306, 500) indicating that at least one user device (110, 308) matching with the state data is available for exploration.

13. The first network device (100, 300, 302, 400, 600) according to any of claims 9 - 12, wherein the first response comprises a subset of the resource configuration that can be allocated by the at least one second network device (102, 306, 500) .

14. The first network device (100, 300, 302, 400,

600) according to any of claims 9 - 13, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to: transmit a triggering message to the second network device (102, 306, 500) to initiate scheduling of uplink transmissions with at least one available user device (110, 308) , wherein the triggering message comprises an indication of one or more resource elements in a time and frequency domain on which to transmit.

15. The first network device (100, 300, 302, 400, 600) according to claim 14, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to : receive a reply from at least one second network device (102, 306, 500) indicating that one or more resource elements in a time and frequency domain cannot be allocated.

16. The first network device (100, 302, 400) according to any of claims 14 - 15, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to : select one or more resource elements in a time and frequency domain on which to schedule at least one exploration transmission; schedule the at least one exploration transmission for the at least one other user device (108, 304) on the selected one or more resource elements m a time and frequency domain; and estimate at least one parameter during the at least one exploration transmission.

17. The first network device (100, 302, 400) according to claim 16, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to: instruct the at least one other user device (108, 304) to transmit duplicated data on the selected one or more resource elements in a time and frequency domain.

18. The first network device (100, 302, 400) according to claim 16 or 17, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (100, 302, 400) at least to : train a machine learning model associated with radio resource management with the at least one parameter .

19. The first network device (100, 300, 302, 400, 600) according to any of claims 1 - 18, wherein the at least one parameter comprises one or more of the following : a block error probability; and an uplink signal to interference plus noise ratio.

20. The first network device (100, 300, 302, 400, 600) according to any of claims 1 - 19, wherein the resource comprises an exploration resource.

21. The first network device (100, 302, 400) according to any of claims 1 - 20, wherein the first network device (100, 302, 400) comprises a base station, a central unit (CU) or a distributed unit (DU) .

22. The first network device (300, 600) according to any of claims 1, 2, 6 - 14, 19 or 20, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (300) at least to: receive a coordination request from a third network device (100, 302, 400) ; and transmit the resource request in response to the coordination request.

23. The first network device (300, 600) according to any of claims 1, 2, 6 - 14, 19 or 20, wherein the at least one memory (404) and the computer program code (406) are configured to, with the at least one processor (402) , cause the first network device (300) at least to: transmit a resource confirmation to a third network device (100, 302, 400) , the resource confirmation triggering to initiate exploration at the third network device (100, 302, 400) .

24. The first network device (300, 600) according to any of claims 1, 2, 6 - 14, 19, 20, 22 or 23, wherein the first network device (300, 600) comprises a network managing entity.

25. A second network device (102, 306, 500) for wireless communication, comprising: at least one processor (502) ; and at least one memory (504) including computer program code (504) , the at least one memory (504) and the computer program code (506) configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to: receive, from a first network device (100, 302, 400) , a resource request comprising state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied, the resource request instructing the second network device (102, 306, 500) to schedule, according to the resource configuration, uplink transmissions with at least one user device (110, 308) matching with the state data for providing interference conditions for at least one other user device (108, 304 ) .

26. The second network device (102, 306, 500) according to claim 25, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (500) at least to: obtain the resource configuration from a network managing entity.

27. The second network device (102, 306, 500) according to claim 26, wherein the resource request comprises the resource configuration.

28. The second network device (100, 302, 400) according to any of claims 26 - 27, wherein the resource comprises one or more resource elements m a time and frequency domain.

29. The second network device (102, 306, 500) according to any of claims 26 - 28, wherein the resource configuration defines one or more of the following: a pattern of the one or more resource elements in a time and frequency domain; on and off periods of the one or more resource elements in a time and frequency domain; probabilities of on and off periods of the one or more resource elements in a time and frequency domain; and one-time timing for using the one or more resource elements in a time and frequency domain.

30. The second network device (102, 306, 500) according to any of claims 27 - 29, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to : determine that at least one user device (110, 308) matching with the state data connected to the second network device is available for exploration; and transmit a first response to the first network device, the first response indicating that at least one user device (110, 308) matching with the state data is available for exploration.

31. The second network device (102, 306, 500) according to claim 30, wherein the first response comprises a timer indicating how long a user device (110, 308) is kept connected or expected to match with the state data.

32. The second network device (102, 306, 500) according to any of claims 28 - 29, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to : transmit a first response to the first network device (100, 302, 400) , the first response providing an indication to wait until at least one user device (110, 308) matching with the state data is available for exploration .

33. The second network device (102, 306, 500) according to claim 32, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to: determine that at least one user device (110, 308) matching with the state data is available for exploration; and transmit a second response to the first network device, the response indicating that at least one user device (110, 308) is available for exploration.

34. The second network device (102, 306, 500) according to claim 32, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to: transmit information comprising the state data to at least one user device; receive at least one response from at least one user device, the response indicating a match with the state data; and transmit a second response to the first network device, the response indicating that at least one user device is available for exploration.

35. The second network device (102, 306, 500) according to claim 30 - 34, wherein the first response comprises a subset of the resource configuration that can be allocated by the second network device (102, 306, 500) .

36. The second network device (102, 306, 500) according to any of claims 30 - 35, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to : receive a triggering message from the first network device (100, 302, 400) to initiate scheduling of uplink transmissions with at least one available user device (110, 308) , wherein the triggering message comprises an indication of one or more resource elements in a time and frequency domain on which to transmit.

37. The second network device (102, 306, 500) according to any of claims 36, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to : transmit a reply to the first network device (100.

400) indicating that one or more resource elements in a time and frequency domain cannot be allocated.

38. The second network device (102, 306, 500) according to any of claims 36 - 37, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to : schedule, based on the indication, uplink transmissions for at least one available user device (110, 308) .

39. The second network device (102, 306, 500) according to claim 38, wherein the at least one memory (504) and the computer program code (506) are configured to, with the at least one processor (502) , cause the second network device (102, 306, 500) at least to: instruct the at least one available user device (110, 308) to transmit duplicated data on the indicated one or more resource elements in a time and frequency domain .

40. The second network device (102, 306, 500) according to any of claims 25 - 39, wherein the resource comprises an exploration resource.

41. A method for wireless communication, comprising : obtaining (200) , by a first network device (100, 302, 400) , state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied; and transmitting (202) , by the first network device (100, 300, 302, 400, 600) , a resource request comprising the state data to at least one second network device (102, 306, 500) for the at least one second network device (102, 306, 500) to schedule, according to the resource configuration, uplink transmissions with at least one user device (110, 308) matching with the state data for providing interference conditions for at least one user other device (108, 304) .

42. A method for wireless communication, comprising : receiving, by a second network device (102, 306, 500) from a first network device (100, 300, 302, 400, 600) , a resource request comprising state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied, the resource request instructing the second network device (102, 306, 500) to schedule, according to the resource configuration, transmissions with at least one user device (110, 308) , associated with the second network device (102, 306, 500) , matching with the state data for providing interference conditions for at least one other user device (108, 304 ) .

43. A computer program comprising instructions for causing an apparatus to perform at least the following: obtaining, by a first network device (100, 300, 302, 400, 600) , state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied; and transmitting, by the first network device (100, 300, 302, 400, 600) , a resource request comprising the state data to at least one second network device (102, 306, 500) for the at least one second network device (102, 306, 500) to schedule, according to the resource configuration, uplink transmissions with at least one user device (110, 308) matching with the state data for providing interference conditions for at least one other user device (108, 304) .

44. A computer program comprising instructions for causing an apparatus to perform at least the following: receiving, by a second network device (102, 306, 500) from a first network device (100, 300, 302, 400, 600) , a resource request comprising state data defining at least one parameter associated with a user device for which a resource configuration associated with a resource is to be applied, the resource request instructing the second network device (102, 306, 500) to schedule, according to the resource configuration, transmissions with at least one user device (110, 308) , associated with the second network device (102, 306, 500) , matching with the state data for providing interference conditions for at least one other user device (108, 304 ) .