WO2022203589A1

WO2022203589A1 - Quality of experience measurements in a wireless communication network

Info

Publication number: WO2022203589A1
Application number: PCT/SE2022/050293
Authority: WO
Inventors: Luca LUNARDI; Johan Rune; Gunnar HEIKKILÄ; Filip BARAC; Angelo Centonza; Cecilia EKLÖF
Original assignee: Telefonaktiebolaget Lm Ericsson (Publ)
Priority date: 2021-03-26
Filing date: 2022-03-25
Publication date: 2022-09-29
Also published as: EP4315940A1

Abstract

A wireless communication device (12) receives, from a network node (20) in a wireless communication network (10), a measurement configuration (40) that defines configuration information for collecting quality of experience, QoE, measurements. The measurement configuration (40) indicates the QoE measurements are for a split test (30) of QoE, includes a test identity (31) identifying a test that is a target for the measurement configuration (40), and/or includes a test set identity (36A) or (36B) identifying a test set that is a target for the measurement configuration (40). The wireless communication device (12) alternatively or additionally transmits a measurement report (42) that reports QoE measurements and that includes a test identity (31) identifying a test for which the measurement report (42) reports QoE and/or a test set identity (36A) or (36B) identifying a test set for which the measurement report (42) reports QoE.

Description

QUALITY OF EXPERIENCE MEASUREMENTS IN A WIRELESS COMMUNICATION

NETWORK

TECHNICAL FIELD

The present application relates generally to a wireless communication network and relates more specifically to quality of experience measurements in such a network.

BACKGROUND

Quality of experience (QoE) is a measure of the end-to-end performance of a service, at the service level, from the perspective of a user of the service. For example, QoE may represent a measure of the delight or annoyance of a user’s experience with a service, such as web browsing, a phone call, or a video broadcast. QoE may thereby be appropriately measured by an application used for a service. Application-level QoE measurements may for instance include user-perceived latency, which reflects the amount of time that a user spends waiting for a user interface response from the application, e.g., web page loading time, post upload time, video streaming stall time, etc.

A wireless communication network can configure wireless communication devices to measure and report QoE to the network. Challenges exist, though, in analyzing and using those QoE measurement reports to improve QoE.

SUMMARY

Some embodiments herein enable split testing of quality of experience (QoE). For example, some embodiments herein enable QoE measurements to be configured and/or reported in such a way that the QoE measurements can be used for a split test of QoE.

Some embodiments for instance enable a wireless communication network to configure QoE measurements to be performed under the same control conditions (e.g., for the same service and during the same time period) but under different variations of a testing parameter (e.g., under different physical layer transmission configurations). Notably, the QoE measurements are reported to the network in such a way that the network is able to distinguish under which variation of the testing parameter the reported QoE measurements were performed. Each QoE measurement report may for instance include an identity associated with the variation under which the reported QoE measurements was performed, e.g., a test set identity that identifies a test set for that variation. With the QoE measurements configured and/or reported in this way, some embodiments enable the network to determine the impact of the testing parameter on QoE, e.g., since the network is able to compare QoE measurements that were performed under the same control conditions but under different variations of the testing parameter. Correspondingly, the network may advantageously adapt one or more parameters (e.g., physical layer transmission configurations) as needed to improve QoE.

More particularly, embodiments herein include a method performed by a wireless communication device configured for use in a wireless communication network. The method comprises receiving, from a network node in the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements. In some embodiments, the measurement configuration indicates the QoE measurements are for a split test of QoE. Additionally or alternatively, the measurement configuration includes a test identity identifying a test that is a target for the measurement configuration. Additionally or alternatively, the measurement configuration includes a test set identity identifying a test set that is a target for the measurement configuration.

In some embodiments, the measurement configuration indicates the QoE measurements are for a split test of QoE.

In some embodiments, the measurement configuration includes the test identity and/or the test set identity.

In some embodiments, the QoE measurements are for a split test of QoE under different variations of a testing parameter. In some embodiments, the test set identity identifies the test set for one of the different variations of the testing parameter.

In one or more of these embodiments involving different variations of the testing parameter, receiving the measurement configuration is performed as part of receiving multiple different measurement configurations that include different test set identities identifying different respective test sets for different respective variations of the testing parameter. In some embodiments, the different measurement configurations define configuration information for collecting QoE measurements at different times according to the different measurement configurations.

Alternatively or additionally, in one or more of the embodiments involving different variations of the testing parameter, the testing parameter comprises a network slice supporting an application or service, where different variations of the testing parameter comprise different network slices supporting the same application or service. Alternatively, the testing parameter comprises a network system supporting an application or service, where different variations of the testing parameter comprise different network systems supporting the same application or service. Alternatively, the testing parameter comprises a radio access technology via which an application or service is provided, where different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided. Alternatively, the testing parameter comprises an area in which an application or service is provided, where different variations of the testing parameter comprise different areas in which the same application or service is provided. Alternatively, the testing parameter comprises a scheduling priority according to which traffic of an application or service is scheduled, where different variations of the testing parameter comprise different scheduling priorities according to which traffic for the same application or service is scheduled.

In other embodiments involving different variations of the testing parameter, the testing parameter comprises an application or service, where different variations of the testing parameter comprise different applications or services such that the split test tests QoE for the different applications or services. Alternatively, the testing parameter comprises a set of applications or services that includes a target application or service, where different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test tests QoE for the different sets of applications or services.

In still other embodiments involving different variations of the testing parameter, the testing parameter comprises a wireless communication device radio access capability, where variations of the testing parameter comprise different values of the wireless communication device radio access capability. In one or more of these embodiments, the wireless communication device radio access capability is a maximum bandwidth capability, a maximum number of component carriers supported, a dual connectivity mode capability, or a handover type capability.

In yet other embodiments involving different variations of the testing parameter, the testing parameter comprises radio conditions under which an application or service is provided, where different variations of the testing parameter comprise different radio conditions under which the same application or service is provided. Alternatively, the testing parameter comprises a physical layer transmission configuration according to which transmissions for an application or service are made, where different variations of the testing parameter comprise different physical layer transmission configurations according to which transmissions for the same application or service are made.

In some embodiments, the method further comprises transmitting a measurement report that reports QoE measurements collected according to the configuration information.

In one or more of these embodiments, the measurement report includes the test identity and/or the test set identity.

In some embodiments, the method further comprises collecting the QoE measurements according to the measurement configuration. Other embodiments herein include a method performed by a network node configured for use in a wireless communication network. The method comprises transmitting, to a wireless communication device served by the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements. In some embodiments, the measurement configuration indicates the QoE measurements are for a split test of QoE. Additionally or alternatively, the measurement configuration includes a test identity identifying a test that is a target for the measurement configuration. Additionally or alternatively, the measurement configuration includes a test set identity identifying a test set that is a target for the measurement configuration.

In some embodiments, the measurement configuration is transmitted as part of configuring a split test of QoE under different variations of a testing parameter. In some embodiments, the test identity identifies the split test and/or the test set identity identifies a test set for a certain one of the different variations of the testing parameter.

In one or more of these embodiments, said transmitting is performed as part of transmitting, to the same wireless communication device or different wireless communication devices served by the wireless communication network, different measurement configurations that include different test set identities identifying test sets for different respective variations of the testing parameter. In one or more of these embodiments, the method comprises transmitting different ones of the measurement configurations to different wireless communication devices.

Alternatively, the method comprises transmitting different ones of the measurement configurations to the same wireless communication device, for collection of QoE measurements at different times according to the different measurement configurations.

In some embodiments, the method further comprises selecting one or more wireless communication devices to measure QoE for the split test. In one or more of these embodiments, said split test tests QoE under the same control conditions but under different variations of the testing parameter. In some embodiments, the one or more wireless communication devices are selected based on the control conditions and the testing parameter.

In some embodiments, the testing parameter comprises a network slice supporting an application or service, where different variations of the testing parameter comprise different network slices supporting the same application or service. Alternatively, the testing parameter comprises a network system supporting an application or service, where different variations of the testing parameter comprise different network systems supporting the same application or service. Alternatively, the testing parameter comprises a radio access technology via which an application or service is provided, where different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided. Alternatively, the testing parameter comprises an area in which an application or service is provided, where different variations of the testing parameter comprise different areas in which the same application or service is provided. Alternatively, the testing parameter comprises a scheduling priority according to which traffic of an application or service is scheduled, where different variations of the testing parameter comprise different scheduling priorities according to which traffic for the same application or service is scheduled.

In other embodiments, the testing parameter comprises an application or service, where different variations of the testing parameter comprise different applications or services such that the split test tests QoE for the different applications or services. Alternatively, the testing parameter comprises a set of applications or services that includes a target application or service, where different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test tests QoE for the different sets of applications or services.

In still other embodiments, the testing parameter comprises a wireless communication device radio access capability, where variations of the testing parameter comprise different values of the wireless communication device radio access capability. In one or more of these embodiments, the wireless communication device radio access capability is a maximum bandwidth capability, a maximum number of component carriers supported, a dual connectivity mode capability, or a handover type capability.

In yet other embodiments, the testing parameter comprises radio conditions under which an application or service is provided, where different variations of the testing parameter comprise different radio conditions under which the same application or service is provided. Alternatively, the testing parameter comprises a physical layer transmission configuration according to which transmissions for an application or service are made, where different variations of the testing parameter comprise different physical layer transmission configurations according to which transmissions for the same application or service are made.

In some embodiments, the method further comprises receiving the QoE measurements collected according to the configuration information. In one or more of these embodiments, the method further comprises evaluating the QoE measurements to determine an impact of a testing parameter on QoE. The method further comprises adapting one or more parameters in the wireless communication network based on said evaluating. In one or more of these embodiments, said receiving comprises receiving a measurement report that reports the QoE measurements collected according to the configuration information. In some embodiments, the measurement report includes the test identity and/or the test set identity.

Other embodiments herein include a wireless communication device configured for use in a wireless communication network. The wireless communication device is configured to receive, from a network node in the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements. In some embodiments, the measurement configuration indicates the QoE measurements are for a split test of QoE. Additionally or alternatively, the measurement configuration includes a test identity identifying a test that is a target for the measurement configuration. Additionally or alternatively, the measurement configuration includes a test set identity identifying a test set that is a target for the measurement configuration.

In some embodiments, the wireless communication device is configured to perform the steps described above for a wireless communication device.

Other embodiments herein include a network node configured for use in a wireless communication network. The network node is configured to transmit, to a wireless communication device served by the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements. In some embodiments, the measurement configuration indicates the QoE measurements are for a split test of QoE. Additionally or alternatively, the measurement configuration includes a test identity identifying a test that is a target for the measurement configuration. Additionally or alternatively, the measurement configuration includes a test set identity identifying a test set that is a target for the measurement configuration.

In some embodiments, the network node is configured to perform the steps described above for a network node.

Other embodiments herein include a computer program comprising instructions which, when executed by at least one processor of a wireless communication device, causes the wireless communication device to perform the steps described above for a wireless communication device. Other embodiments herein include a computer program comprising instructions which, when executed by at least one processor of a network node, causes the network node to perform the steps described above for a network node. In one or more of these embodiments, a carrier containing the computer program is one of an electronic signal, optical signal, radio signal, or computer readable storage medium.

Other embodiments herein include a wireless communication device configured for use in a wireless communication network. The wireless communication device comprises communication circuitry and processing circuitry. The processing circuitry is configured to receive, from a network node in the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements. In some embodiments, the measurement configuration indicates the QoE measurements are for a split test of QoE. Additionally or alternatively, the measurement configuration includes a test identity identifying a test that is a target for the measurement configuration. Additionally or alternatively, the measurement configuration includes a test set identity identifying a test set that is a target for the measurement configuration.

In some embodiments, the processing circuitry is configured to perform the steps described above for a wireless communication device.

Other embodiments herein include a network node configured for use in a wireless communication network. The network node comprises communication circuitry and processing circuitry. The processing circuitry is configured to transmit, to a wireless communication device served by the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements. In some embodiments, the measurement configuration indicates the QoE measurements are for a split test of QoE. Additionally or alternatively, the measurement configuration includes a test identity identifying a test that is a target for the measurement configuration. Additionally or alternatively, the measurement configuration includes a test set identity identifying a test set that is a target for the measurement configuration.

In some embodiments, the processing circuitry is configured to perform the steps described above for a network node.

Of course, the present invention is not limited to the above features and advantages. Indeed, those skilled in the art will recognize additional features and advantages upon reading the following detailed description, and upon viewing the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 is a block diagram of a wireless communication network according to some embodiments.

Figure 2 is a logic flow diagram of a method performed by a wireless communication device according to some embodiments. Figure 3 is a logic flow diagram of a method performed by a network node according to some embodiments.

Figure 4 is a logic flow diagram of a method performed by a network node according to other embodiments.

Figures 5A-5B show a logic flow diagram of a method performed by a wireless communication network according to some embodiments.

Figure 6 is a logic flow diagram of a method performed by a wireless terminal according to some embodiments.

Figure 7 is a block diagram of a wireless communication device according to some embodiments.

Figure 8 is a block diagram of a network node according to some embodiments.

Figure 9 is a call flow diagram for UE capability transfer according to some embodiments.

Figure 10 is a call flow diagram for application layer measurement reporting according to some embodiments.

Figure 11 is a block diagram of a wireless communication network according to some embodiments.

Figure 12 is a block diagram of a user equipment according to some embodiments.

Figure 13 is a block diagram of a virtualization environment according to some embodiments.

Figure 14 is a block diagram of a communication network with a host computer according to some embodiments.

Figure 15 is a block diagram of a host computer according to some embodiments.

Figure 16 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment.

Figure 17 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment.

Figure 18 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment.

Figure 19 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment.

DETAILED DESCRIPTION

Figure 1 shows a wireless communication network 10 according to some embodiments. The wireless communication network 10 provides wireless communication service to one or more wireless communication devices, one of which is shown as wireless communication device 12. Such wireless communication service may for instance be provided over a wireless interface 14. Regardless, the wireless communication service supports provision of an end-to-end service to a user of a wireless communication device.

As shown, for instance, an application server 18 provides an end-to-end service 16 at an application layer 12A of the wireless communication device 12, and the wireless communication network 10 supports provision of the end-to-end service 16 by facilitating communication between the application server 18 and the application layer 12A. Although shown as external to the wireless communication network 10, the application server 18 may nonetheless be internal to the wireless communication network 10 in other embodiments.

The wireless communication network 10 includes a network node 20 that configures the wireless communication device 12 to measure and report quality of experience (QoE). With respect to the end-to-end service 16 in Figure 1, for instance, QoE indicates the performance of the end-to-end service 16, at the service level, from the perspective of the device’s user. In some embodiments, for example, the network node 20 effectively configures the wireless communication device’s application layer 12A to measure and report one or more metrics at the application layer 12A that reflect the QoE for the end-to-end service 16, e.g., a web page loading time, a post upload time, a video streaming stall time, etc.

Notably, though, QoE measurements according to embodiments herein are configured and/or reported in such a way that the QoE measurements can be used for a split test 30 of QoE. As shown, the split test 30 tests QoE under the same control conditions 32 (e.g., for the same service and during the same time period) but under different variations 34A, 34B of a testing parameter (e.g., under different physical layer transmission configurations). A network node 20 in the wireless communication network 10 (perhaps in conjunction with one or more other network nodes in the wireless communication network 10) may configure this split test 30, e.g., so as to test QoE under the different variations 34A, 34B of the testing parameter.

Towards this end, in some embodiments, the split test 30 is assigned a test identity 31, e.g., to distinguish the split test 30 from other split tests that may have different control conditions or different testing parameters. Alternatively or additionally, the different variations 34A, 34B of the testing parameter are assigned respective identities (IDs) 36A and 36B.

Such IDs 36A and 36B may also be referred to as test set identities, e.g., whereby different QoE measurements associated with those variations may belong to different sets of QoE measurements for different respective variations 34A, 34B. In some embodiments, the network node 20 exploits the test ID 31 and/or the IDs 36A, 36B in the configuration and/or reporting of the QoE measurements, so that the network 10 is able to distinguish under which variation 34A, 34B of the testing parameter the reported QoE measurements were performed.

As shown, for example, in some embodiments, the network node 20 transmits a measurement configuration 40 to the wireless communication device 12, e.g., to a QoE measurement controller 44 of the wireless communication device 12. This measurement configuration 40 includes the test ID 31 so as to indicate that the measurement configuration 40 configures QoE measurements for a specific test ID, namely test ID 31 for split test 30. Alternatively or additionally, the measurement configuration 40 as shown includes an ID 36A or 36B (e.g., referred to as a test set ID) so as to indicate that the measurement configuration 40 configures QoE measurements for a specific test set ID, e.g., test set ID 36A associated with variation 34A of the testing parameter. In some embodiments where the QoE measurement controller 44 receives this measurement configuration 40, the QoE measurement controller 44 may correspondingly control the application layer 12A to collect the QoE measurements.

QoE measurements collected according to this measurement configuration 40 may accordingly be reported in association with the test ID 31 and/or the test set ID included in the measurement configuration 40. In some embodiments, then, the wireless communication device 12 transmits a measurement report 42 to the network node 20. The QoE measurement report 12 may for instance include an identity 36A or 36B associated with the variation 34A or 34B under which the reported QoE measurements was performed, e.g., a test set identity that identifies a test set for that variation. Alternatively or additionally, the QoE measurement report 12 may include the test ID 31 identifying the test (e.g., split test 30) that the reported QoE measurements target.

With the QoE measurements configured and/or reported in this way, some embodiments enable the network 10 to determine the impact of the testing parameter on QoE, e.g., since the network 10 is able to compare QoE measurements that were performed under the same control conditions 32 but under different variations 34A, 34B of the testing parameter. Correspondingly, the network 10 may advantageously adapt one or more parameters (e.g., physical layer transmission configurations) as needed to improve QoE.

Figure 2 depicts a method performed by a wireless communication device 12 configured for use in a wireless communication network 10 in accordance with particular embodiments. The method includes receiving, from a network node 20 in the wireless communication network 10, a measurement configuration 40 that defines configuration information for collecting quality of experience, QoE, measurements (Block 200). In some embodiments, the measurement configuration 40 indicates the QoE measurements are for a split test 30 of QoE. In other embodiments, the measurement configuration 40 alternatively or additionally includes a test identity 31 identifying a test that is a target for the measurement configuration 40. In still other embodiments, the measurement configuration 40 alternatively or additionally includes a test set identity 36A or 36B identifying a test set that is a target for the measurement configuration 40.

In some embodiments, the QoE measurements are for a split test 30 of QoE under different variations of a testing parameter. In some embodiments, the test set identity 36A or 36B identifies the test set for one of the different variations of the testing parameter.

In one or more of these embodiments involving different variations of the testing parameter, receiving the measurement configuration is performed as part of receiving multiple different measurement configurations 40 that include different test set identities 36A or 36B identifying different respective test sets for different respective variations of the testing parameter. In some embodiments, the different measurement configurations 40 define configuration information for collecting QoE measurements at different times according to the different measurement configurations 40.

In other embodiments involving different variations of the testing parameter, the testing parameter comprises an application or service, where different variations of the testing parameter comprise different applications or services such that the split test 30 tests QoE for the different applications or services. Alternatively, the testing parameter comprises a set of applications or services that includes a target application or service, where different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test 30 tests QoE for the different sets of applications or services.

In some embodiments, the network node 20 is in a core network of the wireless communication network 10.

In some embodiments, the network node 20 is an operations, administration, and maintenance node for the wireless communication network 10.

In some embodiments, the network node 20 is in a radio access network of the wireless communication network 10.

In some embodiments, the network node 20 implements a Trace Collector Entity, TCE, for the wireless communication network 10.

Regardless, in some embodiments, the method includes collecting the QoE measurements according to the measurement configuration 40 (Block 210).

The method may alternatively or additionally comprise transmitting a measurement report 42 that reports QoE measurements collected according to the configuration information (Block 220). For example, in some embodiments, the measurement report 42 includes (i) a test identity 31 identifying a test for which the measurement report 42 reports QoE; and/or (ii) a test set identity 36A or 36B identifying a test set for which the measurement report 42 reports QoE. Generally, then, in some embodiments, a method performed by a wireless communication device 12 herein may comprise transmitting, to a network node 20, a measurement report 42 that reports quality of experience, QoE, measured by a wireless communication device 12 and that includes (i) a test identity 31 identifying a test 30 for which the measurement report 42 reports QoE; and/or (ii) a test set identity 36A or 36B identifying a test set for which the measurement report 42 reports QoE.

In some embodiments, the test set identity 36A or 36B identifies a test set for one of different variations of a testing parameter for a split test 30 of QoE. Additionally or alternatively, in some embodiments the test identity 31 identifies a split test 30 of QoE for which the measurement report 42 reports QoE.

In some embodiments, the test set identity 36A or 36B is a first test set identity identifying a first test set for a first one of the different variations of the testing parameter. In some embodiments, the method further comprises transmitting a second measurement report 42 that reports QoE measured by the wireless communication device 12 and that includes a second test set identity identifying a second test set for a second one of the different variations of the testing parameter.

Figure 3 depicts a method performed by a network node 20 configured for use in a wireless communication network 10 in accordance with other particular embodiments. The method may comprise transmitting, to a wireless communication device 12 served by the wireless communication network 10, a measurement configuration 40 that defines configuration information for collecting quality of experience, QoE, measurements (Block 320). In some embodiments, the measurement configuration 40 indicates the QoE measurements are for a split test 30 of QoE. In other embodiments, the measurement configuration 40 alternatively or additionally includes a test identity 31 identifying a test 30 that is a target for the measurement configuration 40 and/or includes a test set identity 36A or 36B identifying a test set that is a target for the measurement configuration 40.

If the QoE measurement are for a split test 30 of QoE, the method as shown may also comprise deciding the testing parameter for the split test 30 and/or deciding the variations 34A, 36B of the testing parameter for the split test 30 (Block 300). Alternatively or additionally, the method may comprise selecting one or more wireless communication devices to measure QoE for the split test 30 (Block 310).

Regardless, in some embodiments, the method comprises receiving the QoE measurements collected according to the configuration information (Block 330). This may involve for instance receiving a measurement report 42 from the wireless communication device 12 reporting the collected QoE measurements.

In one or more embodiments, the method also comprises evaluating the QoE measurements to determine an impact of a testing parameter on QoE (Block 340) and/or adapting one or more parameters in the wireless communication network 10 based on said evaluating (Block 350).

Other methods disclosed generally herein include the method shown in Figure 4. The method is performed by a network node configured for use in a wireless communication network. The method comprises configuring a split test of quality of experience, QoE, under different variations of a testing parameter (Block 420).

In other embodiments, the testing parameter comprises an application or service, where different variations of the testing parameter comprise different applications or services such that the split test 30 tests QoE for the different applications or services. Alternatively, the testing parameter comprises a set of applications or services that includes a target application or service, where different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test 30 tests QoE for the different sets of applications or services.

In some embodiments, this configuring comprises assigning different test set identifiers to different test sets for testing QoE under respective variations of the testing parameter (Block 420A) and configuring the different test sets as identified by the assigned test set identifiers (Block 420B). In one embodiment, for example, configuring the different test sets comprises, for each of the test sets, transmitting a measurement configuration that includes the respective test set identity assigned to the test set and that defines configuration information for collecting QoE measurements which measure QoE under the respective variation of the testing parameter (Block 420B-1). For instance, the network node may transmit different ones of the measurement configurations to different wireless communication devices. Or, the network node may transmit different ones of the measurement configurations to the same wireless communication device, for collection of QoE measurements at different times according to the different measurement configurations.

Generally, then, configuring the split test in some embodiments may comprise configuring a first group of one or more wireless communication devices to test QoE under a first variation of the testing parameter and a second group of one or more wireless communication devices to test QoE under a second variation of the testing parameter. In other embodiments, configuring the split test may comprise configuring the same wireless communication device to test QoE, during a first time interval, under a first variation of the testing parameter and to test QoE, during a second time interval, under a second variation of the testing parameter.

As another generalization, the method in some embodiments may comprise transmitting, to a wireless communication device served by the wireless communication network, a measurement configuration that defines configuration information for collecting QoE measurements which measure QoE under one of the different variations of the testing parameter. In one embodiment, the measurement configuration indicates the QoE measurements are for the split test of QoE, includes a test identity identifying the split test, and/or includes a test set identity identifying a test set for one of the different variations of the testing parameter.

Regardless, in some embodiments, the method also comprises deciding the testing parameter for the split test and/or deciding the variations of the testing parameter for the split test (Block 400). In this case, said configuring in Block 420 is performed according to said deciding.

Alternatively or additionally, the method may further comprise selecting one or more wireless communication devices to measure QoE for the split test (Block 410). For example, in embodiments wherein the split test tests QoE under the same control conditions but under different variations of the testing parameter, the one or more wireless communication devices may be selected based on the control conditions and the testing parameter.

In any event, the method in some embodiments alternatively or additionally comprises receiving QoE measurements that measure QoE under the different variations of the test parameter for said split test (Block 430). In this case, the method may further comprise evaluating the QoE measurements to determine an impact of the testing parameter on QoE (Block 440). The method may also further comprise adapting one or more parameters in the wireless communication network based on said evaluating (Block 450).

In some embodiments, the network node is in a core network of the wireless communication network. In other embodiments, the network node is an operations, administration, and maintenance node for the wireless communication network. In still other embodiments, the network node implements a Trace Collector Entity, TCE, for the wireless communication network.

In yet other embodiments, the network node is in a radio access network of the wireless communication network. In one such embodiment, the method may further comprise receiving, from another network node, configuration information according to which the split test is to be configured. In this case, configuring the split test may comprise configuring the split test according to the configuration information. In one embodiment, the configuration information configures one or more parameters of the split test, where the one or more parameters comprise one or more of: the testing parameter; the variations of the testing parameter; a type of service or application for which the split test is applicable; a network slice for which the split test is applicable; a radio access technology for which the split test is applicable; groups of wireless communication devices to measure QoE under different respective variations of the testing parameter; a geographical area over which the split test is to be performed; a duration or time period over which the split test is to be performed; and one or more QoE measurement configurations that configure QoE measurements for the split test. Alternatively or additionally, the configuration information includes identities respectively assigned to different test sets that test QoE under the different variations of the testing parameter.

Although not shown, in other embodiments, configuring the split test may comprise transmitting configuration information for the split test to another network node in the wireless communication network and/or to one or more wireless communication devices that are to measure QoE for the split test. In one such embodiment, the configuration information configures one or more parameters of the split test, where the one or more parameters comprise one or more of: the testing parameter; the variations of the testing parameter; a type of service or application for which the split test is applicable; a network slice for which the split test is applicable; a radio access technology for which the split test is applicable; groups of wireless communication devices to measure QoE under different respective variations of the testing parameter; a geographical area over which the split test is to be performed; a duration or time period over which the split test is to be performed; and one or more QoE measurement configurations that configure QoE measurements for the split test. Alternatively or additionally, transmitting the configuration information may comprise transmitting the configuration information for the split test to a radio network node in the wireless communication network. Alternatively or additionally, the configuration information includes identities respectively assigned to different test tests for testing QoE under the different variations of the testing parameter.

These and other embodiments herein generally enable support of A/B testing methodology for QoE measurements.

For example, in some embodiments, A/B testing methodology can be applied to collect QoE measurements from different sets of wireless terminals executing the same application of the same service type or service sub-type, when a parameter (or multiple parameters) affecting the service or application is (are) configured with different values among the different sets of wireless terminals. In other embodiments, A/B testing methodology can be applied to collect QoE measurements from the same wireless terminal executing the same application of the same service type or service sub-type, where a parameter (or multiple parameters) affecting the service or application has (have) different value(s) for different time instances of usage of the service.

A/B testing can be conducted also to compare the behavior associated to one application or service type when used concurrently with other applications or service types.

One advantage of some embodiments herein is the reduced effort (in terms of time and resources) required to detect the impact of a specific factor or parameter on QoE. Such advantage can be used for different use cases, for example: (i) troubleshooting QoE degradation (at the radio access network, RAN, level or operations and maintenance, OAM, level); (ii) evaluating new applications or new service types; (iii) understanding how an application performs when mapped to different slices; and (iv) comparing the QoE performance for wireless terminals with different capabilities.

Generally, other embodiments herein include methods to enable A/B testing when QoE measurements are collected. The methods may apply to both signaling-based QoE and management-based QoE configurations. In some embodiments, a first RAN node receives a QoE measurement configuration from another entity (e.g., from OAM, a 5GC node or a second RAN node) comprising parameters to be used for A/B testing purposes. Alternatively, the first RAN node can prepare a QoE measurement configuration comprising the parameters, or complement a QoE measurement configuration received from another entity with the additional configuration parameters to be used for A/B testing purposes.

In some embodiments, the A/B testing pertains to one application for which QoE measurements are of interest. The application is mapped to one service type or potentially one service subtype of a service type.

The first RAN node can configure at least two sets of wireless terminals with the same QoE measurement configuration. In this case, the sets of wireless terminals can be differentiated based on at least one configuration parameter pertaining to the service realization or system configuration, e.g., user equipment (UE) capabilities (e.g., Carrier Aggregation, Voice over New Radio, VoNR, support), dual connectivity mode (e.g., EN-DC, NR-DC, NE-DC), scheduling priority, handover thresholds or handover type (e.g., DAPS, Conditional Handover), PDU Session to S-NSSAI mapping, etc. Here, EN-DC stands for E- UTRAN New Radio (NR) Dual Connectivity (DC), NR-DC stands for NR Dual Connectivity, NE-DC stands for NR E-UTRAN DC, DAPS stands for Dual Active Protocol Stack, PDU stands for Protocol Data Unit, and S-NSSAI stands for Single Network Slice Selection Assistance Information.

In another embodiment, the first RAN node can configure at least two sets of wireless terminals with different QoE measurement configurations for the same application. QoE measurement configurations for the different A/B testing alternatives can be differentiated based on QoE specific settings within the QoE configuration.

In other embodiments, the first RAN node can configure the same wireless terminal using the same UE capabilities and the same QoE measurement configuration at different times of the day. Or, in yet other embodiments, the first RAN node can configure the same wireless terminal using different UE capabilities and the same QoE measurement configuration at different times of the day.

If multiple wireless terminals are used, each set of wireless terminals may be associated to a “set identifier” that uniquely identifies the group of wireless terminals associated to a specific value of the test parameter (corresponding to set “A”, “B”, “C”, ...), within the entire set of wireless terminals used for A/B testing. On the other hand, if the same wireless terminal is used, the “set identifier” uniquely identifies the set (“A”, “B”, “C”, ...) to which the QoE measurements collected from the wireless terminal pertains to during different time instances. In some embodiments, the first RAN node receives QoE reports for the different sets, including the “set identifier” to which the QoE reports are associated to. If the first RAN node can read the content of the QoE reports, it can do so and compares the QoE reports received for the different sets. In other embodiments, the first RAN node forwards the QoE reports to the MCE for further analysis.

Note in this regard that different options are possible for the collection of A/B testing for QoE. One option is to configure QoE measurements for two or more Lies utilizing the same application/service but for which a limited set of characteristics (e.g., capabilities, configurations) are different between Lies. This way of configuring QoE A/B testing can be referred to as “parallel testing”. Another option is to configure a QoE measurement for one or more Lies in a way that the measurement is repeated at least twice for the same UE.

Namely, the measurement concerns a specific application/service and it is collected for a configured time duration. In a first iteration of the measurement collection, the UE collects QoE measurements while running a certain configuration or while being in a specific radio condition, or in general while being in a specific service utilization context. In a second iteration of the measurement collection, the same UE is using the same application/service but at least one factor (e.g., related to radio conditions, or related to the UE configuration, or related to network load) has changed with respect to the context concerning the first measurement. This way of configuring QoE A/B testing can be referred to as “serial testing”. Yet another option is to use both serial and parallel testing together.

In some methods described, if the RAN is able to decode the QoE measurement reports, the RAN is able to associate each A/B testing QoE report with the condition of the UE reporting (e.g., UE capabilities, radio conditions, UE configuration, network load) and determine which of the UE conditions differentiating Ues or UE measurement contexts affects QoE the most. This information is very useful to allow the RAN to determine which are the configurations, radio conditions, or UE capabilities, or network load that positively or negatively affect QoE. Hence, the RAN may attempt in the future to resemble for a given UE the conditions that produce a maximization of QoE or avoid QoE degradation.

In another embodiment, the QoE reports may be signalled to the Trace Collection Entity (TCE). The RAN can in this case signal to the TCE the parameters that differentiate the QoE measurement process in the A/B testing process. For example, if two sets of Lies were configured with QoE measurements and if these two sets of Lies have in common the same capabilities, the same radio conditions, the same configuration, but the two sets of Lies use different modulation and coding schemes, the RAN shall signal such differentiating factor (i.e. , the modulation and coding scheme used by each UE group) to the TCE, to allow the TCE to determine which of such differentiating factors has an impact (positive or negative) on the QoE. This is advantageous, because it allows the TCE to determine which UE configuration can maximize QoE. The TCE could export this information to other systems that have an influence on how to choose a configuration for the UE.

Figures 5A-5B and Figure 6 generally describe methods performed according to some embodiments herein. In one or more such embodiments, the wireless communication device 12 in Figure 1 may be exemplified as the UE or wireless terminal, and the network node 20 in Figure 1 may be exemplified as a (first) RAN node, a CN node, an OAM node, a TCE, or node that performs functionality described as being on the network-side.

Consider additional details in this regard of some embodiments related to a first RAN node.

In one embodiment, the first RAN node receives from a second entity (e.g., from OAM, a 5GC node or a second RAN node), at least one of: a QoE measurement configuration pertaining to one and only one application, the application being mapped to one and only one service type or to one and only one service subtype of a service type. In a variant, QoE measurement configurations for the different A/B testing alternatives can be differentiated based on QoE specific settings within the QoE configuration. In another variant, the first RAN node prepares the QoE measurement configuration. In another variant, the first RAN node complements the received QoE measurement by a testing parameter to be used for A/B testing purpose. an indication, indicating that the QoE measurements are collected for A/B testing purposes an indication, indicating the number of or the percentage of wireless terminals to use for A/B testing purposes a pointer or an index, to uniquely identify the A/B test for which QoE measurements are to be collected a list of pointers or a list of indexes, each pointer or index uniquely identifying one of the plurality of A/B test alternatives (“A”, “B”, “C”, ...) the number of distinct sets (or groups of wireless terminals) to be used for the test a duration for the A/B testing measurement (indicated as a time window within which measurements could be collected, or in terms of number of measurements that should be collected) an indication of whether the A/B testing should be performed as serial or as parallel, or an indication that both options can be used an indication of the exact values (or range of values) for the different instances of the differentiating parameter in the A/B testing an indication of the delta between values for the different instances of the differentiating parameter in the A/B testing an indication of the area for which the A/B testing is applicable an indication of the Single Network Slice Selection Assistance Information (S-

NSSAI(s)) for which the A/B testing is applicable an indication of the radio access technologies (RAT(s)) for which the A/B testing is applicable an indication of an Application ID for which the A/B testing is applicable any combination of the above.

In another embodiment, the first RAN node receives from a second entity (e.g., from OAM, a 5GC node or a second RAN node) a testing parameter to be used as distinctive criterion between A/B testing alternatives.

The testing parameter may be received from OAM or 5GC or another RAN node together with or as part of the QoE configuration.

As an example, the first RAN node can receive from OAM, in a format that is understandable by the RAN node, a list of distinct S-NSSAIs to which one application to be monitored can be mapped. The S-NSSAI is used as criterion to distinguish between A/B testing alternatives. So, for example, a first testing alternative will group QoE reports from wireless terminals for which the application is mapped to the first S-NSSAI value, and a second testing alternative will group QoE reports from wireless terminals for which the same application is mapped to the second S-NSSAI value.

Similarly, in another example of management-based QoE, the first RAN node may receive from OAM the indication of an area scope consisting of a list of cells or Tracking Areas where the QoE measurements should be collected, and the object “cell” or “Tracking Area” is used as distinctive criterion between A/B testing alternatives.

In another example, the first RAN node can receive from OAM, in a format that is understandable by the RAN node, the indication of using a differentiating parameter that is the scheduling priority. Such indication may be given together with exact scheduling priority values to be used to select Lies for the A/B testing process, or is may be given with a delta value, which is the gap between the scheduling priority levels to select Lies for the A/B testing process.

In another example, the first RAN node can receive from OAM, in a format that is understandable by the RAN node, the indication of using a differentiating parameter that is the RAT or the network system (EPS, 5GS).

In another example, the first RAN node can receive from OAM, in a format that is understandable by the RAN node, the indication of using a differentiating parameter that is the Application ID.

In other embodiments, the testing parameter can be received independently of the QoE configuration. For example, the first RAN node can receive from 5GC (e.g., at PDU Session Setup or PDU Session Modification), a value of S-NSSAI towards which the PDU Session is mapped. The S-NSSAI value can be used to assign wireless terminal and corresponding QoE reports to different A/B testing alternatives.

In another embodiment, the first RAN node independently selects the testing parameter to be used as distinctive criterion between A/B testing alternatives. Non-limiting examples of alternatives for such testing parameter are: (i) one of the UE radio access capabilities, e.g.: the maximum supported bandwidth in uplink (UL) or (DL), the maximum number of component carriers in UL or DL, the support for VoNR, the supported dual connectivity mode (e.g., EN-DC, NR-DC, NE-DC), the supported handover types (e.g., intra frequency or inter-frequency DAPS, Conditional Handover); (ii) scheduling priority; (iii) RAT (e.g., EUTRA, NR); (iv) network system (e.g., EPS, 5GS); and/or (v) application identifier.

In another embodiment, the first RAN node constructs at least one of: (i) a pointer or an index, to uniquely identify the A/B test; (ii) a list of pointers or a list of indexes, each pointer or index uniquely identifying one of the pluralities of A/B test alternatives (“A”, “B”,

“C”, ...); and/or (iii) a list of alternative sets (or groups).

In another embodiment, the first RAN node identifies at least two sets to be used for A/B testing, based on at least two distinct values of the testing parameter.

In another embodiment, at a given instance in time, the first RAN node assigns a wireless terminal, to be configured for QoE measurements, to one and only one of the A/B testing alternatives, based on the distinct values of the testing parameter. If more than one wireless terminal is assigned to one A/B testing alternative, the A/B testing can be conducted at the same time or not. If serial A/B testing is conducted to compare QoE measurements collected from the same wireless terminal at different times, the same wireless terminal is assigned to distinct A/B testing alternatives based on the testing parameter at different times.

In another embodiment, the first RAN node configures a wireless terminal for QoE measurements and signals to the wireless terminal at least one of: a pointer or an index, to uniquely identify the A/B test a pointer or an index, to uniquely identify the A/B test alternatives to which the wireless terminal is assigned (“A”, “B”, “C”, ...) an indication of whether the A/B testing is in serial or parallel an indication of delta for the testing an indication of the duration of the QoE measurements an indication of the service type or sub-service type which the A/B testing is for an indication of the area which the A/B testing is for an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

In another embodiment, A/B testing can be conducted to compare QoE measurements when a first, common application or service type is concurrently executed with other applications or service types. In this case, the A/B testing alternatives are distinguished based on the distinct applications concurrently executed with the common application.

As a non-limiting example, three applications (Application^, Application_2, Application_3) are considered, and the plurality of A/B testing alternatives consists of the following. In Alternative A, a set of wireless terminals executing both Application^ and Application_2 executed and for which QoE measurements are collected for both Application^ and Application_2. In Alternative B, a set of wireless terminals executing both Application^ and Application_3 executed and for which QoE measurements are collected for both Application^ and Application_3.

Note that, in this case, the very same wireless terminal can be dynamically assigned to different A/B testing alternatives, depending on the application or service type being executed at a given moment in time. Or a certain wireless terminal previously assigned to one of the A/B testing alternatives can be excluded from the test when one or all the applications pertaining to the A/B test is (are) stopped.

The above description is valid in case the plurality of A/B testing alternatives includes more than two alternatives. The first RAN node can append to the QoE report received from the wireless terminal, the information about the values of the testing parameter used in sets A and B, and forwards this information together with the QoE report(s) to the MCE.

In the latter case, the RAN may also send to the MCE measurement report identifiers that allow the MCE to understand that the measurement reports are part of an A/B testing. Consider now some embodiments related to a wireless terminal.

In one embodiment, a wireless terminal is configured by the first RAN node for QoE measurement, and together with or as part of the QoE measurement configuration, it receives at least one of: an indication, indicating that the QoE measurements are collected for A/B testing purposes a pointer or an index that uniquely identifies the A/B test a pointer or an index that uniquely identifies the A/B test alternative to which the wireless terminal is assigned (“A”, “B”, “C”, ...) the set (group or alternative) to which the wireless terminal is assigned an indication of whether the A/B testing is in serial or parallel. In case the process is serial, the UE understands that two instances of the same measurement need to be taken, where each instance of the measurement needs to be taken while a differentiating parameter for the A/B process is set to a specific value or to different ranges of values an indication of the delta between values for the different instances of the differentiating parameter in the A/B testing. This indication could comprise a set of parameters with different values for the A/B testing an indication of the duration of the QoE measurements to be taken. Such duration can be expressed in terms of a time window within which measurements could be collected, or in terms of number of measurements that should be collected an indication of the service type or sub-service type with the A/B testing is relevant for, e.g., only for a certain application. This indication may be configured together with other information such as e.g., a time window or serial indication. If e.g., a configuration of A/B testing for a service type together with a serial indication is made, the UE understands that the testing is to be done for a certain application, for two sessions run in serial. The difference compared to the existing service type is that in this case the service type is indicated specifically for the A/B-testing. The UE may at the same time be configured with QoE measurements for other service types which are not subject to A/B testing an indication of the area for the A/B testing. The difference compared to the existing service type is that in this case the area is indicated specifically for the A/B-testing. The UE may at the same time be configured with QoE measurements with different area scope and which are not subject to A/B testing an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

In another embodiment, the Access Stratum of the wireless terminal sends to the application layer commands (such as AT command “Application level measurement configuration” or alike), to control the application level measurement configuration, comprising QoE measurement configuration and one of: an indication, indicating that the QoE measurements are collected for A/B testing purposes an identifier such as a pointer or an index identifying the A/B test an identifier such as a pointer or an index identifying the A/B test alternative an indication of whether the A/B testing is in serial or parallel an indication of delta for the testing an indication of the duration of the QoE measurements an indication of the service type or sub-service type which the A/B testing is for an indication of the area which the A/B testing is for an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

In another embodiment, the Access Stratum of the wireless terminal receives from the application layer commands (such as AT command “Application level measurement report” or alike) providing application level measurement reports, comprising the QoE measurement report and one of: an indication, indicating that the QoE measurements are collected for A/B testing purposes an identifier such as a pointer or an index identifying the A/B test an identifier such as a pointer or an index identifying the A/B test alternative an indication of whether the A/B testing is in serial or parallel an indication of delta for the testing an indication of the duration of the QoE measurements an indication of the service type or sub-service type which the A/B testing is for an indication of the area which the A/B testing is for an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

In one embodiment, the wireless terminal sends to the first RAN node QoE measurement reports and together and/or within the QoE reports it includes at least one of: an indication, indicating that the QoE measurements reports refer to A/B testing an identifier such as a pointer or an index identifying the A/B test to which the QoE report relates an identifier such as a pointer or an index identifying the A/B test alternative to which the QoE report relates an indication of whether the A/B testing is in serial or parallel an indication of delta for the testing an indication of the duration of the QoE measurements an indication of the service type or sub-service type which the A/B testing is for an indication of the area which the A/B testing is for an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

Consider now some embodiments related to the application layer.

In one embodiment, the application layer of receives from the Access Stratum of the wireless terminal commands (such as AT command “Application level measurement configuration” or alike), to control the application level measurement configuration, comprising QoE measurement configuration and one of: an indication, indicating that the QoE measurements are collected for A/B testing purposes an identifier such as a pointer or an index identifying the A/B test an identifier such as a pointer or an index identifying the A/B test alternative an indication of whether the A/B testing is in serial or parallel an indication of delta for the testing an indication of the duration of the QoE measurements an indication of the service type or sub-service type which the A/B testing is for an indication of the area which the A/B testing is for an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

In another embodiment, the application layer sends to the Access Stratum of the wireless terminal commands (such as AT command “Application level measurement report” or alike) providing application level measurement reports, comprising the QoE measurement report and one of: an indication, indicating that the QoE measurements reports refer to A/B testing an identifier such as a pointer or an index identifying the A/B test an identifier such as a pointer or an index identifying the A/B test alternative an indication of whether the A/B testing is in serial or parallel an indication of delta for the testing an indication of the duration of the QoE measurements an indication of the service type or sub-service type which the A/B testing is for an indication of the area which the A/B testing is for an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

Consider now some embodiments related to ensuring a meaningful comparison between testing alternatives.

In order for an A/B testing to be meaningful, it is necessary to ensure a fair comparison of the test alternatives (A, B, C, ...). As a non-limiting example, this can be achieved by choosing for each one of the sets “A”, “B”, “C”, ..., wireless terminals that operate in similar conditions. As non-limiting examples, the RAN node or the OAM may choose for the sets A, B, C, ..., the wireless terminals:

• Running simultaneously an application, e.g., an MBS session (e.g., streaming the same sports event)

• Running services with similar (preferably identical) traffic characteristics

• Located in approximately the same geographical area

• Being subject to similar radio conditions

• Exhibit similar mobility behavior (e.g., wireless terminals onboard a moving train)

• Having the same UE radio capabilities, or at least the same radio capabilities relevant for the test (e.g., if the test is conducted in an area where no carrier on FR2 is present, the support for FR2 is not relevant)

• Having the same mapping between the same application and the same S-NSSAI

• Are equally distributed among the test alternatives

Consider next some embodiments related to the TCE.

This set of embodiments applies in general to the OAM system. Namely, they apply to the TCE, however it is understood that the TCE can share its knowledge and analysis with the OAM system, hence making the OAM system aware of the results from the A/B testing.

In one embodiment, the TCE signals to the first RAN node, at least one of: a QoE measurement configuration pertaining to one and only one application, the application being mapped to one and only one service type or to one and only one service subtype of a service type an indication, indicating that the QoE measurements are collected for A/B testing purposes an indication, indicating the number of or the percentage of wireless terminals to use for A/B testing purposes a pointer or an index, to uniquely identify the A/B test for which QoE measurements are to be collected a list of pointers or a list of indexes, each pointer or index uniquely identifying one of the plurality of A/B test alternatives (“A”, “B”, “C”, ...) number of alternative sets a duration for the A/B testing measurement an indication of whether the A/B testing should be performed as serial or as parallel, or an indication that both options can be used an indication of the exact values (or range of values) for the different instances of the differentiating parameter in the A/B testing an indication of the delta between values for the different instances of the differentiating parameter in the A/B testing an indication of the area(s) where the A/B testing was performed an indication of the RATs to which the A/B testing refers an indication of the network systems to which the A/B testing refers an indication of the application identifier to which the A/B testing refers an indication of the S-NSSAI to which the A/B testing refers any combination of the above.

In another embodiment, the TCE signals to the first RAN node a testing parameter to be used as distinctive criterion between A/B testing alternatives.

As an example, the OAM can signal to the first RAN node, in a format that is understandable by the RAN node, a list of distinct S-NSSAIs to which one application to be monitored can be mapped to. The S-NSSAI is used as criterion to distinguish between A/B testing alternatives. So, for example, a first testing alternative will group QoE reports from wireless terminals for which the application is mapped to the first S-NSSAI value; a second testing alternative will group QoE reports from wireless terminals for which the same application is mapped to the second S-NSSAI value.

Similarly, in another example of management-based QoE, the OAM can signal to the first RAN node the indication of an area scope consisting of a list of cells or Tracking Areas where the QoE measurements should be collected, and the object “cell” or “Tracking Area” is used as distinctive criterion between A/B testing alternatives.

In another example, the OAM can signal to the first RAN node, in a format that is understandable by the RAN node, the indication of using a differentiating parameter that is the scheduling priority. Such indication may be given together with exact scheduling priority values to be used to select Ues for the A/B testing process, or is may be given with a delta value, which is the gap between the scheduling priority levels to select Ues for the A/B testing process.

In another example, the OAM can signal to the first RAN node, in a format that is understandable by the RAN node, the indication of using a differentiating parameter that is the RAT, or the network system, or the application identifier. The TCE may receive from the first RAN node QoE measurement reports associated with measurement identifiers that allow the TCE to deduce that the measurements belong to the same A/B testing process. Additionally, and optionally, one or more of the parameters below may be received from the RAN:

The one or more differentiating parameter and its values used for the A/B testing. As an example, this could be UE capabilities, radio conditions, UE configurations.

- An indication, indicating that the QoE measurements reports refer to A/B testing.

Information on whether the process has been conducted in a serial or in a parallel way.

The application and/or service for which the A/B testing was carried out.

The RAT and/or the network system for which A/B testing was carried out.

Indications of whether the measurements collected were subject to factors that might have polluted the measurements, e.g., radio interference, limiting UE capabilities.

In view of the above modifications and variations, then, in some embodiments, a QoE measurements configuration is prepared, which comprises or is complemented with testing parameter(s) and additional indications pertaining to A/B testing. The testing parameter(s) may also be independent from the QoE configuration.

In a parallel testing approach, at least two Ues are involved, and the Ues are assigned to distinct groups, one group corresponding to one set of the test (A, B, C, ...). The wireless terminals are configured for QoE measurements and the configuration sent to one individual UE is associated to only one of the sets of the A/B testing.

In a serial testing approach, the sets of the tests (A, B, C, ...) can target multiple terminals or the same wireless terminal. In the latter case, the same UE receives separate configurations over time for the sets included in the test, and each configuration sent to the UE is associated with only one of the sets of the A/B testing.

The parallel testing approach and the serial testing approach can be combined, provided that at any given moment in time, the configuration provided to one UE is associated to one and only one of the sets (A, B, C, ...) of the A/B testing.

In some embodiments, the wireless terminals are mapped to testing alternatives (A,

B, C,..) based on criteria that ensure a fair comparison, e.g., running the same application at the same time, running services with identical (or similar) traffic characteristics, being located in the same area or being subject to similar radio conditions, etc.

If a RAN node is able to decode the results of A/B testing for QoE, the RAN node can perform optimization based on the received information.

In some embodiments, if the QoE reports are signaled to a TCE, the RAN can signal to the TCE parameters that differentiate the QoE measurement process in the A/B testing (e.g., UE capabilities, radio conditions, etc.)

In some embodiments, a first RAN node can receive from a second entity (e.g.,

OAM, 5GC, or a second RAN node), QoE configuration related information, comprising or complemented by various indications pertaining A/B testing (e.g., which test should be conducted, the number of groups to be used, the testing parameter and its value or range of values, other parameters to filter the scope of the test - e.g., slices, RAT, application identifier, etc.).

In some embodiments, the first RAN node can receive the testing parameter together with the QoE configuration, or as part of the QoE configuration, or independently of the QoE configuration, or independently selects the testing parameter.

In some embodiments, the first RAN node uniquely identifies the A/B test and the constituting sets (or groups, or alternatives) and at a given moment in time assigns a wireless terminal to one and only one of the A/B testing alternatives, based on the testing parameter.

If more than one UE is assigned to one A/B testing alternative, the test can be conducted at the same time or not.

If serial A/B testing is conducted to compare QoE measurements collected from the same wireless terminal at different times, the same wireless terminal is assigned to distinct A/B testing alternatives based on the testing parameter at different times.

In some embodiments, the first RAN node configures the wireless terminal(s) for QoE measurements and signals to the UE(s) the parameters pertaining to the A/B testing (e.g., the identifier of the A/B test, the service type, the duration of the data collection, the area of interest, etc.).

At the wireless terminal side, the UE is configured by the first RAN node for QoE measurements, and, together with or as part of the QoE configuration, it receives parameters pertaining to the A/B testing.

The Access Stratum (AS) of the wireless terminal can send to the Application Layer of the UE, commands (such as AT command or alike) to control the application level measurement configuration, comprising A/B testing related parameters.

The Access Stratum (AS) of the wireless terminal can receive from the Application Layer of the UE, commands (such as AT command or alike) QoE report, comprising A/B testing related parameters.

The Access Stratum (AS) of the wireless terminal can send to the first RAN node the QoE report, and, together with said report or within said report, include A/B testing related information. The application layer of the UE can receive command controlling QoE measurement, comprising A/B testing parameters, and return to the AS of the UE QoE reports complemented with A/B testing related information.

Regarding the TCE, it can signal to the first RAN node QoE configuration comprising A/B testing associated parameters. The TCE can then receive from the first RAN node, QoE reporting comprising or complemented with A/B testing related information.

Consider now an example implementation provided below for NGAP (TS 38.413). UE Application layer measurement configuration The IE defines configuration information for the QoE Measurement Collection

(QMC) function.

AT commands

Consider also an example implementation provided below for AT command (TS 27.007).

8.78 Application level measurement configuration +CAPPLEVMC. In some embodiments, this Application level measurement configuration is an example of the measurement configuration 40 shown in Figure 1.

Table 8.78-1 : +CAPPLEVMC parameter command syntax

Description

This command allows control of the application level measurement configuration according to 3GPP TS 25.331 and 3GPP TS 36.331. The set command controls the presentation of the unsolicited result code +CAPPLEVMC: <app-meas_service_type>,<app- meas_test_id>, <app-meas_test_set_id>, <start-stop_reporting>[,<app- meas_config_file_length>,<app-meas_config-file>] providing data for the configuration.

Refer subclause 9.2 for possible <err> values.

Read command returns the current value of <n>.

Test command returns values supported as a compound value.

Defined values

<n>: integer type. Disable and enable presentation of the unsolicited result code +CAPPLEVMC to the TE.

0 Disable presentation of the unsolicited result code 1 Enable presentation of the unsolicited result code

<app-meas_service_type>: integer type. Contains the indication of what application that is target for the application level measurement configuration.

1 QoE measurement collection for streaming services

2 QoE measurement collection for MTSI services <app-meas_test_id>: string of octets. Contains the indication of the test that is the target for the application level measurement configuration.

<app-meas_test_set_id>: string of octets. Contains the indication of the test set that is the target for the application level measurement configuration. <start-stop_reporting>: integer type. Indicates the start and stop of the application level measurement reporting for the application indicated by the <app-meas_service_type>.

0 start the application level measurement reporting 1 stop the application level measurement reporting <app-meas_config_file_length>: integer type. Indicates the number of octets of the <app- meas_config-file> parameter.

<app-meas_config-file>: string of octets. Contains the application level measurement configuration file for the application indicated by the <app-meas_service_type>, <app- meas_test_id> and <app-meas_test_set_id>. The parameter shall not be subject to conventional character conversion as per +CSCS.

Implementation

Optional. Application level measurement report +CAPPLEVMR. In some embodiments, this Application level measurement report is an example of the measurement report 42 shown in Figure 1.

Table 8.79-1 : +CAPPLEVMR action command syntax

Description

This command allows the MT to provide the application level measurement report according to 3GPP TS 25.331 and 3GPP TS 36.331.

Defined values

<app_meas_service_type>: integer type. Contains the indication of what application that is providing the application level measurement report.

1 QoE measurement collection for streaming services

2 QoE measurement collection for MTSI services

<app-meas_test_id>: string of octets. Contains the indication of the test that is providing application level measurement report.

<app-meas_test_set_id>: string of octets. Contains the indication of the test set that is providing application level measurement report.

Embodiments herein also include corresponding apparatuses. Embodiments herein for instance include a wireless communication device 12 configured to perform any of the steps of any of the embodiments described above for the wireless communication device 12.

Embodiments also include a wireless communication device 12 comprising processing circuitry and power supply circuitry. The processing circuitry is configured to perform any of the steps of any of the embodiments described above for the wireless device 12. The power supply circuitry is configured to supply power to the wireless communication device 12.

Embodiments further include a wireless communication device 12 comprising processing circuitry. The processing circuitry is configured to perform any of the steps of any of the embodiments described above for the wireless communication device 12. In some embodiments, the wireless communication device 12 further comprises communication circuitry.

Embodiments further include a wireless communication device 12 comprising processing circuitry and memory. The memory contains instructions executable by the processing circuitry whereby the wireless communication device 12 is configured to perform any of the steps of any of the embodiments described above for the wireless communication device 12.

Embodiments moreover include a user equipment (UE). The UE comprises an antenna configured to send and receive wireless signals. The UE also comprises radio front- end circuitry connected to the antenna and to processing circuitry, and configured to condition signals communicated between the antenna and the processing circuitry. The processing circuitry is configured to perform any of the steps of any of the embodiments described above for the wireless communication device 12. In some embodiments, the UE also comprises an input interface connected to the processing circuitry and configured to allow input of information into the UE to be processed by the processing circuitry. The UE may comprise an output interface connected to the processing circuitry and configured to output information from the UE that has been processed by the processing circuitry. The UE may also comprise a battery connected to the processing circuitry and configured to supply power to the UE.

Embodiments herein also include a network node 20 configured to perform any of the steps of any of the embodiments described above for the network node 20.

Embodiments also include a network node 20 comprising processing circuitry and power supply circuitry. The processing circuitry is configured to perform any of the steps of any of the embodiments described above for the network node 20. The power supply circuitry is configured to supply power to the network node 20.

Embodiments further include a network node 20 comprising processing circuitry. The processing circuitry is configured to perform any of the steps of any of the embodiments described above for the network node 20. In some embodiments, the network node 20 further comprises communication circuitry.

Embodiments further include a network node 20 comprising processing circuitry and memory. The memory contains instructions executable by the processing circuitry whereby the network node 20 is configured to perform any of the steps of any of the embodiments described above for the network node 20.

More particularly, the apparatuses described above may perform the methods herein and any other processing by implementing any functional means, modules, units, or circuitry. In one embodiment, for example, the apparatuses comprise respective circuits or circuitry configured to perform the steps shown in the method figures. The circuits or circuitry in this regard may comprise circuits dedicated to performing certain functional processing and/or one or more microprocessors in conjunction with memory. For instance, the circuitry may include one or more microprocessor or microcontrollers, as well as other digital hardware, which may include digital signal processors (DSPs), special-purpose digital logic, and the like. The processing circuitry may be configured to execute program code stored in memory, which may include one or several types of memory such as read-only memory (ROM), random-access memory, cache memory, flash memory devices, optical storage devices, etc. Program code stored in memory may include program instructions for executing one or more telecommunications and/or data communications protocols as well as instructions for carrying out one or more of the techniques described herein, in several embodiments. In embodiments that employ memory, the memory stores program code that, when executed by the one or more processors, carries out the techniques described herein.

Figure 7 for example illustrates a wireless communication device 700 (e.g., wireless communication device 12) as implemented in accordance with one or more embodiments.

As shown, the wireless device 700 includes processing circuitry 710 and communication circuitry 720. The communication circuitry 720 (e.g., radio circuitry) is configured to transmit and/or receive information to and/or from one or more other nodes, e.g., via any communication technology. Such communication may occur via one or more antennas that are either internal or external to the wireless device 700. The processing circuitry 710 is configured to perform processing described above, e.g., in Figure 2 or Figure 6, such as by executing instructions stored in memory 730. The37unctiosing circuitry 710 in this regard may implement certain functional means, units, or modules.

Figure 8 illustrates a network node 800 (e.g., network node 20) as implemented in accordance with one or more embodiments. As shown, the network node 800 includes processing circuitry 810 and communication circuitry 820. The communication circuitry 820 is configured to transmit and/or receive information to and/or from one or more other nodes, e.g., via any communication technology. The processing circuitry 810 is configured to perform processing described above, e.g., in Figure 3, Figure 4, or Figure 5, such as by executing instructions stored in memory 830. The processing circuitry 810 in this regard may implement certain functional means, units, or modules.

Those skilled in the art will also appreciate that embodiments herein further include corresponding computer programs.

A computer program comprises instructions which, when executed on at least one processor of an apparatus, cause the apparatus to carry out any of the respective processing described above. A computer program in this regard may comprise one or more code modules corresponding to the means or units described above.

Embodiments further include a carrier containing such a computer program. This carrier may comprise one of an electronic signal, optical signal, radio signal, or computer readable storage medium.

In this regard, embodiments herein also include a computer program product stored on a non-transitory computer readable (storage or recording) medium and comprising instructions that, when executed by a processor of an apparatus, cause the apparatus to perform as described above.

Embodiments further include a computer program product comprising program code portions for performing the steps of any of the embodiments herein when the computer program product is executed by a computing device. This computer program product may be stored on a computer readable recording medium.

Additional embodiments will now be described. At least some of these embodiments may be described as applicable in certain contexts and/or wireless network types for illustrative purposes, but the embodiments are similarly applicable in other contexts and/or wireless network types not explicitly described.

Some embodiments herein are applicable for quality of experience (QoE) measurements for Long Term Evolution (LTE), UMTS, and/or New Radio (NR). In one embodiment, a purpose of the measurements (e.g., in the form of application layer measurements) is to measure the end user experience when using certain applications. QoE measurements may for example do so for streaming services or for MTSI (Mobility Telephony Service for IMS) services.

In some embodiments, e.g., as applicable for LTE and UMTS, Quality of Experience Measurement Collection equipment enables configuration of application layer measurements in a user equipment (UE) and transmission of QoE measurement result files by means of radio resource control (RRC) signalling. Application layer measurement configuration received from Operation, Administration, and Maintenance (OAM) or Core network (CN) is encapsulated in a transparent container, which is forwarded to a UE in a downlink RRC message. Application layer measurements received from a UE’s higher layer are encapsulated in a transparent container and sent to the network in an uplink RRC message. The resulting container is forwarded to a Trace Collector Entity (TCE). Some embodiments herein are applicable in this context, e.g., with the wireless communication device 12 exemplified as the UE and with the network node 20 exemplified as an OAM node, a CN node, a TCE node, a radio access network (RAN) node, or some combination thereof.

Although exemplified above with respect to LTE and UMTS, embodiments herein may also apply to NR. In this context, QoE management in NR embodiments may collect the experience parameters of streaming services as well as performance requirements of diverse services (e.g., augmented reality (AR) / virtual reality (VR) or Ultra-Reliable Low- Latency Communications, URLLC).

In some embodiments, QoE measurements may be initiated towards the RAN in a management-based manner, i.e., from an Operations & Maintenance (O&M) node in a generic way (e.g., for a group of Ues).

In other embodiments, QoE measurements may be initiated in a signaling-based manner, i.e., initiated from CN to RAN (e.g., for a single UE). In such case, the configuration of the measurement in some embodiments includes the measurement details, which are encapsulated in a container that is transparent to RAN. In some embodiments, when initiated via the core network, the measurement is started towards a specific UE. For the LTE case, the “TRACE START” S1AP message may be used, which carries, among others, the details about the measurement configuration the application should collect (in the “Container for application layer measurement configuration” IE, transparent to the RAN) and the details to reach the trace collection entity to which the measurements should be sent.

In some embodiments, the RAN is not aware of when the streaming session is ongoing in the UE Access Stratum, and the RAN is also not aware of when the measurements are ongoing. It is an implementation decision when RAN stops the measurements. In some embodiments, it is done when the UE has moved outside the measured area.

In some embodiments, the QoE measurements are kept for the whole session, even during a handover situation.

Consider an example QoE measurement in E-UTRAN according to some embodiments. For E-UTRAN, the UE capability transfer is used to transfer UE radio access capability information from the UE to E-UTRAN, as shown in Figure 9.

The UE-EUTRA-Capability IE is used to convey the E-UTRA UE Radio Access Capability Parameters and the Feature Group Indicators for mandatory features to the network.

In the response message “UECapabilitylnformation”, the UE can include the “UE- EUTRA-Capability” IE. The “UE-EUTRA-Capability” IE may include the UE-EUTRA- Capability-v1530-IE which can be used by the UE to indicate whether the UE supports or not QoE Measurement Collection for streaming services and/or MTSI services, as detailed in the “MeasParameters-v1530” encoding below. In some embodiments, the “UE-EUTRA-Capability” IE is extended so that, within the “UE-EUTRA-Capability-v16xy-IE”, may include a “measParameters-v16xy” comprising the qoe-Extensions-r16 IE, e.g., according to 3GPP CR 4297 (R2-2004624) for 3GPP TS 36.331 v16.0.0. The qoe-Extensions-r16 IE may be used to indicate whether the UE supports the release 16 extensions for QoE Measurement Collection, i.e., if the UE supports more than one QoE measurement type at a time and if the UE supports the signaling of withinArea, sessionRecordinglndication, qoe-Reference, temporaryStopQoE and restartQoE.

The QoE measurements in some embodiments are reported via a measurement report as described below, e.g., according to the “Application layer measurement reporting” procedure described in 3GPP TS 36.331 and shown in Figure 10. In some embodiments, this reporting procedure informs the network (e.g., E-UTRAN) about application layer measurement report.

In some embodiments, a UE capable of application layer measurement reporting in RRC_CONNECTED may initiate the procedure when configured with application layer measurement, i.e., when measConfigAppLayer has been configured by E-UTRAN.

In some embodiments, upon initiating the procedure, the UE shall:

1 > if configured with application layer measurement, and SRB4 is configured, and the UE has received application layer measurement report information from upper layers: 2> set the measReportAppLayerContainer in the MeasReportAppLayer message to the value of the application layer measurement report information;

2> set the serviceType in the MeasReportAppLayer message to the type of the application layer measurement report information;

2> submit the MeasReportAppLayer message to lower layers for transmission via SRB4.

Consider now QoE measurement configuration setup and release according to some embodiments, e.g., via RRC signaling.

In some embodiments, the RRCConnectionReconfiguration message is used to reconfigure the UE to setup or release the UE for Application Layer measurements. This is signaled in the measConfigAppLayer-15 IE within the “OtherConfig” IE.

In some embodiments, the setup includes the transparent container measConfigAppLayerContainer, which specifies the QoE measurement configuration for the Application of interest and the serviceType IE indicates the Application (or service) for which the QoE measurements are being configured. Supported services may for instance include streaming and MTSI. In some embodiments, the measConfigAppl_ayeiToAddModUst-r16 may be used to add or modify multiple QoE measurement configurations (up to maxQoE-Measurement- r16), e.g., according to CR 4297 (R2-2004624) for 3GPP TS 36.331 v16.0.0. The measConfigAppl_ayerToReleaseUst-r16 IE may be used to remove multiple QoE measurement configuration (up to maxQoE-Measurement-r16).

Consider now QoE measurement reporting according to other embodiments, e.g., via RRC signaling.

In some embodiments, e.g., as specified in 3GPP TS 36.331, the MeasReportAppLayer RRC message is used by the UE to send to a E-UTRAN node the QoE measurement results of an Application (or service). The service for which the report is being sent is indicated in the “serviceType” IE.

In some embodiments, the MeasReportAppLayer les is extended to introduce a QoE reference comprising the PLMN identity and the identifier of the QoE Measurement Collection, e.g., according to CR 4297 (R2-2004624) for 3GPP TS 36.331 v16.0.0.

For E-UTRAN, an example of desired UE behavior for Application layer measurement reporting is described below, e.g., according to CR 4297 (R2-2004624):

UE Application layer measurement configuration

The “UE Application layer measurement configuration” IE is described in 3GPP TS 36.413 V16.3.0 and TS 36.423 v16.3.0.

Area scope for QoE measurements

According to 3GPP TS 28.405, the area scope parameter defines the area in terms of cells or Tracking Area/Routing Area/Location Area where the QoE Measurement Collection (QMC( shall take place. If the parameter is not present the QMC shall be done throughout the Public Land Mobile Network (PLMN) specified in PLMN target.

The area scope parameter in UMTS is either:

- List of cells, identified by Cell Global Identity (CGI). Maximum 32 CGI can be defined.

- List of Routing Area, identified by Routing Area Identity (RAI). Maximum of 8 RAIs can be defined.

- List of Location Area, identified by Location Area Identifier (LAI). Maximum of 8 LAIs can be defined.

The area scope parameter in LTE is either:

- List of cells, identified by E-UTRAN-CGI. Maximum 32 CGI can be defined.

- List of Tracking Area, identified by Tracking Area Code (TAC). Maximum of 8 TAC can be defined. The parameter is mandatory if area based QMC is requested.

Some embodiments herein exploit and enable split testing in this context, also referred to herein as A/B testing. An A/B test as used herein is a user experience research methodology. An A/B test consists of a randomized experiment with two variants of the same process, A and B.

An A/B test is the shorthand for a simple controlled experiment. As the name implies, two versions (A and B) of a test parameter are compared, which are identical except for a variation that might affect a user’s experience.

Although some embodiments herein are exemplified in the form of A/B testing (i.e. , using two variants), such embodiments may be extended to other testing scenarios with more variants (e.g., A/B/C, or A/B/C/D etc.). Generally, A/B testing and other variants thereof (A/B/C, as well as A/B/C/D, etc.) are referred to generically as split testing.

By exploiting split testing, some embodiments herein enable an understanding, by means of controlled experiments, of what variations in UE policies and configurations improve QoE in a wireless communication network. Rather than collecting QoE measurements from Ues using specific services and at specific points in time in an uncoordinated, uncontrolled way, some embodiments exploit split testing and in doing so are able to determine whether there are specific factors that improve QoE, without requiring an intensive and time-consuming process of comparison between QoE measurements, UE’s characteristics, service conditions, and other influencing factors.

Some embodiments thereby advantageously enable a comparison of QoE measurements collected from different sets of Ues that execute the same application of the same service type or service sub-type, when one parameter (or more parameters) affecting the service or application is (are) configured with different values among the different sets of Ues. Alternatively or additionally, some embodiments advantageously enable a comparison of two or more sets of data pertaining to QoE measurements collected in different measurement campaigns from the same UE executing the same application of the same service type or service sub-type, where one parameter (or parameters) affecting the service or application has (have) different value(s) between the measurement campaigns.

Note that, as used herein, the terms “UE”, “terminal equipment”, “wireless terminal” and “terminal” are used interchangeably. The terms “QoE measurement report”, “QoE report”, “measurement report” and “report” are used interchangeably. The terms “QoE measurement configuration”, QoE measurement and reporting configuration”, “QoE measurement”, “QoE configuration” and “application layer measurement configuration” are used interchangeably. Note that the term “QoE measurement” also can refer to a measurement or data collection performed for the purpose of determining a QoE metric. The terms “service” and “application” are used interchangeably. The terms “MCE” and “TCE” are used interchangeably.

Note further that a RAN node can be any of gNB, eNB, en-gNB, ng-eNB, gNB-CU, gNB-CU-CP, gNB-CU-UP, eNB-CU, eNB-CU-CP, eNB-CU-UP, IAB-node, IAB-donor DU, IAB-donor-CU, IAB-DU, IAB-MT, O-CU, O-CU-CP, O-CU-UP, O-DU, O-RU, O-eNB.

Although the subject matter described herein may be implemented in any appropriate type of system using any suitable components, the embodiments disclosed herein are described in relation to a wireless network, such as the example wireless network illustrated in Figure 11. For simplicity, the wireless network of Figure 11 only depicts network 1106, network nodes 1160 and 1160b, and WDs 1110, 1110b, and 1110c. In practice, a wireless network may further include any additional elements suitable to support communication between wireless devices or between a wireless device and another communication device, such as a landline telephone, a service provider, or any other network node or end device.

Of the illustrated components, network node 1160 and wireless device (WD) 1110 are depicted with additional detail. The wireless network may provide communication and other types of services to one or more wireless devices to facilitate the wireless devices’ access to and/or use of the services provided by, or via, the wireless network.

The wireless network may comprise and/or interface with any type of communication, telecommunication, data, cellular, and/or radio network or other similar type of system. In some embodiments, the wireless network may be configured to operate according to specific standards or other types of predefined rules or procedures. Thus, particular embodiments of the wireless network may implement communication standards, such as Global System for Mobile Communications (GSM), Universal Mobile Telecommunications System (UMTS),

Long Term Evolution (LTE), Narrowband Internet of Things (NB-loT), and/or other suitable 2G, 3G, 4G, or 5G standards; wireless local area network (WLAN) standards, such as the IEEE 802.11 standards; and/or any other appropriate wireless communication standard, such as the Worldwide Interoperability for Microwave Access (WiMax), Bluetooth, Z-Wave and/or ZigBee standards.

Network 1106 may comprise one or more backhaul networks, core networks, IP networks, public switched telephone networks (PSTNs), packet data networks, optical networks, wide-area networks (WANs), local area networks (LANs), wireless local area networks (WLANs), wired networks, wireless networks, metropolitan area networks, and other networks to enable communication between devices.

Network node 1160 and WD 1110 comprise various components described in more detail below. These components work together in order to provide network node and/or wireless device functionality, such as providing wireless connections in a wireless network. In different embodiments, the wireless network may comprise any number of wired or wireless networks, network nodes, base stations, controllers, wireless devices, relay stations, and/or any other components or systems that may facilitate or participate in the communication of data and/or signals whether via wired or wireless connections.

As used herein, network node refers to equipment capable, configured, arranged and/or operable to communicate directly or indirectly with a wireless device and/or with other network nodes or equipment in the wireless network to enable and/or provide wireless access to the wireless device and/or to perform other functions (e.g., administration) in the wireless network. Examples of network nodes include, but are not limited to, access points (Aps) (e.g., radio access points), base stations (BSs) (e.g., radio base stations, Node Bs, evolved Node Bs (eNBs) and NR NodeBs (gNBs)). Base stations may be categorized based on the amount of coverage they provide (or, stated differently, their transmit power level) and may then also be referred to as femto base stations, pico base stations, micro base stations, or macro base stations. A base station may be a relay node or a relay donor node controlling a relay. A network node may also include one or more (or all) parts of a distributed radio base station such as centralized digital units and/or remote radio units (RRUs), sometimes referred to as Remote Radio Heads (RRHs). Such remote radio units may or may not be integrated with an antenna as an antenna integrated radio. Parts of a distributed radio base station may also be referred to as nodes in a distributed antenna system (DAS). Yet further examples of network nodes include multi-standard radio (MSR) equipment such as MSR BSs, network controllers such as radio network controllers (RNCs) or base station controllers (BSCs), base transceiver stations (BTSs), transmission points, transmission nodes, multi-cell/multicast coordination entities (MCEs), core network nodes (e.g., MSCs, MMEs), O&M nodes, OSS nodes, SON nodes, positioning nodes (e.g., E- SMLCs), and/or MDTs. As another example, a network node may be a virtual network node as described in more detail below. More generally, however, network nodes may represent any suitable device (or group of devices) capable, configured, arranged, and/or operable to enable and/or provide a wireless device with access to the wireless network or to provide some service to a wireless device that has accessed the wireless network.

In Figure 11, network node 1160 includes processing circuitry 1170, device readable medium 1180, interface 1190, auxiliary equipment 1184, power source 1186, power circuitry 1187, and antenna 1162. Although network node 1160 illustrated in the example wireless network of Figure 11 may represent a device that includes the illustrated combination of hardware components, other embodiments may comprise network nodes with different combinations of components. It is to be understood that a network node comprises any suitable combination of hardware and/or software needed to perform the tasks, features, functions and methods disclosed herein. Moreover, while the components of network node 1160 are depicted as single boxes located within a larger box, or nested within multiple boxes, in practice, a network node may comprise multiple different physical components that make up a single illustrated component (e.g., device readable medium 1180 may comprise multiple separate hard drives as well as multiple RAM modules).

Similarly, network node 1160 may be composed of multiple physically separate components (e.g., a NodeB component and a RNC component, or a BTS component and a BSC component, etc.), which may each have their own respective components. In certain scenarios in which network node 1160 comprises multiple separate components (e.g., BTS and BSC components), one or more of the separate components may be shared among several network nodes. For example, a single RNC may control multiple NodeB’s. In such a scenario, each unique NodeB and RNC pair, may in some instances be considered a single separate network node. In some embodiments, network node 1160 may be configured to support multiple radio access technologies (RATs). In such embodiments, some components may be duplicated (e.g., separate device readable medium 1180 for the different RATs) and some components may be reused (e.g., the same antenna 1162 may be shared by the RATs). Network node 1160 may also include multiple sets of the various illustrated components for different wireless technologies integrated into network node 1160, such as, for example, GSM, WCDMA, LTE, NR, WiFi, or Bluetooth wireless technologies. These wireless technologies may be integrated into the same or different chip or set of chips and other components within network node 1160.

Processing circuitry 1170 is configured to perform any determining, calculating, or similar operations (e.g., certain obtaining operations) described herein as being provided by a network node. These operations performed by processing circuitry 1170 may include processing information obtained by processing circuitry 1170 by, for example, converting the obtained information into other information, comparing the obtained information or converted information to information stored in the network node, and/or performing one or more operations based on the obtained information or converted information, and as a result of said processing making a determination.

Processing circuitry 1170 may comprise a combination of one or more of a microprocessor, controller, microcontroller, central processing unit, digital signal processor, application-specific integrated circuit, field programmable gate array, or any other suitable computing device, resource, or combination of hardware, software and/or encoded logic operable to provide, either alone or in conjunction with other network node 1160 components, such as device readable medium 1180, network node 1160 functionality. For example, processing circuitry 1170 may execute instructions stored in device readable medium 1180 or in memory within processing circuitry 1170. Such functionality may include providing any of the various wireless features, functions, or benefits discussed herein. In some embodiments, processing circuitry 1170 may include a system on a chip (SOC).

In some embodiments, processing circuitry 1170 may include one or more of radio frequency (RF) transceiver circuitry 1172 and baseband processing circuitry 1174. In some embodiments, radio frequency (RF) transceiver circuitry 1172 and baseband processing circuitry 1174 may be on separate chips (or sets of chips), boards, or units, such as radio units and digital units. In alternative embodiments, part or all of RF transceiver circuitry 1172 and baseband processing circuitry 1174 may be on the same chip or set of chips, boards, or units

In certain embodiments, some or all of the functionality described herein as being provided by a network node, base station, eNB or other such network device may be performed by processing circuitry 1170 executing instructions stored on device readable medium 1180 or memory within processing circuitry 1170. In alternative embodiments, some or all of the functionality may be provided by processing circuitry 1170 without executing instructions stored on a separate or discrete device readable medium, such as in a hard-wired manner. In any of those embodiments, whether executing instructions stored on a device readable storage medium or not, processing circuitry 1170 can be configured to perform the described functionality. The benefits provided by such functionality are not limited to processing circuitry 1170 alone or to other components of network node 1160, but are enjoyed by network node 1160 as a whole, and/or by end users and the wireless network generally.

Device readable medium 1180 may comprise any form of volatile or non-volatile computer readable memory including, without limitation, persistent storage, solid-state memory, remotely mounted memory, magnetic media, optical media, random access memory (RAM), read-only memory (ROM), mass storage media (for example, a hard disk), removable storage media (for example, a flash drive, a Compact Disk (CD) or a Digital Video Disk (DVD)), and/or any other volatile or non-volatile, non-transitory device readable and/or computer-executable memory devices that store information, data, and/or instructions that may be used by processing circuitry 1170. Device readable medium 1180 may store any suitable instructions, data or information, including a computer program, software, an application including one or more of logic, rules, code, tables, etc. and/or other instructions capable of being executed by processing circuitry 1170 and, utilized by network node 1160. Device readable medium 1180 may be used to store any calculations made by processing circuitry 1170 and/or any data received via interface 1190. In some embodiments, processing circuitry 1170 and device readable medium 1180 may be considered to be integrated.

Interface 1190 is used in the wired or wireless communication of signalling and/or data between network node 1160, network 1106, and/or WDs 1110. As illustrated, interface 1190 comprises port(s)/terminal(s) 1194 to send and receive data, for example to and from network 1106 over a wired connection. Interface 1190 also includes radio front end circuitry 1192 that may be coupled to, or in certain embodiments a part of, antenna 1162. Radio front end circuitry 1192 comprises filters 1198 and amplifiers 1196. Radio front end circuitry 1192 may be connected to antenna 1162 and processing circuitry 1170. Radio front end circuitry may be configured to condition signals communicated between antenna 1162 and processing circuitry 1170. Radio front end circuitry 1192 may receive digital data that is to be sent out to other network nodes or WDs via a wireless connection. Radio front end circuitry 1192 may convert the digital data into a radio signal having the appropriate channel and bandwidth parameters using a combination of filters 1198 and/or amplifiers 1196. The radio signal may then be transmitted via antenna 1162. Similarly, when receiving data, antenna 1162 may collect radio signals which are then converted into digital data by radio front end circuitry 1192. The digital data may be passed to processing circuitry 1170. In other embodiments, the interface may comprise different components and/or different combinations of components.

In certain alternative embodiments, network node 1160 may not include separate radio front end circuitry 1192, instead, processing circuitry 1170 may comprise radio front end circuitry and may be connected to antenna 1162 without separate radio front end circuitry 1192. Similarly, in some embodiments, all or some of RF transceiver circuitry 1172 may be considered a part of interface 1190. In still other embodiments, interface 1190 may include one or more ports or terminals 1194, radio front end circuitry 1192, and RF transceiver circuitry 1172, as part of a radio unit (not shown), and interface 1190 may communicate with baseband processing circuitry 1174, which is part of a digital unit (not shown).

Antenna 1162 may include one or more antennas, or antenna arrays, configured to send and/or receive wireless signals. Antenna 1162 may be coupled to radio front end circuitry 1190 and may be any type of antenna capable of transmitting and receiving data and/or signals wirelessly. In some embodiments, antenna 1162 may comprise one or more omni-directional, sector or panel antennas operable to transmit/receive radio signals between, for example, 2 GHz and 66 GHz. An omni-directional antenna may be used to transmit/receive radio signals in any direction, a sector antenna may be used to transmit/receive radio signals from devices within a particular area, and a panel antenna may be a line of sight antenna used to transmit/receive radio signals in a relatively straight line. In some instances, the use of more than one antenna may be referred to as MIMO. In certain embodiments, antenna 1162 may be separate from network node 1160 and may be connectable to network node 1160 through an interface or port.

Antenna 1162, interface 1190, and/or processing circuitry 1170 may be configured to perform any receiving operations and/or certain obtaining operations described herein as being performed by a network node. Any information, data and/or signals may be received from a wireless device, another network node and/or any other network equipment.

Similarly, antenna 1162, interface 1190, and/or processing circuitry 1170 may be configured to perform any transmitting operations described herein as being performed by a network node. Any information, data and/or signals may be transmitted to a wireless device, another network node and/or any other network equipment.

Power circuitry 1187 may comprise, or be coupled to, power management circuitry and is configured to supply the components of network node 1160 with power for performing the functionality described herein. Power circuitry 1187 may receive power from power source 1186. Power source 1186 and/or power circuitry 1187 may be configured to provide power to the various components of network node 1160 in a form suitable for the respective components (e.g., at a voltage and current level needed for each respective component). Power source 1186 may either be included in, or external to, power circuitry 1187 and/or network node 1160. For example, network node 1160 may be connectable to an external power source (e.g., an electricity outlet) via an input circuitry or interface such as an electrical cable, whereby the external power source supplies power to power circuitry 1187. As a further example, power source 1186 may comprise a source of power in the form of a battery or battery pack which is connected to, or integrated in, power circuitry 1187. The battery may provide backup power should the external power source fail. Other types of power sources, such as photovoltaic devices, may also be used.

Alternative embodiments of network node 1160 may include additional components beyond those shown in Figure 11 that may be responsible for providing certain aspects of the network node’s functionality, including any of the functionality described herein and/or any functionality necessary to support the subject matter described herein. For example, network node 1160 may include user interface equipment to allow input of information into network node 1160 and to allow output of information from network node 1160. This may allow a user to perform diagnostic, maintenance, repair, and other administrative functions for network node 1160.

As used herein, wireless device (WD) refers to a device capable, configured, arranged and/or operable to communicate wirelessly with network nodes and/or other wireless devices. Unless otherwise noted, the term WD may be used interchangeably herein with user equipment (UE). Communicating wirelessly may involve transmitting and/or receiving wireless signals using electromagnetic waves, radio waves, infrared waves, and/or other types of signals suitable for conveying information through air. In some embodiments, a WD may be configured to transmit and/or receive information without direct human interaction. For instance, a WD may be designed to transmit information to a network on a predetermined schedule, when triggered by an internal or external event, or in response to requests from the network. Examples of a WD include, but are not limited to, a smart phone, a mobile phone, a cell phone, a voice over IP (VoIP) phone, a wireless local loop phone, a desktop computer, a personal digital assistant (PDA), a wireless cameras, a gaming console or device, a music storage device, a playback appliance, a wearable terminal device, a wireless endpoint, a mobile station, a tablet, a laptop, a laptop-embedded equipment (LEE), a laptop-mounted equipment (LME), a smart device, a wireless customer-premise equipment (CPE). A vehicle-mounted wireless terminal device, etc.. A WD may support device-to- device (D2D) communication, for example by implementing a 3GPP standard for sidelink communication, vehicle-to-vehicle (V2V), vehicle-to-infrastructure (V2I), vehicle-to- everything (V2X) and may in this case be referred to as a D2D communication device. As yet another specific example, in an Internet of Things (loT) scenario, a WD may represent a machine or other device that performs monitoring and/or measurements, and transmits the results of such monitoring and/or measurements to another WD and/or a network node. The WD may in this case be a machine-to-machine (M2M) device, which may in a 3GPP context be referred to as an MTC device. As one particular example, the WD may be a UE implementing the 3GPP narrow band internet of things (NB-loT) standard. Particular examples of such machines or devices are sensors, metering devices such as power meters, industrial machinery, or home or personal appliances (e.g. refrigerators, televisions, etc.) personal wearables (e.g., watches, fitness trackers, etc.). In other scenarios, a WD may represent a vehicle or other equipment that is capable of monitoring and/or reporting on its operational status or other functions associated with its operation. A WD as described above may represent the endpoint of a wireless connection, in which case the device may be referred to as a wireless terminal. Furthermore, a WD as described above may be mobile, in which case it may also be referred to as a mobile device or a mobile terminal.

As illustrated, wireless device 1110 includes antenna 1111, interface 1114, processing circuitry 1120, device readable medium 1130, user interface equipment 1132, auxiliary equipment 1134, power source 1136 and power circuitry 1137. WD 1110 may include multiple sets of one or more of the illustrated components for different wireless technologies supported by WD 1110, such as, for example, GSM, WCDMA, LTE, NR, WiFi, WiMAX, NB-loT, or Bluetooth wireless technologies, just to mention a few. These wireless technologies may be integrated into the same or different chips or set of chips as other components within WD 1110.

Antenna 1111 may include one or more antennas or antenna arrays, configured to send and/or receive wireless signals, and is connected to interface 1114. In certain alternative embodiments, antenna 1111 may be separate from WD 1110 and be connectable to WD 1110 through an interface or port. Antenna 1111, interface 1114, and/or processing circuitry 1120 may be configured to perform any receiving or transmitting operations described herein as being performed by a WD. Any information, data and/or signals may be received from a network node and/or another WD. In some embodiments, radio front end circuitry and/or antenna 1111 may be considered an interface.

As illustrated, interface 1114 comprises radio front end circuitry 1112 and antenna 1111. Radio front end circuitry 1112 comprise one or more filters 1118 and amplifiers 1116. Radio front end circuitry 1114 is connected to antenna 1111 and processing circuitry 1120, and is configured to condition signals communicated between antenna 1111 and processing circuitry 1120. Radio front end circuitry 1112 may be coupled to or a part of antenna 1111.

In some embodiments, WD 1110 may not include separate radio front end circuitry 1112; rather, processing circuitry 1120 may comprise radio front end circuitry and may be connected to antenna 1111. Similarly, in some embodiments, some or all of RF transceiver circuitry 1122 may be considered a part of interface 1114. Radio front end circuitry 1112 may receive digital data that is to be sent out to other network nodes or WDs via a wireless connection. Radio front end circuitry 1112 may convert the digital data into a radio signal having the appropriate channel and bandwidth parameters using a combination of filters 1118 and/or amplifiers 1116. The radio signal may then be transmitted via antenna 1111. Similarly, when receiving data, antenna 1111 may collect radio signals which are then converted into digital data by radio front end circuitry 1112. The digital data may be passed to processing circuitry 1120. In other embodiments, the interface may comprise different components and/or different combinations of components.

Processing circuitry 1120 may comprise a combination of one or more of a microprocessor, controller, microcontroller, central processing unit, digital signal processor, application-specific integrated circuit, field programmable gate array, or any other suitable computing device, resource, or combination of hardware, software, and/or encoded logic operable to provide, either alone or in conjunction with other WD 1110 components, such as device readable medium 1130, WD 1110 functionality. Such functionality may include providing any of the various wireless features or benefits discussed herein. For example, processing circuitry 1120 may execute instructions stored in device readable medium 1130 or in memory within processing circuitry 1120 to provide the functionality disclosed herein. As illustrated, processing circuitry 1120 includes one or more of RF transceiver circuitry 1122, baseband processing circuitry 1124, and application processing circuitry 1126. In other embodiments, the processing circuitry may comprise different components and/or different combinations of components. In certain embodiments processing circuitry 1120 of WD 1110 may comprise a SOC. In some embodiments, RF transceiver circuitry 1122, baseband processing circuitry 1124, and application processing circuitry 1126 may be on separate chips or sets of chips. In alternative embodiments, part or all of baseband processing circuitry 1124 and application processing circuitry 1126 may be combined into one chip or set of chips, and RF transceiver circuitry 1122 may be on a separate chip or set of chips. In still alternative embodiments, part or all of RF transceiver circuitry 1122 and baseband processing circuitry 1124 may be on the same chip or set of chips, and application processing circuitry 1126 may be on a separate chip or set of chips. In yet other alternative embodiments, part or all of RF transceiver circuitry 1122, baseband processing circuitry 1124, and application processing circuitry 1126 may be combined in the same chip or set of chips. In some embodiments, RF transceiver circuitry 1122 may be a part of interface 1114. RF transceiver circuitry 1122 may condition RF signals for processing circuitry 1120.

In certain embodiments, some or all of the functionality described herein as being performed by a WD may be provided by processing circuitry 1120 executing instructions stored on device readable medium 1130, which in certain embodiments may be a computer- readable storage medium. In alternative embodiments, some or all of the functionality may be provided by processing circuitry 1120 without executing instructions stored on a separate or discrete device readable storage medium, such as in a hard-wired manner. In any of those particular embodiments, whether executing instructions stored on a device readable storage medium or not, processing circuitry 1120 can be configured to perform the described functionality. The benefits provided by such functionality are not limited to processing circuitry 1120 alone or to other components of WD 1110, but are enjoyed by WD 1110 as a whole, and/or by end users and the wireless network generally.

Processing circuitry 1120 may be configured to perform any determining, calculating, or similar operations (e.g., certain obtaining operations) described herein as being performed by a WD. These operations, as performed by processing circuitry 1120, may include processing information obtained by processing circuitry 1120 by, for example, converting the obtained information into other information, comparing the obtained information or converted information to information stored by WD 1110, and/or performing one or more operations based on the obtained information or converted information, and as a result of said processing making a determination.

Device readable medium 1130 may be operable to store a computer program, software, an application including one or more of logic, rules, code, tables, etc. and/or other instructions capable of being executed by processing circuitry 1120. Device readable medium 1130 may include computer memory (e.g., Random Access Memory (RAM) or Read Only Memory (ROM)), mass storage media (e.g., a hard disk), removable storage media (e.g., a Compact Disk (CD) or a Digital Video Disk (DVD)), and/or any other volatile or non volatile, non-transitory device readable and/or computer executable memory devices that store information, data, and/or instructions that may be used by processing circuitry 1120. In some embodiments, processing circuitry 1120 and device readable medium 1130 may be considered to be integrated.

User interface equipment 1132 may provide components that allow for a human user to interact with WD 1110. Such interaction may be of many forms, such as visual, audial, tactile, etc. User interface equipment 1132 may be operable to produce output to the user and to allow the user to provide input to WD 1110. The type of interaction may vary depending on the type of user interface equipment 1132 installed in WD 1110. For example, if WD 1110 is a smart phone, the interaction may be via a touch screen; if WD 1110 is a smart meter, the interaction may be through a screen that provides usage (e.g., the number of gallons used) or a speaker that provides an audible alert (e.g., if smoke is detected). User interface equipment 1132 may include input interfaces, devices and circuits, and output interfaces, devices and circuits. User interface equipment 1132 is configured to allow input of information into WD 1110, and is connected to processing circuitry 1120 to allow processing circuitry 1120 to process the input information. User interface equipment 1132 may include, for example, a microphone, a proximity or other sensor, keys/buttons, a touch display, one or more cameras, a USB port, or other input circuitry. User interface equipment 1132 is also configured to allow output of information from WD 1110, and to allow processing circuitry 1120 to output information from WD 1110. User interface equipment 1132 may include, for example, a speaker, a display, vibrating circuitry, a USB port, a headphone interface, or other output circuitry. Using one or more input and output interfaces, devices, and circuits, of user interface equipment 1132, WD 1110 may communicate with end users and/or the wireless network, and allow them to benefit from the functionality described herein.

Auxiliary equipment 1134 is operable to provide more specific functionality which may not be generally performed by WDs. This may comprise specialized sensors for doing measurements for various purposes, interfaces for additional types of communication such as wired communications etc. The inclusion and type of components of auxiliary equipment 1134 may vary depending on the embodiment and/or scenario.

Power source 1136 may, in some embodiments, be in the form of a battery or battery pack. Other types of power sources, such as an external power source (e.g., an electricity outlet), photovoltaic devices or power cells, may also be used. WD 1110 may further comprise power circuitry 1137 for delivering power from power source 1136 to the various parts of WD 1110 which need power from power source 1136 to carry out any functionality described or indicated herein. Power circuitry 1137 may in certain embodiments comprise power management circuitry. Power circuitry 1137 may additionally or alternatively be operable to receive power from an external power source; in which case WD 1110 may be connectable to the external power source (such as an electricity outlet) via input circuitry or an interface such as an electrical power cable. Power circuitry 1137 may also in certain embodiments be operable to deliver power from an external power source to power source 1136. This may be, for example, for the charging of power source 1136. Power circuitry 1137 may perform any formatting, converting, or other modification to the power from power source 1136 to make the power suitable for the respective components of WD 1110 to Ih power is supplied.

Figure 12 illustrates one embodiment of a UE in accordance with various aspects described herein. As used herein, a user equipment or UE may not necessarily have a user in the sense of a human user who owns and/or operates the relevant device. Instead, a UE may represent a device that is intended for sale to, or operation by, a human user but which may not, or which may not initially, be associated with a specific human user (e.g., a smart sprinkler controller). Alternatively, a UE may represent a device that is not intended for sale to, or operation by, an end user but which may be associated with or operated for the benefit of a user (e.g., a smart power meter). UE 12200 may be any UE identified by the 3^rd Generation Partnership Project (3GPP), including a NB-loT UE, a machine type communication (MTC) UE, and/or an enhanced MTC (eMTC) UE. UE 1200, as illustrated in Figure 12, is one example of a WD configured for communication in accordance with one or more communication standards promulgated by the 3^rd Generation Partnership Project (3GPP), such as 3GPP’s GSM, UMTS, LTE, and/or 5G standards. As mentioned previously, the term WD and UE may be used interchangeable. Accordingly, although Figure 12 is a UE, the components discussed herein are equally applicable to a WD, and vice-versa.

In Figure 12, UE 1200 includes processing circuitry 1201 that is operatively coupled to input/output interface 1205, radio frequency (RF) interface 1209, network connection interface 1211, memory 1215 including random access memory (RAM) 1217, read-only memory (ROM) 1219, and storage medium 1221 or the like, communication subsystem 1231, power source 1233, and/or any other component, or any combination thereof.

Storage medium 1221 includes operating system 1223, application program 1225, and data 1227. In other embodiments, storage medium 1221 may include other similar types of information. Certain UEs may utilize all of the components shown in Figure 12, or only a subset of the components. The level of integration between the components may vary from one UE to another UE. Further, certain UEs may contain multiple instances of a component, such as multiple processors, memories, transceivers, transmitters, receivers, etc.

In Figure 12, processing circuitry 1201 may be configured to process computer instructions and data. Processing circuitry 1201 may be configured to implement any sequential state machine operative to execute machine instructions stored as machine- readable computer programs in the memory, such as one or more hardware-implemented state machines (e.g., in discrete logic, FPGA, ASIC, etc.); programmable logic together with appropriate firmware; one or more stored program, general-purpose processors, such as a microprocessor or Digital Signal Processor (DSP), together with appropriate software; or any combination of the above. For example, the processing circuitry 1201 may include two central processing units (CPUs). Data may be information in a form suitable for use by a computer.

In the depicted embodiment, input/output interface 1205 may be configured to provide a communication interface to an input device, output device, or input and output device. UE 1200 may be configured to use an output device via input/output interface 1205. An output device may use the same type of interface port as an input device. For example, a USB port may be used to provide input to and output from UE 1200. The output device may be a speaker, a sound card, a video card, a display, a monitor, a printer, an actuator, an emitter, a smartcard, another output device, or any combination thereof. UE 1200 may be configured to use an input device via input/output interface 1205 to allow a user to capture information into UE 1200. The input device may include a touch-sensitive or presence- sensitive display, a camera (e.g., a digital camera, a digital video camera, a web camera, etc.), a microphone, a sensor, a mouse, a trackball, a directional pad, a trackpad, a scroll wheel, a smartcard, and the like. The presence-sensitive display may include a capacitive or resistive touch sensor to sense input from a user. A sensor may be, for instance, an accelerometer, a gyroscope, a tilt sensor, a force sensor, a magnetometer, an optical sensor, a proximity sensor, another like sensor, or any combination thereof. For example, the input device may be an accelerometer, a magnetometer, a digital camera, a microphone, and an optical sensor.

In Figure 12, RF interface 1209 may be configured to provide a communication interface to RF components such as a transmitter, a receiver, and an antenna. Network connection interface 1211 may be configured to provide a communication interface to network 1243a. Network 1243a may encompass wired and/or wireless networks such as a local-area network (LAN), a wide-area network (WAN), a computer network, a wireless network, a telecommunications network, another like network or any combination thereof.

For example, network 1243a may comprise a Wi-Fi network. Network connection interface 1211 may be configured to include a receiver and a transmitter interface used to communicate with one or more other devices over a communication network according to one or more communication protocols, such as Ethernet, TCP/IP, SONET, ATM, or the like. Network connection interface 1211 may implement receiver and transmitter functionality appropriate to the communication network links (e.g., optical, electrical, and the like). The transmitter and receiver functions may share circuit components, software or firmware, or alternatively may be implemented separately.

RAM 1217 may be configured to interface via bus 1202 to processing circuitry 1201 to provide storage or caching of data or computer instructions during the execution of software programs such as the operating system, application programs, and device drivers. ROM 1219 may be configured to provide computer instructions or data to processing circuitry 1201. For example, ROM 1219 may be configured to store invariant low-level system code or data for basic system functions such as basic input and output (I/O), startup, or reception of keystrokes from a keyboard that are stored in a non-volatile memory.

Storage medium 1221 may be configured to include memory such as RAM, ROM, programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic disks, optical disks, floppy disks, hard disks, removable cartridges, or flash drives. In one example, storage medium 1221 may be configured to include operating system 1223, application program 1225 such as a web browser application, a widget or gadget engine or another application, and data file 1227. Storage medium 1221 may store, for use by UE 1200, any of a variety of various operating systems or combinations of operating systems.

Storage medium 1221 may be configured to include a number of physical drive units, such as redundant array of independent disks (RAID), floppy disk drive, flash memory, USB flash drive, external hard disk drive, thumb drive, pen drive, key drive, high-density digital versatile disc (HD-DVD) optical disc drive, internal hard disk drive, Blu-Ray optical disc drive, holographic digital data storage (HDDS) optical disc drive, external mini-dual in-line memory module (DIMM), synchronous dynamic random access memory (SDRAM), external micro- DIMM SDRAM, smartcard memory such as a subscriber identity module or a removable user identity (SIM/RUIM) module, other memory, or any combination thereof. Storage medium 1221 may allow UE 1200 to access computer-executable instructions, application programs or the like, stored on transitory or non-transitory memory media, to off-load data, or to upload data. An article of manufacture, such as one utilizing a communication system may be tangibly embodied in storage medium 1221, which may comprise a device readable medium.

In Figure 12, processing circuitry 1201 may be configured to communicate with network 1243b using communication subsystem 1231. Network 1243a and network 1243b may be the same network or networks or different network or networks. Communication subsystem 1231 may be configured to include one or more transceivers used to communicate with network 1243b. For example, communication subsystem 1231 may be configured to include one or more transceivers used to communicate with one or more remote transceivers of another device capable of wireless communication such as another WD, UE, or base station of a radio access network (RAN) according to one or more communication protocols, such as IEEE 802.11, CDMA, WCDMA, GSM, LTE, UTRAN, WiMax, or the like. Each transceiver may include transmitter 1233 and/or receiver 1235 to implement transmitter or receiver functionality, respectively, appropriate to the RAN links (e.g., frequency allocations and the like). Further, transmitter 1233 and receiver 1235 of each transceiver may share circuit components, software or firmware, or alternatively may be implemented separately.

In the illustrated embodiment, the communication functions of communication subsystem 1231 may include data communication, voice communication, multimedia communication, short-range communications such as Bluetooth, near-field communication, location-based communication such as the use of the global positioning system (GPS) to determine a location, another like communication function, or any combination thereof. For example, communication subsystem 1231 may include cellular communication, Wi-Fi communication, Bluetooth communication, and GPS communication. Network 1243b may encompass wired and/or wireless networks such as a local-area network (LAN), a wide-area network (WAN), a computer network, a wireless network, a telecommunications network, another like network or any combination thereof. For example, network 1243b may be a cellular network, a W-Fi network, and/or a near-field network. Power source 1213 may be configured to provide alternating current (AC) or direct current (DC) power to components of UE 1200.

The features, benefits and/or functions described herein may be implemented in one of the components of UE 1200 or partitioned across multiple components of UE 1200. Further, the features, benefits, and/or functions described herein may be implemented in any combination of hardware, software or firmware. In one example, communication subsystem 1231 may be configured to include any of the components described herein. Further, processing circuitry 1201 may be configured to communicate with any of such components over bus 1202. In another example, any of such components may be represented by program instructions stored in memory that when executed by processing circuitry 1201 perform the corresponding functions described herein. In another example, 57unctionctionality of any of such components may be partitioned between processing circuitry 1201 and communication subsystem 1231. In another example, the non-computationally intensive functions of any of such components may be implemented in software or firmware and the computationally intensive functions may be implemented in hardware.

Figure 13 is a schematic block diagram illustrating a virtualization environment 1300 in which functions implemented by some embodiments may be virtualized. In the present context, virtualizing means creating virtual versions of apparatuses or devices which may include virtualizing hardware platforms, storage devices and networking resources. As used herein, virtualization can be applied to a node (e.g., a virtualized base station or a virtualized radio access node) or to a device (e.g., a UE, a wireless device or any other type of communication device) or components thereof and relates to an implementation in which at least a portion of the functionality is implemented as one or more virtual components (e.g., via one or more applications, components, functions, virtual machines or containers executing on one or more physical processing nodes in one or more networks).

In some embodiments, some or all of the functions described herein may be implemented as virtual components executed by one or more virtual machines implemented in one or more virtual environments 1300 hosted by one or more of hardware nodes 1330. Further, in embodiments in which the virtual node is not a radio access node or does not require radio connectivity (e.g., a core network node), then the network node may be entirely virtualized.

The functions may be implemented by one or more applications 1320 (which may alternatively be called software instances, virtual appliances, network functions, virtual nodes, virtual network functions, etc.) operative to implement some of the features, functions, and/or benefits of some of the embodiments disclosed herein. Applications 1320 are run in virtualization environment 1300 which provides hardware 1330 comprising processing circuitry 1360 and memory 1390. Memory 1390 contains instructions 1395 executable by processing circuitry 1360 whereby application 1320 is operative to provide one or more of the features, benefits, and/or functions disclosed herein.

Virtualization environment 1300, comprises general-purpose or special-purpose network hardware devices 1330 comprising a set of one or more processors or processing circuitry 1360, which may be commercial off-the-shelf (COTS) processors, dedicated Application Specific Integrated Circuits (ASICs), or any other type of processing circuitry including digital or analog hardware components or special purpose processors. Each hardware device may comprise memory 1390-1 which may be non-persistent memory for temporarily storing instructions 1395 or software executed by processing circuitry 1360.

Each hardware device may comprise one or more network interface controllers (NICs) 1370, also known as network interface cards, which include physical network interface 1380. Each hardware device may also include non-transitory, persistent, machine-readable storage media 1390-2 having stored therein software 1395 and/or instructions executable by processing circuitry 1360. Software 1395 may include any type of software including software for instantiating one or more virtualization layers 1350 (also referred to as hypervisors), software to execute virtual machines 1340 as well as software allowing it to execute functions, features and/or benefits described in relation with some embodiments described herein.

Virtual machines 1340, comprise virtual processing, virtual memory, virtual networking or interface and virtual storage, and may be run by a corresponding virtualization layer 1350 or hypervisor. Different embodiments of the instance of virtual appliance 1320 may be implemented on one or more of virtual machines 1340, and the implementations may be made in different ways.

During operation, processing circuitry 1360 executes software 1395 to instantiate the hypervisor or virtualization layer 1350, which may sometimes be referred to as a virtual machine monitor (VMM). Virtualization layer 1350 may present a virtual operating platform that appears like networking hardware to virtual machine 1340.

As shown in Figure 13, hardware 1330 may be a standalone network node with generic or specific components. Hardware 1330 may comprise antenna 13225 and may implement some functions via virtualization. Alternatively, hardware 1330 may be part of a larger cluster of hardware (e.g. such as in a data center or customer premise equipment (CPE)) where many hardware nodes work together and are managed via management and orchestration (MANO) 13100, which, among others, oversees lifecycle management of applications 1320.

Virtualization of the hardware is in some contexts referred to as network function virtualization (NFV). NFV may be used to consolidate many network equipment types onto industry standard high volume server hardware, physical switches, and physical storage, which can be located in data centers, and customer premise equipment.

In the context of NFV, virtual machine 1340 may be a software implementation of a physical machine that runs programs as if they were executing on a physical, non-virtualized machine. Each of virtual machines 1340, and that part of hardware 1330 that executes that virtual machine, be it hardware dedicated to that virtual machine and/or hardware shared by that virtual machine with others of the virtual machines 1340, forms a separate virtual network elements (VNE). Still in the context of NFV, Virtual Network Function (VNF) is responsible for handling specific network functions that run in one or more virtual machines 1340 on top of hardware networking infrastructure 1330 and corresponds to application 1320 in Figure 13.

In some embodiments, one or more radio units 13200 that each include one or more transmitters 13220 and one or more receivers 13210 may be coupled to one or more antennas 13225. Radio units 13200 may communicate directly with hardware nodes 1330 via one or more appropriate network interfaces and may be used in combination with the virtual components to provide a virtual node with radio capabilities, such as a radio access node or a base station.

In some embodiments, some signalling can be effected with the use of control system 13230 which may alternatively be used for communication between the hardware nodes 1330 and radio units 13200.

Figure 14 illustrates a telecommunication network connected via an intermediate network to a host computer in accordance with some embodiments. In particular, with reference to FIGURE 14, in accordance with an embodiment, a communication system includes telecommunication network 1410, such as a 3GPP-type cellular network, which comprises access network 1411, such as a radio access network, and core network 1414. Access network 1411 comprises a plurality of base stations 1412a, 1412b, 1412c, such as NBs, eNBs, gNBs or other types of wireless access points, each defining a corresponding coverage area 1413a, 1413b, 1413c. Each base station 1412a, 1412b, 1412c is connectable to core network 1414 over a wired or wireless connection 1415. A first UE 1491 located in coverage area 1413c is configured to wirelessly connect to, or be paged by, the corresponding base station 1412c. A second UE 1492 in coverage area 1413a is wirelessly connectable to the corresponding base station 1412a. While a plurality of UEs 1491, 1492 are illustrated in this example, the disclosed embodiments are equally applicable to a situation where a sole UE is in the coverage area or where a sole UE is connecting to the corresponding base station 1412.

Telecommunication network 1410 is itself connected to host computer 1430, which may be embodied in the hardware and/or software of a standalone server, a cloud- implemented server, a distributed server or as processing resources in a server farm. Host computer 1430 may be under the ownership or control of a service provider, or may be operated by the service provider or on behalf of the service provider. Connections 1421 and 1422 between telecommunication network 1410 and host computer 1430 may extend directly from core network 1414 to host computer 1430 or may go via an optional intermediate network 1420. Intermediate network 1420 may be one of, or a combination of more than one of, a public, private or hosted network; intermediate network 1420, if any, may be a backbone network or the Internet; in particular, intermediate network 1420 may comprise two or more sub-networks (not shown).

The communication system of Figure 14 as a whole enables connectivity between the connected UEs 1491, 1492 and host computer 1430. The connectivity may be described as an over-the-top (OTT) connection 1450. Host computer 1430 and the connected UEs 1491, 1492 are configured to communicate data and/or signaling via OTT connection 1450, using access network 1411, core network 1414, any intermediate network 1420 and possible further infrastructure (not shown) as intermediaries. OTT connection 1450 may be transparent in the sense that the participating communication devices through which OTT connection 1450 passes are unaware of routing of uplink and downlink communications. For example, base station 1412 may not or need not be informed about the past routing of an incoming downlink communication with data originating from host computer 1430 to be forwarded (e.g., handed over) to a connected UE 1491. Similarly, base station 1412 need not be aware of the future routing of an outgoing uplink communication originating from the UE 1491 towards the host computer 1430.

Example implementations, in accordance with an embodiment, of the UE, base station and host computer discussed in the preceding paragraphs will now be described with reference to Figure 15. Figure 15 illustrates host computer communicating via a base station with a user equipment over a partially wireless connection in accordance with some embodiments In communication system 1500, host computer 1510 comprises hardware 1515 including communication interface 1516 configured to set up and maintain a wired or wireless connection with an interface of a different communication device of communication system 1500. Host computer 1510 further comprises processing circuitry 1518, which may have storage and/or processing capabilities. In particular, processing circuitry 1518 may comprise one or more programmable processors, application-specific integrated circuits, field programmable gate arrays or combinations of these (not shown) adapted to execute instructions. Host computer 1510 further comprises software 1511, which is stored in or accessible by host computer 1510 and executable by processing circuitry 1518. Software 1511 includes host application 1512. Host application 1512 may be operable to provide a service to a remote user, such as UE 1530 connecting via OTT connection 1550 terminating at UE 1530 and host computer 1510. In providing the service to the remote user, host application 1512 may provide user data which is transmitted using OTT connection 1550.

Communication system 1500 further includes base station 1520 provided in a telecommunication system and comprising hardware 1525 enabling it to communicate with host computer 1510 and with UE 1530. Hardware 1525 may include communication interface 1526 for setting up and maintaining a wired or wireless connection with an interface of a different communication device of communication system 1500, as well as radio interface 1527 for setting up and maintaining at least wireless connection 1570 with UE 1530 located in a coverage area (not shown in Figure 15) served by base station 1520. Communication interface 1526 may be configured to facilitate connection 1560 to host computer 1510. Connection 1560 may be direct or it may pass through a core network (not shown in Figure 15) of the telecommunication system and/or through one or more intermediate networks outside the telecommunication system. In the embodiment shown, hardware 1525 of base station 1520 further includes processing circuitry 1528, which may comprise one or more programmable processors, application-specific integrated circuits, field programmable gate arrays or combinations of these (not shown) adapted to execute instructions. Base station 1520 further has software 1521 stored internally or accessible via an external connection.

Communication system 1500 further includes UE 1530 already referred to. Its hardware 1535 may include radio interface 1537 configured to set up and maintain wireless connection 1570 with a base station serving a coverage area in which UE 1530 is currently located. Hardware 1535 of UE 1530 further includes processing circuitry 1538, which may comprise one or more programmable processors, application-specific integrated circuits, field programmable gate arrays or combinations of these (not shown) adapted to execute instructions. UE 1530 further comprises software 1531, which is stored in or accessible by UE 1530 and executable by processing circuitry 1538. Software 1531 includes client application 1532. Client application 1532 may be operable to provide a service to a human or non-human user via UE 1530, with the support of host computer 1510. In host computer 1510, an executing host application 1512 may communicate with the executing client application 1532 via OTT connection 1550 terminating at UE 1530 and host computer 1510. In providing the service to the user, client application 1532 may receive request data from host application 1512 and provide user data in response to the request data. OTT connection 1550 may transfer both the request data and the user data. Client application 1532 may interact with the user to generate the user data that it provides.

It is noted that host computer 1510, base station 1520 and UE 1530 illustrated in Figure 15 may be similar or identical to host computer 1430, one of base stations 1412a, 1412b, 1412c and one of UEs 1491, 1492 of Figure 14, respectively. This is to say, the inner workings of these entities may be as shown in Figure 15 and independently, the surrounding network topology may be that of Figure 14.

In Figure 15, OTT connection 1550 has been drawn abstractly to illustrate the communication between host computer 1510 and UE 1530 via base station 1520, without explicit reference to any intermediary devices and the precise routing of messages via these devices. Network infrastructure may determine the routing, which it may be configured to hide from UE 1530 or from the service provider operating host computer 1510, or both.

While OTT connection 1550 is active, the network infrastructure may further take decisions by which it dynamically changes the routing (e.g., on the basis of load balancing consideration or reconfiguration of the network).

Wireless connection 1570 between UE 1530 and base station 1520 is in accordance with the teachings of the embodiments described throughout this disclosure. One or more of the various embodiments improve the performance of OTT services provided to UE 1530 using OTT connection 1550, in which wireless connection 1570 forms the last segment.

A measurement procedure may be provided for the purpose of monitoring data rate, latency and other factors on which the one or more embodiments improve. There may further be an optional network functionality for reconfiguring OTT connection 1550 between host computer 1510 and UE 1530, in response to variations in the measurement results.

The measurement procedure and/or the network functionality for reconfiguring OTT connection 1550 may be implemented in software 1511 and hardware 1515 of host computer 1510 or in software 1531 and hardware 1535 of UE 1530, or both. In embodiments, sensors (not shown) may be deployed in or in association with communication devices through which OTT connection 1550 passes; the sensors may participate in the measurement procedure by supplying values of the monitored quantities exemplified above, or supplying values of other physical quantities from which software 1511, 1531 may compute or estimate the monitored quantities. The reconfiguring of OTT connection 1550 may include message format, retransmission settings, preferred routing etc.; the reconfiguring need not affect base station 1520, and it may be unknown or imperceptible to base station 1520. Such procedures and functionalities may be known and practiced in the art. In certain embodiments, measurements may involve proprietary UE signaling facilitating host computer 1510’s measurements of throughput, propagation times, latency and the like. The measurements may be implemented in that software 1511 and 1531 causes messages to be transmitted, in particular empty or ‘dummy’ messages, using OTT connection 1550 while it monitors propagation times, errors etc.

Figure 16 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment. The communication system includes a host computer, a base station and a UE which may be those described with reference to Figures 14 and 15. For simplicity of the present disclosure, only drawing references to Figure 16 will be included in this section. In step 1610, the host computer provides user data. In substep 1611 (which may be optional) of step 1610, the host computer provides the user data by executing a host application. In step 1620, the host computer initiates a transmission carrying the user data to the UE. In step 1630 (which may be optional), the base station transmits to the UE the user data which was carried in the transmission that the host computer initiated, in accordance with the teachings of the embodiments described throughout this disclosure. In step 1640 (which may also be optional), the UE executes a client application associated with the host application executed by the host computer.

Figure 17 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment. The communication system includes a host computer, a base station and a UE which may be those described with reference to Figures 14 and 15. For simplicity of the present disclosure, only drawing references to Figure 17 will be included in this section. In step 1710 of the method, the host computer provides user data. In an optional substep (not shown) the host computer provides the user data by executing a host application. In step 1720, the host computer initiates a transmission carrying the user data to the UE. The transmission may pass via the base station, in accordance with the teachings of the embodiments described throughout this disclosure. In step 1730 (which may be optional), the UE receives the user data carried in the transmission.

Figure 18 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment. The communication system includes a host computer, a base station and a UE which may be those described with reference to Figures 14 and 15. For simplicity of the present disclosure, only drawing references to Figure 18 will be included in this section. In step 1810 (which may be optional), the UE receives input data provided by the host computer. Additionally or alternatively, in step 1820, the UE provides user data. In substep 1821 (which may be optional) of step 1820, the UE provides the user data by executing a client application. In substep 1811 (which may be optional) of step 1810, the UE executes a client application which provides the user data in reaction to the received input data provided by the host computer. In providing the user data, the executed client application may further consider user input received from the user. Regardless of the specific manner in which the user data was provided, the UE initiates, in substep 1830 (which may be optional), transmission of the user data to the host computer. In step 1840 of the method, the host computer receives the user data transmitted from the UE, in accordance with the teachings of the embodiments described throughout this disclosure.

Figure 19 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment. The communication system includes a host computer, a base station and a UE which may be those described with reference to Figures 14 and 15. For simplicity of the present disclosure, only drawing references to Figure 19 will be included in this section. In step 1910 (which may be optional), in accordance with the teachings of the embodiments described throughout this disclosure, the base station receives user data from the UE. In step 1920 (which may be optional), the base station initiates transmission of the received user data to the host computer. In step 1930 (which may be optional), the host computer receives the user data carried in the transmission initiated by the base station.

Any appropriate steps, methods, features, functions, or benefits disclosed herein may be performed through one or more functional units or modules of one or more virtual apparatuses. Each virtual apparatus may comprise a number of these functional units. These functional units may be implemented via processing circuitry, which may include one or more microprocessor or microcontrollers, as well as other digital hardware, which may include digital signal processors (DSPs), special-purpose digital logic, and the like. The processing circuitry may be configured to execute program code stored in memory, which may include one or several types of memory such as read-only memory (ROM), random- access memory (RAM), cache memory, flash memory devices, optical storage devices, etc. Program code stored in memory includes program instructions for executing one or more telecommunications and/or data communications protocols as well as instructions for carrying out one or more of the techniques described herein. In some implementations, the processing circuitry may be used to cause the respective functional unit to perform corresponding functions according one or more embodiments of the present disclosure.

In view of the above, then, embodiments herein generally include a communication system including a host computer. The host computer may comprise processing circuitry configured to provide user data. The host computer may also comprise a communication interface configured to forward the user data to a cellular network for transmission to a user equipment (UE). The cellular network may comprise a base station having a radio interface and processing circuitry, the base station’s processing circuitry configured to perform any of the steps of any of the embodiments described above for a base station.

In some embodiments, the communication system further includes the base station.

In some embodiments, the communication system further includes the UE, wherein the UE is configured to communicate with the base station.

In some embodiments, the processing circuitry of the host computer is configured to execute a host application, thereby providing the user data. In this case, the UE comprises processing circuitry configured to execute a client application associated with the host application.

Embodiments herein also include a method implemented in a communication system including a host computer, a base station and a user equipment (UE). The method comprises, at the host computer, providing user data. The method may also comprise, at the host computer, initiating a transmission carrying the user data to the UE via a cellular network comprising the base station. The base station performs any of the steps of any of the embodiments described above for a base station.

In some embodiments, the method further comprising, at the base station, transmitting the user data.

In some embodiments, the user data is provided at the host computer by executing a host application. In this case, the method further comprises, at the UE, executing a client application associated with the host application.

Embodiments herein also include a user equipment (UE) configured to communicate with a base station. The UE comprises a radio interface and processing circuitry configured to perform any of the embodiments above described for a UE.

Embodiments herein further include a communication system including a host computer. The host computer comprises processing circuitry configured to provide user data, and a communication interface configured to forward user data to a cellular network for transmission to a user equipment (UE). The UE comprises a radio interface and processing circuitry. The UE’s components are configured to perform any of the steps of any of the embodiments described above for a UE.

In some embodiments, the cellular network further includes a base station configured to communicate with the UE.

In some embodiments, the processing circuitry of the host computer is configured to execute a host application, thereby providing the user data. The UE’s processing circuitry is configured to execute a client application associated with the host application.

Embodiments also include a method implemented in a communication system including a host computer, a base station and a user equipment (UE). The method comprises, at the host computer, providing user data and initiating a transmission carrying the user data to the UE via a cellular network comprising the base station. The UE performs any of the steps of any of the embodiments described above for a UE.

In some embodiments, the method further comprises, at the UE, receiving the user data from the base station.

Embodiments herein further include a communication system including a host computer. The host computer comprises a communication interface configured to receive user data originating from a transmission from a user equipment (UE) to a base station. The UE comprises a radio interface and processing circuitry. The UE’s processing circuitry is configured to perform any of the steps of any of the embodiments described above for a UE.

In some embodiments the communication system further includes the UE.

In some embodiments, the communication system further including the base station. In this case, the base station comprises a radio interface configured to communicate with the UE and a communication interface configured to forward to the host computer the user data carried by a transmission from the UE to the base station.

In some embodiments, the processing circuitry of the host computer is configured to execute a host application. And the UE’s processing circuitry is configured to execute a client application associated with the host application, thereby providing the user data.

In some embodiments, the processing circuitry of the host computer is configured to execute a host application, thereby providing request data. And the UE’s processing circuitry is configured to execute a client application associated with the host application, thereby providing the user data in response to the request data.

Embodiments herein also include a method implemented in a communication system including a host computer, a base station and a user equipment (UE). The method comprises, at the host computer, receiving user data transmitted to the base station from the UE. The UE performs any of the steps of any of the embodiments described above for the UE.

In some embodiments, the method further comprises, at the UE, providing the user data to the base station.

In some embodiments, the method also comprises, at the UE, executing a client application, thereby providing the user data to be transmitted. The method may further comprise, at the host computer, executing a host application associated with the client application.

In some embodiments, the method further comprises, at the UE, executing a client application, and, at the UE, receiving input data to the client application. The input data is provided at the host computer by executing a host application associated with the client application. The user data to be transmitted is provided by the client application in response to the input data.

Embodiments also include a communication system including a host computer. The host computer comprises a communication interface configured to receive user data originating from a transmission from a user equipment (UE) to a base station. The base station comprises a radio interface and processing circuitry. The base station’s processing circuitry is configured to perform any of the steps of any of the embodiments described above for a base station.

In some embodiments, the communication system further includes the UE. The UE is configured to communicate with the base station.

In some embodiments, the processing circuitry of the host computer is configured to execute a host application. And the UE is configured to execute a client application associated with the host application, thereby providing the user data to be received by the host computer.

Embodiments moreover include a method implemented in a communication system including a host computer, a base station and a user equipment (UE). The method comprises, at the host computer, receiving, from the base station, user data originating from a transmission which the base station has received from the UE. The UE performs any of the steps of any of the embodiments described above for a UE.

In some embodiments, the method further comprises, at the base station, receiving the user data from the UE.

In some embodiments, the method further comprises, at the base station, initiating a transmission of the received user data to the host computer.

Generally, all terms used herein are to be interpreted according to their ordinary meaning in the relevant technical field, unless a different meaning is clearly given and/or is implied from the context in which it is used. All references to a/an/the element, apparatus, component, means, step, etc. are to be interpreted openly as referring to at least one instance of the element, apparatus, component, means, step, etc., unless explicitly stated otherwise. The steps of any methods disclosed herein do not have to be performed in the exact order disclosed, unless a step is explicitly described as following or preceding another step and/or where it is implicit that a step must follow or precede another step. Any feature of any of the embodiments disclosed herein may be applied to any other embodiment, wherever appropriate. Likewise, any advantage of any of the embodiments may apply to any other embodiments, and vice versa. Other objectives, features and advantages of the enclosed embodiments will be apparent from the description.

The term unit may have conventional meaning in the field of electronics, electrical devices and/or electronic devices and may include, for example, electrical and/or electronic circuitry, devices, modules, processors, memories, logic solid state and/or discrete devices, computer programs or instructions for carrying out respective tasks, procedures, computations, outputs, and/or displaying functions, and so on, as such as those that are described herein.

The term “A and/or B” as used herein covers embodiments having A alone, B alone, or both A and B together. The term “A and/or B” may therefore equivalently mean “at least one of any one or more of A and B”.

Some of the embodiments contemplated herein are described more fully with reference to the accompanying drawings. Other embodiments, however, are contained within the scope of the subject matter disclosed herein. The disclosed subject matter should not be construed as limited to only the embodiments set forth herein; rather, these embodiments are provided by way of example to convey the scope of the subject matter to those skilled in the art.

Notably, modifications and other embodiments of the disclosed invention(s) will come to mind to one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the invention(s) is/are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of this disclosure. Although specific terms may be employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Example embodiments of the techniques and apparatus described herein include, but are not limited to, the following enumerated examples:

Group A Embodiments

A1. A method performed by a wireless communication device configured for use in a wireless communication network, the method comprising: receiving, from a network node in the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration: indicates the QoE measurements are for a split test of QoE; and/or includes a test identity identifying a test that is a target for the measurement configuration; and/or includes a test set identity identifying a test set that is a target for the measurement configuration.

A2. The method of embodiment A1 , wherein the measurement configuration indicates the QoE measurements are for split testing of QoE.

A3. The method of any of embodiments A1-A2, wherein the measurement configuration includes the test identity and/or the test set identity.

A4. The method of any of embodiments A1-A3, wherein the QoE measurements are for a split test of QoE under different variations of a testing parameter, wherein the test set identity identifies the test set for one of the different variations of the testing parameter.

A5. The method of embodiment A4, wherein said receiving is performed as part of receiving multiple different measurement configurations that include different test set identities identifying different respective test sets for different respective variations of the testing parameter, wherein the different measurement configurations define configuration information for collecting QoE measurements at different times according to the different measurement configurations.

A6. The method of any of embodiments A4-A5, wherein the testing parameter comprises: a network slice supporting an application or service, wherein different variations of the testing parameter comprise different network slices supporting the same application or service; a network system supporting an application or service, wherein different variations of the testing parameter comprise different network systems supporting the same application or service; a radio access technology via which an application or service is provided, wherein different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided; an area in which an application or service is provided, wherein different variations of the testing parameter comprise different areas in which the same application or service is provided; or a scheduling priority according to which traffic of an application or service is scheduled, wherein different variations of the testing parameter comprise different scheduling priorities according to which traffic for the same application or service is scheduled.

A7. The method of any of embodiments A4-A5, wherein the testing parameter comprises: an application or service, wherein different variations of the testing parameter comprise different applications or services such that the split test tests QoE for the different applications or services; or a set of applications or services that includes a target application or service, wherein different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test tests QoE for the different sets of applications or services.

A8. The method of any of embodiments A4-A5, wherein the testing parameter comprises a wireless communication device radio access capability, wherein different variations of the testing parameter comprise different values of the wireless communication device radio access capability.

A9. The method of embodiment A8, wherein the wireless communication device radio access capability is a maximum bandwidth capability, a maximum number of component carriers supported, a dual connectivity mode capability, or a handover type capability.

A10. The method of any of embodiments A4-A5, wherein the testing parameter comprises: radio conditions under which an application or service is provided, wherein different variations of the testing parameter comprise different radio conditions under which the same application or service is provided; or a physical layer transmission configuration according to which transmissions for an application or service are made, wherein different variations of the testing parameter comprise different physical layer transmission configurations according to which transmissions for the same application or service are made.

A11. The method of any of embodiments A4-A10, further comprising transmitting a measurement report that reports QoE measurements collected according to the configuration information.

A12. The method of embodiment A11 , wherein the measurement report includes the test identity and/or the test set identity.

A13. The method of any of embodiments A1-A12, wherein the network node is in a core network of the wireless communication network.

A14. The method of any of embodiments A1-A12, wherein the network node is an operations, administration, and maintenance node for the wireless communication network.

A15. The method of any of embodiments A1-A12, wherein the network node is in a radio access network of the wireless communication network.

A16. The method of any of embodiments A1-A12, wherein the network node implements a Trace Collector Entity, TCE, for the wireless communication network.

A17. The method of any of embodiments A1-A16, further comprising collecting the QoE measurements according to the measurement configuration.

AA. The method of any of the previous embodiments, further comprising: providing user data; and forwarding the user data to a host computer via the transmission to a base station.

Group AA Embodiments

AA1. A method performed by a wireless communication device configured for use in a wireless communication network, the method comprising: transmitting, to a network node, a measurement report that reports quality of experience, QoE, measured by a wireless communication device and that includes: a test identity identifying a test for which the measurement report reports QoE; and/or a test set identity identifying a test set for which the measurement report reports QoE.

AA2. The method of embodiment AA1 , wherein the test set identity identifies a test set for one of different variations of a testing parameter for a split test of QoE and/or wherein the test identity identifies a split test of QoE for which the measurement report reports QoE.

AA3. The method of embodiment AA2, wherein the test set identity is a first test set identity identifying a first test set for a first one of the different variations of the testing parameter, and wherein the method further comprises transmitting a second measurement report that reports QoE measured by the wireless communication device and that includes a second test set identity identifying a second test set for a second one of the different variations of the testing parameter.

AA4. The method of any of embodiments AA2-AA3, wherein the testing parameter comprises: a network slice supporting an application or service, wherein different variations of the testing parameter comprise different network slices supporting the same application or service; a network system supporting an application or service, wherein different variations of the testing parameter comprise different network systems supporting the same application or service; a radio access technology via which an application or service is provided, wherein different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided; an area in which an application or service is provided, wherein different variations of the testing parameter comprise different areas in which the same application or service is provided; or a scheduling priority according to which traffic of an application or service is scheduled, wherein different variations of the testing parameter comprise different scheduling priorities according to which traffic for the same application or service is scheduled.

AA5. The method of any of embodiments AA2-AA3, wherein the testing parameter comprises: an application or service, wherein different variations of the testing parameter comprise different applications or services such that the split test tests QoE for the different applications or services; or a set of applications or services that includes a target application or service, wherein different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test tests QoE for the different sets of applications or services.

AA6. The method of any of embodiments AA2-AA3, wherein the testing parameter comprises a wireless communication device radio access capability, wherein different variations of the testing parameter comprise different values of the wireless communication device radio access capability.

AA7. The method of embodiment AA6, wherein the wireless communication device radio access capability is a maximum bandwidth capability, a maximum number of component carriers supported, a dual connectivity mode capability, or a handover type capability.

AA8. The method of any of embodiments AA2-AA3, wherein the testing parameter comprises: radio conditions under which an application or service is provided, wherein different variations of the testing parameter comprise different radio conditions under which the same application or service is provided; or a physical layer transmission configuration according to which transmissions for an application or service are made, wherein different variations of the testing parameter comprise different physical layer transmission configurations according to which transmissions for the same application or service are made.

AA9. The method of any of embodiments AA1-AA8, wherein the network node is in a core network of the wireless communication network.

AA10. The method of any of embodiments AA1-AA8, wherein the network node is an operations, administration, and maintenance node for the wireless communication network.

AA11. The method of any of embodiments AA1-AA8, wherein the network node is in a radio access network of the wireless communication network.

AA12. The method of any of embodiments AA1-AA8, wherein the network node implements a Trace Collector Entity, TCE, for the wireless communication network.

Group B Embodiments

B1. A method performed by a network node configured for use in a wireless communication network, the method comprising: configuring a split test of quality of experience, QoE, under different variations of a testing parameter.

B2. The method of embodiment B1 , further comprising transmitting, to a wireless communication device served by the wireless communication network, a measurement configuration that defines configuration information for collecting QoE measurements which measure QoE under one of the different variations of the testing parameter.

B3. The method of embodiment B2, wherein the measurement configuration indicates the QoE measurements are for the split test of QoE.

B4. The method of any of embodiments B2-B3, wherein the measurement configuration includes a test identity identifying the split test.

B5. The method of any of embodiments B2-B4, wherein the measurement configuration includes a test set identity identifying a test set for one of the different variations of the testing parameter.

B6. The method of any of embodiments B1-B5, wherein said configuring comprises: assigning different test set identifiers to different test sets for testing QoE under respective variations of the testing parameter; and configuring the different test sets as identified by the assigned test set identifiers.

B7. The method of embodiment B6, wherein configuring the different test sets comprises, for each of the test sets, transmitting a measurement configuration that includes the respective test set identity assigned to the test set and that defines configuration information for collecting QoE measurements which measure QoE under the respective variation of the testing parameter.

B8. The method of embodiment B7, comprising transmitting different ones of the measurement configurations to different wireless communication devices.

B9. The method of embodiment B7, comprising transmitting different ones of the measurement configurations to the same wireless communication device, for collection of QoE measurements at different times according to the different measurement configurations.

B10. The method of any of embodiments B1-B9, further comprising deciding the testing parameter for the split test and/or deciding the variations of the testing parameter for the split test, and wherein said configuring is performed according to said deciding.

B11. The method of any of embodiments B1-B11 , further comprising selecting one or more wireless communication devices to measure QoE for the split test.

B12. The method of embodiment B11 , wherein said split test tests QoE under the same control conditions but under different variations of the testing parameter, and wherein the one or more wireless communication devices are selected based on the control conditions and the testing parameter. B13. The method of any of embodiments B1-E312, wherein said configuring comprises configuring a first group of one or more wireless communication devices to test QoE under a first variation of the testing parameter and a second group of one or more wireless communication devices to test QoE under a second variation of the testing parameter.

B14. The method of any of embodiments B1-B12, wherein said configuring comprises configuring the same wireless communication device to test QoE, during a first time interval, under a first variation of the testing parameter and to test QoE, during a second time interval, under a second variation of the testing parameter.

B15. The method of any of embodiments B1-B14, wherein said configuring comprises transmitting configuration information for the split test to another network node in the wireless communication network and/or to one or more wireless communication devices that are to measure QoE for the split test.

B16. The method of embodiment B15, wherein the configuration information configures one or more parameters of the split test, wherein the one or more parameters comprise one or more of: the testing parameter; the variations of the testing parameter; a type of service or application for which the split test is applicable; a network slice for which the split test is applicable; a radio access technology for which the split test is applicable; groups of wireless communication devices to measure QoE under different respective variations of the testing parameter; a geographical area over which the split test is to be performed; a duration or time period over which the split test is to be performed; and one or more QoE measurement configurations that configure QoE measurements for the split test.

B17. The method of any of embodiments B15-B16, wherein said transmitting comprises transmitting the configuration information for the split test to a radio network node in the wireless communication network.

B18. The method of any of embodiments B15-B17, wherein the configuration information includes identities respectively assigned to different test tests for testing QoE under the different variations of the testing parameter.

B19. The method of any of embodiments B1-E318, wherein the testing parameter comprises: a network slice supporting an application or service, wherein different variations of the testing parameter comprise different network slices supporting the same application or service; a network system supporting an application or service, wherein different variations of the testing parameter comprise different network systems supporting the same application or service; a radio access technology via which an application or service is provided, wherein different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided; an area in which an application or service is provided, wherein different variations of the testing parameter comprise different areas in which the same application or service is provided; or a scheduling priority according to which traffic of an application or service is scheduled, wherein different variations of the testing parameter comprise different scheduling priorities according to which traffic for the same application or service is scheduled.

B20. The method of any of embodiments B1-B18, wherein the testing parameter comprises: an application or service, wherein different variations of the testing parameter comprise different applications or services such that the split test tests QoE for the different applications or services; or a set of applications or services that includes a target application or service, wherein different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test tests QoE for the different sets of applications or services.

B21. The method of any of embodiments B1-B18, wherein the testing parameter comprises a wireless communication device radio access capability, wherein different variations of the testing parameter comprise different values of the wireless communication device radio access capability. B22. The method of embodiment B21 , wherein the wireless communication device radio access capability is a maximum bandwidth capability, a maximum number of component carriers supported, a dual connectivity mode capability, or a handover type capability.

B23. The method of any of embodiments B1-B18, wherein the testing parameter comprises: radio conditions under which an application or service is provided, wherein different variations of the testing parameter comprise different radio conditions under which the same application or service is provided; or a physical layer transmission configuration according to which transmissions for an application or service are made, wherein different variations of the testing parameter comprise different physical layer transmission configurations according to which transmissions for the same application or service are made.

B24. The method of any of embodiments B1-B23, further comprising receiving QoE measurements that measure QoE under the different variations of the test parameter for said split test.

B25. The method of embodiment B24, further comprising evaluating the QoE measurements to determine an impact of the testing parameter on QoE.

B26. The method of embodiment B25, further comprising adapting one or more parameters in the wireless communication network based on said evaluating.

B27. The method of any of embodiments B1-B26, wherein the network node is in a core network of the wireless communication network.

B28. The method of any of embodiments B1-B26, wherein the network node is an operations, administration, and maintenance node for the wireless communication network.

B29. The method of any of embodiments B1-B26, wherein the network node implements a Trace Collector Entity, TCE, for the wireless communication network.

B30. The method of any of embodiments B1-B26, wherein the network node is in a radio access network of the wireless communication network. B31. The method of embodiment B30, further comprising receiving, from another network node, configuration information according to which the split test is to be configured, and wherein said configuring comprises configuring the split test according to the configuration information.

B32. The method of embodiment B31, wherein the configuration information configures one or more parameters of the split test, wherein the one or more parameters comprise one or more of: the testing parameter; the variations of the testing parameter; a type of service or application for which the split test is applicable; a network slice for which the split test is applicable; a radio access technology for which the split test is applicable; groups of wireless communication devices to measure QoE under different respective variations of the testing parameter; a geographical area over which the split test is to be performed; a duration or time period over which the split test is to be performed; and one or more QoE measurement configurations that configure QoE measurements for the split test.

B33. The method of any of embodiments B31-B32, wherein the configuration information includes identities respectively assigned to different test sets that test QoE under the different variations of the testing parameter.

BB. The method of any of the previous embodiments, further comprising: obtaining user data; and forwarding the user data to a host computer or a wireless device.

Group BB Embodiments

BB1. A method performed by a network node configured for use in a wireless communication network, the method comprising: transmitting, to a wireless communication device served by the wireless communication network, a measurement configuration that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration: indicates the QoE measurements are for a split test of QoE; and/or includes a test identity identifying a test that is a target for the measurement configuration; and/or includes a test set identity identifying a test set that is a target for the measurement configuration.

BB2. The method of embodiment BB1, wherein the measurement configuration indicates the QoE measurements are for a split test of QoE.

BB3. The method of any of embodiments BB1-BB2, wherein the measurement configuration includes the test identity and/or the test set identity.

BB4. The method of any of embodiments BB1-BB3, wherein the measurement configuration is transmitted as part of configuring a split test of QoE under different variations of a testing parameter, wherein the test identity identifies the split test and/or the test set identity identifies a test set for a certain one of the different variations of the testing parameter.

BB5. The method of embodiment BB4, wherein said transmitting is performed as part of transmitting, to the same wireless communication device or different wireless communication devices served by the wireless communication network, different measurement configurations that include different test set identities identifying test sets for different respective variations of the testing parameter.

BB6. The method of embodiment BB5, comprising transmitting different ones of the measurement configurations to different wireless communication devices.

BB7. The method of embodiment BB5, comprising transmitting different ones of the measurement configurations to the same wireless communication device, for collection of QoE measurements at different times according to the different measurement configurations.

BB8. The method of any of embodiments BB4-BB7, further comprising deciding the testing parameter for the split test and/or deciding the variations of the testing parameter for the split test. BB9. The method of any of embodiments BB4-BB8, further comprising selecting one or more wireless communication devices to measure QoE for the split test.

BB10. The method of embodiment BB9, wherein said split test tests QoE under the same control conditions but under different variations of the testing parameter, and wherein the one or more wireless communication devices are selected based on the control conditions and the testing parameter.

BB11. The method of any of embodiments BB4-BB10, wherein the testing parameter comprises: a network slice supporting an application or service, wherein different variations of the testing parameter comprise different network slices supporting the same application or service; a network system supporting an application or service, wherein different variations of the testing parameter comprise different network systems supporting the same application or service; a radio access technology via which an application or service is provided, wherein different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided; an area in which an application or service is provided, wherein different variations of the testing parameter comprise different areas in which the same application or service is provided; or a scheduling priority according to which traffic of an application or service is scheduled, wherein different variations of the testing parameter comprise different scheduling priorities according to which traffic for the same application or service is scheduled.

BB12. The method of any of embodiments BB4-BB10, wherein the testing parameter comprises: an application or service, wherein different variations of the testing parameter comprise different applications or services such that the split test tests QoE for the different applications or services; or a set of applications or services that includes a target application or service, wherein different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test tests QoE for the different sets of applications or services. BB13. The method of any of embodiments BB4-BB10, wherein the testing parameter comprises a wireless communication device radio access capability, wherein different variations of the testing parameter comprise different values of the wireless communication device radio access capability.

BB14. The method of embodiment BB13, wherein the wireless communication device radio access capability is a maximum bandwidth capability, a maximum number of component carriers supported, a dual connectivity mode capability, or a handover type capability.

BB15. The method of any of embodiments BB4-BB10, wherein the testing parameter comprises: radio conditions under which an application or service is provided, wherein different variations of the testing parameter comprise different radio conditions under which the same application or service is provided; or a physical layer transmission configuration according to which transmissions for an application or service are made, wherein different variations of the testing parameter comprise different physical layer transmission configurations according to which transmissions for the same application or service are made.

BB16. The method of any of embodiments BB1-BB15, further comprising receiving the QoE measurements collected according to the configuration information.

BB17. The method of embodiment BB16, further comprising evaluating the QoE measurements to determine an impact of a testing parameter on QoE.

BB18. The method of embodiment BB17, further comprising adapting one or more parameters in the wireless communication network based on said evaluating.

BB19. The method of any of embodiments BB1-BB18, wherein the network node is in a core network of the wireless communication network.

BB20. The method of any of embodiments BB1-BB18, wherein the network node is an operations, administration, and maintenance node for the wireless communication network. BB21. The method of any of embodiments BB1-BB18, wherein the network node is in a radio access network of the wireless communication network.

BB22. The method of any of embodiments BB1-BB18, wherein the network node implements a Trace Collector Entity, TCE, for the wireless communication network.

Group BBB Embodiments BBB1. A method performed by a network node configured for use in a wireless communication network, the method comprising: receiving a first measurement report that reports quality of experience, QoE, measured by a wireless communication device and that includes: a test identity identifying a test for which the first measurement report reports QoE; and/or a first test set identity identifying a first test set for which the first measurement report reports QoE.

BBB2. The method of embodiment BBB1 , wherein the test is a split test that tests QoE under different variations of a testing parameter and/or wherein the first test set is a test set for a first one of the different variations of the testing parameter.

BBB3. The method of embodiment BBB2, further comprising receiving a second measurement report that reports QoE measured by a wireless communication device and that includes the test identity and/or a second test set identity identifying a second test set for which the second measurement report reports QoE, wherein the second test set is a test set for a second one of the different variations of the testing parameter.

BBB4. The method of embodiment BBB3, further comprising evaluating the first and second measurement reports to determine an impact of the testing parameter on QoE.

BBB5. The method of embodiment BBB4, further comprising adapting one or more parameters in the wireless communication network based on said evaluating. BBB6. The method of any of embodiments BBB2-BBB5, further comprising transmitting, to another network node, signaling that includes the first and second measurement reports and that indicates the testing parameter.

BBB7. The method of any of embodiments BBB1-BBB6, wherein the testing parameter comprises: a network slice supporting an application or service, wherein different variations of the testing parameter comprise different network slices supporting the same application or service; a network system supporting an application or service, wherein different variations of the testing parameter comprise different network systems supporting the same application or service; a radio access technology via which an application or service is provided, wherein different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided; an area in which an application or service is provided, wherein different variations of the testing parameter comprise different areas in which the same application or service is provided; or a scheduling priority according to which traffic of an application or service is scheduled, wherein different variations of the testing parameter comprise different scheduling priorities according to which traffic for the same application or service is scheduled.

BBB8. The method of any of embodiments BBB1-BBB6, wherein the testing parameter comprises: an application or service, wherein different variations of the testing parameter comprise different applications or services such that the split test tests QoE for the different applications or services; or a set of applications or services that includes a target application or service, wherein different variations of the testing parameter comprise different sets of applications or services that include the target application or service such that the split test tests QoE for the different sets of applications or services.

BBB9. The method of any of embodiments BBB1-BBB6, wherein the testing parameter comprises a wireless communication device radio access capability, wherein different variations of the testing parameter comprise different values of the wireless communication device radio access capability.

BBB10. The method of embodiment BBB9, wherein the wireless communication device radio access capability is a maximum bandwidth capability, a maximum number of component carriers supported, a dual connectivity mode capability, or a handover type capability.

BBB11. The method of any of embodiments BBB1-BBB6, wherein the testing parameter comprises: radio conditions under which an application or service is provided, wherein different variations of the testing parameter comprise different radio conditions under which the same application or service is provided; or a physical layer transmission configuration according to which transmissions for an application or service are made, wherein different variations of the testing parameter comprise different physical layer transmission configurations according to which transmissions for the same application or service are made.

BBB12. The method of any of embodiments BBB1-BBB11 , wherein the network node is in a core network of the wireless communication network.

BBB13. The method of any of embodiments BBB1-BBB11 , wherein the network node is an operations, administration, and maintenance node for the wireless communication network.

BBB14. The method of any of embodiments BBB1-BBB11 , wherein the network node is in a radio access network of the wireless communication network.

BBB15. The method of any of embodiments BBB1-BBB11 , wherein the network node implements a Trace Collector Entity, TCE, for the wireless communication network.

Group C Embodiments C1. A wireless device configured to perform any of the steps of any of the Group A or Group AA embodiments. C2. A wireless device comprising processing circuitry configured to perform any of the steps of any of the Group A or Group AA embodiments.

C3. A wireless device comprising: communication circuitry; and processing circuitry configured to perform any of the steps of any of the Group A or Group AA embodiments.

C4. A wireless device comprising: processing circuitry configured to perform any of the steps of any of the Group A or Group AA embodiments; and power supply circuitry configured to supply power to the wireless device.

C5. A wireless device comprising: processing circuitry and memory, the memory containing instructions executable by the processing circuitry whereby the wireless device is configured to perform any of the steps of any of the Group A or Group AA embodiments.

C6. A user equipment (UE) comprising: an antenna configured to send and receive wireless signals; radio front-end circuitry connected to the antenna and to processing circuitry, and configured to condition signals communicated between the antenna and the processing circuitry; the processing circuitry being configured to perform any of the steps of any of the Group A or Group AA embodiments; an input interface connected to the processing circuitry and configured to allow input of information into the UE to be processed by the processing circuitry; an output interface connected to the processing circuitry and configured to output information from the UE that has been processed by the processing circuitry; and a battery connected to the processing circuitry and configured to supply power to the UE.

C7. A computer program comprising instructions which, when executed by at least one processor of a wireless device, causes the wireless device to carry out the steps of any of the Group A or Group AA embodiments.

C8. A carrier containing the computer program of embodiment C7, wherein the carrier is one of an electronic signal, optical signal, radio signal, or computer readable storage medium.

C9. A radio network node configured to perform any of the steps of any of the Group B, Group BB, or Group BBB embodiments.

C10. A radio network node comprising processing circuitry configured to perform any of the steps of any of the Group B, Group BB, or Group BBB embodiments.

C11. A radio network node comprising: communication circuitry; and processing circuitry configured to perform any of the steps of any of the Group B, Group BB, or Group BBB embodiments.

C12. A radio network node comprising: processing circuitry configured to perform any of the steps of any of the Group B, Group BB, or Group BBB embodiments; power supply circuitry configured to supply power to the radio network node.

C13. A radio network node comprising: processing circuitry and memory, the memory containing instructions executable by the processing circuitry whereby the radio network node is configured to perform any of the steps of any of the Group B, Group BB, or Group BBB embodiments.

C14. The radio network node of any of embodiments C9-C13, wherein the radio network node is a base station.

C15. A computer program comprising instructions which, when executed by at least one processor of a radio network node, causes the radio network node to carry out the steps of any of the Group B, Group BB, or Group BBB embodiments.

C16. The computer program of embodiment C14, wherein the radio network node is a base station.

C17. A carrier containing the computer program of any of embodiments C15-C16, wherein the carrier is one of an electronic signal, optical signal, radio signal, or computer readable storage medium.

Group D Embodiments

D1. A communication system including a host computer comprising: processing circuitry configured to provide user data; and a communication interface configured to forward the user data to a cellular network for transmission to a user equipment (UE), wherein the cellular network comprises a base station having a radio interface and processing circuitry, the base station’s processing circuitry configured to perform any of the steps of any of the Group B, Group BB, or Group BBB embodiments.

D2. The communication system of the previous embodiment further including the base station.

D3. The communication system of the previous 2 embodiments, further including the UE, wherein the UE is configured to communicate with the base station.

D4. The communication system of the previous 3 embodiments, wherein: the processing circuitry of the host computer is configured to execute a host application, thereby providing the user data; and the UE comprises processing circuitry configured to execute a client application associated with the host application.

D5. A method implemented in a communication system including a host computer, a base station and a user equipment (UE), the method comprising: at the host computer, providing user data; and at the host computer, initiating a transmission carrying the user data to the UE via a cellular network comprising the base station, wherein the base station performs any of the steps of any of the Group B, Group BB, or Group BBB embodiments. D6. The method of the previous embodiment, further comprising, at the base station, transmitting the user data.

D7. The method of the previous 2 embodiments, wherein the user data is provided at the host computer by executing a host application, the method further comprising, at the UE, executing a client application associated with the host application.

D8. A user equipment (UE) configured to communicate with a base station, the UE comprising a radio interface and processing circuitry configured to perform any of the previous 3 embodiments.

D9. A communication system including a host computer comprising: processing circuitry configured to provide user data; and a communication interface configured to forward user data to a cellular network for transmission to a user equipment (UE), wherein the UE comprises a radio interface and processing circuitry, the UE’s components configured to perform any of the steps of any of the Group A or Group AA embodiments.

D10. The communication system of the previous embodiment, wherein the cellular network further includes a base station configured to communicate with the UE.

D11. The communication system of the previous 2 embodiments, wherein: the processing circuitry of the host computer is configured to execute a host application, thereby providing the user data; and the UE’s processing circuitry is configured to execute a client application associated with the host application.

D12. A method implemented in a communication system including a host computer, a base station and a user equipment (UE), the method comprising: at the host computer, providing user data; and at the host computer, initiating a transmission carrying the user data to the UE via a cellular network comprising the base station, wherein the UE performs any of the steps of any of the Group A or Group AA embodiments.

D13. The method of the previous embodiment, further comprising at the UE, receiving the user data from the base station.

D14. A communication system including a host computer comprising: communication interface configured to receive user data originating from a transmission from a user equipment (UE) to a base station, wherein the UE comprises a radio interface and processing circuitry, the UE’s processing circuitry configured to perform any of the steps of any of the Group A or Group AA embodiments.

D15. The communication system of the previous embodiment, further including the UE.

D16. The communication system of the previous 2 embodiments, further including the base station, wherein the base station comprises a radio interface configured to communicate with the UE and a communication interface configured to forward to the host computer the user data carried by a transmission from the UE to the base station.

D17. The communication system of the previous 3 embodiments, wherein: the processing circuitry of the host computer is configured to execute a host application; and the UE’s processing circuitry is configured to execute a client application associated with the host application, thereby providing the user data.

D18. The communication system of the previous 4 embodiments, wherein: the processing circuitry of the host computer is configured to execute a host application, thereby providing request data; and the UE’s processing circuitry is configured to execute a client application associated with the host application, thereby providing the user data in response to the request data.

D19. A method implemented in a communication system including a host computer, a base station and a user equipment (UE), the method comprising: at the host computer, receiving user data transmitted to the base station from the UE, wherein the UE performs any of the steps of any of the Group A or Group AA embodiments.

D20. The method of the previous embodiment, further comprising, at the UE, providing the user data to the base station.

D21. The method of the previous 2 embodiments, further comprising: at the UE, executing a client application, thereby providing the user data to be transmitted; and at the host computer, executing a host application associated with the client application.

D22. The method of the previous 3 embodiments, further comprising: at the UE, executing a client application; and at the UE, receiving input data to the client application, the input data being provided at the host computer by executing a host application associated with the client application, wherein the user data to be transmitted is provided by the client application in response to the input data.

D23. A communication system including a host computer comprising a communication interface configured to receive user data originating from a transmission from a user equipment (UE) to a base station, wherein the base station comprises a radio interface and processing circuitry, the base station’s processing circuitry configured to perform any of the steps of any of the Group B, Group BB, or Group BBB embodiments.

D24. The communication system of the previous embodiment further including the base station.

D25. The communication system of the previous 2 embodiments, further including the UE, wherein the UE is configured to communicate with the base station.

D26. The communication system of the previous 3 embodiments, wherein: the processing circuitry of the host computer is configured to execute a host application; the UE is configured to execute a client application associated with the host application, thereby providing the user data to be received by the host computer.

D27. A method implemented in a communication system including a host computer, a base station and a user equipment (UE), the method comprising: at the host computer, receiving, from the base station, user data originating from a transmission which the base station has received from the UE, wherein the UE performs any of the steps of any of the Group A or Group AA embodiments.

D28. The method of the previous embodiment, further comprising at the base station, receiving the user data from the UE. D29. The method of the previous 2 embodiments, further comprising at the base station, initiating a transmission of the received user data to the host computer.

Claims

CLAIMS What is claimed is:

1. A method performed by a wireless communication device (12) configured for use in a wireless communication network (10), the method comprising: receiving (200), from a network node (20) in the wireless communication network (10), a measurement configuration (40) that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration (40): indicates the QoE measurements are for a split test (30) of QoE; and/or includes a test identity (31) identifying a test that is a target for the measurement configuration (40); and/or includes a test set identity (36A, 36B) identifying a test set that is a target for the measurement configuration (40).

2. The method of claim 1 , wherein the measurement configuration (40) indicates the QoE measurements are for a split test (30) of QoE.

3. The method of any of claims 1-2, wherein the measurement configuration (40) includes the test identity (31) and/or the test set identity (36A, 36B).

4. The method of any of claims 1-3, wherein the QoE measurements are for a split test (30) of QoE under different variations of a testing parameter, wherein the test set identity (36A, 36B) identifies the test set for one of the different variations of the testing parameter.

5. The method of claim 4, wherein said receiving is performed as part of receiving multiple different measurement configurations (40) that include different test set identities identifying different respective test sets for different respective variations of the testing parameter, wherein the different measurement configurations (40) define configuration information for collecting QoE measurements at different times according to the different measurement configurations (40).

6. The method of any of claims 4-5, wherein the testing parameter comprises: a network slice supporting an application or service, wherein different variations of the testing parameter comprise different network slices supporting the same application or service; or an area in which an application or service is provided, wherein different variations of the testing parameter comprise different areas in which the same application or service is provided.

7. The method of any of claims 4-5, wherein the testing parameter comprises an application or service, wherein different variations of the testing parameter comprise different applications or services such that the split test (30) tests QoE for the different applications or services.

8. The method of any of claims 4-5, wherein the testing parameter comprises: a network system supporting an application or service, wherein different variations of the testing parameter comprise different network systems supporting the same application or service; or a radio access technology via which an application or service is provided, wherein different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided.

9. The method of any of claims 1-8, further comprising transmitting a measurement report (42) that reports QoE measurements collected according to the configuration information.

10. The method of claim 9, wherein the measurement report (42) includes the test identity (31) and/or the test set identity (36A, 36B).

11. The method of any of claims 1-10, further comprising collecting the QoE measurements according to the measurement configuration (40).

12. A method performed by a network node (20) configured for use in a wireless communication network (10), the method comprising: transmitting (320), to a wireless communication device (12) served by the wireless communication network (10), a measurement configuration (40) that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration (40): indicates the QoE measurements are for a split test (30) of QoE; and/or includes a test identity (31) identifying a test that is a target for the measurement configuration (40); and/or includes a test set identity (36A, 36B) identifying a test set that is a target for the measurement configuration (40).

13. The method of claim 12, wherein the measurement configuration (40) indicates the QoE measurements are for a split test (30) of QoE.

14. The method of any of claims 12-13, wherein the measurement configuration (40) includes the test identity (31) and/or the test set identity (36A, 36B).

15. The method of any of claims 12-14, wherein the measurement configuration (40) is transmitted as part of configuring a split test (30) of QoE under different variations of a testing parameter, wherein the test identity (31) identifies the split test (30) and/or the test set identity (36A, 36B) identifies a test set for a certain one of the different variations of the testing parameter.

16. The method of claim 15, wherein said transmitting is performed as part of transmitting, to the same wireless communication device (12) or different wireless communication devices (12) served by the wireless communication network (10), different measurement configurations (40) that include different test set identities identifying test sets for different respective variations of the testing parameter.

17. The method of claim 16, comprising: transmitting different ones of the measurement configurations (40) to different wireless communication devices (12); or transmitting different ones of the measurement configurations (40) to the same wireless communication device (12), for collection of QoE measurements at different times according to the different measurement configurations (40).

18. The method of any of claims 15-17, further comprising selecting one or more wireless communication devices (12) to measure QoE for the split test (30).

19. The method of claim 18, wherein said split test (30) tests QoE under the same control conditions but under different variations of the testing parameter, and wherein the one or more wireless communication devices (12) are selected based on the control conditions and the testing parameter.

20. The method of any of claims 15-19, wherein the testing parameter comprises: a network slice supporting an application or service, wherein different variations of the testing parameter comprise different network slices supporting the same application or service; or an area in which an application or service is provided, wherein different variations of the testing parameter comprise different areas in which the same application or service is provided.

21. The method of any of claims 15-19, wherein the testing parameter comprises an application or service, wherein different variations of the testing parameter comprise different applications or services such that the split test (30) tests QoE for the different applications or services.

22. The method of any of claims 15-19, wherein the testing parameter comprises: a network system supporting an application or service, wherein different variations of the testing parameter comprise different network systems supporting the same application or service; or a radio access technology via which an application or service is provided, wherein different variations of the testing parameter comprise different radio access technologies via which the same application or service is provided.

23. The method of any of claims 12-22, further comprising receiving the QoE measurements collected according to the configuration information.

24. The method of claim 23, further comprising: evaluating the QoE measurements to determine an impact of a testing parameter on QoE; and adapting one or more parameters in the wireless communication network (10) based on said evaluating.

25. The method of any of claims 23-24, wherein said receiving comprises receiving a measurement report (42) that reports the QoE measurements collected according to the configuration information, wherein the measurement report (42) includes the test identity (31) and/or the test set identity (36A, 36B).

26. A wireless communication device (12) configured for use in a wireless communication network (10), the wireless communication device (12) configured to: receive, from a network node (20) in the wireless communication network (10), a measurement configuration (40) that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration (40): indicates the QoE measurements are for a split test (30) of QoE; and/or includes a test identity (31) identifying a test that is a target for the measurement configuration (40); and/or includes a test set identity (36A, 36B) identifying a test set that is a target for the measurement configuration (40).

27. The wireless communication device (12) of claim 26, configured to perform the method of any of claims 2-11.

28. A network node (20) configured for use in a wireless communication network (10), the network node (20) configured to: transmit, to a wireless communication device (12) served by the wireless communication network (10), a measurement configuration (40) that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration (40): indicates the QoE measurements are for a split test (30) of QoE; and/or includes a test identity (31) identifying a test that is a target for the measurement configuration (40); and/or includes a test set identity (36A, 36B) identifying a test set that is a target for the measurement configuration (40).

29. The network node (20) of claim 28, configured to perform the method of any of claims 13-25.

30. A computer program comprising instructions which, when executed by at least one processor of a wireless communication device (12), causes the wireless communication device (12) to perform the method of any of claims 1-11.

31. A computer program comprising instructions which, when executed by at least one processor of a network node (20), causes the network node (20) to perform the method of any of claims 12-25.

32. A carrier containing the computer program of any of claims 30-31 , wherein the carrier is one of an electronic signal, optical signal, radio signal, or computer readable storage medium.

33. A wireless communication device (12) configured for use in a wireless communication network (10), the wireless communication device (12) comprising: communication circuitry (720); and processing circuitry (710) configured to receive, from a network node (20) in the wireless communication network (10), a measurement configuration (40) that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration (40): indicates the QoE measurements are for a split test (30) of QoE; and/or includes a test identity (31) identifying a test that is a target for the measurement configuration (40); and/or includes a test set identity (36A, 36B) identifying a test set that is a target for the measurement configuration (40).

34. The wireless communication device (12) of claim 33, the processing circuitry (710) configured to perform the method of any of claims 2-11.

35. A network node (20) configured for use in a wireless communication network (10), the network node (20) comprising: communication circuitry (820); and processing circuitry (810) configured to transmit, to a wireless communication device (12) served by the wireless communication network (10), a measurement configuration (40) that defines configuration information for collecting quality of experience, QoE, measurements, wherein the measurement configuration (40): indicates the QoE measurements are for a split test (30) of QoE; and/or includes a test identity (31) identifying a test that is a target for the measurement configuration (40); and/or includes a test set identity (36A, 36B) identifying a test set that is a target for the measurement configuration (40).

36. The network node (20) of claim 35, the processing circuitry (810) configured to perform the method of any of claims 13-25.