WO2022152305A1

WO2022152305A1 - Extended reality data transmission method and apparatus

Info

Publication number: WO2022152305A1
Application number: PCT/CN2022/072401
Authority: WO
Inventors: 廖树日; 窦圣跃; 吴健; 吴可镝; 沈慧; 马志斌
Original assignee: 华为技术有限公司
Priority date: 2021-01-18
Filing date: 2022-01-17
Publication date: 2022-07-21
Also published as: CN114828104A

Abstract

The present application provides an extended reality (XR) data transmission method and apparatus. The method comprises: acquiring network transmission statistics information, source parameter information and terminal parameter information (710); acquiring user image quality experience information according to the network transmission statistics information and the source parameter information (720); acquiring user interaction experience information according to the network transmission statistics information, the source parameter information and the terminal parameter information (730); acquiring quality evaluation index information of a network according to the user image quality experience information and the user interaction experience information (740); and communicating with a communication device according to the quality evaluation index information of the network (750). Since the quality evaluation index information of the network may represent the transmission quality of XR data in the network, by means of said method, the service experience performance of the XR data in network transmission may thus be systematically evaluated to thereby guide a network operator to maintain and optimize the network for the needs of the XR data.

Description

Extended reality data transmission method and device

technical field

The present application relates to the field of communication technologies, and in particular, to an extended reality data transmission method and device.

Background technique

In wireless communication networks, extended reality (XR) technology has the advantages of multi-view and strong interactivity, which can provide users with a brand-new visual experience, and has great application value and commercial potential. XR includes technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), which can be widely used in entertainment, gaming, medical, advertising, industry, online education, and engineering and many other fields.

The transmission of XR data in the network has real-time and high-speed requirements, and measuring whether these requirements are met generally depends on user experience. However, the user's experience of XR data network transmission is a subjective feeling of the user, and it is impossible to accurately measure the objective impact of XR data in network transmission, so it cannot systematically help network operators to optimize the network for XR data. Therefore, how to measure the impact of XR data in network transmission more systematically and objectively, so as to guide network design and guide network operators to optimize the network for XR data, has become an urgent problem to be solved.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a communication method and apparatus.

In the first aspect, an embodiment of the present application provides a communication method, which may be performed by a wireless access network device, server, or centralized controller, or may be performed by a component (such as a processing device, chip, or chip system, etc.) execution, including: obtaining network transmission statistical information, source parameter information and terminal parameter information. According to the network transmission statistical information and the information source parameter information, user image quality experience information is obtained. User interaction experience information is obtained according to the network transmission statistical information, the source parameter information and the terminal parameter information. According to the user image quality experience information and the user interaction experience information, network quality evaluation index information is obtained. Communicate with the communication device according to the quality evaluation index information of the network. The impact of network transmission on the XR service experience quality can be reflected through the network quality evaluation index information, which can provide more flexible indicators for the transmission quality of XR data in the network, thereby providing controllable and controllable indicators for network maintenance and optimization for XR data requirements. Quantitative evaluation basis.

Optionally, the network transmission statistics indicate a packet error rate (PER) or a block error rate (BLER), packet error conditions, packet delay conditions, average transmission delay, and packet delay budget ( One or more of packet delay budget (PDB), or frame delay budget (frame delay budget, FDB). Among them, PER (also known as Packet Error Rate) represents the ratio of the number of packets received in error to the total number of packets received. BLER represents the ratio of the number of blocks received in error to the total number of blocks received. The PDB indicates how long a packet needs to be transmitted correctly. Through the above-mentioned various specific network transmission statistics, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to meet the delay requirements of XR data on the network. maintenance and optimization.

Optionally, the information source parameter information indicates the fragmentation information or stripe information of the information source, the information of the source data unit to which the packet belongs, the group of picture (group of picture, GOP) information or the refresh period of the source data, the source of the information. One or more of the frame rate of the data or the encoding method of the source. The slice information or slice information of the source indicates whether the data frame of the source data unit is sliced or sliced. A video frame can be encoded according to region division during encoding, and the divided region is called a video frame slice or a video frame slice. The refresh period of the source data indicates how often the data frame of the source data unit is refreshed. The encoding method of the information source may be a scalable encoding method. Through the above-mentioned various specific source parameter information, it is possible to measure the influence of transmission errors when XR data is transmitted in the network from different dimensions, so as to guide network operators to maintain and optimize the network according to the reliability requirements of XR data.

Optionally, the terminal parameter information indicates the buffer processing capability of the terminal. Through the above various specific terminal parameter information, it is possible to measure the influence of transmission errors when XR data is transmitted in the network from different dimensions, so as to guide network operators to maintain and optimize the network according to the reliability requirements of XR data.

With reference to the first aspect, in some embodiments of the first aspect, the radio access network device obtains the above-mentioned source parameter information from a media information layer of the core network, and the above-mentioned media information layer is defined between the application layer and the transport layer. The core network obtains the above-mentioned source parameter information by parsing the media information layer, and encapsulates the source parameter information in general packet radio system tunneling protocol user (GTP-U) information and sends it to the wireless access The wireless access network device obtains the source parameter information by parsing the GTP-U information. Through the above information source parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data. .

With reference to the first aspect, in some embodiments of the first aspect, the radio access network device receives a quality of experience (QoE) report from the terminal, and obtains source parameter information according to the QoE report. Through the above information source parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data. .

Optionally, the radio access network device obtains the QoE configuration information and the configuration information related to the source parameters from the core network, and encapsulates the QoE configuration information and the configuration information related to the source parameters into the QoE configuration container and sends the information through the air interface message. (eg, a radio resource control (RRC) message) is sent to the terminal. The configuration information related to the information source parameter is used by the terminal to generate the information source parameter information according to the configuration information. After receiving the QoE configuration information and the configuration information related to the source parameters, the terminal generates the QoE report and the source parameter information. The terminal encapsulates the QoE report and source parameter information into a QoE report container, and reports the QoE report container to the wireless access network device through air interface information. The radio access network device obtains the QoE report container through the air interface information, and obtains the source parameter information according to the QoE report container. Through the above information source parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data. .

Optionally, the radio access network device may also obtain terminal parameter information according to the above-mentioned QoE report. For example, in the above QoE reporting process, in addition to sending the QoE configuration information and the configuration information related to the source parameters, the core network also sends the configuration information related to the terminal parameters. The configuration information related to the terminal parameters is used by the terminal to generate terminal parameter information according to the configuration information. The wireless access network device encapsulates the above-mentioned QoE configuration information, configuration information related to source parameters, and configuration information related to terminal parameters into a QoE configuration container and sends it to the terminal. After receiving the QoE configuration container, the terminal generates a QoE report, source parameter information, and terminal parameter information, and encapsulates the generated QoE report, source parameter information, and terminal parameter information into a QoE report container and reports it to the wireless access network device. The radio access network device obtains the QoE report container, and obtains source parameter information and terminal parameter information according to the QoE report container. Through the above source parameter information and terminal parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to meet the delay requirements of XR data on the network. maintenance and optimization.

With reference to the first aspect, in some embodiments of the first aspect, the radio access network device receives a QoE report from the terminal, and obtains terminal parameter information according to the QoE report. Through the above terminal parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data.

Optionally, the radio access network device obtains the QoE configuration information and the configuration information related to the terminal parameters from the core network, and encapsulates the QoE configuration information and the configuration information related to the terminal parameters into the QoE configuration container and passes the air interface message (such as RRC message) to the terminal. After receiving the QoE configuration information and the configuration information related to the terminal parameters, the terminal generates a QoE report and terminal parameter information. The terminal encapsulates the QoE report and terminal parameter information into a QoE report container, and reports the QoE report container to the wireless access network device through air interface information. The radio access network device obtains the QoE report container through air interface information, and obtains terminal parameter information according to the QoE report container. Through the above terminal parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data.

With reference to the first aspect, in some embodiments of the first aspect, the wireless access network device obtains the average frame damage rate and/or the position of the error frame of the data frame according to the above-mentioned network transmission statistical information and the above-mentioned information source parameter information, and User image quality experience information is obtained according to the average frame damage rate and/or the position of the erroneous frame. The impact of network transmission statistics and source parameter information on the XR service image quality and experience quality can be reflected by the user image quality experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide more flexible indicators for XR data demand. Provide a controllable and quantifiable evaluation basis for network maintenance and optimization.

With reference to the first aspect, in some embodiments of the first aspect, the wireless access network device obtains the average frame hopping rate and average transmission time of the data frame according to the above-mentioned network transmission statistical information, the above-mentioned source parameter information and the above-mentioned terminal parameter information. delay, and obtain user interaction experience information according to the average frame skip rate and the average transmission delay. The impact of network transmission statistics, source parameter information and terminal parameter information on the XR service interaction experience quality can be reflected through the user interaction experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide more flexible indicators for XR data transmission quality. Network maintenance and optimization of data requirements provide a controllable and quantifiable evaluation basis.

In conjunction with the first aspect, some implementations of the first aspect further include: obtaining first evaluation information and second evaluation information, the first evaluation information indicating the source quality of the XR data, and the second evaluation information indicating the ability to process the XR data . Among them, the source quality of XR data can be used to evaluate one or more of the following indicators of the XR video source and/or audio source: picture quality definition, picture fluency, picture three-dimensionality, picture distortion, frame rate, audio quality, or rendering effects. The capability of processing XR data may be used to evaluate the capability of the XR terminal to process and/or display XR data, such as the supported FOV angle and/or refresh rate, etc. The ability to process XR data can also be used to evaluate one or more of the XR terminal's endurance, wearing comfort, wearing fatigue, portability, or friendliness to visual impairments. Optionally, the first evaluation information and the second evaluation information can be obtained by MOS, POLQA, VQI or VMAF, or by a combination of two or more of MOS, POLQA, VQI and VMAF, or by Obtained by other methods, which is not limited in this application.

Optionally, third evaluation information is obtained according to the quality evaluation index information of the network, the first evaluation information, and the second evaluation information, and the third evaluation information indicates the user experience of the end-to-end process of the XR service, and the end-to-end process includes XR data. generation, transmission of XR data, and processing of XR data. The first evaluation information indicates the source quality of the XR data, which can be understood as being used to evaluate the quality (ie, the source quality) when the XR data is generated. The second evaluation information indicates the capability of processing XR data, which can be understood as an index (ie, terminal quality) used to evaluate the XR terminal when processing XR data. The quality evaluation index information of the network represents the transmission quality of the XR data, and can be understood as being used to evaluate the transmission quality of the XR data in the network (ie, the pipeline quality). The three parts of information of the network quality evaluation index information, the first evaluation information and the second evaluation information can be obtained independently at the corresponding network element.

The user experience of the end-to-end process of the XR service can be obtained by synthesizing the evaluation information of the data source, terminal and transmission pipeline of the XR service, and an end-to-end comprehensive evaluation system can be established for the XR service, and then the network operator can be guided to use the evaluation system to evaluate the network. Maintained and optimized to meet the needs of the XR business.

In a second aspect, an embodiment of the present application provides a communication method, which can be executed by a terminal or by a component of a terminal device (such as a processor, a chip, or a chip system, etc.), including: obtaining network transmission statistical information, Source parameter information and terminal parameter information. According to the network transmission statistical information and the information source parameter information, user image quality experience information is obtained. User interaction experience information is obtained according to the network transmission statistical information, the source parameter information and the terminal parameter information. According to the user image quality experience information and the user interaction experience information, network quality evaluation index information is obtained. Communicate with the communication device according to the quality evaluation index information of the network. The impact of the network on the XR service experience quality can be reflected through the network quality evaluation index information, which can provide more flexible indicators for the transmission quality of XR data in the network, and can provide controllable and quantifiable indicators for network maintenance and optimization for XR data requirements. evaluation basis.

With reference to the second aspect, in some implementations of the second aspect, the terminal obtains the above-mentioned source parameter information through the application layer. For example, the terminal may obtain the above-mentioned source parameter information through the interaction between the application layer and the transport layer, the interaction between the transport layer and the network layer, and the interaction between the network layer and the data link layer. This embodiment can measure the impact of XR data transmission on the XR service experience quality from different dimensions, so as to guide network design and guide network operators to maintain and optimize the network according to the delay requirement of XR data.

With reference to the second aspect, in some embodiments of the second aspect, the terminal receives a quality of experience (QoE) configuration container from a wireless access network device, and obtains source parameter information according to the QoE configuration container. Through the above information source parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data. .

Optionally, the radio access network device obtains the QoE configuration information and the configuration information related to the source parameters from the core network, and encapsulates the QoE configuration information and the configuration information related to the source parameters into the QoE configuration container and sends the information through the air interface message. (eg, a radio resource control (RRC) message) is sent to the terminal. The configuration information related to the information source parameter is used by the terminal to generate the information source parameter information according to the configuration information. After receiving the QoE configuration information and the configuration information related to the source parameters, the terminal generates the QoE report and the source parameter information. Through the above information source parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data. .

Optionally, the terminal may also obtain terminal parameter information according to the above-mentioned QoE configuration container. For example, in the above QoE reporting process, in addition to sending the QoE configuration information and the configuration information related to the source parameters, the core network also sends the configuration information related to the terminal parameters. The configuration information related to the terminal parameters is used by the terminal to generate terminal parameter information according to the configuration information. The wireless access network device encapsulates the above-mentioned QoE configuration information, configuration information related to source parameters, and configuration information related to terminal parameters into a QoE configuration container and sends it to the terminal. The terminal generates a QoE report, source parameter information and terminal parameter information after receiving the QoE configuration container. Through the above source parameter information and terminal parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to meet the delay requirements of XR data on the network. maintenance and optimization.

With reference to the second aspect, in some embodiments of the second aspect, the terminal receives a QoE configuration container from a wireless access network device, and obtains terminal parameter information according to the QoE configuration container. Through the above terminal parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data.

Optionally, the radio access network device obtains the QoE configuration information and the configuration information related to the terminal parameters from the core network, and encapsulates the QoE configuration information and the configuration information related to the terminal parameters into the QoE configuration container and passes the air interface message (such as RRC message) to the terminal. After receiving the QoE configuration information and the configuration information related to the terminal parameters, the terminal generates a QoE report and terminal parameter information. Through the above terminal parameter information, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data.

With reference to the second aspect, in some embodiments of the second aspect, the terminal receives a QoE configuration container from a wireless access network device, and obtains network transmission statistics according to the QoE configuration container. Through the above network transmission statistics, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data. .

Optionally, the radio access network device obtains QoE configuration information and network transmission statistical information from the core network, encapsulates the QoE configuration information and network transmission statistical information into a QoE configuration container, and sends it to the terminal through an air interface message (for example, an RRC message). . The terminal can obtain network transmission statistics after receiving the QoE configuration container. Through the above network transmission statistics, the impact of XR data transmission on the XR service experience quality can be measured from different dimensions, which can guide network design and guide network operators to maintain and optimize the network according to the delay requirements of XR data. .

With reference to the second aspect, in some embodiments of the second aspect, the terminal obtains the average frame damage rate and/or the position of the error frame of the data frame according to the above-mentioned network transmission statistical information and the above-mentioned information source parameter information, and according to the average frame damage Rate and/or error frame position to obtain user picture quality experience information. The impact of network transmission statistics and source parameter information on the XR service image quality and experience quality can be reflected by the user image quality experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide more flexible indicators for XR data demand. Provide a controllable and quantifiable evaluation basis for network maintenance and optimization.

With reference to the second aspect, in some embodiments of the second aspect, the terminal obtains the average frame hopping rate and the average transmission delay of the data frame according to the above-mentioned network transmission statistical information, the above-mentioned information source parameter information and the above-mentioned terminal parameter information, and according to The average frame skip rate and the average transmission delay obtain user interaction experience information. The impact of network transmission statistics, source parameter information and terminal parameter information on the XR service interaction experience quality can be reflected through the user interaction experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide more flexible indicators for XR data transmission quality. Network maintenance and optimization of data requirements provide a controllable and quantifiable evaluation basis.

In conjunction with the second aspect, some implementations of the second aspect further include: obtaining first evaluation information and second evaluation information, the first evaluation information indicating the source quality of the XR data, and the second evaluation information indicating the ability to process the XR data . Among them, the source quality of XR data can be used to evaluate one or more of the following indicators of the XR video source and/or audio source: picture quality definition, picture fluency, picture three-dimensionality, picture distortion, frame rate, audio quality, or rendering effects. The capability of processing XR data may be used to evaluate the capability of the XR terminal to process and/or display XR data, such as the supported FOV angle and/or refresh rate, etc. The ability to process XR data can also be used to evaluate one or more of the XR terminal's endurance, wearing comfort, wearing fatigue, portability, or friendliness to visual impairments. Optionally, the first evaluation information and the second evaluation information can be obtained by MOS, POLQA, VQI or VMAF, or by a combination of two or more of MOS, POLQA, VQI and VMAF, or by Obtained by other methods, which is not limited in this application.

In a third aspect, an embodiment of the present application provides an apparatus, which can implement the method in the first aspect or any possible implementation manner of the first aspect. The apparatus comprises corresponding units or components for carrying out the above-described method. The units included in the apparatus may be implemented by software and/or hardware. The apparatus can be, for example, a terminal, a network device, a server or a centralized controller, or a chip, a chip system, or a processor that can support the terminal, network device, server or centralized controller to implement the above method.

In a fourth aspect, an embodiment of the present application provides an apparatus, which can implement the method in the second aspect or any possible implementation manner of the second aspect. The apparatus comprises corresponding units or components for carrying out the above-described method. The units included in the apparatus may be implemented by software and/or hardware. The apparatus can be, for example, a terminal, a network device, a server or a centralized controller, or a chip, a chip system, or a processor that can support the terminal, network device, server or centralized controller to implement the above method.

In a fifth aspect, an embodiment of the present application provides an apparatus, including: a processor, where the processor is coupled to a memory, and the memory is used to store a program or an instruction, and when the program or instruction is executed by the processor, The device is made to implement the above-mentioned first aspect, or the method described in any possible implementation manner of the first aspect.

In a sixth aspect, an embodiment of the present application provides an apparatus, including: a processor, where the processor is coupled to a memory, and the memory is used to store a program or an instruction, and when the program or instruction is executed by the processor, The device is made to implement the above-mentioned second aspect, or the method described in any possible implementation manner of the second aspect.

In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program or instruction is stored, and when the computer program or instruction is executed, causes a computer to execute the first aspect or any one of the first aspect. The method described in the possible embodiments.

In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program or instruction is stored, and when the computer program or instruction is executed, causes a computer to execute the second aspect or any one of the second aspect. The method described in the possible embodiments.

In a ninth aspect, an embodiment of the present application provides a computer program product, which includes computer program code, and when the computer program code runs on a computer, the computer program code enables the computer to execute the first aspect or any possible implementation of the first aspect. method described in the method.

In a tenth aspect, an embodiment of the present application provides a computer program product, which includes computer program code, and when the computer program code runs on a computer, enables the computer to execute the second aspect or any possible implementation of the second aspect. method described in the method.

In an eleventh aspect, an embodiment of the present application provides a chip, including: a processor, where the processor is coupled to a memory, and the memory is used to store a program or an instruction, and when the program or instruction is executed by the processor , so that the chip implements the method described in the first aspect or any possible implementation manner of the first aspect.

In a twelfth aspect, an embodiment of the present application provides a chip, including: a processor, where the processor is coupled to a memory, and the memory is used to store a program or an instruction, and when the program or instruction is executed by the processor , so that the chip implements the method described in the second aspect or any possible implementation manner of the second aspect.

In a thirteenth aspect, an embodiment of the present application provides a communication system, including: the device of the third aspect and the device of the fourth aspect.

In a fourteenth aspect, an embodiment of the present application provides a communication system, including: the device of the fifth aspect and the device of the sixth aspect.

Description of drawings

FIG. 1 is a schematic diagram of a communication system to which an embodiment provided by the present application is applied;

FIG. 2 shows a schematic diagram of an example of an architecture of a communication system;

Figure 3 shows a schematic diagram of four business requirements;

4-6 show schematic diagrams of several system frameworks to which the embodiments of the present application are applicable;

FIG. 7 shows a schematic flowchart of a communication method provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a communication device according to an embodiment of the present application;

FIG. 9 is a schematic structural diagram of a terminal according to an embodiment of the present application;

FIG. 10 is a schematic diagram of another communication apparatus provided by an embodiment of the present application.

Detailed ways

The methods and apparatuses provided in the embodiments of the present application can be applied to a communication system. Figure 1 shows a schematic structural diagram of a communication system. The communication system 100 includes one or more network devices (the network device 110 and the network device 120 are shown in the figure), and one or more terminals that communicate with the one or more network devices.

Terminals

114 and 118 are shown in FIG. 1 in communication with network device 110 , and

terminals

124 and 128 are shown in communication with network device 120 . It can be understood that network devices and terminals can also be referred to as communication devices.

The technologies described in the embodiments of the present invention can be used in various communication systems, for example, a fourth generation (4th generation, 4G) communication system, a 4.5G communication system, a 5G communication system, a system that integrates multiple communication systems, or a communication system that evolves in the future (eg 6G communication system). For example, long term evolution (LTE) system, new radio (NR) system, wireless-fidelity (WiFi) system, wireless ad hoc system, device-to-device direct connection communication system, and third Generation Partnership Project (3rd generation partnership project, 3GPP) related communication systems, etc., and other such communication systems.

Fig. 2 shows a schematic diagram of an example of a possible architecture of the communication system. As shown in Fig. 2, the network equipment in the radio access network (RAN) includes a centralized unit (CU) and a distributed unit (distributed unit). unit, DU) separate architecture base station (such as gNodeB or gNB). The RAN may be connected to the core network (for example, it may be the core network of LTE, or the core network of 5G, etc.). CU and DU can be understood as the division of the base station from the perspective of logical functions. CUs and DUs can be physically separate or deployed together. Multiple DUs can share one CU. One DU can also be connected to multiple CUs (not shown in the figure). The CU and the DU can be connected through an interface, such as an F1 interface. CU and DU can be divided according to the protocol layer of the wireless network. For example, the functions of the packet data convergence protocol (PDCP) layer and the radio resource control (RRC) layer are set in the CU, while the radio link control (RLC), media access control The functions of the (media access control, MAC) layer and the physical layer are set in the DU. It can be understood that the division of CU and DU processing functions according to this protocol layer is only an example, and may also be divided in other ways. For example, a CU or DU may be divided into functions with more protocol layers. For example, a CU or DU can also be divided into partial processing functions with a protocol layer. In one design, some functions of the RLC layer and functions of the protocol layers above the RLC layer are placed in the CU, and the remaining functions of the RLC layer and the functions of the protocol layers below the RLC layer are placed in the DU. In another design, the functions of the CU or DU may also be divided according to service types or other system requirements. For example, according to the delay, the functions whose processing time needs to meet the delay requirements are set in the DU, and the functions that do not need to meet the delay requirements are set in the CU. The network architecture shown in Figure 2 can be applied to a 5G communication system, which can also share one or more components or resources with an LTE system. In another design, the CU may also have one or more functions of the core network. One or more CUs can be set centrally or separately. For example, the CU can be set on the network side to facilitate centralized management. The DU can have multiple radio functions, or the radio functions can be set farther away.

The functions of the CU can be implemented by one entity, or the control plane (CP) and the user plane (UP) can be further separated, that is, the control plane (CU-CP) and the user plane (CU-UP) of the CU can be composed of different functions. The CU-CP and the CU-UP can be coupled with the DU to jointly complete the functions of the base station.

It can be understood that the embodiments provided in this application are also applicable to the architecture in which the CU and the DU are not separated.

In this application, the network device may be any device with a wireless transceiver function. Including but not limited to: evolved base station (NodeB or eNB or e-NodeB, evolutional Node B) in LTE, base station (gNodeB or gNB) or transceiver point (transmission receiving point/transmission receiving point, TRP) in NR, 3GPP Subsequent evolution of base stations, access nodes in WiFi systems, wireless relay nodes, wireless backhaul nodes, core network equipment, etc. The base station can be: a macro base station, a micro base station, a pico base station, a small base station, a relay station, or a balloon station, etc. Multiple base stations may support the above-mentioned networks of the same technology, or may support the above-mentioned networks of different technologies. A base station may contain one or more co-sited or non-co-sited TRPs. The network device may also be a server (eg, a cloud server), a wireless controller, a CU, and/or a DU in a cloud radio access network (cloud radio access network, CRAN) scenario. The network device can also be a server, a wearable device, a machine communication device, a vehicle-mounted device, or a smart screen. The following description takes the network device as the base station as an example. The multiple network devices may be base stations of the same type, or may be base stations of different types. The base station can communicate with the terminal equipment, and can also communicate with the terminal equipment through the relay station. The terminal device can communicate with multiple base stations of different technologies. For example, the terminal device can communicate with the base station supporting the LTE network, the base station supporting the 5G network, and the base station supporting the LTE network and the base station of the 5G network. Dual connection.

A terminal is a device with wireless transceiver function, which can be deployed on land, including indoor or outdoor, handheld, wearable or vehicle-mounted; it can also be deployed on water (such as ships, etc.); it can also be deployed in the air (such as aircraft, balloons, etc.) and satellite, etc.). The terminal can be a mobile phone (mobile phone), a tablet computer (Pad), a computer with a wireless transceiver function, a VR terminal device, an AR terminal device, an MR terminal device, a terminal in an industrial control (industrial control), a vehicle-mounted terminal device, Terminals in self-driving, terminals in assisted driving, terminals in remote medical, terminals in smart grid, terminals in transportation safety, terminals in smart cities ( Terminals in smart city), terminals in smart home (smart home), etc. The embodiments of the present application do not limit application scenarios. A terminal may also sometimes be referred to as terminal equipment, user equipment (UE), access terminal equipment, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal equipment, mobile equipment, UE terminal equipment, wireless communication equipment, machine terminal, UE proxy or UE device, etc. Terminals can be fixed or mobile.

As an example and not a limitation, in this application, the terminal may be a wearable device. Wearable devices can also be called wearable smart devices, which are the general term for the intelligent design of daily wear and the development of wearable devices using wearable technology, such as glasses, gloves, watches, clothing and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothing or accessories. Wearable device is not only a hardware device, but also realizes powerful functions through software support, data interaction, and cloud interaction. In a broad sense, wearable smart devices include full-featured, large-scale, complete or partial functions without relying on smart phones, such as smart watches or smart glasses, and only focus on a certain type of application function, which needs to cooperate with other devices such as smart phones. Use, such as all kinds of smart bracelets, smart jewelry, etc. for physical sign monitoring.

In this application, the terminal may be a terminal in the Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Machine interconnection, the intelligent network of the interconnection of things and things. The terminal in this application may be a terminal in machine type communication (MTC). The terminal of the present application may be an on-board module, on-board module, on-board component, on-board chip or on-board unit built into the vehicle as one or more components or units, and the vehicle passes through the built-in on-board module, on-board module, on-board component , on-board chip or on-board unit can implement the method of the present application. Therefore, the embodiments of the present application can be applied to the Internet of Vehicles, such as vehicle to everything (V2X), long term evolution vehicle (LTE-V), vehicle to vehicle (V2V) Wait.

The terminal in this application may also be a VR terminal, an AR terminal, or an MR terminal. VR terminals, AR terminals, and MR terminals may all be referred to as XR terminals. The XR terminal can be, for example, a head-mounted device (such as a helmet or glasses), an all-in-one machine, a TV, a monitor, a car, a vehicle-mounted device, a tablet or a smart screen, and the like. The XR terminal can present XR data to the user, and the user can experience a variety of XR services by wearing or using the XR terminal. The XR terminal can access the network in a wireless or wired manner, for example, through WiFi or a 5G system.

XR technology has the advantages of multiple perspectives and strong interactivity, which can provide users with a brand-new experience and has great application value and commercial potential. XR includes technologies such as VR, AR, and MR, and can be widely used in entertainment, gaming, medical, advertising, industry, online education, and engineering. VR technology mainly refers to the rendering of visual and audio scenes to simulate the visual and audio sensory stimulation of users in the real world as much as possible. VR technology usually requires users to wear XR terminals (such as head-mounted devices) to simulate visual effects to users. and/or hearing. VR technology can also perform motion tracking of the user, thereby updating the simulated visual and/or auditory content in time. AR technology mainly refers to providing visual and/or auditory additional information or artificially generated content in the real environment perceived by the user, where the user's acquisition of the real environment can be direct (eg, without sensing, processing and rendering), It can also be indirect (for example, transmitted through sensors, etc.), and further enhanced processing is performed. MR technology is to insert some virtual elements into the physical scene, the purpose is to provide users with an immersive experience where these elements are part of the real scene. The network device can process and transmit the data generated by the XR service (may be called XR data). For example, the network device in the cloud can render and encode the XR source data (such as source encoding). The connected network equipment transmits the XR data to the XR terminal. The XR terminal provides users with a variety of XR experiences (such as immersive experience, visual experience, interactive experience or device experience, etc.) by processing XR data. There are various evaluation dimensions for XR experience, including one or more of the following evaluation dimensions: picture clarity, picture fluency, picture distortion, picture three-dimensionality, picture black borders, picture smear, sound quality, sound effect, Field of view, stuttering, blurry screen, vertigo, audio and video synchronization, interactive freedom, interactive operation response speed, interactive operation accuracy, interactive content loading speed, terminal wearing comfort, terminal wearing fatigue, terminal battery life , terminal portability, or terminal visual impairment friendliness, etc.

The data of the XR service includes one or more of VR data, AR data, MR data, video data, audio data, or picture data. The demand for data transmission of XR services is related to enhanced mobile broadband (eMBB) services, massive machine type communication (mMTC) services, and ultra-reliable low latency communication (URLLC) services ) business has different requirements for data transmission. Figure 3 shows a schematic diagram of four business requirements. Figure 3 illustrates a triangular pyramid. The four vertices of the triangular pyramid represent the emphasis on data transmission of eMBB service, mMTC service, URLLC service, and XR service. Different vertices represent different needs of different services on data transmission. The XR service can also be considered as the fourth type of service in the post-5G or 6G communication system, which can be referred to as the fourth pole service for short. The eMBB service has higher requirements on data rate, the mMTC service has higher requirements on coverage and capacity, and the URLLC service has higher requirements on delay and reliability. The XR service has the requirements of low latency and high speed, and it generally depends on the user experience to measure whether the requirements of the XR service are met. For example, when the transmission of XR data has a large delay or a low rate, the user may feel dizzy, resulting in a poor user's visual experience. However, the user's experience of XR data network transmission is a subjective feeling of the user, and it is impossible to accurately and objectively measure the impact of XR data in network transmission, so that it cannot systematically help network operators to optimize the network for XR data. Therefore, how to measure the impact of XR data in network transmission more systematically and objectively, so as to guide network operators to optimize the network for XR data, has become an urgent problem to be solved.

The embodiments of the present application provide a method for evaluating the XR transmission quality for the transmission of XR data, in which the transmission quality of the XR data is determined according to the available performance parameters of the network. This method can systematically evaluate the objective influence of XR data in network transmission, so as to guide network operators to maintain and optimize the network according to the needs of XR data.

The technical solutions of the present application will be described in detail below with reference to specific embodiments and accompanying drawings. The following embodiments and implementations may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. It should be understood that the functions explained in this application may be implemented by stand-alone hardware circuits, using software running in conjunction with a processor/microprocessor or general purpose computer, using application specific integrated circuits, and/or using one or more digital signal processors. accomplish. When the application describes a method, it can also be implemented in a computer processor and a memory coupled to the processor.

For easy understanding of the embodiments in this application, some concepts or terms involved in this application are briefly described first.

1. Mean opinion score (MOS)

MOS (also called subjective average score or subjective evaluation opinion score) is a subjective quantification method for evaluating voice quality, and MOS can reflect the user's subjective feeling of voice quality. For example, a possible 5-point MOS is shown in Table 1 below.

Table 1

语音质量voice quality	MOSMOS
excellentexcellent	55
goodgood	44
acceptaccept	33
poorpoor	22
badbad	11

2. Perceptual objective listening quality analysis (POLQA)

POLQA is a set of procedural voice quality measurement methods. It mainly evaluates the voice quality through professional instruments, and obtains the evaluation conclusion of the voice quality.

3. Voice quality indicator (VQI)

VQI (also known as Voice Quality Indication) is a voice quality assessment method based on parameter estimation, which can obtain a voice quality score by calculating the main factors affecting voice quality, for example, obtain the value of VQI according to the frame error rate of voice data , so as to evaluate the voice quality.

4. Video multi-method assessment fusion (VMAF)

VMAF (also known as video multi-dimensional evaluation fusion) can fuse multi-dimensional indicators related to video sources (such as distortion degree and distortion type, etc.), and obtain evaluation of video quality through machine learning or artificial intelligence algorithms. VMAF can assign a certain weight to each indicator in the multi-dimensional indicators, so as to reflect the dominant proportion of each indicator in the final evaluation, thereby obtaining a more accurate evaluation score.

5. Cloud Extended Reality (Cloud XR)

Cloud XR (also known as the cloudification of XR) refers to the introduction of cloud computing and cloud rendering technologies into the application of XR services, and the display output and sound output of the cloud are encoded and compressed through the network and transmitted to the XR terminal.

The embodiments provided in this application are applicable to many different scenarios. 4-6 show schematic diagrams of several system frameworks to which the embodiments of the present application are applicable.

FIG. 4 shows a schematic diagram of a system network element to which this embodiment of the present application is applicable. FIG. 4 illustrates a system 400 including a cloud server 410 , a core network and an access network 420 (may be referred to as a transport network 420 for short, such as an LTE, 5G or 6G network), and an XR terminal 430 . The cloud server 410 can be used to encode, decode and render XR source data, the transmission network 420 can be used to transmit the XR data, and the XR terminal 430 can provide users with diversified XR experience by processing the XR data. It can be understood that other devices may also be included between the transmission network 420 and the XR terminal 430, for example, other terminals (such as mobile phones, laptops, or cars, etc.) and/or network devices (such as relays, WiFi routers, or WiFi access point, etc.), the XR terminal 430 obtains XR data from the transmission network 420 by means of other terminals and/or network equipment. Optionally, the system 400 further includes a centralized controller 440, and the centralized controller 440 can receive/collect data from one or more of the cloud server 410, the transmission network 420 or the XR terminal 430, and can also transmit data to the cloud server 410, the transmission network 420 or the XR terminal 430. One or more of network 420 or XR terminal 430 transmits the data. It can be understood that the centralized controller 440 can be deployed independently of the cloud server 410, the transmission network 420 and the XR terminal 430, or can be deployed in the cloud server 410, the transmission network 420 or the XR terminal 430, or the centralized controller 440 may not be deployed. The function of the centralized controller 440 is realized by the cloud server 410 , the transmission network 420 or the XR terminal 430 .

FIG. 5 shows another schematic diagram of a system network element to which this embodiment of the present application is applicable. FIG. 5 illustrates a system 500 including an XR terminal 520 and other terminals 510. The other terminal 510 is a terminal other than the XR terminal 520, and the other terminal 510 may be an XR terminal or a common terminal (also called a non-XR terminal). Other terminals 510 may transmit XR data to XR terminal 520 . Optionally, the system 500 further includes a centralized controller 530, and the centralized controller 530 can receive/collect data from the XR terminal 520 and/or other terminals 510, and can also send data to the XR terminal 520 and/or other terminals 510. It can be understood that the centralized controller 530 may be deployed independently of the XR terminal 520 and other terminals 510, or may be deployed in the XR terminal 520 or other terminals 510, or the centralized controller 530 may not be deployed but by the XR terminal 520 or other terminals 510 implements the functions of the centralized controller 530 .

FIG. 6 shows another schematic diagram of a system network element to which this embodiment of the present application is applicable. FIG. 6 illustrates a system 600 comprising an XR terminal 630, a WiFi router or WiFi access point 620 (which may be referred to simply as a WiFi device 620), and other terminals 610. The other terminal 610 is a terminal other than the XR terminal 630, and the other terminal 610 may be a kind of XR or a common terminal (also called a non-XR terminal). Other terminals 610 may transmit XR data to the XR terminal 630 via the WiFi device 620 . Optionally, the system 600 further includes a centralized controller 640, and the centralized controller 640 can receive/collect data from one or more of the other terminals 610, the WiFi device 620 or the XR terminal 630, and can also send data to the other terminals 610, WiFi One or more of device 620 or XR terminal 630 transmits the data. It can be understood that the centralized controller 640 can be deployed independently of other terminals 610, WiFi devices 620, and XR terminals 630, or can be deployed in other terminals 610, WiFi devices 620, or XR terminals 630, or the centralized controller 640 may not be deployed. The function of the centralized controller 640 is realized by the other terminal 610 , the WiFi device 620 or the XR terminal 630 .

FIG. 7 is a schematic flowchart of a communication method 700 provided by an embodiment of the present application. The execution body of the method can be a network device (such as a core network device, a wireless access network device, a WiFi router, or a WiFi access point), or a chip, a chip system, or a processor that supports the network device to implement the method. . The execution body of the method may be a server (for example, a cloud server), or a chip, a chip system, or a processor that supports the server to implement the method. The execution body of the method may be a centralized controller, or may be a chip, a chip system, or a processor that supports the centralized controller to implement the method. The executive bodies of each part in FIG. 7 may be the same or different. As shown in FIG. 7, the method 700 of this embodiment may include

parts

710, 720, 730, 740 and 750:

Part 710: Obtain network transmission statistics, source parameter information and terminal parameter information.

Part 720: Obtaining user image quality experience information based on network transmission statistics and source parameter information

Part 730: Obtain user interaction experience information according to network transmission statistics, source parameter information, and terminal parameter information.

Part 740: Obtain network quality evaluation index information according to user image quality experience information and user interaction experience information.

Part 750: Communicate with communications equipment based on information on quality assessment indicators for this network

In section 710, optionally, the network transmission statistics indicate packet error rate (PER) or block error rate (BLER), packet error conditions, packet delay conditions, average transmission delay, One or more of packet delay budget (packet delay budget, PDB), or frame delay budget (frame delay budget, FDB). Among them, PER (also known as Packet Error Rate) represents the ratio of the number of packets received in error to the total number of packets received. BLER represents the ratio of the number of blocks received in error to the total number of blocks received. Packet error conditions indicate correct or incorrect transmission of data packets. The packet delay situation indicates the delay situation of data packet transmission. The average transmission delay represents the average transmission delay of the data packet. The PDB indicates how long a packet needs to be transmitted correctly. For example, if the PDB is 10 milliseconds (millisecond, ms), it means that the data packet needs to be transmitted correctly within 10 ms. FDB indicates how long the data frame needs to be transmitted correctly. For example, if the FDB is 100ms, it means that the data frame needs to be transmitted correctly within 100ms.

In part 710, optionally, the source parameter information indicates the slice information or stripe information of the source, the information of the source data unit to which the packet belongs, the group of picture (GOP) information, or the information of the source data. One or more of the refresh period, the frame rate of the source data, or the encoding method of the source. The slice information or slice information of the source indicates whether the data frame of the source data unit is sliced or sliced. A video frame can be encoded according to region division during encoding, and the divided region is called a video frame slice or a video frame slice. The refresh period of the source data indicates how often the data frame of the source data unit is refreshed. The encoding method of the source can be a scalable encoding method, such as scalable video coding (scalable video coding, SVC) and high efficiency scalable video coding (scalable high efficiency video coding, SHVC). Scalable coding can generate two video data streams of base layer and enhancement layer after source coding.

In part 710, optionally, the terminal parameter information indicates the buffer processing capability of the terminal. The buffering capability of the terminal refers to the maximum buffering delay of video frames allowed by the terminal device on the terminal side while ensuring the normal experience of video playback.

In a possible implementation manner of obtaining network transmission statistical information in part 710, the radio access network device obtains the above-mentioned source parameter information from the media information layer of the core network, and the above-mentioned media information layer is defined between the application layer and the transport layer. The core network obtains the above-mentioned source parameter information by parsing the media information layer, and encapsulates the source parameter information in general packet radio system tunneling protocol user (GTP-U) information and sends it to the wireless access The wireless access network device obtains the source parameter information by parsing the GTP-U information.

In a possible implementation manner of obtaining the source parameter information in section 710, the radio access network device receives a quality of experience (QoE) report from the terminal, and obtains the source parameter information according to the QoE report.

Optionally, the radio access network device obtains the QoE configuration information and the configuration information related to the source parameters from the core network, and encapsulates the QoE configuration information and the configuration information related to the source parameters into the QoE configuration container and sends the information through the air interface message. (eg, a radio resource control (RRC) message) is sent to the terminal. The configuration information related to the information source parameter is used by the terminal to generate the information source parameter information according to the configuration information. After receiving the QoE configuration information and the configuration information related to the source parameters, the terminal generates the QoE report and the source parameter information. The terminal encapsulates the QoE report and source parameter information into a QoE report container, and reports the QoE report container to the wireless access network device through air interface information. The radio access network device obtains the QoE report container through the air interface information, and obtains the source parameter information according to the QoE report container.

Optionally, the radio access network device may also obtain terminal parameter information according to the above-mentioned QoE report. For example, in the above QoE reporting process, in addition to sending the QoE configuration information and the configuration information related to the source parameters, the core network also sends the configuration information related to the terminal parameters. The configuration information related to the terminal parameters is used by the terminal to generate terminal parameter information according to the configuration information. The wireless access network device encapsulates the above-mentioned QoE configuration information, configuration information related to source parameters, and configuration information related to terminal parameters into a QoE configuration container and sends it to the terminal. After receiving the QoE configuration container, the terminal generates a QoE report, source parameter information, and terminal parameter information, and encapsulates the generated QoE report, source parameter information, and terminal parameter information into a QoE report container and reports it to the wireless access network device. The radio access network device obtains the QoE report container, and obtains source parameter information and terminal parameter information according to the QoE report container.

In a possible implementation manner of obtaining the terminal parameter information in part 710, the radio access network device receives a QoE report from the terminal, and obtains the terminal parameter information according to the QoE report.

Optionally, the radio access network device obtains the QoE configuration information and the configuration information related to the terminal parameters from the core network, and encapsulates the QoE configuration information and the configuration information related to the terminal parameters into the QoE configuration container and passes the air interface message (such as RRC message) to the terminal. After receiving the QoE configuration information and the configuration information related to the terminal parameters, the terminal generates a QoE report and terminal parameter information. The terminal encapsulates the QoE report and terminal parameter information into a QoE report container, and reports the QoE report container to the wireless access network device through air interface information. The radio access network device obtains the QoE report container through the air interface information, and obtains the terminal parameter information according to the QoE report container.

Part 720: Obtain user image quality experience information according to network transmission statistics and information source parameter information. The impact of network transmission statistics and source parameter information on the XR service image quality and experience quality can be reflected by the user image quality experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide more flexible indicators for XR data demand. Provide a controllable and quantifiable evaluation basis for network maintenance and optimization.

In a possible implementation manner of obtaining the user image quality experience information in part 720, the wireless access network device obtains the average frame impairment rate of the data frame and/or the position of the error frame according to the above-mentioned network transmission statistics information and the above-mentioned information source parameter information , and obtain the user image quality experience information according to the average frame damage rate and/or the position of the erroneous frame.

In part 720, the user image quality experience information is obtained according to the average frame impairment rate and/or the position of the erroneous frame. In a possible implementation manner, if the slice information or slice information of the source indicates that the source has no slice or slice , the wireless access network device determines the location of the first error frame according to the packet error condition indicated by the network transmission statistics information, the GOP information indicated by the source parameter information, or the refresh period of the source data, and the location information of the error frame can be, for example, Represented by the frame index number. It can be understood that, according to the encoding and transmission characteristics of XR service data frames, within a GOP, if an error occurs in a certain frame, the data frames after the error frame in this GOP cannot be decoded correctly, that is, there is an error propagation phenomenon. The frame impairment rate R within a GOP can be expressed as:

Among them, N represents the number of frames in a GOP, and the frames in a GOP can be represented as the first frame, the second frame...the Nth frame according to the index; i represents the frame index number of the first error frame, and i is greater than or equal to 1 and an integer less than or equal to N. Calculate the frame damage rate of each GOP in the user image quality experience information statistical period, and then obtain the average frame damage rate _Rave in the statistical period according to the number of GOPs in the statistical period. For example, suppose the user image quality experience information statistics If there are M GOPs in the period, the average frame damage rate _Rave in the statistical period of user image quality experience information is:

Ri represents the frame damage rate in each GOP in the user image quality experience information statistical period.

The corresponding value S ₁ of the image quality experience information in the statistical period can be obtained according to the average frame damage rate _Rave and the frame rate information. For example, S ₁ satisfies:

S ₁ =100(1-α* _Rave *1/RF) or

S ₁ =100-α*ln(R _ave *1/RF)

α represents a coefficient constant, α is a non-zero real number, and the specific value of α is not limited in this application; RF represents the frame rate of the frame.

Optionally, if the fragmentation information or the fragmentation information of the information source indicates that the information source has fragmentation or fragmentation, the wireless access network device according to the packet error condition indicated by the network transmission statistical information and the GOP indicated by the source parameter information. The refresh cycle of information or source data determines the position of the first erroneous frame stripe or erroneous frame fragment, and the erroneous frame position information can be represented by a frame index number. It can be understood that, according to the encoding and transmission characteristics of the XR service data frame, within a GOP, if an error occurs in a certain frame striping or frame fragmentation, the corresponding position of the data frame after the frame striping or frame fragmentation in this GOP The frame slice or frame slice cannot be decoded correctly, that is, there is an error propagation phenomenon. At this time, the frame damage rate R in a GOP can be expressed as:

where i represents the frame index number corresponding to the first erroneous frame slice or the first erroneous frame slice. β(n) represents the frame impairment rate of the corresponding data frame when the frame segmentation or frame segmentation error in the nth frame occurs, and the value range of β(n) is 0≤β(n)≤1. Calculate the frame damage rate of each GOP in the user image quality experience information statistical period, and then obtain the average frame damage rate _Rave in the statistical period according to the number of GOPs in the statistical period. For example, _Rave can satisfy the aforementioned _Rave The exemplary formula of , which will not be repeated here, and then obtain the corresponding value S ₁ of the image quality experience information in the statistical period according to the average frame damage rate _Rave and the frame rate information. For example, S ₁ can satisfy the aforementioned exemplary formula of S ₁ , and will not be repeated here.

In this way, the influence of network transmission statistics and information source parameter information on the user experience of XR services can be reflected by obtaining the user image quality experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide Provide controllable and quantifiable evaluation basis for network maintenance and optimization of XR data requirements.

In another possible implementation manner of obtaining the user image quality experience information according to the average frame impairment rate and/or the position of the erroneous frame in part 720, if the slice information or slice information of the source indicates that the source has no slice or slice slice, the relative position of the nth frame of the data frame and the ith frame of the first error frame can be calculated, and the position can be represented by the interval L=ni frames. The corresponding value S ₃ (n) of the image quality experience score of the n th frame can be obtained according to the relative positions of the n th frame and the ith frame. For example, S ₃ (n) satisfies:

or

γ represents a coefficient constant, γ is a non-zero real number, and the specific value of γ is not limited in this application; RF represents the frame rate of the frame.

The wireless access network device calculates the average image quality experience score in the GOP according to the corresponding value S ₃ (n) of the image quality experience score of each frame in the GOP, and then obtains the corresponding value S ₁ of the image quality experience information in the statistical period. S ₁ can be obtained by summing and averaging the image quality experience scores S ₃ (n) of each frame in the statistical period. For example, there are Q frames in the statistical period, and the corresponding value S ₁ of the user image quality experience information in the statistical period is:

Optionally, if the fragmentation information or the fragmentation information of the information source indicates that the information source has fragmentation or fragmentation, the relative position of the nth frame of the data frame and the ith frame of the first error frame can be calculated, and the position can be used as The interval L=ni frames is represented. The corresponding value S ₃ (n) of the image quality experience score of the n th frame can be obtained according to the relative positional relationship between the n th frame and the ith frame. For example, S ₃ (n) satisfies:

or

Among them, ε(n) represents the influence coefficient of frame segmentation or frame segmentation when considering frame segmentation or frame segmentation errors in each frame, 0≤ε(n)≤1; RF represents frame frame rate.

The wireless access network device calculates the average picture quality experience score in the GOP according to the corresponding value S ₃ (n) of the picture quality experience score of each frame in the GOP, and then obtains the corresponding value S ₁ of the user picture quality experience information in the statistical period , for example, S ₁ can satisfy the above-mentioned exemplary formula of S ₁ , which will not be repeated here. In this way, the influence of network transmission statistics and source parameter information on the user experience of the XR service can be reflected by obtaining the user image quality experience information, and a more flexible indicator can be provided for the transmission quality of XR data in the network, so as to provide Provide controllable and quantifiable evaluation basis for network maintenance and optimization of XR data requirements.

In another possible implementation manner of obtaining the user image quality experience information according to the average frame impairment rate and/or the position of the erroneous frame in part 720, if the slice information or slice information of the source indicates that the source has no slice or slice The encoding mode information of the source indicates that the source uses SVC or SHVC encoding to generate two data streams of the base layer and the enhancement layer. The two data streams correspond to the base layer and the enhancement layer of the video frame. The damage rate R can be expressed as:

Among them, N represents the number of frames in a GOP, and the frames in a GOP can be sequentially represented as the first frame, the second frame...the Nth frame according to the index; i represents the frame index number of the data frame corresponding to the first erroneous base layer , i is an integer greater than or equal to 1 and less than or equal to N; j represents the frame index number of the data frame corresponding to the first erroneous base layer, j is an integer greater than or equal to 1 and less than or equal to N; θ represents the loss of the enhancement layer to the frame damage The influence coefficient of the rate, θ is a non-zero real number. Calculate the frame damage rate of each GOP in the user image quality experience information statistical period, and then obtain the average frame damage rate _Rave in the statistical period according to the number of GOPs in the statistical period. For example, _Rave can satisfy the aforementioned _Rave . Exemplary formulas are not repeated here. The wireless access network device obtains the corresponding value S ₁ of the user image quality experience information in the statistical period according to the average frame impairment rate _Rave and the frame rate information in the statistical period. For example, S ₁ may satisfy the foregoing exemplary formula of S _1. This It is not repeated here.

Optionally, if the slice information or slice information of the source indicates that the source has slices or slices, the frame impairment rate R in one GOP of the source can be expressed as:

Among them, N represents the number of frames in a GOP, and the frames in a GOP can be sequentially represented as the first frame, the second frame...the Nth frame according to the index; μ(n) indicates that there is frame striping in the base layer of the nth frame Or the frame damage rate of the base layer corresponding to the data frame when the frame fragmentation error occurs, 0≤μ(n)≤1; τ(n) indicates that the data frame corresponds to the frame stripe or frame fragmentation error in the base layer of the nth frame The frame damage rate of the base layer, 0≤τ(n)≤1; θ represents the influence coefficient of the loss of the enhancement layer on the frame damage rate. Calculate the frame damage rate of each GOP in the user image quality experience information statistical period, and then obtain the average frame damage rate _Rave in the statistical period according to the number of GOPs in the statistical period. For example, _Rave can satisfy the aforementioned _Rave . Exemplary formulas are not repeated here. The corresponding value S ₁ of the user image quality experience information in the statistical period is calculated according to the average frame damage rate _Rave and the frame rate information. For example, S ₁ may satisfy the aforementioned exemplary formula of S ₁ , which will not be repeated here.

In another possible implementation manner of obtaining the user image quality experience information according to the average frame impairment rate and/or the position of the erroneous frame in part 720, if the slice information or slice information of the source indicates that the source has no slice Or slice, the encoding mode information of the source indicates that the source uses SVC or SHVC encoding to generate two data streams of the base layer and the enhancement layer, and the two data streams correspond to the base layer and the enhancement layer of the video frame. Coding and transmission characteristics, in a GOP, if an error occurs in a certain frame, the data frames after the error frame in this GOP cannot be decoded correctly, that is, there is an error propagation phenomenon. In addition, if there is an error in the basic layer of a certain frame, In this GOP, neither the base layer nor the enhancement layer after the erroneous frame can be correctly decoded. If an error occurs in the enhancement layer of a certain frame, neither the enhancement layer after the erroneous frame in this GOP can be correctly decoded. According to the information source parameter information, it is obtained that the ith frame is the error starting position of the base layer within the GOP, and the jth frame is the starting position of the enhancement layer error within the GOP. Then, the corresponding value S ₁ of the picture quality experience information of each frame can be obtained according to the base layer, the enhancement layer, and the relative positional relationship with the corresponding start error base layer and start error enhancement layer errors of each frame in the GOP.

For example, when j < i, S ₁ satisfies:

or

For another example, when j>=i, S ₁ satisfies:

or

Among them, α1 and α2 represent the influence coefficient of the base layer error on the quality experience of the whole frame; β1 and β2 represent the influence coefficient of the enhancement layer error on the quality experience of the whole frame; L1=n-i represents the base layer error position (the ith frame) and The distance between the base layers of the nth frame; L2=m-j represents the distance between the error position of the enhancement layer (the jth frame) and the enhancement layer of the mth frame.

Optionally, if the fragmentation information or the fragmentation information of the information source indicates that the information source has fragmentation or fragmentation, and within a GOP, an error occurs in a certain frame fragmentation or frame fragmentation, then the frame fragmentation in this GOP is incorrect. The frame slice or frame slice at the corresponding position of the video frame after slice or frame slice cannot be decoded correctly, that is, there is an error propagation phenomenon. The corresponding value S ₁ of the picture quality experience information of each frame can be obtained according to the base layer, the enhancement layer, and the relative positional relationship between the corresponding base layer and enhancement layer errors of each frame in the GOP.

For example, when j < i, S ₁ satisfies:

or

For another example, when j>=i, S ₁ satisfies:

or

Among them, β1(n) and β2(n) represent the influence coefficients on the whole frame image quality experience when considering part of the base layer in each frame or fragmentation errors when frame segmentation or frame segmentation is performed, and γ1(n) and γ1(n) and γ2(n) represents the influence coefficient on the whole frame image quality experience when considering part of the enhancement layer in each frame or fragmentation error when frame segmentation or frame segmentation is considered, β1(n), β2(n), γ1( The value range of n) and γ2(n) is 0 to 1; L1=n-i represents the distance between the base layer error position (the i-th frame base layer) and the n-th frame base layer; L2=m-j represents the enhancement layer error position The distance between (jth frame enhancement layer) and mth frame enhancement layer. In this way, the influence of network transmission statistics and information source parameter information on the user experience of XR services can be reflected by obtaining the user image quality experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide Provide controllable and quantifiable evaluation basis for network maintenance and optimization of XR data requirements.

Part 730: Obtain user interaction experience information according to network transmission statistics, source parameter information, and terminal parameter information. It can be understood that the present application does not limit the execution order of

parts

720 and 730 . Part 720 can be executed first and then part 730, or part 730 can be executed first and then part 720, or part 720 and part 730 can be executed at the same time. The impact of network transmission statistics, source parameter information and terminal parameter information on the XR service interaction experience quality can be reflected through the user interaction experience information, which can provide more flexible indicators for the transmission quality of XR data in the network, so as to provide more flexible indicators for XR data transmission quality. Network maintenance and optimization of data requirements provide a controllable and quantifiable evaluation basis.

In a possible implementation manner of obtaining the user interaction experience information in part 730, the wireless access network device obtains the average frame hopping rate and average transmission rate of the data frames according to the above-mentioned network transmission statistics information, the above-mentioned information source parameter information and the above-mentioned terminal parameter information delay, and obtain user interaction experience information according to the average frame skip rate and the average transmission delay.

In a possible implementation manner in which the user interaction experience information is obtained according to the average frame hopping rate and the average transmission delay in part 730, if the packet delay indicated by the network transmission statistics exceeds the terminal buffer indicated by the FDB and the terminal parameter information The sum of the processing power delay will cause frame skipping. At this time, the frame skip rate R _jump in one GOP can be expressed as:

Among them, M represents the number of skipped frames in the next GOP with a specified delay, and N represents the total number of frames in one GOP. Calculate the frame skip rate in each GOP in the user interaction experience information statistical period, and then obtain the average frame skip rate _{Rave_jump} in the statistical period according to the number of GOPs in the statistical period. For example, within the user interaction experience information statistical period If M GOPs are included, the average frame skip rate _{Rave_jump} in the statistical period of user image quality experience information is:

where R _jump (i) represents the frame skip rate in each GOP in the interactive experience information statistical period.

The corresponding value S ₂ of the user interaction experience information in the statistical period is calculated according to the average frame skip rate and the average transmission delay of each frame. For example S2 can satisfy _:

or

where f(T1(n)) represents the function of the average transmission delay of each frame, for example, it can satisfy:

Among them, Q represents the total number of frames in the statistical period, T1(n) represents the average transmission delay of each frame, and ρ is a non-zero real number.

In this way, the user interaction experience information can be obtained to reflect the impact of network transmission statistics, source parameter information and terminal parameter information on the user experience of the XR service, which can provide more flexible indicators for the transmission quality of XR data in the network. This can provide a controllable and quantifiable evaluation basis for network maintenance and optimization for XR data requirements.

In another possible implementation manner of obtaining the user interaction experience information according to the average frame hopping rate and the average transmission delay in part 730, if the fragmentation information or the fragmentation information of the information source indicates that the information source has no fragmentation or fragmentation If the packet delay indicated by the network transmission statistics information exceeds the sum of the terminal buffer processing capability delay indicated by the FDB and the terminal parameter information, frame skipping will occur. At this time, the base layer frame skip rate R _{Base_jump} and the enhancement layer frame skip rate R _{Enhance_jump} in a GOP can be expressed as:

Where M represents the number of base layer skip frames counted in the next GOP with a specified delay, L represents the number of base layer skip frames counted in the next GOP with a specified delay, and N represents the total number of frames in one GOP. Calculate the frame skip rate of the base layer and the frame skip rate of the enhancement layer in each GOP of the user interaction experience information statistical period, and then obtain the average base layer frame skip rate _{Rave_Base_jump} according to the number of GOPs in the statistical period. and the average enhancement layer frame skip rate _{Rave_Enhance_jump} , for example, if the user interaction experience information statistical period contains M GOPs, the average base layer frame skip rate _{Rave_Base_jump} in the user interaction experience information statistical period is:

Wherein R _{Base_jump} (i) represents the base layer frame skip rate in each GOP in the user interaction experience information statistical period.

The average enhancement layer frame skip rate _{Rave_Enhance_jump} in the user interaction experience information statistical period is:

where R _{Enhance_jump} (i) represents the frame skip rate of the enhancement layer in each GOP in the user interaction experience information statistical period.

The corresponding value S ₂ of the user interaction experience information in the statistical period is calculated according to the average base layer frame skip rate _{Rave_Base_jump} and the average enhancement layer frame skip rate _{Rave_Enhance_jump} in the statistical period. For example S2 can satisfy _:

S ₂ =100(1-α* _{Rave_Base_jump} *RF*f1(T1(n))-β* _{Rave_Enhance_jump} *1/RF*f2(T2(n)))

or

where f1(T1(n)) and f2(T2(n)) represent the functions of the average transmission delay of the base layer of each frame and the average transmission delay of the enhancement layer of each frame, for example, it can satisfy:

where Q is the total number of frames in the statistical period, T1(n) is the average transmission delay of the base layer of each frame, T2(n) is the average transmission delay of the enhancement layer of each frame, ρ and

is a non-zero real number.

Part 740: Obtain network quality evaluation index information according to the user image quality experience information and the user interaction experience information. In a possible implementation, obtaining the network quality evaluation index information according to the user image quality experience information and the user interaction experience information may be specifically implemented as follows: the corresponding value S of the network quality evaluation index information satisfies the relationship between S 1 and S ₁ and S ₂ related function f3(S ₁ , S ₂ ):

S ₃ =f3(S ₁ , S ₂ )

Among them, "f3(S ₁ , S ₂ )" represents the function f3 with the user image quality experience information and user interaction experience information as independent variables, S ₁ represents the corresponding value of the user image quality experience information, and S ₂ represents the user interaction experience information the corresponding value of . The quality evaluation index information of the network can characterize the transmission quality of XR data. The quality evaluation index information of the network may also be called network transmission MOS, or network user experience index, etc., which is not limited in the present invention. The quality evaluation index information of the network represents the transmission quality of the XR data in the network, and the network includes a core network and/or an access network. Therefore, the quality evaluation index information of the network can reflect the influence on the transmission of XR data in the core network and/or the access network, that is, it can reflect the user's experience quality of the XR service.

Part 750: Communicate with the communication device according to the quality evaluation index information of the network. In a possible implementation manner, the communication with the communication device according to the quality evaluation index information of the network may be specifically implemented as: outputting the quality evaluation index information of the network. For example, the execution subject performing the method 700 may send the obtained quality evaluation index information of the network to other communication devices in the system through the communication interface. For another example, the executive body performing the method 700 may output the obtained quality evaluation index information of the network to other devices in the network element where the executive body is located through a communication interface. In another possible implementation, the communication according to the quality evaluation index information of the network may be specifically implemented as: sending or receiving XR data according to the quality evaluation index information of the network.

Since the above-mentioned quality evaluation index information of the network can characterize the transmission quality of XR data in the network, this method can systematically evaluate the objective impact of XR data in network transmission, thereby guiding network operators to meet the needs of XR data. Maintain and optimize the network.

Optionally, the method 700 further includes: obtaining first evaluation information and second evaluation information, where the first evaluation information indicates the source quality of the XR data, and the second evaluation information indicates the capability of processing the XR data. Among them, the source quality of XR data can be used to evaluate one or more of the following indicators of the XR video source and/or audio source: picture quality definition, picture fluency, picture three-dimensionality, picture distortion, frame rate, audio quality, or rendering effects. The capability of processing XR data may be used to evaluate the capability of the XR terminal to process and/or display XR data, such as the supported FOV angle and/or refresh rate, etc. The ability to process XR data can also be used to evaluate one or more of the XR terminal's endurance, wearing comfort, wearing fatigue, portability, or friendliness to visual impairments. Optionally, the first evaluation information and the second evaluation information can be obtained by MOS, POLQA, VQI or VMAF, or by a combination of two or more of MOS, POLQA, VQI and VMAF, or by Obtained by other methods, which is not limited in this application.

Optionally, the method 700 further includes: obtaining third evaluation information according to the quality evaluation index information of the network, the first evaluation information and the second evaluation information, where the third evaluation information indicates the user experience of the end-to-end process of the XR service, the The end-to-end process includes the generation of XR data, the transmission of XR data, and the processing of XR data. The first evaluation information indicates the source quality of the XR data, which can be understood as being used to evaluate the quality (ie, the source quality) when the XR data is generated. The second evaluation information indicates the capability of processing XR data, which can be understood as an index (ie, terminal quality) used to evaluate the XR terminal when processing XR data. The quality evaluation index information of the network represents the transmission quality of the XR data, and can be understood as being used to evaluate the transmission quality of the XR data in the network (ie, the pipeline quality). The three parts of information of the network quality evaluation index information, the first evaluation information and the second evaluation information can be obtained independently at the corresponding network element. The third evaluation information obtained by integrating the quality evaluation index information, the first evaluation information and the second evaluation information of the network can reflect the user experience of the entire end-to-end process of the XR service.

For example, take the first evaluation information, the second evaluation information and the third evaluation information indicating the first MOS, the second MOS and the third MOS respectively, and the quality evaluation index information of the network indicating the quality evaluation index of the network as an example, the third MOS can satisfy The following formula:

Third MOS=f4 (S ₃ , first MOS, second MOS)

Wherein, "f4 (S ₃ , the first MOS, the second MOS)" represents the function f4 with the quality evaluation index of the network, the first MOS and the second MOS as independent variables. For example, the third MOS can satisfy one of the following formulas:

Third MOS=f4(S ₃ , first MOS, second MOS)=S ₃ +first MOS+second MOS

Third MOS=f4(S ₃ , first MOS, second MOS)=wX*S ₃ +wM1*first MOS+wM2*second MOS

Wherein, wX, wM1 and wM2 respectively represent weighting coefficients corresponding to the quality evaluation index information of the network, the first MOS and the second MOS, and wX, wM1 and wM2 may be real numbers greater than or equal to 0 and less than or equal to 1.

Figure 8 shows a schematic structural diagram of a device. The apparatus 800 may be a network device, a terminal device, a server or a centralized controller, or a chip, a chip system, or a processor that supports the network device, terminal device, server or centralized controller to implement the above method. The apparatus can be used to implement the methods described in the foregoing method embodiments, and for details, reference may be made to the descriptions in the foregoing method embodiments.

The apparatus 800 may include one or more processors 801, and the processors 801 may also be referred to as processing units, and may implement certain control functions. The processor 801 may be a general-purpose processor or a special-purpose processor or the like. For example, it may be a baseband processor or a central processing unit. The baseband processor can be used to process communication protocols and communication data, and the central processing unit can be used to control communication devices (such as base stations, baseband chips, terminals, terminal chips, DU or CU, etc.), execute software programs, process software program data.

In an optional design, the processor 801 may also store instructions and/or data 803, and the instructions and/or data 803 may be executed by the processor, so that the apparatus 800 performs the above method embodiments method described.

In another optional design, the processor 801 may include a transceiver unit for implementing receiving and transmitting functions. For example, the transceiver unit may be a transceiver circuit, or an interface, or an interface circuit, or a communication interface. Transceiver circuits, interfaces or interface circuits used to implement receiving and transmitting functions may be separate or integrated. The above-mentioned transceiver circuit, interface or interface circuit can be used for reading and writing code/data, or the above-mentioned transceiver circuit, interface or interface circuit can be used for signal transmission or transmission.

In yet another possible design, the apparatus 800 may include a circuit, and the circuit may implement the functions of sending or receiving or communicating in the foregoing method embodiments.

Optionally, the apparatus 800 may include one or more memories 802, on which instructions 804 may be stored, and the instructions may be executed on the processor, so that the apparatus 800 executes the above method embodiments method described. Optionally, data may also be stored in the memory. Optionally, instructions and/or data may also be stored in the processor. The processor and the memory can be provided separately or integrated together. For example, the corresponding relationship described in the above method embodiments may be stored in a memory or in a processor.

Optionally, the apparatus 800 may further include a transceiver 805 and/or an antenna 806 . The processor 801 may be referred to as a processing unit, and controls the apparatus 800 . The transceiver 805 may be referred to as a transceiver unit, a transceiver, a transceiver circuit, a transceiver device, or a transceiver module, etc., and is used to implement a transceiver function.

Optionally, the apparatus 800 in this embodiment of the present application may be used to execute the method described in FIG. 7 in the embodiment of this application.

The processors and transceivers described in this application can be implemented in integrated circuits (ICs), analog ICs, radio frequency integrated circuits (RFICs), mixed-signal ICs, application specific integrated circuits (ASICs), printed circuit boards ( printed circuit board, PCB), electronic equipment, etc. The processor and transceiver can also be fabricated using various IC process technologies, such as complementary metal oxide semiconductor (CMOS), nMetal-oxide-semiconductor (NMOS), P-type Metal oxide semiconductor (positive channel metal oxide semiconductor, PMOS), bipolar junction transistor (Bipolar Junction Transistor, BJT), bipolar CMOS (BiCMOS), silicon germanium (SiGe), gallium arsenide (GaAs), etc.

The apparatus described in the above embodiments may be network equipment or terminal equipment, but the scope of the apparatus described in this application is not limited thereto, and the structure of the apparatus may not be limited by FIG. 8 . An apparatus may be a stand-alone device or may be part of a larger device. For example the means may be:

(1) Independent integrated circuit IC, or chip, or, chip system or subsystem;

(2) A set with one or more ICs, optionally, the IC set may also include storage components for storing data and/or instructions;

(3) ASIC, such as modem (MSM);

(4) Modules that can be embedded in other equipment;

(5) Receivers, terminals, smart terminals, cellular phones, wireless equipment, handsets, mobile units, in-vehicle equipment, network equipment, cloud equipment, artificial intelligence equipment, machine equipment, household equipment, medical equipment, industrial equipment, etc.;

(6) Others, etc.

FIG. 9 provides a schematic structural diagram of a terminal device. The terminal device may be applicable to the scenarios shown in FIG. 1 , FIG. 4 , FIG. 5 or FIG. 6 . For convenience of explanation, FIG. 9 only shows the main components of the terminal device. As shown in FIG. 9 , the terminal device 900 includes a processor, a memory, a control circuit, an antenna, and an input and output device. The processor is mainly used to process communication protocols and communication data, control the entire terminal, execute software programs, and process data of the software programs. The memory is mainly used to store software programs and data. The radio frequency circuit is mainly used for the conversion of the baseband signal and the radio frequency signal and the processing of the radio frequency signal. Antennas are mainly used to send and receive radio frequency signals in the form of electromagnetic waves. Input and output devices, such as touch screens, display screens, and keyboards, are mainly used to receive data input by users and output data to users.

When the terminal device is powered on, the processor can read the software program in the storage unit, parse and execute the instructions of the software program, and process the data of the software program. When data needs to be sent wirelessly, the processor performs baseband processing on the data to be sent, and outputs the baseband signal to the radio frequency circuit. The radio frequency circuit processes the baseband signal to obtain a radio frequency signal and sends the radio frequency signal through the antenna in the form of electromagnetic waves. . When data is sent to the terminal device, the radio frequency circuit receives the radio frequency signal through the antenna, the radio frequency signal is further converted into a baseband signal, and the baseband signal is output to the processor, and the processor converts the baseband signal into data and processes the data. deal with.

For ease of illustration, FIG. 9 shows only one memory and processor. In an actual terminal device, there may be multiple processors and memories. The memory may also be referred to as a storage medium or a storage device, etc., which is not limited in this embodiment of the present invention.

As an optional implementation manner, the processor may include a baseband processor and a central processing unit. The baseband processor is mainly used to process communication protocols and communication data, and the central processing unit is mainly used to control the entire terminal device, execute A software program that processes data from the software program. The processor in FIG. 9 integrates the functions of the baseband processor and the central processing unit. Those skilled in the art can understand that the baseband processor and the central processing unit may also be independent processors, interconnected by technologies such as a bus. Those skilled in the art can understand that a terminal device may include multiple baseband processors to adapt to different network standards, a terminal device may include multiple central processors to enhance its processing capability, and various components of the terminal device may be connected through various buses. The baseband processor may also be expressed as a baseband processing circuit or a baseband processing chip. The central processing unit can also be expressed as a central processing circuit or a central processing chip. The function of processing the communication protocol and communication data may be built in the processor, or may be stored in the storage unit in the form of a software program, and the processor executes the software program to realize the baseband processing function.

In one example, the antenna and control circuit with a transceiving function can be regarded as the transceiving unit 911 of the terminal device 900 , and the processor having a processing function can be regarded as the processing unit 912 of the terminal device 900 . As shown in FIG. 9 , the terminal device 900 includes a transceiver unit 911 and a processing unit 912 . The transceiving unit may also be referred to as a transceiver, a transceiver, a transceiving device, or the like. Optionally, the device for implementing the receiving function in the transceiver unit 911 may be regarded as a receiving unit, and the device for implementing the transmitting function in the transceiver unit 911 may be regarded as a transmitting unit, that is, the transceiver unit 911 includes a receiving unit and a transmitting unit. Exemplarily, the receiving unit may also be referred to as a receiver, a receiver, a receiving circuit, and the like, and the transmitting unit may be referred to as a transmitter, a transmitter, or a transmitting circuit, or the like. Optionally, the above-mentioned receiving unit and transmitting unit may be an integrated unit, or may be multiple independent units. The above-mentioned receiving unit and transmitting unit may be located in one geographic location, or may be dispersed in multiple geographic locations.

As shown in FIG. 10 , another embodiment of the present application provides an apparatus 1000 . The apparatus may be a terminal, a network device, a server or a centralized controller, or a component (eg, an integrated circuit, a chip, etc.) of a terminal, a network device, a server or a centralized controller. The device may also be other communication modules, which are used to implement the methods in the method embodiments of the present application. The apparatus 1000 may include: a processing module 1002 (or referred to as a processing unit). Optionally, an interface module 1001 (or referred to as a transceiver unit or a transceiver module) and a storage module 1003 (or referred to as a storage unit) may also be included. The interface module 1001 is used to implement communication with other devices. The interface module 1001 may be, for example, a transceiver module or an input/output module.

In a possible design, one or more modules as shown in FIG. 10 may be implemented by one or more processors, or by one or more processors and memory; or by one or more processors and a transceiver; or implemented by one or more processors, a memory, and a transceiver, which is not limited in this embodiment of the present application. The processor, memory, and transceiver can be set independently or integrated.

The apparatus has the function of implementing the terminal described in the embodiments of the present application. For example, the apparatus includes modules or units or means corresponding to the terminal-related steps described in the embodiments of the present application by the terminal. The functions or units or The means can be implemented by software, or by hardware, or by executing corresponding software by hardware, or by a combination of software and hardware. For details, further reference may be made to the corresponding descriptions in the foregoing corresponding method embodiments. Alternatively, the apparatus has the function of implementing the network equipment described in the embodiments of the present application. For example, the apparatus includes modules or units or means corresponding to the network equipment performing the steps involved in the network equipment described in the embodiments of the present application. , the functions or units or means (means) may be implemented by software, or by hardware, or by executing corresponding software by hardware, or by a combination of software and hardware. For details, further reference may be made to the corresponding descriptions in the foregoing corresponding method embodiments.

Optionally, each module in the apparatus 1000 in the embodiment of the present application may be used to execute the method described in FIG. 7 in the embodiment of the present application.

In a possible design, an apparatus 1000 may include: a processing module 1002 and an interface module 1001 . The processing module 1002 is configured to obtain network transmission statistical information, source parameter information and terminal parameter information. The processing module 1002 is further configured to obtain user image quality experience information according to network transmission statistics information and information source parameter information; and obtain user interaction experience information according to network transmission statistics information, information source parameter information and terminal parameter information. The processing module 1002 is further configured to obtain network quality evaluation index information according to the user image quality experience information and the user interaction experience information. The processing module 1002 may be configured to communicate with the communication device through the interface module 1001 according to the quality evaluation index information of the network.

Since the quality evaluation index information of the above-mentioned network can characterize the transmission quality of XR data in the network, the device can systematically evaluate the objective impact of XR data in network transmission, so as to guide network operators to meet the needs of XR data. The network is maintained and optimized.

In some possible implementations of the above apparatus 1000, the network transmission statistics indicate packet error rate (PER) or block error rate (BLER), packet error conditions, packet delay conditions, average transmission delay, packet delay budget ( PDB), or one or more of Frame Delay Budget (FDB).

In some possible implementations of the above apparatus 1000, the source parameter information indicates the source slice information or stripe information, the information of the source data unit to which the packet belongs, the group of pictures (GOP) information or the refresh cycle of the source data. , one or more of the frame rate of the source data, or the encoding method of the source.

In some possible implementations of the above apparatus 1000, the terminal parameter information indicates the buffer processing capability of the terminal.

In some possible implementations of the above apparatus 1000, the processing module 1002 is configured to obtain the information source parameter information, including: the processing module 1002 is configured to obtain the information source parameter information from the media information layer of the core network, where the media information layer is located in between the application layer and the transport layer.

In a possible implementation manner in which the processing module 1002 is configured to obtain the source parameter information, the processing module 1002 is further configured to obtain the terminal parameter information, including: the processing module 1002 is further configured to obtain the terminal parameter information according to the above-mentioned QoE report.

In some possible implementations of the above apparatus 1000, the processing module 1002 is further configured to obtain terminal parameter information, including: the processing module 1002 is further configured to receive a QoE report from the terminal, and obtain the terminal parameter information according to the QoE report.

In some possible implementation manners of the above apparatus 1000, the processing module 1002 is further configured to obtain user image quality experience information according to network transmission statistical information and information source parameter information, including:

The processing module 1002 is further configured to obtain the average frame impairment rate of the data frame and/or the position of the error frame according to the network transmission statistical information and the information source parameter information; and

User image quality experience information is obtained according to the average frame damage rate and/or the position of the erroneous frame.

In some possible implementation manners of the above apparatus 1000, the processing module 1002 is further configured to obtain user interaction experience parameter information according to network transmission statistical information, information source parameter information and terminal parameter information, including:

The processing module 1002 is further configured to obtain the average frame hopping rate and the average transmission delay of the data frame according to the network transmission statistical information, the parameter information and the terminal parameter information; and

The user interaction experience information is obtained according to the average frame skip rate and the average transmission delay.

It can be understood that, in some scenarios, some optional features in the embodiments of the present application can be implemented independently of other features, such as the solution currently based on them, to solve corresponding technical problems and achieve corresponding The effect can also be combined with other features according to requirements in some scenarios. Correspondingly, the apparatuses provided in the embodiments of the present application may also implement these features or functions correspondingly, which will not be repeated here.

Those skilled in the art can also understand that various illustrative logical blocks (illustrative logical blocks) and steps (steps) listed in the embodiments of the present application may be implemented by electronic hardware, computer software, or a combination of the two. Whether such functionality is implemented in hardware or software depends on the specific application and overall system design requirements. For corresponding applications, those skilled in the art can use various methods to implement the described functions, but such implementation should not be understood as exceeding the protection scope of the embodiments of the present application.

It can be understood that the processor in this embodiment of the present application may be an integrated circuit chip, which has signal processing capability. In the implementation process, each step of the above method embodiments may be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processor may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable circuits. Programming logic devices, discrete gate or transistor logic devices, discrete hardware components.

The solutions described in this application can be implemented in various ways. For example, these techniques can be implemented in hardware, software, or a combination of hardware. For a hardware implementation, a processing unit for performing the techniques at a communication device (eg, a base station, terminal, network entity, or chip) may be implemented in one or more general purpose processors, DSPs, digital signal processing devices, ASICs, A programmable logic device, FPGA, or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of the above. A general-purpose processor may be a microprocessor, or alternatively, the general-purpose processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented by a combination of computing devices, such as a digital signal processor and a microprocessor, multiple microprocessors, one or more microprocessors in combination with a digital signal processor core, or any other similar configuration. accomplish.

It can be understood that the memory in this embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically programmable Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory. Volatile memory may be random access memory (RAM), which acts as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) ) and direct memory bus random access memory (direct rambus RAM, DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but not be limited to, these and any other suitable types of memory.

The present application also provides a computer-readable medium on which a computer program is stored, and when the computer program is executed by a computer, implements the functions of any of the foregoing method embodiments.

The present application also provides a computer program product, which implements the functions of any of the above method embodiments when the computer program product is executed by a computer.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line, DSL) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The available media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, high-density digital video discs (DVDs)), or semiconductor media (eg, solid state disks, SSD)) etc.

It is to be understood that reference throughout the specification to "an embodiment" means that a particular feature, structure or characteristic associated with the embodiment is included in at least one embodiment of the present application. Thus, various embodiments throughout this specification are not necessarily necessarily referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. It can be understood that, in various embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, and should not be used in the embodiments of the present application. implementation constitutes any limitation.

It can be understood that in this application, "when", "if" and "if" all mean that the device will perform corresponding processing under certain objective circumstances, not a limited time, and it is not required that the device must be implemented when it is implemented. The act of judgment does not imply the existence of other limitations.

In this application, "simultaneously" can be understood as being at the same point in time, within a certain period of time, or within the same period.

Those skilled in the art can understand that the various numbers such as the first, the second, etc. involved in the present application are only for the convenience of description, and are not used to limit the scope of the embodiments of the present application. The specific values of the numbers (also referred to as indexes) in this application, the specific values of the quantities, and the positions are only for illustrative purposes, not the only representations, and are not used to limit the scope of the embodiments of the present application. . The first, second, and other numeral numbers involved in the present application are only for the convenience of description, and are not used to limit the scope of the embodiments of the present application.

References in this application to elements in the singular are intended to mean "one or more" rather than "one and only one" unless specifically stated otherwise. In this application, unless otherwise specified, "at least one" is intended to mean "one or more", and "plurality" is intended to mean "two or more".

Additionally, the terms "system" and "network" are often used interchangeably herein. The term "and/or" in this article is only an association relationship to describe the associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and A and B exist independently The three cases of B, where A can be singular or plural, and B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship.

The terms "at least one of" or "at least one of" herein mean all or any combination of the listed items, eg, "at least one of A, B, and C", It can be expressed as: A alone exists, B alone exists, C alone exists, A and B exist simultaneously, B and C exist simultaneously, and A, B and C exist simultaneously, where A can be singular or plural, and B can be Singular or plural, C can be singular or plural.

It can be understood that, in various embodiments of the present application, "B corresponding to A" means that B is associated with A, and B can be determined according to A. However, it should also be understood that determining B according to A does not mean that B is only determined according to A, and B may also be determined according to A and/or other information.

The corresponding relationships shown in each table in this application may be configured or predefined. The values of the information in each table are only examples, and can be configured with other values, which are not limited in this application. When configuring the corresponding relationship between the information and each parameter, it is not necessarily required to configure all the corresponding relationships indicated in each table. For example, in the tables in this application, the corresponding relationships shown in some rows may not be configured. For another example, appropriate deformation adjustments can be made based on the above table, for example, splitting, merging, and so on. The names of the parameters shown in the headings in the above tables may also adopt other names that can be understood by the communication device, and the values or representations of the parameters may also be other values or representations that the communication device can understand. When the above tables are implemented, other data structures can also be used, such as arrays, queues, containers, stacks, linear lists, pointers, linked lists, trees, graphs, structures, classes, heaps, hash tables, or hash tables. Wait.

Predefined in this application may be understood as defining, predefining, storing, pre-storing, pre-negotiating, pre-configuring, curing, or pre-firing.

Those skilled in the art can understand that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

It can be understood that the systems, devices and methods described in this application can also be implemented in other ways. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program codes .

The same or similar parts among the various embodiments in this application may refer to each other. In each embodiment in this application and each implementation/implementation method/implementation method in each embodiment, if there is no special description or logical conflict, between different embodiments and each implementation/implementation method in each embodiment The terms and/or descriptions between the implementation methods/implementation methods are consistent and can be referred to each other. Different embodiments, and the technical features in the various implementations/implementation methods/implementation methods in each embodiment are based on their inherent Logical relationships can be combined to form new embodiments, implementations, implementations, or implementations. The above-described embodiments of the present application do not limit the protection scope of the present application.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application.

Claims

A communication method, comprising:

Obtain network transmission statistics, source parameter information and terminal parameter information;

obtaining user image quality experience information according to the network transmission statistical information and the information source parameter information;

Obtain user interaction experience information according to the network transmission statistical information, the source parameter information and the terminal parameter information;

Obtain network quality evaluation index information according to the user image quality experience information and the user interaction experience information;

Communicate with the communication device according to the quality evaluation index information of the network.
The method according to claim 1, wherein the network transmission statistical information indicates a packet error rate (PER) or a block error rate (BLER), a packet error condition, a packet delay condition, an average transmission delay, a packet time One or more of Delay Budget (PDB), or Frame Delay Budget (FDB).
The method according to claim 1 or 2, wherein the source parameter information indicates slice information or slice information of the source, information of the source data unit to which the packet belongs, group of pictures (GOP) information, or One or more of the refresh period of the source data, the frame rate of the source data, or the encoding method of the source.
The method according to any one of claims 1-3, wherein the terminal parameter information indicates the buffer processing capability of the terminal.
The method according to any one of claims 1-4, wherein obtaining the source parameter information comprises:

The information source parameter information is obtained from the media information layer of the core network, and the media information layer is located between the application layer and the transport layer.
The method according to any one of claims 1-4, wherein obtaining the source parameter information comprises:

Receive a quality of experience (QoE) report from the terminal, and obtain the source parameter information according to the QoE report.
The method according to claim 6, wherein obtaining the terminal parameter information comprises:

The terminal parameter information is obtained according to the QoE report.
The method according to any one of claims 1-5, wherein obtaining the terminal parameter information comprises:

Receive a quality of experience (QoE) report from the terminal, and obtain the terminal parameter information according to the QoE report.
The method according to any one of claims 1-8, wherein obtaining the user image quality experience information according to the network transmission statistical information and the information source parameter information, comprising:

Obtaining the average frame impairment rate of the data frame and/or the position of the erroneous frame according to the network transmission statistical information and the information source parameter information; and

The user image quality experience information is obtained according to the average frame damage rate and/or the position of the erroneous frame.
The method according to any one of claims 1-9, wherein obtaining the user interaction experience parameter information according to the network transmission statistical information, the information source parameter information, and the terminal parameter information, comprising: :

Obtaining the average frame hopping rate and average transmission delay of data frames according to the network transmission statistical information, the information source parameter information and the terminal parameter information; and

The user interaction experience information is obtained according to the average frame skip rate and the average transmission delay.
A communication device, comprising: a processing module and an interface module;

The processing module is used to obtain network transmission statistical information, source parameter information and terminal parameter information;

The processing module is further configured to obtain user image quality experience information according to the network transmission statistical information and the information source parameter information;

The processing module is further configured to obtain user interaction experience information according to the network transmission statistical information, the information source parameter information and the terminal parameter information;

The processing module is further configured to obtain network quality evaluation index information according to the user image quality experience information and the user interaction experience information;

The processing module is further configured to control the interface module to communicate with the communication device according to the quality evaluation index information of the network.
The apparatus according to claim 11, wherein the network transmission statistical information indicates a packet error rate (PER) or a block error rate (BLER), a packet error condition, a packet delay condition, an average transmission delay, a packet time One or more of Delay Budget (PDB), or Frame Delay Budget (FDB).
The apparatus according to claim 11 or 12, wherein the source parameter information indicates slice information or stripe information of the source, information of the source data unit to which the packet belongs, group of pictures (GOP) information or information. One or more of the refresh period of the source data, the frame rate of the source data, or the encoding method of the source.
The apparatus according to any one of claims 11 to 13, wherein the terminal parameter information indicates a buffer processing capability of the terminal.
The apparatus according to any one of claims 11 to 14, wherein the processing module is configured to obtain the source parameter information, comprising:

The processing module is configured to obtain the information source parameter information from the media information layer of the core network, where the media information layer is located between the application layer and the transport layer.
The apparatus according to any one of claims 11 to 14, wherein the processing module is configured to obtain the source parameter information, comprising:

The processing module is configured to receive a quality of experience (QoE) report from a terminal, and obtain the source parameter information according to the QoE report.
The apparatus according to claim 16, wherein the processing module is configured to obtain the terminal parameter information, comprising:

The processing module is configured to obtain the terminal parameter information according to the QoE report.
The apparatus according to any one of claims 11 to 15, wherein the processing module is configured to obtain the terminal parameter information, comprising:

The processing module is configured to receive a quality of experience (QoE) report from a terminal, and obtain the terminal parameter information according to the QoE report.
The apparatus according to any one of claims 11 to 18, wherein the processing module is configured to obtain the user image quality experience information according to the network transmission statistical information and the information source parameter information, comprising: :

The processing module is configured to obtain the average frame impairment rate of the data frame and/or the position of the erroneous frame according to the network transmission statistical information and the information source parameter information; and

The processing module is configured to obtain the user image quality experience information according to the average frame damage rate and/or the position of the error frame.
The apparatus according to any one of claims 11 to 19, wherein the processing module is configured to obtain the user according to the network transmission statistical information, the source parameter information and the terminal parameter information Interactive experience parameter information, including:

The processing module is configured to obtain the average frame hopping rate and average transmission delay of the data frame according to the network transmission statistical information, the information source parameter information and the terminal parameter information; and

The processing module is configured to obtain the user interaction experience information according to the average frame skip rate and the average transmission delay.
A communication device, characterized in that it comprises: a processor coupled with a memory, the memory is used to store a program or an instruction, when the program or instruction is executed by the processor, the device causes the device A method as claimed in any one of claims 1 to 10 is performed.
A computer-readable storage medium on which a computer program or instruction is stored, characterized in that, when the computer program or instruction is executed, the computer executes the method according to any one of claims 1 to 10.
A computer program, characterized in that it includes a program or an instruction, and when the program or instruction is run on a computer, the method according to any one of claims 1-10 is performed.
A communication device, characterized by comprising a unit for performing the method according to any one of claims 1-10.
A communication device, characterized in that, the device is configured to execute the method according to any one of claims 1-10.