CN114885359A

CN114885359A - Time delay performance evaluation method, access network device and storage medium

Info

Publication number: CN114885359A
Application number: CN202210648764.6A
Authority: CN
Inventors: 李�一; 龙青良; 金雨超; 郑雨婷; 狄子翔; 李德屹; 朱小萌; 贾玉玮; 李菲; 程新洲
Original assignee: China United Network Communications Group Co Ltd
Current assignee: China United Network Communications Group Co Ltd
Priority date: 2022-06-09
Filing date: 2022-06-09
Publication date: 2022-08-09

Abstract

The disclosure provides a time delay performance evaluation method, access network equipment and a storage medium, which relate to the technical field of communication and can evaluate the time delay performance of a target service. The method comprises the following steps: determining the time delay of a data packet transmitted by a target service in a target time period; determining an overtime data packet in the data packet according to the time delay of the data packet; the overtime data packet is a data packet with the time delay larger than the target time delay; and evaluating the time delay performance of the target service according to the time delay of the overtime data packet. The embodiment of the disclosure is used in the process of evaluating the time delay performance of the target service.

Description

Time delay performance evaluation method, access network device and storage medium

Technical Field

The present disclosure relates to the field of communications technologies, and in particular, to a time delay performance evaluation method, an access network device, and a storage medium.

Background

In the related art, access network equipment generally employs a Quality of Service (QoS) monitoring mechanism to monitor the delay of a data packet, and uses the average delay of the data packet of a Service in a statistical period as the delay of the Service, so as to determine whether the transmission of the Service meets the Service transmission requirement according to the average delay. However, currently, it can only be determined whether the delay of service transmission meets the requirement according to the average delay, and the delay performance of the service cannot be evaluated.

Disclosure of Invention

The disclosure provides a time delay performance evaluation method, an access network device and a storage medium, which are used for evaluating time delay performance in a transmission process of a service.

In order to achieve the purpose, the technical scheme adopted by the disclosure is as follows:

in a first aspect, a method for evaluating latency performance is provided, including: determining the time delay of a data packet transmitted by a target service in a target time period; determining an overtime data packet in the data packet according to the time delay of the data packet; the overtime data packet is a data packet with the time delay larger than the target time delay; and evaluating the time delay performance of the target service according to the time delay of the overtime data packet.

With reference to the foregoing first aspect, in a possible implementation manner, the evaluating, according to a delay of a timeout packet, a delay performance of a target service includes: determining the average time delay of the overtime data packet; the average time delay of the overtime data packets is the ratio of the sum of the time delays of the overtime data packets to the number of the overtime data packets; and evaluating the time delay performance of the target service according to the average time delay of the overtime data packet.

With reference to the first aspect, in a possible implementation manner, the evaluating the delay performance of the target service according to the average delay of the timeout data packet includes: under the condition that the time delay average value of the overtime data packet is larger than a first preset threshold value, evaluating that the time delay performance of the target service does not meet the requirement; and under the condition that the time delay average value of the overtime data packet is less than or equal to a first preset threshold value, evaluating the time delay performance of the target service to meet the requirement.

With reference to the first aspect, in a possible implementation manner, the evaluating the delay performance of the target service according to the delay of the timeout packet further includes: determining a plurality of time delay intervals; the time delay value of the left end point of the minimum time delay interval in the plurality of time delay intervals is a target time delay; determining a time delay interval to which the time delay of each overtime data packet in the overtime data packets belongs; and evaluating the time delay performance of the target service according to the time delay quantity of the overtime data packets included in each time delay interval.

With reference to the first aspect, in a possible implementation manner, the evaluating the delay performance of the target service according to the number of delays of the timeout packets included in each delay interval includes: under the condition that the time delay quantity of the overtime data packets included in the target time delay interval meets a first preset condition, evaluating the time delay performance of the target service to meet the requirement; the target time delay interval is one or more time delay intervals in the multiple time delay intervals; and under the condition that the time delay quantity of the overtime data packets included in the target time delay interval does not meet a first preset condition, evaluating that the time delay performance of the target service does not meet the requirement.

With reference to the first aspect, in a possible implementation manner, after evaluating that the delay performance of the target service does not meet the requirement, the method further includes: starting a target function; the target function includes at least one of: mini-slot, uplink GRANT UL GRANT, physical downlink shared channel repeat PDSCH repeat, physical uplink shared channel repeat PUSCH repeat, LOW spectral efficiency LOW-SE, packet data convergence protocol repeat PDCP repeat, preemption indication PI and cancellation indication CI.

With reference to the first aspect, in a possible implementation manner, the target time delay includes: a first target time delay and a second target time delay; the first target time delay is a time delay corresponding to the uplink data packet; the second target time delay is the time delay corresponding to the downlink data packet; under the condition that the target time delay comprises a first target time delay, the data packet comprises an uplink data packet; and under the condition that the target time delay comprises a second target time delay, the data packet comprises a downlink data packet.

With reference to the first aspect, in a possible implementation manner, the target time delay includes: a third target time delay, a fourth target time delay and a fifth target time delay; the third target time delay is the time delay corresponding to the data packet of the target PLMN network; the fourth target time delay is the time delay corresponding to the data packet of the target slice; the time delay corresponding to the data packet of the fifth target time delay target 5QI service; under the condition that the target time delay comprises a third target time delay, the data packet comprises a data packet of a target PLMN network; under the condition that the target time delay comprises a fourth target time delay, the data packet comprises a data packet of a target slice; and in the case that the target time delay comprises a fifth target time delay, the data packet comprises the data packet of the target 5QI service.

With reference to the first aspect, in a possible implementation manner, the target time delay is a time delay determined by the access network device in response to the first operation; the first operation is an operation for configuring a target delay input in a network management configuration system of the access network.

With reference to the first aspect, in a possible implementation manner, the target time delay is a time delay determined by the access network device according to the preconfigured first time delay configuration information; the first delay configuration information is used for configuring a target delay.

With reference to the first aspect, in a possible implementation manner, the target time delay is a time delay determined according to first indication information sent by the core network device; the first indication information is used for indicating the value of the target time delay.

With reference to the first aspect, in a possible implementation manner, the target time delay is a time delay determined according to second indication information sent by the core network device; the second indication information is used for indicating second time delay configuration information; the second delay configuration information is used for configuring the target delay.

With reference to the first aspect, in a possible implementation manner, the method further includes: determining the time delay of a data packet transmitted by a target cell in a target time period; determining an overtime data packet in the data packet transmitted by the target cell according to the time delay of the data packet transmitted by the target cell; and evaluating the time delay performance of the target cell according to the time delay of the overtime data packet transmitted by the target cell.

In a second aspect, an access network device is provided, which includes: a processing unit; the processing unit is used for determining the time delay of the data packet transmitted by the target service in the target time period; the processing unit is also used for determining an overtime data packet in the data packet according to the time delay of the data packet; the overtime data packet is a data packet with the time delay larger than the target time delay; and the processing unit is also used for evaluating the time delay performance of the target service according to the time delay of the overtime data packet.

With reference to the second aspect, in a possible implementation manner, the processing unit is specifically configured to: determining the average time delay of the overtime data packet; the average time delay of the overtime data packets is the ratio of the sum of the time delays of the overtime data packets to the number of the overtime data packets; and evaluating the time delay performance of the target service according to the average time delay of the overtime data packet.

With reference to the second aspect, in a possible implementation manner, the processing unit is specifically configured to: under the condition that the time delay average value of the overtime data packet is larger than a first preset threshold value, evaluating that the time delay performance of the target service does not meet the requirement; and under the condition that the time delay average value of the overtime data packet is less than or equal to a first preset threshold value, evaluating the time delay performance of the target service to meet the requirement.

With reference to the second aspect, in a possible implementation manner, the processing unit is specifically configured to: determining a plurality of time delay intervals; the time delay value of the left end point of the minimum time delay interval in the plurality of time delay intervals is a target time delay; determining a time delay interval to which the time delay of each overtime data packet in the overtime data packets belongs; and evaluating the time delay performance of the target service according to the time delay quantity of the overtime data packets included in each time delay interval.

With reference to the second aspect, in a possible implementation manner, the processing unit is specifically configured to: under the condition that the time delay quantity of the overtime data packets included in the target time delay interval meets a first preset condition, evaluating the time delay performance of the target service to meet the requirement; the target time delay interval is one or more time delay intervals in the multiple time delay intervals; and under the condition that the time delay quantity of the overtime data packets included in the target time delay interval does not meet a first preset condition, evaluating that the time delay performance of the target service does not meet the requirement.

With reference to the second aspect, in a possible implementation manner, the processing unit is further configured to: starting a target function; the target function includes at least one of: mini-slot, uplink GRANT UL GRANT, physical downlink shared channel repeat PDSCH repeat, physical uplink shared channel repeat PUSCH repeat, LOW spectral efficiency LOW-SE, packet data convergence protocol repeat PDCP repeat, preemption indication PI and cancellation indication CI.

With reference to the second aspect, in a possible implementation manner, the target time delay includes: a first target time delay and a second target time delay; the first target time delay is a time delay corresponding to the uplink data packet; the second target time delay is the time delay corresponding to the downlink data packet; under the condition that the target time delay comprises a first target time delay, the data packet comprises an uplink data packet; and under the condition that the target time delay comprises a second target time delay, the data packet comprises a downlink data packet.

With reference to the second aspect, in a possible implementation manner, the target time delay includes: a third target time delay, a fourth target time delay and a fifth target time delay; the third target time delay is the time delay corresponding to the data packet of the target PLMN network; the fourth target time delay is the time delay corresponding to the data packet of the target slice; the time delay corresponding to the data packet of the fifth target time delay target 5QI service; under the condition that the target time delay comprises a third target time delay, the data packet comprises a data packet of a target PLMN network; under the condition that the target time delay comprises a fourth target time delay, the data packet comprises a data packet of a target slice; and in the case that the target time delay comprises a fifth target time delay, the data packet comprises the data packet of the target 5QI service.

With reference to the second aspect, in a possible implementation manner, the target time delay is a time delay determined by the access network device in response to the first operation; the first operation is an operation for configuring a target delay input in a network management configuration system of the access network.

With reference to the second aspect, in a possible implementation manner, the target time delay is a time delay determined by the access network device according to the preconfigured first time delay configuration information; the first delay configuration information is used for configuring the target delay.

With reference to the second aspect, in a possible implementation manner, the target time delay is a time delay determined according to first indication information sent by the core network device; the first indication information is used for indicating the value of the target time delay.

With reference to the second aspect, in a possible implementation manner, the target time delay is a time delay determined according to second indication information sent by the core network device; the second indication information is used for indicating second time delay configuration information; the second delay configuration information is used for configuring the target delay.

With reference to the second aspect, in a possible implementation manner, the processing unit is further configured to: determining the time delay of a data packet transmitted by a target cell in a target time period; determining an overtime data packet in the data packet transmitted by the target cell according to the time delay of the data packet transmitted by the target cell; and evaluating the time delay performance of the target cell according to the time delay of the overtime data packet transmitted by the target cell.

In a third aspect, the present disclosure provides an access network device, including: a processor and a memory; wherein the memory is configured to store computer-executable instructions, and when the access network device runs, the processor executes the computer-executable instructions stored by the memory to cause the access network device to perform the latency performance assessment method as described in the first aspect and any one of the possible implementation manners of the first aspect.

In a fourth aspect, the present disclosure provides a computer-readable storage medium having instructions stored therein, which when executed by a processor of an access network device, enable the access network device to perform the latency performance assessment method as described in the first aspect and any one of the possible implementations of the first aspect.

In the present disclosure, the names of the above-mentioned access network devices do not constitute limitations on the devices or functional modules themselves, which may appear by other names in actual implementations. Insofar as the functions of the respective devices or functional modules are similar to those of the present disclosure, they are within the scope of the claims of the present disclosure and their equivalents.

These and other aspects of the disclosure will be more readily apparent from the following description.

The technical scheme provided by the disclosure at least brings the following beneficial effects:

the embodiment of the disclosure provides a time delay performance evaluation method, wherein an access network device obtains the time delay of each data packet in a target time period, and determines the time delay of all overtime data packets in the target time period according to a set target time delay. And the access network equipment evaluates the time delay performance of the target service according to the time delay of the overtime data packet. Based on the method, the access network equipment can screen the overtime data packets from the data packets, analyze the time delay of the overtime data packets and determine the time delay performance of the overtime data packets. And determining the time delay performance of the service according to the time delay performance of the overtime data packet. In this way, the access network device may evaluate the delay performance of the target service based on the delay of the data packet which may be overtime.

Drawings

Fig. 1 is a schematic hardware structure diagram of an access network device provided in the present disclosure;

fig. 2 is a schematic view of a monitoring process of uplink and downlink time delay between a base station and a UPF according to the present disclosure;

fig. 3 is a schematic diagram of an average delay of a downlink air interface between an access network device and a terminal according to the present disclosure;

fig. 4 is a schematic diagram of an average delay of an uplink air interface between an access network device and a terminal according to the present disclosure;

fig. 5 is a schematic flow chart of a delay performance evaluation method provided by the present disclosure;

FIG. 6 is a schematic flow chart diagram illustrating another method for evaluating delay performance according to the present disclosure;

FIG. 7 is a schematic flow chart diagram illustrating another method for evaluating delay performance according to the present disclosure;

FIG. 8 is a schematic flow chart diagram illustrating another method for evaluating delay performance according to the present disclosure;

FIG. 9 is a schematic flow chart diagram illustrating another method for evaluating delay performance according to the present disclosure;

fig. 10 is a schematic structural diagram of an access network device according to the present disclosure.

Detailed Description

The delay performance evaluation method, the access network device, and the storage medium provided in the embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone.

The terms "first" and "second" and the like in the specification and drawings of the present disclosure are used for distinguishing different objects or for distinguishing different processes for the same object, and are not used for describing a specific order of the objects.

Furthermore, the terms "including" and "having," and any variations thereof, mentioned in the description of the present disclosure, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

It should be noted that in the embodiments of the present disclosure, words such as "exemplary" or "for example" are used to mean serving as examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "e.g.," in an embodiment of the present disclosure is not to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

Fig. 1 is a schematic structural diagram of an access network device according to an embodiment of the present disclosure. As shown in fig. 1, the access network device 100 includes at least one processor 101, a communication line 102, and at least one communication interface 104, and may also include a memory 103. The processor 101, the memory 103 and the communication interface 104 may be connected via a communication line 102.

The processor 101 may be a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present disclosure, such as: one or more Digital Signal Processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs).

The communication link 102 may include a path for communicating information between the aforementioned components.

The communication interface 104 is used for communicating with other devices or a communication network, and may use any transceiver or the like, such as ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), and the like.

The memory 103 may be, but is not limited to, a read-only memory (ROM) or other type of static storage device that may store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that may store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to include or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

In a possible design, the memory 103 may exist separately from the processor 101, that is, the memory 103 may be a memory external to the processor 101, in which case, the memory 103 may be connected to the processor 101 through the communication line 102, and is used for storing execution instructions or application program codes, and is controlled by the processor 101 to execute, so as to implement the network quality determination method provided by the following embodiments of the present disclosure. In yet another possible design, the memory 103 may also be integrated with the processor 101, that is, the memory 103 may be an internal memory of the processor 101, for example, the memory 103 is a cache memory, and may be used for temporarily storing some data and instruction information.

As one implementation, the processor 101 may include one or more CPUs, such as CPU0 and CPU1 in fig. 1. As another implementation, the access network apparatus 100 may include multiple processors, such as the processor 101 and the processor 107 in fig. 1. As yet another implementation, the access network device 100 may further include an output device 105 and an input device 106.

Hereinafter, terms related to the embodiments of the present disclosure are explained for convenience of understanding.

1、URLLC

URLLC is a communication technology with ultra-low latency and ultra-high reliability. In the aspect of time delay, the URLLC technology can meet the data transmission requirement that the uplink and downlink time delay of the user plane between the base station and the terminal is as low as 0.5 ms. In terms of reliability, URLLC technology can achieve a reliability of 10 ^-5 A level of data transmission requirements.

URLLC service is one of three major application scenarios of fifth generation mobile communication technology (5G), the main application scenarios include but are not limited to: industrial control, device automation, car networking, and telesurgery.

Because the URLLC service needs to consider both delay and reliability, the probability that the transmission delay is smaller than a certain threshold value in data transmission of the URLLC service usually reaches a preset threshold value. For example, the probability of requiring a transmission delay of less than 10ms is greater than 60%.

2. QoS monitoring

QoS monitoring is a technique for monitoring the average delay of data packets. Because the URLLC service has higher time delay to the data, the time delay of the URLLC service can be monitored by a QoS monitoring technology in the URLLC service so as to determine whether the time delay reliability of the URLLC service meets the time delay reliability requirement of the URLLC service.

QoS monitoring is a new monitoring mechanism proposed in 3GPP R16 release, and can monitor the delay of traffic with different granularities. Currently, QoS monitoring mainly includes: QoS monitoring with each QoS flow granularity of each terminal, and QoS monitoring with a General Packet Radio Service (GPRS) tunnel Protocol User Plane Part (User Plane Part of GPRS tunneling Protocol, GTP-U) GTP-U tunnel as granularity.

QoS monitoring is mainly used to monitor the time delay from the User Plane Function (UPF) to the terminal. Wherein, the time delay between the UPF and the terminal comprises: uplink and downlink air interface time delay, and uplink and downlink time delay between the base station and the UPF. And the uplink and downlink air interface time delay is monitored by the base station. The uplink and downlink time delay between the base station and the UPF is monitored by the base station and the UPF together.

Specifically, the uplink and downlink time delay between the base station and the UPF includes the following two types: QoS flow level latency, and GTP-U level latency. The following description will take the example of monitoring the delay of QoS flow levels.

As shown in fig. 2, the monitoring process for uplink and downlink time delay between a base station and a UPF includes the following steps 201 to 205.

Step 201, an Access Facility (AF) sends a first QoS monitoring request to a Policy Control Function (PCF). Accordingly, the PCF receives a first QoS monitoring request from the AF.

The first QoS monitoring request is used for requesting the PCF to generate a QoS monitoring strategy.

Step 202, PCF sends QoS monitoring policy to Session Management Function (SMF).

Specifically, after receiving the first QoS monitoring request, the PCF generates an authorized QoS monitoring policy according to the first QoS monitoring request. After that, the PCF sends the QoS monitoring policy to the SMF.

Optionally, the QoS monitoring Policy is carried in a Policy and Charging Control (PCC) rule sent by the PCF to the SMF.

Step 203, the SMF monitors the delay of the QoS flow between the terminal and the PCF according to the QoS monitoring policy.

Specifically, the SMF activates the QoS monitoring policy in a process of establishing a Protocol Data Unit (PDU) session or modifying a PDU session. After the QoS monitoring strategy is activated, the SMF monitors the time delay of end-to-end uplink and downlink QoS flows between the terminal and the PCF according to the QoS monitoring strategy.

Step 204, the SMF sends the second QoS monitoring request to the UPF, and sends the third QoS monitoring request to the access network device.

Wherein the second QoS monitoring request is for requesting the UPF to monitor the QoS flow between the UPF and the access network device. The third QoS monitoring request is for requesting the access network device to monitor the QoS flow between the UPF and the access network device.

Optionally, the second QoS monitoring request and the third QoS monitoring request both include: the SMF monitors the monitored parameters determined by the policy based on authorized QoS obtained from the PCF or from a local configuration.

In one possible implementation, the second QoS monitoring request is carried in N4 signaling sent by the SMF to the UPF. The third QoS monitoring request is carried in N2 signaling sent by the SMF to the access network device.

Step 205, the access network device and the UPF determine the time delay of the QoS flow between the terminal and the UPF according to the second QoS monitoring request and the third QoS monitoring request.

In a possible implementation manner, the access network device initiates Uplink (UL)/Downlink (DL) delay measurement on the radio access network side according to the third QoS monitoring request. The access network equipment reports the time delay measurement result of UL/DL on the wireless access network side to the UPF in the uplink data packet or the virtual uplink data packet.

Specifically, step 205 can be specifically realized through the following steps 2051 to 2054.

Step 2051, the UPF sends the data packet to the access network device.

Wherein, the data message includes: qos Flow Identifier (QFI), Qos monitoring packet indicator (QMP), time T1. Wherein the QoS monitoring packet indicator is used for indicating that the packet is used for UL/DL packet delay measurement. Time T1 is the local time when the UPF sends a downstream monitoring packet.

In a specific implementation, the QFI, the QoS monitoring packet indicator, and the time T1 are encapsulated in a header of a data message by the UPF, and after encapsulation, the UPF sends the data message to the access network device.

Step 2052, the access network equipment receives the data message and measures the time delay of the wireless access network side.

Specifically, after receiving the data packet, the access network device parses the header of the data packet, and determines time T1. The access network device determines the local time T2 at which the data packet was received. After that, the access network equipment starts to measure the UL/DL data packet time delay on the wireless access network side.

Step 2053, the access network device reports the monitoring response packet to the UPF.

Specifically, when the access network device receives an uplink packet for this QFI from the terminal, or when the access network device sends a virtual uplink packet as a monitoring response (if there is no uplink service packet data for uplink packet latency monitoring), the access network device encapsulates QMP the indicator, the radio access network portion of the uplink/downlink packet latency result, time T1, time T2, and time T3. Wherein, the time T3 is the time when the access network device sends the monitoring response packet to the UPF through the N3 interface.

Step 2054, the access network device receives the monitoring response packet and determines a time delay between the access network device and the UPF.

Specifically, when the access network device receives the monitoring response packet, the local time T4 is recorded, and the round-trip delay between the access network device and the UPF is calculated based on the time information included in the GTP-U header of the received monitoring response packet.

2.1 air interface downlink time delay

The downlink time delay of the air interface is the average time delay of the downlink air interface between the access network equipment and the terminal in the statistical period. The definition of the average time delay of the downlink air interface between the access network device and the terminal in 3GPP is shown in the following fig. 3, where the downlink time delay of the air interface includes: downlink time delay D1, downlink time delay D2, downlink time delay D3 and downlink time delay D4.

As shown in fig. 3, the downlink delay D1 is a delay between a terminal and a Distribution Unit (DU), the downlink delay D2 is a delay between a Radio Link Control (RLC) layer of the DU and a Media Access Control (MAC) layer of the DU, the downlink delay D3 is a delay between a Packet Data Convergence Protocol (PDCP) layer of a Central Unit (CU) and the RLC layer of the DU, and the downlink delay D4 is a delay between a Service Data Adaptation Protocol (SDAP) layer of the CU and the PDCP layer of the CU.

As shown in table 1 below, is an explanation of the four delays in the standard protocol.

TABLE 1 description of Downlink latency

2.2 air interface uplink time delay

The uplink time delay of the air interface is the average time delay of the uplink air interface between the access network equipment and the terminal in the statistical period. The definition of the average delay of the uplink air interface between the access network device and the terminal in 3GPP is shown in fig. 4, where the uplink delay of the air interface includes: an uplink time delay D1, an uplink time delay D2.1, an uplink time delay D2.2 and an uplink time delay D2.3.

As shown in fig. 4, the uplink delay D1 is a delay between an SDAP layer of the terminal and a Physical layer (PHY) layer of the terminal, the uplink delay D2.1 is a delay between the terminal and a DU, the uplink delay D2.2 is a delay between the PHY layer of the DU and the RLC layer of the DU, the uplink delay D2.3 is a delay between the RLC layer of the DU and the PDCP layer of the CU, and the uplink delay D4.1 is a delay between the PDCP layer of the CU and the SDAP layer of the CU.

As shown in table 2 below, for the explanation of the four delays in the standard protocol.

TABLE 2 description of uplink time delay

The terms related to the present application are explained in detail above.

In the related art, access network equipment generally adopts a QoS monitoring mechanism to monitor the delay of a data packet, and uses the average delay of a data packet of a service in a statistical period as the delay of the service, so as to determine whether the transmission of the service meets the service transmission requirement according to the average delay. However, currently, it can only be determined whether the delay of service transmission meets the requirement according to the average delay, and the delay performance of the service cannot be evaluated. In order to solve the problems in the related art, an embodiment of the present disclosure provides a delay performance evaluation method, where an access network device obtains a delay of each data packet in a target time period, and determines a delay of all timeout data packets in the target time period according to a set target delay. And the access network equipment evaluates the time delay performance of the target service according to the time delay of the overtime data packet. Based on the method, the access network equipment can screen the overtime data packets from the data packets, analyze the time delay of the overtime data packets and determine the reliability of the overtime data packets. And expressing the reliability of service transmission according to the reliability of the overtime data packet. In this way, the access network device may evaluate the delay performance of the target service based on the delay of the data packet which may be overtime.

As shown in fig. 5, the method for evaluating delay performance provided by the embodiment of the present disclosure may be specifically implemented by steps 501 to 503 shown in fig. 5, which will be described in detail below.

Step 501, the access network device determines the time delay of the data packet transmitted by the target service in the target time period.

In a possible implementation manner, the data packet is a data packet of a specific service. For example, the data packet is a data packet of URLLC service transmitted by the target service in the target time period.

Optionally, the access network device may determine the delay of each data packet by means of QoS monitoring.

It should be noted that the access network device may periodically count the data packets of the target service, in this case, the target time period is a counting period of the access network device.

The data packet of the target service transmitted in the target time period may be all data packets of the target service collected by the access network device in the target time period, or may be a data packet satisfying requirements in all data packets of the target service collected by the access network device in the target time period.

For example, when determining the uplink delay performance, the data packet of the target service transmitted in the target time period may be an uplink data packet of the target service acquired by the access network device in the target time period.

When determining the downlink delay performance, the data packet of the target service transmitted in the target time period may be a downlink data packet of the target service acquired by the access network device in the target time period.

Step 502, the access network device determines the overtime data packet in the data packet according to the time delay of the data packet.

The overtime data packet is a data packet with the time delay larger than the target time delay.

Specifically, the access network device determines a target delay and compares the delay of each packet with the target delay. And the access network equipment determines the data packet with the time delay larger than the target time delay as an overtime data packet.

It should be noted that, in this embodiment of the present disclosure, the value of the target time delay may be configured for the access network device by the staff, or determined by the access network device according to the time delay configuration information, or indicated by the core network device for the access network device, or determined by the access network device according to the relevant configuration after the core network device issues the relevant configuration information for the access network device, which is not limited by the present disclosure.

As an example, the value of the target delay in the embodiment of the present disclosure may be 10 ms.

Step 503, the access network device evaluates the delay performance of the target service according to the delay of the overtime data packet.

In one possible implementation, the access network device determines the first indicator and the second indicator according to a time delay of the timeout packet. And the access network equipment evaluates the time delay performance of the target service based on the first index and the second index.

Optionally, the first indicator is used to represent an average time delay of the timeout data packet; the second index is used for representing the time delay distribution condition of the overtime data packet. Thus, the access network device can determine whether the time delay of the target service is serious or not according to the average time delay of the overtime data packet. The access network device can determine whether the delay of the data packet of the target service is stable or not and whether the condition of larger delay fluctuation exists or not according to the delay distribution of the overtime data packet.

The scheme at least has the following beneficial effects: the embodiment of the disclosure provides a time delay performance evaluation method, wherein an access network device obtains the time delay of each data packet in a target time period, and determines the time delay of all overtime data packets in the target time period according to a set target time delay. And the access network equipment evaluates the time delay performance of the target service according to the time delay of the overtime data packet. Based on the method, the access network equipment can screen the overtime data packets from the data packets, analyze the time delay of the overtime data packets and determine the reliability of the overtime data packets. And expressing the reliability of service transmission according to the reliability of the overtime data packet. In this way, the access network device may evaluate the delay performance of the target service based on the delay of the data packet which may be overtime.

The time delay performance evaluation method according to the embodiment of the present disclosure is explained above.

It should be noted that the access network device needs to first determine the target delay before determining the timeout packet. Hereinafter, a method for determining the target delay of the access network device will be described in detail.

In the embodiment of the present disclosure, the cases where the access network device determines the target latency include the following cases 1 to 4. Cases 1-4 are respectively: in case 1, the target time delay is a time delay determined by the access network device in response to the first operation; case 2, the target time delay is the time delay determined by the access network equipment according to the pre-configured first time delay configuration information; case 3, the target time delay is the time delay determined according to the first indication information sent by the core network equipment; and 4, the target time delay is the time delay determined according to the second indication information sent by the core network equipment.

The above cases 1 and 4 will be described in detail below.

In case 1, the target delay is a delay determined by the access network device in response to the first operation.

The first operation is an operation for configuring a target time delay input in a network management configuration system of the access network equipment.

For example, in response to a target latency configuration request operation received by the input device, the access network equipment displays a target latency configuration interface. The operator may manually enter the value of the target time delay in the configuration interface. And responding to the operation of configuring the value of the target time delay on the configuration interface received by the input device, and configuring the value of the target time delay by the access network equipment.

And 2, the target time delay is the time delay determined by the access network equipment according to the pre-configured first time delay configuration information.

The preconfigured delay configuration information may be a target delay configured for a service by a worker when configuring the service. The first delay configuration information is used for configuring the target delay.

Illustratively, when a network management system configures service parameters of a service, a worker configures the service parameters by using a target time delay as one of the service parameters. After the configuration is completed, the access network equipment determines a target time delay according to the service parameters of the service.

Optionally, the delay configuration information may be a specific value of the target delay, or may be a corresponding relationship between different types of services and different values of the target delay, or a calculation manner of the value of the target delay, which is not limited in this disclosure.

As an example, the first latency configuration information may be packet latency budget (PDB) configuration information. The access network device may determine the target delay according to the delay value indicated by the packet delay budget configuration information and the corresponding calculation rule. For example, taking the 5QI of the target service as 82 as an example, according to the current relevant protocol, if the 5QI is 82, the PDB takes a value of 10ms, the reserved CN PDB for transmission between the access network device and the core network device takes 1ms, and at this time, the value of the downlink target delay on the radio air interface side of the access network device takes 9 ms.

And in case 3, the target time delay is the time delay determined according to the first indication information sent by the core network equipment.

The first indication information is used for indicating the value of the target time delay.

In a possible implementation manner, the core network device sends first indication information to the access network device, where the first indication information is used to indicate a value of the target delay. And after receiving the first indication information, the access network equipment determines the value of the target time delay according to the first indication information.

Optionally, the first indication information may be carried in a server time signaling sent by the core network device to the access network device.

And 4, the target time delay is the time delay determined according to the second indication information sent by the core network equipment.

The second indication information is used for indicating second time delay configuration information; the second delay configuration information is used for configuring the target delay.

In a possible implementation manner, the core network device sends second indication information to the access network device, where the second indication information is used to indicate the delay configuration information. And after receiving the second indication information, the access network equipment determines a value of the target time delay according to the time delay configuration information in the second indication information.

It is to be understood that the above cases 1-4 are merely exemplary described methods for determining the target latency by the access network device. In a specific implementation process, the access network device may also determine the target delay in other manners, which is not limited in this disclosure.

It should be noted that, in the embodiment of the present disclosure, the access network device may determine different target delays for uplink transmission and downlink transmission, respectively.

For example, the target latency may include: a first target delay and a second target delay. The first target time delay is a time delay corresponding to the uplink data packet; the second target time delay is the time delay corresponding to the downlink data packet.

Under the condition that the target time delay comprises a first target time delay, the data packet comprises an uplink data packet; that is, for the uplink data packet, the access network device determines that the target delay is the first target delay corresponding to the uplink data packet.

When the target time delay comprises a second target time delay, the data packet comprises a downlink data packet; that is, for the downlink data packet, the access network device determines that the target delay is the second target delay corresponding to the downlink data packet.

Therefore, in the uplink transmission scene and the downlink transmission scene, the access network equipment sets different target time delays, and the accuracy of evaluating the time delay performance of the target service can be further improved.

In addition, for different Public Land Mobile Network (PLMN) networks, different slices or services with different 5G QoS identifiers (5G QoS identifiers, 5QI), the access Network device may set different target delays respectively. That is, the target delays corresponding to services of different PLMN networks may be different. The target time delay of the service carried by different slices may be different, and the target time delay of different 5QI services may also be different.

Specifically, the access network device may set corresponding target time delays for services in different PLMN networks; and/or, the access network device may set corresponding target time delays for services carried by different slices; and/or the access network equipment can set corresponding target time delay for different 5QI services. And after the access network equipment acquires the data packet, determining the target time delay of the data packet according to at least one item of 5QI, slice and PLMN (public land mobile network) of the data packet service.

An example, the target latency includes: a third target delay, a fourth target delay, and a fifth target delay.

The third target time delay is the time delay corresponding to the data packet of the target PLMN network; the fourth target time delay is the time delay corresponding to the data packet of the target slice; and the fifth target delay target is the delay corresponding to the data packet of the 5QI service.

And in the case that the target time delay comprises a third target time delay, the data packet comprises a data packet of the target PLMN network.

And in the case that the target time delay comprises a fourth target time delay, the data packet of the target slice is included in the data packet.

And in the case that the target time delay comprises a fifth target time delay, the data packet comprises the data packet of the target 5QI service.

It is noted that in case of differentiating the target delays with granularity of PLMN, slice or 5 QI. The access network equipment may further use PLMN, slice, or 5QI as granularity, and further distinguish in combination with uplink and downlink transmission.

For example, the third target delay may include a first sub-target delay and a second sub-target delay; wherein, the first sub-target time delay is the time delay corresponding to the uplink data packet of the target PLMN network; the second sub-target time delay is the time delay corresponding to the downlink data packet of the target PLMN network.

The fourth target delay may include a third sub-target delay and a fourth sub-target delay; the third sub-target time delay is the time delay corresponding to the uplink data packet of the target slice; the fourth sub-target time delay is the time delay corresponding to the downlink data packet.

The fifth target delay may include a fifth sub-target delay and a sixth sub-target delay; wherein, the fifth sub-target time delay is the time delay corresponding to the uplink data packet of the target 5 QI; and the sixth sub-target delay is the delay corresponding to the downlink data packet of the target 5 QI.

In the above, the manner of determining the target delay by the access network device is described.

The following describes a specific way for the access network device to evaluate the delay performance of the target service according to the delay of the timeout packet in step 503.

The step 503 may specifically include the following scenario 1 and scenario 2, which are respectively: scene 1, access network equipment evaluates the time delay performance of a target service according to the average time delay of an overtime data packet; and in the scene 2, the access network equipment evaluates the delay performance of the target service according to the delay distribution of the overtime data packet. The following description is made separately.

And in the scenario 1, the access network equipment evaluates the delay performance of the target service according to the average delay of the overtime data packet.

With reference to fig. 5, as shown in fig. 6, in scenario 1, the above step 503 can be specifically implemented by the following steps 601 to 602.

Step 601, the access network device determines the average time delay of the overtime data packet.

The average time delay of the overtime data packets is the ratio of the sum of the time delays of the overtime data packets to the number of the overtime data packets. That is, the average time delay of the timeout packets is the total time delay of the timeout packets/the total number of the timeout packets.

In a possible implementation manner, the access network equipment accumulates all data packets with time delay larger than a target time delay to obtain the total time delay of the overtime data packets; the access network device calculates the total number of the timeout packets. After that, the access network device divides the total time delay of the overtime data packets by the total number of the overtime data packets to obtain the average time delay of the overtime data packets.

It should be noted that, in the embodiment of the present disclosure, the data packet that is not received does not include the timeout data packet.

Step 602, the access network device evaluates the delay performance of the target service according to the average delay of the overtime data packet.

Specifically, the access network equipment determines the time delay average value of the overtime data packet, and compares and determines whether the time delay average value of the overtime data packet is greater than a first preset threshold value.

And under the condition that the time delay average value of the overtime data packet is greater than a first preset threshold value, the access network equipment evaluates that the time delay performance of the target service does not meet the requirement.

And under the condition that the time delay average value of the overtime data packet is less than or equal to a first preset threshold value, the access network equipment evaluates the time delay performance of the target service to meet the requirement.

Based on the technical scheme, the access network equipment can evaluate the time delay performance of the target service based on the average time delay of the overtime data packet. The access network device may determine that the time delay of the timeout data packet is generally large when the average time delay of the timeout data packet is greater than a first preset threshold, and in this case, the time delay performance of the target service of the access network device is low. The access network equipment determines that the time delay of the overtime data packet is generally smaller under the condition that the average time delay of the overtime data packet is smaller than or equal to a first preset threshold, and under the condition, the time delay performance of the target service is higher.

And in the scene 2, the access network equipment evaluates the delay performance of the target service according to the delay distribution of the overtime data packet.

Referring to fig. 5, as shown in fig. 7, the step 503 may be implemented by the following steps 701 to 703, which are described in detail below.

Step 701, the access network device determines a plurality of delay intervals.

And the time delay value of the left end point of the minimum time delay interval in the plurality of time delay intervals is the target time delay.

In a possible implementation manner, the access network device determines the interval lengths of the multiple delay intervals, and determines that the left end point of the first delay interval (i.e., the minimum delay interval) is the target delay. And the access network equipment determines the right end point of the first time delay interval according to the target time delay and the interval length. And the access network equipment takes the right end point of the first time delay interval as the left end point of the second time delay interval, and determines the right end point of the second time delay interval according to the method. According to the above process, the access network device determines the plurality of delay intervals.

In yet another possible implementation, the access network device determines a plurality of delay values { T0, T1, T2 … Tn }. And the access network equipment takes every two adjacent delay values as the left end point and the right end point of the delay interval to obtain the plurality of delay intervals. The plurality of delay values may be pre-configured in the access network device, may be indicated to the access network device by the access network device, or may be determined by other manners, which is not limited in this disclosure.

Step 702, the access network device determines a time delay interval to which the time delay of each timeout data packet in the timeout data packets belongs.

In a specific implementation manner, after the access network device determines a delay interval to which a delay of each timeout data packet in the timeout data packets belongs, the access network device determines the number of the timeout data packets in each delay interval (that is, the number of delays of the timeout data packets).

Step 703, the access network device evaluates the delay performance of the target service according to the number of delays of the timeout packets included in each delay interval.

Specifically, the access network device determines the number of time delays of the timeout data packets in each time delay interval, and determines whether the number meets a first preset condition.

And under the condition that the time delay quantity of the overtime data packets included in the target time delay interval meets a first preset condition, evaluating the time delay performance of the target service to meet the requirement.

And under the condition that the time delay quantity of the overtime data packets included in the target time delay interval does not meet a first preset condition, evaluating that the time delay performance of the target service does not meet the requirement.

In a possible implementation manner, the first preset condition is: the number of the time delays of the overtime data packets included in the target time delay interval is smaller than or equal to a second preset threshold value.

In another possible implementation manner, the first preset condition is: and the proportion of the time delay number of the overtime data packets included in the target time delay interval to the total number of the overtime data packets is less than or equal to a third preset threshold.

In another possible implementation manner, the first preset condition is: and the proportion of the time delay number of the overtime data packets in the target time delay interval to the total number of all the data packets is less than or equal to a fourth preset threshold.

In addition, the first preset condition may also be other preset conditions, which is not limited in this disclosure.

It should be noted that, in a specific implementation, the access network device may evaluate the delay performance of the target service according to a manner recorded in at least one of the scenario 1 and the scenario 2; the access network device may also evaluate the delay performance of the target service by combining the manners described in the above scenario 1 and scenario 2, which is not limited in this disclosure.

It can be understood that, when the access network device evaluates the delay performance of the target service, the access network device may also comprehensively evaluate the delay performance of the target service in combination with other indexes in the related art. For example, the access network device may further comprehensively evaluate the delay performance of the target service according to parameters such as RSRP, SINR, packet loss ratio, and the like, as well as the average delay of the timeout data packet, the delay distribution of the timeout data packet, and the like, which is not limited in this disclosure.

The above describes a method for evaluating the delay performance of the target service by the access network device according to the delay of the timeout data packet.

Hereinafter, a method for optimizing the delay performance of the target service by the access network device when the delay performance of the target service does not meet the requirement will be specifically described.

Referring to fig. 5, as shown in fig. 8, the access network device may specifically optimize the delay performance of the target service through the following step 801.

Step 801, the access network device starts a target function.

The target function is used for optimizing the time delay performance of the target service.

An example, the target function includes at least one of: a minislot, an Uplink GRANT UL GRANT, a Physical Downlink Shared Channel (PDSCH) repeat requests, a Physical Uplink Shared Channel (PUSCH) repeat requests, a LOW spectral efficiency LOW-SE, a packet data convergence protocol repeat PDCP duplicate, a Preemption Indication (PI), and a Cancellation Indication (CI).

In a possible implementation manner, as shown in fig. 9, an embodiment of the present disclosure further provides a method for determining a delay performance of a cell, which specifically includes:

step 901, the access network device determines the delay of the data packet transmitted by the target cell in the target time period.

When the target delay is configured with 5QI as granularity, the data packet transmitted by the target cell may be a data packet of one or more services corresponding to 5QI transmitted by the target cell.

In the case that the target time delay is configured with the slice as the granularity, the data packet transmitted by the target cell may be a data packet of a service corresponding to one or more slices transmitted by the target cell.

In the case that the target time delay is configured with the PLMN as the granularity, the data packet transmitted by the target cell may be a data packet of a service corresponding to one or more PLMNs transmitted by the target cell.

It should be noted that the implementation of step 901 is similar to that of step 501, and is not described here again.

Step 902, the access network device determines the overtime data packet in the data packet transmitted by the target cell according to the time delay of the data packet transmitted by the target cell.

It should be noted that the implementation manner of step 902 is similar to that of step 502 described above, and the specific implementation manner of step 902 may refer to the descriptions in step 502 and the possible implementation manners of step 502 described above, and is not described herein again.

Step 903, the access network device evaluates the delay performance of the target cell according to the delay of the overtime data packet transmitted by the target cell.

It should be noted that the implementation manner of step 903 is similar to that of step 503, and the specific implementation manner of step 903 may refer to the descriptions in step 503 and the possible implementation manners of step 503, and is not described herein again.

It can be understood that, in the case that the delay performance of the target cell does not meet the requirement, the access network device may also perform the above step 801 by instructing the target cell to improve the delay performance of the target cell. This is not limited in this application.

Hereinafter, the delay performance evaluation method according to the embodiment of the present disclosure will be described in detail with reference to specific examples.

Example 1, the value of the wireless-side downlink delay configured by the access network device for the target service is 10 ms. The preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold for the target traffic is 30 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The downlink time delay of the wireless side of the 8 data packets is shown in the following table 3:

TABLE 3 Wireless side Downlink delay

Data packet numbering	Data packet downlink delay
		packet1	8ms
Packet2	7ms
		Packet3	9ms
Packet4	5ms
		Packet5	4ms
Packet6	6ms
		Packet7	7ms
Packet8	8ms

According to table 3, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 0, the total time delay of the downlink timeout data packets is 0, and the average time delay of the downlink timeout data packets is 0. At this time, the downlink delay performance of the target service does not need to be optimized.

Example 2, the access network device configures a target delay value for the target service to be 9ms according to an existing Packet Delay Budget (PDB). The preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold of the target traffic is 30 ms.

The PDB may be sent by the core network to the access network device, or may be preconfigured by the access network device. When the core network device sends a message to the access network device, taking a 5QI of the target service as an example, and according to the current relevant protocol, when the 5QI is 82, the value of the PDB is 10ms, and the transmission reservation CN PDB between the access network device and the core network device is 1ms, at this time, the value of the downlink target delay at the radio air interface side of the access network device is 9 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The downlink time delay of the wireless side of the 8 data packets is shown in the following table 4:

TABLE 4 Wireless side Downlink delay

According to table 4, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 0, the total time delay of the downlink timeout data packets is 0, and the average time delay of the downlink timeout data packets is 0. At this time, the downlink delay performance of the target service does not need to be optimized.

Example 3, the access network device configures a target delay value of 10ms for the target service according to an existing Packet Delay Budget (PDB). The preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold for the target traffic is 30 ms.

The PDB may be sent by the core network to the access network device, or may be preconfigured by the access network device. When the core network device transmits to the access network device, taking the 5QI of the target service as 82 as an example, according to the current relevant protocol, when the PDB takes a value of 10ms when the 5QI is 82, at this time, the value of the downlink target delay on the radio air interface side of the access network device is 10 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless downlink delay of the 8 data packets is shown in the following table 5:

TABLE 5 Wireless side Downlink delay

According to table 5, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 0, the total time delay of the downlink timeout data packets is 0, and the average time delay of the downlink timeout data packets is 0. At this time, the downlink delay performance of the target service does not need to be optimized.

Example 4, the core network device sends a survival time to the access network device. And the access network equipment takes the value of the survivval time as the value of the downlink target time delay of the wireless side of the target service. For example, if the survivval time of the target service is 10ms, the access network device determines that the value of the downlink target delay of the wireless side of the target service is also 10 ms.

The preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold for the target traffic is 30 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless downlink delay of the 8 data packets is shown in the following table 6:

TABLE 6 Wireless side Downlink delay

According to table 6, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 0, the total time delay of the downlink timeout data packets is 0, and the average time delay of the downlink timeout data packets is 0. At this time, the downlink delay performance of the target service does not need to be optimized.

Example 5, the core network device sends a survival time to the access network device. And the access network equipment determines the value of the downlink target time delay of the wireless side of the target service according to the value of the survivval time. For example, the survivval time of the target service is 12ms, and considering that the transmission time from the access network device to the core network device is 2ms, the access network device determines that the value of the downlink target delay of the wireless side of the target service is: 12ms-2ms is 10 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless downlink delay of the 8 data packets is shown in the following table 7:

TABLE 7 Wireless side Downlink delay

According to table 7, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 0, the total time delay of the downlink timeout data packets is 0, and the average time delay of the downlink timeout data packets is 0. At this time, the downlink delay performance of the target service does not need to be optimized.

Example 6, the access network device determines that the value of the target uplink delay of the target service on the wireless side is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold for the target traffic is 30 ms.

The target service collected by the access network equipment in the target time period sends 8 uplink data packets. The uplink time delay of the wireless side of the 8 uplink data packets is shown in the following table 8:

TABLE 8 Wireless side uplink delay

Data packet numbering	Data packet uplink delay
		packet1	8ms
Packet2	7ms
		Packet3	9ms
Packet4	5ms
		Packet5	4ms
Packet6	6ms
		Packet7	7ms
Packet8	8ms

According to table 8, it can be determined that the total number of the uplink data packets sent by the target service is 8, the number of the uplink timeout data packets is 0, the total time delay of the uplink timeout data packets is 0, and the average time delay of the uplink timeout data packets is 0. At this time, the uplink delay performance of the target service does not need to be optimized.

Example 7, the access network device determines that the value of the downlink target delay of the wireless side of the target service is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless downlink delay of the 8 data packets is shown in the following table 9:

TABLE 9, wireless side down delay

According to the table 9, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 3, the total delay of the downlink timeout data packets is 59ms, the average delay of the downlink timeout data packets is 19.67ms, the number of the timeout data packets distributed in the 10ms to 15ms delay interval is 0, the number of the timeout data packets distributed in the 15ms to 20ms delay interval is 2, the number of the timeout data packets distributed in the 20ms to 25ms delay interval is 1, and the number of the data packets distributed in other delay intervals is 0.

Example 8, the access network device determines that the value of the target uplink delay of the target service on the wireless side is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, and positive infinity }. The first preset threshold for the target traffic is 30 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless side uplink delay of the 8 data packets is shown in the following table 10:

TABLE 10 Wireless side uplink delay

Data packet numbering	Data packet uplink delay
		packet1	8ms
Packet2	7ms
		Packet3	19ms
Packet4	5ms
		Packet5	24ms
Packet6	16ms
		Packet7	7ms
Packet8	8ms

According to the table 10, it can be determined that the total number of the uplink data packets sent by the target service is 8, the number of the uplink timeout data packets is 3, the total delay of the uplink timeout data packets is 59ms, the average delay of the uplink timeout data packets is 19.67ms, the number of the timeout data packets distributed in the 10ms to 15ms delay interval is 0, the number of the timeout data packets distributed in the 15ms to 20ms delay interval is 2, the number of the timeout data packets distributed in the 20ms to 25ms delay interval is 1, and the number of the data packets distributed in other delay intervals is 0. Since the average time delay of the uplink timeout data packet is 19.67, which is less than 30ms, the uplink time delay performance of the target service does not need to be optimized.

Example 9, the access network device determines that the value of the downlink target delay of the wireless side of the target service is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold for the target traffic is 30 ms. The delay distribution of the target service requires that the proportion of data packets distributed with delay more than 20ms is less than 10%.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless downlink delay of the 8 data packets is shown in the following table 11:

TABLE 11 Wireless side Downlink delay

Data packet numbering	Data packet downlink delay
		packet1	28ms
Packet2	37ms
		Packet3	19ms
Packet4	14ms
		Packet5	24ms
Packet6	16ms
		Packet7	57ms
Packet8	18ms

According to the table 11, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 8, the total delay of the downlink timeout data packets is 213ms, the average delay of the downlink timeout data packets is 26.625ms, the number of the timeout data packets distributed in the 10ms to 15ms delay interval is 1, the number of the timeout data packets distributed in the 15ms to 20ms delay interval is 4, the number of the timeout data packets distributed in the 20ms to 25ms delay interval is 1, the number of the timeout data packets distributed in the 25ms to 30ms delay interval is 1, the number of the timeout data packets distributed in the 30ms to 100ms delay interval is 2, and the number of the timeout data packets distributed in the 100ms to positive infinite delay interval is 0. The average time delay of the downlink timeout data packet is 19.67 and is less than 30 ms. At this time, the access network equipment determines that the downlink time delay performance of the target service does not need to be optimized according to the average time delay of the overtime data packet; and the access network equipment determines that the downlink time delay performance of the target service needs to be optimized according to the time delay distribution of the overtime data packet.

Example 10, the access network device determines that the value of the target uplink delay of the target service on the wireless side is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold for the target traffic is 30 ms. The delay distribution of the target service requires that the proportion of data packets distributed with delay longer than 20ms is less than 10%. The proportion of the overtime data packets in the total data packets is less than 60%.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless side uplink delay of the 8 data packets is shown in the following table 12:

TABLE 12 Wireless side uplink time delay

Data packet numbering	Data packet uplink delay
		packet1	28ms
Packet2	37ms
		Packet3	19ms
Packet4	14ms
		Packet5	24ms
Packet6	16ms
		Packet7	57ms
Packet8	18ms

According to the table 12, it can be determined that the total number of the uplink data packets sent by the target service is 8, the number of the uplink timeout data packets is 8, the total time delay of the uplink timeout data packets is 213ms, the average time delay of the uplink timeout data packets is 26.625ms, the number of the timeout data packets distributed in the 10ms to 15ms delay interval is 1, the number of the timeout data packets distributed in the 15ms to 20ms delay interval is 4, the number of the timeout data packets distributed in the 20ms to 25ms delay interval is 1, the number of the timeout data packets distributed in the 25ms to 30ms delay interval is 1, the number of the timeout data packets distributed in the 30ms to 100ms delay interval is 2, and the number of the timeout data packets distributed in the 100ms to positive infinite delay interval is 0. The average time delay of the data packet is 19.67 and is less than 30ms due to the uplink timeout. At this time, the access network equipment determines that the uplink time delay performance of the target service does not need to be optimized according to the average time delay of the overtime data packet; and the access network equipment determines that the uplink time delay performance of the target service needs to be optimized according to the proportion of the overtime data packet to the total data packet and the time delay distribution of the overtime data packet.

Example 11, the access network device determines that a value of a downlink target delay of a wireless side of the target service is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, positive infinity }. The first preset threshold for the target traffic is 30 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless downlink delay of the 8 data packets is shown in the following table 13:

watch 13, wireless side down time delay

Data packet numbering	Data packet downlink delay
		packet1	8ms
Packet2	37ms
		Packet3	9ms
Packet4	4ms
		Packet5	24ms
Packet6	6ms
		Packet7	7ms
Packet8	8ms

According to the table 13, it can be determined that the total number of the downlink data packets sent by the target service is 8, the number of the downlink timeout data packets is 2, the total delay of the downlink timeout data packets is 61ms, the average delay of the downlink timeout data packets is 30.5ms, the number of the timeout data packets distributed in the 10ms to 15ms delay interval is 0, the number of the timeout data packets distributed in the 15ms to 20ms delay interval is 0, the number of the timeout data packets distributed in the 20ms to 25ms delay interval is 1, the number of the timeout data packets distributed in the 25ms to 30ms delay interval is 0, the number of the timeout data packets distributed in the 30ms to 100ms delay interval is 1, and the number of the timeout data packets distributed in the 100ms to positive infinite delay interval is 0. Because the average time delay of the downlink overtime data packet is 30.5ms longer than 30ms, the access network equipment determines that the downlink time delay performance of the target service does not need to be optimized according to the average time delay of the overtime data packet.

Example 12, the access network device determines that the value of the target uplink delay of the target service on the wireless side is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, and positive infinity }. The first preset threshold for the target traffic is 30 ms.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless side uplink delay of the 8 data packets is shown in the following table 14:

TABLE 14, wireless side uplink time delay

Data packet numbering	Data packet uplink delay
		packet1	8ms
Packet2	37ms
		Packet3	9ms
Packet4	4ms
		Packet5	24ms
Packet6	6ms
		Packet7	7ms
Packet8	8ms

According to the table 14, it can be determined that the total number of the uplink data packets sent by the target service is 8, the number of the uplink timeout data packets is 2, the total delay of the uplink timeout data packets is 61ms, the average delay of the uplink timeout data packets is 30.5ms, the number of the timeout data packets distributed in the 10ms to 15ms delay interval is 0, the number of the timeout data packets distributed in the 15ms to 20ms delay interval is 0, the number of the timeout data packets distributed in the 20ms to 25ms delay interval is 1, the number of the timeout data packets distributed in the 25ms to 30ms delay interval is 0, the number of the timeout data packets distributed in the 30ms to 100ms delay interval is 1, and the number of the timeout data packets distributed in the 100ms to positive infinite delay interval is 0. Because the average time delay of the uplink overtime data packet is 30.5ms longer than 30ms, the access network equipment determines that the uplink time delay performance of the target service does not need to be optimized according to the average time delay of the overtime data packet.

Example 13, the access network device determines that the value of the target uplink delay of the target service is 10ms, and the preset delay value is {10ms, 15ms, 20ms, 25ms, 30ms, 100ms, and positive infinity }. The first preset threshold for the target traffic is 30 ms. The delay distribution of the target service requires that the proportion of data packets distributed with delay longer than 20ms is less than 10%.

The target service collected by the access network equipment in the target time period totally sends 8 data packets. The wireless side uplink delay of the 8 data packets is shown in the following table 15:

TABLE 15 Wireless side uplink time delay

According to the table 15, it can be determined that the total number of the uplink data packets sent by the target service is 8, the number of the uplink timeout data packets is 2, the total delay of the uplink timeout data packets is 61ms, the average delay of the uplink timeout data packets is 30.5ms, the number of the timeout data packets distributed in the 10ms to 15ms delay interval is 0, the number of the timeout data packets distributed in the 15ms to 20ms delay interval is 0, the number of the timeout data packets distributed in the 20ms to 25ms delay interval is 1, the number of the timeout data packets distributed in the 25ms to 30ms delay interval is 0, the number of the timeout data packets distributed in the 30ms to 100ms delay interval is 1, and the number of the timeout data packets distributed in the 100ms to positive infinite delay interval is 0. Since the average time delay of the uplink timeout data packet is 30.5ms longer than 30ms, the evaluation of the time delay performance of the target service needs to be optimized according to the average time delay of the timeout data packet. And determining the time delay performance of the target service without optimization according to the time delay distribution of the overtime data packet. At this time, the access network device optimizes the delay performance of the target service according to the average delay of the overtime data packet.

It should be noted that, in examples 1 to 13, if the access network device optimizes the delay performance of the target service, the access network device starts at least one of the target functions: mini-slot, UL GRANT, PDSCH repetizations, PUSCH repetizations, LOW-SE, PDCP duplicate, PI, CI.

The delay performance evaluation method according to the embodiment of the present disclosure is described in detail above.

It can be seen that the technical solutions provided by the embodiments of the present disclosure are introduced mainly from the perspective of methods. In order to implement the above functions, it includes a hardware structure and/or a software module for performing each function. Those of skill in the art will readily appreciate that the various illustrative modules and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The embodiment of the present disclosure may perform functional module division on the access network device according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated in one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. Optionally, the division of the modules in the embodiment of the present disclosure is illustrative, and is only a logic function division, and there may be another division manner in actual implementation.

Fig. 10 is a schematic structural diagram of an access network device according to an embodiment of the present disclosure. The access network device includes: a processing unit 1001. A processing unit 1001, configured to determine a delay of a data packet transmitted by a target service in a target time period; the processing unit 1001 is further configured to determine an overtime data packet in the data packet according to the time delay of the data packet; the overtime data packet is a data packet with the time delay larger than the target time delay; the processing unit 1001 is further configured to evaluate a delay performance of the target service according to the delay of the timeout data packet.

In a possible implementation manner, the processing unit 1001 is specifically configured to: determining the average time delay of the overtime data packet; the average time delay of the overtime data packets is the ratio of the sum of the time delays of the overtime data packets to the number of the overtime data packets; and evaluating the time delay performance of the target service according to the average time delay of the overtime data packet.

In a possible implementation manner, the processing unit 1001 is specifically configured to: under the condition that the time delay average value of the overtime data packet is larger than a first preset threshold value, evaluating that the time delay performance of the target service does not meet the requirement; and under the condition that the time delay average value of the overtime data packet is less than or equal to a first preset threshold value, evaluating the time delay performance of the target service to meet the requirement.

In a possible implementation manner, the processing unit 1001 is specifically configured to: determining a plurality of time delay intervals; the time delay value of the left end point of the minimum time delay interval in the plurality of time delay intervals is a target time delay; determining a time delay interval to which the time delay of each overtime data packet in the overtime data packets belongs; and evaluating the time delay performance of the target service according to the time delay quantity of the overtime data packets included in each time delay interval.

In a possible implementation manner, the processing unit 1001 is specifically configured to: under the condition that the time delay quantity of the overtime data packets included in the target time delay interval meets a first preset condition, evaluating the time delay performance of the target service to meet the requirement; the target time delay interval is one or more time delay intervals in the multiple time delay intervals; and under the condition that the time delay quantity of the overtime data packets included in the target time delay interval does not meet a first preset condition, evaluating that the time delay performance of the target service does not meet the requirement.

In one possible implementation, the processing unit 1001 is further configured to: starting a target function; the target function includes at least one of: mini-slot, uplink GRANT UL GRANT, physical downlink shared channel repeat PDSCH repeat, physical uplink shared channel repeat PUSCH repeat, LOW spectral efficiency LOW-SE, packet data convergence protocol repeat PDCP repeat, preemption indication PI and cancellation indication CI.

In one possible implementation, the target latency includes: a first target delay and a second target delay; the first target time delay is a time delay corresponding to the uplink data packet; the second target time delay is the time delay corresponding to the downlink data packet; under the condition that the target time delay comprises a first target time delay, the data packet comprises an uplink data packet; and under the condition that the target time delay comprises a second target time delay, the data packet comprises a downlink data packet.

In one possible implementation, the target latency includes: a third target time delay, a fourth target time delay and a fifth target time delay; the third target time delay is the time delay corresponding to the data packet of the target PLMN network; the fourth target time delay is the time delay corresponding to the data packet of the target slice; the time delay corresponding to the data packet of the fifth target time delay target 5QI service; under the condition that the target time delay comprises a third target time delay, the data packet comprises a data packet of a target PLMN network; under the condition that the target time delay comprises a fourth target time delay, the data packet comprises a data packet of a target slice; and in the case that the target time delay comprises a fifth target time delay, the data packet comprises the data packet of the target 5QI service.

In one possible implementation, the target delay is a delay determined by the access network device in response to the first operation; the first operation is an operation for configuring a target delay input in a network management configuration system of the access network.

In a possible implementation manner, the target time delay is a time delay determined by the access network device according to the preconfigured first time delay configuration information; the first delay configuration information is used for configuring the target delay.

In a possible implementation manner, the target time delay is a time delay determined according to first indication information sent by core network equipment; the first indication information is used for indicating the value of the target time delay.

In a possible implementation manner, the target time delay is a time delay determined according to second indication information sent by the core network device; the second indication information is used for indicating second time delay configuration information; the second delay configuration information is used for configuring the target delay.

In one possible implementation, the processing unit 1001 is further configured to: determining a third number of data packets transmitted by the target cell in the target time period and a time delay of the data packets transmitted by the target cell; determining the fourth number of the data packets which are not overtime in the data packets transmitted by the target cell according to the time delay of the data packets transmitted by the target cell; and determining the delay reliability of the target cell according to the ratio of the fourth quantity to the third quantity.

Optionally, the access network device further includes a communication unit 1002, where the communication unit 1002 is configured to communicate with other devices (such as a core network device and a terminal).

The embodiment of the present disclosure provides an access network device, which is configured to execute a method that needs to be executed by any device in the data integrity determination system. The access network device may be an access network device referred to in this disclosure, or a module in an access network device; or a chip in the access network device, or other devices for executing the network quality determination method, which is not limited in this disclosure.

The embodiment of the present disclosure further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed by a computer, the computer executes each step in the method flow shown in the above method embodiment.

Embodiments of the present disclosure provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of the above-described method embodiments.

Embodiments of the present disclosure provide a chip comprising a processor and a communication interface, the communication interface being coupled to the processor, the processor being configured to execute a computer program or instructions to implement the method as in the above-mentioned method embodiments.

The computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, and a hard disk. Random Access Memory (RAM), Read-Only Memory (ROM), Erasable Programmable Read-Only Memory (EPROM), registers, a hard disk, an optical fiber, a portable Compact disk Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any other form of computer-readable storage medium, in any suitable combination, or as appropriate in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuit (ASIC). In the disclosed embodiments, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

Since the apparatus, the device, the computer-readable storage medium, and the computer program product in the embodiments of the present disclosure may be applied to the method, for technical effects that can be obtained by the apparatus, the computer-readable storage medium, and the computer program product, reference may also be made to the method embodiments, and details of the embodiments of the present disclosure are not repeated here.

The above description is only a specific embodiment of the present disclosure, but the scope of the present disclosure is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered within the scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

1. A method for evaluating delay performance, comprising:

determining the time delay of a data packet transmitted by a target service in a target time period;

determining an overtime data packet in the data packet according to the time delay of the data packet; the overtime data packet is a data packet with the time delay larger than the target time delay;

and evaluating the time delay performance of the target service according to the time delay of the overtime data packet.

2. The method of claim 1, wherein the evaluating the latency performance of the target service according to the latency of the timeout packet comprises:

determining the average time delay of the overtime data packet; wherein, the average time delay of the overtime data packets is the ratio of the sum of the time delays of the overtime data packets to the number of the overtime data packets;

and evaluating the time delay performance of the target service according to the average time delay of the overtime data packet.

3. The method of claim 2, wherein the evaluating the latency performance of the target service according to the average latency of the timeout packets comprises:

under the condition that the time delay average value of the overtime data packet is larger than a first preset threshold value, evaluating that the time delay performance of the target service does not meet the requirement;

and under the condition that the time delay average value of the overtime data packet is less than or equal to the first preset threshold value, evaluating the time delay performance of the target service to meet the requirement.

4. The method of claim 1, wherein the evaluating the latency performance of the target service according to the latency of the timeout packet further comprises:

determining a plurality of time delay intervals; wherein, the delay value of the left end point of the minimum delay interval in the plurality of delay intervals is the target delay;

determining the time delay interval to which the time delay of each overtime data packet in the overtime data packets belongs;

and evaluating the time delay performance of the target service according to the time delay quantity of the overtime data packets included in each time delay interval.

5. The method according to claim 4, wherein the evaluating the delay performance of the target service according to the number of delays of the timeout packets included in each of the delay intervals comprises:

under the condition that the time delay quantity of the overtime data packets included in the target time delay interval meets a first preset condition, evaluating the time delay performance of the target service to meet the requirement; the target time delay interval is one or more time delay intervals in the plurality of time delay intervals;

and under the condition that the time delay quantity of the overtime data packets included in the target time delay interval does not meet the first preset condition, evaluating that the time delay performance of the target service does not meet the requirement.

6. The method of claim 3 or 5, wherein after evaluating that the latency performance of the target service does not meet the requirement, the method further comprises:

starting a target function; the target function includes at least one of: the method comprises the following steps of micro-slot mini-slot, uplink GRANT UL GRANT, physical downlink shared channel repeat PDSCH repeats, physical uplink shared channel repeat PUSCH repeats, LOW spectral efficiency LOW-SE, packet data convergence protocol repeat PDCP duplicates, preemption indication PI and cancellation indication CI.

7. The method of any of claims 1-5, wherein the target latency comprises: a first target time delay and a second target time delay;

the first target time delay is a time delay corresponding to an uplink data packet; the second target time delay is a time delay corresponding to a downlink data packet;

when the target time delay comprises the first target time delay, the data packet comprises the uplink data packet;

and under the condition that the target time delay comprises the second target time delay, the data packet comprises the downlink data packet.

8. The method of any of claims 1-5, wherein the target latency comprises: a third target time delay, a fourth target time delay and a fifth target time delay;

wherein, the third target time delay is a time delay corresponding to a data packet of the target PLMN network; the fourth target time delay is the time delay corresponding to the data packet of the target slice; the time delay corresponding to the data packet of the fifth target time delay target 5QI service;

when the target time delay comprises the third target time delay, the data packet comprises a data packet of the target PLMN network;

when the target time delay comprises the fourth target time delay, the data packet comprises a data packet of the target slice;

and if the target delay comprises the fifth target delay, the data packet comprises a data packet of the target 5QI service.

9. The method of any of claims 1-5, wherein the target latency is a latency determined by the access network device in response to the first operation; the first operation is an operation for configuring the target time delay input in a network management configuration system of the access network.

10. The method according to any of claims 1-5, wherein the target delay is a delay determined by the access network device according to the preconfigured first delay configuration information; the first delay configuration information is used for configuring the target delay.

11. The method according to any of claims 1-5, wherein the target delay is a delay determined according to first indication information sent by a core network device; the first indication information is used for indicating the value of the target time delay.

12. The method according to any of claims 1-5, wherein the target time delay is a time delay determined according to second indication information sent by a core network device; the second indication information is used for indicating second time delay configuration information; the second delay configuration information is used for configuring the target delay.

13. The method according to any one of claims 1-5, further comprising:

determining the time delay of the data packet transmitted by the target cell in the target time period;

determining an overtime data packet in the data packets transmitted by the target cell according to the time delay of the data packets transmitted by the target cell;

and evaluating the time delay performance of the target cell according to the time delay of the overtime data packet transmitted by the target cell.

14. An access network device, comprising: a processing unit;

the processing unit is used for determining the time delay of the data packet transmitted by the target service in the target time period;

the processing unit is further configured to determine an overtime data packet in the data packet according to the time delay of the data packet; the overtime data packet is a data packet with the time delay larger than the target time delay;

and the processing unit is further configured to evaluate the delay performance of the target service according to the delay of the timeout data packet.

15. An access network device, comprising: a processor and a memory; wherein the memory is configured to store computer-executable instructions, and when the access network device is running, the processor executes the computer-executable instructions stored in the memory to cause the access network device to perform the latency performance assessment method according to any one of claims 1 to 13.

16. A computer-readable storage medium having instructions stored therein, which when executed by a processor of an access network device, cause the access network device to perform the latency performance assessment method of any one of claims 1-13.