WO2019153337A1 - Network quality evaluation method and apparatus, network detection device, and readable storage medium - Google Patents

Network quality evaluation method and apparatus, network detection device, and readable storage medium Download PDF

Info

Publication number
WO2019153337A1
WO2019153337A1 PCT/CN2018/076473 CN2018076473W WO2019153337A1 WO 2019153337 A1 WO2019153337 A1 WO 2019153337A1 CN 2018076473 W CN2018076473 W CN 2018076473W WO 2019153337 A1 WO2019153337 A1 WO 2019153337A1
Authority
WO
WIPO (PCT)
Prior art keywords
network
network delay
value
effective
determining
Prior art date
Application number
PCT/CN2018/076473
Other languages
French (fr)
Chinese (zh)
Inventor
王华涛
Original Assignee
深圳前海达闼云端智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海达闼云端智能科技有限公司 filed Critical 深圳前海达闼云端智能科技有限公司
Priority to PCT/CN2018/076473 priority Critical patent/WO2019153337A1/en
Priority to CN201880001299.9A priority patent/CN108886479B/en
Publication of WO2019153337A1 publication Critical patent/WO2019153337A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0805Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
    • H04L43/0811Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking connectivity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays
    • H04L43/0864Round trip delays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/16Threshold monitoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • H04L43/0829Packet loss

Definitions

  • the present application relates to the field of communications technologies, and in particular, to a network quality assessment method, apparatus, network detection apparatus, and readable storage medium.
  • Packet Internet Groper is a common network diagnostic tool for testing network connections. The purpose is to test whether the network between two network hosts is connected and based on network delay (Roud Trip Time, RTT). ) Determine the current network quality. For example, a network host (which can be called a source host) sends an Internet Control Management Protocol (ICMP) through the ping command, which can be used to echo the request packet to another network host. It is called: the destination host, and waits for the ICMP echo reply to be returned. If the source host receives the response within a certain period of time, the destination host is considered reachable (that is, the network between the source host and the destination host is connected).
  • ICMP Internet Control Management Protocol
  • the operation of completing the ICMP echo request and the echo reply message by using the ping command may be specifically implemented in conjunction with FIG. 1 .
  • the source host initiates an ICMP request of type "0”
  • the destination host that receives the request makes an ICMP response of type "8”
  • the current network delay and in the process of sending requests and receiving responses multiple times, record the time difference between each request and response.
  • the ping command is executed, the maximum (max) and minimum values will be seen in the ping structure. Data such as (min) and average (avg) network delay, so that the current network quality can be determined based on these network delay data.
  • network delay ie, a message or packet is transmitted from one end of a network to The time required by the other end is constantly changing. For example, when the network traffic is larger, the longer the queues and routers are queued, the larger the network delay will be. In this complicated case, the maximum network delay and minimum network delay obtained by the ping command are often The difference is very large, and the network quality is usually expressed by calculating the average network delay. Therefore, when there is abnormal network delay data, simply calculating the average network delay does not reflect the true network quality.
  • a technical problem to be solved by some embodiments of the present application is to provide a network quality evaluation method, apparatus, network detection apparatus, and readable storage medium to solve the above technical problems.
  • An embodiment of the present application provides a network quality assessment method, where the network quality assessment method includes: initiating a network probe request; wherein the network probe request carries a confidence probability value and at least one request data packet; and the receiving network node according to each A response packet requested by the data packet, and records the network delay value when the response packet is received; according to the confidence probability value, selects an effective network delay value from all the network delay values recorded; determines the network according to the effective network delay value quality.
  • An embodiment of the present application provides a network quality evaluation apparatus, where the network quality evaluation apparatus includes: a sending module, configured to initiate a network probe request; wherein the network probe request carries a confidence probability value and at least one request data packet; a receiving module, configured to receive a response data packet that is generated by the network node according to each request data packet; a recording module configured to record a network delay value when the response data packet is received; and a selection module configured to use the trusted probability value from the recorded A valid network delay value is selected among all network delay values; a determining module is configured to determine network quality based on the effective network delay value.
  • An embodiment of the present application provides a network detecting device including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions Executed by at least one processor to enable at least one processor to perform the network quality assessment method involved in any of the method embodiments of the present application.
  • One embodiment of the present application provides a readable storage medium that is a computer readable storage medium; the computer readable storage medium stores computer instructions for causing a computer to perform any of the method embodiments of the present application The network quality assessment method involved.
  • the embodiment of the present application selects an effective network delay value from all the network delay values recorded according to the confidence probability value carried in the network probe request, and determines the network quality according to the effective network delay value, thereby avoiding the present
  • the interference of abnormal data greatly improves the accuracy of the network quality assessment results, and makes the network quality assessment results closer to the real network quality.
  • FIG. 1 is a schematic diagram of an ICMP echo request and an echo response message in the prior art
  • FIG. 2 is a flowchart of a network quality assessment method in the first embodiment of the present application
  • FIG. 3 is a flowchart of a network quality assessment method in a second embodiment of the present application.
  • FIG. 4 is a flowchart of a network quality assessment method in a third embodiment of the present application.
  • FIG. 5 is a block diagram showing a network quality evaluation apparatus in a fourth embodiment of the present application.
  • FIG. 6 is a schematic block diagram of a network detecting apparatus in a fifth embodiment of the present application.
  • the first embodiment of the present application relates to a network quality assessment method that can be applied to a network node.
  • the network node referred to in this embodiment refers to each device that has its own unique network address, and may specifically be a workstation, a client, a network user, or a personal computer, or may be a server, a printer, or the like. Interconnected devices.
  • the network node that initiates the network probe request is referred to as a “source host”, and the responding network node is referred to as a “destination host”.
  • the specific process of the network quality assessment method is as shown in FIG. 2 .
  • step 201 a network probe request is initiated.
  • the network probe request initiated by the source host is specifically an ICMP echo reply request, so that the echo reply and the echo request can be implemented by using a ping command, thereby enabling the source host and the destination host.
  • Pass control information to determine whether the network is connected, whether the host is reachable, and so on.
  • the network probe request in this embodiment needs to carry the IP (Internet Protocol) address of the destination host to be requested. Or a domain name, and at least one request packet (such as 60), also need to carry a confidence probability value.
  • IP Internet Protocol
  • the confidence probability value is specifically a probability value used to measure the reliability of statistical inference, and its meaning refers to the probability that the estimated parameter is included in a certain range when performing statistical inference.
  • the specific value of the confidence probability value those skilled in the art can appropriately set according to the actual test requirements, and no limitation is made here.
  • step 202 a response packet is received and the network delay value when the response packet is received is recorded.
  • the response data packet received by the source host is a response data packet made by the destination host according to each request data packet.
  • an effective network delay value is selected from all of the recorded network delay values based on the confidence probability value.
  • the effective network delay value when the effective network delay value is selected from all the network delay values recorded according to the confidence probability value, the abnormal network delay value is determined according to the confidence probability value, and then all the networks are recorded from the network.
  • the effective network delay value is obtained by removing the abnormal network delay value from the delay value.
  • S1 Determine the network delay absolute value and the abnormal threshold.
  • the absolute value of the network delay mentioned here is the absolute value of the network delay of the response packet.
  • all the network delay values recorded need to be averaged to obtain the average network delay.
  • the difference between each network delay value and the network delay average is calculated, and the obtained difference is taken as the absolute value of the network delay of the corresponding response packet.
  • the abnormal threshold it is necessary to first obtain the test threshold of the Grubbs criterion corresponding to the network delay value, and determine the network delay standard deviation according to the network delay value. Then, the product of the test threshold value and the network delay standard deviation is calculated, and the obtained product is taken as the abnormal threshold value.
  • T K G (n, ⁇ ) ⁇ (x);
  • T is the abnormal threshold
  • K G (n, a) is the test threshold
  • ⁇ (x) is the network delay standard deviation determined based on all the network delay values recorded.
  • K G (n, a) can be obtained according to the Grubbs criterion test threshold table or the test threshold value calculation formula, and ⁇ (x) can be obtained according to the standard deviation calculation formula, and will not be described herein.
  • test threshold K G (n, a)
  • Method 1 Obtain the test threshold table using the Rabbs criterion.
  • n is the number of measurements (the total number of packets sent for the request packet) and P is the confidence probability value.
  • those skilled in the art can obtain the required test threshold according to the existing Gurbus criterion test threshold table, and details are not described herein again.
  • Method 2 Obtain the formula using the test threshold value.
  • K G (n, a) is the test threshold
  • n is the number of measurements (the total batch of the request packet is sent)
  • a is the risk probability value
  • t crit is the t distribution with a degree of freedom of n-2 (Student's t The probability of -distribution, student t-distribution) is the upper quantile of ⁇ (2n).
  • the absolute value of the network delay by comparing the absolute value of the network delay with the abnormal threshold, if it is determined that the absolute value of the network delay is greater than or equal to the abnormal threshold, it is determined that the absolute value of the network delay satisfies the abnormal threshold.
  • S3 Obtain a network delay value corresponding to each network delay absolute value that meets the abnormal threshold, and determine the obtained network delay value as an abnormal network delay value.
  • the network delay values are sorted in ascending order, starting from the minimum network delay value, and sequentially performing the network delay absolute value and the abnormal threshold corresponding to the sorted network delay values. In contrast, it is determined that the comparison result satisfies the abnormal threshold stop comparison, and it is determined that the network delay values that are not compared satisfy the abnormal threshold.
  • step 204 the network quality is determined based on the effective network delay value.
  • the source host when determining the network quality according to the effective network delay value, the source host needs to determine the effective network delay average of the network probe request according to the effective network delay value, and then determine the current network according to the obtained effective network delay average value. quality.
  • the effective network delay standard deviation of the network probe request may also be determined according to the effective network delay value, and then the current network quality is determined according to the obtained effective network delay standard deviation.
  • the effective network delay average of the network probe request and the effective network delay standard deviation can be determined according to the effective network delay value, so that the final network quality can be determined according to the comprehensive consideration of the two.
  • the network quality assessment method provided in this embodiment selects an effective network delay value from all recorded network delay values according to the confidence probability value carried in the network probe request, and determines according to the effective network delay value.
  • the network quality avoids the interference of abnormal data in the existing network quality assessment process, greatly improves the accuracy of the network quality assessment results, and makes the network quality assessment result closer to the real network quality.
  • a second embodiment of the present application relates to a network quality assessment method.
  • the embodiment is further improved on the basis of the first embodiment, and the specific improvement is: when the total batch of the request data packet carried in the network probe request is greater than 2, the network detection is determined according to the effective network delay value.
  • the requested effective network delay average and/or the effective network delay standard deviation which is determined according to the effective network delay average of each batch and/or the effective network delay standard deviation.
  • the steps 301 to 306 are included, and the steps 301 and 302 are respectively the same as the steps 201 and 202 in the first embodiment, and are not described herein again.
  • the steps 301 and 302 are respectively the same as the steps 201 and 202 in the first embodiment, and are not described herein again.
  • the network quality assessment method provided by the first embodiment, and details are not described herein again.
  • step 303 an effective network delay value for each batch is selected based on the confidence probability value.
  • step 304 an average of the effective network delays for each batch is determined.
  • an effective network delay average of the network probe request is determined based on the average of the effective network delays for each batch.
  • step 306 the network quality is determined based on the average of the effective network delays of the network probe request.
  • the manner of selecting the effective network delay value of each batch from all the network delay values recorded is still based on the confidence probability value, based on the Grubbs criterion, where No longer.
  • the source host initiates a network probe request of the ICMP protocol to the destination host, and the request carries the IP of the destination host, the number of packets per batch, the total batch of the request packet, and the confidence probability.
  • the values of these four parameters are taken as an example for specific explanation.
  • the number of request packets per batch is set to 60, the total number of packets sent for request packets is three, and the confidence probability value is 0.95.
  • the number of request packets successfully sent by the first batch is n (less than or equal to 60), and the received response packet is nh (h is an integer greater than or equal to 0), and the recorded network delay value is nh.
  • the number of request packets successfully sent by the second batch is n (less than or equal to 60), and the received response packet is nj (j is an integer greater than or equal to 0), and the recorded network delay value is nj.
  • the number of request packets successfully sent by the third batch is n (less than or equal to 60), and the received response packet is nk (k is an integer greater than or equal to 0), and the recorded network delay value is nk. .
  • the source host selects the effective network extension value from the network delay values of the three batches based on the set confidence probability value based on the Grubbs criterion.
  • the network delay values of the three batches are first sorted from small to large.
  • the network delay values of the first batch are sorted in ascending order, and the sorted values are m1, m2...mi (i is nk).
  • the network delay value of the first batch is averaged to obtain the network delay average of the first batch.
  • the standard deviation calculation is performed to obtain the network delay standard deviation ⁇ 1 of the first batch.
  • Starting mi calculate mi and network latency average
  • the absolute value ie, the absolute value of the network delay of the response packet corresponding to the network delay value mi)
  • test threshold table for the Grubbs criterion or use the test threshold to calculate the formula
  • a test threshold K G (i, ⁇ ) corresponding to each network delay value mi is obtained. Determine whether the network delay absolute value
  • the loop After all the abnormal network delay values in the first batch are eliminated, the loop performs nh times of testing, traversing the effective network delay value, accumulating all the effective network delay values and dividing by the number of effective network delay values to obtain an effective network. Average value of delay value Based on the average of these effective network delay values Calculate the effective network delay standard deviation ⁇ v .
  • the network delay values of the remaining two batches are processed to obtain the average value of the effective network delay value and the effective network delay standard deviation of each batch.
  • the effective network delay average and the effective network delay standard deviation of the network probe request can be obtained.
  • the network quality assessment method determines the network quality according to the effective network delay value by setting the total batch of the carried request packet to be greater than 2 when the network probe request is sent.
  • a third embodiment of the present application relates to a network quality assessment method. This embodiment is further improved on the basis of the first or second embodiment, and the specific improvement is: before selecting the effective network delay value from all the network delay values recorded according to the confidence probability value, it is necessary to determine the current Whether the packet loss rate of the network probe request satisfies the preset normal packet loss rate. For convenience of description, the following is specifically described in conjunction with FIG. 4 on the basis of the first embodiment.
  • step 401 to step 405 are included, wherein step 401 and step 202, step 404, and step 405 are respectively approximated to step 201 and step 202, step 203, and step 204 in the first embodiment.
  • step 401 and step 202, step 404, and step 405 are respectively approximated to step 201 and step 202, step 203, and step 204 in the first embodiment.
  • the details are not described here.
  • the following is a description of the differences.
  • the technical details that are not described in detail in this embodiment refer to the network quality assessment method provided in the first embodiment, and details are not described herein again.
  • step 403 it is determined whether the packet loss rate of the network probe request meets a preset normal packet loss rate.
  • step 404 if it is determined that the packet loss rate of the network probe request meets the preset normal packet loss rate, proceed to step 404, and select an effective network delay value from all the network delay values recorded according to the confidence probability value; otherwise, return to the step 401. Re-initiate the network probe request.
  • the packet loss rate of the current network probe request is calculated according to the number of request data packets carried in the network probe request and the number of received response data packets, which can be calculated according to the following formula:
  • R Q is the number of request packets sent
  • R S is the number of received response packets
  • P L is the packet loss rate of the network probe request
  • the final calculated packet loss rate is the packet loss rate after averaging the packet loss rate of each batch.
  • the packet loss rate usually, when the traffic of the Gigabit NIC is greater than 200 Mbps, the packet loss rate is less than 50,000, and the packet loss rate is less than one ten thousand when the traffic is greater than 60 Mbps. Normal, specific settings, those skilled in the art can be reasonably set according to the test needs, and no limitation is made here.
  • the network quality evaluation method determines whether the packet loss rate of the current network probe request is determined before selecting an effective network delay value from all the network delay values recorded according to the confidence probability value.
  • the preset normal packet loss rate is met, and the network quality operation is determined after the predetermined normal packet loss rate is determined, thereby further ensuring the accuracy of the final determined network quality.
  • a fourth embodiment of the present application relates to a network quality evaluation apparatus, and the specific structure is as shown in FIG. 5.
  • the network quality evaluation apparatus transmits a module 501, a receiving module 502, a recording module 503, a selecting module 504, and a determining module 505.
  • the sending module 501 is configured to initiate a network probe request.
  • the network probe request initiated by the sending module 501 is specifically an echo reply response request of the ICMP, so that the echo reply and the echo request can be implemented by using a ping command, so that the network can be set.
  • the request device of the quality evaluation device hereinafter referred to as "source host”
  • the response device responding to the request hereinafter referred to as "destination host” transfer control information to determine whether the network is unreachable, whether the host is reachable, or the like.
  • the network probe request in this embodiment needs to carry the IP (Internet Protocol) address of the destination host to be requested. Or a domain name, and at least one request packet, you also need to carry a confidence probability value.
  • IP Internet Protocol
  • the sending batch of the request data packet can be set in a network probe request to be greater than 2, so that the plurality of batches can be obtained.
  • the data is averaged so that the final result is more in line with the actual network conditions.
  • the sending batch of the requested data packet is greater than 2 because the check threshold of the Grubbs criterion is selected when the effective network delay value is selected based on the Grubbs criterion. The lowest is from the number of measurements (sending batch) is 3.
  • the transmission format of the network probe request will be exemplified below.
  • the specific request format may be: ping+space+destination host IP address + space + number of request packets + space + confidence probability value.
  • the receiving module 502 is configured to receive a response data packet that the network node makes according to each request data packet.
  • the recording module 503 is configured to record a network delay value when the response packet is received.
  • the recording module 503 when the recording module 503 records the network delay value, in order to facilitate subsequent use, it is necessary to simultaneously record which response packet corresponds to each network delay value, and the corresponding response packet. It is also corresponding to which request packet. In this way, in the subsequent processing, it can be clearly known which request packets have not received the response, and which response packets received are abnormal.
  • the selecting module 504 is configured to select an effective network delay value from all the network delay values recorded according to the confidence probability value.
  • the selecting module 504 selects an effective network delay value from all the network delay values recorded according to the confidence probability value, specifically, based on the Grubbs criterion, all the network delay values to be recorded. The wrong error (significantly exceeding the expected error under specified conditions) is stripped and the remaining network delay value is taken as the effective network delay value.
  • the determining module 505 is configured to determine the network quality according to the effective network delay value.
  • the determining module 505 when determining the network quality according to the effective network delay value, specifically needs to determine an effective network delay average of the network probe request according to the effective network delay value, and then determine the current according to the obtained effective network delay average value. Network quality.
  • the effective network delay standard deviation of the network probe request may also be determined according to the effective network delay value, and then the current network quality is determined according to the obtained effective network delay standard deviation.
  • the effective network delay average of the network probe request and the effective network delay standard deviation can be determined according to the effective network delay value, so that the final network quality can be determined according to the comprehensive consideration of the two.
  • the interference information may be filtered by using the packet loss rate, for example, determining whether the packet loss rate of the current network probe request satisfies the preset normal packet loss rate, and determining that the preset normal packet loss is satisfied. At the time of the rate, the above operations are performed to further ensure the accuracy of the final result.
  • the number of request data packets carried in the network probe request and the number of received response data packets recorded by the recording module 503 are calculated according to the sending module 501, when the network probe request is initiated by the sending module 501. acquired.
  • the present embodiment is a virtual device embodiment corresponding to the method embodiment, and thus the technical details not described in detail in this embodiment, refer to the network quality evaluation method provided by any embodiment of the present application. I will not repeat them here.
  • the network quality evaluation apparatus provided in this embodiment effectively avoids the interference of abnormal data in the network quality assessment process by the cooperation of the above various functional modules, and greatly improves the accuracy of the network quality assessment result. To make the network quality assessment results closer to the real network quality.
  • a fifth embodiment of the present application relates to a network detecting device, and the specific structure is as shown in FIG. 6.
  • the network node in this embodiment refers to each device that has its own unique network address, and may specifically be a workstation, a client, a network user, or a personal computer, and may also be a server, a printer, and other devices capable of interconnecting through a network. There are no restrictions here.
  • the network detecting device may specifically include one or more processors 601 and a memory 602.
  • One processor 601 is taken as an example in FIG.
  • each functional module in the network quality evaluation apparatus involved in the foregoing embodiment is deployed on the processor 601, and the processor 601 and the memory 602 can be connected through a bus or other manner, and the bus is connected through the bus in FIG. Connection is an example.
  • the memory 602 is a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the network quality evaluation method involved in any method embodiment of the present application.
  • the processor 601 executes various functional applications and data processing of the server by running software programs, instructions, and modules stored in the memory 602, that is, implementing the network quality evaluation method involved in any method embodiment of the present application.
  • the memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required by at least one function; and the storage data area may establish a historical database for storing abnormal thresholds and normal packet loss. Rate and so on.
  • the memory 602 may include a high speed random access memory, and may also include a readable and writable memory (RAM).
  • memory 602 can optionally include memory remotely located relative to processor 601 that can be connected to the terminal device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the memory 602 may store at least one instruction executed by the processor 601, and the instruction is executed by the at least one processor 601, so that the at least one processor 601 can perform the network quality assessment method involved in any method embodiment of the present application.
  • Each of the functional modules in the control network quality assessment device performs the operations in the network quality assessment method.
  • the network quality assessment method provided in any embodiment of the present application.
  • a sixth embodiment of the present application is directed to a computer readable storage medium, which is a computer readable storage medium having stored therein computer instructions that enable a computer to perform any of the present application The network quality assessment method involved in the method embodiment.
  • a program instructing related hardware may be completed by a program instructing related hardware, and the program is stored in a storage medium, and includes a plurality of instructions for making a device (which may be a single chip microcomputer). , a chip, etc. or a processor performs all or part of the steps of the methods described in various embodiments of the present application.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Abstract

The present application relates to the technical field of communications. Disclosed are a network quality evaluation method and apparatus, a network detection device, and a readable storage medium. The network quality evaluation method in the present application comprises: initiating a network detection request, the network detection request carrying a confidence probability value and at least one request data packet; receiving a response data packet made by a network node according to each request data packet, and recording network latency values upon receipt of the response data packet; selecting, according to the confidence probability value, an effective network latency value from all the recorded network latency values; and determining the network quality according to the effective network latency value. According to the network quality evaluation method, the accuracy of the network quality evaluation result can be significantly improved, thereby enabling the network quality evaluation result to approach the real network quality more.

Description

网络质量评估方法、装置、网络检测设备及可读存储介质Network quality assessment method, device, network detection device and readable storage medium 技术领域Technical field
本申请涉及通信技术领域,特别涉及一种网络质量评估方法、装置、网络检测设备及可读存储介质。The present application relates to the field of communications technologies, and in particular, to a network quality assessment method, apparatus, network detection apparatus, and readable storage medium.
背景技术Background technique
因特网包探索器(Packet Internet Groper,ping)是一种测试网络连接量的常用网络诊断工具,其目的是为了测试两台网络主机之间的网络是否连通,并根据网络延迟(Roud Trip Time,RTT)确定当前网络质量。比如,一台网络主机(可以称为:源主机)通过ping命令发送一份因特网控制报文协议(Internet Control Management Protocol,ICMP),具体可以是回显请求报文给另一台网络主机(可以称为:目的主机),并等待返回ICMP回显应答,如果源主机在一定时间内收到应答,则认为目的主机可达(即源主机与目的主机之间的网络是连通的)。Packet Internet Groper (ping) is a common network diagnostic tool for testing network connections. The purpose is to test whether the network between two network hosts is connected and based on network delay (Roud Trip Time, RTT). ) Determine the current network quality. For example, a network host (which can be called a source host) sends an Internet Control Management Protocol (ICMP) through the ping command, which can be used to echo the request packet to another network host. It is called: the destination host, and waits for the ICMP echo reply to be returned. If the source host receives the response within a certain period of time, the destination host is considered reachable (that is, the network between the source host and the destination host is connected).
具体的说,在实际应用中,利用ping命令完成ICMP回显请求和回显应答报文的操作具体可以结合图1实现。具体的,源主机发起类型为“0”的ICMP请求,收到该请求的目的主机作出类型为“8”的ICMP回应,然后通过计算ICMP应答报文数量和发送报文之间的时间差,得到当前的网络延迟,并在多次发送请求和接收响应的过程中,记录每一个请求和响应之间的时间差,当ping命令执行完成后,在ping的结构中会看到最大(max)、最小(min)和平均(avg)网络延迟等数据,从而能够根据这些网络延迟数据确定当前网络质量。Specifically, in an actual application, the operation of completing the ICMP echo request and the echo reply message by using the ping command may be specifically implemented in conjunction with FIG. 1 . Specifically, the source host initiates an ICMP request of type "0", and the destination host that receives the request makes an ICMP response of type "8", and then calculates the time difference between the number of ICMP response packets and the sent packet. The current network delay, and in the process of sending requests and receiving responses multiple times, record the time difference between each request and response. When the ping command is executed, the maximum (max) and minimum values will be seen in the ping structure. Data such as (min) and average (avg) network delay, so that the current network quality can be determined based on these network delay data.
但是,发明人发现现有技术中至少存在如下问题:由于互联网的复杂性、网络流量的动态变化和网络路由的动态选择,网络时延(即:一个报文或分组从一个网络的一端传送到另一个端所需要的时间)是在不停变化的。比如说,在网络流量越大时,交换机和路由器排队的时间就会越长,网络延迟也就会越大,而在这种复杂的情况下,ping命令得到的最大网络延迟和最小网络延迟往往差异很大,而网络质量通常是通过计算平均网络延迟来表达的,因此,当有异常的网络延迟数据时,简单的计算平均网络延迟并不能反映真实的网络质量。However, the inventors have found that at least the following problems exist in the prior art: due to the complexity of the Internet, the dynamic change of network traffic, and the dynamic selection of network routing, network delay (ie, a message or packet is transmitted from one end of a network to The time required by the other end is constantly changing. For example, when the network traffic is larger, the longer the queues and routers are queued, the larger the network delay will be. In this complicated case, the maximum network delay and minimum network delay obtained by the ping command are often The difference is very large, and the network quality is usually expressed by calculating the average network delay. Therefore, when there is abnormal network delay data, simply calculating the average network delay does not reflect the true network quality.
发明内容Summary of the invention
本申请部分实施例所要解决的一个技术问题在于提供一种网络质量评估方法、装置、网络检测设备及可读存储介质,以解决上述技术问题。A technical problem to be solved by some embodiments of the present application is to provide a network quality evaluation method, apparatus, network detection apparatus, and readable storage medium to solve the above technical problems.
本申请的一个实施例提供了一种网络质量评估方法,该网络质量评估方法包括:发起网络探测请求;其中,网络探测请求中携带有置信概率值和至少一个请求数据包;接收网络节点根据每一个请求数据包作出的响应数据包,并记录收到响应数据包时的网络延迟值;根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值;根据有效网络延迟值,确定网络质量。An embodiment of the present application provides a network quality assessment method, where the network quality assessment method includes: initiating a network probe request; wherein the network probe request carries a confidence probability value and at least one request data packet; and the receiving network node according to each A response packet requested by the data packet, and records the network delay value when the response packet is received; according to the confidence probability value, selects an effective network delay value from all the network delay values recorded; determines the network according to the effective network delay value quality.
本申请的一个实施例提供了一种网络质量评估装置,该网络质量评估装置包括:发送模块,用于发起网络探测请求;其中,网络探测请求中携带有置信概率值和至少一个请求数据包;接收模块,用于接收网络节点根据每一个请求数据包作出的响应数据包;记录模块,用于记录收到响应数据包时的网络延迟值;选择模块,用于根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值;确定模块,用于根据有效网络延迟值,确定网络质量。An embodiment of the present application provides a network quality evaluation apparatus, where the network quality evaluation apparatus includes: a sending module, configured to initiate a network probe request; wherein the network probe request carries a confidence probability value and at least one request data packet; a receiving module, configured to receive a response data packet that is generated by the network node according to each request data packet; a recording module configured to record a network delay value when the response data packet is received; and a selection module configured to use the trusted probability value from the recorded A valid network delay value is selected among all network delay values; a determining module is configured to determine network quality based on the effective network delay value.
本申请的一个实施例提供了一网络检测设备,该网络检测设备包括至少一个处理器;以及与至少一个处理器通信连接的存储器;其中,存储器存储有可被至少一个处理器执行的指令,指令被至少一个处理器执行,以使至少一个处理器能够执行本申请任意方法实施例中涉及的网络质量评估方法。An embodiment of the present application provides a network detecting device including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions Executed by at least one processor to enable at least one processor to perform the network quality assessment method involved in any of the method embodiments of the present application.
本申请的一个实施例提供了一种可读存储介质,该可读存储介质为计算机可读存储介质;计算机可读存储介质存储有计算机指令,计算机指令用于使计算机执行本申请任意方法实施例中涉及的网络质量评估方法。One embodiment of the present application provides a readable storage medium that is a computer readable storage medium; the computer readable storage medium stores computer instructions for causing a computer to perform any of the method embodiments of the present application The network quality assessment method involved.
本申请实施例相对于现有技术而言,根据网络探测请求中携带的置信概率值,从记录的所有网络延迟值中选择有效网络延迟值,根据有效网络延迟值来确定网络质量,避免了现有网络质量评估过程中,异常数据的干扰,大大提高了网络质量评估结果的准确性,使网络质量评估结果更加接近真实的网络质量。Compared with the prior art, the embodiment of the present application selects an effective network delay value from all the network delay values recorded according to the confidence probability value carried in the network probe request, and determines the network quality according to the effective network delay value, thereby avoiding the present In the process of network quality assessment, the interference of abnormal data greatly improves the accuracy of the network quality assessment results, and makes the network quality assessment results closer to the real network quality.
附图说明DRAWINGS
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。The one or more embodiments are exemplified by the accompanying drawings in the accompanying drawings, and FIG. The figures in the drawings do not constitute a scale limitation unless otherwise stated.
图1是现有技术中ICMP回显请求和回显应答报文的示意图;1 is a schematic diagram of an ICMP echo request and an echo response message in the prior art;
图2是本申请第一实施例中网络质量评估方法的流程图;2 is a flowchart of a network quality assessment method in the first embodiment of the present application;
图3是本申请第二实施例中网络质量评估方法的流程图;3 is a flowchart of a network quality assessment method in a second embodiment of the present application;
图4是本申请第三实施例中网络质量评估方法的流程图;4 is a flowchart of a network quality assessment method in a third embodiment of the present application;
图5是本申请第四实施例中网络质量评估装置的方框示意图;FIG. 5 is a block diagram showing a network quality evaluation apparatus in a fourth embodiment of the present application; FIG.
图6是本申请第五实施例中网络检测设备的方框示意图。FIG. 6 is a schematic block diagram of a network detecting apparatus in a fifth embodiment of the present application.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请部分实施例进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the objects, the technical solutions and the advantages of the present application more clear, some embodiments of the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.
本申请的第一实施例涉及一种网络质量评估方法,该网络质量评估方法可以应用于网络节点。The first embodiment of the present application relates to a network quality assessment method that can be applied to a network node.
需要说明的是,本实施例中所说的网络节点指每一个拥有自己唯一网络地址的设备,具体可以是工作站、客户、网络用户或个人计算机,还可以是服务器、打印机和其他够通过网络实现互联的设备。为了便于说明,以下将发起网络探测请求的网络节点称为“源主机”,将作出响应的的网络节点称为“目的主机”,该网络质量评估方法的具体流程如图2所示。It should be noted that the network node referred to in this embodiment refers to each device that has its own unique network address, and may specifically be a workstation, a client, a network user, or a personal computer, or may be a server, a printer, or the like. Interconnected devices. For convenience of description, the network node that initiates the network probe request is referred to as a “source host”, and the responding network node is referred to as a “destination host”. The specific process of the network quality assessment method is as shown in FIG. 2 .
在步骤201中,发起网络探测请求。In step 201, a network probe request is initiated.
具体的说,在本实施例中,源主机发起的网络探测请求具体为ICMP的回显应答请求,这样通过一个ping命令就可以实现回显应答和回显请求,从而能够在源主机和目的主机之间传递控制信息,确定网络是否连通、主机是否可达等。Specifically, in this embodiment, the network probe request initiated by the source host is specifically an ICMP echo reply request, so that the echo reply and the echo request can be implemented by using a ping command, thereby enabling the source host and the destination host. Pass control information to determine whether the network is connected, whether the host is reachable, and so on.
另外,为了能够在确定网络质量时,仅根据有效网络延迟值进行确定网络质量的操作,本实施例中的网络探测请求中除了需要携带要请求的目的主机的IP(互联网协议,Internet Protocol)地址或域名,以及至少一个请求数据包(如60个)之外,还需要携带一个置信概率值。In addition, in order to be able to determine the network quality based on the effective network delay value, the network probe request in this embodiment needs to carry the IP (Internet Protocol) address of the destination host to be requested. Or a domain name, and at least one request packet (such as 60), also need to carry a confidence probability value.
需要说明的是,置信概率值具体为用来衡量统计推断可靠程度的概率值,其意义是指在进行统计推断时,被估参数包含在某一范围内的概率。关于置信概率值的具体取值,本领域的技术人员可以根据实际测试需要合理设置,此处不做限制。It should be noted that the confidence probability value is specifically a probability value used to measure the reliability of statistical inference, and its meaning refers to the probability that the estimated parameter is included in a certain range when performing statistical inference. Regarding the specific value of the confidence probability value, those skilled in the art can appropriately set according to the actual test requirements, and no limitation is made here.
需要说明的是,以上仅为举例说明,并不对本申请的技术方案及要保护的范围构成限定,在实际应用中,本领域的技术人员可以根据实际需要,合理设置,此处不做限制。It should be noted that the above is only an example, and does not limit the technical solution of the present application and the scope to be protected. In practical applications, those skilled in the art can appropriately set according to actual needs, and no limitation is made herein.
在步骤202中,接收响应数据包,并记录收到响应数据包时的网络延迟值。In step 202, a response packet is received and the network delay value when the response packet is received is recorded.
具体的说,在本实施例中源主机接收到的响应数据包为目的主机根据每一个请求数据包作出的响应数据包。Specifically, in the embodiment, the response data packet received by the source host is a response data packet made by the destination host according to each request data packet.
另外,需要说明的是,在记录网络延迟值时,为了便于后续使用,需要同时记录每一个网络延迟值分别对应的是哪一个响应数据包,并且与之对应的响应数据包又是与哪一个请求数据包对应。这样在后续的处理中,就可以清楚的获知哪些请求数据包没有收到响应,收到的哪些响应数据包存在异常。In addition, it should be noted that, when recording the network delay value, in order to facilitate subsequent use, it is necessary to simultaneously record which response packet corresponds to each network delay value, and which response packet corresponds to which one. The request packet corresponds. In this way, in the subsequent processing, it can be clearly known which request packets have not received the response, and which response packets received are abnormal.
在步骤203中,根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值。In step 203, an effective network delay value is selected from all of the recorded network delay values based on the confidence probability value.
具体的说,在本实施例中,根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值时,具体需要先根据置信概率值,确定异常网络延迟值,然后从记录的所有网络延迟值中剔除异常网络延迟值,即可得到有效网络延迟值。Specifically, in the embodiment, when the effective network delay value is selected from all the network delay values recorded according to the confidence probability value, the abnormal network delay value is determined according to the confidence probability value, and then all the networks are recorded from the network. The effective network delay value is obtained by removing the abnormal network delay value from the delay value.
为了便于理解,以下对根据置信概率值,确定异常网络延迟值的操作,进行具体说明:For ease of understanding, the following describes the operation of determining the abnormal network delay value according to the confidence probability value:
S1:确定网络延迟绝对值和异常门限值。S1: Determine the network delay absolute value and the abnormal threshold.
具体的说,此处所说的网络延迟绝对值为响应数据包的网络延迟绝对值,在确定该值时,需要先对记录的所有网络延迟值进行求平均运算,得到网络延迟平均值。然后,计算每一个网络延迟值与网络延迟平均值的差,将得到的差值作为相应响应数据包的网络延迟绝对值。Specifically, the absolute value of the network delay mentioned here is the absolute value of the network delay of the response packet. When determining the value, all the network delay values recorded need to be averaged to obtain the average network delay. Then, the difference between each network delay value and the network delay average is calculated, and the obtained difference is taken as the absolute value of the network delay of the corresponding response packet.
在确定异常门限值时,需要先获取网络延迟值对应的格拉布斯准则的检验临界值,并根据网络延迟值,确定网络延迟标准差。然后,计算检验临界值与网络延迟标准差的积,将得到的积作为异常门限值。When determining the abnormal threshold, it is necessary to first obtain the test threshold of the Grubbs criterion corresponding to the network delay value, and determine the network delay standard deviation according to the network delay value. Then, the product of the test threshold value and the network delay standard deviation is calculated, and the obtained product is taken as the abnormal threshold value.
为了便于理解,以下结合公式进行具体说明:In order to facilitate understanding, the following specific formula is combined:
公式1:T=K G(n,α)σ(x); Formula 1: T = K G (n, α) σ (x);
具体的说,T为异常门限值,K G(n,a)为检验临界值,σ(x)为根据记录的所有网络延迟值确定的网络延迟标准差。 Specifically, T is the abnormal threshold, K G (n, a) is the test threshold, and σ(x) is the network delay standard deviation determined based on all the network delay values recorded.
其中,K G(n,a)可以根据格拉布斯准则的检验临界值表或检验临界值计算公式获得,σ(x)可以根据标准差的计算公式获得,此处不再赘述。 Where K G (n, a) can be obtained according to the Grubbs criterion test threshold table or the test threshold value calculation formula, and σ(x) can be obtained according to the standard deviation calculation formula, and will not be described herein.
为了便于理解检验临界值K G(n,a)的两种获取方式,以下进行具体说明: In order to facilitate understanding of the two acquisition methods of the test threshold K G (n, a), the following is specifically described:
方式一:采用拉布斯准则的检验临界值表获取。Method 1: Obtain the test threshold table using the Rabbs criterion.
格拉布斯准则的检验临界值表一Grubbs criterion test threshold table 1
Figure PCTCN2018076473-appb-000001
Figure PCTCN2018076473-appb-000001
其中,n为测量次数(请求数据包的发送总批次),P为置信概率值。Where n is the number of measurements (the total number of packets sent for the request packet) and P is the confidence probability value.
需要说明的是,检验临界值K G(n,a)中的危险概率值a(也称:超差概率值)与置信概率值P满足如下关系:α=1-P。 It should be noted that the risk probability value a (also referred to as the out-of-tolerance probability value) in the inspection threshold K G (n, a) and the confidence probability value P satisfy the following relationship: α=1-P.
另外,需要说明的是,上述格拉布斯准则的检验临界值表一中罗列的检验临界值仅为测量次数在3到20中取值时,α=0.05和α=0.01的检验临界值。在实际应用中,本领域的技术人员可以根据现有的格拉布斯准则的检验临界值表获取需要的检验临界值,此处不再赘述。In addition, it should be noted that the test threshold value listed in Table 1 of the above-mentioned Grubbs criterion is only the test threshold value of α=0.05 and α=0.01 when the number of measurements is in the range of 3 to 20. In practical applications, those skilled in the art can obtain the required test threshold according to the existing Gurbus criterion test threshold table, and details are not described herein again.
方式二:采用检验临界值计算公式获取。Method 2: Obtain the formula using the test threshold value.
公式2:
Figure PCTCN2018076473-appb-000002
Formula 2:
Figure PCTCN2018076473-appb-000002
其中,K G(n,a)为检验临界值,n为测量次数(请求数据包的发送总批次),a为危险概率值,t crit为自由度为n-2的t分布(Student's t-distribution,学生t-分布)的概率为α÷(2n)的上侧分位数。 Where K G (n, a) is the test threshold, n is the number of measurements (the total batch of the request packet is sent), a is the risk probability value, and t crit is the t distribution with a degree of freedom of n-2 (Student's t The probability of -distribution, student t-distribution) is the upper quantile of α÷(2n).
由于t分布的应用已经较为成熟,本领域的技术人员可以根据其掌握的技术获得,此处不再赘述。Since the application of the t-distribution is relatively mature, those skilled in the art can obtain the technology according to the mastery thereof, and details are not described herein again.
S2:确定网络延迟绝对值满足异常门限值。S2: Determine that the absolute value of the network delay meets the abnormal threshold.
具体的,通过将网络延迟绝对值与异常门限值进行对比,若确定网络延迟绝对值大于或等于异常门限值,则确定网络延迟绝对值满足异常门限值。Specifically, by comparing the absolute value of the network delay with the abnormal threshold, if it is determined that the absolute value of the network delay is greater than or equal to the abnormal threshold, it is determined that the absolute value of the network delay satisfies the abnormal threshold.
S3:获取满足异常门限值的每一个网络延迟绝对值对应的网络延迟值,将获取到的网络延迟值确定为异常网络延迟值。S3: Obtain a network delay value corresponding to each network delay absolute value that meets the abnormal threshold, and determine the obtained network delay value as an abnormal network delay value.
另外,值得一提的是,在实际应用中,为了能够快速从记录的所有网络延迟值中选择有效网络延迟值,在确定网络延迟绝对值满足异常门限值的步骤中,可以先按照从小到大或从大到小的顺序对网络延迟值排序。In addition, it is worth mentioning that, in practical applications, in order to quickly select an effective network delay value from all recorded network delay values, in the step of determining that the absolute value of the network delay satisfies the abnormal threshold, it may first Sort the network delay values in large or small to small order.
为了便于说明,以下以按照从小到大的顺序对网络延迟值排序为例进行说明。For convenience of explanation, the following describes an example in which the network delay values are sorted in ascending order.
在对记录的所有网络延迟值,按照从小到大的顺序对网络延迟值排序后,从最小的网络延迟值开始,依次将排序后的网络延迟值对应的网络延迟绝对值与异常门限值进行对比,直至确定对比结果满足异常门限值停止比对,并确定未进行比对的网络延迟值均满足异常门限值。After all the network delay values are recorded, the network delay values are sorted in ascending order, starting from the minimum network delay value, and sequentially performing the network delay absolute value and the abnormal threshold corresponding to the sorted network delay values. In contrast, it is determined that the comparison result satisfies the abnormal threshold stop comparison, and it is determined that the network delay values that are not compared satisfy the abnormal threshold.
需要说明的是,上述给出的仅仅为“根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值”的一种具体实现方式,在实际应用中,本领域的技术人员可以根据其掌握的技术手段,选择合适的去除粗大误差(去除异常网络延迟值)的方式,此处不做限制。It should be noted that, the above is only a specific implementation manner of “selecting an effective network delay value from all the network delay values recorded according to the confidence probability value”. In practical applications, those skilled in the art can The technical means that it masters, choose the appropriate way to remove the coarse error (remove the abnormal network delay value), and there is no limit here.
在步骤204中,根据有效网络延迟值,确定网络质量。In step 204, the network quality is determined based on the effective network delay value.
具体的说,源主机在根据有效网络延迟值,确定网络质量时,具体需要根据有效网络延迟值,确定网络探测请求的有效网络延迟平均值,然后根据得到的有效网络延迟平均值来确定当前网络质量。Specifically, when determining the network quality according to the effective network delay value, the source host needs to determine the effective network delay average of the network probe request according to the effective network delay value, and then determine the current network according to the obtained effective network delay average value. quality.
另外,需要说明的是,在实际应用中还可以根据有效网络延迟值,确定网络探测请求的有效网络延迟标准差,然后根据得到的有效网络延迟标准差来确定当前网络质量。In addition, it should be noted that, in actual applications, the effective network delay standard deviation of the network probe request may also be determined according to the effective network delay value, and then the current network quality is determined according to the obtained effective network delay standard deviation.
另外,为了保证结果的准确性,可以根据有效网络延迟值,同时确定网络探测请求的有效网络延迟平均值和有效网络延迟标准差,从而能够根据二者综合考虑,确定最终的网络质量。In addition, in order to ensure the accuracy of the result, the effective network delay average of the network probe request and the effective network delay standard deviation can be determined according to the effective network delay value, so that the final network quality can be determined according to the comprehensive consideration of the two.
与现有技术相比,本实施例中提供的网络质量评估方法,根据网络探测请求中携带的置信概率值,从记录的所有网络延迟值中选择有效网络延迟值,根据有效网络延迟值来确定网络质量,避免了现有网络质量评估过程中,异常数据的干扰,大大提高了网络质量评估结果的准确性,使网络质量评估结果更加接近真实的网络质量。Compared with the prior art, the network quality assessment method provided in this embodiment selects an effective network delay value from all recorded network delay values according to the confidence probability value carried in the network probe request, and determines according to the effective network delay value. The network quality avoids the interference of abnormal data in the existing network quality assessment process, greatly improves the accuracy of the network quality assessment results, and makes the network quality assessment result closer to the real network quality.
本申请的第二实施例涉及一种网络质量评估方法。本实施例在第一实施例的基础上做了进一步改进,具体改进之处为:在网络探测请求中携带的请求数据包的发送总批次大于2时,根据有效网络延迟值,确定网络探测请求的有效网络延迟平均值和/或有效网络延迟标准差,具体是根据每一个批次的有效网 络延迟平均值和/或有效网络延迟标准差确定的,为了便于说明,以下结合图3进行具体说明。A second embodiment of the present application relates to a network quality assessment method. The embodiment is further improved on the basis of the first embodiment, and the specific improvement is: when the total batch of the request data packet carried in the network probe request is greater than 2, the network detection is determined according to the effective network delay value. The requested effective network delay average and/or the effective network delay standard deviation, which is determined according to the effective network delay average of each batch and/or the effective network delay standard deviation. For convenience of explanation, the following is specifically described with reference to FIG. Description.
具体的说,在本实施例中,包含步骤301至步骤306,其中,步骤301和步骤302分别与第一实施例中的步骤201和步骤202大致相同,此处不再赘述,下面主要介绍不同之处,未在本实施方式中详尽描述的技术细节,可参见第一实施例所提供的网络质量评估方法,此处不再赘述。Specifically, in this embodiment, the steps 301 to 306 are included, and the steps 301 and 302 are respectively the same as the steps 201 and 202 in the first embodiment, and are not described herein again. For the technical details that are not described in detail in this embodiment, refer to the network quality assessment method provided by the first embodiment, and details are not described herein again.
在步骤303中,根据置信概率值,选择每一个批次的有效网络延迟值。In step 303, an effective network delay value for each batch is selected based on the confidence probability value.
在步骤304中,确定每一个批次的有效网络延迟平均值。In step 304, an average of the effective network delays for each batch is determined.
在步骤305中,根据每一个批次的有效网络延迟平均值,确定网络探测请求的有效网络延迟平均值。In step 305, an effective network delay average of the network probe request is determined based on the average of the effective network delays for each batch.
在步骤306中,根据网络探测请求的有效网络延迟平均值,确定网络质量。In step 306, the network quality is determined based on the average of the effective network delays of the network probe request.
需要说明的是,在本实施例中,从记录的所有网络延迟值中选择每一个批次的有效网络延迟值的方式采用的方式仍然为根据置信概率值,基于格拉布斯准则选择,此处不再赘述。It should be noted that, in this embodiment, the manner of selecting the effective network delay value of each batch from all the network delay values recorded is still based on the confidence probability value, based on the Grubbs criterion, where No longer.
为了便于理解,以下以源主机向目的主机发起一次ICMP协议的网络探测请求,且该请求中携带了目的主机的IP、每批请求数据包个数、请求数据包的发送总批次和置信概率值这4个参数为例,进行具体说明。For ease of understanding, the source host initiates a network probe request of the ICMP protocol to the destination host, and the request carries the IP of the destination host, the number of packets per batch, the total batch of the request packet, and the confidence probability. The values of these four parameters are taken as an example for specific explanation.
假定,设置的每批请求数据包个数为60个,请求数据包的发送总批次为3次,置信概率值为0.95。第一个批次发送成功的请求包个数为n(小于或等于60)个,收到的响应数据包为n-h(h为大于或等0的整数)个,记录的网络延迟值为n-h个。第二个批次发送成功的请求包个数为n(小于或等于60)个,收到的响应数据包为n-j(j为大于或等0的整数)个,记录的网络延迟值为n-j个。第三个批次发送成功的请求包个数为n(小于或等于60)个,收到的响应数据包为n-k(k为大于或等0的整数)个,记录的网络延迟值为n-k个。Assume that the number of request packets per batch is set to 60, the total number of packets sent for request packets is three, and the confidence probability value is 0.95. The number of request packets successfully sent by the first batch is n (less than or equal to 60), and the received response packet is nh (h is an integer greater than or equal to 0), and the recorded network delay value is nh. . The number of request packets successfully sent by the second batch is n (less than or equal to 60), and the received response packet is nj (j is an integer greater than or equal to 0), and the recorded network delay value is nj. . The number of request packets successfully sent by the third batch is n (less than or equal to 60), and the received response packet is nk (k is an integer greater than or equal to 0), and the recorded network delay value is nk. .
源主机根据设置的置信概率值,基于格拉布斯准则,从这三个批次的网络延迟值中选取有效网络延长值。The source host selects the effective network extension value from the network delay values of the three batches based on the set confidence probability value based on the Grubbs criterion.
为了快速计算,先将3个批次的网络延迟值进行从小到大的排序。For fast calculations, the network delay values of the three batches are first sorted from small to large.
为了便于说明,以下以第一批次为例进行说明:For the convenience of explanation, the following is an example of the first batch:
将第一批次的网络延迟值按照从小到大的顺序排序,排序后的值为m1,m2...mi(i为n-k)。对第一批次的网络延迟值进行求平均计算,得到第一批次的网络延迟平均值
Figure PCTCN2018076473-appb-000003
对第一批次的网络延迟值,进行标准差计算,得到第一批 次的网络延迟标准差σ1。从mi开始,计算mi和网络延迟平均值
Figure PCTCN2018076473-appb-000004
的绝对值(即与该网络延迟值mi对应的响应数据包的网络延迟绝对值),公式表示如下:
Figure PCTCN2018076473-appb-000005
The network delay values of the first batch are sorted in ascending order, and the sorted values are m1, m2...mi (i is nk). The network delay value of the first batch is averaged to obtain the network delay average of the first batch.
Figure PCTCN2018076473-appb-000003
For the network delay value of the first batch, the standard deviation calculation is performed to obtain the network delay standard deviation σ1 of the first batch. Starting mi, calculate mi and network latency average
Figure PCTCN2018076473-appb-000004
The absolute value (ie, the absolute value of the network delay of the response packet corresponding to the network delay value mi), the formula is expressed as follows:
Figure PCTCN2018076473-appb-000005
查找格拉布斯准则的检验临界值表或者利用检验临界值计算公式
Figure PCTCN2018076473-appb-000006
得到每一个网络延迟值mi对应的检验临界值K G(i,α)。判断网络延迟绝对值|Δxi|是否大于异常门限值(K G(i,α)×σ1),如果|Δxi|大于K G(i,α)×σ1,认为网络延迟值mi是异常网络延迟值,将该数值丢弃。
Find the test threshold table for the Grubbs criterion or use the test threshold to calculate the formula
Figure PCTCN2018076473-appb-000006
A test threshold K G (i, α) corresponding to each network delay value mi is obtained. Determine whether the network delay absolute value |Δxi| is greater than the abnormal threshold (K G (i, α) × σ1), and if |Δxi| is greater than K G (i, α) × σ1, the network delay value mi is considered to be an abnormal network delay. Value, discard the value.
在将第一批次中的所有异常网络延迟值剔除后,循环进行n-h次检验,遍历出有效网络延迟值,将所有的有效网络延迟值累加并除以有效网络延迟值的数量,得到有效网络延迟值平均值
Figure PCTCN2018076473-appb-000007
根据这些有效网络延迟值平均值
Figure PCTCN2018076473-appb-000008
计算出有效网络延迟标准差σ v
After all the abnormal network delay values in the first batch are eliminated, the loop performs nh times of testing, traversing the effective network delay value, accumulating all the effective network delay values and dividing by the number of effective network delay values to obtain an effective network. Average value of delay value
Figure PCTCN2018076473-appb-000007
Based on the average of these effective network delay values
Figure PCTCN2018076473-appb-000008
Calculate the effective network delay standard deviation σ v .
按照上述操作,对其余两个批次的网络延迟值进行处理,即可得到每一个批次的有效网络延迟值平均值和有效网络延迟标准差。According to the above operation, the network delay values of the remaining two batches are processed to obtain the average value of the effective network delay value and the effective network delay standard deviation of each batch.
对得到的3个有效网络延迟值平均值和有效网络延迟标准差分别进行求平均计算,即可得到本次网络探测请求的有效网络延迟平均值和有效网络延迟标准差。By averaging the average of the three effective network delay values and the effective network delay standard deviation, the effective network delay average and the effective network delay standard deviation of the network probe request can be obtained.
需要说明的是,以上仅为举例说明,并不对本申请的技术方案及要保护的范围构成限定,在实际应用中,本领域的技术人员可以根据实际需要,合理设置,此处不做限制。It should be noted that the above is only an example, and does not limit the technical solution of the present application and the scope to be protected. In practical applications, those skilled in the art can appropriately set according to actual needs, and no limitation is made herein.
与现有技术相比,本实施例中提供的网络质量评估方法,在发送网络探测请求时,通过设置携带的请求数据包的发送总批次大于2,在根据有效网络延迟值,确定网络质量时,对每一个批次的有效网络延迟值进行求平均处理,从而使得最终确定的网络探测请求的有效网络延迟平均值和/或有效网络延迟标准差,能够更真实的反应当前网络质量,进一步提升了网络质量评估的准确性。Compared with the prior art, the network quality assessment method provided in this embodiment determines the network quality according to the effective network delay value by setting the total batch of the carried request packet to be greater than 2 when the network probe request is sent. When averaging the effective network delay values of each batch, so that the effective network delay average of the final network probe request and/or the effective network delay standard deviation can more accurately reflect the current network quality, further Improve the accuracy of network quality assessment.
本申请的第三实施例涉及一种网络质量评估方法。本实施例在第一或第二实施例的基础上做了进一步改进,具体改进之处为:在根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值之前,需要先确定当前网络探测请求的丢包率是否满足预设的正常丢包率,为了便于说明,以下在第一实施例的基础上结合图4进行具体说明。A third embodiment of the present application relates to a network quality assessment method. This embodiment is further improved on the basis of the first or second embodiment, and the specific improvement is: before selecting the effective network delay value from all the network delay values recorded according to the confidence probability value, it is necessary to determine the current Whether the packet loss rate of the network probe request satisfies the preset normal packet loss rate. For convenience of description, the following is specifically described in conjunction with FIG. 4 on the basis of the first embodiment.
具体的说,在本实施例中,包含步骤401至步骤405,其中,步骤401和步骤202、步骤404和步骤405分别与第一实施例中的步骤201和步骤202、步骤203和步骤204大致相同,此处不再赘述,下面主要介绍不同之处,未在 本实施方式中详尽描述的技术细节,可参见第一实施例所提供的网络质量评估方法,此处不再赘述。Specifically, in this embodiment, step 401 to step 405 are included, wherein step 401 and step 202, step 404, and step 405 are respectively approximated to step 201 and step 202, step 203, and step 204 in the first embodiment. For the same, the details are not described here. The following is a description of the differences. For the technical details that are not described in detail in this embodiment, refer to the network quality assessment method provided in the first embodiment, and details are not described herein again.
在步骤403中,判断网络探测请求的丢包率是否满足预设的正常丢包率。In step 403, it is determined whether the packet loss rate of the network probe request meets a preset normal packet loss rate.
具体的说,若确定网络探测请求的丢包率满足预设的正常丢包率,则进入步骤404,根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值;否则,返回步骤401,重新发起网络探测请求。Specifically, if it is determined that the packet loss rate of the network probe request meets the preset normal packet loss rate, proceed to step 404, and select an effective network delay value from all the network delay values recorded according to the confidence probability value; otherwise, return to the step 401. Re-initiate the network probe request.
关于当前网络探测请求的丢包率,是根据网络探测请求中携带的请求数据包的个数和记录的收到的响应数据包的个数计算获得的,具体可以根据如下公式计算获得:The packet loss rate of the current network probe request is calculated according to the number of request data packets carried in the network probe request and the number of received response data packets, which can be calculated according to the following formula:
公式3:
Figure PCTCN2018076473-appb-000009
Formula 3:
Figure PCTCN2018076473-appb-000009
其中,R Q为发送的请求数据包的个数,R S为收到的响应数据包的个数,P L为本次网络探测请求的丢包率。 Where R Q is the number of request packets sent, R S is the number of received response packets, and P L is the packet loss rate of the network probe request.
另外,如果网络探测请求中设置的请求数据包的发送批次大于2,最终计算的丢包率为对每一批次的丢包率进行求平均后的丢包率。In addition, if the sending batch of the request packet set in the network probe request is greater than 2, the final calculated packet loss rate is the packet loss rate after averaging the packet loss rate of each batch.
另外,关于正常丢包率的设置,通常,千兆网卡在流量大于200Mbps时,丢包率小于万分之五为正常,百兆网卡在流量大于60Mbps时,丢包率小于万分之一为正常,具体的设置,本领域的技术人员可以根据测试需要合理设置,此处不做限制。In addition, regarding the setting of the normal packet loss rate, usually, when the traffic of the Gigabit NIC is greater than 200 Mbps, the packet loss rate is less than 50,000, and the packet loss rate is less than one ten thousand when the traffic is greater than 60 Mbps. Normal, specific settings, those skilled in the art can be reasonably set according to the test needs, and no limitation is made here.
需要说明的是,以上仅为举例说明,并不对本申请的技术方案及要保护的范围构成限定,在实际应用中,本领域的技术人员可以根据实际需要,合理设置,此处不做限制。It should be noted that the above is only an example, and does not limit the technical solution of the present application and the scope to be protected. In practical applications, those skilled in the art can appropriately set according to actual needs, and no limitation is made herein.
与现有技术相比,本实施例中提供的网络质量评估方法,在根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值之前,先确定当前网络探测请求的丢包率是否满足预设的正常丢包率,并在确定满足预设的正常丢包率时,才进行后续确定网络质量的操作,从而进一步保证最终确定的网络质量的准确性。Compared with the prior art, the network quality evaluation method provided in this embodiment determines whether the packet loss rate of the current network probe request is determined before selecting an effective network delay value from all the network delay values recorded according to the confidence probability value. The preset normal packet loss rate is met, and the network quality operation is determined after the predetermined normal packet loss rate is determined, thereby further ensuring the accuracy of the final determined network quality.
本申请的第四实施例涉及一种网络质量评估装置,具体结构如图5所示。A fourth embodiment of the present application relates to a network quality evaluation apparatus, and the specific structure is as shown in FIG. 5.
如图5所示,网络质量评估装置发送模块501、接收模块502、记录模块503、选择模块504和确定模块505。As shown in FIG. 5, the network quality evaluation apparatus transmits a module 501, a receiving module 502, a recording module 503, a selecting module 504, and a determining module 505.
其中,发送模块501,用于发起网络探测请求。The sending module 501 is configured to initiate a network probe request.
具体的说,在本实施例中,发送模块501发起的网络探测请求具体为 ICMP的回显应答请求,这样通过一个ping命令就可以实现回显应答和回显请求,从而能够在设置有该网络质量评估装置的请求设备(以下用“源主机”表示)和响应该请求的响应设备(以下用“目的主机”表示)之间传递控制信息,确定网络通不通、主机是否可达等。Specifically, in this embodiment, the network probe request initiated by the sending module 501 is specifically an echo reply response request of the ICMP, so that the echo reply and the echo request can be implemented by using a ping command, so that the network can be set. The request device of the quality evaluation device (hereinafter referred to as "source host") and the response device responding to the request (hereinafter referred to as "destination host") transfer control information to determine whether the network is unreachable, whether the host is reachable, or the like.
另外,为了能够在确定网络质量时,仅根据有效网络延迟值进行确定网络质量的操作,本实施例中的网络探测请求中除了需要携带要请求的目的主机的IP(互联网协议,Internet Protocol)地址或域名,以及至少一个请求数据包之外,还需要携带一个置信概率值。In addition, in order to be able to determine the network quality based on the effective network delay value, the network probe request in this embodiment needs to carry the IP (Internet Protocol) address of the destination host to be requested. Or a domain name, and at least one request packet, you also need to carry a confidence probability value.
另外,为了能够使评估的网络质量更加接近真实网络情况,在发起网络探测请求时,可以在一次网络探测请求中设置请求数据包的发送批次大于2,这样就可以对多个批次所得的数据进行求平均操作,从而使得最终结果更加符合实际网络情况。In addition, in order to make the evaluated network quality closer to the real network situation, when the network probe request is initiated, the sending batch of the request data packet can be set in a network probe request to be greater than 2, so that the plurality of batches can be obtained. The data is averaged so that the final result is more in line with the actual network conditions.
需要说明的是,在本实施例中,设置的请求数据包的发送批次之所以要大于2是因为,在基于格拉布斯准则,选取有效网络延迟值时,格拉布斯准则的检验临界值是最低是从测量次数(发送批次)为3时开始的。It should be noted that, in this embodiment, the sending batch of the requested data packet is greater than 2 because the check threshold of the Grubbs criterion is selected when the effective network delay value is selected based on the Grubbs criterion. The lowest is from the number of measurements (sending batch) is 3.
另外,为了便于理解,网络探测请求的发送格式,一下进行举例说明。比如说,在网络探测请求中携带有目的主机IP地址、每批请求数据包个数、请求数据包的发送总批次和置信概率值时,其具体请求格式可以为:ping+空格+目的主机的IP地址+空格+请求数据包的个数+空格+置信概率值。In addition, for ease of understanding, the transmission format of the network probe request will be exemplified below. For example, when the network probe request carries the destination host IP address, the number of request packets per batch, the total batch of the request packet, and the confidence probability value, the specific request format may be: ping+space+destination host IP address + space + number of request packets + space + confidence probability value.
需要说明的是,以上仅为举例说明,并不对本申请的技术方案及要保护的范围构成限定,在实际应用中,本领域的技术人员可以根据实际需要,合理设置,此处不做限制。It should be noted that the above is only an example, and does not limit the technical solution of the present application and the scope to be protected. In practical applications, those skilled in the art can appropriately set according to actual needs, and no limitation is made herein.
接收模块502,用于接收网络节点根据每一个请求数据包作出的响应数据包。The receiving module 502 is configured to receive a response data packet that the network node makes according to each request data packet.
记录模块503,用于记录收到响应数据包时的网络延迟值。The recording module 503 is configured to record a network delay value when the response packet is received.
具体的说,在本实施例中,记录模块503记录网络延迟值时,为了便于后续使用,需要同时记录每一个网络延迟值分别对应的是哪一个响应数据包,并且与之对应的响应数据包又是与哪一个请求数据包对应。这样在后续的处理中,就可以清楚的获知哪些请求数据包没有收到响应,收到的哪些响应数据包存在异常。Specifically, in the embodiment, when the recording module 503 records the network delay value, in order to facilitate subsequent use, it is necessary to simultaneously record which response packet corresponds to each network delay value, and the corresponding response packet. It is also corresponding to which request packet. In this way, in the subsequent processing, it can be clearly known which request packets have not received the response, and which response packets received are abnormal.
需要说明的是,以上仅为举例说明,并不对本申请的技术方案及要保护的范围构成限定,在实际应用中,本领域的技术人员可以根据实际需要,合理 设置,此处不做限制。It should be noted that the above is only an example, and does not limit the technical solution of the present application and the scope to be protected. In practical applications, those skilled in the art can appropriately set according to actual needs, and no limitation is made herein.
选择模块504,用于根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值。The selecting module 504 is configured to select an effective network delay value from all the network delay values recorded according to the confidence probability value.
具体的说,本实施例中,选择模块504在根据置信概率值,从记录的所有网络延迟值中选择有效网络延迟值时,具体是基于格拉布斯准则,将记录的所有网络延迟值中的错的误差(明显超出规定条件下预期的误差)数据剔除,然后将剩下的网络延迟值作为有效网络延迟值。Specifically, in this embodiment, the selecting module 504 selects an effective network delay value from all the network delay values recorded according to the confidence probability value, specifically, based on the Grubbs criterion, all the network delay values to be recorded. The wrong error (significantly exceeding the expected error under specified conditions) is stripped and the remaining network delay value is taken as the effective network delay value.
确定模块505,用于根据有效网络延迟值,确定网络质量。The determining module 505 is configured to determine the network quality according to the effective network delay value.
具体的说,确定模块505在根据有效网络延迟值,确定网络质量时,具体需要根据有效网络延迟值,确定网络探测请求的有效网络延迟平均值,然后根据得到的有效网络延迟平均值来确定当前网络质量。Specifically, when determining the network quality according to the effective network delay value, the determining module 505 specifically needs to determine an effective network delay average of the network probe request according to the effective network delay value, and then determine the current according to the obtained effective network delay average value. Network quality.
另外,需要说明的是,在实际应用中还可以根据有效网络延迟值,确定网络探测请求的有效网络延迟标准差,然后根据得到的有效网络延迟标准差来确定当前网络质量。In addition, it should be noted that, in actual applications, the effective network delay standard deviation of the network probe request may also be determined according to the effective network delay value, and then the current network quality is determined according to the obtained effective network delay standard deviation.
另外,为了保证结果的准确性,可以根据有效网络延迟值,同时确定网络探测请求的有效网络延迟平均值和有效网络延迟标准差,从而能够根据二者综合考虑,确定最终的网络质量。In addition, in order to ensure the accuracy of the result, the effective network delay average of the network probe request and the effective network delay standard deviation can be determined according to the effective network delay value, so that the final network quality can be determined according to the comprehensive consideration of the two.
进一步地,在实际应用中,还可以先利用丢包率过滤一下干扰信息,比如先确定当前网络探测请求的丢包率是否满足预设的正常丢包率,在确定满足预设的正常丢包率时,在进行上述操作,从而进一步保证了最终结果的准确性。Further, in the actual application, the interference information may be filtered by using the packet loss rate, for example, determining whether the packet loss rate of the current network probe request satisfies the preset normal packet loss rate, and determining that the preset normal packet loss is satisfied. At the time of the rate, the above operations are performed to further ensure the accuracy of the final result.
关于当前网络探测请求的丢包率,具体是根据发送模块501发起网络探测请求时,网络探测请求中携带的请求数据包的个数和记录模块503记录的收到的响应数据包的个数计算获得的。Regarding the packet loss rate of the current network probe request, the number of request data packets carried in the network probe request and the number of received response data packets recorded by the recording module 503 are calculated according to the sending module 501, when the network probe request is initiated by the sending module 501. acquired.
需要说明的是,由于本实施例为与方法实施例对应的虚拟装置实施例,因而未在本实施方式中详尽描述的技术细节,可参见本申请任一实施例所提供的网络质量评估方法,此处不再赘述。It should be noted that, because the present embodiment is a virtual device embodiment corresponding to the method embodiment, and thus the technical details not described in detail in this embodiment, refer to the network quality evaluation method provided by any embodiment of the present application. I will not repeat them here.
通过上述描述不难发现,本实施例中提供的网络质量评估装置,通过上述各功能模块的配合,有效避免了网络质量评估过程中,异常数据的干扰,大大提高了网络质量评估结果的准确性,使网络质量评估结果更加接近真实的网络质量。Through the above description, it is not difficult to find that the network quality evaluation apparatus provided in this embodiment effectively avoids the interference of abnormal data in the network quality assessment process by the cooperation of the above various functional modules, and greatly improves the accuracy of the network quality assessment result. To make the network quality assessment results closer to the real network quality.
另外,需要说明的是,以上所描述的装置实施例仅仅是示意性的,并不对本申请的保护范围构成限定,在实际应用中,本领域的技术人员可以根据实 际的需要选择其中的部分或者全部模块来实现本实施例方案的目的,此处不做限制。In addition, it should be noted that the device embodiments described above are merely illustrative and do not limit the scope of protection of the present application. In practical applications, those skilled in the art may select some of them according to actual needs or All modules are used to achieve the purpose of the solution of the embodiment, and no limitation is imposed here.
本申请的第五实施例涉及一种网络检测设备,具体结构如图6所示。A fifth embodiment of the present application relates to a network detecting device, and the specific structure is as shown in FIG. 6.
本实施例中所说的网络节点指每一个拥有自己唯一网络地址的设备,具体可以是工作站、客户、网络用户或个人计算机,还可以是服务器、打印机和其他够通过网络实现互联的设备等,此处不做限制。The network node in this embodiment refers to each device that has its own unique network address, and may specifically be a workstation, a client, a network user, or a personal computer, and may also be a server, a printer, and other devices capable of interconnecting through a network. There are no restrictions here.
为了便于说明,以下以个人计算机为例,进行具体说明。For convenience of explanation, a personal computer will be taken as an example for specific description.
具体的说,该网络检测设备内部具体可以包括一个或多个处理器601以及存储器602,图6中以一个处理器601为例。Specifically, the network detecting device may specifically include one or more processors 601 and a memory 602. One processor 601 is taken as an example in FIG.
在本实施例中,上述实施例中涉及到的网络质量评估装置中的各功能模块均部署在处理器601上,处理器601和存储器602可以通过总线或其他方式连接,图6中以通过总线连接为例。In this embodiment, each functional module in the network quality evaluation apparatus involved in the foregoing embodiment is deployed on the processor 601, and the processor 601 and the memory 602 can be connected through a bus or other manner, and the bus is connected through the bus in FIG. Connection is an example.
存储器602作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本申请任意方法实施例中涉及的网络质量评估方法对应的程序指令/模块。处理器601通过运行存储在存储器602中的软件程序、指令以及模块,从而执行服务器的各种功能应用以及数据处理,即实现本申请任意方法实施例中涉及的网络质量评估方法。The memory 602 is a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the network quality evaluation method involved in any method embodiment of the present application. The processor 601 executes various functional applications and data processing of the server by running software programs, instructions, and modules stored in the memory 602, that is, implementing the network quality evaluation method involved in any method embodiment of the present application.
存储器602可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可建立历史数据库,用于存储异常门限值、正常丢包率等。此外,存储器602可以包括高速随机存取存储器,还可以包括可读写存储器(Random Access Memory,RAM)等。在一些实施例中,存储器602可选包括相对于处理器601远程设置的存储器,这些远程存储器可以通过网络连接至终端设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required by at least one function; and the storage data area may establish a historical database for storing abnormal thresholds and normal packet loss. Rate and so on. In addition, the memory 602 may include a high speed random access memory, and may also include a readable and writable memory (RAM). In some embodiments, memory 602 can optionally include memory remotely located relative to processor 601 that can be connected to the terminal device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
在实际应用中,存储器602中可以存储至少一个处理器601执行的指令,指令被至少一个处理器601执行,以使至少一个处理器601能够执行本申请任意方法实施例涉及的网络质量评估方法,控制网络质量评估装置中的各个功能模块完成网络质量评估方法中的各个操作,未在本实施例中详尽描述的技术细节,可参见本申请任一实施例所提供的网络质量评估方法。In an actual application, the memory 602 may store at least one instruction executed by the processor 601, and the instruction is executed by the at least one processor 601, so that the at least one processor 601 can perform the network quality assessment method involved in any method embodiment of the present application. Each of the functional modules in the control network quality assessment device performs the operations in the network quality assessment method. For the technical details not described in detail in this embodiment, refer to the network quality assessment method provided in any embodiment of the present application.
本申请的第六实施例涉及一种计算机可读存储介质,该可读存储介质为计算机可读存储介质,该计算机可读存储介质中存储有计算机指令,该计算机指令使计算机能够执行本申请任意方法实施例中涉及的网络质量评估方法。A sixth embodiment of the present application is directed to a computer readable storage medium, which is a computer readable storage medium having stored therein computer instructions that enable a computer to perform any of the present application The network quality assessment method involved in the method embodiment.
本领域技术人员可以理解实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。Those skilled in the art can understand that all or part of the steps of implementing the above embodiments may be completed by a program instructing related hardware, and the program is stored in a storage medium, and includes a plurality of instructions for making a device (which may be a single chip microcomputer). , a chip, etc. or a processor performs all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
本领域的普通技术人员可以理解,上述各实施例是实现本申请的具体实施例,而在实际应用中,可以在形式上和细节上对其作各种改变,而不偏离本申请的精神和范围。A person skilled in the art can understand that the above embodiments are specific embodiments of the present application, and various changes can be made in the form and details without departing from the spirit and scope of the application. range.

Claims (13)

  1. 一种网络质量评估方法,包括:A method for network quality assessment, including:
    发起网络探测请求;其中,所述网络探测请求中携带有置信概率值和至少一个请求数据包;Initiating a network probe request, where the network probe request carries a confidence probability value and at least one request data packet;
    接收网络节点根据每一个所述请求数据包作出的响应数据包,并记录收到所述响应数据包时的网络延迟值;Receiving, by the network node, a response data packet according to each of the request data packets, and recording a network delay value when the response data packet is received;
    根据所述置信概率值,从记录的所有所述网络延迟值中选择有效网络延迟值;Determining, according to the confidence probability value, an effective network delay value from all of the recorded network delay values;
    根据所述有效网络延迟值,确定网络质量。The network quality is determined based on the effective network delay value.
  2. 如权利要求1所述的网络质量评估方法,其中,所述根据所述置信概率值,从记录的所有所述网络延迟值中选择有效网络延迟值,具体包括:The network quality evaluation method according to claim 1, wherein the selecting the effective network delay value from all the network delay values recorded according to the confidence probability value comprises:
    根据所述置信概率值,确定异常网络延迟值;Determining an abnormal network delay value according to the confidence probability value;
    从记录的所有所述网络延迟值中剔除所述异常网络延迟值,得到所述有效网络延迟值。The abnormal network delay value is removed from all of the recorded network delay values to obtain the effective network delay value.
  3. 如权利要求2所述的网络质量评估方法,其中,所述根据所述置信概率值,确定异常网络延迟值,具体包括:The network quality evaluation method according to claim 2, wherein the determining the abnormal network delay value according to the confidence probability value comprises:
    对记录的所有所述网络延迟值进行求平均运算,得到网络延迟平均值;Performing an averaging operation on all of the recorded network delay values to obtain an average network delay value;
    计算所述网络延迟值与所述网络延迟平均值的差,将得到的差值作为所述响应数据包的网络延迟绝对值;Calculating a difference between the network delay value and the network delay average, and using the obtained difference as the network delay absolute value of the response packet;
    根据所述置信概率值,确定异常门限值;Determining an abnormal threshold according to the confidence probability value;
    确定所述网络延迟绝对值满足所述异常门限值;Determining that the network delay absolute value satisfies the abnormal threshold value;
    获取满足所述异常门限值的所述网络延迟绝对值对应的所述网络延迟值,将获取到的所述网络延迟值确定为所述异常网络延迟值。Obtaining the network delay value corresponding to the network delay absolute value that meets the abnormal threshold value, and determining the obtained network delay value as the abnormal network delay value.
  4. 如权利要求3所述的网络质量评估方法,其中,所述确定所述网络延迟绝对值满足所述异常门限值,具体包括:The network quality assessment method according to claim 3, wherein the determining that the network delay absolute value satisfies the abnormal threshold value comprises:
    按照从小到大的顺序对所述网络延迟值排序;Sorting the network delay values in ascending order;
    从最小的所述网络延迟值开始,依次将排序后的所述网络延迟值对应的所述网络延迟绝对值与所述异常门限值进行对比,直至确定对比结果满足所述异常门限值停止比对,并确定未进行比对的所述网络延迟值均满足所述异常门限值。Starting from the smallest network delay value, sequentially comparing the network delay value corresponding to the sorted network delay value with the abnormal threshold value until determining that the comparison result satisfies the abnormal threshold value Aligning, and determining that the network delay values that are not aligned satisfy the abnormal threshold.
  5. 如权利要求3或4所述的网络质量评估方法,其中,所述根据所述置信概率值,确定异常门限值,具体包括:The network quality assessment method according to claim 3 or 4, wherein the determining the abnormal threshold according to the confidence probability value comprises:
    获取所述网络延迟值对应的格拉布斯准则的检验临界值;Obtaining a test threshold of a Grubbs criterion corresponding to the network delay value;
    根据所述网络延迟值,确定网络延迟标准差;Determining a network delay standard deviation according to the network delay value;
    计算所述检验临界值与所述网络延迟标准差的积,将得到的积作为所述异常门限值。A product of the test threshold and the network delay standard deviation is calculated, and the obtained product is used as the abnormal threshold.
  6. 如权利要求5所述的网络质量评估方法,其中,所述确定所述网络延迟绝对值满足所述异常门限值,具体包括:The network quality assessment method according to claim 5, wherein the determining that the network delay absolute value satisfies the abnormal threshold value comprises:
    确定所述网络延迟绝对值大于或等于所述异常门限值。Determining that the network delay absolute value is greater than or equal to the abnormal threshold.
  7. 如权利要求1至6任意一项所述的网络质量评估方法,其中,所述根据所述有效网络延迟值,确定网络质量,具体包括:The network quality assessment method according to any one of claims 1 to 6, wherein the determining the network quality according to the effective network delay value comprises:
    根据所述有效网络延迟值,确定所述网络探测请求的有效网络延迟平均值和/或有效网络延迟标准差;Determining an effective network delay average of the network probe request and/or an effective network delay standard deviation according to the effective network delay value;
    根据所述网络探测请求的有效网络延迟平均值和/或所述有效网络延迟标准差,确定所述网络质量。The network quality is determined based on an average of an effective network delay of the network probe request and/or the effective network delay standard deviation.
  8. 如权利要求7所述的网络质量评估方法,其中,所述网络探测请求中还携带有所述请求数据包的发送总批次,且所述发送总批次大于2;The network quality assessment method according to claim 7, wherein the network probe request further carries a total batch of the request packet, and the total batch sent is greater than two;
    所述根据所述有效网络延迟值,确定所述网络探测请求的有效网络延迟平均值和/或有效网络延迟标准差,具体为:Determining, according to the effective network delay value, an effective network delay average value of the network probe request and/or an effective network delay standard deviation, specifically:
    根据所述置信概率值,从记录的每一个批次的所有网络延迟值中选择每一个批次的有效网络延迟值;Selecting an effective network delay value for each batch from all network delay values of each batch recorded according to the confidence probability value;
    分别针对每一个批次的有效网络延迟值进行以下处理:The following processing is performed for each batch's effective network delay value:
    确定每一个批次的有效网络延迟平均值和/或有效网络延迟标准差;Determine the effective network delay average and/or effective network delay standard deviation for each batch;
    根据每一个批次的所述有效网络延迟平均值,确定所述网络探测请求的有效网络延迟平均值;Determining an average of effective network delays of the network probe request according to the average of the effective network delays of each batch;
    和/或,根据每一个批次的所述有效网络延迟标准差,确定所述网络探测请求的有效网络延迟标准差。And/or determining an effective network delay standard deviation of the network probe request based on the effective network delay standard deviation of each batch.
  9. 如权利要求1至8任意一项所述的网络质量评估方法,其中,所述根据所述置信概率值,从记录的所有所述网络延迟值中选择有效网络延迟值之前,所述网络质量评估方法还包括:The network quality evaluation method according to any one of claims 1 to 8, wherein said network quality evaluation is performed before selecting an effective network delay value from all of said recorded network delay values according to said confidence probability value The method also includes:
    确定所述网络探测请求的丢包率满足预设的正常丢包率;Determining that the packet loss rate of the network probe request meets a preset normal packet loss rate;
    其中,所述丢包率根据所述请求数据包的个数和接收到的所述响应数据包 的个数确定。The packet loss rate is determined according to the number of the request data packets and the number of the received response data packets.
  10. 如权利要求1至9任意一项所述的网络质量评估方法,其中,所述网络探测请求为ICMP的回显应答请求。The network quality assessment method according to any one of claims 1 to 9, wherein the network probe request is an echo reply request of an ICMP.
  11. 一种网络质量评估装置,包括:A network quality assessment device comprising:
    发送模块,用于发起网络探测请求;其中,所述网络探测请求中携带有置信概率值和至少一个请求数据包;a sending module, configured to initiate a network probe request, where the network probe request carries a confidence probability value and at least one request data packet;
    接收模块,用于接收网络节点根据每一个所述请求数据包作出的响应数据包;a receiving module, configured to receive, by the network node, a response data packet according to each of the request data packets;
    记录模块,用于记录收到所述响应数据包时的网络延迟值;a recording module, configured to record a network delay value when the response packet is received;
    选择模块,用于根据所述置信概率值,从记录的所有所述网络延迟值中选择有效网络延迟值;a selecting module, configured to select an effective network delay value from all the network delay values recorded according to the confidence probability value;
    确定模块,用于根据所述有效网络延迟值,确定网络质量。And a determining module, configured to determine a network quality according to the effective network delay value.
  12. 一种网络检测设备,包括:A network detection device includes:
    至少一个处理器;以及,At least one processor; and,
    与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein
    所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1至10任意一项所述的网络质量评估方法。The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 10. Network quality assessment method.
  13. 一种可读存储介质,其中,所述可读存储介质为计算机可读存储介质;A readable storage medium, wherein the readable storage medium is a computer readable storage medium;
    所述计算机可读存储介质存储有计算机指令,所述计算机指令用于使所述计算机执行权利要求1至10任意一项所述的网络质量评估方法。The computer readable storage medium stores computer instructions for causing the computer to perform the network quality assessment method of any one of claims 1 to 10.
PCT/CN2018/076473 2018-02-12 2018-02-12 Network quality evaluation method and apparatus, network detection device, and readable storage medium WO2019153337A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/076473 WO2019153337A1 (en) 2018-02-12 2018-02-12 Network quality evaluation method and apparatus, network detection device, and readable storage medium
CN201880001299.9A CN108886479B (en) 2018-02-12 2018-02-12 Network quality evaluation method and device, network detection equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/076473 WO2019153337A1 (en) 2018-02-12 2018-02-12 Network quality evaluation method and apparatus, network detection device, and readable storage medium

Publications (1)

Publication Number Publication Date
WO2019153337A1 true WO2019153337A1 (en) 2019-08-15

Family

ID=64325026

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/076473 WO2019153337A1 (en) 2018-02-12 2018-02-12 Network quality evaluation method and apparatus, network detection device, and readable storage medium

Country Status (2)

Country Link
CN (1) CN108886479B (en)
WO (1) WO2019153337A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111817911A (en) * 2020-06-23 2020-10-23 腾讯科技(深圳)有限公司 Method and device for detecting network quality, computing equipment and storage medium
CN112596985A (en) * 2020-12-30 2021-04-02 绿盟科技集团股份有限公司 IT asset detection method, device, equipment and medium
CN112804743A (en) * 2021-01-05 2021-05-14 上海艾策通讯科技股份有限公司 Self-adaptive adjusting method for gateway AP transmitting power, storage medium and gateway equipment
CN114006845A (en) * 2020-07-14 2022-02-01 芜湖美的厨卫电器制造有限公司 Control method and control device for household appliance, household appliance and storage medium
CN114172830A (en) * 2021-10-28 2022-03-11 阿里巴巴(中国)有限公司 Network delay detection method, device and system
CN114286402A (en) * 2021-06-16 2022-04-05 荣耀终端有限公司 Channel switching method, electronic device and storage medium
CN114584485A (en) * 2022-01-30 2022-06-03 阿里巴巴(中国)有限公司 Method, device, equipment and computer readable storage medium for detecting edge network quality
CN114615178A (en) * 2022-03-16 2022-06-10 北京轻网科技有限公司 Link quality detection method and device
CN115134277A (en) * 2022-06-24 2022-09-30 山东信通电子股份有限公司 Broadband network rate testing method and equipment for dynamically adjusting network connection number
CN115134274A (en) * 2022-05-19 2022-09-30 赛尔网络有限公司 Network speed measuring method and device, electronic equipment and storage medium
CN116016257A (en) * 2023-01-28 2023-04-25 鹏城实验室 State monitoring method, device, equipment and storage medium

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110601874B (en) * 2019-08-14 2022-06-17 深圳壹账通智能科技有限公司 Block chain deployment method, device, computer equipment and storage medium
CN110677319B (en) * 2019-08-23 2021-03-23 北京邮电大学 End-to-end time delay measuring method and device
CN110636339B (en) * 2019-09-30 2022-11-15 北京字节跳动网络技术有限公司 Scheduling method and device based on code rate and electronic equipment
CN112788265B (en) * 2019-11-11 2024-02-02 浙江宇视科技有限公司 Video data storage method and device, image acquisition equipment and readable storage medium
CN111464374B (en) * 2020-02-21 2021-09-21 中国电子技术标准化研究院 Network delay control method, equipment and device
CN112073271A (en) * 2020-09-24 2020-12-11 杭州迪普科技股份有限公司 Network delay measuring method, device, equipment and medium
CN112511454A (en) * 2020-10-14 2021-03-16 网宿科技股份有限公司 Method, system and device for detecting network quality
CN112566170B (en) * 2020-11-25 2022-07-29 中移(杭州)信息技术有限公司 Network quality evaluation method, device, server and storage medium
CN112954765B (en) * 2021-02-24 2022-12-09 四川速宝网络科技有限公司 Dynamic operator routing method based on network state monitoring
CN114143226B (en) * 2021-12-06 2024-01-19 上海沄熹科技有限公司 Dynamic cost calibration method and system for distributed database network delay
CN115473871B (en) * 2022-09-19 2023-08-04 广州市百果园网络科技有限公司 Domain name local resolution method and device, equipment, medium and product thereof

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104935446A (en) * 2014-03-17 2015-09-23 华为技术有限公司 Network quality assessment method and device based on credibility mining
CN105827473A (en) * 2015-01-06 2016-08-03 中国移动通信集团江苏有限公司 Method and device for network quality evaluation

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101483547B (en) * 2009-02-12 2011-05-11 中国人民解放军信息工程大学 Evaluation method and system for network burst affair
WO2010118255A2 (en) * 2009-04-08 2010-10-14 The University Of North Carolina At Chapel Hill Methods, systems, and computer program products for network server performance anomaly detection
CN105471878B (en) * 2015-12-03 2018-10-30 西安交通大学 Intelligence instrument malicious code injects detection method in the advanced measurement system of intelligent grid
CN106961366B (en) * 2017-05-15 2020-03-31 重庆邮电大学 Network performance comprehensive test evaluation analysis method oriented to Internet of vehicles environment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104935446A (en) * 2014-03-17 2015-09-23 华为技术有限公司 Network quality assessment method and device based on credibility mining
CN105827473A (en) * 2015-01-06 2016-08-03 中国移动通信集团江苏有限公司 Method and device for network quality evaluation

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111817911A (en) * 2020-06-23 2020-10-23 腾讯科技(深圳)有限公司 Method and device for detecting network quality, computing equipment and storage medium
CN111817911B (en) * 2020-06-23 2023-08-08 腾讯科技(深圳)有限公司 Method, device, computing equipment and storage medium for detecting network quality
CN114006845A (en) * 2020-07-14 2022-02-01 芜湖美的厨卫电器制造有限公司 Control method and control device for household appliance, household appliance and storage medium
CN112596985A (en) * 2020-12-30 2021-04-02 绿盟科技集团股份有限公司 IT asset detection method, device, equipment and medium
CN112596985B (en) * 2020-12-30 2023-11-10 绿盟科技集团股份有限公司 IT asset detection method, device, equipment and medium
CN112804743A (en) * 2021-01-05 2021-05-14 上海艾策通讯科技股份有限公司 Self-adaptive adjusting method for gateway AP transmitting power, storage medium and gateway equipment
CN114286402B (en) * 2021-06-16 2022-11-22 荣耀终端有限公司 Channel switching method, electronic device and storage medium
CN114286402A (en) * 2021-06-16 2022-04-05 荣耀终端有限公司 Channel switching method, electronic device and storage medium
CN114172830B (en) * 2021-10-28 2023-12-12 阿里巴巴(中国)有限公司 Network delay detection method, device and system
CN114172830A (en) * 2021-10-28 2022-03-11 阿里巴巴(中国)有限公司 Network delay detection method, device and system
CN114584485A (en) * 2022-01-30 2022-06-03 阿里巴巴(中国)有限公司 Method, device, equipment and computer readable storage medium for detecting edge network quality
CN114584485B (en) * 2022-01-30 2023-10-31 阿里巴巴(中国)有限公司 Method, apparatus, device and computer readable storage medium for detecting edge network quality
CN114615178A (en) * 2022-03-16 2022-06-10 北京轻网科技有限公司 Link quality detection method and device
CN114615178B (en) * 2022-03-16 2024-02-13 北京轻网科技股份有限公司 Link quality detection method and device
CN115134274B (en) * 2022-05-19 2023-08-22 赛尔网络有限公司 Network speed measuring method and device, electronic equipment and storage medium
CN115134274A (en) * 2022-05-19 2022-09-30 赛尔网络有限公司 Network speed measuring method and device, electronic equipment and storage medium
CN115134277B (en) * 2022-06-24 2023-10-20 山东信通电子股份有限公司 Broadband network rate testing method and device capable of dynamically adjusting network connection number
CN115134277A (en) * 2022-06-24 2022-09-30 山东信通电子股份有限公司 Broadband network rate testing method and equipment for dynamically adjusting network connection number
CN116016257A (en) * 2023-01-28 2023-04-25 鹏城实验室 State monitoring method, device, equipment and storage medium
CN116016257B (en) * 2023-01-28 2023-06-20 鹏城实验室 State monitoring method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN108886479B (en) 2022-04-22
CN108886479A (en) 2018-11-23

Similar Documents

Publication Publication Date Title
WO2019153337A1 (en) Network quality evaluation method and apparatus, network detection device, and readable storage medium
US9106548B2 (en) Network fault localization
US8270309B1 (en) Systems for monitoring delivery performance of a packet flow between reference nodes
US10536343B2 (en) Traffic management apparatus and traffic management method
EP3687141A1 (en) Monitoring wireless access point events
US9980163B2 (en) Admission control for allowing or rejecting a measurement request between a first and a second device
CN108259364B (en) Network congestion determination method and device
US20150256649A1 (en) Identification apparatus and identification method
US10404611B2 (en) Discovering path maximum transmission unit
CN116545936B (en) Congestion control method, system, device, communication equipment and storage medium
CN112653634A (en) Flow control method, device, equipment and readable storage medium
WO2017055225A1 (en) Analysis of network performance
JP5862811B1 (en) Evaluation apparatus, evaluation method, and program
Gebert et al. Performance modeling of softwarized network functions using discrete-time analysis
US20160285730A1 (en) Apparatus and method for measuring a bandwidth for data transmission between communication devices
CN110380981B (en) Flow distribution method and equipment
US10003524B2 (en) Routing loop determining method and device
CN112367311B (en) DDoS attack detection method, device, equipment and storage medium
US11444880B2 (en) Traffic control method and related apparatus
WO2021149182A1 (en) Traffic application amount calculation device, traffic application amount calculation method, and traffic application amount calculation program
CN108833276B (en) Method and device for determining preferred path and server
CN114520784A (en) Dynamic content accelerated access method and device
Kang et al. Imr-pathload: Robust available bandwidth estimation under end-host interrupt delay
CN113676369B (en) Network quality analysis method, data receiving server and storage medium
JP7315099B2 (en) Connection count measurement device, connection state detection device, connection state detection method, and connection count measurement program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18905368

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18905368

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/01/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18905368

Country of ref document: EP

Kind code of ref document: A1