WO2023095185A1 - Procédé de mesure de qualité de ligne, dispositif de mesure de qualité de ligne et programme de mesure de qualité de ligne - Google Patents

Procédé de mesure de qualité de ligne, dispositif de mesure de qualité de ligne et programme de mesure de qualité de ligne Download PDF

Info

Publication number
WO2023095185A1
WO2023095185A1 PCT/JP2021/042866 JP2021042866W WO2023095185A1 WO 2023095185 A1 WO2023095185 A1 WO 2023095185A1 JP 2021042866 W JP2021042866 W JP 2021042866W WO 2023095185 A1 WO2023095185 A1 WO 2023095185A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
line quality
measurement
program
line
Prior art date
Application number
PCT/JP2021/042866
Other languages
English (en)
Japanese (ja)
Inventor
博文 山本
Original Assignee
合同会社on flow
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 合同会社on flow filed Critical 合同会社on flow
Priority to PCT/JP2021/042866 priority Critical patent/WO2023095185A1/fr
Priority to JP2023563364A priority patent/JP7442775B2/ja
Publication of WO2023095185A1 publication Critical patent/WO2023095185A1/fr

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/04Processing captured monitoring data, e.g. for logfile generation
    • H04L43/045Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • H04L43/0829Packet loss
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays
    • H04L43/0864Round trip delays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Definitions

  • the present invention relates to a line quality measuring method, a line quality measuring system and a line quality measuring device.
  • ISP Internet Service Provider
  • line quality varies depending on the service.
  • a quality measurement service may be used (see, for example, Non-Patent Document 1).
  • MMORPG Massively Multiplayer Online Role-Playing Game
  • online games This is because, in an online game, the game progresses while communication is performed between the client and the server, so that the communication speed of the Internet affects the smoothness of the progress of the game.
  • FPS First-person shooter
  • TPS Third-person shooter
  • Non-Patent Document 1 For example, in a state in which target software is executed on a PC (Personal Computer), a user who instructs execution of measurement by executing a line quality measurement service as disclosed in Non-Patent Document 1 on the same terminal It can recognize that the measurement result is the measurement result while executing the specific software. However, such an operation is complicated, and such a fact cannot be grasped only from the information of the measurement result obtained by the measurement, so the convenience is low.
  • the present invention has been made in view of the above circumstances, and aims to simplify the measurement of line quality in the application execution state.
  • one aspect of the present invention is a line quality measuring method for measuring line quality of a network when an electronic device communicates via the network.
  • measurement communication processing for performing a certain measurement communication in the electronic device;
  • measurement result acquisition processing for obtaining a communication result of the measurement communication as a line quality measurement result;
  • running program acquisition processing for acquiring running program information indicating the running program;
  • measurement result storage processing for storing the line quality measurement result and the running program information in a storage medium in association with each other;
  • the line quality measurement display information generation processing for generating information for displaying the measurement result of the line quality and the execution state of the program in the electronic device in association with each other, based on the result and the program information being executed; .
  • FIG. 4 is a block diagram showing the functional configuration of the measurement service server according to the embodiment of the present invention.
  • FIG. It is a block diagram showing the functional configuration of the user terminal according to the embodiment of the present invention.
  • 4 is a block diagram showing the functional configuration of the line measurement application according to the embodiment of the present invention;
  • FIG. 4 is a sequence diagram showing the operation of the entire system according to the embodiment of the invention;
  • FIG. 4 is a diagram showing the GUI of the line measurement application according to the embodiment of the present invention;
  • FIG. 4 is a diagram showing contents of environment information acquired by the line measurement application according to the embodiment of the present invention according to user input;
  • FIG. 4 is a diagram showing the contents of measurement information saved by one Ping by the line measurement application according to the embodiment of the present invention;
  • FIG. 4 is a diagram showing the contents of a process list that the line measurement application according to the embodiment of the present invention refers to in process check;
  • FIG. 10 is a diagram showing the contents of process check result information stored as process check results by the line measurement application according to the embodiment of the present invention;
  • FIG. 4 is a diagram showing the GUI of the line measurement application according to the embodiment of the present invention;
  • FIG. 7 is a diagram showing the contents of measurement result summary information transmitted to the measurement service server by the line measurement application according to the embodiment of the present invention;
  • FIG. 10 is a diagram showing process check result aggregate information transmitted to the measurement service server by the line measurement application according to the embodiment of the present invention
  • FIG. 4 is a diagram showing the contents of determination rule information that the measurement service server according to the embodiment of the present invention refers to when determining an ISP
  • 4 is a flow chart showing ISP determination operation by the measurement service server according to the embodiment of the present invention
  • It is a figure which shows the example of the analysis result display screen which concerns on embodiment of this invention.
  • 4 is a flow chart showing process name information confirmation operation by the measurement service server according to the embodiment of the present invention.
  • FIG. 10 is a diagram showing an example of a list of the number of data for each application name generated in the process name confirmation operation according to the embodiment of the present invention; It is a figure which shows the example of the application execution state error report screen which concerns on embodiment of this invention. It is a figure which shows the example of the information contained in the process check result which concerns on embodiment of this invention.
  • FIG. 4 is a diagram showing the GUI of the line measurement application according to the embodiment of the present invention;
  • FIG. 4 is a diagram showing the GUI of the line measurement application according to the embodiment of the present invention;
  • 4 is a flow chart showing the operation of the improvement proposal function according to the embodiment of the present invention; It is a figure which shows the example of the factor specific information which concerns on embodiment of this invention.
  • Embodiment 1 BEST MODE FOR CARRYING OUT THE INVENTION
  • the terminal used by the user sends a ping to a specific target to measure the quality of the line, and also has a function to check the execution status of software such as games running on the terminal.
  • a circuit quality measurement system to be implemented will be described.
  • one of the gists of this embodiment is to provide a function for checking the execution status of software in a terminal used by a user.
  • FIG. 1 is a diagram showing the overall configuration of the system according to this embodiment.
  • the line quality measurement system includes a measurement service server 1, measurement target servers 2a and 2b (hereinafter collectively referred to as “measurement target servers 2"), and user terminals 3a, 3b and 3c. (hereinafter collectively referred to as "user terminal 3") are communicably connected via a wide area network A such as the Internet.
  • a wide area network A such as the Internet.
  • ISP Internet Service Provider
  • the main function of this system is to measure the quality of communication by this ISP, that is, the line quality.
  • the measurement service server 1 is a server managed by an entity that provides a line quality measurement service related to this system, and mainly collects measurement results. Offer a program.
  • the measurement target server 2 functions as a communication target that performs communication for quality measurement when line quality measurement is performed in this system.
  • the user terminal 3 is an information processing terminal such as a smart phone, a tablet, a notebook PC, a desktop PC, etc., and is an electronic device used by a user who uses this system.
  • FIG. 2 is a diagram showing the hardware configuration of information equipment such as the measurement service server 1, the measurement target server 2, and the user terminal 3 included in the system according to this embodiment.
  • the system according to this embodiment can be realized by the hardware configuration of general information processing equipment, and as shown in FIG. Memory) 30 , HDD (Hard Disk Drive) 40 and I/F 50 are connected via a bus 80 . Also, an LCD (Liquid Crystal Display) 60 and an operation unit 70 are connected to the I/F 50 .
  • LCD Liquid Crystal Display
  • the CPU 10 is computing means and controls the operation of the entire information equipment.
  • the RAM 20 is a volatile storage medium from which information can be read and written at high speed, and is used as a working area when the CPU 10 processes information.
  • the ROM 30 is a read-only non-volatile storage medium and stores programs such as firmware.
  • the HDD 40 is a nonvolatile storage medium from which information can be read and written, and stores an OS (Operating System), various control programs, application programs, and the like.
  • the I/F 50 connects and controls the bus 80 and various hardware and networks.
  • the LCD 60 is a visual user interface for the user to check the status of the information equipment.
  • the operation unit 70 is a user interface such as a keyboard, a mouse, various hardware buttons, a touch panel, etc., for the user to input information to the information equipment. Since the measurement service server 1 is operated as a server, user interfaces such as the LCD 60 and the operation unit 70 can be omitted.
  • a functional block that implements the function of each device that constitutes the line quality measurement system according to the present embodiment is configured by combining the functions of the software configured in this manner with the hardware.
  • the measurement service server 1 includes a service GUI (graphical user interface) providing unit 101, a measurement result collection unit 102, a measurement result information storage unit 103, a line type determination unit 104, and a line determination unit.
  • a service GUI graphical user interface
  • the service GUI providing unit 101 provides a GUI for the user to use the system via the user terminal 3.
  • the GUI on the user terminal 3 may be provided as a web application using JS (Java Script) or the like when the user terminal 3 accesses the measurement service server 1 via the web. provided in the form
  • the measurement result collection unit 102 receives measurement result information that is saved by executing line quality measurement in the user terminal 3 and stores it in the measurement result information storage unit 103 .
  • the line type determination unit 104 refers to the measurement result information stored in the measurement result information storage unit 103, and verifies whether or not the ISP information specified in each measurement result is correct. During the verification, the line type determination unit 104 refers to the line determination information stored in the line determination information storage unit 105 .
  • the user terminal 3 according to the present embodiment includes an OS 300, a line measurement application 310, and various applications according to the user's intended use of the user terminal 3.
  • FIG. 4 a game A application 321, a game B application 322, and a video editing application 323 are included as an example.
  • the OS 300 is basic software for operating the user terminal 3, and commonly used ones are used.
  • the line measurement application 310 is software that provides functions related to paper according to the present embodiment, and is provided by the service GUI providing unit 101 described with reference to FIG. As described above, the line measurement application 310 is provided as a web application when the user terminal 3 accesses the measurement service server 1 via the web, or is provided in the form of a software program that is downloaded and installed on the user terminal 3. be.
  • a program for realizing the line measurement application 310 is a line quality measurement program, and the user terminal 3 functions as a line quality measurement device by operating the line measurement application 310 .
  • the game A application 321, the game B application 322, and the video editing application 323 are, as their names suggest, software that provides functions such as games and video editing, and processes executed when the line measurement application 310 performs line quality measurement. It becomes the check target of the check.
  • the line measurement application 310 measures the line quality, it is important to check whether these applications are running and to save the information in a format that can be confirmed after the fact. is one.
  • the line measurement application 310 includes a measurement result display processing unit 311, a measurement result transmission processing unit 312, a line quality measurement unit 313, a measurement result information storage unit 314, an application execution state determination unit 315, and process name information.
  • a storage unit 316 is included.
  • the measurement result display processing unit 311 displays the measurement result on the display unit of the user terminal 3 based on the information stored in the measurement result information storage unit 314 through the line quality measurement process.
  • the measurement result transmission processing unit 312 collectively transmits the information stored in the measurement result information storage unit 314 to the measurement service server 1 .
  • the line quality measurement unit 313 performs line quality measurement by communicating with the measurement target server 2 based on instructions from the user who operates the user terminal 3, and stores the information obtained as a result in the measurement result information storage unit. 314 to store.
  • the application execution state determination unit 315 uses the function of the OS 300 to check the execution state of other games and applications in the user terminal 3 in response to execution of line quality measurement by the line quality measurement unit 313, and stores measurement result information. Stored in unit 314 .
  • the application execution state determination unit 315 refers to the process name information stored in the process name information storage unit 316 when checking the execution state.
  • FIG. 6 is a sequence diagram showing the operation of the entire system according to this embodiment.
  • the line measurement application 310 operates on the user terminal 3 to display the GUI.
  • the line measurement application 310 is implemented as a web application or native application as described above.
  • a program for configuring the line measurement application 310 is transmitted from the service GUI providing unit 101 to the user by the user terminal 3 accessing the measurement service server 1 via the web using the function of the web browser installed in the user terminal 3 . It is downloaded to the terminal 3 and executed on the user terminal 3 .
  • the line measurement application 310 installed in the user terminal 3 is loaded into the RAM 20 in the user terminal 3, and the CPU 10 performs calculations accordingly.
  • FIG. 7 is a diagram showing the initial screen after activation of the GUI of the line measurement application 310 according to the present embodiment.
  • input fields for inputting information about the line environment of the user and the user terminal 3 are displayed.
  • the information to be entered includes "prefecture”, "city”, “line type”, “contract line name”, “housing type”, and "protocol". These pieces of information are used as line information.
  • Line type is a column for inputting the type of line used for Internet connection, such as “optical line”, “ADSL”, “mobile carrier”, “mobile Wi-Fi”, and “cable TV”.
  • Contracted line name is a column for inputting the name of the ISP with which the user has contracted to access the Internet via the user terminal 3 and the name of the service.
  • Housing type is a field for entering the type of housing such as “detached house” or “condominium/apartment housing”.
  • "Protocol” is a column for selecting which of "IPv4" and “IPv6” is used to transmit the Ping to be transmitted when measuring the line quality.
  • these input fields can be selected from a list prepared in advance, including the option of "Other", to improve the accuracy of information, analyze information after the fact, and convenience for statistics. can improve sexuality.
  • the line quality measurement unit 313 of the line measurement application 310 converts the input information into the environmental information. and stored in the measurement result information storage unit 314 (S601). As a result, information such as that shown in FIG. 8 is temporarily stored in the measurement result information storage unit 314 as environment information during line quality measurement. Then, the line quality measurement unit 313 starts Ping transmission and response reception processing targeting the measurement target server 2 (S602).
  • the line quality measurement unit 313 uses a function provided in the OS 300 to send a ping to the measurement target server 2, and performs processing for receiving a response from the measurement target server 2, that is, a communication result, at predetermined intervals. run to That is, the line quality measurement unit 313 executes measurement communication processing and measurement result acquisition processing.
  • the transmission frequency of this Ping can be arbitrarily set according to the operation of the system, and is, for example, once per second. Also, when a plurality of measurement target servers 2 are set as destinations to which Pings are sent, the line quality measuring unit 313 sends Pings to each of the destinations.
  • the IP address of the measurement target server 2, which is the destination of the Ping transmission, is preset and stored as a parameter of the line quality measurement unit 313.
  • the line quality measurement unit 313 periodically communicates with the measurement service server 1. to update this parameter. This makes it possible to execute line quality measurement processing based on the latest information determined by the service manager.
  • the measurement service server 1 may also serve as the measurement target server 2, by using a server that actually provides an online game as the measurement target server 2, it is possible to improve the line quality in an environment that is more like a game play. measurements can be realized.
  • timing of updating the parameters is arbitrary, for example, it is the timing when the line measurement application 310 described above is executed as a program. Further, when the line measurement application 310 is realized as a web application, a program in which the latest parameters are set in the measurement service server 1 is downloaded to the user terminal 3, so updating processing of these parameters is unnecessary.
  • the line quality measurement unit 313 acquires information on "Ping value” and "packet loss".
  • the "Ping value” is the period from sending a Ping to receiving a response from the measurement target server 2, that is, a delay value. (millisecond) order.
  • Packet loss is information indicating whether or not a response to Ping has been received without any problem, that is, whether or not a packet loss has occurred (True) or not (False).
  • the line quality measurement unit 313 Since the line quality measurement unit 313 according to the present embodiment sends a Ping at a frequency of once per second, it determines timeout using a period less than that, for example, 800 ms as a threshold, and recognizes packet loss. In addition, as a method of recognizing packet loss, when a notification is returned from a router in the middle of the route to the effect that the destination IP could not be reached in response to a Ping transmission, or when the TTL (Time to Live) value becomes zero.
  • TTL Time to Live
  • the line quality measurement unit 313 that has received the response to the Ping in this way causes the measurement result information storage unit 314 to store information as shown in FIG. 9 for each Ping transmission.
  • the measurement information stored according to one Ping includes "server ID”, “client IP”, “server IP”, “connection method”, “IPv4/IPv6", "communication It contains the information of "method”, “ping value”, "packet loss” and "measurement time”.
  • “Server ID” is an identifier that primarily identifies the measurement target server 2 on the Internet.
  • “Client IP” is the global IP address of the user terminal 3 and is information that can be obtained based on the functions of the OS 300 .
  • “Server IP” is the IP address of the measurement target server 2 that has sent the Ping.
  • Connection method is information indicating whether the user terminal 3 is connected to the Internet through a wired connection or through a wireless connection such as Wi-Fi or a mobile carrier line.
  • IPv4/IPv6 is an Internet protocol selected by the user in the GUI of FIG. 7 and used when sending Ping.
  • Communication method is information indicating a protocol such as TCP (Transmission Control Protocol), UDP (User Datagram Protocol), ICMP (Internet Control Message Protocol), and indicates the protocol used when sending a Ping. Which communication method is to be used is set in advance in line quality measuring section 313, and the information is saved as "communication method” shown in FIG. "Ping value”, “packet loss”, and “measurement time” are information acquired in response to Ping transmission as described above.
  • the application execution state determination unit 315 starts checking and recording processes being executed in the user terminal 3 (S603).
  • the application execution state determination unit 315 uses the function of the OS 300 to acquire the process name being executed in the user terminal 3 every predetermined period, and obtains the process name information stored in the process name information storage unit 316 . Check against. That is, the application execution state determination unit 315 executes the executing program acquisition process.
  • FIG. 10 is a diagram showing an example of process name information stored in the process name information storage unit 316.
  • an identifier "ID" is assigned to an "application name” that is the name of a game or application whose execution state is to be checked when measuring line quality.
  • Each "application name” is associated with a "process name” corresponding to a character string obtained by a process check performed by the OS 300 function.
  • the games and applications listed in the process name information as "game A”, “game B”, and “application A” are targets for measuring line quality during execution in the system according to this embodiment. It was picked up as Accordingly, each of the listed games and applications has a nature in which the line quality of the network affects its performance, and are mainly online games such as MMORPG and online FPS. Also, this "process name" is typically a file name when each program is managed in the OS 300 as a file. That is, the process name information shown in FIG. 10 is target program specifying information in which character string information for specifying, in the user terminal 3, the target program whose execution state is to be grasped is described.
  • the process name information stored in the process name information storage unit 316 is updated to the latest information by being downloaded from the measurement service server 1 via the network.
  • the latest process name information is stored and managed by the service manager in the measurement service server 1, and the information is downloaded to the process name information storage unit 316 in the line measurement application 310 in each user terminal 3, thereby enabling the service A process name check based on the latest information defined by the administrator can be performed.
  • the update of the process name information is executed at arbitrary timing by the application execution state determination unit 315, and the timing is, for example, the timing when the line measurement application 310 is executed as a program.
  • the application execution state determination unit 315 executes a process of acquiring a process name by using the "tasklist" command. As a result, the name of the process being executed in the user terminal 3 is acquired as character string information.
  • the application execution state determination unit 315 performs a character string search using the "process name" shown in FIG. game or application is running.
  • each "application name" of the game or application determined to be in execution is associated with the time when the check was performed, and recorded as the process check result in the measurement result information storage unit 314 in the format shown in FIG. be done. That is, the line quality measurement unit 313 and the application execution state determination unit 315 are linked to execute the measurement result storage process. Also, the process check result shown in FIG. 11 is used as the program-in-execution information.
  • the process of acquiring the name of the process being executed by the above-mentioned "tasklist” command or the like is a case of collectively acquiring the process names that can be recognized by the OS 300 in the user terminal 3, or the "process name” shown in FIG. are sequentially referred to, and each "process name" is specified to obtain the determination result as to whether or not the "process name” is being executed. For example, if the number of process names that can be recognized by the OS 300 is enormous, such a procedure can complete processing more quickly.
  • the interval at which the application execution state determination unit 315 executes the process check and recording process in S603 according to the present embodiment is longer than the interval at which the line quality measurement unit 313 executes the line quality measurement process in S602. / minutes.
  • the measurement result display processing unit 311 displays the line quality measurement result on the GUI of the line measurement application 310 in real time based on the information stored in the measurement result information storage unit 314. FIG. That is, the measurement result display processing unit 311 executes display information generation processing.
  • FIG. 12 is a diagram showing a real-time screen of line quality measurement results displayed on the GUI of the line measurement application 310.
  • FIG. 12 As shown in FIG. 12, on the real-time screen of the measurement results, "Ping value”, "packet loss” and “jitter” are selected and switched.
  • the Ping values obtained by the measurement are displayed in chronological order as a line graph as shown in FIG.
  • the Ping values for a plurality of measurement target servers 2 are displayed using different line types, solid lines and dashed lines.
  • the “jitter” is the amount of fluctuation in the “Ping value” of measurement information that is continuous in time series. Each time, the “jitter value” is calculated by calculating the difference between the "Ping value” in the newly stored measurement information and the "Ping value” in the previous measurement information.
  • the execution state of the game or application is reflected and displayed based on the process check results obtained at each measurement timing.
  • the example of FIG. 12 shows that "game A", whose process name was confirmed at timing t1 , continued to be executed until timing t2 .
  • the application execution state determination unit 315 performs process checks at a frequency of once per minute, and stores the information shown in FIG. 11 in the measurement result information storage unit 314. Then, when the same "application name" is in the running state at consecutive timings, the measurement result display processing unit 311 assumes that the game or application of that "application name” is in the running state continuously during that time. Generates execution status display information as shown in .
  • the process name of the software program executed in the user terminal 3 that sends Pings is checked, and information such as that shown in FIG. 11 is saved at a predetermined frequency.
  • FIG. 12 it is possible to display the measurement result of the line quality for the user terminal 3 to access the Internet and the execution state of the game or application in the user terminal 3 in chronological order.
  • the process of transmitting measurement result information to the measurement service server 1 every predetermined period is started (S604).
  • the interval at which the measurement result transmission processing unit 312 transmits the measurement result information in S604 according to the present embodiment is longer than the interval at which the application execution state determination unit 315 executes the process check processing in S603. be.
  • FIG. 13 is a diagram showing the contents of measurement result total information obtained by totaling the measurement result information shown in FIG.
  • the measurement result summary information includes "average Ping value”, “average jitter value”, “average packet loss rate”, “number of pings”, “number of packet losses”, “ping Includes information that aggregates measurement results such as “total value”, “total jitter value”, “aggregation start time”, “aggregation end time”, and “measurement time”.
  • the measurement result summary information also includes a "data ID” that uniquely identifies individual data.
  • Average Ping value is the average value of the “Ping values” shown in FIG.
  • the “average jitter value” is the average value of the blurring width of the “Ping values” of the continuous time-series measurement information.
  • Average packet loss rate is the packet loss rate of all measurement information to be aggregated.
  • the “number of pings” is as the name suggests, and is equal to the number of pieces of measurement information to be counted.
  • the "packet loss count” is the number of pieces of data whose “packet loss” is “True” in the measurement information to be aggregated.
  • Ping total value is the total value of "Ping values” included in the measurement information to be aggregated.
  • “Jitter total value” is the total value of the blur width of the “Ping value” of the continuous measurement information in time series.
  • “Aggregation start time” is the earliest timing value among the “start times” of the measurement information to be aggregated.
  • “Aggregation end time” is the value of the latest timing among the “start times” of the measurement information to be aggregated.
  • the “measurement time” is the time from the “aggregation start time” to the “aggregation end time”.
  • the measurement result total information includes "server ID”, “server IP”, “client IP”, “network connection method”, “IPv4/IPv6”, “communication method”. ", "prefecture”, "city”, “housing type”, “line type”, “contract line name”. These pieces of information are the same as the information explained in FIGS. 8 and 9, and those pieces of information are copied.
  • "user ID”, "CPU manufacturer”, “CPU frequency”, “number of CPU cores”, “CPU brand name”, “PC manufacturer”, “PC model name”, “OS”, “OS version” including information such as “User ID” is a user identifier that is registered when the user who operates the user terminal 3 uses this system.
  • "CPU manufacturer”, “CPU frequency”, “number of CPU cores”, “CPU brand name”, “PC manufacturer”, “PC model name”, “OS”, and “OS version” It is information about hardware and software specifications, and can be obtained according to the functions of the OS 300 .
  • the measurement result transmission processing unit 312 transmits to the measurement service server 1 process check result aggregate information obtained by aggregating the information stored in the measurement result information storage unit 314 by the process check processing by the application execution state determination unit 315.
  • FIG. 14 is a diagram showing the contents of the process check result information transmitted in S604.
  • the process check result information according to the present embodiment is information indicating the period during which each game or application whose "application name" is specified in the process name information shown in FIG. 10 was executed on the user terminal 3, Generated for each "app name”.
  • the measurement result transmission processing unit 312 When generating the process check result information shown in FIG. 14, the measurement result transmission processing unit 312 extracts the process check result information shown in FIG. 11 stored in the measurement result information storage unit 314 for each "application name”. Then, the measurement result transmission processing unit 312 groups pieces of the extracted information in which the “time” information is continuous in time series, and sets the earliest time among the grouped pieces as the “execution start”. The information shown in FIG. 14 is generated with the time until the latest time as the "execution period”.
  • the process check result total information includes "user ID” information as shown in FIG. It corresponds to "user ID”.
  • This "user ID”, "execution start”, and "execution period” information can be used to determine which line measurement result information corresponds to the process execution status information indicated by each process check result summary information. can be discriminated.
  • data ID shown in FIG. 13 instead of "user ID” in the process check result total information, it is also possible to determine the correspondence relationship with the measurement result total information.
  • the line type determination unit 104 in the measurement service server 1 performs a line type determination process for determining the truth or falseness of the information of "contracted line name" among the information shown in FIG. 13 stored in the measurement result information storage unit 103. (S605).
  • the "contract line name” information shown in FIG. 13 is information selected by the user on the GUI shown in FIG. Therefore, the information is not necessarily correct.
  • the process of S605 is a process of confirming the authenticity of such "contracted line name" and collecting information on unknown ISPs.
  • the line type determination unit 104 refers to the line determination information stored in the line determination information storage unit 105.
  • FIG. 15 is a diagram showing the contents of line determination information according to this embodiment. As shown in FIG. 15, the line determination information according to the present embodiment is information associated with information of "determination rule", "hostname”, "Whois”, and "determination result”.
  • Determination rule is information indicating a rule for determining a determination result, and values such as "hostname”, “Whois”, and “hostname+Whois” are specified. For example, "hostname” indicates that the "judgment result” can be found if the [hostname] found based on the IP address matches.
  • "hostname” and "Whois” indicate network information obtained based on the global IP address of the user terminal 3, that is, the "client IP” shown in FIG.
  • “Determination result” is information indicating the ISP determined as a result of "determination rule”, "hostname”, and "Whois”.
  • line type determination processing by the line type determination unit 104 will be described with reference to FIG. As shown in FIG. 16, line type determination section 104 selects one piece of measurement result aggregate information stored in measurement result information storage section 103 for which determination processing has not yet been completed. [Whois] information is acquired based on the "client IP" of the selected information, that is, the source of the information, and line type determination information is retrieved based on the acquisition result (S1601).
  • the line type determination unit 104 determines based on the "client IP”. [hostname] information is acquired, and line type determination information is retrieved based on the acquisition result (S1603).
  • the line type determination unit 104 determines that the ISP related to the target measurement result summary information is an unknown ISP, Flag information indicating that the ISP is undetermined is set in the target measurement result summary information (S1605), and the process is terminated.
  • the line type determination unit 104 determines the "determination result" of the extracted record. " matches the "contracted line name" in the target measurement result summary information (S1606). If the results match (S1606/YES), the line type determination unit 104 determines that the ISP information in the target measurement result summary information is correct, adds a confirmed flag (S1607), and ends the process.
  • the line type determination unit 104 determines that the ISP information in the target measurement result total information is incorrect and sets an exclusion flag. is added (S1608), and the process ends. That is, the line type determination unit 104 executes line information determination processing. As a result of such processing, the undetermined flag, confirmed flag, or exclusion flag is added to the measurement result summary information selected as the determination target, and it is confirmed that the determination processing of FIG. 16 has ended. It becomes possible.
  • FIG. 17 is a diagram showing an example of an analysis result display screen provided by the measurement service server 1. As shown in FIG. The screen of FIG. 17 is downloaded to the user terminal 3 as web page information, for example, when the user terminal 3 accesses a specific URL (Uniform Resource Locator) provided by the measurement service server 1 via a web browser. Is displayed.
  • a specific URL Uniform Resource Locator
  • the screen shown in FIG. 17 is a function provided in advance in the measurement result display processing unit 311 of the line measurement application 310, and the information is downloaded to the user terminal 3 by accessing the measurement service server 1 in the same manner as described above. is displayed on the GUI of the line measurement application 310. Information for displaying such a screen is provided by the service GUI providing unit 101 . That is, the service GUI providing unit 101 executes the tally result display processing.
  • the analysis result display screen displays analysis results based on the measurement result total information and the process check result total information accumulated in the measurement result information storage unit 103 .
  • the service GUI providing unit 101 classifies and groups each measurement result summary information by "contracted line name", and furthermore, processes check results associated with each measurement result summary information by "data ID”. Group by "App Name” for aggregate information. Then, the service GUI providing unit 101 further averages the data grouped in this way, that is, the "average Ping value", the "average jitter value” and the "average packet loss rate” included in each classification result. to generate each information shown in FIG.
  • the file name of the program for executing each game or application executed on the user terminal 3, that is, the "process name" of the process name information shown in FIG. 10, may be changed by updating the game or application. .
  • the process names do not match in the process check processing in S603, and the application execution state determination unit 315 cannot recognize the game or application being executed.
  • Such a problem is solved by updating the process name information stored in the process name information storage unit 316 by downloading the latest data from the measurement service server 1 as described above.
  • the measurement service server 1 it is necessary for the measurement service server 1 to always keep the "process name" in the process name information for downloading to the line measurement application 310 of the user terminal 3 up-to-date. The functions of the measurement service server 1 for realizing this will be described with reference to FIG.
  • FIG. 18 is a flow chart showing the operation of the measurement service server 1 to always keep the "process name" in the process name information downloaded to the line measurement application 310 of the user terminal 3 up-to-date.
  • the processing shown in FIG. 18 is executed by the measurement result collection unit 102 in the measurement service server 1.
  • FIG. 18 is a flow chart showing the operation of the measurement service server 1 to always keep the "process name" in the process name information downloaded to the line measurement application 310 of the user terminal 3 up-to-date.
  • the processing shown in FIG. 18 is executed by the measurement result collection unit 102 in the measurement service server 1.
  • FIG. 18 is a flow chart showing the operation of the measurement service server 1 to always keep the "process name" in the process name information downloaded to the line measurement application 310 of the user terminal 3 up-to-date.
  • the processing shown in FIG. 18 is executed by the measurement result collection unit 102 in the measurement service server 1.
  • FIG. 18 is a flow chart showing the operation of the measurement service server 1 to always keep the "process name" in
  • the measurement result collection unit 102 collects, within 24 hours, the process check result summary information collected as one piece of data from the group shown in FIG. 14 at a frequency of once per day. are grouped by "application name” and the number of data is counted to generate a list of the number of data for each "application name” as shown in FIG. 19 (S1801).
  • the measurement result collection unit 102 compares the "count number" for the same "application name” between the tabulated result generated in S1801 and the tabulated result generated in the previous process, i.e., the process one day ago (S1802). ). As a result, if there is no significant decrease from the "count number" in the tallied result of the day before (S1803/NO), the measurement result collection unit 102 terminates the process.
  • the measurement result collection unit 102 collects the "process number" associated with the "application name” in the process name information. It is determined that the application name may have been changed due to an update, and the application name is recorded (S1804), and the process ends.
  • the information in which the "application name" is stored in S1804 is the process name change flag list.
  • process name is periodically added to the process name change flag list, so that the administrator of the measurement service server 1 is notified that the "process name” may have been changed due to an update or the like. It is possible to grasp the "application name”.
  • the final update or addition of process name information must be manually performed by the administrator after confirming the information, but the process name change flag list enables the administrator to quickly recognize the necessity.
  • the sudden decrease determination in S1803 is made based on, for example, the ratio between the "count number” in the previous tally result and the "count number” in the current tally result. Specifically, if the "count number" in the current totalization result is 50% or less of the "count number” in the previous totalization result, it can be determined that a rapid decrease has occurred.
  • the threshold for this determination can be arbitrarily set according to the fluctuation range of the daily "count number".
  • step S603 the process name obtained from the OS 300 by the application execution state determination unit 315 using the "tasklis" command or the like does not match the "process name" of the process name information stored in the process name information storage unit 316. becomes.
  • the user operating the user terminal 3 can recognize that the execution state of the game or application is not accurately grasped.
  • the system accepts information provided by many users and performs the processing described in FIG. It is possible to collect information for grasping the new process name corresponding to the process name change flag list accumulated by.
  • FIG. 20 is a diagram showing a GUI of an application execution state error report screen for requesting update of process name information from the user terminal 3 to the measurement service server 1 .
  • the measurement result display processing unit 311 sends the character string information of all the acquired process names and the character string information input or selected in the “application name” input field shown in FIG. 20 to the measurement service server 1. Send.
  • the measurement service server 1 recognizes the game or application whose process name may have been changed by the "application name" entered or selected in the input field shown in FIG. It is possible to check the process name corresponding to the "application name" from the list of character string information, and update the process name information or add a new one. In this manner, the functions of the measurement service server 1 and line measurement application 310 described with reference to FIGS. 18 to 20 can assist the administrator in manually updating the process name information.
  • the line quality measurement system in parallel with the line quality measurement process by collecting the Ping response results in the user terminal 3, the information of the program being executed in the terminal is collected and recorded. do. This makes it possible to simplify the line quality measurement in the application execution state.
  • Embodiment 2 In the first embodiment, the "time" at which the process check was performed and the "application name” for which it was confirmed that the process was being executed, as shown in FIG. is recorded as an example. In the present embodiment, an example will be described in which information is collected not only about whether or not each process is running, but also about the influence each process has on the operating state and specifications of the user terminal 3 .
  • the application execution state determination unit 315 performs the same processing as in the first embodiment, and determines whether the process confirmed to be in the execution state is performed by the hardware in the user terminal 3. Get information about resource usage.
  • the information about the usage state of the hardware resources is, for example, information such as "CPU usage”, “memory usage”, “disk access”, and "network usage”.
  • the application execution state 5 acquires information as shown in FIG. 21 instead of information as shown in FIG.
  • the "CPU usage rate” is the rate at which the computing power of the CPU 10 in the user terminal 3 was consumed for the process indicated by the "process name” at that "time”, and the unit is ( %).
  • “Memory usage” is the amount of RAM 20 occupied in the user terminal 3 for the process indicated by "process name” at that "time”, and is indicated in units of (MB).
  • Disk access is the amount of information transferred between the user terminal 3 and the HDD 40 for the process indicated by the "process name” at that "time”, and the unit is (MB/sec).
  • the "network usage amount” is the information transfer amount of communication performed via the network in the user terminal 3 for the process indicated by the "process name” at the “time”, and the unit is (Mbps).
  • FIG. 22 is a diagram showing a real-time screen of line quality measurement results displayed on the user terminal 3 in place of FIG. 12 of the first embodiment.
  • process check results recorded as shown in FIG.
  • Information such as "CPU usage”, “memory usage”, “disk access”, “network usage” (hereafter referred to as “resource information") will be displayed according to the line quality measurement results. displayed in real time in chronological order.
  • the measurement result transmission processing unit 312 aggregates the process check results and transmits them to the measurement service server 1 as shown in FIG. 14, but the measurement result transmission processing unit 312 according to this embodiment As shown in FIG. 21, the acquired process check results are transmitted to the measurement service server 1 as they are without being aggregated. As a result, in the measurement service server 1 as well as in the user terminal 3, information indicating time-series changes in resource information is stored. Therefore, as described with reference to FIG. 17, it is possible to display chronological changes in resource information in each cell in the line quality measurement results displayed in a matrix of ISPs and running games and applications. .
  • FIG. 23 is a diagram showing an example of such a specific period resource change screen.
  • the service GUI providing unit 101 When generating information for displaying the specific period resource change screen, the service GUI providing unit 101 first receives an operation by the user to designate one of the cells included in the analysis result display screen shown in FIG.
  • the period of the measurement result aggregated information that is the object of aggregation for displaying the analysis result display screen, that is, the earliest of the "aggregation start time" and the latest of the "aggregation end time” shown in FIG. is acquired, this is reflected in the display of "*year*month*day to *year*month*day" shown in FIG.
  • the service GUI providing unit 101 acquires the "contracted line name" of the measurement result aggregation information to be aggregated in the cell specified by the user. This is reflected in the display of " ⁇ Internet" shown in FIG.
  • the service GUI providing unit 101 extracts the "aggregation start time", the “aggregation end time” and the “user ID” for each piece of measurement result aggregate information that is aggregated in the cell specified by the user. In addition to narrowing down the collected process check results with the "process name" of the application name corresponding to the cell specified by the user as the condition, extract the information of the process check results to be aggregated. Based on the process check results thus extracted, the service GUI providing unit 101 generates display information in the same manner as in FIG.
  • the measurement service server 1 collects process check result information from a plurality of user terminals 3, there may be multiple pieces of information indicating the same "time". In such a case, the service GUI providing unit 101 calculates an average value of a plurality of data and generates values at respective timings. Such processing makes it possible to provide quantitative analysis results based on a larger number of samples.
  • the line quality measurement system analyzes the process check results collected at the user terminal 3 as shown in FIG. becomes.
  • the improvement proposal function according to this embodiment will be described with reference to FIG.
  • FIG. 24 is a flowchart showing the operation of the improvement proposal function according to this embodiment.
  • the operation shown in FIG. 24 is started according to the operation of S602 described with reference to FIG.
  • the line quality measuring unit 313 starts the process of S602, it monitors whether the line quality has deteriorated based on the Ping return value that is repeatedly acquired (S2401). ).
  • the conditions for the line quality measuring unit 313 to determine the deterioration of the line quality in S2401 are realized, for example, by a threshold for the amount of change in the packet loss rate or Ping value.
  • the line quality measurement unit 313 calculates the packet loss rate by calculating [the number of packet losses/the number of pings] every time the response result of Pin is obtained at a frequency of once per second. Then, when the packet loss rate obtained as a result of the calculation exceeds a predetermined threshold value, it is determined that the line quality has deteriorated.
  • the number of packets to be referred to when calculating the packet loss rate may be all Ping responses obtained after the operation of S602 is started, or a predetermined number of past Ping responses. good.
  • the number of past Pings to be calculated is, for example, 100 times, and in this case, the packet loss rate in the past 100 seconds is the object of determination.
  • the condition for judging the deterioration of the line quality is realized by a threshold for the amount of change in the Ping value.
  • the line quality measurement unit 313 determines whether the value is the minimum value or the maximum value each time the Pin response result is acquired at a frequency of once per second, and the minimum value and update the highest value.
  • line quality measuring section 313 determines that the line quality has deteriorated. Also in this case, as in the case of the packet loss rate described above, an upper limit may be set for the number of past Ping responses to be determined. Alternatively, the jitter value may be used as the determination target in S2401.
  • the application execution state determination unit 315 refers to the process check results acquired at predetermined intervals as shown in FIG. resource information for determining the state of the hardware resources of the user terminal 3 (S2402).
  • the processing of S2402 acquires a value based on the rules defined for each piece of resource information shown in FIG.
  • the rule is, for example, the highest value of "CPU usage”, “memory usage”, “disk access”, and “network usage” in the process check results for a predetermined period in the past, or the average value for the predetermined period and so on.
  • the application execution state determination unit 315 refers to the factor identification information, which is a table for determining improvements in hardware resources based on changes in the resource state.
  • the factor identification information is stored in the process name information storage unit 316 .
  • FIG. 25 is a diagram showing an example of factor identification information according to this embodiment.
  • the factor identification information according to the present embodiment includes a "determination target" indicating which resource information is to be determined in determination, a “threshold value” to be compared with the resource information, and It is information associated with a "determination result” that specifies a message to be presented to the user when the condition is met. That is, the information shown in FIG. 25 is used as judgment information for judging that the hardware environment of the user terminal 3 is insufficient.
  • a dedicated message is prepared separately assuming that the factor does not exist in the resource information such as "CPU usage rate".
  • the message is, for example, "The packet loss rate is high, but there is no problem with the hardware status of the terminal. There may be a problem with the status of the local network or the external network. Run traceroute to isolate the cause. Let's go.”
  • the measurement result display processing unit 311 displays the message on the display unit of the user terminal 3 (S2404).
  • the operation of the improvement proposal function according to the present embodiment is completed. That is, each part of the line measurement application 310 works together to execute the environment determination process.
  • the circuit cortex measurement system similar to the above, the circuit quality measurement, the execution state of the program in parallel with it, and the hardware of the user terminal 3 used for executing the program It is possible to check the resource status. In addition, it becomes possible to propose environmental improvements to the user so that each program can be executed more comfortably, thereby further improving the user's convenience.
  • each value such as "CPU usage rate” is compared with a threshold
  • the normal value of each resource information (hereinafter referred to as "normal value”) is recorded based on a lot of data, and the difference from the normal value or the rate of change can be used as a threshold. good. This makes it possible to more appropriately determine a change in the resource state that affects the deterioration of the line quality, rather than setting a threshold for the value itself.
  • the measurement service server 1 may perform similar processing based on information transmitted from the user terminal 3 to the measurement service server 1 and notify the user terminal 3 of the extracted message.
  • 1 measurement service server 2, 2a, 2b measurement target server 3, 3a, 3b user terminal 10 CPU 20 RAMs 30 ROMs 40 HDDs 50 interface 60 LCDs 70 operation unit 80 bus 101 service GUI providing unit 102 measurement result collection unit 103 measurement result information storage unit 104 line type determination unit 105 line determination information storage unit 300 OS 310 line measurement application 311 measurement result display processing unit 312 measurement result transmission processing unit 313 line quality measurement unit 314 measurement result information storage unit 315 application execution state determination unit 316 process name information storage unit 321 game A application 322 game B application 323 video editing app

Abstract

Le problème décrit par la présente invention consiste à simplifier la mesure d'une qualité de ligne dans un état d'exécution d'une application. La solution selon l'invention porte sur un processus de communication de mesure permettant d'effectuer, dans un appareil électronique, une communication de mesure qui est une communication destinée à mesurer une qualité de ligne ; un processus d'acquisition de résultat de mesure permettant d'acquérir un résultat de communication de la communication de mesure en tant que résultat de mesure de qualité de ligne ; un processus d'acquisition de programme en cours d'exécution permettant d'acquérir des informations de programme en cours d'exécution qui indiquent un programme en cours d'exécution dans l'appareil électronique, en parallèle avec la communication de mesure ; un processus de stockage de résultat de mesure permettant de stocker le résultat de mesure de qualité de ligne et les informations de programme en cours d'exécution dans un support de stockage en association les uns avec les autres ; et un processus de génération d'informations d'affichage permettant de générer des informations pour afficher un résultat de mesure de qualité de ligne et l'état d'exécution d'un programme dans l'appareil électronique en association les uns avec les autres sur la base du résultat de mesure de qualité de ligne et des informations de programme en cours d'exécution.
PCT/JP2021/042866 2021-11-23 2021-11-23 Procédé de mesure de qualité de ligne, dispositif de mesure de qualité de ligne et programme de mesure de qualité de ligne WO2023095185A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2021/042866 WO2023095185A1 (fr) 2021-11-23 2021-11-23 Procédé de mesure de qualité de ligne, dispositif de mesure de qualité de ligne et programme de mesure de qualité de ligne
JP2023563364A JP7442775B2 (ja) 2021-11-23 2021-11-23 回線品質測定方法、回線品質測定装置及び回線品質測定プログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/042866 WO2023095185A1 (fr) 2021-11-23 2021-11-23 Procédé de mesure de qualité de ligne, dispositif de mesure de qualité de ligne et programme de mesure de qualité de ligne

Publications (1)

Publication Number Publication Date
WO2023095185A1 true WO2023095185A1 (fr) 2023-06-01

Family

ID=86539082

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/042866 WO2023095185A1 (fr) 2021-11-23 2021-11-23 Procédé de mesure de qualité de ligne, dispositif de mesure de qualité de ligne et programme de mesure de qualité de ligne

Country Status (2)

Country Link
JP (1) JP7442775B2 (fr)
WO (1) WO2023095185A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002157172A (ja) * 2000-11-20 2002-05-31 Hitachi Ltd 計測情報ブローカー
JP2009037611A (ja) * 2002-04-26 2009-02-19 Ricoh Co Ltd 起動制御を行うためのプログラム
US20170223577A1 (en) * 2010-09-20 2017-08-03 Enpire Technology Development Llc Dynamic mobile application quality-of-service monitor

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005269460A (ja) 2004-03-19 2005-09-29 Intec Netcore Inc 通信品質の計測システム及び計測方法、並びに提示サーバ装置
JP2013128237A (ja) 2011-12-19 2013-06-27 Nec Casio Mobile Communications Ltd 通信システム、及び携帯端末装置の通信回線選択方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002157172A (ja) * 2000-11-20 2002-05-31 Hitachi Ltd 計測情報ブローカー
JP2009037611A (ja) * 2002-04-26 2009-02-19 Ricoh Co Ltd 起動制御を行うためのプログラム
US20170223577A1 (en) * 2010-09-20 2017-08-03 Enpire Technology Development Llc Dynamic mobile application quality-of-service monitor

Also Published As

Publication number Publication date
JP7442775B2 (ja) 2024-03-05
JPWO2023095185A1 (fr) 2023-06-01

Similar Documents

Publication Publication Date Title
US8407685B2 (en) Systems and methods for generating ordered download selections based on usage information
US20120317151A1 (en) Model-Based Method for Managing Information Derived From Network Traffic
CN110233769A (zh) 一种流量检测方法和流量检测设备
US20090299940A1 (en) Rule-based system for client-side quality-of-service tracking and reporting
EP3864516B1 (fr) Modèle reposant sur le véto pour mesurer la santé d'un produit
US20090327353A1 (en) method for measuring web site performance
KR100816503B1 (ko) Ip망에서 플로우를 이용한 트래픽 분석장치 및 그 방법
WO2021051839A1 (fr) Procédé, appareil et système de traitement de données et support de stockage
EP2817946A1 (fr) Quantification de qualité d'expérience d'utilisateur par surveillance passive
US8818927B2 (en) Method for generating rules and parameters for assessing relevance of information derived from internet traffic
US20030115316A1 (en) System and method for network usage metering
Gharakheili et al. iTeleScope: Softwarized network middle-box for real-time video telemetry and classification
US20070047438A1 (en) Identifying a transaction of interest within a network
CN107924345A (zh) 用于度量的聚合测量结果的数据存储区
CN114707850A (zh) 企业网IPv6深化部署程度监测方法及其相关设备
CN111061588A (zh) 一种定位数据库异常来源的方法及装置
EP3596884B1 (fr) Performance de réseau de communications
WO2023095185A1 (fr) Procédé de mesure de qualité de ligne, dispositif de mesure de qualité de ligne et programme de mesure de qualité de ligne
Zhang et al. Sampling bias in bittorrent measurements
JP2003005857A (ja) Webアプリケーションが動作するWebサーバを備えたサーバ計算機及びWebアプリケーションの利用時間測定方法
Uzun et al. End-to-end internet speed analysis of mobile networks with mapReduce
Torres et al. Identifying sessions to websites as an aggregation of related flows
Ibrahim et al. Comiqual: collaborative measurement of internet quality
Downey An empirical model of TCP performance
Deng Comparing ISP broadband performance using M-Lab data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21965559

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023563364

Country of ref document: JP