CN113259194A - Network quality comprehensive evaluation method based on customer use experience - Google Patents
Network quality comprehensive evaluation method based on customer use experience Download PDFInfo
- Publication number
- CN113259194A CN113259194A CN202110476269.7A CN202110476269A CN113259194A CN 113259194 A CN113259194 A CN 113259194A CN 202110476269 A CN202110476269 A CN 202110476269A CN 113259194 A CN113259194 A CN 113259194A
- Authority
- CN
- China
- Prior art keywords
- calculating
- domain name
- experience
- time
- quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/145—Network analysis or design involving simulating, designing, planning or modelling of a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
Abstract
The invention relates to the technical field of data network resource quality evaluation, and discloses a network quality comprehensive evaluation method based on customer use experience, which comprises the following steps of: selecting domain name resources to be tested, carrying out simulated user dial testing on different resources according to a specific time interval, and acquiring a subentry quality index: calculating quality parameters influencing personal use experience according to the dial-up original data; calculating the total score: and calculating user experience indexes including three dimensions of downloading speed, time and success rate according to the returned original data, and calculating the user experience indexes of each domain name to uniformly calculate a total score. According to the network quality comprehensive evaluation method based on the customer experience, an evaluation model for adjusting the parameter weights according to the user experience can be provided through calculating the total score, different parameter weights can be adjusted dynamically according to different types of websites, and the user experience can be reflected more effectively.
Description
Technical Field
The invention relates to the technical field of data network resource quality evaluation, in particular to a network quality comprehensive evaluation method based on customer use experience.
Background
In the prior art, resource quality is measured by dial one by one, and the URL on which line has the best quality is judged by sorting all parameters of the same URL dial measurement result in different lines, such as download speed, opening time, success rate and the like. However, in practical cases, even though the parameters of the same URL in different lines are not necessarily changed in the same direction, for example, there may be a case where the download speed of the a line is better than that of the B line, but the open time and success rate of the a line are lower than those of the B line. Under the condition, how to quantify the influence of each parameter, how to quickly and consistently quickly evaluate the quality and the quality of the URL on different lines, and carrying out network resource debugging on the basis of the quality and the quality.
The existing testing mode can not show the intuitive feeling of the user to the link quality, and has complex judging flow and is inconvenient to realize the programmed automatic scheduling function.
Disclosure of Invention
Technical problem to be solved
Aiming at the defects of the prior art, the invention provides a network quality comprehensive evaluation method based on customer use experience, which has the advantages of quantifying visual feelings of users for different link qualities and the like, and solves the problems provided in the background art.
(II) technical scheme
In order to achieve the purpose, the invention provides the following technical scheme:
another technical problem to be solved by the present invention is to provide a network quality comprehensive assessment method based on customer experience, which includes the following steps:
1) collecting dial testing data: selecting domain name resources to be tested, carrying out dial testing on different resources according to a specific time interval, and taking dial testing values as original data sources to be put into a database.
2) Acquiring the branch quality indexes: calculating quality parameters influencing personal use experience according to dial-testing original data, acquiring log records by using a Webdriver, counting domain names, IPs, loading time, sizes and HTTP (hyper text transport protocol) return values of all loading elements, and accumulating the sizes of all loading elements to serve as total downloading amount of a website; the number of elements with HTTP return values of 200 series and 300 series is used as the number of elements successfully opened by the website.
3) And calculating the total score.
4) And (3) domain name flow preferential scheduling: and dredging the flow accurate to the domain name/element level according to the quality of the total score of each domain name.
Preferably, the dial testing data acquisition comprises establishing a dial testing domain name library, classifying dial testing domain name tasks and executing dial testing lines, wherein the number of the dial testing lines is set according to actual conditions.
Preferably, the subentry quality indexes include connection time, first byte delay, first screen time, downloading speed, website element success rate and website opening success rate.
Preferably, in the total score calculation process, the average value of each dial measurement parameter in 24 hours is used as a calculation reference, and the dial measurement period is set according to actual requirements.
Preferably, in the total score process, a normalization model is used for flattening parameters with different dimensions, and the contrast ratio of each parameter is compressed within a range of [0,1 ].
(III) advantageous effects
Compared with the prior art, the invention provides a network quality comprehensive evaluation method based on customer use experience, which has the following beneficial effects:
1. according to the network quality comprehensive evaluation method based on the customer experience, an evaluation model for adjusting the parameter weights according to the user experience can be provided through calculating the total score, different parameter weights can be adjusted dynamically according to different types of websites, and the user experience can be reflected more effectively.
2. The network quality comprehensive evaluation method based on the customer experience can be used for directly evaluating the quality of the corresponding outlet resource by calculating the total score, can be connected with an automatic flow grooming system, and is convenient for realizing automatic flow analysis grooming of automatic dial testing, automatic analysis and automatic grooming.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Step one, dial testing data acquisition: selecting domain name resources to be tested, carrying out dial testing on different resources according to a specific time interval, and taking dial testing values as original data sources to be put into a database;
step two, acquiring the subentry quality indexes: calculating quality parameters influencing personal use experience according to dial-testing original data, acquiring log records by using a Webdriver, counting domain names, IPs, loading time, sizes and HTTP (hyper text transport protocol) return values of all loading elements, and accumulating the sizes of all loading elements to serve as total downloading amount of a website; taking the number of elements with HTTP return values of 200 series and 300 series as the number of elements successfully opened by the website;
step three, calculating the total score: calculating user experience indexes including three dimensions of downloading speed, time and success rate according to the returned original data, calculating the user experience indexes of each domain name to uniformly calculate a total score for expressing the quality of the whole domain name, wherein the specific calculation mode is as follows:
1) and calculating the average value of each parameter in 24 hours, wherein the calculation formula is as follows:
the connection time a calculated at the time a is, on average, (connection time (a-23) +
The first node response time a calculated at the time a is, on average, (first node response time (a-23) +. +. + first node response time (a-1) + first node response time a)/24
The first screen time a calculated by the participation time a is (first screen time (a-23) +. + -.. + -. first screen time (a-1) + first screen time a)/24 on average
Total time a calculated as participating in time a is, on average, (total time (a-23) +
The download speed a calculated at the participation time a is, on average, (download speed (a-23) +
The average website element success rate a calculated at the participation time a is (website element success rate (a-23) +... + -. website element success rate (a-1) + website element success rate a)/24
The website opening success rate a calculated at the participation time a is (average of the website opening success rate a-23) +
2) The difference ratio of each parameter is calculated as follows (24-hour average value of specified line)
Time partial contrast ratio (reference time-private line time)/reference time
For example, as for the connection time, the connection time section ratio (reference line connection time-dedicated line connection time)/reference line connection time, and the other time section contrast ratio calculation method is the same as the connection time section calculation method
Speed part contrast ratio (special linear speed-reference speed)/reference speed
The contrast ratio of the success ratio part is (special line success ratio-reference success ratio)/reference success ratio;
3) and calculating the scores of the items by using a normalized model, wherein the calculation formula is as follows:
partial score of download speed 24 h average speed partial contrast ratio/(1 + |24 h average speed partial contrast ratio |)
The score of the success rate part is 24 hours average success rate part contrast ratio/(1 + |24 hours average success rate part contrast ratio |)
The time partial score is 24 hours average time partial contrast ratio/(1 + |24 hours average time partial contrast ratio |);
4) and calculating the correlation among the parameters, wherein the calculation formula is as follows:
wherein r is the correlation between parameters i and j, K is the original data index set, the data sequence of the ith index is Di ═ { Di1, Di2, Di 3.. times }, wherein the average value number is i, and the correlation between the data sequences of the ith index and the jth index is rij;
5) calculating the ratio of the time part, and calculating the following formula (the calculation mode of the parameters d, e, f and g is introduced in the step 8):
time division score d (24-hour average connection time contrast ratio/(1 + | 24-hour average connection time contrast ratio |) + e (24-hour average first byte time contrast ratio/(1 + | 24-hour average first byte time contrast ratio |) + f (24-hour average first screen time contrast ratio/(1 + | 24-hour average first screen time contrast ratio |) + g (24-hour average total time contrast ratio/(1 + | 24-hour average total time contrast ratio |));
6) and calculating the success rate according to the following calculation formula:
the power score (24 hour average website element success rate contrast/(1 + |24 hour average website element success rate contrast |) + (24 hour average website success rate contrast/(1 + |24 hour average website success rate contrast |)));
7) and calculating the downloading speed according to the following calculation formula:
download speed partial score 24 hours average download rate contrast ratio/(1 + |24 hours average download rate contrast ratio |)
8) Calculating parameters according to the following calculation formula:
r' is linked-first byte-0.5 r is linked-first byte +0.5
r' first byte-first screen ═ 0.5 r first byte-first screen +0.5
r' first screen-total time-0.5 r first screen-total time +0.5
k ═ 1/(r ' join-first byte + r ' first byte-first screen + r ' first screen-total time)
d 0.2 k r' is connected to the first node
e-0.2 k r' head byte-head screen
f 0.3 k r' first screen-total time
g＝0.3*(4-d-e-f)
a ═ 0.4 × k (r ' connection-first byte + r ' first byte-first screen + r ' first screen-total time)/3
b ═ 0.3 ═ 1-k (r ' connect-first byte + r ' first byte-first screen + r ' first screen-total time)/3)
c＝0.3
9) And calculating the total score by the following calculation formula:
total score ═ a (d · (24-hour average connection time contrast ratio/(1 + | 24-hour average connection time contrast ratio |)) + e · (24-hour average first byte time contrast ratio/(1 + | 24-hour average first byte time contrast ratio |) + f · (24-hour average first screen time contrast ratio/(1 + | 24-hour average first screen time contrast ratio |) + g |) + b (24-hour average total time contrast ratio/(1 + | 24-hour average total time contrast ratio |) + c |) + b (24-hour average download rate contrast ratio/(1 + | 24-hour average download rate contrast ratio |) + c |) (24-hour average website element success ratio/(1 + | 24-hour average website element success ratio |) + ((24-hour average website success ratio/(1 + | 24-hour average website element success ratio |) + c |) +;
step four, domain name flow preferential scheduling: and dredging the flow accurate to the domain name/element level according to the quality of the total score of each domain name.
And (4) judging the standard: the smaller the time part parameter in the same domain name is, the better the corresponding network performance is, the positive value of the time part contrast ratio shows that the special line quality is better than that of the reference line, and the negative value shows the opposite; the larger the speed part parameter is, the better the corresponding network performance is, so as to judge the optimization effect.
The invention has the beneficial effects that: the evaluation model for adjusting the parameter weights according to the feelings of the user can be provided through the calculation of the total score, different parameter weights can be dynamically adjusted better according to different types of websites, the feelings of the user can be effectively reflected, the calculation of the total score can be used for directly evaluating the quality of corresponding export resources, an automatic flow grooming system can be connected, and the full-automatic flow analysis grooming of automatic dial testing, automatic analysis and automatic grooming is convenient to realize.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (5)
1. A network quality comprehensive evaluation method based on customer use experience is characterized in that: the method comprises the following steps:
1) collecting dial testing data: selecting domain name resources to be tested, carrying out dial testing on different resources according to a specific time interval, and taking dial testing values as original data sources to be put into a database.
2) Acquiring the branch quality indexes: calculating quality parameters influencing personal use experience according to dial-testing original data, acquiring log records by using a Webdriver, counting domain names, IPs, loading time, sizes and HTTP (hyper text transport protocol) return values of all loading elements, and accumulating the sizes of all loading elements to serve as total downloading amount of a website; the number of elements with HTTP return values of 200 series and 300 series is used as the number of elements successfully opened by the website.
3) Calculating the total score: and calculating user experience indexes including three dimensions of downloading speed, time and success rate according to the returned original data, and calculating the user experience indexes of each domain name to uniformly calculate a total score for expressing the quality of the whole domain name.
4) And (3) domain name flow preferential scheduling: and dredging the flow accurate to the domain name/element level according to the quality of the total score of each domain name.
2. The method for comprehensively evaluating the network quality based on the customer using experience as claimed in claim 1, wherein: the dial testing data acquisition comprises the steps of establishing a dial testing domain name library, classifying dial testing domain name tasks and executing dial testing lines, wherein the number of the dial testing lines is set according to actual conditions.
3. The method for comprehensively evaluating the network quality based on the customer using experience as claimed in claim 1, wherein: the subentry quality indexes comprise connection time, first byte time delay, first screen time, downloading speed, website element success rate and website opening success rate.
4. The method for comprehensively evaluating the network quality based on the customer using experience as claimed in claim 1, wherein: in the total score calculation process, each dial testing parameter takes the average value of 24 hours as a calculation reference, and the dial testing period is set according to actual requirements.
5. The method for comprehensively evaluating the network quality based on the customer using experience as claimed in claim 1, wherein: and flattening different dimensional parameters by using a normalization model in the total score process, and compressing the contrast ratio of each parameter in a [0,1] range.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110476269.7A CN113259194A (en) | 2021-04-29 | 2021-04-29 | Network quality comprehensive evaluation method based on customer use experience |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110476269.7A CN113259194A (en) | 2021-04-29 | 2021-04-29 | Network quality comprehensive evaluation method based on customer use experience |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113259194A true CN113259194A (en) | 2021-08-13 |
Family
ID=77223659
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110476269.7A Pending CN113259194A (en) | 2021-04-29 | 2021-04-29 | Network quality comprehensive evaluation method based on customer use experience |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259194A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792879A (en) * | 2016-12-28 | 2017-05-31 | 成都网丁科技有限公司 | A kind of active dial testing method of quality of service |
| CN106899448A (en) * | 2017-01-22 | 2017-06-27 | 中国人民解放军信息工程大学 | Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement |
| CN110635965A (en) * | 2019-08-19 | 2019-12-31 | 北京基调网络股份有限公司 | IPv6 network quality monitoring method, equipment and storage medium |
| WO2020172209A1 (en) * | 2019-02-19 | 2020-08-27 | Smartsky Networks LLC | Method and apparatus for providing network experience testing |
| CN112163783A (en) * | 2020-10-19 | 2021-01-01 | 中国移动通信集团黑龙江有限公司 | Method, device and equipment for evaluating service quality of cache resource |
-
2021
- 2021-04-29 CN CN202110476269.7A patent/CN113259194A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792879A (en) * | 2016-12-28 | 2017-05-31 | 成都网丁科技有限公司 | A kind of active dial testing method of quality of service |
| CN106899448A (en) * | 2017-01-22 | 2017-06-27 | 中国人民解放军信息工程大学 | Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement |
| WO2020172209A1 (en) * | 2019-02-19 | 2020-08-27 | Smartsky Networks LLC | Method and apparatus for providing network experience testing |
| CN110635965A (en) * | 2019-08-19 | 2019-12-31 | 北京基调网络股份有限公司 | IPv6 network quality monitoring method, equipment and storage medium |
| CN112163783A (en) * | 2020-10-19 | 2021-01-01 | 中国移动通信集团黑龙江有限公司 | Method, device and equipment for evaluating service quality of cache resource |
Non-Patent Citations (1)
| Title |
|---|
| 刘畅等: "基于网页元素的网络质量评价方法研究", 《邮电设计技术》, no. 03, 20 March 2017 (2017-03-20) * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104102875B (en) | Software service quality monitoring method and system based on weighted naive Bayes classifier | |
| CN110988422B (en) | Electricity stealing identification method and device and electronic equipment | |
| CN107832927B (en) | 10kV line variable relation evaluation method based on grey correlation analysis method | |
| CN109598534A (en) | Information determines method and device, electronic equipment and storage medium | |
| CN110276491A (en) | Bean vermicelli prediction management method, apparatus, computer equipment and storage medium | |
| CN107688589A (en) | The method and device of Database System Optimization | |
| CN107391373A (en) | Automatic performance method of testing based on AutoIT | |
| CN113392029A (en) | Comprehensive performance testing device and method for different levels of container cloud platform | |
| CN115016766A (en) | Internet and cloud computing software development method | |
| CN111881185A (en) | Data monitoring method, device, equipment and storage medium | |
| CN113259194A (en) | Network quality comprehensive evaluation method based on customer use experience | |
| Robinson | Automated analysis of simulation output data | |
| CN108924369A (en) | NPS assessment method for running, systems and management platform based on telephone poll | |
| CN112950048A (en) | National higher education system health evaluation based on fuzzy comprehensive evaluation | |
| CN110517142B (en) | Method and device for outputting policy evaluation information | |
| CN105046372A (en) | Vegetable day-to-day price predicting method and device | |
| CN115378928B (en) | Monitoring method and system based on cloud service | |
| CN109858632A (en) | A kind of method and device of threshold value | |
| CN113642209B (en) | Structure implantation fault response data acquisition and evaluation method based on digital twinning | |
| CN112632364A (en) | News propagation speed evaluation method and system | |
| CN108322346A (en) | A kind of voice quality assessment method based on machine learning | |
| CN113590608A (en) | Data stream processing-based user electricity consumption information collecting and correcting method | |
| CN114139408A (en) | Power transformer health state assessment method | |
| CN110825632A (en) | Method, system and device for testing cloud computing resource metering data and electronic equipment | |
| CN101582133A (en) | Scheme evaluating system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210813 |
|
| RJ01 | Rejection of invention patent application after publication |