CN107948015B - A kind of Analysis on Quality of Service method, apparatus and network system - Google Patents
A kind of Analysis on Quality of Service method, apparatus and network system Download PDFInfo
- Publication number
- CN107948015B CN107948015B CN201711229732.8A CN201711229732A CN107948015B CN 107948015 B CN107948015 B CN 107948015B CN 201711229732 A CN201711229732 A CN 201711229732A CN 107948015 B CN107948015 B CN 107948015B
- Authority
- CN
- China
- Prior art keywords
- user
- application
- log
- service
- quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 92
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000012545 processing Methods 0.000 claims description 39
- 238000004140 cleaning Methods 0.000 claims description 22
- 238000013507 mapping Methods 0.000 claims description 17
- 238000004364 calculation method Methods 0.000 claims description 12
- 238000013481 data capture Methods 0.000 claims description 11
- 238000002360 preparation method Methods 0.000 claims description 8
- 239000000523 sample Substances 0.000 claims description 8
- 235000013399 edible fruits Nutrition 0.000 claims 1
- 238000012360 testing method Methods 0.000 abstract description 36
- 238000004891 communication Methods 0.000 abstract description 3
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Abstract
The embodiment provides a kind of Analysis on Quality of Service method, apparatus and network systems, it is related to field of communication technology, it solves in the prior art in the service quality of the method test user using testing, it is difficult to the problem of calculating service quality when each user is using broadband services in test area in detail.This method includes obtaining the real-time of user to apply data；It obtains in real time using the traffic server log and network flow NETFLOW log in data；The average flow rate for the application that user uses is determined according to traffic server log and NETFLOW log；Wherein, the type of application includes: webpage, game, video；The Analysis on Quality of Service result of user is determined according to average flow rate.The embodiment of the present invention is used to analyze service quality of the user using broadband services when.
Description
Technical field
The present invention relates to field of communication technology more particularly to a kind of Analysis on Quality of Service method, apparatus and network system.
Background technique
With the continuous development of China's Base communication, broadband is more more and more universal, and 2013 according to statistics, the broadband in China
User has had reached 1.89 hundred million；User is more, and following problem is also just more and more, and the complaint amount of user is also on
It rises；How to guarantee and monitor the behaviour in service of broadband user, improves service quality when user uses broadband services, increase user
Viscosity is that major operator waits for a problem with solution.
Currently, operator to user using broadband services when Analysis on Quality of Service generally use the method for testing to test
The networking speed of user；Pass through the internet behavior of script analog subscriber, such as browse webpage or downloading, carries out small area
Sampling, to carry out whole analysis to test area.
However, when the method using testing analyzes service quality when user uses broadband services, the standard of test result
The available guarantee of true property；But due to the actual broadband services data volume in test area be it is very huge, use the side of testing
Method is difficult to calculate each user in test area in detail and uses width when analyzing the service quality of test area user
Service quality when with business；If however according to the method for testing to test area in each user use broadband services when
Service quality is analyzed, then needs to put into more man power and materials, increase operator to user using broadband services when
Analysis on Quality of Service cost；Therefore, the method for testing is more suitable for doing sampling use.
It can be seen from the above, in the prior art in the service quality of the method test user using testing, it is difficult in detail
Calculate service quality when each user is using broadband services in test area.
Summary of the invention
The embodiment of the present invention provides a kind of Analysis on Quality of Service method, apparatus and network system, solves the prior art
In in the service quality of the method test user using testing, it is difficult to calculate each user in test area in detail and use
The problem of service quality when broadband services.
In order to achieve the above objectives, the embodiment of the present invention adopts the following technical scheme that
First aspect, the embodiment of the present invention provide a kind of Analysis on Quality of Service method, comprising: obtain answering in real time for user
Use data；It obtains in real time using the traffic server log and network flow NETFLOW log in data；According to traffic server
Log and NETFLOW log determine the average flow rate for the application that user uses；Wherein, the type of application include: webpage, game,
Video；The Analysis on Quality of Service result of user is determined according to average flow rate.
Optionally, determine that the Analysis on Quality of Service result of user includes: to search the according to average flow rate according to average flow rate
One Analysis on Quality of Service table obtains the application score of user；Wherein, first service quality analysis table includes: average flow rate and answer
With the mapping table of score；According to application score and corresponding weight is applied, calculates the service quality score of user；According to clothes
Business quality score searches second service quality analysis table, obtains the Analysis on Quality of Service result of user；Wherein, second service quality
Analytical table includes: the mapping table of service quality score and Analysis on Quality of Service result.
Optionally, according to application score and using corresponding weight, the service quality score for calculating user includes: building clothes
The calculation formula of business quality score: M=W*a+G*b+V*c；Wherein, M indicates service quality score, and W indicates applying for webpage
Point, G indicates the application score of game, and V indicates the application score of video, and a indicates the weight of webpage, and b indicates the weight of game, c
Indicate the weight of video, M ∈ [0,100], G ∈ [0,100], V ∈ [0,100], a ∈ [0,1], b ∈ [0,1], c ∈ [0,1] and a
+ b+c=1；The service quality score of user is calculated according to calculation formula.
Optionally, traffic server log includes: RADIUS log and DNS log；According to traffic server log and
NETFLOW log determines the average flow rate for the application that user uses；It include: according between application, domain name, life span TTL, detection
Every establishing traffic characteristic library with user's viscosity；RADIUS log and DNS log are counted according to traffic characteristic library and IP address
According to arrangement, intermediate file to be processed is generated；Wherein, the format of intermediate file includes: the request IP of user, at the beginning of
Between, application end time and application type；According to the information and intermediate file of NETFLOW log user, user is generated
Application it is single in detail；Wherein, using in detail singly include: the request IP of user, user, at the beginning of and end time, application
Type and flowing of access；According to the average flow rate of the application application that single determining user uses in detail.
Optionally, data preparation is carried out to RADIUS log and DNS log according to traffic characteristic library and IP address, generate to
Before the intermediate file of processing, further includes: carry out flow cleaning to RADIUS log and DNS log, wherein after flow cleaning
The format of RADIUS log includes: user name, time started, end time, uplink traffic, downlink traffic and IP address；Stream
The format of DNS log after amount cleaning includes: request IP information, Long type timestamp and request domain name.
Second aspect, the embodiment of the present invention provide a kind of Analysis on Quality of Service device, comprising: data capture unit is used
Data are applied in obtaining the real-time of user；Data capture unit was also used to obtain in real time using the traffic server day in data
Will and network flow NETFLOW log；Data processing unit, the traffic server log for being obtained according to data capture unit
The NETFLOW log obtained with data capture unit determines the average flow rate for the application that user uses；Wherein, the type packet of application
It includes: webpage, game, video；Data processing unit is also used to determine the Analysis on Quality of Service result of user according to average flow rate.
Optionally, data processing unit is specifically used for searching first service quality analysis table according to average flow rate, be used
The application score at family；Wherein, first service quality analysis table includes: the mapping table of average flow rate and application score；Data
Processing unit is also used to according to application score and applies corresponding weight, calculates the service quality score of user；Data processing list
Member is also used to search second service quality analysis table according to service quality score, obtains the Analysis on Quality of Service result of user；Its
In, second service quality analysis table includes: the mapping table of service quality score and Analysis on Quality of Service result.
Optionally, data processing unit, specifically for constructing the calculation formula of service quality score: M=W*a+G*b+V*
c；Wherein, M indicates service quality score, and W indicates the application score of webpage, and G indicates the application score of game, and V indicates video
Using score, a indicates the weight of webpage, and b indicates the weight of game, and c indicates the weight of video, M ∈ [0,100], G ∈ [0,
100], [0,100] V ∈, a ∈ [0,1], b ∈ [0,1], c ∈ [0,1] and a+b+c=1；Data processing unit is also used to basis
The service quality score of calculation formula calculating user.
Optionally, traffic server log includes: RADIUS log and DNS log；Data processing unit is specifically used for root
Traffic characteristic library is established according to application, domain name, life span TTL, probe interval and user's viscosity；Data processing unit is also used to
Data preparation is carried out to RADIUS log and DNS log according to traffic characteristic library and IP address, generates intermediate file to be processed；
Wherein, the format of intermediate file include: user request IP, at the beginning of, application end time and application
Type；Data processing unit is also used to information and intermediate file according to NETFLOW log user, generates the application of user in detail
It is single；Wherein, using singly include: in detail user, user request IP, at the beginning of and the end time, application type with
And flowing of access；Data processing unit is also used to the average flow rate according to the application application that single determining user uses in detail.
Optionally, data processing unit is also used to carry out flow cleaning to RADIUS log and DNS log, wherein flow
The format of RADIUS log after cleaning includes: user name, time started, end time, uplink traffic, downlink traffic and IP
Address；The format of DNS log after flow cleaning includes: request IP information, Long type timestamp and request domain name.
The third aspect, the embodiment of the present invention provide a kind of network system, any one clothes provided including such as second aspect
Business quality analysis apparatus.
Analysis on Quality of Service method, apparatus and network system provided in an embodiment of the present invention, pass through the real-time application of user
Traffic server log and network flow NETFLOW log in data determine user in the average flow rate of the application used；Such as:
User uses the average flow rate, and/or user of average flow rate, and/or user when webpage when carrying out game using video
When average flow rate, may thereby determine that user's corresponding average flow rate when carrying out different applications, then according to mean flow
Measure the Analysis on Quality of Service result for determining the user；Analysis on Quality of Service method provided in an embodiment of the present invention can calculate survey
Each user in examination area uses service quality when broadband services, to solve in the prior art in the side using testing
When method tests the service quality of user, it is difficult to calculate service when each user is using broadband services in test area in detail
The problem of quality.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is a kind of flow diagram for Analysis on Quality of Service method that the embodiment of the present invention provides；
Fig. 2 is a kind of another flow diagram for Analysis on Quality of Service method that the embodiment of the present invention provides；
Fig. 3 is a kind of another flow diagram for Analysis on Quality of Service method that the embodiment of the present invention provides；
Fig. 4 is a kind of another flow diagram for Analysis on Quality of Service method that the embodiment of the present invention provides；
Fig. 5 is a kind of process signal of Analysis on Quality of Service method for providing of the embodiment of the present invention in practical applications
Figure；
Fig. 6 is a kind of stream of Analysis on Quality of Service method for providing of the embodiment of the present invention flow cleaning in practical applications
Journey schematic diagram；
Fig. 7 is a kind of stream of Analysis on Quality of Service method for providing of the embodiment of the present invention data processing in practical applications
Journey schematic diagram；
Fig. 8 is a kind of structural schematic diagram for Analysis on Quality of Service device that the embodiment of the present invention provides.
Appended drawing reference:
Analysis on Quality of Service device -10；
Data capture unit -101；
Data processing unit -102.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
A kind of Analysis on Quality of Service method, apparatus and network system that the embodiment of the present invention provides rely on extra large dupp
(full name in English: Hadoop Distributed File System, referred to as: Hadoop) Data Analysis Platform, it is answered actual
It can be realized based on HADOOP distributed computing and by the mapping MAP abbreviation REDUCE of HADOOP in, it is specific real
Existing mode is as follows:
Embodiment one, the embodiment of the present invention provide a kind of Analysis on Quality of Service method, include: as shown in Figure 1
S101, the real-time using data of user is obtained.
S102, it obtains in real time using the traffic server log and network flow NETFLOW log in data.
S103, the average flow rate that the application that user uses is determined according to traffic server log and NETFLOW log；Wherein,
The type of application includes: webpage, game, video.
It should be noted that game refers to either network game or page trip, as long as by super literary in actual application
This transport protocol (full name in English: Hyper Text Transfer Protocol, referred to as: http), and have domain name access, and
The domain name feature database for bringing us into, can all be classified as game；Video refers to either video software or webpage viewing video, only
If by http, and having domain name access, and bring our domain name feature database into, it can all be classified as video.
S104, the Analysis on Quality of Service result that user is determined according to average flow rate.
Optionally, as shown in Fig. 2, determining that the Analysis on Quality of Service result of user includes: according to average according to average flow rate
Flow searches first service quality analysis table, obtains the application score of user；Wherein, first service quality analysis table includes: flat
The mapping table of equal flow and application score；According to application score and corresponding weight is applied, calculates the service quality of user
Score；Second service quality analysis table is searched according to service quality score, obtains the Analysis on Quality of Service result of user；Wherein,
Second service quality analysis table includes: the mapping table of service quality score and Analysis on Quality of Service result.
Optionally, according to application score and using corresponding weight, the service quality score for calculating user includes: building clothes
The calculation formula of business quality score: M=W*a+G*b+V*c；Wherein, M indicates service quality score, and W indicates applying for webpage
Point, G indicates the application score of game, and V indicates the application score of video, and a indicates the weight of webpage, and b indicates the weight of game, c
Indicate the weight of video, M ∈ [0,100], G ∈ [0,100], V ∈ [0,100], a ∈ [0,1], b ∈ [0,1], c ∈ [0,1] and a
+ b+c=1；The service quality score of user is calculated according to calculation formula.
It should be noted that in actual application, first service quality analysis table include: webpage average flow rate with answer
With the mapping table (as shown in table 1) of score, the average flow rate of game and the mapping table of application score are (such as 2 institute of table
Show), the average flow rate of video and the mapping table (as shown in table 3) of application score.
Model is established according to average flow rate empirical value to each classification, this is to discriminate between bandwidth；Illustratively, such as table 4
It is shown to give the mapping table of service quality score and Analysis on Quality of Service result under 100M bandwidth；For example a user is complete
The flow of its webpage is 80KBytes/s, and game is 20KBytes/s, and video is 20Kbytes；According to the meter of service quality score
Final service quality known to calculating formula is scored at 70*0.5+25*0.25+0*0.25=41.25, according to the Service Quality of the user
It measures point, the service quality of the user is poor known to contrast table 4.
Table 1
Table 2
Table 3
Table 4
Optionally, traffic server log as shown in Figure 3 include: remote customer dialing authentication service (full name in English:
Remote Authentication Dial In User Service, referred to as: RADIUS) (English is complete for log and domain name system
Claim: Domain Name System, referred to as: DNS) log；User is determined according to traffic server log and NET FLOW log
The average flow rate of the application used；Include: according to application, domain name, life span (full name in English: Time To Live, referred to as:
TTL), probe interval and user's viscosity establish traffic characteristic library；According to the agreement (English interconnected between traffic characteristic library and network
Full name: Internet Protocol, referred to as: IP) address carries out data preparation to RADIUS log and DNS log, it generates wait locate
The intermediate file of reason；Wherein, the format of intermediate file includes: the request IP of user, at the beginning of, at the end of application
Between and application type；According to the information and intermediate file of NETFLOW log user, the application for generating user is single in detail；Wherein,
Using singly include: in detail user, user request IP, at the beginning of with the end time, application type and access stream
Amount；According to the average flow rate of the application application that single determining user uses in detail.
It should be noted that parser includes two treatment processes, first is that passing through NETFLOW in actual application
Log obtains the flow service condition of one day certain port of certain IP (IP address requesting of user), such as HTTP, 80 ports
It is the flow of network application, TCP, 5014 flows applied for PPLIVE.
This process is realized by the MAPREDUCE of HADOOP.The information of user and flow information are stored in
In HDFS.Information format is as follows: first place is the information of IP, and data are every 10 minutes points, unit Bytes/s.One
A IP can generate 145 information in one day；Wherein, table 5 gives the information format of NETFLOW log.
Table 5
Network application flow be can analyze out by user in certain periods, what has been carried out in conjunction with the feature of DNS log
Using.It is illustrative: to occur the log that certain request IP requires parsing www.youku.com in DNS log, we are respectively with 1
Point, 5 points, 10 points, 15 points be interval traverses whether have the parsing to youku.com domain name again downwards, and parse IP and do not have
It changes.If meeting these conditions, being considered as user is persistently to carry out the access to the website.For different types of
Using such as video, game, webpage we relevant domain-name information and probe interval can be put into traffic characteristic library.
Traffic characteristic library is made of classification, domain name, correlation TTL, probe interval, five part of user's viscosity.Such as video class
In youku.com just have following definition: video, youku.com, 3600,1-5-10-15,5.
Classification belongs to video, and the TTL of domain name youku.com, DNS are 3600 seconds, probe interval is respectively 1 point, 5 points,
10 points, 15 points.User's viscosity refers to login after net the time, for being defaulted as 5 minutes for video class.Use MAPREDUECE
After being calculated, Final Format intermediate result as shown in table 6.IP is the request IP of user, at the beginning of date1 is application
Between, date2 be application end time, style be apply type.It is identical as IP in NETFLOW using IP in DNS, finally
Two kinds of files are attached so that IP is equal for condition, generate the intermediate file to be processed comprising flow, application.
| IP | Data1 | Data2 | Style |
| IP | Data1 | Data2 | Style |
Table 6
Another treatment process, which refers to, combines information of the information of radius user with more than, so that user,
IP, upper downtime, access application, flowing of access are together in series.To reach analysis user in one day online service condition, with
And the network speed situation used, specific analysis situation are as shown in Figure 7.
Optionally, whole to RADIUS log and DNS log progress data according to traffic characteristic library and IP address as shown in Figure 4
Reason, before generating intermediate file to be processed, further includes: flow cleaning is carried out to RADIUS log and DNS log, wherein flow
The format of RADIUS log after cleaning includes: user name, time started, end time, uplink traffic, downlink traffic and IP
Address；The format of DNS log after flow cleaning includes: request IP information, Long type timestamp and request domain name；Wherein,
Long in Long type timestamp is a data type in java language, and Long type timestamp refers to current time dative
The difference number of seconds of Lin Weizhi time.
It should be noted that in actual application: by traffic characteristic model determine one in application, can be by two
Kind implementation:
Mode one, according to DNS log, when accessing certain applications, the feature of reflected DNS log confirms certain
A application.
Mode two passes through NETFLOW log, confirms some application using fixed agreement and port numbers；It is illustrative:
Poly- power video (full name in English: PPLive Inc, referred to as: PPLive) spread defeated agreement be transmission control protocol (full name in English:
Transmission Control Protocol, referred to as: TCP), port numbers are just 5014.
Flow cleaning, which refers to, not to have influential field to remove statistics in log, and retaining or modifying influences statistical result
Field, specific algorithm is as shown in Figure 6:
Log is submitted to the Map method of Map Interface Mapper interface, is based on HADOOP distributed computing,
The parallel computation on more machines of Map method, the major function of Map method are the log informations according to input, by effective word
Section output.Map(writable key,writable value,context context)
Log output format be KEY+ t+VALUE, corresponding type be Key Value Text Input Format.
The format of DNS log: date, time, access information, request IP information, request domain-name information, request domain name feature, DNS service
Device feature.Journal format after cleaning: " request IP information+t+Long type timestamp _ request domain name "；RADIUS log
Format has 82 fields, the journal format after cleaning: " user name+the t+ time started+the t+ end time+t+ uplink traffic
+ t+ downlink traffic+t+IP "；Wherein, Key refers to unique index value；Value refers to the actual value that index value is directed toward；T be
Separator generally represents 8 null character strings.
Analysis on Quality of Service method provided in an embodiment of the present invention passes through the real-time traffic service using in data of user
Device log and network flow NETFLOW log determine user in the average flow rate of the application used；When using webpage such as: user
The average flow rate of average flow rate, and/or user when using video of average flow rate, and/or user when carrying out game, thus
It can determine user's corresponding average flow rate when carrying out different applications, the service of the user is then determined according to average flow rate
Quality analysis results；Analysis on Quality of Service method provided in an embodiment of the present invention can calculate each user in test area
Service quality when using broadband services, to solve in the prior art in the Service Quality of the method test user using testing
When amount, it is difficult to the problem of calculating service quality when each user is using broadband services in test area in detail.
Embodiment two, the embodiment of the present invention provide a kind of Analysis on Quality of Service device 10, include: as shown in Figure 8
Data capture unit 101, for obtaining the real-time using data of user.
Data capture unit 101 is also used to obtain traffic server log and the network flow applied in data in real time
NETFLOW log.
Data processing unit 102, traffic server log and data acquisition for being obtained according to data capture unit 101
The NETFLOW log that unit 101 obtains determines the average flow rate for the application that user uses；Wherein, the type of application includes: net
Page, game, video.
Data processing unit 102 is also used to determine the Analysis on Quality of Service result of user according to average flow rate.
Optionally, data processing unit 102 are specifically used for searching first service quality analysis table according to average flow rate, obtain
To the application score of user；Wherein, first service quality analysis table includes: the mapping table of average flow rate and application score；
Data processing unit 102 is also used to according to application score and applies corresponding weight, calculates the service quality score of user；Number
According to processing unit 102, it is also used to search second service quality analysis table according to service quality score, obtains the service quality of user
Analyze result；Wherein, second service quality analysis table includes: the mapping relations of service quality score and Analysis on Quality of Service result
Table.
Optionally, data processing unit 102, specifically for constructing the calculation formula of service quality score: M=W*a+G*b+
V*c；Wherein, M indicates service quality score, and W indicates the application score of webpage, and G indicates the application score of game, and V indicates video
Application score, a indicate webpage weight, b indicate game weight, c indicate video weight, M ∈ [0,100], G ∈ [0,
100], [0,100] V ∈, a ∈ [0,1], b ∈ [0,1], c ∈ [0,1] and a+b+c=1；Data processing unit 102, is also used to root
The service quality score of user is calculated according to calculation formula.
Optionally, traffic server log includes: RADIUS log and DNS log；Data processing unit 102, it is specific to use
In establishing traffic characteristic library according to application, domain name, life span TTL, probe interval and user's viscosity；Data processing unit 102,
It is also used to carry out data preparation to RADIUS log and DNS log according to traffic characteristic library and IP address, generate in be processed
Between file；Wherein, the format of intermediate file include: user request IP, at the beginning of, application end time and
The type of application；Data processing unit 102 is also used to information and intermediate file according to NETFLOW log user, generates user
Application it is single in detail；Wherein, using in detail singly include: the request IP of user, user, at the beginning of and end time, application
Type and flowing of access；Data processing unit 102 is also used to being averaged according to the application application that single determining user uses in detail
Flow.
Optionally, data processing unit 102 are also used to carry out flow cleaning to RADIUS log and DNS log, wherein
The format of RADIUS log after flow cleaning include: user name, the time started, the end time, uplink traffic, downlink traffic with
And IP address；The format of DNS log after flow cleaning includes: request IP information, Long type timestamp and request domain name.
Analysis on Quality of Service device provided in an embodiment of the present invention passes through the real-time traffic service using in data of user
Device log and network flow NETFLOW log determine user in the average flow rate of the application used；When using webpage such as: user
The average flow rate of average flow rate, and/or user when using video of average flow rate, and/or user when carrying out game, thus
It can determine user's corresponding average flow rate when carrying out different applications, the service of the user is then determined according to average flow rate
Quality analysis results；Analysis on Quality of Service method provided in an embodiment of the present invention can calculate each user in test area
Service quality when using broadband services, to solve in the prior art in the Service Quality of the method test user using testing
When amount, it is difficult to the problem of calculating service quality when each user is using broadband services in test area in detail.
The third aspect, the embodiment of the present invention provide a kind of network system, any one clothes provided including such as second aspect
Business quality analysis apparatus.
Network system provided in an embodiment of the present invention, by the real-time traffic server log using in data of user with
And network flow NETFLOW log determines user in the average flow rate of the application used；Such as: user uses mean flow when webpage
The average flow rate of average flow rate, and/or user when using video of amount, and/or user when carrying out game, so as to true
Determine user's corresponding average flow rate when carrying out different applications, the service quality point of the user is then determined according to average flow rate
Analyse result；Each user that Analysis on Quality of Service method provided in an embodiment of the present invention can calculate in test area uses wide
Service quality when with business, thus solve in the prior art in the service quality of the method test user using testing,
It is difficult to the problem of calculating service quality when each user is using broadband services in test area in detail.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (9)
1. a kind of Analysis on Quality of Service method characterized by comprising
It obtains the real-time of user and applies data；
Obtain the real-time traffic server log and network flow NETFLOW log using in data；
The average flow rate for the application that the user uses is determined according to the traffic server log and the NETFLOW log；
Wherein, the type of the application includes: webpage, game, video；
The Analysis on Quality of Service result of the user is determined according to the average flow rate；
The Analysis on Quality of Service result that the user is determined according to the average flow rate includes:
First service quality analysis table is searched according to the average flow rate, obtains the application score of the user；Wherein, described
One Analysis on Quality of Service table includes: the mapping table of average flow rate and application score；
According to the application score and the corresponding weight of the application, the service quality score of the user is calculated；
Second service quality analysis table is searched according to the service quality score, obtains the Analysis on Quality of Service knot of the user
Fruit；Wherein, the second service quality analysis table includes: the mapping relations of service quality score and Analysis on Quality of Service result
Table.
2. Analysis on Quality of Service method according to claim 1, which is characterized in that according to the application score and described answer
With corresponding weight, the service quality score for calculating the user includes:
Construct the calculation formula of the service quality score:
M=W*a+G*b+V*c；
Wherein, M indicates service quality score, and W indicates the application score of webpage, and G indicates the application score of game, and V indicates video
Application score, a indicate webpage weight, b indicate game weight, c indicate video weight, M ∈ [0,100], G ∈ [0,
100], [0,100] V ∈, a ∈ [0,1], b ∈ [0,1], c ∈ [0,1] and a+b+c=1；
The service quality score of the user is calculated according to the calculation formula.
3. Analysis on Quality of Service method according to claim 1, which is characterized in that the traffic server log includes:
RADIUS log and DNS log；
The mean flow that application that the user uses is determined according to the traffic server log and the NETFLOW log
Amount；Include:
Traffic characteristic library is established according to application, domain name, life span TTL, probe interval and user's viscosity；
Data preparation is carried out to the RADIUS log and the DNS log according to the traffic characteristic library and IP address, is generated
Intermediate file to be processed；Wherein, the format of the intermediate file includes: the request IP of user, at the beginning of, application
End time and application type；
According to the information of the NETFLOW log user and the intermediate file, the application for generating the user is single in detail；Wherein,
The application singly includes: in detail user, the request IP of user, at the beginning of and the type and visit of end time, application
Ask flow；
According to the average flow rate of the application application that single determining user uses in detail.
4. Analysis on Quality of Service method according to claim 3, which is characterized in that it is described according to the traffic characteristic library and
IP address carries out data preparation to the RADIUS log and the DNS log and also wraps before generating intermediate file to be processed
It includes:
Flow cleaning is carried out to the RADIUS log and the DNS log, wherein the RADIUS log after flow cleaning
Format include: user name, time started, end time, uplink traffic, downlink traffic and IP address；
The format of the DNS log after flow cleaning includes: request IP information, Long type timestamp and request domain name.
5. a kind of Analysis on Quality of Service device characterized by comprising
Data capture unit, for obtaining the real-time using data of user；
The data capture unit is also used to obtain the real-time traffic server log and network flow using in data
NETFLOW log；
Data processing unit, the traffic server log and the data for being obtained according to the data capture unit obtain
The NETFLOW log for taking unit to obtain determines the average flow rate for the application that the user uses；Wherein, the class of the application
Type includes: webpage, game, video；
The data processing unit is also used to determine the Analysis on Quality of Service result of the user according to the average flow rate；
The data processing unit is specifically used for searching first service quality analysis table according to the average flow rate, obtains described
The application score of user；Wherein, the first service quality analysis table includes: the mapping relations of average flow rate and application score
Table；
The data processing unit is also used to calculate the user according to the application score and the corresponding weight of the application
Service quality score；
The data processing unit is also used to search second service quality analysis table according to the service quality score, obtains institute
State the Analysis on Quality of Service result of user；Wherein, the second service quality analysis table includes: service quality score and Service Quality
The mapping table of amount analysis result.
6. Analysis on Quality of Service device according to claim 5, which is characterized in that the data processing unit, it is specific to use
In the calculation formula for constructing the service quality score:
M=W*a+G*b+V*c；
Wherein, M indicates service quality score, and W indicates the application score of webpage, and G indicates the application score of game, and V indicates video
Application score, a indicate webpage weight, b indicate game weight, c indicate video weight, M ∈ [0,100], G ∈ [0,
100], [0,100] V ∈, a ∈ [0,1], b ∈ [0,1], c ∈ [0,1] and a+b+c=1；
The data processing unit is also used to calculate the service quality score of the user according to the calculation formula.
7. Analysis on Quality of Service device according to claim 5, which is characterized in that the traffic server log includes:
RADIUS log and DNS log；
The data processing unit is specifically used for being established according to application, domain name, life span TTL, probe interval and user's viscosity
Traffic characteristic library；
The data processing unit is also used to according to the traffic characteristic library and IP address to the RADIUS log and described
DNS log carries out data preparation, generates intermediate file to be processed；Wherein, the format of the intermediate file includes: asking for user
Ask IP, at the beginning of, application end time and application type；
The data processing unit is also used to information and the intermediate file according to the NETFLOW log user, generates institute
The application for stating user is single in detail；Wherein, the application singly includes: in detail user, the request IP of user, at the beginning of and terminates
Time, the type of application and flowing of access；
The data processing unit is also used to the average flow rate according to the application application that single determining user uses in detail.
8. Analysis on Quality of Service device according to claim 7, which is characterized in that the data processing unit is also used to
Flow cleaning is carried out to the RADIUS log and the DNS log, wherein the lattice of the RADIUS log after flow cleaning
Formula includes: user name, time started, end time, uplink traffic, downlink traffic and IP address；
The format of the DNS log after flow cleaning includes: request IP information, Long type timestamp and request domain name.
9. a kind of network system, which is characterized in that including the described in any item Analysis on Quality of Service devices of such as claim 5-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711229732.8A CN107948015B (en) | 2017-11-29 | 2017-11-29 | A kind of Analysis on Quality of Service method, apparatus and network system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711229732.8A CN107948015B (en) | 2017-11-29 | 2017-11-29 | A kind of Analysis on Quality of Service method, apparatus and network system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107948015A CN107948015A (en) | 2018-04-20 |
| CN107948015B true CN107948015B (en) | 2019-03-19 |
Family
ID=61946769
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711229732.8A Active CN107948015B (en) | 2017-11-29 | 2017-11-29 | A kind of Analysis on Quality of Service method, apparatus and network system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107948015B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109327356B (en) * | 2018-11-20 | 2020-10-27 | 中国联合网络通信集团有限公司 | User portrait generation method and device |
| CN112511426B (en) * | 2019-09-16 | 2022-09-27 | 中国移动通信集团河北有限公司 | Traffic grooming method and device, computing device and storage medium for service |
| CN116471237B (en) * | 2023-06-16 | 2023-10-13 | 四川轻化工大学 | Network addiction control method based on QoS technology |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8089952B2 (en) * | 2007-08-31 | 2012-01-03 | Intelepeer, Inc. | Intelligent call routing |
| CN103906027A (en) * | 2014-03-28 | 2014-07-02 | 中国联合网络通信集团有限公司 | User value evaluation method and system based on mobile user internet surfing behaviors |
| CN104462245B (en) * | 2014-11-19 | 2017-09-05 | 南京亚信软件有限公司 | A kind of user's online preference data recognition methods |
| CN104468402B (en) * | 2014-11-24 | 2017-12-26 | 福建星网锐捷网络有限公司 | The treating method and apparatus of service quality |
| CN105871734B (en) * | 2015-01-22 | 2019-06-07 | 阿里巴巴集团控股有限公司 | The method and apparatus for obtaining local domain name system flow distribution information |
| CN105119735B (en) * | 2015-07-15 | 2018-07-06 | 百度在线网络技术（北京）有限公司 | A kind of method and apparatus for determining discharge pattern |
| CN105704483B (en) * | 2016-01-15 | 2018-06-22 | 北京市博汇科技股份有限公司 | A kind of wired interactive television service dial testing method and system |
-
2017
- 2017-11-29 CN CN201711229732.8A patent/CN107948015B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107948015A (en) | 2018-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102307123B (en) | NAT (Network Address Translation) flow identification method based on transmission layer flow characteristic | |
| US10320628B2 (en) | Confidence scoring of device reputation based on characteristic network behavior | |
| US7487508B2 (en) | System and method for reconstructing client web page accesses from captured network packets | |
| US7246101B2 (en) | Knowledge-based system and method for reconstructing client web page accesses from captured network packets | |
| US7801985B1 (en) | Data transfer for network interaction fraudulence detection | |
| CN107948015B (en) | A kind of Analysis on Quality of Service method, apparatus and network system | |
| US9729563B2 (en) | Data transfer for network interaction fraudulence detection | |
| WO2016101464A1 (en) | Quality of experience estimation method, device, terminal and server | |
| CN105337753B (en) | A kind of internet real quality monitoring method and device | |
| CN109905288A (en) | A kind of application service classification method and device | |
| CN104202418B (en) | Recommend the method and system of the content distributing network of business for content supplier | |
| CN108965011A (en) | One kind being based on intelligent gateway deep packet inspection system and analysis method | |
| CN108964967A (en) | Method and system for intelligently monitoring and analyzing CDN acceleration service | |
| Fu et al. | EtE: Passive End-to-End Internet Service Performance Monitoring. | |
| US11394687B2 (en) | Fully qualified domain name (FQDN) determination | |
| CN108512816A (en) | A kind of detection method and device that flow is kidnapped | |
| US10419351B1 (en) | System and method for extracting signatures from controlled execution of applications and application codes retrieved from an application source | |
| CN112449371B (en) | Performance evaluation method of wireless router and electronic equipment | |
| Rizothanasis et al. | Identifying user actions from HTTP (S) traffic | |
| US10164819B2 (en) | Correlating web traffic events to a web page session | |
| US10027774B2 (en) | Information on navigation behavior of web page users | |
| CN108268370B (en) | Website quality analysis method, device and system based on Referer and template library matching | |
| Uzun et al. | End-to-end internet speed analysis of mobile networks with mapReduce | |
| Saidi | Characterizing the IoT ecosystem at scale | |
| Deng et al. | Comparing Broadband ISP Performance using Big Data from M-Lab |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |