CN108268370A - Based on Referer and the matched Website quality analysis method of template library, device and system - Google Patents
Based on Referer and the matched Website quality analysis method of template library, device and system Download PDFInfo
- Publication number
- CN108268370A CN108268370A CN201611260470.7A CN201611260470A CN108268370A CN 108268370 A CN108268370 A CN 108268370A CN 201611260470 A CN201611260470 A CN 201611260470A CN 108268370 A CN108268370 A CN 108268370A
- Authority
- CN
- China
- Prior art keywords
- website
- referer
- index values
- template library
- conversation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3604—Software analysis for verifying properties of programs
- G06F11/3612—Software analysis for verifying properties of programs by runtime analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
Abstract
The embodiment of the invention discloses one kind to be based on Referer and the matched Website quality analysis method of template library, device and system.The method includes：The full dose flow obtained in link is parsed, and the access request obtained after parsing is matched with response data to obtain whole conversation recordings of all users and all websites；The conversation recording for carrying Referer fields is associated with corresponding website using Referer matching process；The conversation recording for not carrying Referer fields with static resource template library is matched using template library matching process, the above-mentioned conversation recording for not carrying Referer fields is made all to be associated with corresponding website；It scores after whole conversation recordings are associated with website each website, so that user analyzes Website quality.Whole conversation recordings can be associated with website by the embodiment of the present invention using Referer matching process and template library matching process, so as to improve the integrality of website conversation recording and accuracy.The embodiment of the present invention analyzes Website quality for user by carrying out scoring to each website.
Description
Technical field
The present embodiments relate to the network management technology fields of data service, and in particular to one kind is based on Referer and template
Website quality analysis method, the device and system of storehouse matching.
Background technology
At present, Website quality analytical plan mainstream technology includes active testing technology and passive monitoring is analyzed.Wherein, actively
Testing analysis is the related data that each website is recorded by way of pseudo-terminal testing, and above-mentioned data preparation then is gone out needs
Index；The subjective feeling of user can be obtained according to the index situation of each website.Passive monitoring analysis is by using net
The data message of network outlet, which is analyzed, analyzes the message data of website.
But during the embodiment of the present invention is realized, inventor has found：Part perceives index not when active testing is analyzed
Have generality, be affected by testing content and testing environment so that this part perceives index and fails to accurately reflect website
Quality causes analysis result to be only capable of that reference number can not be provided for fault location from the good and evil idea for macroscopically obtaining a website
According to.
During passive monitoring analysis, it is scattered due to message data and does not correspond to some websites directly, can only divides at this time
The uniform resource locator (Uniform Resource Locator, URL) of message data is analysed, then passes through Referer (HTTP
Referer is a part of header, when browser is sent to web server asks, can generally take Referer,
The Tell server request comes from which page link, server base this can obtain some information for handling) hand
Message is associated with corresponding website by section.It can be seen that passive monitoring analysis is only applicable to analyze each element or each server ip
Index of correlation (such as time delay, success rate), and can not to entire website carry out overall recognition.
Invention content
One purpose of the embodiment of the present invention be solve the prior art due to active testing analysis can not positioning failure or
The problem of passive monitoring analysis only analyzes each element and can not carry out overall recognition to website.
In a first aspect, an embodiment of the present invention provides one kind based on Referer and the matched Website quality analysis of template library
Method, the method includes：
The full dose flow obtained in link is parsed, and the access request obtained after parsing is matched with response data
To obtain whole conversation recordings of all users and all websites；
The conversation recording for carrying Referer fields is associated with corresponding website using Referer matching process；
The conversation recording of Referer fields and the progress of static resource template library will not be carried using template library matching process
Match, the above-mentioned conversation recording for not carrying Referer fields is made all to be associated with corresponding website；
It scores after whole conversation recordings are associated with website each website, so that user analyzes Website quality.
Optionally, the conversation recording and static resource that will not carry Referer fields using template library matching process
Template library is matched, the step of above-mentioned conversation recording for not carrying Referer fields is made all to be associated with corresponding website it
Before, including：
Using simulation browser timing access request is sent to each website；
The response data of above-mentioned website is obtained using network packet snapping method；
All conversation recordings of each website are formed according to access request and corresponding response data and are preserved to the website
Static resource template library in.
Optionally, it is described to include score after whole conversation recordings are associated with website each website the step of：
Obtain all KQI index values of each website；
The scoring of each website is calculated according to each KQI index values and its default weighted value；
Wherein, the KQI index values are web page browsing end-to-end delay, the end-to-end speed of web page browsing, web page browsing end
Opposite end success rate or the end-to-end percentage of head rice of web page browsing.
Optionally, described the step of scoring on the basis of whole conversation recordings each website, further includes：
Any one KQI index of all websites is obtained, and obtains KQI index values maximum or minimum corresponding website；
The KQI index values of the corresponding each HOST in the website are obtained, and it is maximum or minimum corresponding to obtain KQI index values
HOST；
The KPI index values of the corresponding each URL of the HOST are obtained, and it is maximum or minimum corresponding to obtain KPI index values
URL；
The KPI index values of the corresponding each server ips of the URL are obtained, and it is maximum or minimum corresponding to obtain KPI index values
Server ip；
Wherein, the KPI indexs are answer delay, response success rate or retransmit packet loss；
Each website includes multiple HOST, and each HOST corresponds to multiple URL, and each URL corresponds to multiple server ips.
Optionally, it is described to obtain any one KQI index of all websites, and it is maximum or minimum to obtain the KQI index values
The following contents replacement may be used in the step of corresponding website：
Selection needs the website analyzed and its any one KQI index directly from all websites.
Second aspect, the embodiment of the present invention additionally provide a kind of based on Referer and template library matched Website quality point
Analysis apparatus, described device include：
Conversation recording acquisition module, the full dose flow for obtaining in link are parsed, the access that will be obtained after parsing
Request is matched whole conversation recordings to obtain all users and all websites with response data；
Referer conversation recording relating modules, for the meeting that will carry Referer fields using Referer matching process
Words record is associated with corresponding website；
Template library conversation recording relating module, for the meeting that will not carry Referer fields using template library matching process
Words record is matched with static resource template library, and the above-mentioned conversation recording for not carrying Referer fields is made all to be associated with pair
The website answered；
Grading module, for scoring after whole conversation recordings are associated with website each website, for user couple
Website quality is analyzed.
Optionally, described device further includes static resource template library module, for performing following steps：
Using simulation browser timing access request is sent to each website；
The response data of above-mentioned website is obtained using network packet snapping method；
All conversation recordings of each website are formed according to access request and corresponding response data and are preserved to the website
Static resource template library in.
Optionally, institute's scoring module is used to perform following steps：
Obtain all KQI index values of each website；
The scoring of each website is calculated according to each KQI index values and its default weighted value；
Wherein, the KQI index values are web page browsing end-to-end delay, the end-to-end speed of web page browsing, web page browsing end
Opposite end success rate or the end-to-end percentage of head rice of web page browsing.
Optionally, institute's scoring module is additionally operable to perform following steps：
Any one KQI index of all websites is obtained, and obtains KQI index values maximum or minimum corresponding website；
The KQI index values of the corresponding each HOST in the website are obtained, and it is maximum or minimum corresponding to obtain KQI index values
HOST；
The KPI index values of the corresponding each URL of the HOST are obtained, and it is maximum or minimum corresponding to obtain KPI index values
URL；
The KPI index values of the corresponding each server ips of the URL are obtained, and it is maximum or minimum corresponding to obtain KPI index values
Server ip；
Wherein, the KPI indexs are answer delay, response success rate or retransmit packet loss；
Each website includes multiple HOST, and each HOST includes multiple URL, and each URL includes multiple server ips.
The third aspect, the embodiment of the present invention provide a kind of based on Referer and template library matched Website quality point again
Analysis system, the system comprises：Deep packet inspection device DPI and the Website quality analytical equipment as described in second aspect；It is described
DPI is communicated to connect with the Website quality analytical equipment；
The DPI settings pass through in concatenation or mirror-image fashion access link, for obtaining the full dose flow of the link
It is sent to the Website quality analytical equipment；
The parsing of full dose flow, associating websites and the website that the Website quality analytical equipment is used to obtain the link are commented
Point.
As shown from the above technical solution, the embodiment of the present invention can be obtained by the full dose flow obtained in link in the link
The access request of all users and the response data of all websites, so as to obtain whole conversation recordings of the link；Then it utilizes
The conversation recording for carrying Referer fields is associated with corresponding website by Referer matching process；Recycle template library match party
Method matches the conversation recording for not carrying Referer fields with static resource template library, makes above-mentioned not carrying Referer words
The conversation recording of section is all associated with corresponding website；Finally, scoring is carried out to each website and carries out Website quality point for user
Analysis.Compared with prior art, the embodiment of the present invention can be by whole meetings using Referer matching process and template library matching process
Words record is associated with website, so as to improve the integrality of website conversation recording and accuracy.Also, it is right that the embodiment of the present invention passes through
Each website carries out scoring and Website quality is analyzed for user.
Description of the drawings
The features and advantages of the present invention can be more clearly understood by reference to attached drawing, attached drawing is schematically without that should manage
It solves to carry out any restrictions to the present invention, in the accompanying drawings：
Fig. 1 is provided in an embodiment of the present invention a kind of based on Referer and the matched Website quality analysis method of template library
Flow diagram；
Fig. 2 is multiple website appraisal result contrast schematic diagrams of method shown in Fig. 1；
Fig. 3 is the appraisal result comparison signal of the web page browsing end-to-end time delay index of multiple websites of method shown in Fig. 1
Figure；
Fig. 4 is provided in an embodiment of the present invention a kind of based on Referer and the matched Website quality analytical equipment of template library
Structure diagram；
Fig. 5 is provided in an embodiment of the present invention a kind of based on Referer and the matched Website quality analytical equipment of template library
Structure diagram.
Specific embodiment
Purpose, technical scheme and advantage to make the embodiment of the present invention are clearer, below in conjunction with the embodiment of the present invention
In attached drawing, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
The part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
Member's all other embodiments obtained under the premise of creative work is not made, shall fall within the protection scope of the present invention.
Embodiment one
An embodiment of the present invention provides one kind based on Referer and the matched Website quality analysis method of template library, such as Fig. 1
It is shown, the method includes：
S1, the full dose flow obtained in link are parsed, and the access request obtained after parsing and response data are carried out
It matches to obtain whole conversation recordings of all users and all websites；
S2, the conversation recording for carrying Referer fields is associated with corresponding website using Referer matching process；
S3, using template library matching process by do not carry Referer fields conversation recording and static resource template library into
Row matching, makes the above-mentioned conversation recording for not carrying Referer fields all be associated with corresponding website；
S4, it scores after whole conversation recordings are associated with website each website, so that user is to Website quality point
Analysis.
In practical application, set in the embodiment of the present invention using deep-packet detection (Deep Packet Inspection, DPI)
It is standby, such as carrier class DPI equipment of the prior art, it is linked into link by concatenation or mirror-image fashion, acquires the link
Full dose flow.Wherein, full dose flow refers to the data on flows of all users in certain region.Therefore, above-mentioned DPI equipment is generally set
Put the outlet of group backbone network, tripartite interconnect outlet, save net outlet, Internet data center (Internet Data Center,
IDC) and mobile core network outlet etc. key networks position.Certainly, those skilled in the art can select according to concrete scene
The installation site of DPI equipment and the parameter of DPI equipment, the present invention are not construed as limiting.
In practical application, Referer fields refer in the embodiment of the present invention, and browser sends in access request to website and takes
Band HTTP Referer；The HTTP Referer are a parts of header, when browser is sent to web server asks
It waits, can generally take Referer, Tell server comes from which page link, and server can thereby obtain some letters
It ceases to handle.Due to the Referer fields comparative maturity, details are not described herein.
It should be noted that Website quality analysis method provided in an embodiment of the present invention can be set in server or individually
It is realized on standby computing device.It is illustrated by taking server as an example in the present invention.
In step S1, DPI equipment obtain in real time full dose flow on the link be sent to server.Server is from full dose
It is parsed in flow from the access request of browser and the response data from each website, by access request and response data
Conversation recording is formed after matching, finally obtains whole conversation recordings of all users and all websites.
In step S2, server obtains the Referer fields in every conversation recording, according to Referer fields with it is corresponding
Website be associated, until by carry Referer fields conversation recording be all associated with website until.
There are a small number of conversation recordings not carry Referer fields or taken in practical application, in whole conversation recordings
Band Referer across station calling, CDN distributions, mistake caused by due to tactful configuration error etc., server is according to the portion at this time
Divide conversation recording that can not judge which website belonged to.Whole conversation recordings can not be associated with by Referer matching process
Corresponding website, so as to which also accurately Website quality analysis can not be carried out by using these conversation recordings.
Therefore, in step S3, server by utilizing template library matching process remembers the above-mentioned session for not carrying Referer fields
Record is matched with static resource template library.When conversation recording is present in some static resource template library, then illustrate the session
Record belongs to website corresponding with the static resource template library, this conversation recording is associated with and is provided with the static state by server at this time
The corresponding website of source template library.In this way, the session that server by utilizing template library matching process will can not carry Referer fields
Record is all associated with website.
In practical application, the embodiment of the present invention before step S3 include obtain static resource template library the step of：
S31, using simulation browser timing access request is sent to each website；
S32, the response data that above-mentioned website is obtained using network packet snapping method；
S33, all conversation recordings that each website is formed according to access request and corresponding response data and preservation extremely should
In the static resource template library of website.
Server by utilizing simulation browser accesses website, sends access request to the website, then utilizes network packet capturing side
Method (prior art, details are not described herein) obtains the response data of above-mentioned website, so as to obtain all sessions of the website
Record, such as picture, advertisement, content.Server preserves all conversation recordings of above-mentioned website into static resource template library.
For example, server needs the static resource template library of Sina, then the server can timing (such as 5 minutes primary) access Sina
Then website gets all conversation recordings of Sina website, form the static resource template library of Sina website.
When server by utilizing Referer matching process is associated with, if certain conversation recording does not have Referer fields, quiet
State resource template is matched in library.If having visit conversation recording in the static resource template library, using the conversation recording as new
One element of unrestrained website, will the conversation recording be associated with Sina website.
As it can be seen that whole conversation recordings can be all associated with net using step S2 and step S3 in the embodiment of the present invention
It stands.
It should be noted that above-mentioned steps S3 can be interchanged with step S2, step S3 can be to all conversation recordings at this time
It is matched, carrying Referer fields or the conversation recording for not carrying Referer fields is associated with corresponding website.This
When step S3 include four kinds of results：(1) conversation recording is all associated with, the conversation recording of (2) part carrying Referer fields does not close
Join, the conversation recording of (3) part carrying Referer fields is not associated and (4) part does not carry or carry Referer fields
Conversation recording is not associated.
For result (1), step S2 need not be performed at this time.
For result (2), step S2 is performed at this time, until all conversation recordings are all associated with corresponding website.
For result (3), need to update static resource template library at this time, re-execute step S3.Then further according to association
As a result each scheme is gone to.
For result (4), step S2 is first carried out at this time, then performs step S3 again after the update of static resource template library,
Until all conversation recordings are associated with corresponding website.
It is same that each scheme can be added in above steps gained scheme by those skilled in the art according to concrete scene
Sample falls into the protection domain of the application.
In practical application, user using browser access website homepage SP or the website in can click through one by one
The specific link gone.But from DPI angle analysis, for user in the click each time of browser, website will generate tens very
To the conversation recording of hundreds of.For comment a website quality, need from subjective feeling and objective data to the website into
Row precisely analysis comprehensively.For this purpose, in the step S4 of the embodiment of the present invention, server is according to conversation recording and corresponding index to every
It scores a website.
When server carries out subjective feeling commentary to website in the embodiment of the present invention, Key Quality Indicator KQI may be used
Method is commented.When Key Quality Indicator KQI methods are commented, subjective feeling during by accessing website (such as open net
Whether the speed and the content of display stood are complete), formulate several indexs based on perception.Select webpage clear in the embodiment of the present invention
Look at end-to-end time delay, the end-to-end rate of web page browsing, the end-to-end success rate of web page browsing and the end-to-end percentage of head rice of web page browsing 4
KQI indexs are commented.Wherein, what web page browsing end-to-end time delay and the end-to-end rate of web page browsing reflected is to open website
Speed, whether the end-to-end success rate of web page browsing and web page browsing end-to-end percentage of head rice reflection web site contents successful and complete aobvious
Show.In practical application, the i.e. default weighted value of weighting also certain for above-mentioned 4 KQI setup measures of the embodiment of the present invention, so as to suitable
Different commentary occasions is answered to improve to the attention situation of some KQI index and comment effect.In practical application, those skilled in the art
The quantity of KQI indexs and KQI indexs can be set according to concrete scene, and the present invention is not construed as limiting.
Server obtains 4 KQI index values of each website and the default weighted value of each KQI indexs, so as to
Obtain the scoring of each website.In practical application, the scoring of each website can be 0~100 point, convenient to Website quality point
Analysis.Fig. 2 is multiple website appraisal result contrast schematic diagrams provided in an embodiment of the present invention.Referring to Fig. 2, server to Netease 163,
Sina sina, Baidu baidu, Tencent tencent, Sohu sohu and the scoring of the several common websites of Taobao taobao, and wash in a pan
The highest scoring of precious taobao is 87.32 points.I.e. user can understand the quality of each website according to above-mentioned scoring subjectivity.
Appraisal result obtained by above-mentioned Key Quality Indicator KQI methods facilitates the quality of user's understanding website, but can not
It is optimized according to the appraisal result to showing poor website.The embodiment of the present invention also uses Key Quality Indicator KQI thus
Pair method and KPI Key Performance Indicator KPI (Key Performance Indicators) method score to each website, i.e.,
Each website carries out drilling analysis.
In practical application, the homepage SP of each website is made of multiple main frames HOST, and each HOST corresponds to multiple unifications
Resource Locator (Uniform Resoure Locator, URL), each URL corresponds to multiple server ips.According to each website
The distribution of vertical level, quality analysis is carried out to a few dimension index for selection of each website in the embodiment of the present invention, i.e., according to one
The vertical level of a website carries out quality analysis, until analyze the quality of server ip, so as to be Website quality positioning and excellent
Change and decision-making foundation is provided.
When the embodiment of the present invention is to the homepage SP of website and host HOST quality analyses, using Key Quality Indicator KQI side
Method, but when being analyzed based on uniform resource position mark URL and server ip, using KPI Key Performance Indicator KPI methods.Optionally,
Above-mentioned KPI indexs can be answer delay, response success rate or retransmit packet loss.In practical application, those skilled in the art can
To set the quantity of KPI indexs and KPI indexs according to concrete scene, the present invention is not construed as limiting.
The i.e. drilling analysis that scored in the embodiment of the present invention each website includes：
S41, any one the KQI index for obtaining all websites, and obtain KQI index values maximum or minimum corresponding net
It stands；
S42, the KQI index values for obtaining the corresponding each HOST in the website, and it is maximum or minimum corresponding to obtain KQI index values
HOST；
S43, the KPI index values for obtaining the corresponding each URL of the HOST, and it is maximum or minimum corresponding to obtain KPI index values
URL；
S44, the KPI index values for obtaining the corresponding each server ips of the URL, and it is maximum or minimum to obtain KPI index values
Corresponding server ip.
First, server obtains the KQI indexs of each website and default weighted value, referring to Fig. 1.Alternatively, it directly selects
The website analyzed and its any one KQI index are needed, when selecting KQI indexs, that is, web page browsing end-to-end in the embodiment of the present invention
Prolong and analyzed.Referring to Fig. 2, in above-mentioned several websites, the web page browsing end-to-end delay (KQI index values) of Taobao taobao is
10595.96ms, minimum behaves oneself best in several websites.
The web page browsing end-to-end time delay appraisal result of more than 1 a website of table
Server of the embodiment of the present invention also scores to multiple websites with reference to some KQI index using the above method.With
In KQI indexs for web page browsing end-to-end time delay, table 1 shows the appraisal result of multiple websites.
Referring to table 1, using website worst in web page browsing end-to-end time delay in KQI indexs as east wealth eastmoney
Website, time delay value 36326.49ms.
Referring to table 2, the web page browsing of multiple HOST of east wealth eastmoney websites is obtained according to the perpendicular layers of website
End-to-end time delay value.
The web page browsing end-to-end time delay appraisal result of multiple HOST of 2 east wealth of table
It is entitled by comparison it is found that in 17 HOST of east wealth eastmoney websites
The end-to-end time delay of the HOST of " hqguba1.eastmoney.com " is maximum, time delay value 58255.66ms
Then, server by utilizing KPI Key Performance Indicator KPI methods continue to analyze to URL and server ip.Referring to table 3.
The server ip answer delay of 3 east wealth of table
As shown in Table 3, IP is the server of 140.207.213.99, and answer delay has 302.72 seconds, and normal range (NR) one
As at 0.3~1 second or so.It is possible thereby to the reason of judging, causing the east wealth website time delay larger is in this period
The server answer delay is larger.At this point, website maintenance personnel can be adjusted optimization by corresponding server to IP, so as to carry
The high Website quality.
From the foregoing, it will be observed that Referer matching process and template library matching process are utilized in the embodiment of the present invention by whole sessions
Record is associated with website, can promote the associated accuracy rate of each website conversation recording and percentage of head rice, has and Website quality is analyzed
Basis.Then subjective feeling scoring is carried out to website using KQI methods and KPI methods and/or objective data scores, allow user
The quality of each website is had a clear understanding of, can also further position and cause the basic reason of each website quality (in the embodiment of the present invention
By taking web site performance is poor as an example), optimize the Website quality so as to be adjusted to the server navigated to.
Embodiment two
Fig. 4 shows provided in an embodiment of the present invention a kind of based on Referer and the matched Website quality analysis of template library
Device, as shown in figure 4, described device includes：
Conversation recording acquisition module M1, the full dose flow for obtaining in link are parsed, the visit that will be obtained after parsing
Ask that request is matched whole conversation recordings to obtain all users and all websites with response data；
Referer conversation recording relating module M2, for using Referer matching process Referer fields will to be carried
Conversation recording is associated with corresponding website；
Template library conversation recording relating module M3, for will not carry Referer fields using template library matching process
Conversation recording is matched with static resource template library, and the above-mentioned conversation recording for not carrying Referer fields is made all to be associated with
Corresponding website；
Grading module M4, for scoring after whole conversation recordings are associated with website each website, for user
Website quality is analyzed.
It is obtained it should be noted that above-mentioned conversation recording acquisition module M1 is practical from the chain road that DPI equipment is acquired
Full dose flow, then above-mentioned full dose flow is parsed；Access request and response data are obtained in data after analytically
It is matched, so as to obtain whole conversation recordings of all users and all websites.Referer conversation recording relating modules M2 will
The conversation recording of carrying Referer fields, which will be associated with corresponding website and template library conversation recording relating module M3, not to be taken
Conversation recording with Referer fields is matched with static resource template library, makes the above-mentioned session for not carrying Referer fields
Record is all associated with corresponding website.Finally, grading module M4 comments each website using KQI methods and/or KPI methods
Point, so as to carry out quality analysis to each website or optimize positioned server ip to promote each Website quality.
In practical application, since template library conversation recording relating module M3 also needs to use static resource template library,
Website quality analytical equipment provided in an embodiment of the present invention further includes static resource template library module M5 (not shown)s.This is quiet
State resource template library module M5 is utilized sends access request using simulation browser timing to each website, is then grabbed using network
Packet method obtains the response data of above-mentioned website；The institute of each website is finally formed according to access request and corresponding response data
There is conversation recording and preserve into the static resource template library of the website.In this way, timing update static resource template library, it can be complete
Beauteously make up Referer conversation recording relating modules M2 can not associated conversation recording, so as to ensure the meeting that will not carry field
Words record is associated with the accuracy rate and percentage of head rice of website.
In practical application, grading module M4 obtains all KQI index values of each website, such as KQI index values are webpage
It is end-to-end complete to browse end-to-end delay, the end-to-end speed of web page browsing, the end-to-end success rate of web page browsing or web page browsing
Then rate calculates the scoring of each website according to each KQI index values and its default weighted value.The scoring can represent user couple
The subjective feeling of website experiences the quality of the website.
In practical application, grading module M4 also obtains any one KQI index of all websites, and obtains the KQI indexs
Value maximum or minimum corresponding website；Then, the KQI index values of the corresponding each HOST in the website are obtained, and obtain KQI indexs
Value maximum or minimum corresponding HOST；Furthermore the KPI index values of the corresponding each URL of the HOST are obtained, and obtain KPI indexs
(KPI indexs are answer delay, response success rate or retransmit packet loss) value maximum or minimum corresponding URL；Finally, obtaining should
The KPI index values of the corresponding each server ips of URL, and obtain KPI index values maximum or minimum corresponding server ip.This
Sample, grading module M4 can orient some server ip for causing website scoring variation, facilitate website maintenance personnel to above-mentioned
Server ip adjusting and optimizing, so as to promote the Website quality.
For device embodiments, since it is substantially similar to method embodiment, so description is fairly simple,
Related part illustrates referring to the part of method embodiment.
Embodiment three
One kind is additionally provided in the embodiment of the present invention and is based on Referer and the matched Website quality analysis system of template library,
The system comprises：Deep packet inspection device DPI and the Website quality analytical equipment described in embodiment two；The DPI with it is described
Website quality analytical equipment communicates to connect；
The DPI settings pass through in concatenation or mirror-image fashion access link, for obtaining the full dose flow of the link
It is sent to the Website quality analytical equipment；
The parsing of full dose flow, associating websites and the website that the Website quality analytical equipment is used to obtain the link are commented
Point.
For system embodiment, since it is substantially similar to method, apparatus embodiment, so the comparison of description
Simply, related part illustrates referring to the part of method embodiment.
Example IV
Fig. 5 be show the embodiment of the present application four based on Referer and the matched Website quality analytical equipment of template library
Structure diagram.Reference Fig. 5, the Website quality analytical equipment, including：Processor (processor) 501, memory
(memory) 502, communication interface (Communications Interface) 503 and bus 504；
Wherein,
The processor 501, memory 502, communication interface 503 complete mutual communication by the bus 504；
The communication interface 503 is for the information transmission between the communication equipment of the Website quality analytical equipment；
The processor 501 is used to call the program instruction in the memory 502, to perform above-mentioned each method embodiment
The method provided, such as including：The full dose flow obtained in link is parsed, the access request and sound that will be obtained after parsing
Data is answered to be matched to obtain whole conversation recordings of all users and all websites；It will be taken using Referer matching process
Conversation recording with Referer fields is associated with corresponding website；Referer fields will not be carried using template library matching process
Conversation recording matched with static resource template library, make it is above-mentioned do not carry Referer fields conversation recording all be associated with
To corresponding website；It scores after whole conversation recordings are associated with website each website, so that user is to Website quality
Analysis.
Embodiment five
The embodiment of the present invention discloses a kind of computer program product, and the computer program product includes being stored in non-transient
Computer program on computer readable storage medium, the computer program include program instruction, when described program instructs quilt
When computer performs, computer is able to carry out the method that above-mentioned each method embodiment is provided, such as including：It obtains in link
Full dose flow is parsed, and the access request obtained after parsing is matched to obtain all users and own with response data
Whole conversation recordings of website；Using Referer matching process by carry Referer fields conversation recording be associated with it is corresponding
Website；The conversation recording for not carrying Referer fields is matched with static resource template library using template library matching process,
The above-mentioned conversation recording for not carrying Referer fields is made all to be associated with corresponding website；Net is associated in whole conversation recordings
It scores after standing each website, so that user analyzes Website quality.
Embodiment six
The embodiment of the present invention provides a kind of non-transient computer readable storage medium storing program for executing, the non-transient computer readable storage
Medium storing computer instructs, and the computer instruction makes the computer perform the side that above-mentioned each method embodiment is provided
Method, such as including：The full dose flow obtained in link is parsed, and the access request obtained after parsing and response data are carried out
It matches to obtain whole conversation recordings of all users and all websites；Referer words will be carried using Referer matching process
The conversation recording of section is associated with corresponding website；The conversation recording that will not carry Referer fields using template library matching process
It is matched with static resource template library, the above-mentioned conversation recording for not carrying Referer fields is made all to be associated with corresponding net
It stands；It scores after whole conversation recordings are associated with website each website, so that user analyzes Website quality.
The all parts embodiment of the present invention can be with hardware realization or to be transported on one or more processor
Capable software module is realized or is realized with combination thereof.In the present apparatus, PC is by realizing internet to equipment or device
The step of remote control, accurately control device or device each operate.The present invention is also implemented as performing here
The some or all equipment or program of device of described method are (for example, computer program and computer program production
Product).The program of the present invention, which is achieved, may be stored on the computer-readable medium, and the file or document tool that program generates
Having can be statistical, generates data report and cpk reports etc., and batch testing can be carried out to power amplifier and is counted.
It should be noted that the present invention will be described rather than limits the invention for the above embodiment, and this
Field technology personnel can design replacement embodiment without departing from the scope of the appended claims.In claim
In, any reference mark between bracket should not be configured to limitations on claims.Word "comprising" is not excluded for depositing
In element or step not listed in the claims.Word "a" or "an" before element do not exclude the presence of it is multiple this
The element of sample.The present invention can be by means of including the hardware of several different elements and by means of properly programmed computer
It realizes.If in the unit claim for listing equipment for drying, several in these devices can be by same hardware
It embodies.The use of word first, second, and third does not indicate that any sequence.These words can be construed to
Title.
Although being described in conjunction with the accompanying embodiments of the present invention, those skilled in the art can not depart from this hair
Various modifications and variations are made in the case of bright spirit and scope, such modifications and variations are each fallen within by appended claims
Within limited range.
Claims (10)
1. one kind is based on Referer and the matched Website quality analysis method of template library, which is characterized in that the method includes：
The full dose flow obtained in link is parsed, and the access request obtained after parsing is matched to obtain with response data
To all users and whole conversation recordings of all websites；
The conversation recording for carrying Referer fields is associated with corresponding website using Referer matching process；
The conversation recording for not carrying Referer fields is matched with static resource template library using template library matching process,
The above-mentioned conversation recording for not carrying Referer fields is made all to be associated with corresponding website；
It scores after whole conversation recordings are associated with website each website, so that user analyzes Website quality.
2. Website quality analysis method according to claim 1, which is characterized in that described to utilize template library matching process
The conversation recording for not carrying Referer fields matched with static resource template library, makes the above-mentioned Referer fields that do not carry
Conversation recording was all associated with before the step of corresponding website, including：
Using simulation browser timing access request is sent to each website；
The response data of above-mentioned website is obtained using network packet snapping method；
All conversation recordings of each website are formed according to access request and corresponding response data and are preserved quiet to the website
In state resource template library.
3. Website quality analysis method according to claim 1, which is characterized in that described to be associated in whole conversation recordings
The step of scoring behind website each website includes：
Obtain all KQI index values of each website；
The scoring of each website is calculated according to each KQI index values and its default weighted value；
Wherein, the KQI index values be web page browsing end-to-end delay, the end-to-end speed of web page browsing, web page browsing it is end-to-end
Success rate or the end-to-end percentage of head rice of web page browsing.
4. according to claims 1 to 3 any one of them Website quality analysis method, which is characterized in that described in whole sessions
The step of scoring on the basis of record each website further includes：
Any one KQI index of all websites is obtained, and obtains KQI index values maximum or minimum corresponding website；
The KQI index values of the corresponding each HOST in the website are obtained, and obtain KQI index values maximum or minimum corresponding HOST；
The KPI index values of the corresponding each URL of the HOST are obtained, and obtain KPI index values maximum or minimum corresponding URL；
The KPI index values of the corresponding each server ips of the URL are obtained, and obtain KPI index values maximum or minimum corresponding clothes
Be engaged in device IP；
Wherein, the KPI indexs are answer delay, response success rate or retransmit packet loss；
Each website includes multiple HOST, and each HOST corresponds to multiple URL, and each URL corresponds to multiple server ips.
5. Website quality analysis method according to claim 4, which is characterized in that described to obtain any one of all websites
A KQI indexs, and the step of obtaining the KQI index values maximum or minimum corresponding website the following contents replacement may be used：
Selection needs the website analyzed and its any one KQI index directly from all websites.
6. one kind is based on Referer and the matched Website quality analytical equipment of template library, which is characterized in that described device includes：
Conversation recording acquisition module, the full dose flow for obtaining in link are parsed, the access request that will be obtained after parsing
Whole conversation recordings to obtain all users and all websites are matched with response data；
Referer conversation recording relating modules, for being remembered the session for carrying Referer fields using Referer matching process
Record is associated with corresponding website；
Template library conversation recording relating module, for being remembered the session for not carrying Referer fields using template library matching process
Record is matched with static resource template library, the above-mentioned conversation recording for not carrying Referer fields is made all to be associated with corresponding
Website；
Grading module, for scoring after whole conversation recordings are associated with website each website, so that user is to website
Quality analysis.
7. Website quality analytical equipment according to claim 6, which is characterized in that described device further includes static resource mould
Plate library module, for performing following steps：
Using simulation browser timing access request is sent to each website；
The response data of above-mentioned website is obtained using network packet snapping method；
All conversation recordings of each website are formed according to access request and corresponding response data and are preserved quiet to the website
In state resource template library.
8. Website quality analytical equipment according to claim 6, which is characterized in that institute's scoring module is following for performing
Step：
Obtain all KQI index values of each website；
The scoring of each website is calculated according to each KQI index values and its default weighted value；
Wherein, the KQI index values be web page browsing end-to-end delay, the end-to-end speed of web page browsing, web page browsing it is end-to-end
Success rate or the end-to-end percentage of head rice of web page browsing.
9. Website quality analytical equipment according to claim 6, which is characterized in that institute's scoring module be additionally operable to perform with
Lower step：
Any one KQI index of all websites is obtained, and obtains KQI index values maximum or minimum corresponding website；
The KQI index values of the corresponding each HOST in the website are obtained, and obtain KQI index values maximum or minimum corresponding HOST；
The KPI index values of the corresponding each URL of the HOST are obtained, and obtain KPI index values maximum or minimum corresponding URL；
The KPI index values of the corresponding each server ips of the URL are obtained, and obtain KPI index values maximum or minimum corresponding clothes
Be engaged in device IP；
Wherein, the KPI indexs are answer delay, response success rate or retransmit packet loss；
Each website includes multiple HOST, and each HOST includes multiple URL, and each URL includes multiple server ips.
10. one kind is based on Referer and the matched Website quality analysis system of template library, which is characterized in that the system comprises：
Deep packet inspection device DPI and such as claim 6~9 any one of them Website quality analytical equipment；The DPI and the net
Quality analysis apparatus of standing communicates to connect；
The DPI settings for obtaining the full dose flow of the link by concatenation or mirror-image fashion access link, sending
To the Website quality analytical equipment；
The Website quality analytical equipment is used to obtain the full dose flow parsing of the link, associating websites and website scoring.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611260470.7A CN108268370B (en) | 2016-12-30 | 2016-12-30 | Website quality analysis method, device and system based on Referer and template library matching |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611260470.7A CN108268370B (en) | 2016-12-30 | 2016-12-30 | Website quality analysis method, device and system based on Referer and template library matching |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108268370A true CN108268370A (en) | 2018-07-10 |
| CN108268370B CN108268370B (en) | 2021-06-15 |
Family
ID=62753752
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611260470.7A Active CN108268370B (en) | 2016-12-30 | 2016-12-30 | Website quality analysis method, device and system based on Referer and template library matching |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108268370B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113448835A (en) * | 2020-09-25 | 2021-09-28 | 北京新氧科技有限公司 | Static resource testing method and device, electronic equipment and storage medium |
| CN114328184A (en) * | 2021-12-01 | 2022-04-12 | 重庆长安汽车股份有限公司 | Big data cloud test method based on vehicle-mounted Ethernet architecture |
| CN114328184B (en) * | 2021-12-01 | 2024-05-17 | 重庆长安汽车股份有限公司 | Big data cloud testing method based on vehicle-mounted Ethernet architecture |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102361484A (en) * | 2011-07-05 | 2012-02-22 | 上海交通大学 | Passive network performance measuring system and page identification method thereof |
| CN104301161A (en) * | 2013-07-17 | 2015-01-21 | 华为技术有限公司 | Computing method, computing device and communication system for business quality index |
| CN104410516A (en) * | 2014-11-24 | 2015-03-11 | 中国联合网络通信集团有限公司 | User-service awareness assessment method and device |
| US20160103861A1 (en) * | 2014-10-10 | 2016-04-14 | OnPage.org GmbH | Method and system for establishing a performance index of websites |
-
2016
- 2016-12-30 CN CN201611260470.7A patent/CN108268370B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102361484A (en) * | 2011-07-05 | 2012-02-22 | 上海交通大学 | Passive network performance measuring system and page identification method thereof |
| CN104301161A (en) * | 2013-07-17 | 2015-01-21 | 华为技术有限公司 | Computing method, computing device and communication system for business quality index |
| US20160103861A1 (en) * | 2014-10-10 | 2016-04-14 | OnPage.org GmbH | Method and system for establishing a performance index of websites |
| CN104410516A (en) * | 2014-11-24 | 2015-03-11 | 中国联合网络通信集团有限公司 | User-service awareness assessment method and device |
Non-Patent Citations (1)
| Title |
|---|
| 云南电信移动互联网业务感知提升研究: "戴明珠", 《中国优秀硕士学位论文全文数据库 经济与管理科学辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113448835A (en) * | 2020-09-25 | 2021-09-28 | 北京新氧科技有限公司 | Static resource testing method and device, electronic equipment and storage medium |
| CN113448835B (en) * | 2020-09-25 | 2023-10-20 | 北京新氧科技有限公司 | Static resource testing method and device, electronic equipment and storage medium |
| CN114328184A (en) * | 2021-12-01 | 2022-04-12 | 重庆长安汽车股份有限公司 | Big data cloud test method based on vehicle-mounted Ethernet architecture |
| CN114328184B (en) * | 2021-12-01 | 2024-05-17 | 重庆长安汽车股份有限公司 | Big data cloud testing method based on vehicle-mounted Ethernet architecture |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108268370B (en) | 2021-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210352090A1 (en) | Network security monitoring method, network security monitoring device, and system | |
| US10530671B2 (en) | Methods, systems, and computer readable media for generating and using a web page classification model | |
| KR102076862B1 (en) | Network performance indicator visualization method and apparatus, and system | |
| US20160307101A1 (en) | Method, device, and server for friend recommendation | |
| CA3015146A1 (en) | Non-intrusive techniques for discovering and using organizational relationships | |
| US10885466B2 (en) | Method for performing user profiling from encrypted network traffic flows | |
| CN102752792A (en) | Method, device and system for monitoring internet service quality of mobile terminal | |
| CN103257989A (en) | Webpage download time analysis | |
| El Halabi et al. | Identifying the linkability between Web servers for Enhanced Internet Computing | |
| CN110535684A (en) | A kind of method and apparatus that web-browsing service perception assessment is realized based on DPI | |
| US9479414B1 (en) | System and method for analyzing computing performance | |
| Trevisan et al. | PAIN: A Passive Web performance indicator for ISPs | |
| US20140304653A1 (en) | Method For Generating Rules and Parameters for Assessing Relevance of Information Derived From Internet Traffic | |
| CN107766509A (en) | A kind of method and apparatus of webpage static backup | |
| CN107133161A (en) | One kind generation client performance test script method and device | |
| CN107766234A (en) | A kind of assessment method, the apparatus and system of the webpage health degree based on mobile device | |
| CN103929477B (en) | Without coupling integration analogy method and system between system based on Http agreements | |
| WO2015123990A1 (en) | Page push method, device, server and system | |
| Liu et al. | Request dependency graph: A model for web usage mining in large-scale web of things | |
| CN107948015B (en) | A kind of Analysis on Quality of Service method, apparatus and network system | |
| CN107370628A (en) | Based on the log processing method and system buried a little | |
| CN114285760A (en) | Webpage access quality evaluation method and device | |
| CN108268370A (en) | Based on Referer and the matched Website quality analysis method of template library, device and system | |
| US20080162687A1 (en) | Data acquisition system and method | |
| Rizothanasis et al. | Identifying user actions from HTTP (S) traffic |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |