CN108183837B - Website performance monitoring method and system - Google Patents
Website performance monitoring method and system Download PDFInfo
- Publication number
- CN108183837B CN108183837B CN201711377943.6A CN201711377943A CN108183837B CN 108183837 B CN108183837 B CN 108183837B CN 201711377943 A CN201711377943 A CN 201711377943A CN 108183837 B CN108183837 B CN 108183837B
- Authority
- CN
- China
- Prior art keywords
- website
- client
- response data
- performance
- monitored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to the technical field of Internet, in particular to a website performance monitoring method and a website performance monitoring system. In the scheme, in order to monitor the website performance, a website to be monitored is subjected to a web crawling operation through a client, website response data generated by the client through the web crawling operation is obtained, the website response data can be used for judging the website performance, the website to be monitored is not required to be modified, the stability of the website is maintained, and the risk of implementing the website performance monitoring is greatly reduced; meanwhile, the network crawling operation is carried out through a real client, so that the acquired website response data are closer to the real situation, and the accuracy of website performance monitoring is improved.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a method and a system for monitoring website performance.
Background
With the development of science and technology, the internet is more and more widely used in people's lives, and the proportion of network economy is continuously increased. In order to improve the browsing experience of the web pages, the network developer needs to monitor the performance of the website, so as to purposefully improve the website of the developer.
At present, in order to monitor the performance of a website, a mode of modifying the website is generally selected, and javascript codes are implanted into an existing page, so that when a user accesses the website, the codes are loaded and specific data are fed back to a website back-end server for analysis, so that the performance of the website is monitored. However, this method needs to modify the web page, which causes the stability problem of the website and has a great risk.
Disclosure of Invention
Based on this, because the stability problem of the website to be monitored is easy to occur in the existing website performance monitoring process, a website performance monitoring method and system need to be provided.
A website performance monitoring method comprises the following steps:
receiving website response data sent by a client, wherein the website response data is response data generated after the client performs a network crawling operation on a website to be monitored;
acquiring a website access performance index parameter of the client according to the website response data;
and judging the performance of the website to be monitored according to the website access performance index parameters and a preset standard value.
In one embodiment, the step of receiving the website response data sent by the client further comprises the following steps:
and carrying out agent program embedding on the client, so that the client can execute the step of carrying out the web crawling operation on the website to be monitored through the agent program.
In one embodiment, the step of performing agent dotting on the client comprises the following steps:
sending an agent program installation file and a startup script to a client of the website to be monitored through a domain policy; and the client executes the agent program installation file according to the startup script when starting up next time.
In one embodiment, the step of obtaining the website access performance index parameter of the client according to the website response data includes the following steps:
extracting the loading time of each webpage element of the client from the website response data;
and calculating a weighted average value of the loading time of each webpage element according to a preset weight value corresponding to each webpage element, and taking the weighted average value of the loading time of each webpage element as a website access performance index parameter of the client.
In one embodiment, the preset weight corresponding to each web page element is directly proportional to the frequency of loading each web page element.
In one embodiment, the step of judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value further includes the following steps:
receiving test response data sent by a client, wherein the test response data is response data generated after the client performs a network crawling operation on a test scene of a website to be monitored;
acquiring a test access performance index parameter of the client according to the test response data;
sending a test access satisfaction query to a corresponding client according to the received test response data;
receiving a satisfaction feedback value returned by the client according to the test access satisfaction query;
obtaining an absolute average value of test access performance index parameters corresponding to a plurality of specified clients, and taking the absolute average value as the preset standard value; and the specified client is the client which returns a satisfaction feedback value to an expected value.
In one embodiment, the website response data is a plurality of groups of response data generated after the client performs the web crawling operation for a plurality of times within a preset time period;
the website access performance index parameters comprise a plurality of groups of access performance index parameters corresponding to the plurality of groups of response data;
the step of judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value comprises the following steps:
and judging the performance of the website to be monitored according to the number of the multiple groups of access performance index parameters exceeding a preset standard value.
In one embodiment, the step of judging the performance of the network station to be monitored according to the number of the multiple groups of access performance index parameters exceeding a preset standard value includes the following steps:
and when the number of the multiple groups of access performance index parameters of a single client exceeding a preset standard value is larger than a first threshold value, judging that the performance of the website to be monitored is low.
In one embodiment, the number of the clients is multiple, and the step of judging the performance of the network station to be monitored according to the number of the multiple groups of access performance index parameters exceeding a preset standard value includes the following steps:
and when the sum of the number of the multiple groups of access performance index parameters of each client exceeds a preset standard value is larger than a second threshold value, judging that the performance of the website to be monitored is low.
A website performance monitoring system, comprising the following modules:
the data receiving module is used for receiving website response data sent by a client, wherein the website response data is response data generated after the client conducts a network crawling operation on a website to be monitored;
the performance acquisition module is used for acquiring the website access performance index parameter of the client according to the website response data;
and the performance judgment module is used for judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value.
According to the website performance monitoring method and system, website response data generated through a network crawling operation and sent by a client side are received, website access performance index parameters of the client side are obtained according to the website response data, and the performance of the website to be monitored is judged according to the website access performance index parameters and a preset standard value. In the scheme, in order to monitor the website performance, a website to be monitored is subjected to a web crawling operation through a client, website response data generated by the client through the web crawling operation is obtained, the website response data can be used for judging the website performance, the website to be monitored is not required to be modified, the stability of the website is maintained, and the risk of implementing the website performance monitoring is greatly reduced; meanwhile, the network crawling operation is carried out through a real client, so that the acquired website response data are closer to the real situation, and the accuracy of website performance monitoring is improved.
A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, performs the steps of the above-described website performance monitoring method.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the website performance monitoring method when executing the program.
Drawings
FIG. 1 is a flowchart illustrating a website performance monitoring method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a website performance monitoring system according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a website performance monitoring method according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating connections among a performance analysis server, a client, and an information system web application server of an enterprise according to an embodiment of the website performance monitoring method of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the detailed description and specific examples, while indicating the scope of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
Fig. 1 is a schematic flow chart of a website performance monitoring method according to an embodiment of the present invention. The website performance monitoring method in the embodiment comprises the following steps:
step S110: receiving website response data sent by a client, wherein the website response data is generated after the client performs a crawling operation on a website to be monitored;
in this step, the client is a client accessing a website to be monitored, and may specifically be an electronic device such as a personal computer, a smart phone, or a portable tablet computer; the website to be monitored is a website which needs performance monitoring and analysis; the crawling refers to a process of acquiring and analyzing information of a webpage of a website and a webpage connected with a hyperlink contained in the webpage, and complete data of the website to be monitored can be acquired by crawling the website to be monitored, so that comprehensive performance monitoring of the website to be monitored is achieved.
Optionally, the website response data may be received by a server of the website to be monitored, and the server does not need to be additionally arranged to process the website response data, so as to reduce the cost of monitoring the website performance; and a performance analysis server can be additionally arranged and used for receiving and processing the website response data so as to reduce the load of the website to be monitored and improve the efficiency of monitoring the website performance.
In another embodiment, the step of receiving the website response data sent by the client further comprises the following steps:
and carrying out agent program embedding on the client, so that the client can execute the step of carrying out the web crawling operation on the website to be monitored through the agent program.
In this embodiment, after the agent program is embedded in the client, the client may automatically execute the step of performing the web crawling operation on the website to be monitored by running the agent program, so that no manual operation is required, and convenience in the website performance monitoring process is improved.
In another embodiment, the step of performing agent dotting on the client comprises the steps of:
sending an agent program installation file and a startup script to a client of the website to be monitored through a domain policy; and the client executes the agent program installation file according to the startup script when starting up next time.
In the embodiment, the agent program installation file and the startup script are sent to the client, and the client installs the agent program according to the startup script, so that manual operation is not needed in the installation process, and the convenience of the client in the network crawling operation step is improved; the domain strategy is a tool for managing computers in the domain, and because the number of clients accessing a website to be monitored is large, the agent program installation files and the startup scripts are sent to the clients in batches through the domain strategy, so that batch unified management of the clients can be realized, and the efficiency of agent program embedding of the clients is improved.
Optionally, in the step of embedding the proxy program into the client, in order to improve the efficiency of embedding the point, for the newly added client accessing the website to be monitored, because the number of the newly added clients accessing the website to be monitored is small, the website to be monitored can send a proxy program installation file to the newly added client for the newly added client to install when the newly added client accesses the website to be monitored; the installation process can select a silent installation mode without manual installation.
Optionally, in the step of performing agent program embedding on the client, the agent program may be embedded in an installation file image of the operating system, and the client may perform the installation of the agent program simultaneously when the operating system is installed or updated according to the installation file image, so that the efficiency of agent program embedding may be improved.
Step S120: acquiring a website access performance index parameter of the client according to the website response data;
in another embodiment, the step of obtaining the website access performance index parameter of the client according to the website response data includes the following steps:
extracting the loading time of each webpage element of the client from the website response data;
and calculating a weighted average value of the loading time of each webpage element according to a preset weight value corresponding to each webpage element, and taking the weighted average value of the loading time of each webpage element as a website access performance index parameter of the client.
In this embodiment, since the website to be monitored is generally composed of various web page elements, such as images, style sheets, scripts, and flash, by obtaining the loading time of the web page elements, it can be determined whether the settings of the elements in the website to be monitored are normal; and then, calculating the weighted average value of the loading time of each webpage element according to the preset weight of each webpage element, so as to judge whether the overall design of the website to be monitored is reasonable.
Specifically, there are multiple web page elements of the website to be monitored, and the preset weight of each web page element is F1、F2、F3……FnThe corresponding loading time in the operation process of certain network climbing is S1、S2、S3……SnThe website access performance index parameter T can be obtained according to the following functional relation:
optionally, the preset weight corresponding to each web page element may be specifically set according to factors such as the size of the occupied capacity of each web page element, the frequency of being loaded during access, or the complexity of being loaded and then being analyzed.
In another embodiment, the preset weight corresponding to each web page element is proportional to the frequency of loading each web page element.
In this embodiment, since access to the website is performed through the browser in general, and the browser has a cache mechanism, after the browser loads the page of the website, part of the web page elements of the page are cached, so as to increase the loading speed when the page is loaded next time; therefore, the reloading rate of the cached webpage elements is not high; by setting the preset weight value to be in direct proportion to the frequency of loading each webpage element, the obtained website access performance index parameter of the client can be closer to reality.
For example, the weights may be divided into 5 levels, with corresponding weights of 1, 2, 3, 4, and 5; the webpage elements of a general website page comprise html files, javascript files, css style files, pictures, audio, videos and the like, and the browser has a cache mechanism and can cache the webpage elements of the html files, the javascript files, the css files, the pictures and the like, so that the repeated loading frequency of the cached webpage elements is not high, the preset weights of the pictures, the javascript files, the css style files and the html files can be respectively set to be 1, 2 and 3, and the preset weights of the audio and the videos can be respectively set to be 4 and 5.
Step S130: and judging the performance of the website to be monitored according to the website access performance index parameters and a preset standard value.
In another embodiment, the step of judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value further comprises the following steps of:
receiving test response data sent by a client, wherein the test response data is response data generated after the client performs a network crawling operation on a test scene of a website to be monitored;
acquiring a test access performance index parameter of the client according to the test response data;
sending a test access satisfaction query to a corresponding client according to the received test response data;
receiving a satisfaction feedback value returned by the client according to the test access satisfaction query;
obtaining an absolute average value of test access performance index parameters corresponding to a plurality of specified clients, and taking the absolute average value as the preset standard value; and the specified client is the client which returns a satisfaction feedback value to an expected value.
In this embodiment, when the feedback value of the satisfaction returned by the client reaches the expected value, the process that the client accesses the website to be monitored can be reflected as a normal condition; the method comprises the steps of selecting a test access performance index parameter corresponding to a client side with a returned satisfaction degree feedback value reaching an expected value, obtaining an absolute average value according to the test access performance index parameter, taking the obtained absolute average value as a preset standard value, providing a basis for judging the performance of a website to be monitored, enabling the judgment result of the performance of the website to be monitored to be more accurate, and avoiding the individual extreme value of the website access performance index parameter from reducing the accuracy of performance judgment.
Alternatively, the satisfaction feedback value may be returned in the form of a percentage: after the satisfaction query is sent to the client, the client selects a numerical value as a satisfaction feedback value within the range of 0% -100% according to the actual experience and returns the feedback value, the higher the numerical value is, the better the actual experience of the client is, and meanwhile, the expected value can be set to be 85%, and the client is designated to return the satisfaction feedback value which is greater than or equal to 85%.
Optionally, the satisfaction feedback value may also be returned in the form of yes or no: and after the satisfaction query is sent to the client, selecting one value from the yes or the no as a satisfaction feedback value according to the actual experience by the client and returning the selected value, wherein the specified client is the client which returns the satisfaction feedback value of yes.
Specifically, the test access performance index parameters corresponding to the specified clients are respectively T1、T2、T3…TnThen, the preset standard value T can be obtained according to the following functional relations：
In order to make the website performance monitoring process more flexible, in some embodiments, the obtained preset standard value may be appropriately adjusted according to an actual situation. For example, a fluctuation parameter T may be setxAdjusted preset standard value TsrShould satisfy Tsr∈[Ts-Tx,Ts+Tx]At this moment, the preset standard value T is required to be obtainedsrAnd judging the performance of the website to be monitored by the website access performance index parameter of the client.
Optionally, the absolute average value of the test access performance index parameters corresponding to a plurality of specified clients may be obtained, or after one specified client is determined, the specified client performs network crawling operation for multiple times to obtain the absolute average value of the test access performance index parameters of the specified client.
In another embodiment, the website response data are multiple groups of response data generated after the client performs the web crawling operation for multiple times within a preset time period;
the website access performance index parameters comprise a plurality of groups of access performance index parameters corresponding to the plurality of groups of response data;
the step of judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value comprises the following steps:
and judging the performance of the website to be monitored according to the number of the multiple groups of access performance index parameters exceeding a preset standard value.
In the embodiment, the influence of accidental factors on the website performance monitoring process can be reduced by performing multiple crawling operations on the website to be monitored by the client and acquiring multiple groups of response data; however, when the website to be monitored is subjected to the network crawling operation, resources of the client and a server of the website to be monitored need to be occupied, so that the client performs the network crawling operation on the website to be monitored for multiple times within a preset time period to generate multiple groups of response data; acquiring the number of a plurality of groups of access performance index parameters of the client in the preset time period exceeding a preset standard value; and judging the performance of the website to be monitored according to the quantity, so that the influence caused by accidental factors can be reduced in the website performance monitoring process, and the occupation of resources in the monitoring process is reduced.
In another embodiment, the step of judging the performance of the network station to be monitored according to the number of the multiple sets of access performance index parameters exceeding the preset standard value includes the following steps:
and when the number of the multiple groups of access performance index parameters of a single client exceeding a preset standard value is larger than a first threshold value, judging that the performance of the website to be monitored is low.
In this embodiment, the process of the client performing the crawling operation on the website to be monitored is influenced by various factors, wherein the factors include internal factors of the website, network conditions, configuration of the client and other external factors; for example, in some cases, it may happen that the performance index parameter exceeds a preset standard value when the client accesses the website at the next time due to network delay, but this is not caused by the low performance of the website. Therefore, by setting the first threshold, the website access performance index parameter of a single client in the preset time period is allowed to exceed the preset standard value for a certain number of times, so that the website performance misjudgment caused by accidental factors can be avoided, and the accuracy of website performance monitoring is improved.
Specifically, in some embodiments, the preset time period may be set to 5 minutes, so that each of the clients performs a plurality of crawling operations on the website to be monitored within 5 minutes; acquiring a plurality of groups of website response data generated by the clients through a network crawling operation; acquiring multiple groups of website access performance index parameters of the clients according to the multiple groups of website response data; and meanwhile, the first threshold value is set to be 5, and when the number of the multiple groups of website access performance index parameters of a single client in the 5 minutes exceeding the standard preset value is greater than 5, the performance of the website to be monitored can be judged to be low.
In another embodiment, the number of the clients is multiple, and the step of judging the performance of the network station to be monitored according to the number of the multiple groups of access performance index parameters exceeding a preset standard value includes the following steps:
and when the sum of the number of the multiple groups of access performance index parameters of each client exceeds a preset standard value is larger than a second threshold value, judging that the performance of the website to be monitored is low.
In this embodiment, the process of the client performing the crawling operation on the website to be monitored is influenced by various factors, wherein the factors include internal factors of the website, network conditions, configuration of the client and other external factors; for example, in some cases, it may be that the website performance index parameter of a certain client is always beyond the standard preset value due to its configuration, but this is not caused by the low performance of the website. Therefore, the second threshold value is set, when the sum of the number of the multiple groups of access performance index parameters of each client exceeds the preset standard value is greater than the second threshold value, the performance of the website to be monitored is judged to be low, the phenomenon that the performance of the website is misjudged due to the configuration problem of each client can be avoided, and the accuracy of monitoring the performance of the website is improved.
Specifically, in some embodiments, the preset time period may be set to 15 minutes, so that each client performs a plurality of crawling operations on the website to be monitored within 15 minutes; acquiring a plurality of groups of website response data generated by the clients through a network crawling operation; acquiring multiple groups of website access performance index parameters corresponding to the clients according to the multiple groups of website response data; setting the second threshold according to the total number of the clients, for example, setting the second threshold to ten percent of the total number of the clients; when the sum of the number of the multiple groups of website access performance index parameters of each client within the 15 minutes exceeds the standard preset value is more than ten percent of the total number of the clients, the fact that the performance of the website to be monitored is low can be judged.
In some further embodiments, the first threshold may also be validated simultaneously with the second threshold, namely: and when the number of the multiple groups of access performance index parameters of a single client exceeding a preset standard value is larger than a first threshold value, or when the sum of the number of the multiple groups of access performance index parameters of each client exceeding the preset standard value is larger than a second threshold value, judging that the performance of the website to be monitored is low.
In some other embodiments, after the step of determining that the performance of the website to be monitored is low, a performance monitoring warning signal is generated for notifying operation and maintenance managers of the website to be monitored to perform relevant processing to improve the performance of the website to be monitored.
According to the website performance monitoring method, website response data generated through a network crawling operation and sent by a client side are received, website access performance index parameters of the client side are obtained according to the website response data, and the performance of a website to be monitored is judged according to the website access performance index parameters and a preset standard value. In the scheme, in order to monitor the website performance, a website to be monitored is subjected to a web crawling operation through a client, website response data generated by the client through the web crawling operation is obtained, the website response data can be used for judging the website performance, the website to be monitored is not required to be modified, the stability of the website is maintained, and the risk of implementing the website performance monitoring is greatly reduced; meanwhile, the network crawling operation is carried out through a real client, so that the acquired website response data are closer to the real situation, and the accuracy of website performance monitoring is improved.
Fig. 2 is a schematic structural diagram of an embodiment of the website performance monitoring system according to the present invention. The website performance monitoring system in this embodiment includes the following modules:
the data receiving module 210 is configured to receive website response data sent by a client, where the website response data is website response data generated after the client performs a web crawling operation on a website to be monitored;
in another embodiment, the data receiving module 210 performs agent program site burying on the client, so that the client performs a web crawling operation on a website to be monitored through the agent program.
In another embodiment, the data receiving module 210 sends the agent installation file and the boot script to the client of the website to be monitored through the domain policy; and the client executes the agent program installation file according to the startup script when starting up next time.
A performance obtaining module 220, configured to obtain a website access performance index parameter of the client according to the website response data;
in another embodiment, the performance acquisition module 220 extracts the loading time of each web page element of the client from the website response data; and calculating a weighted average value of the loading time of each webpage element according to a preset weight value corresponding to each webpage element, and taking the weighted average value of the loading time of each webpage element as a website access performance index parameter of the client.
In another embodiment, when the performance obtaining module 220 calculates the weighted average of the loading time of each web page element according to the preset weight corresponding to each web page element, the preset weight corresponding to each web page element is in direct proportion to the loading frequency of each web page element.
And the performance judgment module 230 is configured to judge the performance of the website to be monitored according to the website access performance index parameter and a preset standard value.
In another embodiment, the performance obtaining module 220 receives test response data sent by a client, where the test response data is response data generated after the client performs a web crawling operation on a test scene of a website to be monitored; acquiring a test access performance index parameter of the client according to the test response data; sending a test access satisfaction query to a corresponding client according to the received test response data; receiving a satisfaction feedback value returned by the client according to the test access satisfaction query; obtaining an absolute average value of test access performance index parameters corresponding to a plurality of specified clients, and taking the absolute average value as the preset standard value; and the specified client is the client which returns a satisfaction feedback value to an expected value.
In another embodiment, the website response data received by the data receiving module 210 are multiple sets of response data generated after the client performs the crawling operation for multiple times within a preset time period; the website access performance index parameters obtained by the performance obtaining module 220 include multiple sets of access performance index parameters corresponding to the multiple sets of response data; the performance determining module 230 determines the performance of the website to be monitored according to the number of the sets of access performance index parameters exceeding a preset standard value.
In another embodiment, the performance determining module 230 determines that the performance of the website to be monitored is low when the number of the sets of access performance indicator parameters of a single client exceeds a preset standard value is greater than a first threshold.
In another embodiment, there are multiple clients, and the performance determining module 230 determines that the performance of the website to be monitored is low when the sum of the number of the multiple sets of access performance index parameters of each of the clients exceeds a preset standard value is greater than a second threshold.
The website performance monitoring system and the website performance monitoring method are in one-to-one correspondence, and the technical characteristics and the beneficial effects described in the embodiment of the website performance monitoring method are all suitable for the embodiment of the website performance monitoring system.
Referring to fig. 3, a schematic flow chart of an embodiment of the website performance monitoring method of the present invention is shown; the website to be monitored in this embodiment may be an information system web application server of an enterprise, as shown in fig. 4, the information system web application server may be connected to clients in various ways, each client is connected to a performance analysis server, each client may initiate a simulated access request to the information system web application server through an agent program, and report collected data to the performance analysis server, thereby implementing performance monitoring on a website of the information system web application server of the enterprise; the website performance monitoring method in the embodiment comprises the following steps:
step S310: the performance analysis server sends an agent program installation file and a startup script to a client accessing a website to be monitored through a domain policy;
for the client side outside the domain strategy, the performance analysis server directly sends an agent program installation file for the client side outside the domain strategy to install, and the installation mode can be silent installation; the agent program can also be built in the operating system installation file image, and the client can install the agent program simultaneously when installing the operating system by using the operating system installation file image.
Step S321: the client executes the agent program installation file according to the startup script and installs the agent program;
step S322: the client performs network crawling operation on a website to be monitored through the agent program to generate website response data; the website response data comprises loading time of webpage elements such as html pages, javascript files, css style files, pictures, audio and videos;
step S323: the client sends the website response data to a performance analysis server;
step S330: the performance analysis server generates website access performance index parameters corresponding to the clients through a weighted average method according to the website response data; the performance analysis server generates a website access performance index parameter corresponding to each client according to the following function relation:
in the formula, T is a website access performance index parameter corresponding to a certain crawling operation of the client, and the loading time corresponding to each webpage element in the certain crawling operation process of the client is S1、S2、S3……SnThe preset weight of each web page element is F1、F2、F3……FnThe preset weight of each web page element is specifically set according to the frequency of loading the web page element, for example, the weight may be divided into 5 levels, and the corresponding weights are 1, 2, 3, 4 and 5 respectively; the webpage elements of a general website page comprise html files, javascript files, css style files, pictures, audio, videos and the like, and because the browser has a cache mechanism, the browser can cache the webpage elements of the html files, the javascript files, the css files, the pictures and the like, the repeated loading frequency of the cached webpage elements is not high, the preset weights of the pictures, the javascript files, the css style files and the html files can be respectively set to be 1, 2 and 3, and the preset weights of the audio and the videos are respectively set to be 4 and 5;
step S341: the performance analysis server sends a website access satisfaction query to the corresponding client according to the received website response data;
step S342: the performance analysis server receives a satisfaction feedback value returned by the client according to the website access satisfaction query;
step S343: the performance analysis server obtains the absolute average value of the website access performance index parameters corresponding to at least 3 specified clients, and takes the absolute average value as the preset standard value; the specified client is the client which returns a satisfaction feedback value to an expected value; the obtained website access performance index parameters corresponding to the specified client are respectively T1、T2、T3…TnThe preset standard value T can be obtained according to the following functional relations：
In order to make the website performance monitoring process more flexible, in some embodiments, the obtained preset standard value may be appropriately adjusted according to an actual situation. For example, a fluctuation parameter T may be setx1, adjusted preset standard value TsrShould satisfy Tsr∈[Ts-1,Ts+1]At this moment, the preset standard value T is required to be obtainedsrJudging the performance of the website to be monitored by using the website access performance index parameter of the client;
step S351: the performance analysis server respectively obtains the times that the website performance index parameter of each client is greater than the preset standard value within 5 minutes, wherein the times are first times;
step S352: the performance analysis server obtains the sum of times that the website performance index parameter of each client is greater than the preset standard value within 15 minutes, wherein the sum of the times is a second time;
step S353: and when the first number of the single client is more than 5 or the second number of the single client is more than ten percent of the total number of the clients, judging that the performance of the website to be monitored is low, and triggering a performance monitoring alarm.
According to the website performance monitoring method, in order to monitor the website performance, a client performs a crawling operation on a website to be monitored, website response data generated by the client through the crawling operation is obtained, the website response data can be used for judging the website performance, the website to be monitored does not need to be modified, the stability of the website is kept, and the risk of implementing website performance monitoring is greatly reduced; meanwhile, the website to be monitored is crawled at a real client, so that the acquired website response data is closer to the real situation, and the accuracy of website performance monitoring is improved; and when the performance of the website to be monitored is low, a performance monitoring warning is triggered, so that operation and maintenance personnel of the website to be monitored can find out problems in time and improve the problems, and the office efficiency when the client accesses the website to be monitored is improved.
According to the website performance monitoring method, the embodiment of the invention also provides a readable storage medium and computer equipment. The readable storage medium stores executable program, and the program realizes the steps of the website performance monitoring method when being executed by the processor; the computer device comprises a memory, a processor and an executable program stored on the memory and capable of running on the processor, and the steps of the website performance monitoring method are realized when the processor executes the program.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (8)
1. A website performance monitoring method is characterized by comprising the following steps:
receiving website response data sent by a client, wherein the website response data is response data generated after the client performs a network crawling operation on a website to be monitored;
acquiring a website access performance index parameter of the client according to the website response data;
judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value;
the step of obtaining the website access performance index parameter of the client according to the website response data comprises the following steps:
extracting the loading time of each webpage element of the client from the website response data;
calculating the weighted average value of the loading time of each webpage element according to the preset weight value corresponding to each webpage element, and calculating the weighted average value of the loading time of each webpage element
Taking the weighted average value of the loading time of the webpage elements as a website access performance index parameter of the client;
the preset weight value corresponding to each web page element is in direct proportion to the loaded frequency of each web page element.
2. The website performance monitoring method according to claim 1, wherein the step of receiving the website response data sent by the client further comprises the following steps:
and carrying out agent program embedding on the client, so that the client can execute the step of carrying out the web crawling operation on the website to be monitored through the agent program.
3. The website performance monitoring method according to claim 2, wherein the step of performing proxy burial of the client comprises the steps of:
sending an agent program installation file and a startup script to a client of the website to be monitored through a domain policy; and the client executes the agent program installation file according to the startup script when starting up next time.
4. The website performance monitoring method according to any one of claims 1 to 3, wherein the step of judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value further comprises the following steps:
receiving test response data sent by a client, wherein the test response data is response data generated after the client performs a network crawling operation on a test scene of a website to be monitored;
acquiring a test access performance index parameter of the client according to the test response data;
sending a test access satisfaction query to a corresponding client according to the received test response data;
receiving a satisfaction feedback value returned by the client according to the test access satisfaction query;
obtaining an absolute average value of test access performance index parameters corresponding to a plurality of specified clients, and taking the absolute average value as the preset standard value; and the specified client is the client which returns a satisfaction feedback value to an expected value.
5. The website performance monitoring method according to claim 1, wherein the website response data are a plurality of groups of response data generated after the client performs a crawling operation for a plurality of times within a preset time period;
the website access performance index parameters comprise a plurality of groups of access performance index parameters corresponding to the plurality of groups of response data; the step of judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value comprises the following steps:
and judging the performance of the website to be monitored according to the number of the multiple groups of access performance index parameters exceeding a preset standard value.
6. The website performance monitoring method according to claim 5, wherein the step of determining the performance of the website to be monitored according to the number of the sets of access performance index parameters exceeding a preset standard value comprises the steps of:
and when the number of the multiple groups of access performance index parameters of a single client exceeding a preset standard value is larger than a first threshold value, judging that the performance of the website to be monitored is low.
7. The website performance monitoring method according to claim 5, wherein the number of the clients is multiple, and the step of determining the performance of the website to be monitored according to the number of the multiple sets of the access performance index parameters exceeding a preset standard value comprises the following steps:
and when the sum of the number of the multiple groups of access performance index parameters of each client exceeds a preset standard value is larger than a second threshold value, judging that the performance of the website to be monitored is low.
8. A website performance monitoring system is characterized by comprising the following modules:
the data receiving module is used for receiving website response data sent by a client, wherein the website response data is response data generated after the client conducts a network crawling operation on a website to be monitored;
the performance acquisition module is used for acquiring the website access performance index parameter of the client according to the website response data;
the performance judgment module is used for judging the performance of the website to be monitored according to the website access performance index parameter and a preset standard value;
the performance acquisition module is further used for extracting the loading time of each webpage element of the client from the website response data; calculating a weighted average value of the loading time of each webpage element according to a preset weight corresponding to each webpage element, and taking the weighted average value of the loading time of each webpage element as a website access performance index parameter of the client; the preset weight value corresponding to each webpage element is in direct proportion to the loaded frequency of each webpage element.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711377943.6A CN108183837B (en) | 2017-12-19 | 2017-12-19 | Website performance monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711377943.6A CN108183837B (en) | 2017-12-19 | 2017-12-19 | Website performance monitoring method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108183837A CN108183837A (en) | 2018-06-19 |
| CN108183837B true CN108183837B (en) | 2020-08-14 |
Family
ID=62546471
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711377943.6A Active CN108183837B (en) | 2017-12-19 | 2017-12-19 | Website performance monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108183837B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103067214A (en) * | 2011-10-19 | 2013-04-24 | 阿里巴巴集团控股有限公司 | Method, client, server and system used for testing web site performance |
| CN105099755A (en) * | 2015-05-29 | 2015-11-25 | 北京奇虎科技有限公司 | Method, device and system for monitoring performance of website system |
| CN106296429A (en) * | 2016-08-31 | 2017-01-04 | 哈尔滨工业大学（威海） | A kind of intelligent test method for social network sites |
| CN107231268A (en) * | 2016-03-25 | 2017-10-03 | 北京京东尚科信息技术有限公司 | The method and apparatus for testing web site performance |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8631116B2 (en) * | 2007-11-28 | 2014-01-14 | Ccip Corp. | System and method for active business configured website monitoring |
-
2017
- 2017-12-19 CN CN201711377943.6A patent/CN108183837B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103067214A (en) * | 2011-10-19 | 2013-04-24 | 阿里巴巴集团控股有限公司 | Method, client, server and system used for testing web site performance |
| CN105099755A (en) * | 2015-05-29 | 2015-11-25 | 北京奇虎科技有限公司 | Method, device and system for monitoring performance of website system |
| CN107231268A (en) * | 2016-03-25 | 2017-10-03 | 北京京东尚科信息技术有限公司 | The method and apparatus for testing web site performance |
| CN106296429A (en) * | 2016-08-31 | 2017-01-04 | 哈尔滨工业大学（威海） | A kind of intelligent test method for social network sites |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108183837A (en) | 2018-06-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108259266B (en) | Website performance monitoring method and system | |
| AU2017206281B2 (en) | System and method for improving access to search results | |
| CN108763398B (en) | Database configuration parameter processing method and device, computer equipment and storage medium | |
| CN107515865B (en) | Page data click rate statistical method and device | |
| US8504558B2 (en) | Framework to evaluate content display policies | |
| CN106599146B (en) | Cache page processing method and device and cache page updating request processing method and device | |
| CN109901881B (en) | Plug-in loading method and device of application program, computer equipment and storage medium | |
| CN112559086B (en) | Applet page rendering method and device, electronic equipment and readable storage medium | |
| CN109740089A (en) | Collecting method, device, system, readable storage medium storing program for executing and electronic equipment | |
| CN109684576A (en) | Web page resources lazyness loads monitoring method, device, equipment and storage medium | |
| US20210357473A1 (en) | Page-loading method and terminal, and page-responding method and server | |
| CN103530292A (en) | Webpage displaying method and device | |
| CN114416512A (en) | Test method, test device, electronic equipment and computer storage medium | |
| CN112907128A (en) | Data analysis method, device, equipment and medium based on AB test result | |
| CN112130996A (en) | Data monitoring control system, method and device, electronic equipment and storage medium | |
| CN111984896A (en) | Buried point data acquisition method and device, computer equipment and readable storage medium | |
| CN110555146A (en) | method and system for generating network crawler camouflage data | |
| US8935285B2 (en) | Searchable and size-constrained local log repositories for tracking visitors' access to web content | |
| CN109711656B (en) | Multisystem association early warning method, device, equipment and computer readable storage medium | |
| CN110929129B (en) | Information detection method, equipment and machine-readable storage medium | |
| CN110659435A (en) | Page data acquisition processing method and device, computer equipment and storage medium | |
| CN108183837B (en) | Website performance monitoring method and system | |
| CN110347546B (en) | Dynamic adjustment method, device, medium and electronic equipment for monitoring task | |
| CN116776030A (en) | Gray release method, device, computer equipment and storage medium | |
| CN108399031B (en) | Method and device for determining interface layout mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200925 Address after: 510620 Tianhe District, Guangzhou, Tianhe South Road, No. two, No. 2, No. Patentee after: Guangzhou Power Supply Bureau of Guangdong Power Grid Co.,Ltd. Address before: 510620 Tianhe District, Guangzhou, Tianhe South Road, No. two, No. 2, No. Patentee before: GUANGZHOU POWER SUPPLY Co.,Ltd. |
|
| TR01 | Transfer of patent right |