CN100499521C - Network operation monitoring method and system - Google Patents

Network operation monitoring method and system Download PDF

Info

Publication number
CN100499521C
CN100499521C CNB2006100626966A CN200610062696A CN100499521C CN 100499521 C CN100499521 C CN 100499521C CN B2006100626966 A CNB2006100626966 A CN B2006100626966A CN 200610062696 A CN200610062696 A CN 200610062696A CN 100499521 C CN100499521 C CN 100499521C
Authority
CN
China
Prior art keywords
network data
data
webpage
network
computer
Prior art date
Application number
CNB2006100626966A
Other languages
Chinese (zh)
Other versions
CN101072131A (en
Inventor
祝小斌
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Priority to CNB2006100626966A priority Critical patent/CN100499521C/en
Publication of CN101072131A publication Critical patent/CN101072131A/en
Application granted granted Critical
Publication of CN100499521C publication Critical patent/CN100499521C/en

Links

Abstract

The method and system are in use for monitoring response condition of computer in procedure of running web page. The method includes following steps: (1) obtaining all network data in monitored web page received from and sent to computer in procedure of running network; (2) based on all network data in web page to analyze response condition of each part in procedure of web page run by computer. The system includes data acquisition module, data recognition module, data storage module, and data analysis module. The invention solves issue that computer is unable to monitor running condition correctly and truly. Further, the invention monitors response condition of each part in procedure of downloading web page, and carries out reasonable optimization for web service based on response condition of each part.

Description

A kind of method and system of network operation monitoring

Technical field

The present invention relates to Internet technology, relate in particular to a kind of method and system of network monitor.

Background technology

Web service is one of service that occurs the earliest in the Internet, and along with Internet development, web service has now become the Internet service of present maximum.The speed of download of webpage often directly influences the quality that people enjoy Web service, owing to causing the slow-footed reason of page download but is many-sided, it may be the excessive or webserver overload of being moved of webpage, the Center Processing Unit Utilization that also might be local computer is crossed high reason, and if the excessive speed of download that causes of webpage is slow, specifically be which picture or flash etc. element is excessive causes, also be to optimize the situation that Web service need be understood.Therefore the situation that takies of the resources such as central processing unit, internal memory of the statistical web page visit capacity and the webserver is generally wanted in performance, the load of people in order to monitor Web server.The web page access quantitative statistics can realize that the current occupation condition of server generally is that the timing operation monitoring program is come the current occupation condition of collecting and reporting on server by increase modes such as counter at webpage.Optimize Web service according to these data.In order to monitor the response condition of webpage, installation testing instrument is on computers directly downloaded the test webpage in the prior art, and according to http protocol, downloads data such as the script used in web page code in the webpage and the webpage, picture, flash in order.According to the request time of webpage each several part with download size that the concluding time provides the each several part data, download situations such as consuming time.

But one of shortcoming of prior art is this technology is the mode that the simulation browser is opened webpage, but simulation can not embody real page download process fully, and the possibility of result that draws at last is not in full conformity with actual conditions.If ActiveX control is arranged in the webpage, when browser was opened webpage, if computer is not installed this control, whether browser can be downloaded earlier so, remind the user to install then.This process of downloading is consuming time more so, but is not because Web server overload, and is neither webpage excessive, but the browser downloads ActiveX control has expended the time.The testing tool of this situation in computer just can't monitor.Two of shortcoming is if webpage format is very complicated, contained content is a lot, testing tool is difficult to as the browser operate as normal, for example browser adopts multithreading to download web data, this requires testing tool also will adopt same thread scheduling, HTML to resolve as browser, and testing tool wants the situation of real monitoring network operation just to implement very difficulty so.

Summary of the invention

The invention provides a kind of method and system of network monitor, in order to solve in the page download process owing to non-webpage contents such as downloading ActiveX control increased the consuming time of webpage operation, perhaps because webpage format is too complicated, contained content is more, and the testing tool of computer can't monitor the problem of the true correct response condition of webpage.

For addressing the above problem, the invention provides following technical scheme:

A kind of method of network operation monitoring comprises the steps:

Step 1 is intercepted mode by bypass and is obtained in the network operation process computer and receive and the all-network data of sending relevant with the browser downloads webpage;

Whether the all-network data that step 2, identification are obtained are network datas of this monitoring, if the network data of this monitoring is then carried out step 3, otherwise abandon this network data;

Step 3, preservation comprise to be sent the zero-time of download request and downloads the network data of concluding time the webpage each several part;

Step 4, whether the all-network data of judging this monitoring are all collected and are finished, and finish then carry out step 5 if collected, and do not finish then continue to obtain network data if collect;

Step 5 is according to the response condition of each several part in the above-mentioned network data analysis computer run webpage process.

Described bypass is intercepted mode and is meant and obtains the network data that computer is received and sent under the situation that does not influence the normal operation of other programs in the computer.

Described network data comprises that the zero-time of sending download request and concluding time, each part of webpage and respective downloaded are consuming time, takies central processing unit size and/or committed memory size.

Described step 5 is according to http protocol the webpage of computer run to be analyzed.

Analyze described in the step 5 is to comprising that zero-time and concluding time, each part of webpage and the respective downloaded network data consuming time, that take central processing unit size and/or committed memory size of sending download request analyze.

The response condition of computer each several part comprises that webpage each several part size of data, webpage each several part are downloaded consuming time and flow, speed of response of server, central processing unit take situation and/or EMS memory occupation situation in the described step 5.

A kind of system of network operation monitoring, comprise data acquisition module, intercepting mode by bypass obtains in the network operation process computer and receives and the all-network data of sending relevant with the browser downloads webpage, data recognition module is used to distinguish whether the network data of obtaining is the network data of this monitoring, if then preserve network data, not then to abandon by data memory module; Data memory module is used to preserve and comprises the webpage each several part is sent the zero-time of download request and downloads the network data of concluding time, the data judge module is used to judge whether the network data of this monitoring all collects finishes, and determines that the all-network data collection finishes; And data analysis module, be used for response condition according to above-mentioned network data analysis computer run webpage process each several part.

By said method and system, solve computer and can't correctly monitor the problem of webpage ruuning situation really, realized real-time monitoring to operation webpage on the computer, the response condition of each several part in the monitoring webpage downloading process, and according to the response condition of each several part, reasonable optimizing is carried out in service to web.

Description of drawings

Fig. 1 is the inventive method flow chart;

Fig. 2 is a system construction drawing of the present invention;

Fig. 3 is the process schematic diagram of network data acquisition in the inventive method.

Embodiment

In order to make purpose of the present invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with drawings and Examples.

With reference to figure 2, the effect of each module and concern as follows in the system of the present invention:

Data acquisition module Q1 intercepts mode by bypass and obtains the all-network data relevant with the browser downloads webpage that need analyze.

Data recognition module Q2 distinguishes the all-network data that data acquisition module Q1 collects, and determines that the network data of obtaining is the network data that this monitoring needs, and these network datas are preserved on computers by data memory module Q3; Network data if not this monitoring needs then abandons these data.

Data judge module Q4, whether the network data of judging this monitoring is all collected and is preserved and finish, if do not collect fully, then continues to collect required network data by data acquisition module Q1, all collects and finishes until all network datas.

Data analysis module Q5 analyzes the all-network data relevant with this monitoring webpage of preserving on computers, and the output analysis result.

In conjunction with Fig. 1 and Fig. 2, the embodiment of the inventive method is as follows:

Step S1 obtains and these monitoring webpage relevant all-network data, promptly by data acquisition module collect need analyze with the relevant all-network data of this monitoring webpage.These network datas comprise the data of each several part in download request that computer sends and the download webpage process of receiving.In order to make the normal operation that does not influence local computer in the gatherer process, adopt bypass to intercept mode and obtain.

It is a kind of under the situation that does not influence the local computer operate as normal that mode is intercepted in bypass, obtain the method for data in the computer, among the present invention the network interface card in the computer is made as promiscuous mode, because under the general case, computer only responds two kinds of network packet, the i.e. packet that is complementary with this computer hardware address and the broadcast data packet of prosper all machines, therefore after network interface card was set to promiscuous mode, data acquisition module obtained all packets that this computer sends and receives by transmission and the raw data packets more than the receiving computer network layer.

Step S2, the data recognition module in the network monitoring system differentiates whether the network data of obtaining is the network data of this monitoring.At first determine the address of the webpage of this monitoring, it is the URL address of webpage, secondly when system monitoring when the GET/HTTP of the web page address that mails to appointment asks, illustrate that the browser of computer has begun the visit of named web page, network monitoring system starts immediately.When then network monitoring system monitors the request of other GET/HTTP that computer sends, in the URL address web pages downloaded HTML code of the destination address that data recognition module is judged this request this monitoring whether the time, if in this web pages downloaded HTML code, then this network data is the network of relation data of this monitoring webpage, and carries out step S3.In this web pages downloaded HTML code, then not network of relation data of this monitoring webpage, therefore abandon this network data.

Step S3 preserves collected network data by data memory module, comprises that computer sends the zero-time of download request and downloads the consuming time of each part in the webpage process.

Step S4 judges the network data that is kept in the data memory module by the data judge module, and whether the network data of judging this monitoring has been collected and finished.With reference to figure 3, whole process is similar to the analytic process of browser in the computer.Data acquisition module is according to the agreement of HTTP, download initial web page code and element wherein, comprise elements such as iframe, script, picture, flash in the data judge module analyzing web page code, if among the iframe that downloads, still comprise elements such as picture, flash, so also will continue to download the element that comprises among the iframe, by that analogy, all element is all downloaded and is finished in webpage, and network data of then judging monitoring has this time all been collected and finished.This step can also be seen complete the opening of all the elements in the webpage by artificial method operation in the browser of tester at computer, then impel monitoring system to stop the collection network data with outside control.

Step S5, data analysis module carries out Macro or mass analysis according to http protocol to the network data information that is kept in the data memory module, according to request time started of webpage each several part with download size that the concluding time provides the each several part data, download consuming time, webpage each several part flow, speed of response of server, and analyze central processing unit according to ruuning situation and take situation, EMS memory occupation situation, analyze and exports these analysis results after finishing when computer-chronograph.

By the monitoring to webpage ruuning situation, the resource occupation of grasp computer that can be at any time which part in the process of certain webpage of operation is excessive, and according to the Web service of analysis result reasonable optimizing.

Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.Those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (7)

1, a kind of method of network operation monitoring is characterized in that, comprises the steps:
Step 1 is intercepted mode by bypass and is obtained in the network operation process computer and receive and the all-network data of sending relevant with the browser downloads webpage;
Whether the all-network data that step 2, identification are obtained are network datas of this monitoring, if the network data of this monitoring is then carried out step 3, otherwise abandon this network data;
Step 3, preservation comprise to be sent the zero-time of download request and downloads the network data of concluding time the webpage each several part;
Step 4, whether the all-network data of judging this monitoring are all collected and are finished, and finish then carry out step 5 if collected, and do not finish then continue to obtain network data if collect;
Step 5 is according to the response condition of each several part in the above-mentioned network data analysis computer run webpage process.
According to the described method of claim 1, it is characterized in that 2, described bypass is intercepted mode and is meant and obtains the network data that computer is received and sent under the situation that does not influence the normal operation of other programs in the computer.
According to claim 1 or 2 described methods, it is characterized in that 3, described network data comprises that the zero-time of sending download request and concluding time, each part of webpage and respective downloaded are consuming time, takies central processing unit size and/or committed memory size.
According to claim 1 or 2 described methods, it is characterized in that 4, step 5 is according to http protocol the webpage of computer run to be analyzed.
5, according to claim 1 or 2 described methods, it is characterized in that analyzing described in the step 5 is to comprising that zero-time and concluding time, each part of webpage and the respective downloaded network data consuming time, that take central processing unit size and/or committed memory size of sending download request analyze.
6, according to claim 1 or 2 described methods, it is characterized in that the described response condition of step 5 comprises that webpage each several part size of data, webpage each several part are downloaded consuming time and flow, speed of response of server, central processing unit take situation and/or EMS memory occupation situation.
7, a kind of system of network operation monitoring is characterized in that, comprising:
Data acquisition module is used for obtaining network operation process computer and receives and the all-network data of sending relevant with the browser downloads webpage;
Data recognition module is used to distinguish whether the network data of obtaining is the network data of this monitoring, if then preserve network data by data memory module, is not then to abandon;
Data memory module is used to preserve and comprises the webpage each several part is sent the zero-time of download request and downloads the network data of concluding time;
The data judge module, whether the network data that is used to judge this monitoring is all collected and is finished, and determines that the all-network data collection finishes;
And data analysis module, be used for response condition according to above-mentioned network data analysis computer run webpage process each several part.
CNB2006100626966A 2006-09-19 2006-09-19 Network operation monitoring method and system CN100499521C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006100626966A CN100499521C (en) 2006-09-19 2006-09-19 Network operation monitoring method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006100626966A CN100499521C (en) 2006-09-19 2006-09-19 Network operation monitoring method and system

Publications (2)

Publication Number Publication Date
CN101072131A CN101072131A (en) 2007-11-14
CN100499521C true CN100499521C (en) 2009-06-10

Family

ID=38899132

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006100626966A CN100499521C (en) 2006-09-19 2006-09-19 Network operation monitoring method and system

Country Status (1)

Country Link
CN (1) CN100499521C (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9647913B2 (en) * 2010-11-16 2017-05-09 Avago Technologies General Ip (Singapore) Pte. Ltd. Measuring and managing power usage and cooling in a network
CN102624576B (en) * 2011-01-27 2016-04-20 腾讯科技(深圳)有限公司 A kind of method and system of web page download time of automatic test browser
CN102761467B (en) * 2011-04-25 2016-03-30 腾讯科技(深圳)有限公司 Calculate the methods, devices and systems of browsing device net page download time
CN102215146B (en) * 2011-06-20 2015-04-29 Tcl集团股份有限公司 Webpage downloading monitoring method and device
CN102508773B (en) * 2011-10-18 2014-12-31 深圳市易聆科信息技术有限公司 Method and device for monitoring WEB service system simulation based on Internet explorer (IE) kernel
US9426046B2 (en) * 2011-12-27 2016-08-23 Tektronix Texas, Llc Web page download time analysis
CN103001829A (en) * 2012-12-14 2013-03-27 大唐移动通信设备有限公司 Testing method and device of network data transmission
CN104426717A (en) * 2013-09-09 2015-03-18 中国电信股份有限公司 Method, home gateway and system for detecting quality of Internet applications
CN103632194A (en) * 2013-11-30 2014-03-12 林淑琴 Website visitor flow counter
EP2882135B1 (en) * 2013-12-05 2017-08-23 Accenture Global Services Limited Network server system, client device, computer program product and computer-implemented method
CN106161543A (en) * 2015-04-13 2016-11-23 腾讯科技(深圳)有限公司 CGI load monitoring method and apparatus

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
. .
入侵检测的旁路侦听的一种实现途径. 魏忠等.空军雷达学院学报,第15卷第4期. 2001
入侵检测的旁路侦听的一种实现途径. 魏忠等.空军雷达学院学报,第15卷第4期. 2001 *
基于HTTP的Web服务响应时间测试. 王倩倩等.南京邮电学院学报,第25卷第6期. 2005
基于HTTP的Web服务响应时间测试. 王倩倩等.南京邮电学院学报,第25卷第6期. 2005 *

Also Published As

Publication number Publication date
CN101072131A (en) 2007-11-14

Similar Documents

Publication Publication Date Title
AU2017206281B2 (en) System and method for improving access to search results
US9767006B2 (en) Deploying trace objectives using cost analyses
US9658936B2 (en) Optimization analysis using similar frequencies
US9530099B1 (en) Access to network content
US9767082B2 (en) Method and system of retrieving ajax web page content
EP2956858B1 (en) Periodicity optimization in an automated tracing system
CN105025081B (en) Monitor the method for mobile device used
US8190949B2 (en) Operations management apparatus, operations management system, data processing method, and operations management program
US20160036663A1 (en) Methods and computer program products for generating a model of network application health
EP2590081B1 (en) Method, computer program, and information processing apparatus for analyzing performance of computer system
US20180124203A1 (en) Extensible, asynchronous, centralized analysis and optimization of server responses to client requests
AU2011352038B2 (en) Online privacy management
CN102624920B (en) A kind of method of being conducted interviews by proxy server and device
US6304904B1 (en) Method and apparatus for collecting page-level performance statistics from a network device
US7093169B2 (en) Method, system, and program for diagnosing a computer in a network system
AU2002332740C1 (en) Method for measuring performance metrics of a wireless device
Cheng et al. Software architecture-based adaptation for pervasive systems
US6411998B1 (en) World wide web internet delay monitor
CN105487930B (en) A kind of optimizing and scheduling task method based on Hadoop
US8578017B2 (en) Automatic correlation of service level agreement and operating level agreement
US20130283240A1 (en) Application Tracing by Distributed Objectives
JP5160556B2 (en) Log file analysis method and system based on distributed computer network
US10567407B2 (en) Method and system for detecting malicious web addresses
CN100451989C (en) Software testing system and testing method
CN101662506B (en) Load balancing method based on CPU kernel sharing and device thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant