CN102508779B - Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same - Google Patents

Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same Download PDF

Info

Publication number
CN102508779B
CN102508779B CN201110364342.8A CN201110364342A CN102508779B CN 102508779 B CN102508779 B CN 102508779B CN 201110364342 A CN201110364342 A CN 201110364342A CN 102508779 B CN102508779 B CN 102508779B
Authority
CN
China
Prior art keywords
performance test
test script
markup language
extensible markup
link
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110364342.8A
Other languages
Chinese (zh)
Other versions
CN102508779A (en
Inventor
王士博
王巍
李建涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING BEWINNER COMMUNICATIONS TECHNOLOGY Co Ltd
Original Assignee
BEIJING BEWINNER COMMUNICATIONS TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING BEWINNER COMMUNICATIONS TECHNOLOGY Co Ltd filed Critical BEIJING BEWINNER COMMUNICATIONS TECHNOLOGY Co Ltd
Priority to CN201110364342.8A priority Critical patent/CN102508779B/en
Publication of CN102508779A publication Critical patent/CN102508779A/en
Application granted granted Critical
Publication of CN102508779B publication Critical patent/CN102508779B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The invention discloses an automatic performance test script generating system based on web crawler logs and an automatic performance test script generating method based on the same. The system comprises a crawler log analysis module, an interlinking logic display module and a performance test script generating module, wherein the crawler log analysis module is used for enabling a hierarchical relationship judged by the web crawler logs on accessed links and links related to access to generate a corresponding tree-like structure chart and sending an extensible markup language file of the tree-like structure chart to the interlinking logic display module; the interlinking logic display module is used for receiving the sent extensible markup language file of the tree-like structure chart, logically generating a corresponding extensible markup language file for page presentation and sending the extensible markup language file for page presentation to the performance test script generating module; and the performance test script generating module is used for receiving the extensible markup language file for page presentation and generating a performance test script according to the accessed links and the links related to the access. The system solves the problem that a system in the prior art is incapable of performing complete test on webpage accessibility.

Description

The performance test script robotization generation system of reptile daily record Network Based and method
Technical field
The present invention relates to performance test script and generate field, particularly relate to a kind of performance test script robotization generation system and method for reptile daily record Network Based.
Background technology
The pressure test script of current web site multi-interface, mostly be and manually write for main test page or record, the cycle that this script generates is long, may be inaccurate, and just cover a part of page; And when the performance test of the multistage complex page of similar portal website, be difficult to fast and accurately by the access test script manually writing or record the complete pages at different levels.
Web crawlers instrument is a kind of instrument being exclusively used in hierarchical relationship between the page, although this instrument tentatively can obtain complicated website levels level page relation of plane, and can not as the instrument of performance test.
In sum, of the prior art cannot realization carries out complete test to web page access performance.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of performance test script robotization generation system and method for reptile daily record Network Based, can carry out complete test to solve to web page access performance.
For solving the problems of the technologies described above, the invention provides a kind of performance test script robotization generation system of reptile daily record Network Based, it is characterized in that, comprising: reptile log analysis module, link logic display module and performance test script generation module; Wherein,
Reptile log analysis module, for web crawlers daily record is generated corresponding tree structure figure to the hierarchical relationship that the link that the link of access and this access relate to is judged, and the extensible markup language document of this tree structure figure is sent to described link logic display module;
Link logic display module, for receiving the extensible markup language document of this tree structure figure that described reptile log analysis module is sent, and logic generates the extensible markup language document of corresponding displayed page, and the extensible markup language document of this displayed page is sent to described performance test script generation module;
Performance test script generation module, for receiving the extensible markup language document of described displayed page, and generates performance test script according to the link that link and this access of this access relate to.
Further, wherein, be also provided with in described link logic display module:
Manual intervention interface, for receiving the access rights of the described tree structure figure that user is arranged, and the extensible markup language document of corresponding displayed page is generated according to these access rights adjustment logic, the extensible markup language document of the displayed page containing manual intervention parameter is sent to described performance test script generation module.
Further, wherein, described web crawlers daily record is HERITRIX daily record (Heritrix is a reptile framework, can add as entered some interchangeable assemblies)
Further, wherein, the type of described performance test script is Jmeter type (JMeter is the open source code project of Apache tissue, and it is the instrument of function and performance test) or LoadRunner type (LoadRunner is the load testing instrument of a kind of prognoses system behavior and performance).
Further, wherein, described tree structure figure is the link structure related to the link of the form of page displaying this access described and this access, the corresponding extensible markup language document in its backstage.
For solving the problems of the technologies described above, present invention also offers a kind of performance test script automatic generating method of reptile daily record Network Based, it is characterized in that, comprising:
Web crawlers daily record is generated corresponding tree structure figure to the hierarchical relationship that the link that the link of access and this access relate to is judged;
Receive the extensible markup language document of this tree structure figure, and logic generates the extensible markup language document of corresponding displayed page;
Receive the extensible markup language document of described displayed page, and generate performance test script according to the link that link and this access of this access relate to.
Further, wherein, the extensible markup language document of the tree-shaped structural drawing of described reception simultaneously, by receiving the access rights of the described tree structure figure that user is arranged, and generate the extensible markup language document of corresponding displayed page according to these access rights adjustment logic, the extensible markup language document of the displayed page of final generation containing manual intervention parameter.
Further, wherein, described web crawlers daily record is HERITRIX daily record.
Further, wherein, the type of described performance test script is Jmeter type or LoadRunner type.
Further, wherein, described tree structure figure is the link structure related to the link of the form of page displaying this access described and this access, the corresponding extensible markup language document in its backstage.
Compared with prior art, the present invention mainly solves and can carry out complete test to web page access performance; The hierarchical relationship of targeted website can also be analyzed simultaneously, form tree structure figure clearly, page level clear and definite more; There is provided user to arrange interface, user can adjust the logic of performance test script; And can automatically form the performance test script that can be used for performance testing tool to use, substantially increase the efficiency and accuracy of writing performance test script.
Accompanying drawing explanation
The performance test script robotization generation system structural drawing that Fig. 1 is the reptile daily record Network Based described in the embodiment of the present invention one.
Fig. 2 is the performance test script automatic generating method process flow diagram of the reptile daily record Network Based described in the embodiment of the present invention two.
The performance test script robotization generation system that Fig. 3 is the reptile daily record Network Based described in the embodiment of the present invention one is with the structural drawing of manual intervention interface.
Fig. 4 is the schematic diagram of the tree structure described in the embodiment of the present invention one.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail, but not as a limitation of the invention.
As shown in Figure 1, be the performance test script robotization generation system of the reptile daily record Network Based described in the embodiment of the present invention one, comprise: reptile log analysis module 101, link logic display module 102 and performance test script generation module 103; Wherein,
Reptile log analysis module 101, for web crawlers daily record is generated corresponding tree structure figure (as shown in Figure 4) to the hierarchical relationship that the link that the link of access and this access relate to (Refer) is judged, and the XML file (extend markup language, Extensible Markup Language) of this tree structure figure is sent to link logic display module 102.Here XML file only comprises the hierarchical relationship information between the page).
In the present embodiment, described web crawlers daily record can adopt HERITRIX daily record (Heritrix is a reptile framework, can add as entered some interchangeable assemblies).
Link logic display module 102, for receiving the XML file of the tree structure figure that reptile log analysis module 101 is sent, and logic generates the XML file (XML file here comprises the additional parametric information of page hierarchical relationship and acquiescence) of corresponding displayed page, and the XML file of displayed page is sent to described performance test script generation module 103;
Wherein, all right further: to be provided with in (as shown in Figure 3) link logic display module 102: manual intervention interface 1021 is for receiving the access rights of the described tree structure figure of user's setting, and the XML file of displayed page is generated according to this authority adjustment logic, the XML file of the displayed page finally containing manual intervention parameter is sent to described performance test script generation module 103.
Here the effect adopting manual intervention interface 1021 is that user can be provided with different weights for different linking, and there is different selection strategies in different branches; Corresponding test script can also be generated to the logic of tree structure figure to confirm, can also regenerate if not corresponding.
Performance test script generation module 103, for receiving the XML file of described displayed page, and relates to the link of (Refer) according to the link of this access and this access and additional parameter generates performance test script.
Wherein, the type of the performance test script of described generation, comprise: the performance test scripts such as Jmeter type (JMeter is the open source code project of Apache tissue, and it is the instrument of function and performance test) or LoadRunner type (LoadRunner is the load testing instrument of a kind of prognoses system behavior and performance).
As shown in Figure 2, be the performance test script automatic generating method of the reptile daily record Network Based described in the embodiment of the present invention two, comprise step:
Step 201, generates corresponding tree structure figure by web crawlers daily record to the hierarchical relationship that the link that the link of access and this access relate to (Refer) is judged; Here XML file only comprises the hierarchical relationship information between the page).
Step 202, generates the XML file (XML file here comprises the additional parametric information of page hierarchical relationship and acquiescence) of corresponding displayed page according to the XML file logic of this tree structure figure.
Wherein, can also be further: by receiving the access rights of the described tree structure figure that user is arranged, and adjusting the XML file of the displayed page that logic generates according to these access rights, finally generating the XML file of the displayed page containing manual intervention parameter.
Step 203, according to the XML file of described displayed page, and relates to the link of (Refer) according to the link of this access and this access and additional parameter generates performance test script.
As shown in Figure 4, be " tree structure figure " schematic diagram mentioned in above-described embodiment one, two, wherein homepage is ground floor, and physical culture, news and music belong to the second layer, and domestic, international, popular and classics then belong to third layer.Tree structure figure is: the link structure that the linking structure of web station easily checked for user shows with the form of the page, the link of this access and this access relate to, the corresponding XML file in its backstage.
The present invention, mainly by web crawlers daily record, can analyze the linking layer level structure of website, and automatically can generate the performance test script for target detection website; The object of the invention is to construct a bridge between web crawlers daily record and performance testing tool, realize the function automatically generating performance test script according to the actual link hierarchical relationship of website.
In sum, compared with prior art, the present invention mainly solves the recursive scanning work of the pages at different levels of complicated targeted website, is completed, and achieve quick and precisely by reptile instrument; The hierarchical relationship of targeted website can also be analyzed simultaneously, form tree structure figure clearly, page level clear and definite more; There is provided user to arrange interface, user can adjust the logic of performance test script; And can automatically form the performance test script that can be used for performance testing tool to use, substantially increase the efficiency and accuracy of writing performance test script.
Certainly; the present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those of ordinary skill in the art can make various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection domain that all should belong to the claim appended by the present invention.

Claims (10)

1. a performance test script robotization generation system for reptile daily record Network Based, is characterized in that, comprising: reptile log analysis module, link logic display module and performance test script generation module; Wherein,
Reptile log analysis module, for web crawlers daily record is generated corresponding tree structure figure to the hierarchical relationship that the link that the link of access and this access relate to is judged, and the extensible markup language document of this tree structure figure is sent to described link logic display module;
Link logic display module, for receiving the extensible markup language document of this tree structure figure that described reptile log analysis module is sent, and logic generates the extensible markup language document of corresponding displayed page, and the extensible markup language document of this displayed page is sent to described performance test script generation module;
Performance test script generation module, for receiving the extensible markup language document of described displayed page, and generates performance test script according to the link that link and this access of this access relate to.
2. the performance test script robotization generation system of reptile daily record Network Based as claimed in claim 1, is characterized in that, is also provided with in described link logic display module:
Manual intervention interface, for receiving the access rights of the described tree structure figure that user is arranged, and the extensible markup language document of displayed page is generated according to these access rights adjustment logic, the extensible markup language document of the displayed page finally containing manual intervention parameter is sent to described performance test script generation module.
3. the performance test script robotization generation system of reptile daily record Network Based as claimed in claim 1, is characterized in that, described web crawlers daily record is HERITRIX daily record.
4. the performance test script robotization generation system of reptile daily record Network Based as claimed in claim 1, is characterized in that, the type of described performance test script is Jmeter type or LoadRunner type.
5. the performance test script robotization generation system of reptile daily record Network Based as claimed in claim 1, it is characterized in that, described tree structure figure is the link structure related to the link of the form of page displaying this access described and this access, the corresponding extensible markup language document in its backstage.
6. a performance test script automatic generating method for reptile daily record Network Based, is characterized in that, comprising:
Web crawlers daily record is generated corresponding tree structure figure to the hierarchical relationship that the link that the link of access and this access relate to is judged;
The extensible markup language document of corresponding displayed page is generated according to the extensible markup language document logic of this tree structure figure;
According to the extensible markup language document of described displayed page, and generate performance test script according to the link that link and this access of this access relate to.
7. the performance test script automatic generating method of reptile daily record Network Based as claimed in claim 6, it is characterized in that, be further: receive the extensible markup language document of tree-shaped structural drawing simultaneously, by receiving the access rights of the described tree structure figure that user is arranged, and generate the extensible markup language document of displayed page according to these access rights adjustment logic, the final extensible markup language document generating the displayed page containing manual intervention parameter.
8. the performance test script automatic generating method of reptile daily record Network Based as claimed in claim 6, is characterized in that, described web crawlers daily record is HERITRIX daily record.
9. the performance test script automatic generating method of reptile daily record Network Based as claimed in claim 6, is characterized in that, the type of described performance test script is Jmeter type or LoadRunner type.
10. the performance test script automatic generating method of reptile daily record Network Based as claimed in claim 6, it is characterized in that, described tree structure figure is the link structure related to the link of the form of page displaying this access described and this access, the corresponding extensible markup language document in its backstage.
CN201110364342.8A 2011-11-17 2011-11-17 Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same Expired - Fee Related CN102508779B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110364342.8A CN102508779B (en) 2011-11-17 2011-11-17 Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110364342.8A CN102508779B (en) 2011-11-17 2011-11-17 Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same

Publications (2)

Publication Number Publication Date
CN102508779A CN102508779A (en) 2012-06-20
CN102508779B true CN102508779B (en) 2015-04-22

Family

ID=46220871

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110364342.8A Expired - Fee Related CN102508779B (en) 2011-11-17 2011-11-17 Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same

Country Status (1)

Country Link
CN (1) CN102508779B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729285B (en) * 2012-10-11 2018-06-05 腾讯科技(深圳)有限公司 A kind of webpage test method, equipment and system
US10509717B1 (en) 2016-10-05 2019-12-17 Amdocs Development Limited System, method, and computer program for automatically testing software applications including dynamic web pages
CN107402882B (en) * 2017-07-21 2020-11-06 杭州迪普科技股份有限公司 Web page testing method and device
CN108427639B (en) * 2018-01-24 2021-05-07 深圳壹账通智能科技有限公司 Automated testing method, application server and computer readable storage medium
CN109614308A (en) * 2018-10-16 2019-04-12 深圳壹账通智能科技有限公司 Test data generating method, device and computer equipment based on crawler log
CN109408701B (en) * 2018-11-08 2021-01-15 网易(杭州)网络有限公司 Method and device for displaying crawling path of web crawler
CN109522723B (en) * 2018-11-14 2023-11-03 平安科技(深圳)有限公司 POC script generation method and device, electronic equipment and storage medium
CN109783753A (en) * 2018-12-14 2019-05-21 平安普惠企业管理有限公司 The tree-shaped drawing generating method of web site url, device, equipment and storage medium
CN113342644B (en) * 2021-05-31 2024-03-26 中国工商银行股份有限公司 Automatic test script generation method and device based on grammar analysis technology
CN116974922B (en) * 2023-07-25 2024-05-17 摩尔线程智能科技(北京)有限责任公司 Performance analysis method, device, equipment and storage medium of deep learning model

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101217425A (en) * 2008-01-04 2008-07-09 中兴通讯股份有限公司 Web testing method and device
CN101582075A (en) * 2009-06-24 2009-11-18 大连海事大学 Web information extraction system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060190561A1 (en) * 2002-06-19 2006-08-24 Watchfire Corporation Method and system for obtaining script related information for website crawling
US7334220B2 (en) * 2004-03-11 2008-02-19 Microsoft Corporation Data driven test automation of web sites and web services
CN101848116A (en) * 2010-04-21 2010-09-29 中国海洋大学 Simple and quick automatic pressure test method of Web server

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101217425A (en) * 2008-01-04 2008-07-09 中兴通讯股份有限公司 Web testing method and device
CN101582075A (en) * 2009-06-24 2009-11-18 大连海事大学 Web information extraction system

Also Published As

Publication number Publication date
CN102508779A (en) 2012-06-20

Similar Documents

Publication Publication Date Title
CN102508779B (en) Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same
CN104598376B (en) The layering automatization test system and method for a kind of data-driven
CN107704393B (en) Data test method, apparatus and electronic equipment
CN103729285A (en) Method, device and system for testing web page
CN103530223A (en) Method and device for automatically generating unit test cases
CN103823747A (en) Automatic regression testing method
CN104572463A (en) Method and device for testing interface information
CN103605606B (en) A kind of embedded software test use-case batch execution method that can automatically change
CN107451112B (en) Form tool data checking method, device, terminal equipment and storage medium
CN105138461A (en) Interface testing method and device for application program
CN105808417A (en) Automated testing method and proxy server
CN104657274B (en) software interface test method and device
CN104111852A (en) Web application automated testing system and testing method based on data drive
CN107968833A (en) A kind of cloud application performance monitoring method based on execution route
CN103810090B (en) The method of nuclear plant digital code installation and debugging checking, rise version method and platform
CN109871312A (en) A kind of interface test method, device, equipment and readable storage medium storing program for executing
CN103885341B (en) Performance analysis system based on automotive performance simulator and method
CN101770388A (en) Method and device for obtaining chip code information
CN105630678B (en) A kind of the reliability detector and its detection method of intelligent electric energy meter software
CN105224465A (en) Webpage adjustment method and device
CN102043720A (en) Method and device for generating test data automatically by utilizing structured query language (SQL) sentences
CN109446047B (en) Performance test platform script storage method, device, equipment and storage medium
CN103235757B (en) Several apparatus and method that input domain tested object is tested are made based on robotization
CN101673200B (en) The detection method of user input model and device
CN105573972B (en) The generation method and device of report check formula

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150422

Termination date: 20201117