CN102508779A - Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same - Google Patents
Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same Download PDFInfo
- Publication number
- CN102508779A CN102508779A CN2011103643428A CN201110364342A CN102508779A CN 102508779 A CN102508779 A CN 102508779A CN 2011103643428 A CN2011103643428 A CN 2011103643428A CN 201110364342 A CN201110364342 A CN 201110364342A CN 102508779 A CN102508779 A CN 102508779A
- Authority
- CN
- China
- Prior art keywords
- performance test
- test script
- markup language
- extensible markup
- language file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013515 script Methods 0.000 title claims abstract description 65
- 238000011056 performance test Methods 0.000 title claims abstract description 60
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000012360 testing method Methods 0.000 claims abstract description 17
- 238000010586 diagram Methods 0.000 claims description 31
- 230000006870 function Effects 0.000 description 3
- 230000008520 organization Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention discloses an automatic performance test script generating system based on web crawler logs and an automatic performance test script generating method based on the same. The system comprises a crawler log analysis module, an interlinking logic display module and a performance test script generating module, wherein the crawler log analysis module is used for enabling a hierarchical relationship judged by the web crawler logs on accessed links and links related to access to generate a corresponding tree-like structure chart and sending an extensible markup language file of the tree-like structure chart to the interlinking logic display module; the interlinking logic display module is used for receiving the sent extensible markup language file of the tree-like structure chart, logically generating a corresponding extensible markup language file for page presentation and sending the extensible markup language file for page presentation to the performance test script generating module; and the performance test script generating module is used for receiving the extensible markup language file for page presentation and generating a performance test script according to the accessed links and the links related to the access. The system solves the problem that a system in the prior art is incapable of performing complete test on webpage accessibility.
Description
Technical Field
The invention relates to the field of performance test script generation, in particular to a system and a method for automatically generating a performance test script based on a web crawler log.
Background
At present, pressure test scripts of multi-level pages of a web website are mostly manually written or recorded aiming at main test pages, the generation period of the scripts is long, the scripts are possibly inaccurate, and only a part of the pages are covered; when the performance test of multi-level complex pages similar to a portal website is faced, it is difficult to write or record complete access test scripts of all levels of pages manually and accurately.
The web crawler tool is a tool special for the hierarchical relationship between pages, and although the tool can preliminarily obtain the relationship between upper and lower hierarchical pages of a complex website, the tool cannot be used as a tool for performance testing.
In summary, the prior art cannot completely test the access performance of the web page.
Disclosure of Invention
The invention aims to provide a performance test script automatic generation system and method based on a web crawler log, so as to realize complete test of the access performance of a webpage.
In order to solve the technical problem, the invention provides an automatic generation system of a performance test script based on a web crawler log, which is characterized by comprising the following steps: the system comprises a crawler log analysis module, a link logic display module and a performance test script generation module; wherein,
the crawler log analysis module is used for generating a corresponding tree structure diagram according to the hierarchical relationship of the access link of the web crawler log and the link related to the access and sending the extensible markup language file of the tree structure diagram to the link logic display module;
the link logic display module is used for receiving the extensible markup language file of the tree structure diagram sent by the crawler log analysis module, logically generating the extensible markup language file of the corresponding display page, and sending the extensible markup language file of the display page to the performance test script generation module;
and the performance test script generating module is used for receiving the extensible markup language file of the display page and generating a performance test script according to the accessed link and the link related to the access.
Further, the link logic display module is further provided with:
and the manual intervention interface is used for receiving the access authority of the tree structure chart set by the user, generating an extensible markup language file of a corresponding display page according to the access authority adjusting logic and sending the extensible markup language file of the display page containing manual intervention parameters to the performance test script generating module.
Further, wherein the web crawler log is a HERITRIX log (Heritrix is a crawler framework, and interchangeable components can be added)
Further, the type of the performance test script is a Jmeter type (Jmeter is an open source code item of Apache organization, which is a tool for function and performance test) or a LoadRunner type (LoadRunner is a load test tool for predicting system behavior and performance).
Further, the tree structure diagram shows the accessed link and the link structure involved in the access in the form of a page, and the background of the tree structure diagram corresponds to an extensible markup language file.
In order to solve the technical problem, the invention also provides a performance test script automatic generation method based on the web crawler log, which is characterized by comprising the following steps:
generating a corresponding tree structure diagram by the links accessed by the web crawler log and the hierarchical relationship judged by the links involved in the access;
receiving the extensible markup language file of the tree structure chart, and logically generating the extensible markup language file of the corresponding display page;
and receiving the extensible markup language file of the display page, and generating a performance test script according to the accessed link and the link related to the access.
And further, receiving the extensible markup language file of the tree structure diagram, and generating the extensible markup language file of the display page containing the manual intervention parameters by receiving the access authority of the tree structure diagram set by the user and adjusting the logic according to the access authority to generate the extensible markup language file of the corresponding display page.
Further, wherein the web crawler log is a HERITRIX log.
Further, the type of the performance test script is a meter type or a LoadRunner type.
Further, the tree structure diagram shows the accessed link and the link structure involved in the access in the form of a page, and the background of the tree structure diagram corresponds to an extensible markup language file.
Compared with the prior art, the method mainly solves the problem that the access performance of the webpage can be completely tested; meanwhile, the hierarchical relationship of the target website can be analyzed to form a clear tree structure diagram, so that the page hierarchy is clearer and more clear; providing a user setting interface, wherein the user can adjust the logic of the performance test script; and the performance test script which can be used by the performance test tool can be automatically formed, so that the efficiency and the accuracy of compiling the performance test script are greatly improved.
Drawings
Fig. 1 is a structural diagram of an automated performance testing script generation system based on web crawler logs according to a first embodiment of the present invention.
Fig. 2 is a flowchart of an automated performance testing script generation method based on web crawler logs according to a second embodiment of the present invention.
Fig. 3 is a structural diagram of an automated performance testing script generation system with a manual intervention interface according to a web crawler log in an embodiment of the present invention.
Fig. 4 is a schematic diagram of a tree structure according to a first embodiment of the present invention.
Detailed Description
The present invention will be described in further detail below with reference to the accompanying drawings, but the present invention is not limited thereto.
As shown in fig. 1, an automatic generation system of a performance test script based on a web crawler log according to a first embodiment of the present invention includes: a crawler log analysis module 101, a link logic display module 102 and a performance test script generation module 103; wherein,
the crawler log analysis module 101 is configured to generate a corresponding tree structure diagram (as shown in fig. 4) from a hierarchical relationship determined by a link of the web crawler log to access and a link related to the access (Refer), and send an XML file (Extensible Markup Language) of the tree structure diagram to the link logic display module 102. The XML file here contains only hierarchical relationship information between pages).
In this embodiment, the web crawler log may be a HERITRIX log (Heritrix is a crawler framework, and some interchangeable components may be added).
A link logic display module 102, configured to receive the XML file of the tree-like structure diagram sent by the crawler log analysis module 101, logically generate a corresponding XML file of a display page (where the XML file includes a page hierarchy relationship and default additional parameter information), and send the XML file of the display page to the performance test script generation module 103;
wherein, further still can: the link logic display module 102 (shown in fig. 3) is provided with: the manual intervention interface 1021 is configured to receive an access right of the tree structure diagram set by the user, generate an XML file of a display page according to the right adjustment logic, and send the XML file of the display page, which finally contains manual intervention parameters, to the performance test script generation module 103.
The manual intervention interface 1021 is used for setting different weights for different links by a user, and different branches have different selection strategies; and the logic generation of the tree structure chart can be confirmed to correspond to the test script, and if the logic generation does not correspond to the test script, the logic generation can be regenerated.
And the performance test script generating module 103 is configured to receive the XML file of the presentation page, and generate a performance test script according to the accessed link, the link involved in the access (Refer), and the additional parameter.
Wherein the type of the generated performance test script comprises: a meter type (Jmeter is an open source code item of the Apache organization, which is a tool for function and performance testing) or a LoadRunner type (LoadRunner is a load testing tool for predicting system behavior and performance).
As shown in fig. 2, a method for automatically generating a performance test script based on a web crawler log according to a second embodiment of the present invention includes:
Wherein, further still can be: and finally generating the XML file of the display page containing the manual intervention parameters by receiving the access authority of the tree structure chart set by the user and adjusting the XML file of the display page generated by the logic according to the access authority.
Fig. 4 is a schematic diagram of the tree structure diagram mentioned in the first and second embodiments, wherein the home page is the first layer, the second layer is sports, news and music, and the third layer is national, international, popular and classical. The tree structure diagram is: and displaying the link structure of the easily viewed website, the accessed link and the link structure related to the access for the user in the form of a page, wherein the background of the page corresponds to the XML file.
The method mainly comprises the steps that by means of the web crawler log, the link hierarchical structure of the website can be analyzed, and a performance test script aiming at a target test website can be automatically generated; the invention aims to construct a bridge between a web crawler log and a performance test tool, and realize the function of automatically generating a performance test script according to the actual link hierarchical relation of a website.
In conclusion, compared with the prior art, the method mainly solves the problem that the recursive scanning work of all levels of pages of a complicated target website is completed by a crawler tool, and is quick and accurate; meanwhile, the hierarchical relationship of the target website can be analyzed to form a clear tree structure diagram, so that the page hierarchy is clearer and more clear; providing a user setting interface, wherein the user can adjust the logic of the performance test script; and the performance test script which can be used by the performance test tool can be automatically formed, so that the efficiency and the accuracy of compiling the performance test script are greatly improved.
The present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof, and it is therefore intended that all such changes and modifications as fall within the true spirit and scope of the invention be considered as within the following claims.
Claims (10)
1. A performance test script automatic generation system based on web crawler logs is characterized by comprising: the system comprises a crawler log analysis module, a link logic display module and a performance test script generation module; wherein,
the crawler log analysis module is used for generating a corresponding tree structure diagram according to the hierarchical relationship of the access link of the web crawler log and the link related to the access and sending the extensible markup language file of the tree structure diagram to the link logic display module;
the link logic display module is used for receiving the extensible markup language file of the tree structure diagram sent by the crawler log analysis module, logically generating the extensible markup language file of the corresponding display page, and sending the extensible markup language file of the display page to the performance test script generation module;
and the performance test script generating module is used for receiving the extensible markup language file of the display page and generating a performance test script according to the accessed link and the link related to the access.
2. The web crawler log based performance test script automated generation system of claim 1, wherein the link logic presentation module further comprises:
and the manual intervention interface is used for receiving the access authority of the tree structure chart set by the user, adjusting the logic according to the access authority to generate an extensible markup language file of the display page, and finally sending the extensible markup language file of the display page containing the manual intervention parameters to the performance test script generation module.
3. The web crawler log based performance test script automated generation system of claim 1, wherein the web crawler log is a HERITRIX log.
4. The web crawler log based performance test script automated generation system of claim 1, wherein the type of the performance test script is a meter type or a LoadRunner type.
5. The web crawler log based performance testing script automatic generation system of claim 1, wherein said tree structure diagram is a page showing said accessed link and the link structure related to said access, and its background corresponds to the extensible markup language file.
6. A performance test script automatic generation method based on a web crawler log is characterized by comprising the following steps:
generating a corresponding tree structure diagram by the links accessed by the web crawler log and the hierarchical relationship judged by the links involved in the access;
generating an extensible markup language file of a corresponding display page according to the extensible markup language file logic of the tree structure chart;
and generating a performance test script according to the extensible markup language file of the display page and the accessed link and the link related to the access.
7. The web crawler log based performance test script automated generation method of claim 6, further comprising: and receiving the extensible markup language file of the tree structure chart, and generating the extensible markup language file of the display page containing the manual intervention parameters by receiving the access authority of the tree structure chart set by the user and adjusting logic according to the access authority to finally generate the extensible markup language file of the display page.
8. The method for automated generation of web crawler log based performance test scripts according to claim 6, wherein the web crawler log is a HERITRIX log.
9. The web crawler log based performance test script automatic generation method of claim 6, wherein the type of the performance test script is a Jmeter type or a LoadRunner type.
10. The method according to claim 6, wherein the tree structure diagram is a page showing the accessed links and the link structures related to the access, and the background of the tree structure diagram corresponds to an extensible markup language file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110364342.8A CN102508779B (en) | 2011-11-17 | 2011-11-17 | Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110364342.8A CN102508779B (en) | 2011-11-17 | 2011-11-17 | Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102508779A true CN102508779A (en) | 2012-06-20 |
| CN102508779B CN102508779B (en) | 2015-04-22 |
Family
ID=46220871
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110364342.8A Expired - Fee Related CN102508779B (en) | 2011-11-17 | 2011-11-17 | Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102508779B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103729285A (en) * | 2012-10-11 | 2014-04-16 | 腾讯科技（深圳）有限公司 | Method, device and system for testing web page |
| CN107402882A (en) * | 2017-07-21 | 2017-11-28 | 杭州迪普科技股份有限公司 | Web page method of testing and device |
| CN108427639A (en) * | 2018-01-24 | 2018-08-21 | 深圳壹账通智能科技有限公司 | Automated testing method, application server and computer readable storage medium |
| CN109408701A (en) * | 2018-11-08 | 2019-03-01 | 网易（杭州）网络有限公司 | A kind of web crawlers crawls the methods of exhibiting and device in path |
| CN109522723A (en) * | 2018-11-14 | 2019-03-26 | 平安科技（深圳）有限公司 | POC scenario generation method, device, electronic equipment and storage medium |
| CN109614308A (en) * | 2018-10-16 | 2019-04-12 | 深圳壹账通智能科技有限公司 | Test data generating method, device and computer equipment based on crawler log |
| CN109783753A (en) * | 2018-12-14 | 2019-05-21 | 平安普惠企业管理有限公司 | The tree-shaped drawing generating method of web site url, device, equipment and storage medium |
| US10509717B1 (en) | 2016-10-05 | 2019-12-17 | Amdocs Development Limited | System, method, and computer program for automatically testing software applications including dynamic web pages |
| CN112579860A (en) * | 2019-09-30 | 2021-03-30 | 北京国双科技有限公司 | Method and device for processing digital page turning task, storage medium and electronic equipment |
| CN113342644A (en) * | 2021-05-31 | 2021-09-03 | 中国工商银行股份有限公司 | Test script automatic generation method and device based on syntax analysis technology |
| CN116974922A (en) * | 2023-07-25 | 2023-10-31 | 摩尔线程智能科技(北京)有限责任公司 | Performance analysis method, device, equipment and storage medium of deep learning model |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050267976A1 (en) * | 2004-03-11 | 2005-12-01 | Microsoft Corporation | Data driven test automation of web sites and web services |
| CN101217425A (en) * | 2008-01-04 | 2008-07-09 | 中兴通讯股份有限公司 | Web testing method and device |
| CN101582075A (en) * | 2009-06-24 | 2009-11-18 | 大连海事大学 | Web information extraction system |
| CN101848116A (en) * | 2010-04-21 | 2010-09-29 | 中国海洋大学 | Simple and quick automatic pressure test method of Web server |
| US20110173178A1 (en) * | 2002-06-19 | 2011-07-14 | Craig Conboy | Method and system for obtaining script related information for website crawling |
-
2011
- 2011-11-17 CN CN201110364342.8A patent/CN102508779B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110173178A1 (en) * | 2002-06-19 | 2011-07-14 | Craig Conboy | Method and system for obtaining script related information for website crawling |
| US20050267976A1 (en) * | 2004-03-11 | 2005-12-01 | Microsoft Corporation | Data driven test automation of web sites and web services |
| CN101217425A (en) * | 2008-01-04 | 2008-07-09 | 中兴通讯股份有限公司 | Web testing method and device |
| CN101582075A (en) * | 2009-06-24 | 2009-11-18 | 大连海事大学 | Web information extraction system |
| CN101848116A (en) * | 2010-04-21 | 2010-09-29 | 中国海洋大学 | Simple and quick automatic pressure test method of Web server |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103729285B (en) * | 2012-10-11 | 2018-06-05 | 腾讯科技（深圳）有限公司 | A kind of webpage test method, equipment and system |
| CN103729285A (en) * | 2012-10-11 | 2014-04-16 | 腾讯科技（深圳）有限公司 | Method, device and system for testing web page |
| US10509717B1 (en) | 2016-10-05 | 2019-12-17 | Amdocs Development Limited | System, method, and computer program for automatically testing software applications including dynamic web pages |
| CN107402882A (en) * | 2017-07-21 | 2017-11-28 | 杭州迪普科技股份有限公司 | Web page method of testing and device |
| CN107402882B (en) * | 2017-07-21 | 2020-11-06 | 杭州迪普科技股份有限公司 | Web page testing method and device |
| CN108427639A (en) * | 2018-01-24 | 2018-08-21 | 深圳壹账通智能科技有限公司 | Automated testing method, application server and computer readable storage medium |
| CN109614308A (en) * | 2018-10-16 | 2019-04-12 | 深圳壹账通智能科技有限公司 | Test data generating method, device and computer equipment based on crawler log |
| CN109408701A (en) * | 2018-11-08 | 2019-03-01 | 网易（杭州）网络有限公司 | A kind of web crawlers crawls the methods of exhibiting and device in path |
| CN109522723A (en) * | 2018-11-14 | 2019-03-26 | 平安科技（深圳）有限公司 | POC scenario generation method, device, electronic equipment and storage medium |
| CN109522723B (en) * | 2018-11-14 | 2023-11-03 | 平安科技（深圳）有限公司 | POC script generation method and device, electronic equipment and storage medium |
| CN109783753A (en) * | 2018-12-14 | 2019-05-21 | 平安普惠企业管理有限公司 | The tree-shaped drawing generating method of web site url, device, equipment and storage medium |
| CN112579860A (en) * | 2019-09-30 | 2021-03-30 | 北京国双科技有限公司 | Method and device for processing digital page turning task, storage medium and electronic equipment |
| CN113342644A (en) * | 2021-05-31 | 2021-09-03 | 中国工商银行股份有限公司 | Test script automatic generation method and device based on syntax analysis technology |
| CN113342644B (en) * | 2021-05-31 | 2024-03-26 | 中国工商银行股份有限公司 | Automatic test script generation method and device based on grammar analysis technology |
| CN116974922A (en) * | 2023-07-25 | 2023-10-31 | 摩尔线程智能科技(北京)有限责任公司 | Performance analysis method, device, equipment and storage medium of deep learning model |
| CN116974922B (en) * | 2023-07-25 | 2024-05-17 | 摩尔线程智能科技(北京)有限责任公司 | Performance analysis method, device, equipment and storage medium of deep learning model |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102508779B (en) | 2015-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102508779B (en) | Automatic performance test script generating system based on web crawler logs and automatic performance test script generating method based on same | |
| CN110764753B (en) | Business logic code generation method, device, equipment and storage medium | |
| US7617486B2 (en) | Method and system to automate software testing using sniffer side and browser side recording and a toolbar interface | |
| CN105760290B (en) | The problem of being tested based on webpage front-end localization method and relevant apparatus, system | |
| CN103823747B (en) | The method of automatic regression test | |
| CN102981958B (en) | Method for testing software and proving installation | |
| CN101996131A (en) | Automatic test method and automatic test platform for graphic user interface (GUI) based on x extensive makeup language (XML) packaging key word | |
| US20140075242A1 (en) | Testing rest api applications | |
| US20110239104A1 (en) | Facilitating Automated Validation of a Web Application | |
| US7890536B2 (en) | Generating templates of nodes to structure content objects and steps to process the content objects | |
| JP4516001B2 (en) | Software test management program, software test management apparatus, and software test management method | |
| US20160092502A1 (en) | Graphical modeling of database query statements | |
| CN104424093A (en) | Compatibility testing method and system | |
| US20130290075A1 (en) | Localization quality assurance of localized software | |
| CN105760296A (en) | Automation testing control method, device and terminal | |
| CN101902368B (en) | WEB performance test method based on simulation of bulk thin client operation and test system thereof | |
| Li et al. | Classification of software defect detected by black-box testing: An empirical study | |
| CN109933770A (en) | A kind of test report generation method, system and electronic equipment and storage medium | |
| CN114661615B (en) | FPGA software testing method and device | |
| CN102567351B (en) | Testing method and testing device for database modification effects | |
| CN111966587A (en) | Data acquisition method, device and equipment | |
| CN105224465A (en) | Webpage adjustment method and device | |
| US8549482B2 (en) | Displaying subtitles | |
| CN103885341A (en) | Performance analysis system and method based on automobile performance simulator | |
| CN107704391A (en) | Selenium-based testing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150422 Termination date: 20201117 |