CN105068919A - WSO2 Stratos-based WS-BPEL flow load testing tool - Google Patents
WSO2 Stratos-based WS-BPEL flow load testing tool Download PDFInfo
- Publication number
- CN105068919A CN105068919A CN201510416037.7A CN201510416037A CN105068919A CN 105068919 A CN105068919 A CN 105068919A CN 201510416037 A CN201510416037 A CN 201510416037A CN 105068919 A CN105068919 A CN 105068919A
- Authority
- CN
- China
- Prior art keywords
- test
- bpel
- load testing
- data
- services
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention provides a WSO2 Stratos-based WS-BPEL flow load testing tool. On the basis of a conventional load testing architecture, a test case generator is used for replacing logging software; a real-time monitoring software part is additionally provided with a function of monitoring Web sub-services to extend a function of monitoring load testing results of the Web sub-services; reporting software is replaced with a test report generator so as to, in multiple angles, generate test reports of a WS-BPEL load test and show the test reports; two modules, namely a test case storage area and a test result metadata storage area, are additionally configured and are used for performing centralized management on test cases and test results; the XML markup language is used for describing test script standards of the load testing tool designed by the invention.
Description
Technical field
The invention belongs to the WS-BPEL flow process load testing technical field based on PaaS platform, a kind of WS-BPEL flow process load testing instrument based on WSO2Stratos is particularly provided.
Background technology
WSO2Stratos as a PaaS platform, mean it comprises software application or service exploitation, test, the storehouse of deployment and management, instrument and environment.Because Web service and WS-BPEL be realize interoperability between business system, integrated, cooperation gordian technique, so said two devices is the gordian technique realizing enterprise SOA.Web service and WS-BPEL are also gordian techniquies at WSO2Stratos, they are not only widely used by WSO2Stratos cloud platform itself, such as be used as the communication tie of each assembly of WSO2Stratos, and in WSO2Stratos, provide exploitation, test, dispose and manage their instrument and environment.
WSO2Stratos provides the virtual development platform of sing on web and the Integrated Development Environment of client: WSO2DeveloperStudio.In view of Web service and the WS-BPEL importance in WSO2Stratos, WSO2Stratos is as a PaaS platform, and its development platform at WSO2DeveloperStudio and test platform needs comprise exploitation, the test to Web service and dispose the instrument and environment that run.Through researching and analysing Integrated Development Environment WSO2DeveloperStudio, the development platform part of WSO2DeveloperStudio has met the demand of Web service and WS-BPEL, Web service testing tool has been integrated with in WSO2DeveloperStudio test platform part, can carry out functional test, load testing and safety test to Web service, but WSO2DeveloperStudio still lacks the relevant testing tool of WS-BPEL.Use because WS-BPEL itself also can be used as a Web service, its functional test and safety test can be replaced being responsible for by Web service testing tool, but this is not a good mode.The feature of composite Web services makes WS-BPEL in load testing, have some difficulty, because need the test result judging WS-BPEL load testing only can not see the test data of WS-BPEL, the result of other sub-services test that also should comprise in conjunction with WS-BPEL contrasts.
Just current, the research that WS-BPEL test is relevant is very deficient, and the research for WS-BPEL load testing is then less.If to WS-BPEL test as Web service, can not embody the feature of WS-BPEL composite Web services like this, well imagine, test result can be insincere, inaccurate.WS-BPEL composite Web services and itself be also the feature of a Web service, this makes WS-BPEL load testing be different from the load testing with common application.
For the defect of WS-BPEL testing tool in WSO2DeveloperStudio development environment, the present invention has designed and Implemented WS-BPEL load testing instrument.In WS-BPEL load testing instrument, creatively transform traditional load testing framework based on WS-BPEL feature, be integrated with Test cases technology function, added Web sub-services data monitoring and more abundant test report systematic function.
The realization of WS-BPEL load testing instrument is based on WSO2DeveloperStudio, and the Integrated Development Environment that WSO2DeveloperStudio is Stratos to be provided, and therefore can develop, tests, disposes and manage application in cloud environment or service by it.
Summary of the invention
The object of the invention is to the WS-BPEL service tested in Stratos platform, and by integrated for this testing tool in Stratos Integrated Development Environment WSO2DeveloperStudio to make up the defect of the test platform of Stratos, the WS-BPEL flow process load testing instrument based on WSO2Stratos is proposed.
In order to realize foregoing invention object, the technical solution used in the present invention is as follows:
Based on the WS-BPEL flow process load testing instrument of WSO2Stratos, comprise following ingredient:
(1) test case generator.Be responsible for generating WS-BPEL test case and being saved in designated storage area.Test case generator comprises generating algorithm to meet different business demands.
(2) test case memory block.In order to manage the use-case generated with persistence, so that better recycling is also or reappear test, its mode stored with realize relevant.
(3) load generator.Be responsible for resolving test case and test script file, by simulation Multi-Client Concurrency Access to WS-BPEL loading, perform load testing.
(4) data monitor.Be responsible for monitoring load testing and collect load testing data, comprising two parts, part monitoring WS-BPEL, another part monitoring Web sub-services.WS-BPEL and Web sub-services is all deployed in Stratos cloud environment.
(5) test result meta-data index storage.Be in charge of and the test result raw data of persistence load testing, the mode of test result metadata store with realize relevant.
(6) test report maker.Be responsible for generating various report, comprise figure and document form.The result data that memory block is preserved processes by test report maker further, statistics and analysis, then generates test report.
(7) WSO2Stratos, is a PaaS cloud environment, comprises the development platform of Web service and WS-BPEL, test platform, deployment platform and management platform in this cloud environment.Third party developer or medium and small sized enterprises can develop Web service and WS-BPEL by the related platform of Stratos, test and the operation such as operation.
Compared with prior art, tool of the present invention has the following advantages and technique effect:
WSO2Stratos is an enterprise-level PaaS platform, Web service and WS-BPEL flow process extensive application in this platform.In order to development and testing Web service and WS-BPEL flow process, Stratos provides the virtual development environment of a client-based Integrated Development Environment WSO2DeveloperStudio and sing on web.Do not have for current WSO2DeveloperStudio the testing tool that WS-BPEL flow process is relevant, the present invention has designed and Implemented a kind of WS-BPEL flow process load testing instrument based on WSO2Stratos.On the basis of conventional load test structure, the feature for WS-BPEL is modified and expands: use the logging software part in test case generator replacement conventional load test structure; Watch on-line part increases the monitoring of Web sub-services, expands the monitoring function of the load test results to Web sub-services; Reporting software is replaced with test report maker, employ multiple format and statistical methods and with multiple angles test report generated to WS-BPEL load testing and show; Increase test case storage area and two, test result meta-data index storage module simultaneously, be used for managing test case and test result concentratedly; XML tag language is adopted to describe the test script specification of the load testing instrument designed herein.
Accompanying drawing explanation
Fig. 1 is WS-BPEL load testing instrument overall design frame diagram in example;
Fig. 2 is the drawing of test case generator working machine;
Fig. 3 is the drawing of load generator working machine;
Fig. 4 is the drawing of data monitor working machine;
Fig. 5 is the drawing of test report maker working machine.
Embodiment
Below in conjunction with example and accompanying drawing, enforcement of the present invention is described further, but enforcement of the present invention and protection are not limited thereto.
test script Specification Design
Each testing tool has oneself script specification, can perform by tested instrument, then produce test result according to the test script of script specification editor.The present invention devises a test script specification based on XML syntax rule, be used for configuring the relevant information of WS-BPEL load testing, comprise essential information configuration (protos test suite PROTOS title, base path, test case path etc.), load running configuration (subscribers feeder number of passes, start delay, Control Cooling etc.), test case configuration (time-out time), tested WS-BPEL information configuration (service access end points, tested flow process file path etc.), data monitor configuration (IP of server host, port numbers).As follows is the test script specification of WS-BPEL load testing:
<?xmlversion="1.0"encoding="UTF-8"?>
<bpelloadtestsuitexmlns="http://pengyusong.emos.scut.edu.cn/">
<testsuitename></testsuitename>
<basepath></basepath>
<testcasepath></testcasepath>
<testresultpath></testresultpath>
<testcasecount></testcasecount>
<loadtestconfig>
<vartualUserCount></vartualUserCount>
<startDelay></startDelay>
<controlType></controlType>
<loopCount></loopCount>
<limitRunsTime></limitRunsTime>
</loadtestconfig>
<testcaseconfig>
<timeout></timeout>
</testcaseconfig>
<wsdlfilepath></wsdlfilepath>
<service></service>
<port></port>
<operation></operation>
<targeturl></targeturl>
<soapaction></soapaction>
<calldirection></calldirection>
<targetnamespace></targetnamespace>
<monitor>
<hostip></hostip>
<port></port>
</monitor>
</bpelloadtestsuite>。
test case generator designs
WS-BPEL load testing instrument overall design framework as shown in Figure 1.
When tested WS-BPEL is after WSO2DeveloperStudio has developed, connect Stratos platform, WS-BPEL is deployed in the operation under this cloud environment.Now server end can produce WSDL interface description document, and this file is saved to local side, just can according to WSDL interface description document generating test use case.
Wsdl4j is the instrument of resolving wsdl document, and Dom4j is then the instrument of analyzing XML file.Both being combined for resolving interface description document, extracting the input/output format specification of interface, and generate parameter list tree.WS-BPEL service interface input and output message format is generated according to parameter list tree, then in conjunction with soap message protocol format, generating test use case masterplate.
Then, the strategy that data generating module selects a kind of data to produce produces original test data; Test cases technology module adopts data source mode generating algorithm, Random Generation, screens based on the Test cases generation algorithm of path covering and adjust the test data produced, then by treated test data and the combination of test case masterplate, generating test use case; The test case of generation is stored into the work that the ground of specifying conveniently completes test case generator by On-board test use-case flow process.Fig. 2 is the drawing of test case generator working machine.
load generator designs
Before starting load test, tester needs to write test script according to the test script specification of 1 joint.In test script specification, the script wherein about load generator is configured to:
<loadtestconfig>
<vartualUserCount></vartualUserCount>
<startDelay></startDelay>
<controlType></controlType>
<loopCount></loopCount>
<limitRunsTime></limitRunsTime>
</loadtestconfig>。
Load generator configuration packet contains number, start delay, Control Cooling, the cycle index of Virtual User number and limits the time run.
After starting load generator, load generator resolves the test case that test case generator is kept at memory block, then according to test script configuration and use Java multithreading to go implementation of test cases to simulate multi-user concurrent, adopt OnNow strategy to pressurize, then visit tested flow process WS-BPEL by HTTP internet communication protocol.So far, the work constipation bundle of load generator.
After WS-BPEL load testing instrument start-up load testing, can control by controlling run module the load testing that multi-thread concurrent module and HTTP access protocal module control tested WS-BPEL.Fig. 3 is the drawing of load generator working machine.
Based on above-mentioned design, the content for script that logging software in conventional load testing software framework is recorded is divided into two classes: order or load testing configuration information and test case, more be applicable to the feature of WS-BPEL, make WS-BPEL load testing instrument become easier, and be divided into two class contents make load testing structure more clear, have more characteristic.
data monitor designs
Data monitor for monitoring tested application and service, i.e. WS-BPEL and Web sub-services.Data monitor is saved in test result by monitoring the load testing data obtained.
First, tester needs boot portion to be deployed in Web sub-services data monitoring software module in Stratos cloud environment, then performs load testing flow process.Execution load testing flow process shown in Fig. 4 is the outside flow process introduced, and do not belong to the flow process of data monitor itself, but data monitor of the present invention needs to depend on it.
After the outside flow performing load testing of startup, data monitor just starts the load testing data monitoring Web sub-services and WS-BPEL, the load testing of WS-BPEL load testing instrument monitoring WS-BPEL itself, is deployed in Web sub-services independent data monitoring software and then monitors the load testing of Web sub-services and pass WS-BPEL load testing instrument back by monitoring the Web sub-services data collected.
Along with the monitoring of the load testing of Web service and WS-BPEL performs, the data monitor of WS-BPEL load testing instrument can collect the load testing data of Web sub-services and WS-BPEL.Finally, preservation load testing flow process will be collected load testing data and be saved in test result meta-data index storage, and so far, the work of data monitor just finishes.Fig. 4 is the drawing of data monitor working machine.
Because monitoring WS-BPEL only needs dependence instrument itself, and monitor Web sub-services and need could realize for the monitoring of server end, so the present invention realizes the monitoring use case listen mode of WS-BPEL itself, client-server programming model is adopted to realize to the monitoring of Web sub-services.
In monitoring WS-BPEL part, using the test process of WS-BPEL as an event source object, will call the method for audiomonitor whenever WS-BPEL load testing has new data to arrive, the method can be handled it to this event, such as, preserve data etc.
In monitoring Web sub-services part, adopt following implementation:
1. revise the source code of WS-BPEL server, the data of needs are recorded in independent journal file.The form of record is as follows:
Service Link name | state | initial time | spended time | abnormal
2. the program of writing server end is monitored this journal file, this journal file carries out ever-increasing Web sub-services with load testing and calls record, the client these records being transmitted go back to WS-BPEL load testing instrument place of server practice.
3. client-side program is responsible for the Web sub-services test data that reception server end passes over, and is saved in test result meta-data index storage.
By monitoring and the built-in monitoring of testing tool two kinds of data monitoring methods in conjunction with stand alone software, make the load testing data also obtaining the Web sub-services that it calls while WS-BPEL load testing, obtain these data can better statistical study WS-BPEL load capacity and analyze its bottleneck place.
test report Generator Design
After load generator and data monitor are finished, the data that data monitor is collected are stored in test result meta-data index storage.The processing module that the test result data that first test report maker gathers needs from test result meta-data index storage gives upper strata carries out unifying Treatment Analysis.
Web sub-services data processing module analyzes Web sub-services load test results data, WS-BPEL data processing module analyzes the load test results data of WS-BPEL, and integrated data processing module relies on Web service data processing module and WS-BPEL data processing module, a point statistical study is carried out to the load testing of Web service and WS-BPEL simultaneously.
After completing the statistical study to load testing data, tester or user can select a test case report template according to demand, for the generation task of test report is prepared.Test report masterplate has HTML, XML and Word form, and it has in comprising: the global test result of WS-BPEL is shown, the result of single survey examination example is shown.The global test result displaying of WS-BPEL comprises protos test suite PROTOS name, the use-case number of execution, total number of run, errors number, the frequency of failure, number of success, start-up time, end time, working time, success ratio, averaging time and handling capacity.The displaying displaying of single test case comprises test case name, state, start-up time, end time, spended time, information, exception.
Finally, according to the demand of tester or user, in conjunction with test report masterplate and treated load testing data, generate the test report of specifying.Test report has various ways to select, and comprises curve map, WORD, HTML etc., wherein more can analyze the position of the bottleneck point drawing WS-BPEL according to curve map.Fig. 5 is the drawing of test report maker working machine.
Based on above-mentioned design, load testing data for Web sub-services and WS-BPEL both can separate statistical study, also comprehensive statistical study can be carried out, and the result these data obtained after treatment is combined with the test report masterplate of selection and generates test report.
Claims (3)
1., based on a WS-BPEL flow process load testing instrument of WSO2Stratos, it is characterized in that specifically comprising following ingredient:
Test case generator, generating algorithm, to meet different business demands, generates WS-BPEL test case and WS-BPEL test case is saved in designated storage area;
Test case memory block, the use-case that management and persistence generate, better to recycle or to be reproduction test;
Load generator, resolves test case and test script file, by simulation Multi-Client Concurrency Access to WS-BPEL loading, performs load testing;
Data monitor, monitoring load testing also collects load testing data, comprises two parts, part monitoring WS-BPEL, another part monitoring Web sub-services, WS-BPEL and Web sub-services is all deployed in Stratos cloud environment;
Test result meta-data index storage, manages and the test result raw data of persistence load testing;
Test report maker, by memory block preserve result data process further, statistics and analysis, then generate various test report, comprise figure and document form;
WSO2Stratos, a PaaS cloud environment, comprises the development platform of Web service and WS-BPEL, test platform, deployment platform and management platform in this cloud environment.
2. a kind of WS-BPEL flow process load testing instrument based on WSO2Stratos according to claim 1, is characterized in that: adopt described test case generator to replace logging software; Data monitor is monitored Web sub-services in real time; Test report maker is adopted to replace reporting software.
3. a kind of WS-BPEL flow process load testing instrument based on WSO2Stratos according to claim 1, is characterized in that: adopt XML tag language to describe the test script specification of WS-BPEL flow process load testing instrument.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510416037.7A CN105068919B (en) | 2015-07-15 | 2015-07-15 | A kind of WS BPEL flow load testing instruments based on WSO2 Stratos |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510416037.7A CN105068919B (en) | 2015-07-15 | 2015-07-15 | A kind of WS BPEL flow load testing instruments based on WSO2 Stratos |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105068919A true CN105068919A (en) | 2015-11-18 |
| CN105068919B CN105068919B (en) | 2018-04-13 |
Family
ID=54498296
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510416037.7A Active CN105068919B (en) | 2015-07-15 | 2015-07-15 | A kind of WS BPEL flow load testing instruments based on WSO2 Stratos |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105068919B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110347603A (en) * | 2019-07-12 | 2019-10-18 | 北京精密机电控制设备研究所 | A kind of automation software testing system and method for artificial intelligence |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425585A (en) * | 2013-08-31 | 2013-12-04 | 华南理工大学 | OSGI (Open Service Gateway Initiative) integration testing method |
| CN104090756A (en) * | 2014-06-20 | 2014-10-08 | 华南理工大学 | Enterprise-level application development method based on WSO2 Stratos |
| CN104135525A (en) * | 2014-07-31 | 2014-11-05 | 广州杰赛科技股份有限公司 | Resource expanding method and device for cloud platform ELB components |
-
2015
- 2015-07-15 CN CN201510416037.7A patent/CN105068919B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425585A (en) * | 2013-08-31 | 2013-12-04 | 华南理工大学 | OSGI (Open Service Gateway Initiative) integration testing method |
| CN104090756A (en) * | 2014-06-20 | 2014-10-08 | 华南理工大学 | Enterprise-level application development method based on WSO2 Stratos |
| CN104135525A (en) * | 2014-07-31 | 2014-11-05 | 广州杰赛科技股份有限公司 | Resource expanding method and device for cloud platform ELB components |
Non-Patent Citations (5)
| Title |
|---|
| FA GUI LIU 等: "Research and Implementation of Key Techniques of Osgi Integration Testing Platform", 《ADVANCED MATERIALS RESEARCH》 * |
| MAALEJ A J 等: "WSCLT: A Tool for WS-BPEL Compositions Load Testing", 《2013 WORKSHOPS ON ENABLING TECHNOLOGIES: INFRASTRUCTURE FOR COLLABORATIVE ENTERPRISES》 * |
| TIEN-DUNG CAO 等: "WSOFT : an automatic testing tool for web services composition", 《INTERNATIONAL CONFERENCE ON INTERNET & WEB APPLICATIONS & SERVICES. IEEE COMPUTER SOCIETY》 * |
| 张端: "基于OSGI的PaaS平台的研究与实现", 《中国优秀硕士学文论文全文数据库 信息科技辑》 * |
| 段琦: "基于WSO2Stratos的扩展平台与企业级应用开发", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110347603A (en) * | 2019-07-12 | 2019-10-18 | 北京精密机电控制设备研究所 | A kind of automation software testing system and method for artificial intelligence |
| CN110347603B (en) * | 2019-07-12 | 2023-08-15 | 北京精密机电控制设备研究所 | Automatic software testing system and method for artificial intelligence |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105068919B (en) | 2018-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9697104B2 (en) | End-to end tracing and logging | |
| US9454450B2 (en) | Modeling and testing of interactions between components of a software system | |
| US9235490B2 (en) | Modeling and testing of interactions between components of a software system | |
| CN112910945B (en) | Request link tracking method and service request processing method | |
| Cinque et al. | Microservices monitoring with event logs and black box execution tracing | |
| US10146663B2 (en) | Modeling and testing interactions between components of a software system | |
| US10521322B2 (en) | Modeling and testing of interactions between components of a software system | |
| CN105450476B (en) | A kind of regression test system and test method | |
| US20200133829A1 (en) | Methods and systems for performance testing | |
| CN104581785B (en) | wireless network test method, test device and mobile terminal | |
| CN110750458A (en) | Big data platform testing method and device, readable storage medium and electronic equipment | |
| CN104636146A (en) | Online visual customizing method and system | |
| US9122803B1 (en) | Collaborative software defect detection | |
| US10073755B2 (en) | Tracing source code for end user monitoring | |
| JPWO2014049804A1 (en) | System operation tracing method in distributed system | |
| CN105068876A (en) | Method for acquiring mobile phone APP performance data based on distributed true phones | |
| CN102904774B (en) | Terminal, server and server performance test methods | |
| CN103248511B (en) | A kind of analysis methods, devices and systems of single-point service feature | |
| CN105068919A (en) | WSO2 Stratos-based WS-BPEL flow load testing tool | |
| Coppolino et al. | Effective QoS monitoring in large scale social networks | |
| Safy et al. | Runtime monitoring of soa applications: Importance, implementations and challenges | |
| CN103236954B (en) | Mobile network's Web service evaluation system | |
| Tramontana et al. | Reverse engineering techniques: From web applications to rich Internet applications | |
| CN109634848B (en) | Large-scale testing environment management method and system for bank | |
| Hababeh et al. | An effective multivariate control framework for monitoring cloud systems performance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |