CN102693183A - Method and system for realizing automatic software testing - Google Patents
Method and system for realizing automatic software testing Download PDFInfo
- Publication number
- CN102693183A CN102693183A CN2012101741149A CN201210174114A CN102693183A CN 102693183 A CN102693183 A CN 102693183A CN 2012101741149 A CN2012101741149 A CN 2012101741149A CN 201210174114 A CN201210174114 A CN 201210174114A CN 102693183 A CN102693183 A CN 102693183A
- Authority
- CN
- China
- Prior art keywords
- test
- software
- tested
- script
- automated testing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a method and a system for realizing automatic software testing. The method includes the following steps: obtaining the object code of the to-be-tested software; obtaining the test case for the to-be-tested software, wherein the test case is generated by adopting the oriented object technology and includes a test object key word and a test drive data for the to-be-tested software; compiling and saving the test script according to the test case; running the test script, so as to carry out the automatic software testing of the object code of the to-be-tested software based on the test object key word and the test drive data. By adopting the solution of automatic testing and utilizing the object oriented test case to carry out the automatic testing based on the assemblage of the test object key word and the test drive data, the automatic software testing can be realized without the participation of any operator, and the method and the system for realizing automatic software testing are applicable to all the stages of software testing.
Description
Technical field
The present invention relates to computer technology, particularly a kind of method and system that realize software automated testing.
Background technology
Software test is an important step of software project, also is an important means guaranteeing software quality.The software test activity is the important component part of software test, can improve the quality and reliability of software through the software test activity, and therefore, the test activity in software test stage is vital to improving software quality.The software test activity mainly comprises: unit testing, integration testing, system testing, regression test, the test activity in stages such as performance test, Acceptance Test.
The software manual test that the software test branch is served as reasons and carried out manually reaches the software automated testing that is undertaken by computer software.The main difficulty of software manual test is that the tester does not know to begin how effectively test, does not also know when can finish relievedly test, and still, software project does not allow the undying manual test that carries out.In a lot of software projects; All test activities that the software test personnel carry out in fact all are manual handle, and in fact, have the test job that repeatability is strong greatly independently to realize through software automated testing; Through introducing software automated testing; Can improve software test efficient greatly, function and the performance deficiency in each version of assignment test software reduces the manual test workload greatly fast.The introducing of software automated testing will be passed through comprehensive evaluation scheme; Definitely can not be understood as testing tool simply records and replayed section; Software automated testing is taken all factors into consideration the condition restriction of each side such as software test project making time, human and material resources, financial resources again; The software test action need obtains maximum output in limited input, need Development of Software flow process, testing process, defect management flow process to realize standardization.
At present, the As-Is analysis of the test activity in software test stage and enforcement automatic test thereof is as shown in table 1:
Table 1
For above-mentioned content measurement, existing software automatic test solution is as shown in table 2:
Table 2
Existing software automatic test scheme and instrument, in the software automated testing process, the degree that needs operating personnel to participate in is still higher.
Summary of the invention
The embodiment of the invention provides a kind of method and device of realizing software automated testing, in order to solve the problems of the technologies described above.
The concrete technical scheme that the embodiment of the invention provides is following:
A kind of method that realizes software automated testing comprises:
Obtain and preserve the object code of software to be tested;
Obtain and preserve the test case to said software to be tested, said test case adopts Object-oriented Technique to generate, and comprises tested object key word and test driving data to said software to be tested;
Automatically compile test script and preservation according to said test case, comprise said tested object key word and test driving data in the said test script;
Move said test script, the object code of said software to be tested is carried out software automated testing based on said tested object key word and test driving data.
A kind of system that realizes software automated testing comprises:
Software integral subsystem to be tested is used to obtain and preserve the object code of software to be tested;
The software automated testing Resource Manager Subsystem; Be used to obtain and preserve test case to said software to be tested; Automatically compile test script and preservation according to said test case; Said test case adopts Object-oriented Technique to generate, and comprises tested object key word and test driving data to said software to be tested, comprises said tested object key word and test driving data in the said test script;
The software automated testing executive subsystem; Be used for said test script and software loading to be tested to the tested software subsystem, the object code of said software to be tested carried out software automated testing based on said tested object key word and test driving data.
Above-mentioned automatic test solution is tested and can be accomplished automatically to treating the test target code from the object code that loads software to be tested, need not operating personnel and participates in.Particularly, test case provided by the invention is different from existing test case, and existing test case needs operating personnel manually to generate test script according to the description of test case for describing the text of measuring executing process.And the present invention adopts Object-oriented Technique to obtain tested object key word and test driving data formation test case, compiles the generation test script automatically in conjunction with test case and predetermined measuring executing process.And, adopt tested object key word and test driving data driven in common measuring executing process, in the process of carrying out test script, also need not each step that operating personnel participate in automatically performing test process.It is thus clear that, technical scheme provided by the invention, the automatic test degree is higher.Scheme provided by the invention can also be applicable to each stage of software test, has improved the performance and the scope of application of software test.
Description of drawings
A kind of method flow diagram that Fig. 1 provides for the embodiment of the invention;
A kind of system architecture synoptic diagram that Fig. 2 provides for the embodiment of the invention;
The another kind of system architecture synoptic diagram that Fig. 3 provides for the embodiment of the invention;
Another system architecture synoptic diagram that Fig. 4 provides for the embodiment of the invention.
Embodiment
In order to realize software automated testing truly, improve the performance of software automated testing system, save the test duration.In the embodiment of the invention, based on point to point network is technological, distributed network is technological, template engine is technological and Object-oriented Technique realizes software automated testing solution truly.
Be specially: through software automated testing method and system provided by the invention, need not manually record, editor and playback automatic test script, (predetermined file format is adopted in the configuration of test case based on the tested object key word of software to be tested and the test case of test driving data only to need the software automated testing personnel to adopt the Object-oriented Technique configuration in the test preparatory stage in early stage; As, the file of XML cannonical format), if be necessary; The configuration file that also configuration is relevant is (among the present invention; When mentioning test case, give tacit consent to it and possibly comprise relevant configuration file), the software automated testing system can read the test case that configures voluntarily; And generate the required test script of test (as; The executable file of Java cannonical format), thus realize the automation function test of tested software, automated performance testing through carrying out these test scripts; The automatic dispatching of test assignment flow process, and software test report's robotization generates or the like.The whole software test process realizes that all the robotization mode carries out, and the tester need not manual intervention, thereby realizes software automated testing truly.
Based on software automated testing solution disclosed by the invention; Can realize: the automation function method of testing of software; The automatic performance test, the robotization of test execution flow process, software test result's robotization report; And test related resource automatic dispatching and management, guarantee and realize the test of software automation truly.
Based on foregoing description, the present invention provides a kind of method that realizes software automated testing, and its implementation is as shown in Figure 1, and concrete implementation is following:
Wherein, test case adopts Object-oriented Technique to generate, and comprises tested object key word and test driving data to this software to be tested.
The tested object key word is meant, the corresponding element of object to be tested in the software to be tested.
The test driving data is meant, is used for verifying the accuracy of software to be tested object to be tested, the test data of completeness.
Logining software with the user is example, and the input frame of supposing to input user name is an object to be tested, and its corresponding tested object key word can be " user name ", tests driving data accordingly and can be concrete username data, like " Zhang San " " Li Si " etc.
Wherein, the code that comprises said tested object key word and test driving data and measuring executing process in the test script.
The method of the realization software automated testing that the embodiment of the invention provides is tested and can be accomplished automatically to treating the test target code from the object code that loads software to be tested, need not operating personnel and participates in.Particularly, test case provided by the invention is different from existing test case, and existing test case needs operating personnel manually to generate test script according to the description of test case for describing the text of measuring executing process.And the present invention adopts Object-oriented Technique to obtain tested object key word and test driving data formation test case, compiles the generation test script automatically in conjunction with test case and predetermined measuring executing process.And, adopt tested object key word and test driving data driven in common measuring executing process, in the process of carrying out test script, also need not each step that operating personnel participate in automatically performing test process.It is thus clear that, technical scheme provided by the invention, the automatic test degree is higher.Scheme provided by the invention can also be applicable to each stage of software test, has improved the performance and the scope of application of software test.
Method provided by the invention can also comprise the step that adopts Object-oriented Technique configuration testing use-case, and is specific as follows:
Based on the object to be tested in the above-mentioned software to be tested, generate the tested object key word;
Based on the object to be tested in the above-mentioned software to be tested, generate the test driving data corresponding with above-mentioned tested object key word;
According to above-mentioned tested object key word and corresponding test driving data, configuration testing use-case.
Wherein, the concrete implementation of above-mentioned steps 120 can be: select the test template corresponding with above-mentioned test case, test template is used for the programming language of use test script and describes measuring executing process; Be used in tested object key word that in this test case, disposes and test driving data and the corresponding test template to describe between variable and the constant of measuring executing process and set up mapping relations; According to the mapping relations of setting up, this test case is compiled automatically source code and the preservation that generates test script.
Through introducing test template, realized automatic generation test script.Based on test template, the advantage that test case is compiled as automatically test script is, test case, test script, measuring executing process are realized separating, and is convenient to the independent maintenance of test case.
Before the step 100, the method that the embodiment of the invention provides can also comprise: set up the test event engineering to above-mentioned software to be tested.Accordingly, this method also comprises: with above-mentioned test case and the related preservation of this test event engineering; With above-mentioned test template and the related preservation of this test event engineering; Source code and the related preservation of this test event engineering with above-mentioned test script; With above-mentioned software automated testing result and the related preservation of this test event engineering.
Through introducing the notion of test event engineering, be convenient to realize management to each software automated testing flow process to be tested.Wherein, Can preserve through the tree structure test resource that a test event engineering is related; Also can preserve through the form of the file test resource that a test event engineering is related, can also be through the related test resource of preserving a test event engineering of other forms.
The method that the embodiment of the invention provides can also comprise: with software automated testing result and the related preservation of said test event engineering; Based at least one in software automated testing result, test case, test template, the test script, generation test resource form.
It is thus clear that the method that the embodiment of the invention provides through the test resource in the preservation test process, and then can be managed the test resource in the test process, and generates the test resource form, realizes software automated testing truly.
The also disclosed a kind of system that realizes software automated testing of the present invention, its structure is as shown in Figure 2, and concrete implementation structure is following:
Software automated testing Resource Manager Subsystem 002 is used to obtain the test case to this software to be tested, compiles test script automatically according to this test case and predetermined measuring executing process.
Wherein, this test case adopts Object-oriented Technique to generate, and comprises tested object key word and test driving data to above-mentioned software to be tested; The code that comprises above-mentioned tested object key word and test driving data and measuring executing process in this test script.
Software automated testing executive subsystem 003; Be used for the object code of above-mentioned test script and software to be tested is loaded into tested software subsystem 004; So that according to above-mentioned measuring executing process, the object code of this software to be tested is carried out software automated testing based on above-mentioned tested object key word and test driving data.
The system of the realization software automated testing that the embodiment of the invention provides tests and can accomplish automatically to treating the test target code from the object code that loads software to be tested, need not operating personnel and participates in.Particularly, test case provided by the invention is different from existing test case, and existing test case needs operating personnel manually to generate test script according to the description of test case for describing the text of measuring executing process.And the present invention adopts Object-oriented Technique to obtain tested object key word and test driving data formation test case, compiles the generation test script automatically in conjunction with test case and predetermined measuring executing process.And, adopt tested object key word and test driving data driven in common measuring executing process, in the process of carrying out test script, also need not each step that operating personnel participate in automatically performing test process.It is thus clear that, technical scheme provided by the invention, the automatic test degree is higher.Scheme provided by the invention can also be applicable to each stage of software test, has improved the performance and the scope of application of software test.。
Preferably, software integral subsystem 001 to be tested specifically can comprise: source code storehouse management client device, source code storehouse management server, software integrated management equipment and software storage server to be tested.Source code storage administrative client equipment is used to receive the source code of above-mentioned software to be tested, and the source code of the software to be tested that will receive is uploaded to source code storehouse management server; Software integrated management equipment is used for obtaining from source code storehouse management server the source code of above-mentioned software to be tested; Source code to this software to be tested compiles; Generate the object code of above-mentioned software to be tested, and object code that will this software to be tested is packaged as executable program or compressed package start-up routine; Software storage server to be tested is used to preserve the object code of the above-mentioned software to be tested that is packaged as executable program or compressed package start-up routine.
Preferably, software automated testing Resource Manager Subsystem 002 can comprise: the test template administrative unit is used to select the test template corresponding with above-mentioned test case; Be used in tested object key word that in this test case, disposes and test driving data and the corresponding test template to describe between variable and the constant of measuring executing process and set up mapping relations; Test compiling administrative unit is used for according to the mapping relations of setting up, and above-mentioned test case compiling is generated the source code of test script.
Preferably, software automated testing Resource Manager Subsystem 002 can also comprise: test event engineering management unit, test case management unit, test script management unit, test assignment administrative unit, test dispatching administrative unit and resource management storage server.Test event engineering management unit is used to set up the test event engineering to above-mentioned software to be tested, this test event engineering is saved in the resource management storage server, and the information of this test event engineering is managed.The test case management unit is used to obtain the test case to above-mentioned software to be tested, and this test case is saved in the relative position that is directed against the test event engineering of above-mentioned software to be tested in the resource management storage server.The test script management unit is used for the source code of testing the test script that compiles the administrative unit generation is managed; The test assignment administrative unit is used to generate above-mentioned test script fixed time test task to be carried out, and this fixed time test task is saved in the relative position that is directed against the test event engineering of above-mentioned software to be tested in the test resource management storage server.The test dispatching administrative unit is used for the execution time point stipulated according to above-mentioned fixed time test task, the above-mentioned fixed time test task of timer-triggered scheduler, and give software automated testing executive subsystem 003 with the source code timed sending of above-mentioned test script.
Preferably; Above-mentioned resource management storage server also is used for preserving the software automated testing result at the relative position of the test event engineering that is directed against above-mentioned software to be tested, and preserves above-mentioned test case, above-mentioned test script and above-mentioned test template at the relative position of the test event engineering that is directed against above-mentioned software to be tested.Accordingly; Above-mentioned software automated testing Resource Manager Subsystem 002 can also comprise test resource report form statistics administrative unit; Be used at least one item, generate the test resource form based on above-mentioned software automated testing result, test case, test template, test script.
Preferably, tested software subsystem 004 can also comprise tested network management unit 0041 and equipment under test 0042.
Give below to be combined accompanying drawing, with a concrete application implementation example, the system of the realization software automated testing that the embodiment of the invention is provided, and working method is elaborated.
In this concrete application implementation example; As shown in Figure 3, realize that the system of software automated testing comprises: software integral subsystem to be tested 001, software automated testing Resource Manager Subsystem 002, software automated testing executive subsystem 003 and tested software subsystem 004.
Software integral subsystem 001 to be tested mainly comprises: source code storehouse management client device, source code storehouse management server, software integrated management equipment and software storage server to be tested.Wherein, source code storehouse management client device is used for the source code of the software to be tested that receives is uploaded to the source code storage management server.The developer accomplishes software to be tested in this locality exploitation, and source code and the relevant documentation of submitting software to be tested to through source code storehouse management client device are to the source code storage management server.Wherein, source code storage administrative client equipment and source code storage management server can adopt distributed deployment, also can adopt centralized deployment on an equipment, to realize.Software integrated management equipment is used for obtaining from said source code storage management server through the software continuous integration tool source code of software to be tested; And the source code of this software to be tested compiled; Generate object code; The compressed package start-up routine that then packing of the object code of software to be tested is generated executable file or can start through other modes uploads to this executable file or compressed package start-up routine in the software storage server to be tested at last.Wherein, can continue the function that integration tool is realized software integrated management equipment, also can adopt script mode to realize the function of software integrated management equipment automatically by software test personnel Control Software.Software server to be tested is used to preserve the corresponding executable file or the compressed package start-up routine of object code of software to be tested.Above-mentioned source code storage administrative client equipment, source code storage management server, software integrated management equipment and software storage server to be tested can adopt distributed deployment, also can adopt centralized deployment on an equipment.
Software automated testing Resource Manager Subsystem 002 mainly comprises: test event engineering management unit, test case management unit, test template administrative unit, test compiling administrative unit, test script management unit, test assignment administrative unit, test dispatching administrative unit, test report administrative unit, test resource report form statistics administrative unit and resource management storage server.Software automated testing Resource Manager Subsystem 002 specifically can adopt centralized deployment, perhaps, the three-layer network distributed structure/architecture system that combines based on resource management server, resource management storage server, resource management client device.If adopt three-layer network distributed structure/architecture system, above-mentioned each administrative unit is deployed in respectively on resource management client device and the resource management storage server.The software developer can manage the test event engineering resource of corresponding software automated testing through the resource management client device.The software test personnel then can manage the test event engineering resource of corresponding software automated testing through resource management server.Preferably, each administrative unit in the software automated testing Resource Manager Subsystem 002 is mainly managed the test resource of corresponding software automated testing through computing machine GUI (graphical interfaces) mode.Certainly, also can realize management through other modes to the test resource of software automated testing.
The specific descriptions of each functional unit are following in the software automated testing Resource Manager Subsystem 002:
Test event engineering management unit is used to the test event engineering and is distributed in the work space in the resource management storage server, newly-built test event engineering, revises the test event engineering information, inquires about testing engineering information, deletes the test event engineering, customizes test event engineering display properties, importing or derivation (exporting as the file of EXCEL, TXT form) test event engineering information etc.The test event engineering information is meant the title, attribute of test event engineering or the like information, is kept on the resource management server.
The test case management unit is used to obtain the test case to software to be tested, and this test case is kept at being directed against under the test event engineering catalogue of above-mentioned software to be tested of resource management storage server.This test case adopts the Object-oriented Technique configuration, comprises tested object key word and test driving data to software to be tested.Among the present invention, for the ease of operational administrative, test case adopts predetermined file format, the file of standard XML form for example, the file of perhaps self-defining XML form.
Simultaneously, the test case management unit also supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test case resource that operational administrative is set etc.
Adopt the test case of Object-oriented Technique configuration to have encapsulation, succession, polymorphic characteristics.Adopt Object-oriented Technique that the tested object key word that disposes in the test case is combined with the test driving data, the test preparatory stage only needs once configuration, and the later stage can be reused, and avoids the reconstruct repeatedly of interface detection object keywords and test data.And; Adopt the test case of Object-oriented Technique configuration, its configuration file hierarchical structure is clear, simple, reduces the automatic test script complexity of developing; The tester no longer need manually record script, also do not need the exploitation, debug script; All work all focuses in the configuration file work of a test case, can reduce the automatic test input cost, effectively improves soft friendship automatic test work efficiency.
The test template administrative unit can be realized by template engine.The test case that is used to software to be tested is selected test template; Be used in the test template of the tested object key word that in this test case, disposes and test driving data and selection to describe between variable and the constant of measuring executing process and set up mapping relations, can also generate test template.Among the present invention, test template is used to use the programming language of said test script to describe measuring executing process, and test template comprises: system template, privately owned template, publicly-owned template, User-defined template.Test template is kept in the resource management storage server.In addition, above-mentioned mapping relations also can be preserved with the form of test template, promptly generate the mapping template.
Simultaneously, the test template administrative unit supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test template resource that operational administrative is set etc.
Wherein, The concrete implementation that generates test template can be: adopt a kind of template engine language generation test template; This test template is used for the programming language of use test script, and (include but not limited to: language such as Java, C/C++/C#, VB.net) describe measuring executing process, this measuring executing process comprises: the execution sequencing of the input of the test case of software to be tested, output, testing procedure, test script, the logical organization of control procedure etc.The concrete implementation of setting up mapping relations can be: the constant, the variable that adopt a kind of syntax gauge of template engine, the logical organization of test case configuration variables, constant and test template definition are used are set up mapping relations.
The present invention utilizes template engine to translate, resolve test case; The test template algorithm is tested test case static datas such as input, output, testing procedure and is realized separating with testing procedure execution sequence, the execution operation flow of test template definition; Be that test data, testing procedure are realized separating with test service; Make things convenient for test case to safeguard separately like this, need not be concerned about how testing procedure is carried out, only need to pay close attention to test case, the input of test script, output, testing procedure.
Concrete, said system template: mainly be testing procedure, the test process of all test cases of control, the algorithm of test result warehouse-in;
Above-mentioned publicly-owned template: mainly be to be the shared test service logic of a plurality of test cases, the testing procedure framed structure is a kind of test template of universal test logical organization algorithm;
Above-mentioned privately owned template: mainly be to single test case and privately owned test frame structure, the corresponding privately owned test template of use-case is a kind of test template of privately owned test logic structure algorithm framework;
Above-mentioned User-defined template: mainly be the system template that test case is directed against the acquiescence that provides when system; Publicly-owned template; Privately owned template can not satisfy under the situation of test case demand, and the user can be according to the actual needs of test case, and oneself defines a kind of brand-new test service template.
Test compiling administrative unit; Be used for mapping relations according to the foundation of test template administrative unit; Through the test template of selecting for test case; This test case is compiled the source code that generates test script, and the source code of test script is saved in the resource management storage server under the test event engineering catalogue of software to be tested.
Simultaneously, test compiling administrative unit establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of also supporting to test the compiler task resource such as is provided with at operational administrative.
The test script management unit is used for the source code of testing the test script that compiles the administrative unit generation is managed.
Simultaneously, the test script management unit also supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test script resource that operational administrative is set etc.
The test assignment administrative unit is used to generate above-mentioned test script fixed time test task to be carried out, and the fixed time test task is saved in the test resource management storage server under the test event engineering catalogue of software to be tested.The fixed time test term of reference execution time point of each testing procedure in the test script.
Simultaneously, the test assignment administrative unit also supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test assignment resource that operational administrative is set etc.
The test dispatching administrative unit is used for the execution time point stipulated according to above-mentioned fixed time test task, this fixed time test task of timer-triggered scheduler, and give software automated testing executive subsystem 003 with above-mentioned test script timed sending.
Simultaneously, the test dispatching administrative unit also supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test dispatching task resource that operational administrative is set etc.
The test report administrative unit; Be used for the resource management storage server is managed to the automation software testing result who preserves under the test event engineering catalogue of software to be tested; And, test report is kept in the resource management storage server under the test event engineering catalogue of software to be tested according to test result generation test report.
Wherein, can comprise: generate the test result file of text formatting, and this test result file is duplicated, stickup, rename, deletion, shearing, downloaded, uploads or the like bookkeeping the management of test result.
Test resource report form statistics administrative unit is used for test resource is added up, and generates figure statistics or statistical report form, is convenient to operating personnel's management.Concrete, at least one association in test event engineering information, test case information, test template information, test script information, test assignment information, the test result report information is carried out robotization add up, generate automatically figure statistics or form.
The information of all testing engineering resources all is kept on the resource management storage server, is convenient to the software test personnel the relevant test resource of software automated testing project engineering is managed.
Software automated testing executive subsystem 003 comprises tested object administrative unit and test execution unit.Wherein, The tested object administrative unit is used on tested software subsystem 004, loading the object code of software to be tested; The test execution unit is used on tested software subsystem 004, loading, compiles, resolves tested object key word and test driving data by the automatic test script source code of test dispatching administrative unit distribution; And robotization compiles test script, resolves tested object key word and test driving data, carries out automatic test script; Real-time resource management storage server to software automated testing Resource Manager Subsystem 002 reports test result in resolving implementation, can also printout test process Log daily record.
Tested software subsystem 004 is the actual application environment of software to be tested.This tested software subsystem 004 can be PC computer, server or workstation etc.This software subsystem to be tested can also constitute (as shown in Figure 4) with equipment under test 0042 by tested network management unit 0041.
Wherein, the network node control system that tested network management unit 0041 is a kind of network communication equipment comprises server end, client, database side application program, can concentrate the deployment also can distributed deployment.Can be network management platform and NE Explorer; The network management platform major function provides basic communications framework, common component; Can manage resource, alarm, the performance of communication facilities, NE Explorer mainly be to communication facilities carry out operation layer management, can carry out inquiry business configuration to communication facilities, issue configuration, delete function such as business configuration.Specify; Based on software automated testing solution disclosed by the invention and software automated testing resource management platform system; Be not only applicable to the network management system of communication facilities; Comprise function automatic test, the automatic performance test of network management platform and each product line EMS NE Explorer; Also be applicable to the automatic test of CORBA northbound interface, TL1 northbound interface, WebService northbound interface and hyper terminal, CLI order, autoexec; And; Also support multi-lingual environment, can windows, in the automatic test environment of linux cross operating system, cross-platform installation, deployment, api interface favorable expandability, the portable software application that by force, extensively should be applicable to language developments such as other JAVA, C++, C#, VB.et, HTML, bat batch processing, can be widely used in the computer software testing field.
Equipment under test 0042 can be following arbitrary communication facilities: but transmission series managing communication devices; But the logical series managing communication devices of number; But exchange series managing communication devices; But user terminal series managing communication devices; But other managing communication devices.
The system that the embodiment of the invention provides can adopt centralized deployment between each sub-systems, and for example, software storage server to be tested, resource management server can be concentrated and be deployed on the equipment.
In addition, the system that the embodiment of the invention provides, each sub-systems can also adopt P-2-P technology.For example, software automated testing Resource Manager Subsystem 002 can be made up of two PC (PC), and each functional module in the software automated testing Resource Manager Subsystem 002 all has deployment on these two PC.Can manage the test resource among another PC through a PC.
Based on the system that above-mentioned concrete application implementation example provides, realize that the integrated flow of software to be tested comprises in the software automated testing process:
The source code of the software to be tested that the source code storage administrative client equipment receiving software developer in step 1001, the software integral subsystem 001 to be tested submits to if submit to successfully, gets into step 1002, otherwise continues to return step 1001;
Source code storage administrative client equipment in step 1002, the software integral subsystem 001 to be tested sends to the source code storage management server in the software integral subsystem 001 to be tested with the source code of software to be tested; If success; Get into step 1003, otherwise continue to return step 1002;
Configuration Management Officer can be treated the source code of testing software and manage on the source code storage management server, check that the source code of software to be tested is whether correct and carry out operations such as daily management, backup, rollback;
Step 1003, software integrated management equipment retrieve local the integration environment with the source code of the software to be tested on the source code storage management server, if detect success, get into step 1004, otherwise continue to return step 1003;
Step 1004, software integrated management equipment use the software continuous integration tool that the compilation of source code of software to be tested is object code, if compile successfully, get into step 1005, otherwise continue to return step 1004;
Step 1005, software integrated management equipment are packed the object code of software to be tested; The compressed package start-up routine that generates executable file or can start through other modes; If pack successfully, get into step 1006, otherwise continue to return step 1005;
The software storage server to be tested that step 1006, software integrated management equipment upload to software integral subsystem 001 to be tested with the executable file or the compressed package start-up routine of the object code of software to be tested; If upload success; It is integrated to accomplish software to be tested; Otherwise, continue to return step 1006.
Based on the system that above-mentioned concrete application implementation example provides, realize that the flow process of software automated testing comprises in the software automated testing process:
Test event engineering management unit in step 2001, the software automated testing Resource Manager Subsystem 002 is according to the instruction of software test personnel input; Create test event engineering to software to be tested; If successfully get into step 2002, otherwise return step 2001.
The software test personnel can also inquire about, revise editor, preservation, deletion, importing, derivation, attribute display to the information of test event engineering operational administrative is set etc.
Step 2002, test case management unit obtain the test case to software to be tested, if success gets into step 2003, otherwise, continue to return step 2002.
The software test personnel are based on Object-oriented Technique; The test case of manual configuration XML cannonical format; And carry out Technical Review, after evaluation is passed through, add the test case attribute that disposes the XML form of accomplishing to the test case management unit; And test case managed, support establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test case resource that operational administrative is set etc.
Step 2003, test case management unit are kept at this test case in the resource management server and are directed against under the test event engineering catalogue of above-mentioned software to be tested, if success gets into step 2004, otherwise, continue to return step 2003.
Step 2004, test template administrative unit are selected test template; Be used in the test template of the tested object key word that in this test case, disposes and test driving data and selection to describe between variable and the constant of measuring executing process and set up mapping relations; If success; Get into step 2005, otherwise, execution in step 2004 returned.
Simultaneously, the test template administrative unit supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test template resource that operational administrative is set etc.
The mapping relations that step 2005, test compiling administrative unit are set up according to the test template administrative unit compile the source code that generates test script automatically with this test case, if success gets into step 2006, otherwise, continue to return step 2005;
The source code that the test script of compiling administrative unit generation will be tested in step 2006, test script management unit is saved in the resource management storage server under the test event engineering catalogue of software to be tested; If success; Get into step 2007, otherwise, step 2006 returned.
Simultaneously, the test script management unit also supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test script resource that operational administrative is set etc.
Step 2007, test assignment administrative unit generate above-mentioned test script fixed time test task to be carried out; And the fixed time test task is saved in the test resource management storage server under the test event engineering catalogue of software to be tested; If success; Get into step 2008, otherwise continue to return step 2007.The fixed time test term of reference execution time point of each testing procedure in the test script.
Simultaneously, the test assignment administrative unit also supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test assignment resource that operational administrative is set etc.;
Step 2008, test dispatching administrative unit are according to the execution time point of setting in the above-mentioned fixed time test task; This fixed time test task of timer-triggered scheduler; And give software automated testing executive subsystem 003 with above-mentioned test script timed sending, if success gets into step 2009; Otherwise, continue to return step 2008.
Simultaneously, the test dispatching administrative unit also supports establishment, inquiry, modification editor, preservation, deletion, importing, derivation, the attribute display of test dispatching task resource that operational administrative is set etc.The test dispatching task is meant the task description into realizing that above-mentioned steps 2008 is set up.
The test execution unit of step 2009, software automated testing executive subsystem 003 regularly detects the source code of the test script of test dispatching administrative unit transmission, if success then gets into step 2010, otherwise returns step 2009.
The tested object administrative unit of step 2010, software automated testing executive subsystem 003 loads the object code of software to be tested on tested software subsystem 004, if success then gets into step 2011, otherwise returns step 201.
The test execution unit of step 2011, software automated testing executive subsystem 003 loads on tested software subsystem 004, compiles, resolves by tested object key word in the automatic test script source code of test dispatching administrative unit distribution and test driving data; And robotization compiles test script, resolves tested object key word and test driving data, carries out automatic test script; If success; Then get into step 2012, otherwise return step 2011;
The test execution unit of step 2012, software automated testing executive subsystem 003 reports test result to the resource management storage server of software automated testing Resource Manager Subsystem 002 in real time; All right printout test process Log daily record; If success; Get into step 2013, otherwise, continue to return step 2013.
Step 2013, test report administrative unit are to managing to the test result of preserving under the test event engineering catalogue of software to be tested in the resource management storage server; And according to test result generation test report; Test report is kept in the resource management storage server under the test event engineering catalogue of software to be tested; If success then gets into step 2014, otherwise returns step 2013;
Step 2014, test resource report form statistics administrative unit are used for the test event resource is added up, and generate figure statistics or statistical report form, are convenient to operating personnel's management.Concrete, data such as test event engineering information, test case information, test template information, test script information, test assignment information, test result report information are carried out robotization add up, generate automatically figure statistics or form.
The system and method that the embodiment of the invention provides can be realized the distributed scheduling automatic test script, automatically perform test assignment.
The principle of work of distributed scheduling automatic test script mainly is to adopt the TCP/1P procotol; The TFTP/FTP procotol, based on windows remote command dispatching technique and timed task function; According to distributed scheduling test script demand; Write the bat batch processing script of remote scheduling order; The timing task management function can remove to carry out bat automatically according to the predefined time and dispatch script automatically, dispatches the automatic dispatching automation test script testScript.java of script meeting automatically, the executive software automatic test; Can the real time record test result arrive database in the automatic test script implementation; At last, the real-time demonstration test report of software automated testing Resource Manager Subsystem through this solution provides can increase, delete, revise, inquires about, derive and manage simultaneously testing engineering, automatic test cases, automatic test script, automatic test task, automatic test report.
The flow process of above-mentioned software automated testing executive subsystem 003 executive software automatic test specifically can comprise:
The tested object administrative unit of step 3001, software automated testing executive subsystem 003 loads the tested object of tested software automatically on tested software subsystem 004, if success then gets into step 3002, otherwise returns step 3001;
The test execution unit of step 3002, software automated testing executive subsystem 003 loads the test script source code or starts the test script transcripter and carries out automatic recording test source code on tested software subsystem 004; If success; Then get into step 3003, otherwise return step 3004;
The test execution unit of step 3003, software automated testing executive subsystem 003 becomes the compilation of source code of test script the object code of test script automatically, if success then gets into step 3004, otherwise returns step 3003;
The test execution unit of step 3004, software automated testing executive subsystem 003 loads tested object key word, test script mapping, testing authentication point, the test driving data of software to be tested on tested software subsystem 004; Simultaneously the automatic test step is resolved, carried out to the testing procedure in the test script object code; If success; Then get into step 3005, otherwise return step 3004;
The test execution unit of step 3005, software automated testing executive subsystem 003 is saved in test result the resource management storage server of software automated testing Resource Manager Subsystem 002 automatically, can also printout test process Log daily record.
In the software automated testing implementation; The workflow of tested software subsystem 004 is following: the tested object key word of the testing procedure action of automatic test cases configuration is carried out in the simulation playback, and analog subscriber practical operation software to be tested carries out the test job of automated manner.If tested software subsystem 004 is made up of with equipment under test 0042 tested network management unit 0041.Equipment under test 0042 further response of step analog subscriber practical operation communicates equipment practical business testing process, then next testing procedure of waiting step 3004.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, belong within the scope of claim of the present invention and equivalent technologies thereof if of the present invention these are revised with modification, then the present invention also is intended to comprise these changes and modification interior.
Claims (11)
1. a method that realizes software automated testing is characterized in that, comprising:
Obtain the object code of software to be tested;
Obtain the test case to said software to be tested, said test case adopts Object-oriented Technique to generate, and comprises tested object key word and test driving data to said software to be tested;
Automatically compile test script according to said test case and predetermined measuring executing process, comprise the code of said tested object key word and test driving data and said measuring executing process in the said test script;
Move said test script,, the object code of said software to be tested is carried out software automated testing based on said tested object key word and test driving data so that according to said measuring executing process.
2. method according to claim 1 is characterized in that, this method also comprises:
Based on the object to be tested in the said software to be tested, generate the tested object key word;
Based on the object to be tested in the said software to be tested, generate the test driving data corresponding with said tested object key word;
According to said tested object key word and corresponding test driving data, dispose said test case.
3. method according to claim 2 is characterized in that, compiles test script automatically according to said test case, specifically comprises:
Select the test template corresponding with said test case, said test template is used to use the programming language of said test script to describe said measuring executing process;
Be used in the tested object key word that in said test case, disposes and test driving data and the said test template to describe between variable and the constant of said measuring executing process and set up mapping relations;
According to the mapping relations of setting up, said test case is compiled automatically the source code that generates test script.
4. method according to claim 3 is characterized in that, obtains before the object code of software to be tested, and this method also comprises:
Set up test event engineering to said software to be tested;
This method also comprises:
With said test case and the related preservation of said test event engineering;
With said test template and the related preservation of said test event engineering;
Source code and the related preservation of said test event engineering with said test script;
With said software automated testing result and the related preservation of said test event engineering.
5. method according to claim 4 is characterized in that, this method also comprises:
With software automated testing result and the related preservation of said test event engineering;
Based at least one in said software automated testing result, said test case, said test template, the said test script, generation test resource form.
6. a system that realizes software automated testing is characterized in that, comprising:
Software integral subsystem to be tested is used to obtain the object code of software to be tested;
The software automated testing Resource Manager Subsystem; Be used to obtain test case to said software to be tested; Automatically compile test script according to said test case and predetermined measuring executing process; Said test case adopts Object-oriented Technique to generate, and comprises tested object key word and test driving data to said software to be tested, comprises the code of said tested object key word and test driving data and said measuring executing process in the said test script;
The software automated testing executive subsystem; Be used for the object code of said test script and software to be tested is loaded into the tested software subsystem; So that according to said measuring executing process, the object code of said software to be tested is carried out software automated testing based on said tested object key word and test driving data.
7. system according to claim 6 is characterized in that, said software integral subsystem to be tested comprises: source code storehouse management client device, source code storehouse management server, software integrated management equipment and software storage server to be tested;
Said source code storehouse management client device is used to receive the source code of said software to be tested, and the source code of the software to be tested that will receive is uploaded to said source code storehouse management server;
Said software integrated management equipment is used for obtaining from said source code storehouse management server the source code of said software to be tested; Source code to said software to be tested compiles; Generate the object code of said software to be tested, and the object code of said software to be tested is packaged as executable program or compressed package start-up routine;
Said software storage server to be tested is used to preserve the object code of the said software to be tested that is packaged as executable program or compressed package start-up routine.
8. system according to claim 7 is characterized in that, said software automated testing Resource Manager Subsystem comprises:
The test template administrative unit is used to select the test template corresponding with said test case, and said test template is used to use the programming language of said test script to describe said measuring executing process; Be used in the tested object key word that in said test case, disposes and test driving data and the said test template to describe between variable and the constant of said measuring executing process and set up mapping relations;
Test compiling administrative unit is used for according to the mapping relations of setting up, and said test case compiling is generated the source code of test script.
9. system according to claim 8; It is characterized in that said software automated testing Resource Manager Subsystem also comprises: test event engineering management unit, test case management unit, test script management unit, test assignment administrative unit, test dispatching administrative unit and resource management storage server;
Test event engineering management unit is used to set up the test event engineering to said software to be tested, said test event engineering is saved in the said resource management storage server, and the information of said test event engineering is managed;
The test case management unit is used to obtain the test case to said software to be tested, and said test case is saved in the relative position that is directed against the test event engineering of said software to be tested in the said resource management storage server;
The test script management unit, the source code of the test script that is used for said test compiling administrative unit is generated is managed;
The test assignment administrative unit is used to generate said test script fixed time test task to be carried out, and said fixed time test task is saved in the relative position that is directed against the test event engineering of said software to be tested in the said test resource management storage server;
The test dispatching administrative unit is used for the execution time point stipulated according to said fixed time test task, the said fixed time test task of timer-triggered scheduler, and give said software automated testing executive subsystem with the source code timed sending of said test script.
10. system according to claim 9 is characterized in that:
The resource management storage server; Also be used for preserving the software automated testing result, and preserve said test case, said test script and said test template at the relative position of the test event engineering that is directed against said software to be tested at the relative position of the test event engineering that is directed against said software to be tested;
Said software automated testing Resource Manager Subsystem also comprises test resource report form statistics administrative unit; Be used at least one item, generate the test resource form based on said software automated testing result, said test case, said test template, said test script.
11. system according to claim 10 is characterized in that, the tested software subsystem comprises tested network management unit and equipment under test.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210174114.9A CN102693183B (en) | 2012-05-30 | 2012-05-30 | Method and system for realizing automatic software testing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210174114.9A CN102693183B (en) | 2012-05-30 | 2012-05-30 | Method and system for realizing automatic software testing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102693183A true CN102693183A (en) | 2012-09-26 |
| CN102693183B CN102693183B (en) | 2015-04-01 |
Family
ID=46858656
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210174114.9A Active CN102693183B (en) | 2012-05-30 | 2012-05-30 | Method and system for realizing automatic software testing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102693183B (en) |
Cited By (78)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103236955A (en) * | 2013-04-08 | 2013-08-07 | 汉柏科技有限公司 | Method for testing network equipment performance based on software |
| CN103353857A (en) * | 2013-05-31 | 2013-10-16 | 国家电网公司 | Communication test method of integrated monitoring unit in substation |
| CN103530225A (en) * | 2013-09-10 | 2014-01-22 | 武汉烽火网络有限责任公司 | Automatic compilation testing method and automatic compilation testing platform for realizing same |
| CN103713992A (en) * | 2012-09-29 | 2014-04-09 | 深圳市赛格导航科技股份有限公司 | GPS system alert judgment based automated testing method and system |
| CN104239114A (en) * | 2013-11-12 | 2014-12-24 | 新华瑞德（北京）网络科技有限公司 | Application compiling method and device |
| CN104281518A (en) * | 2013-07-02 | 2015-01-14 | 腾讯科技（深圳）有限公司 | Terminal application test method, device, system and platform and mobile terminal |
| CN104317713A (en) * | 2014-10-27 | 2015-01-28 | 北京锐安科技有限公司 | Automatic testing tool and method on basis of templates |
| CN104516818A (en) * | 2014-12-29 | 2015-04-15 | 北京四方继保自动化股份有限公司 | Automatic testing system and method both applicable to compiler in logical configuration software |
| CN104657340A (en) * | 2015-02-10 | 2015-05-27 | 上海创景计算机系统有限公司 | Expandable script-based Word report generating system and method |
| CN104809056A (en) * | 2014-01-27 | 2015-07-29 | 阿里巴巴集团控股有限公司 | Interface testing code generating method and device |
| CN105068927A (en) * | 2015-08-04 | 2015-11-18 | 株洲南车时代电气股份有限公司 | Keyword drive-based automatic test method of urban rail drive control units |
| CN105095089A (en) * | 2015-09-14 | 2015-11-25 | 北京金山安全软件有限公司 | Method and device for testing performance of application software |
| CN105224449A (en) * | 2014-06-26 | 2016-01-06 | 富士通株式会社 | The method of testing of the application program on mobile terminal and device |
| CN105577475A (en) * | 2015-12-28 | 2016-05-11 | 上海瀚之友信息技术服务有限公司 | Automatic performance test system and method |
| WO2016082476A1 (en) * | 2014-11-25 | 2016-06-02 | 中兴通讯股份有限公司 | Service testing method and apparatus |
| CN105739481A (en) * | 2016-01-29 | 2016-07-06 | 软控股份有限公司 | Industrial control software testing method, industrial control software testing device, and industrial control software testing system |
| CN103268226B (en) * | 2013-05-17 | 2016-07-06 | 瑞斯康达科技发展股份有限公司 | A kind of test script file generates method and device |
| CN105786690A (en) * | 2014-12-24 | 2016-07-20 | 博雅网络游戏开发（深圳）有限公司 | Test method and system by using generated test embodiment steps |
| CN105786691A (en) * | 2014-12-25 | 2016-07-20 | 重庆重邮信科通信技术有限公司 | Automatic integration testing device, method and system of mobile terminal |
| CN105893238A (en) * | 2015-08-04 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Code debugging method and device |
| CN106227652A (en) * | 2016-07-12 | 2016-12-14 | 合网络技术（北京）有限公司 | Automated testing method and system |
| CN106326121A (en) * | 2016-08-22 | 2017-01-11 | 上海亿账通互联网科技有限公司 | Method for automatically generating test script and terminal |
| CN106326127A (en) * | 2016-08-29 | 2017-01-11 | 浪潮电子信息产业股份有限公司 | Automatic test method |
| CN106415504A (en) * | 2014-06-30 | 2017-02-15 | 日立汽车系统株式会社 | Test case generation system and recording medium wherein test case is recorded |
| CN106484613A (en) * | 2016-09-13 | 2017-03-08 | 郑州云海信息技术有限公司 | A kind of interface automated test frame based on fitnese |
| CN106547688A (en) * | 2016-10-19 | 2017-03-29 | 厦门市美亚柏科信息股份有限公司 | Product automation method of testing and its system based on Windows |
| CN106598853A (en) * | 2016-12-05 | 2017-04-26 | 广州唯品会信息科技有限公司 | Method and system for automatically generating test item |
| CN106649073A (en) * | 2015-10-28 | 2017-05-10 | 中国移动通信集团公司 | Test method and device based on dynamic script template |
| CN106649090A (en) * | 2016-10-10 | 2017-05-10 | 上海瀚之友信息技术服务有限公司 | Automated test system and method |
| CN106649094A (en) * | 2016-10-30 | 2017-05-10 | 合肥微匠信息科技有限公司 | Test method based on EventViewer development process |
| CN106897105A (en) * | 2017-02-14 | 2017-06-27 | 泰康保险集团股份有限公司 | program processing method and device |
| CN106997413A (en) * | 2017-04-05 | 2017-08-01 | 广东浪潮大数据研究有限公司 | A kind of method for realizing the examination ＆ verification of Valor software automations |
| CN107024916A (en) * | 2016-12-08 | 2017-08-08 | 中国北方发动机研究所(天津) | A kind of diesel engine electric control system test case parameter automatic patching system and method |
| CN107526685A (en) * | 2017-09-11 | 2017-12-29 | 杭州迪普科技股份有限公司 | A kind of method and device of test command row |
| CN107608873A (en) * | 2016-07-11 | 2018-01-19 | 珠海优特电力科技股份有限公司 | Method for testing software and system and test platform |
| CN107861869A (en) * | 2017-11-01 | 2018-03-30 | 国云科技股份有限公司 | The interface test system and its implementation of a kind of multi-mode suitable for cloud platform |
| CN107861881A (en) * | 2017-11-30 | 2018-03-30 | 五八有限公司 | Method for testing pressure and device |
| CN107872352A (en) * | 2017-11-27 | 2018-04-03 | 瑞斯康达科技发展股份有限公司 | A kind of performance test methods of network management system, apparatus and system |
| CN107908563A (en) * | 2017-11-23 | 2018-04-13 | 中国航空无线电电子研究所 | The test system of test flight task scheduling software human-computer interaction interface |
| CN108009093A (en) * | 2017-12-22 | 2018-05-08 | 北京远特科技股份有限公司 | A kind of method for testing software, apparatus and system |
| CN108153677A (en) * | 2017-12-26 | 2018-06-12 | 上海展扬通信技术有限公司 | The test method and intelligent terminal of intelligent terminal |
| CN108563579A (en) * | 2018-04-23 | 2018-09-21 | 苏州科达科技股份有限公司 | White-box testing method, apparatus, system and storage medium |
| CN108614768A (en) * | 2016-12-14 | 2018-10-02 | 北京国双科技有限公司 | A kind of distribution continuous integrating method and device |
| CN108874649A (en) * | 2017-05-08 | 2018-11-23 | 中兴通讯股份有限公司 | Generation method, device and its computer equipment of automatic test script |
| CN109086199A (en) * | 2018-06-22 | 2018-12-25 | 网宿科技股份有限公司 | A kind of automation generates the method for test script, terminal and can storage medium |
| CN109189676A (en) * | 2018-08-20 | 2019-01-11 | 北京旷视科技有限公司 | Face unlocks method for testing software, device and test macro |
| CN109388376A (en) * | 2018-09-29 | 2019-02-26 | 平安科技（深圳）有限公司 | Risk of software development appraisal procedure, device, equipment and readable storage medium storing program for executing |
| CN109408400A (en) * | 2018-12-25 | 2019-03-01 | 欧普照明股份有限公司 | A kind of software code automatic test approach and test macro |
| CN109669868A (en) * | 2018-12-17 | 2019-04-23 | 南昌弘为企业管理有限公司 | The method and system of software test |
| CN109783342A (en) * | 2017-11-10 | 2019-05-21 | 华为技术有限公司 | Script debugging method, equipment and computer storage medium |
| CN110674024A (en) * | 2018-07-02 | 2020-01-10 | 北京忆恒创源科技有限公司 | Electronic equipment integration test system and method thereof |
| CN110736920A (en) * | 2019-09-25 | 2020-01-31 | 北京握奇智能科技有限公司 | card testing method and system based on engineering management test script |
| US10599767B1 (en) | 2018-05-31 | 2020-03-24 | The Ultimate Software Group, Inc. | System for providing intelligent part of speech processing of complex natural language |
| CN110941546A (en) * | 2019-10-12 | 2020-03-31 | 平安健康保险股份有限公司 | Automatic test method, device, equipment and storage medium for WEB page case |
| CN111061638A (en) * | 2019-12-16 | 2020-04-24 | 上海钧正网络科技有限公司 | Method and device for debugging iOS system and server |
| CN111124914A (en) * | 2019-12-20 | 2020-05-08 | 广州品唯软件有限公司 | Automated test precompilation method, terminal and computer readable storage medium |
| CN111290933A (en) * | 2018-12-06 | 2020-06-16 | 中兴通讯股份有限公司 | Software automation software testing method and device |
| CN111309609A (en) * | 2020-02-13 | 2020-06-19 | 北京字节跳动网络技术有限公司 | Software processing system |
| CN111338965A (en) * | 2020-03-02 | 2020-06-26 | 五八有限公司 | Case testing method and device, electronic equipment and storage medium |
| CN111352828A (en) * | 2018-12-20 | 2020-06-30 | 顺丰科技有限公司 | Automatic testing method and system for black box test |
| CN111400198A (en) * | 2020-06-03 | 2020-07-10 | 中邮消费金融有限公司 | Self-adaptive software testing system |
| CN111506490A (en) * | 2019-01-31 | 2020-08-07 | 上海哔哩哔哩科技有限公司 | Automatic test method and device for application service interface and storage medium |
| US10747651B1 (en) | 2018-05-31 | 2020-08-18 | The Ultimate Software Group, Inc. | System for optimizing system resources and runtime during a testing procedure |
| US10769056B2 (en) | 2018-02-26 | 2020-09-08 | The Ultimate Software Group, Inc. | System for autonomously testing a computer system |
| CN111752823A (en) * | 2019-03-29 | 2020-10-09 | 北京新能源汽车股份有限公司 | Method, device and equipment for testing vehicle-mounted power supply application software |
| CN112148624A (en) * | 2020-10-21 | 2020-12-29 | 深圳创维－Rgb电子有限公司 | Method and system for processing automatic test report of digital television radio frequency performance |
| CN112230627A (en) * | 2020-10-30 | 2021-01-15 | 重庆长安汽车股份有限公司 | Remote testing method of vehicle body controller |
| CN112286814A (en) * | 2020-10-30 | 2021-01-29 | 上海纳恩汽车技术有限公司 | Automatic generation system and method of test case script |
| US10977155B1 (en) | 2018-05-31 | 2021-04-13 | The Ultimate Software Group, Inc. | System for providing autonomous discovery of field or navigation constraints |
| CN112667494A (en) * | 2020-12-08 | 2021-04-16 | 上海纳恩汽车技术股份有限公司 | Automobile UDS automatic testing method and system based on configuration table and storage medium |
| CN112799962A (en) * | 2021-02-26 | 2021-05-14 | 平安消费金融有限公司 | Software testing method, device, equipment and medium |
| US11010284B1 (en) | 2018-05-31 | 2021-05-18 | The Ultimate Software Group, Inc. | System for understanding navigational semantics via hypothesis generation and contextual analysis |
| CN113220597A (en) * | 2021-06-18 | 2021-08-06 | 中国农业银行股份有限公司 | Test method, test device, electronic apparatus, and storage medium |
| US11113175B1 (en) | 2018-05-31 | 2021-09-07 | The Ultimate Software Group, Inc. | System for discovering semantic relationships in computer programs |
| CN115221058A (en) * | 2022-07-21 | 2022-10-21 | 中航机载系统共性技术有限公司 | Software automation test system and method |
| CN115499070A (en) * | 2022-08-08 | 2022-12-20 | 成都万创科技股份有限公司 | Wireless module testing system and method |
| WO2023155384A1 (en) * | 2022-02-18 | 2023-08-24 | 华为云计算技术有限公司 | Method and apparatus for generating test case, and related device |
| US11954461B2 (en) | 2018-02-26 | 2024-04-09 | Ukg Inc. | Autonomously delivering software features |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109861987A (en) * | 2019-01-02 | 2019-06-07 | 广州大学 | Automate Permeation Test System, method and robot |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030126517A1 (en) * | 2001-07-27 | 2003-07-03 | Accordsqa | Automated software testing and validation system |
| CN1567232A (en) * | 2003-07-10 | 2005-01-19 | 华为技术有限公司 | Testing device and method for flush-bonding system |
| CN101833498A (en) * | 2009-07-31 | 2010-09-15 | 北京伟晨豪嘉科技有限责任公司 | Automatic detection system of embedded type system based on testing script technique |
| CN102141962A (en) * | 2011-04-07 | 2011-08-03 | 北京航空航天大学 | Safety distributed test framework system and test method thereof |
-
2012
- 2012-05-30 CN CN201210174114.9A patent/CN102693183B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030126517A1 (en) * | 2001-07-27 | 2003-07-03 | Accordsqa | Automated software testing and validation system |
| CN1567232A (en) * | 2003-07-10 | 2005-01-19 | 华为技术有限公司 | Testing device and method for flush-bonding system |
| CN101833498A (en) * | 2009-07-31 | 2010-09-15 | 北京伟晨豪嘉科技有限责任公司 | Automatic detection system of embedded type system based on testing script technique |
| CN102141962A (en) * | 2011-04-07 | 2011-08-03 | 北京航空航天大学 | Safety distributed test framework system and test method thereof |
Cited By (101)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103713992B (en) * | 2012-09-29 | 2017-03-15 | 深圳市赛格导航科技股份有限公司 | A kind of automated testing method judged based on gps system alert and system |
| CN103713992A (en) * | 2012-09-29 | 2014-04-09 | 深圳市赛格导航科技股份有限公司 | GPS system alert judgment based automated testing method and system |
| CN103236955B (en) * | 2013-04-08 | 2016-08-31 | 汉柏科技有限公司 | The method realizing network apparatus test performance based on software |
| CN103236955A (en) * | 2013-04-08 | 2013-08-07 | 汉柏科技有限公司 | Method for testing network equipment performance based on software |
| CN103268226B (en) * | 2013-05-17 | 2016-07-06 | 瑞斯康达科技发展股份有限公司 | A kind of test script file generates method and device |
| CN103353857A (en) * | 2013-05-31 | 2013-10-16 | 国家电网公司 | Communication test method of integrated monitoring unit in substation |
| CN103353857B (en) * | 2013-05-31 | 2016-04-20 | 国家电网公司 | The communication test method of a kind of transformer station comprehensive monitoring unit |
| CN104281518A (en) * | 2013-07-02 | 2015-01-14 | 腾讯科技（深圳）有限公司 | Terminal application test method, device, system and platform and mobile terminal |
| CN103530225A (en) * | 2013-09-10 | 2014-01-22 | 武汉烽火网络有限责任公司 | Automatic compilation testing method and automatic compilation testing platform for realizing same |
| CN103530225B (en) * | 2013-09-10 | 2016-07-06 | 武汉烽火网络有限责任公司 | Automatization's compiler test method and realize automatization's compiler test platform of the method |
| CN104239114A (en) * | 2013-11-12 | 2014-12-24 | 新华瑞德（北京）网络科技有限公司 | Application compiling method and device |
| CN104809056A (en) * | 2014-01-27 | 2015-07-29 | 阿里巴巴集团控股有限公司 | Interface testing code generating method and device |
| CN104809056B (en) * | 2014-01-27 | 2018-10-02 | 阿里巴巴集团控股有限公司 | A kind of generation method and device of interface testing code |
| CN105224449A (en) * | 2014-06-26 | 2016-01-06 | 富士通株式会社 | The method of testing of the application program on mobile terminal and device |
| CN105224449B (en) * | 2014-06-26 | 2017-12-12 | 富士通株式会社 | The method of testing and device of application program on mobile terminal |
| CN106415504A (en) * | 2014-06-30 | 2017-02-15 | 日立汽车系统株式会社 | Test case generation system and recording medium wherein test case is recorded |
| CN106415504B (en) * | 2014-06-30 | 2019-08-30 | 日立汽车系统株式会社 | Test cases technology system and the recording medium for recording test case |
| CN104317713A (en) * | 2014-10-27 | 2015-01-28 | 北京锐安科技有限公司 | Automatic testing tool and method on basis of templates |
| WO2016082476A1 (en) * | 2014-11-25 | 2016-06-02 | 中兴通讯股份有限公司 | Service testing method and apparatus |
| CN105786690A (en) * | 2014-12-24 | 2016-07-20 | 博雅网络游戏开发（深圳）有限公司 | Test method and system by using generated test embodiment steps |
| CN105786691A (en) * | 2014-12-25 | 2016-07-20 | 重庆重邮信科通信技术有限公司 | Automatic integration testing device, method and system of mobile terminal |
| CN104516818A (en) * | 2014-12-29 | 2015-04-15 | 北京四方继保自动化股份有限公司 | Automatic testing system and method both applicable to compiler in logical configuration software |
| CN104657340A (en) * | 2015-02-10 | 2015-05-27 | 上海创景计算机系统有限公司 | Expandable script-based Word report generating system and method |
| CN105068927A (en) * | 2015-08-04 | 2015-11-18 | 株洲南车时代电气股份有限公司 | Keyword drive-based automatic test method of urban rail drive control units |
| CN105893238A (en) * | 2015-08-04 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Code debugging method and device |
| CN105095089A (en) * | 2015-09-14 | 2015-11-25 | 北京金山安全软件有限公司 | Method and device for testing performance of application software |
| CN106649073A (en) * | 2015-10-28 | 2017-05-10 | 中国移动通信集团公司 | Test method and device based on dynamic script template |
| CN105577475A (en) * | 2015-12-28 | 2016-05-11 | 上海瀚之友信息技术服务有限公司 | Automatic performance test system and method |
| CN105577475B (en) * | 2015-12-28 | 2019-07-05 | 上海瀚之友信息技术服务有限公司 | Automated performance testing system and method |
| CN105739481B (en) * | 2016-01-29 | 2019-03-19 | 软控股份有限公司 | The test method of industrial control software, apparatus and system |
| CN105739481A (en) * | 2016-01-29 | 2016-07-06 | 软控股份有限公司 | Industrial control software testing method, industrial control software testing device, and industrial control software testing system |
| CN107608873B (en) * | 2016-07-11 | 2021-05-25 | 珠海优特电力科技股份有限公司 | Software testing method and system and testing platform |
| CN107608873A (en) * | 2016-07-11 | 2018-01-19 | 珠海优特电力科技股份有限公司 | Method for testing software and system and test platform |
| CN106227652A (en) * | 2016-07-12 | 2016-12-14 | 合网络技术（北京）有限公司 | Automated testing method and system |
| CN106227652B (en) * | 2016-07-12 | 2019-05-28 | 合一网络技术(北京)有限公司 | Automated testing method and system |
| CN106326121A (en) * | 2016-08-22 | 2017-01-11 | 上海亿账通互联网科技有限公司 | Method for automatically generating test script and terminal |
| CN106326127A (en) * | 2016-08-29 | 2017-01-11 | 浪潮电子信息产业股份有限公司 | Automatic test method |
| CN106484613A (en) * | 2016-09-13 | 2017-03-08 | 郑州云海信息技术有限公司 | A kind of interface automated test frame based on fitnese |
| CN106649090A (en) * | 2016-10-10 | 2017-05-10 | 上海瀚之友信息技术服务有限公司 | Automated test system and method |
| CN106547688A (en) * | 2016-10-19 | 2017-03-29 | 厦门市美亚柏科信息股份有限公司 | Product automation method of testing and its system based on Windows |
| CN106649094A (en) * | 2016-10-30 | 2017-05-10 | 合肥微匠信息科技有限公司 | Test method based on EventViewer development process |
| CN106598853A (en) * | 2016-12-05 | 2017-04-26 | 广州唯品会信息科技有限公司 | Method and system for automatically generating test item |
| CN107024916A (en) * | 2016-12-08 | 2017-08-08 | 中国北方发动机研究所(天津) | A kind of diesel engine electric control system test case parameter automatic patching system and method |
| CN108614768A (en) * | 2016-12-14 | 2018-10-02 | 北京国双科技有限公司 | A kind of distribution continuous integrating method and device |
| CN106897105A (en) * | 2017-02-14 | 2017-06-27 | 泰康保险集团股份有限公司 | program processing method and device |
| CN106997413A (en) * | 2017-04-05 | 2017-08-01 | 广东浪潮大数据研究有限公司 | A kind of method for realizing the examination ＆ verification of Valor software automations |
| CN108874649A (en) * | 2017-05-08 | 2018-11-23 | 中兴通讯股份有限公司 | Generation method, device and its computer equipment of automatic test script |
| CN107526685A (en) * | 2017-09-11 | 2017-12-29 | 杭州迪普科技股份有限公司 | A kind of method and device of test command row |
| CN107861869A (en) * | 2017-11-01 | 2018-03-30 | 国云科技股份有限公司 | The interface test system and its implementation of a kind of multi-mode suitable for cloud platform |
| US11360879B2 (en) | 2017-11-10 | 2022-06-14 | Huawei Technologies Co., Ltd. | Script debugging method, device, and computer storage medium |
| CN109783342B (en) * | 2017-11-10 | 2022-03-29 | 华为技术有限公司 | Script debugging method and device and computer storage medium |
| CN109783342A (en) * | 2017-11-10 | 2019-05-21 | 华为技术有限公司 | Script debugging method, equipment and computer storage medium |
| CN107908563A (en) * | 2017-11-23 | 2018-04-13 | 中国航空无线电电子研究所 | The test system of test flight task scheduling software human-computer interaction interface |
| CN107872352B (en) * | 2017-11-27 | 2021-08-24 | 瑞斯康达科技发展股份有限公司 | Performance test method, device and system of network management system |
| CN107872352A (en) * | 2017-11-27 | 2018-04-03 | 瑞斯康达科技发展股份有限公司 | A kind of performance test methods of network management system, apparatus and system |
| CN107861881A (en) * | 2017-11-30 | 2018-03-30 | 五八有限公司 | Method for testing pressure and device |
| CN108009093A (en) * | 2017-12-22 | 2018-05-08 | 北京远特科技股份有限公司 | A kind of method for testing software, apparatus and system |
| CN108153677A (en) * | 2017-12-26 | 2018-06-12 | 上海展扬通信技术有限公司 | The test method and intelligent terminal of intelligent terminal |
| US11954461B2 (en) | 2018-02-26 | 2024-04-09 | Ukg Inc. | Autonomously delivering software features |
| US10769056B2 (en) | 2018-02-26 | 2020-09-08 | The Ultimate Software Group, Inc. | System for autonomously testing a computer system |
| CN108563579A (en) * | 2018-04-23 | 2018-09-21 | 苏州科达科技股份有限公司 | White-box testing method, apparatus, system and storage medium |
| CN108563579B (en) * | 2018-04-23 | 2021-06-18 | 苏州科达科技股份有限公司 | White box testing method, device and system and storage medium |
| US11748232B2 (en) | 2018-05-31 | 2023-09-05 | Ukg Inc. | System for discovering semantic relationships in computer programs |
| US11113175B1 (en) | 2018-05-31 | 2021-09-07 | The Ultimate Software Group, Inc. | System for discovering semantic relationships in computer programs |
| US10599767B1 (en) | 2018-05-31 | 2020-03-24 | The Ultimate Software Group, Inc. | System for providing intelligent part of speech processing of complex natural language |
| US11537793B2 (en) | 2018-05-31 | 2022-12-27 | Ukg Inc. | System for providing intelligent part of speech processing of complex natural language |
| US10747651B1 (en) | 2018-05-31 | 2020-08-18 | The Ultimate Software Group, Inc. | System for optimizing system resources and runtime during a testing procedure |
| US11010284B1 (en) | 2018-05-31 | 2021-05-18 | The Ultimate Software Group, Inc. | System for understanding navigational semantics via hypothesis generation and contextual analysis |
| US10977155B1 (en) | 2018-05-31 | 2021-04-13 | The Ultimate Software Group, Inc. | System for providing autonomous discovery of field or navigation constraints |
| CN109086199A (en) * | 2018-06-22 | 2018-12-25 | 网宿科技股份有限公司 | A kind of automation generates the method for test script, terminal and can storage medium |
| CN110674024A (en) * | 2018-07-02 | 2020-01-10 | 北京忆恒创源科技有限公司 | Electronic equipment integration test system and method thereof |
| CN109189676A (en) * | 2018-08-20 | 2019-01-11 | 北京旷视科技有限公司 | Face unlocks method for testing software, device and test macro |
| CN109388376B (en) * | 2018-09-29 | 2023-08-11 | 平安科技（深圳）有限公司 | Software development risk assessment method, device, equipment and readable storage medium |
| CN109388376A (en) * | 2018-09-29 | 2019-02-26 | 平安科技（深圳）有限公司 | Risk of software development appraisal procedure, device, equipment and readable storage medium storing program for executing |
| CN111290933A (en) * | 2018-12-06 | 2020-06-16 | 中兴通讯股份有限公司 | Software automation software testing method and device |
| CN109669868A (en) * | 2018-12-17 | 2019-04-23 | 南昌弘为企业管理有限公司 | The method and system of software test |
| CN111352828A (en) * | 2018-12-20 | 2020-06-30 | 顺丰科技有限公司 | Automatic testing method and system for black box test |
| CN109408400A (en) * | 2018-12-25 | 2019-03-01 | 欧普照明股份有限公司 | A kind of software code automatic test approach and test macro |
| CN111506490A (en) * | 2019-01-31 | 2020-08-07 | 上海哔哩哔哩科技有限公司 | Automatic test method and device for application service interface and storage medium |
| CN111752823A (en) * | 2019-03-29 | 2020-10-09 | 北京新能源汽车股份有限公司 | Method, device and equipment for testing vehicle-mounted power supply application software |
| CN110736920A (en) * | 2019-09-25 | 2020-01-31 | 北京握奇智能科技有限公司 | card testing method and system based on engineering management test script |
| CN110941546A (en) * | 2019-10-12 | 2020-03-31 | 平安健康保险股份有限公司 | Automatic test method, device, equipment and storage medium for WEB page case |
| CN111061638A (en) * | 2019-12-16 | 2020-04-24 | 上海钧正网络科技有限公司 | Method and device for debugging iOS system and server |
| CN111124914A (en) * | 2019-12-20 | 2020-05-08 | 广州品唯软件有限公司 | Automated test precompilation method, terminal and computer readable storage medium |
| CN111124914B (en) * | 2019-12-20 | 2023-10-24 | 广州品唯软件有限公司 | Automatic test pre-compiling method, terminal and computer readable storage medium |
| CN111309609A (en) * | 2020-02-13 | 2020-06-19 | 北京字节跳动网络技术有限公司 | Software processing system |
| CN111309609B (en) * | 2020-02-13 | 2023-10-03 | 抖音视界有限公司 | software processing system |
| CN111338965A (en) * | 2020-03-02 | 2020-06-26 | 五八有限公司 | Case testing method and device, electronic equipment and storage medium |
| CN111400198A (en) * | 2020-06-03 | 2020-07-10 | 中邮消费金融有限公司 | Self-adaptive software testing system |
| CN112148624A (en) * | 2020-10-21 | 2020-12-29 | 深圳创维－Rgb电子有限公司 | Method and system for processing automatic test report of digital television radio frequency performance |
| CN112286814A (en) * | 2020-10-30 | 2021-01-29 | 上海纳恩汽车技术有限公司 | Automatic generation system and method of test case script |
| CN112230627B (en) * | 2020-10-30 | 2022-10-11 | 重庆长安汽车股份有限公司 | Remote testing method of vehicle body controller |
| CN112230627A (en) * | 2020-10-30 | 2021-01-15 | 重庆长安汽车股份有限公司 | Remote testing method of vehicle body controller |
| CN112667494A (en) * | 2020-12-08 | 2021-04-16 | 上海纳恩汽车技术股份有限公司 | Automobile UDS automatic testing method and system based on configuration table and storage medium |
| CN112799962A (en) * | 2021-02-26 | 2021-05-14 | 平安消费金融有限公司 | Software testing method, device, equipment and medium |
| CN113220597A (en) * | 2021-06-18 | 2021-08-06 | 中国农业银行股份有限公司 | Test method, test device, electronic apparatus, and storage medium |
| CN113220597B (en) * | 2021-06-18 | 2024-04-16 | 中国农业银行股份有限公司 | Test method, test device, electronic equipment and storage medium |
| WO2023155384A1 (en) * | 2022-02-18 | 2023-08-24 | 华为云计算技术有限公司 | Method and apparatus for generating test case, and related device |
| CN115221058B (en) * | 2022-07-21 | 2024-02-06 | 中航机载系统共性技术有限公司 | Automatic software testing system and method |
| CN115221058A (en) * | 2022-07-21 | 2022-10-21 | 中航机载系统共性技术有限公司 | Software automation test system and method |
| CN115499070A (en) * | 2022-08-08 | 2022-12-20 | 成都万创科技股份有限公司 | Wireless module testing system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102693183B (en) | 2015-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102693183B (en) | Method and system for realizing automatic software testing | |
| CN108427641A (en) | A kind of multi-task scheduling automated testing method and system based on Docker containers | |
| EP2572294B1 (en) | System and method for sql performance assurance services | |
| US7895565B1 (en) | Integrated system and method for validating the functionality and performance of software applications | |
| US20140032637A1 (en) | Enterprise Test System Platform and Associated Method for Interoperable Test Data Management, Test Development, Test Libraries and Test Workflow Management and Automation | |
| CN112260877B (en) | AI-based RPA robot management method, platform and storage medium | |
| US9697104B2 (en) | End-to end tracing and logging | |
| CN110321281A (en) | Web test platform and test method based on mixing automated test frame | |
| EP2615555A1 (en) | Framework for automated testing of mobile apps | |
| Eide et al. | An Experimentation Workbench for Replayable Networking Research. | |
| CN102495799A (en) | Automatic test system and method of movable terminal | |
| CN109634843A (en) | A kind of distributed automatization method for testing software and platform towards AI chip platform | |
| US20140123114A1 (en) | Framework for integration and execution standardization (fiesta) | |
| CN102566443A (en) | Simulation verification system and method for integrated avionics system model based on artifact design description language (ADDL) | |
| CN107733735B (en) | Script recording system and method implanted in pressure measurement device | |
| Dhiman et al. | Performance testing: a comparative study and analysis of web service testing tools | |
| CN109086216A (en) | Automatization test system | |
| CN112463588A (en) | Automatic test system and method, storage medium and computing equipment | |
| CN108009086B (en) | System automation test method based on case decomposition and function learning | |
| CN111290934A (en) | Jenkins-based vehicle-mounted network product cloud testing method and system | |
| CN113672502A (en) | Program multi-system testing method and corresponding device, equipment and medium | |
| CN112016256A (en) | Integrated circuit development platform, method, storage medium and equipment | |
| CN115185825A (en) | Interface test scheduling method and device | |
| CN113094266A (en) | Fault testing method, platform and equipment for container database | |
| Admanski et al. | Autotest-testing the untestable |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |