CN105512026A - Automatic batch testing method - Google Patents

Automatic batch testing method Download PDF

Info

Publication number
CN105512026A
CN105512026A CN201510834003.XA CN201510834003A CN105512026A CN 105512026 A CN105512026 A CN 105512026A CN 201510834003 A CN201510834003 A CN 201510834003A CN 105512026 A CN105512026 A CN 105512026A
Authority
CN
China
Prior art keywords
test
client
control end
testing tool
testing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510834003.XA
Other languages
Chinese (zh)
Inventor
赵盼盼
李鹏
周晓宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ISOFT INFRASTRUCTURE SOFTWARE CO Ltd
Original Assignee
ISOFT INFRASTRUCTURE SOFTWARE CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ISOFT INFRASTRUCTURE SOFTWARE CO Ltd filed Critical ISOFT INFRASTRUCTURE SOFTWARE CO Ltd
Priority to CN201510834003.XA priority Critical patent/CN105512026A/en
Publication of CN105512026A publication Critical patent/CN105512026A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites

Abstract

The invention discloses an automatic batch testing method, pertaining to the technical field of automatic testing. The method comprises following steps of: step S1, sequentially sending testing tools corresponding down to all clients by a control end and performing installation operation of operation systems by dependency correspondence; step S2, applying installed testing tools by each client to test compilation performance of the systems and monitoring in order to obtain testing data generated during testing processes; step S3, reporting all the testing data to the control end by each client in order to finish testing compilation performance of the systems and then quitting. The above technical scheme adopted by the automatic batch testing method has following beneficial effects: automatic batch testing problems of operation systems in different versions and types are solved; manual cost is reduced; and testing efficiency is improved.

Description

A kind of batch automatic test approach
Technical field
The present invention relates to automatic test technology field, particularly relate to a kind of batch automatic test approach.
Background technology
In prior art, because various object is such as the support of different computer organization, or the demand of corresponding different application, or many-sided reason such as the demand for localization of different regions or language, there will be the operating system of all kinds of version, and dissimilar operating system.
Then in prior art, in the process of the operating system of dissimilar different editions being tested automatically to (especially the automatic test of System build aspect of performance), owing to not considering above-mentioned multiple test scene, therefore on each system under test (SUT), manually carry out testing tool installation, operation is usually needed, and the step such as the collection of test data, need the artificial operation performing a large amount of repetition, cause the waste of human resources and time resource.And the installation environment of testing tool in the operating system of dissimilar different editions also can be different, do not exist in prior art and can carry out testing tool installation and carry out the implementation method of test data collection by batch in different operating system.
Summary of the invention
According to problems of the prior art, now provide a kind of technical scheme of batch automatic test approach, the problem that the batch being intended to carry out System build performance for the operating system that different editions is dissimilar in solution prior art is tested automatically.
Technique scheme specifically comprises:
A kind of batch automatic test approach, wherein, comprise multiple client and control end, described control end connects each described client respectively, and for controlling the automatic testing process of each described client, each described client is normally run respectively under different operating system, also comprises:
Step S1, the testing tool of each for correspondence described client is issued to each described client and carries out relying on the installation operation of corresponding described operating system by described control end successively;
Step S2, each described client applies the test that mounted described testing tool carries out System build performance respectively, and monitoring obtains the test data produced in test process;
Step S3, described test data is reported to described control end by each described client respectively, to complete the test to described System build performance, with backed off after random.
Preferably, this batch automatic test approach, wherein, before performing described step S1, each described client is set up SSH mutual trust with described control end respectively and is connected.
Preferably, this batch automatic test approach, wherein, before performing described step S1, installs the described operating system of the correspondence needing test in each described client.
Preferably, this batch automatic test approach, wherein, described step S1 specifically comprises;
Step S11, described control end issues the dependence environment installation kit for arranging the test environment being associated with corresponding described operating system respectively to each described client;
Step S12, the described dependence environment installation kit that described client Auto-mounting receives, to arrange the test environment being associated with corresponding described operating system;
Step S13, described control end issues corresponding described testing tool respectively to each described client;
Step S14, the described testing tool that described client Auto-mounting receives, with step S2 described in rear steering.
Preferably, this batch automatic test approach, wherein, before the described step S1 of execution, in described control end, pre-set the address list comprising the IP address being associated with each described client, all described IP address in described address list is according to the order arrangement preset;
Then in described step S1, described testing tool, according to the described default order of the described IP address of preserving in described address list, is issued in each described client by described control end successively.
Preferably, this batch automatic test approach, wherein, pre-sets the test parameter being associated with each described client in described control end;
In described step S1, described control end, while issuing described testing tool, issues corresponding described test parameter respectively to each described client;
Then in described step S2, each described client applies corresponding described testing tool respectively, and the described test parameter according to correspondence carries out the test of System build performance.
Preferably, this batch automatic test approach, wherein, is all associated with in a test script corresponding to the described testing tool of each described client and described test parameter;
Then in described step S1, described control end starts the described test script being associated with each described client successively, respectively described testing tool and described test parameter are sent to each described client.
Preferably, this batch automatic test approach, wherein, described client is normally run on the (SuSE) Linux OS of different editions.
The beneficial effect of technique scheme is: provide a kind of batch automatic test approach, the problem that the batch that cannot carry out System build performance for the operating system that different editions is dissimilar in prior art is tested automatically can be solved, reduce cost of labor, promote testing efficiency.
Accompanying drawing explanation
Fig. 1 is in preferred embodiment of the present invention, a kind of overall procedure schematic diagram of batch automatic test approach;
Fig. 2 is in preferred embodiment of the present invention, and on the basis of Fig. 1, control end issues the schematic flow sheet of testing tool;
Fig. 3 is in preferred embodiment of the present invention, and above-mentioned batch automatic test approach realizes the general structure schematic diagram of the test macro relied on.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art obtain under the prerequisite of not making creative work, all belongs to the scope of protection of the invention.
It should be noted that, when not conflicting, the embodiment in the present invention and the feature in embodiment can combine mutually.
Below in conjunction with the drawings and specific embodiments, the invention will be further described, but not as limiting to the invention.
In preferred embodiment of the present invention, based on the above-mentioned problems in the prior art, a kind of batch automatic test approach is now provided, the method be applicable to dissimilar and or the System build performance of operating system of different editions carry out batch and automatically test, therefore, the method depends on test macro as shown in Figure 3.This test macro comprises multiple customer end A and control end B, and control end B connects each customer end A respectively, and for controlling the automatic testing process of each customer end A, each customer end A is normally run respectively under different operating system.
In preferred embodiment of the present invention, arranging of above-mentioned client can be carried out according to the test case of reality, such as:
Need test S kind operating system, and in often kind of operating system, need the compilation performance testing C kind compiler, then (S*C) individual client can be set, and 1 control end is set.
As: need test 4 kinds of operating systems, all need the compilation performance of test a kind of compiler in often kind of operating system, then the quantity of above-mentioned client is 4*1=4, and arranges 1 control end, and the hardware device therefore in test macro is specially 5.
Again such as: need test 3 kinds of operating systems, in often kind of operating system, all need the compilation performance of test 2 kinds of compilers, then the quantity of above-mentioned client is 3*2=6, and arranges 1 control end, and the hardware device therefore in test macro is specially 7.
In preferred embodiment of the present invention, the hardware configuration of above-mentioned hardware device (comprising client and control end) should be consistent, and affects final test data to avoid unstable test environment.
Then in preferred embodiment of the present invention, based on building of above-mentioned test macro, the concrete steps of above-mentioned batch automatic test approach as shown in Figure 1, comprising:
Step S1, the testing tool of each for correspondence client is issued to each client and carries out relying on the installation operation of corresponding operating system by control end successively;
Step S2, each client applies the test that mounted testing tool carries out System build performance respectively, and monitoring obtains the test data produced in test process;
Step S3, test data is reported to control end by each client respectively, to complete the test to System build performance, with backed off after random.
In a specific embodiment, control end is first according to the operating system of each client, the testing tool of correspondence is issued to different clients successively, and carries out installation operation (testing tool can describe in detail hereinafter) relying on operating system in this client.
Subsequently, in this embodiment, each client applies above-mentioned mounted testing tool respectively, tests, monitor and obtain corresponding test data the compilation performance (i.e. System build performance) that it runs compilers different in the operating system relied on.The test that different compiler for different operating system carries out compilation performance can set in advance, and each client only needs to run corresponding testing tool can realize automatic test.
Finally, each client will be monitored in test process and the test data obtained, and subsequently test data is sent to control end and gathers, thus completes the process of the automatic test of this batch.
In preferred embodiment of the present invention, before performing above-mentioned steps S1, each client is set up SSH (SecureShell, safety shell protocol) mutual trust respectively and is connected with control end.Particularly, each client installs the different operating system needing to carry out testing first respectively, sets up SSH mutual trust respectively subsequently and is connected, to prepare automatically to test according to SSH agreement with above-mentioned control end.
In preferred embodiment of the present invention, as shown in Figure 2, above-mentioned steps S1 specifically comprises;
Step S11, control end issues the dependence environment installation kit for arranging the test environment being associated with corresponding operating system respectively to each client;
In prior art, for the operating system run under the operating system of dissimilar and/or different editions, the installation it being carried out to unified testing tool is obvious and unrealistic.Tester needs to coordinate operating system that is dissimilar and/or different editions respectively each client to be depended on to the installation operation of the testing tool of this operating system, then this process will be very complicated, and occupy a large amount of human resources and time resource.
Therefore, in preferred embodiment of the present invention, in above-mentioned steps S11, control end can be before testing begins, first issue should the type of operating system of client and/or the dependence environment installation kit of version respectively to each client, the testing tool installation environment to the operating system should installed in client is set for different clients.
Particularly, one driving file can be set at control end, the version information of the different operating system of Auto-matching can be realized in the setup function in this driving file and select corresponding bag way to manage, and carry out the series installation problems such as the installation of dependence bag.
Step S12, the dependence environment installation kit that client Auto-mounting receives, to arrange the test environment being associated with corresponding operating system;
Step S13, control end issues corresponding testing tool respectively to each client;
The compilation performance testing tool of a kind of PTS of being called as can be selected as the testing tool used in technical solution of the present invention in a preferred embodiment of the present invention, and adopt automated test frame (Autotest) to realize the main body frame of control end.
Therefore, in this embodiment, above-mentioned PTS testing tool can comprise basic test assembly and protos test suite PROTOS group.
Then in above-mentioned steps S13, consider that the distribution efficiency of the whole testing tool of PTS is lower, the defeated mode of control end inborn ability supplementary biography issues testing tool to client, namely after control end starts test, first respectively basic test assembly be issued to different clients and install, and after client terminal start-up test, more corresponding protos test suite PROTOS group is issued to different clients installs.
In preferred embodiment of the present invention, the distribution of above-mentioned basic test assembly mainly through the Autoserv process in Autotest framework, according to the IP address transfer of the operating system of the destination client of specifying to the destination client of specifying.And the distribution of protos test suite PROTOS group downloads to client mainly through wget from control end, be specially and build a FTP (FileTransferProtocol at control end, file transfer protocol (FTP)) server, and the protos test suite PROTOS group of having debugged is put in the download directory of correspondence, client is downloaded protos test suite PROTOS group according to these download directory set and installs subsequently.
Step S14, the testing tool that client Auto-mounting receives, with rear steering step S2.
In preferred embodiment of the present invention, after installing testing tool, the startup of test can be realized by the run_once function in Autotest framework.First this function realizes the registration of PTS testing tool, and it is mutual by what use shell and pexpect storehouse to realize in test process, then perform corresponding test command, the parameter of test command obtains from the control file (control documents) Autotest framework.In above-mentioned test process test result monitoring and collect then realized by postprocess function.The test result file that this function realizes PTS testing tool generates copies in specific result list, finally completes test result by Autotest framework and is back to control end.Above-mentioned control file is the configuration file of client terminal start-up test, realizes the control of test parameter and test execution number of times simultaneously.Control file realizes the transmission of calling of Test driver file and test parameter by the run_test method in Autotest framework.
In preferred embodiment of the present invention, before execution above-mentioned steps S1, in control end, first pre-set the address list comprising the IP address being associated with each client, all IP addresses in address list are according to the order arrangement preset;
Particularly, for the static ip address that each client sets, all these IP addresses are also kept in above-mentioned control end according in sequence integration to address list preset in advance;
Then in step S1, testing tool, according to the order preset of the IP address of preserving in address list, is issued in each client by control end successively.
In preferred embodiment of the present invention, in control end, pre-set the test parameter being associated with each client;
In step S1, control end, while issuing testing tool, issues corresponding test parameter respectively to each client;
Then in step S2, each client carries out the test of System build performance respectively according to the test parameter of correspondence.
In preferred embodiment of the present invention, be all associated with in a test script corresponding to the testing tool of each client and test parameter;
Then in step S1, control end starts the test script being associated with each client successively, respectively testing tool and test parameter are sent to each client.
Particularly, in preferred embodiment of the present invention, before performing the testing, each client needs to report its IP address to control end in advance, and all IP addresses be reported are incorporated in an address list (IPlist).Then carry out test starting function at control end just to be performed by following two files: iplist and above-mentioned test script (being named as compiler-test.sh in preferred embodiment of the present invention).The function of compiler-test.sh script is the IP address of reading each client in iplist successively, and starts each client successively according to IP address and test.After Autotest framework receives the test request being associated with and starting test, control end can issue PTS testing tool (comprising basic test assembly and protos test suite PROTOS group) to each client successively, client Auto-mounting relies on environment installation kit, and Auto-mounting PTS testing tool, the automatic test parameter according to setting in advance carries out the test of System build performance subsequently, and from trend control end passback test data.
In preferred embodiment of the present invention, above-mentioned each client is normally run on the (SuSE) Linux OS of different editions, namely it is the test carried out in (SuSE) Linux OS inside that the batch carried out in this embodiment is tested automatically, for comparing the quality of the System build performance of the (SuSE) Linux OS of different editions.In other embodiments of the present invention, above-mentioned different client can also operate in dissimilar operating system, such as operate in Windows operating system and (SuSE) Linux OS, then mean that above-mentioned batch is automatically tested the System build performance that may be used for equally dissimilar operating system and carried out batch testing.
The foregoing is only preferred embodiment of the present invention; not thereby embodiments of the present invention and protection domain is limited; to those skilled in the art; should recognize and all should be included in the scheme that equivalent replacement done by all utilizations instructions of the present invention and diagramatic content and apparent change obtain in protection scope of the present invention.

Claims (8)

1. a batch automatic test approach, it is characterized in that, comprise multiple client and control end, described control end connects each described client respectively, and for controlling the automatic testing process of each described client, each described client is normally run respectively under different operating system, also comprises:
Step S1, the testing tool of each for correspondence described client is issued to each described client and carries out relying on the installation operation of corresponding described operating system by described control end successively;
Step S2, each described client applies the test that mounted described testing tool carries out System build performance respectively, and monitoring obtains the test data produced in test process;
Step S3, described test data is reported to described control end by each described client respectively, to complete the test to described System build performance, with backed off after random.
2. batch automatic test approach as claimed in claim 1, it is characterized in that, before performing described step S1, each described client is set up SSH mutual trust with described control end respectively and is connected.
3. batch automatic test approach as claimed in claim 1, is characterized in that, before performing described step S1, installs the described operating system of the correspondence needing test in each described client.
4. batch automatic test approach as claimed in claim 1, is characterized in that,
Described step S1 specifically comprises;
Step S11, described control end issues the dependence environment installation kit for arranging the test environment being associated with corresponding described operating system respectively to each described client;
Step S12, the described dependence environment installation kit that described client Auto-mounting receives, to arrange the test environment being associated with corresponding described operating system;
Step S13, described control end issues corresponding described testing tool respectively to each described client;
Step S14, the described testing tool that described client Auto-mounting receives, with step S2 described in rear steering.
5. batch automatic test approach as claimed in claim 1, it is characterized in that, before the described step S1 of execution, in described control end, pre-set the address list comprising the IP address being associated with each described client, all described IP address in described address list is according to the order arrangement preset;
Then in described step S1, described testing tool, according to the described default order of the described IP address of preserving in described address list, is issued in each described client by described control end successively.
6. batch automatic test approach as claimed in claim 1, is characterized in that, pre-set the test parameter being associated with each described client in described control end;
In described step S1, described control end, while issuing described testing tool, issues corresponding described test parameter respectively to each described client;
Then in described step S2, each described client applies corresponding described testing tool respectively, and the described test parameter according to correspondence carries out the test of System build performance.
7. batch automatic test approach as claimed in claim 6, is characterized in that, is all associated with in a test script corresponding to the described testing tool of each described client and described test parameter;
Then in described step S1, described control end starts the described test script being associated with each described client successively, respectively described testing tool and described test parameter are sent to each described client.
8. batch automatic test approach as claimed in claim 1, it is characterized in that, described client is normally run on the (SuSE) Linux OS of different editions.
CN201510834003.XA 2015-11-25 2015-11-25 Automatic batch testing method Pending CN105512026A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510834003.XA CN105512026A (en) 2015-11-25 2015-11-25 Automatic batch testing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510834003.XA CN105512026A (en) 2015-11-25 2015-11-25 Automatic batch testing method

Publications (1)

Publication Number Publication Date
CN105512026A true CN105512026A (en) 2016-04-20

Family

ID=55720027

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510834003.XA Pending CN105512026A (en) 2015-11-25 2015-11-25 Automatic batch testing method

Country Status (1)

Country Link
CN (1) CN105512026A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107943636A (en) * 2017-12-07 2018-04-20 郑州云海信息技术有限公司 It is a kind of that the method tested is performed based on more machine batches under Linux
CN108829599A (en) * 2018-06-15 2018-11-16 郑州云海信息技术有限公司 A kind of test method and system of the QuickAssist technical software based on Linux
CN111104273A (en) * 2019-12-17 2020-05-05 深圳忆联信息系统有限公司 Batch task-based automatic distribution testing method and device and computer equipment
CN111198758A (en) * 2020-01-08 2020-05-26 深圳忆联信息系统有限公司 SSH-based Windows software starting method and device and computer equipment
CN111538666A (en) * 2020-04-27 2020-08-14 深圳忆联信息系统有限公司 Method and device for collecting test results in batches, computer equipment and storage medium
CN113094276A (en) * 2021-04-15 2021-07-09 深圳忆联信息系统有限公司 Batch testing method and device based on Linux system and computer equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0910018A3 (en) * 1997-10-15 2004-12-15 Alcatel Error checking method for real-time system software
CN101847118A (en) * 2009-03-24 2010-09-29 迈普通信技术股份有限公司 Automatic test system
CN102622298A (en) * 2012-03-02 2012-08-01 奇智软件(北京)有限公司 Software testing system and method
CN103237082A (en) * 2013-05-06 2013-08-07 百度在线网络技术(北京)有限公司 Cloud testing method, system, and cloud server

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0910018A3 (en) * 1997-10-15 2004-12-15 Alcatel Error checking method for real-time system software
CN101847118A (en) * 2009-03-24 2010-09-29 迈普通信技术股份有限公司 Automatic test system
CN102622298A (en) * 2012-03-02 2012-08-01 奇智软件(北京)有限公司 Software testing system and method
CN103237082A (en) * 2013-05-06 2013-08-07 百度在线网络技术(北京)有限公司 Cloud testing method, system, and cloud server

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107943636A (en) * 2017-12-07 2018-04-20 郑州云海信息技术有限公司 It is a kind of that the method tested is performed based on more machine batches under Linux
CN108829599A (en) * 2018-06-15 2018-11-16 郑州云海信息技术有限公司 A kind of test method and system of the QuickAssist technical software based on Linux
CN111104273A (en) * 2019-12-17 2020-05-05 深圳忆联信息系统有限公司 Batch task-based automatic distribution testing method and device and computer equipment
CN111198758A (en) * 2020-01-08 2020-05-26 深圳忆联信息系统有限公司 SSH-based Windows software starting method and device and computer equipment
CN111198758B (en) * 2020-01-08 2024-02-13 深圳忆联信息系统有限公司 Windows software starting method and device based on SSH and computer equipment
CN111538666A (en) * 2020-04-27 2020-08-14 深圳忆联信息系统有限公司 Method and device for collecting test results in batches, computer equipment and storage medium
CN111538666B (en) * 2020-04-27 2024-04-02 深圳忆联信息系统有限公司 Method, device, computer equipment and storage medium for collecting test results in batches
CN113094276A (en) * 2021-04-15 2021-07-09 深圳忆联信息系统有限公司 Batch testing method and device based on Linux system and computer equipment

Similar Documents

Publication Publication Date Title
CN105512026A (en) Automatic batch testing method
WO2017012219A1 (en) Software test method, apparatus and system
CN102752137B (en) The apparatus and method of virtual machine network parameter are initiatively set
CN104932919A (en) Implementation method of Linux unattended setup
CN109802867A (en) A kind of method and system for testing network interface card NCSI connective stability
CN106549789B (en) Method and system for realizing server installation
CN110825985B (en) Data acquisition system, method, device, control equipment and proxy equipment
CN103200271A (en) Advanced Risc machine (ARM) server and method of automatic installation system thereof
CN106502713A (en) A kind of method for upgrading software and system
CN105119732A (en) Device and method for distributing hosts in cluster environment
CN112749095A (en) Method, system and medium for switching operating system to execute test task
CN104503802A (en) Server-side configuration method for unattended and remote installation operation system
CN113849228A (en) Operating system batch deployment method, system, terminal and storage medium
CN111273924A (en) Software updating method and device
CN105183528A (en) Server bios upgrading method and system
CN107071043A (en) The collocation method and device of a kind of network information
CN105404569A (en) Method for testing remote Power Reset of server
CN105653408A (en) Test method for carrying out POWER CYCLE startup and shutdown on the basis of BMC (Baseboard Management Controller) IPMITOOL (Intelligent Platform Management Interface) command single-node batch control
CN104935451A (en) Fault detection method and device
CN113268254A (en) Cluster system installation method and device, electronic equipment and storage medium
CN105159725A (en) Method for establishing PXE server in RHEL6.6 system
US20060048137A1 (en) Method and apparatus for cloning an ORACLE RDBMS software
CN105373477B (en) Capacity testing method
CN110737444A (en) Remote self-adaptive dynamic deployment method and system for operating system based on firmware
CN103279374A (en) Operating system distributing technology based on MAC addresses

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160420