CN106155885A - A kind of full-automatic test system and method for testing - Google Patents

A kind of full-automatic test system and method for testing Download PDF

Info

Publication number
CN106155885A
CN106155885A CN201510149115.1A CN201510149115A CN106155885A CN 106155885 A CN106155885 A CN 106155885A CN 201510149115 A CN201510149115 A CN 201510149115A CN 106155885 A CN106155885 A CN 106155885A
Authority
CN
China
Prior art keywords
test
mobile terminal
automatic
beta version
bag
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510149115.1A
Other languages
Chinese (zh)
Inventor
刘昊天
陈琳
郝伟
王凡
王一凡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Spreadtrum Communications Shanghai Co Ltd
Original Assignee
Spreadtrum Communications Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Spreadtrum Communications Shanghai Co Ltd filed Critical Spreadtrum Communications Shanghai Co Ltd
Priority to CN201510149115.1A priority Critical patent/CN106155885A/en
Publication of CN106155885A publication Critical patent/CN106155885A/en
Pending legal-status Critical Current

Links

Abstract

The invention discloses a kind of full-automatic test system and method, belong to automatization testing technique field;System includes: version management unit, test and management unit and monitoring management unit;Method includes: whether detection controls to include not yet through the beta version bag of test in end, and continues step when including;Control end and extract beta version bag, and obtain the test script needed corresponding to the test-types of execution according to the beta version bag being extracted;Issue the beta version bag being extracted to corresponding mobile terminal, and issue to mobile terminal according to the test script being extracted and test instruction accordingly;Step S4, controls end and is monitored during automatic test in mobile terminal, and controls the hang-up of test and management unit according to monitored results or continue to run with.Technique scheme provides the benefit that: reduces the consuming of human resources in test process, promotes testing efficiency, it is simple to user grasps test process at any time.

Description

A kind of full-automatic test system and method for testing
Technical field
The present invention relates to automatization testing technique field, particularly relate to a kind of full-automatic test system and test Method.
Background technology
Along with the rise of mobile terminal industry, mobile terminal gradually incorporates in the life of people.Along with industry The lifting of competitive pressure, the key of whole mobile terminal industry development be increasingly turned to the shortening construction cycle, The aspects such as guarantee software version is stable.And there is important function be in this respect mobile terminal is performed Automatic test course.
Automatic test course of the prior art is when there being test assignment to need to perform, it is still desirable to artificial Intervene, such as, need artificially to input version, artificial selection test assignment etc..In other words, in prior art Automatization testing technique cannot accomplish when unmanned ensure automatically perform test, reduce the most accordingly The testing efficiency of automatic test.
Summary of the invention
According to problems of the prior art, now provide a kind of full-automatic test system and method for testing Technical scheme, it is intended to reduce the consuming of human resources in automatic test course further, promote automatization The efficiency of test.
Technique scheme specifically includes:
A kind of full-automatic test system, wherein, including controlling end and being connected many with described control end respectively Individual mobile terminal;
Described control end includes:
Version management unit, wherein prestores multiple beta version bag, and described version management unit is for test Personnel add described beta version bag, and detect whether to exist not yet through the beta version bag of test, defeated Go out corresponding testing result;
Test and management unit, is wherein preset with multiple test script, and described test and management unit connects described Version management unit, for according to described testing result, issues not yet warp to corresponding described mobile terminal Cross the described beta version bag of test, and control corresponding with the test script corresponding to described beta version bag Described mobile terminal carry out automatic test;
Monitoring management unit, connects described test and management unit, for performing described mobile terminal automatically The process changing test is monitored, and controls the hang-up of described test and management unit according to monitored results or continue Run.
Preferably, this full-automatic test system, wherein, described version management unit includes:
First memory module, has wherein pre-saved multiple described beta version bag, each described beta version The test system of the corresponding version of this bag;
Editor module, connects described first memory module, for beta version bag described in user editor, and/ Or in described first memory module, add new described beta version bag;
Whether detection module, connects described first memory module, exist not yet through surveying for periodic scanning The described beta version bag of examination, and export corresponding described testing result.
Preferably, this full-automatic test system, wherein, described test and management unit includes:
Version extraction module, corresponding not yet through described in test for extracting according to described testing result Beta version bag also exports;
Second memory module, wherein pre-saves the described test script of different test-types;
Script extraction module, connects described version extraction module and described second memory module respectively, is used for According to the described beta version bag being extracted, it is judged that need the described test-types that carries out, and from described the Two memory modules are extracted the described test script of corresponding types and exports;
Test selects module, connects described version extraction module, for according to the described beta version being extracted This bag selects corresponding described mobile terminal to carry out automatic test;
Version management module, connects described version extraction module respectively and described test selects module, is used for The described beta version bag being extracted is issued, for described mobile terminal to selected described mobile terminal Configure corresponding described test system;
Test and management module, connects described script extraction module respectively and described test selects module, is used for According to the described test script being extracted, issue to selected described mobile terminal and test instruction accordingly, To control the described mobile terminal corresponding automatic test of execution.
Preferably, this full-automatic test system, wherein, described test and management unit issues described beta version The mode of this bag and described test instruction is transmission AT order to corresponding described mobile terminal, with Control described mobile terminal enter downloading mode and automatically download the described beta version bag being extracted and described Test instruction.
Preferably, this full-automatic test system, wherein, described monitoring management unit includes:
First monitoring module, monitors whether during performing automatic test at described mobile terminal The first of the test process that makes a difference is tested abnormal, and record occurs the monitoring daily record of described first test exception, And when occurring described first test abnormal, described test and management unit is hung up;
Second monitoring module, for obtaining after described mobile terminal has performed the process of automatic test The journal file that described mobile terminal produces, analyzes described journal file and is tested report accordingly to process Accuse and show to user.
Preferably, this full-automatic test system, wherein, described second monitoring module is preset with multiple pass Key word information, each described keyword message is used for representing the systematicness of described mobile terminal corresponding to a class The second test that can go wrong is abnormal;
Described second monitoring module screening obtains described journal file and includes the daily record of described keyword message Record, and the described log recording obtained described screening according to described keyword message carries out classification process, The test result abnormal to respectively obtain the second test described in corresponding every class;
All described test results are incorporated in a test report and to user by described second monitoring module Display.
Preferably, this full-automatic test system, wherein, described monitoring management unit also includes:
Input module, connects described second monitoring module, defaults in described second monitoring for user editor Described keyword message in module.
Preferably, this full-automatic test system, wherein, described monitoring management unit also includes:
Abnormal submission module, connects described second monitoring module, is used for would indicate that described second test is abnormal Described test result form an exception record with corresponding described log entry correlation, and submit to described different Often record, carries out abnormal conditions tracking for user.
Preferably, this full-automatic test system, wherein, also include:
Abnormal restoring unit, connects described monitoring management unit, for representing described in described monitored results Mobile terminal issues when producing default test exception during automatic test and recovers instruction accordingly To control the recovery from described test is abnormal of described mobile terminal, and continue executing with automatic test.
A kind of full-automatic testing method, wherein, including control end with respectively and described control end is connected many Individual mobile terminal;
Described control end is preset with multiple beta version bag, and multiple surveys of corresponding different test-types Training originally, and supplies user editor and/or interpolation;
Described full-automatic testing method specifically includes:
Whether step S1, detect and include not yet through the described beta version bag of test in described control end, And include that the described beta version bag not yet passing through test turns to step S2 at described control end;
Step S2, described control end extracts not yet through the described beta version bag of test, and according to being carried The described test script corresponding to test-types obtaining needing to perform searched by the described beta version bag taken;
Step S3, described control end issues the described beta version being extracted to corresponding described mobile terminal Bag, and issue corresponding test according to the described test script being extracted to corresponding described mobile terminal Instruction, to control described mobile terminal execution automatic test;
Step S4, described control end is monitored during automatic test in described mobile terminal, And hang up according to the monitored results described test and management unit of control or continue to run with.
Preferably, this full-automatic testing method, wherein, described step S2 specifically includes:
Step S21, described control end extracts not yet through the described beta version bag of test;
Step S22, described control end determines according to the described beta version bag being extracted needs the survey of test Examination type;
Step S23, described control end, according to the described test-types determined, extracts corresponding multiple test Script also exports, and then switches into described step S3.
Preferably, this full-automatic testing method, wherein, in described step S3, below described control end The mode sending out AT order controls described mobile terminal entrance download state, and automatically downloads described control end The described beta version bag issued and described test instruction.
Preferably, this full-automatic testing method, wherein, described step S3 specifically includes:
Step S31, described control end, according to the described beta version bag being extracted, selects one and matches Described mobile terminal;
Step S32, described control end issues the described test being extracted to selected described mobile terminal Version bag;
Step S33, described control end according to the described test script being extracted to selected described movement Terminal issues corresponding described test instruction, then switches into described step S4.
Preferably, this full-automatic testing method, wherein, in described step S4, described control end is in institute State the content monitored during mobile terminal performs automatic test to include:
Monitor whether, during described mobile terminal performs automatic test, the test process that makes a difference First test is abnormal, and record occurs the monitoring daily record that described first test is abnormal, and is occurring described first When test is abnormal, described test and management unit is hung up;And/or
After described mobile terminal has performed the process of automatic test, obtain what described mobile terminal produced Journal file, analyzes described journal file and obtains corresponding test report to process and show to user.
Preferably, this full-automatic testing method, wherein, it is preset with multiple keyword message, each described Keyword message is used for representing the second survey that the systematic function of described mobile terminal goes wrong corresponding to a class Examination is abnormal;
In described step S4, screening obtains described journal file and includes the daily record of described keyword message Record, and the described log recording obtained described screening according to described keyword message carries out classification process, The test result abnormal to respectively obtain the second test described in corresponding every class;
All described test results are incorporated in a test report and show to user.
Preferably, this full-automatic testing method, wherein, in described step S4, would indicate that described second The described test result of test exception forms an exception record with corresponding described log entry correlation, and carries Hand over described exception record, carry out abnormal conditions tracking for user.
Preferably, this full-automatic testing method, wherein, represent described mobile terminal in described monitored results When producing default test exception during automatic test, issue corresponding recovery and instruct to control Described mobile terminal recovers from described test is abnormal, and continues executing with automatic test.
Technique scheme provides the benefit that:
1) realize the automatic tracking and testing of test system version, reduce human resources in test process further Consuming, promote testing efficiency;
2) test result is monitored, it is simple to user grasps test process at any time, intuitively reflects test The tendency of system version quality.
Accompanying drawing explanation
Fig. 1 is in the preferred embodiment of the present invention, the population structure signal of a kind of full-automatic test system Figure;
Fig. 2-4 is in the preferred embodiment of the present invention, and the fractal structure of a kind of full-automatic test system shows It is intended to;
Fig. 5 is in the preferred embodiment of the present invention, the overall procedure signal of a kind of full-automatic testing method Figure;
Fig. 6-7 is in the preferred embodiment of the present invention, and the step-by-step procedure of a kind of full-automatic testing method shows It is intended to.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out Clearly and completely describe, it is clear that described embodiment is only a part of embodiment of the present invention, and It is not all, of embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art are not making The every other embodiment obtained on the premise of going out creative work, broadly falls into the scope of protection of the invention.
It should be noted that in the case of not conflicting, the embodiment in the present invention and the spy in embodiment Levy and can be mutually combined.
The invention will be further described with specific embodiment below in conjunction with the accompanying drawings, but not as the present invention's Limit.
Existing automatization testing technique, often need nonetheless remain for human intervention, such as, need artificially to input soft Part version, needs manually to carry out the software version inputted the setting of dependence test task, manually by software Version download in mobile terminal and manually arrange in mobile terminal the most pre-configured, at test process Exception on some hardware of middle generation, needs also exist for manual handle.Meanwhile, existing automatic test skill In art, comparison is presented for test result single, it is impossible to allow tester observe test more intuitively As a result, experience is reduced.
In the preferred embodiment of the present invention, based on the above-mentioned problems in the prior art, now provide one Plant the technical scheme of full-automatic test system.
In the preferred embodiment of the present invention, as it is shown in figure 1, above-mentioned full-automatic test system includes control End A processed and mobile terminal B, controls end A and is connected with mobile terminal B respectively.The present invention is preferably In embodiment, the connected mode controlled between end A and mobile terminal B can be wireless connections, it is also possible to For wired connection, the connected mode controlled between end A and mobile terminal B is not defined at this.
In the preferred embodiment of the present invention, the task of above-mentioned control end A is that controlling mobile terminal B holds Row automatic test.Specifically, control end A and issue the beta version bag of test system to mobile terminal B, Mobile terminal B installs this beta version bag and test system is pre-configured completes to this, to be ready for automatically Change test.Control end A to issue to mobile terminal B and test instruction accordingly, mobile terminal B according under The test instruction sent out performs corresponding automatic test.
In the preferred embodiment of the present invention, still as it is shown in figure 1, control end A and include:
Version management unit 1.In the preferred embodiment of the present invention, version management unit 1 prestores Multiple beta version bags.In the preferred embodiment of the present invention, so-called beta version bag, which includes Information needed for corresponding test system is installed, and configures the information needed for corresponding test system.This In the preferred embodiment of invention, so-called test system, is not necessarily operating system, it is also possible to be one Individual software application, in technical solution of the present invention, alleged test system, is to recognize for ease of those skilled in the art Know the consideration done corresponding to the test environment building a respective version to beta version bag, not will survey Test system is equal to operating system.
In the preferred embodiment of the present invention, version management unit 1 adds beta version bag for tester, And detect whether to exist not yet through the beta version bag of test, export corresponding testing result.
In the preferred embodiment of the present invention, so-called not yet through the beta version bag of test, normal conditions Under refer to the beta version bag that tester is newly added.
In one preferred embodiment of the present invention, after a beta version bag has been tested by, This beta version bag can be stamped corresponding labelling by version management unit 1.Therefore, version management unit 1 Can be by by whether judge in the way of stamping respective markers that whether a beta version bag is through test;
In another preferred embodiment of the present invention, when a beta version bag has been tested by complete After, this beta version bag can be deleted by version management unit 1.Therefore, version management unit 1 can lead to Cross to search and the most whether be preset with the beta version that beta version bag judges whether that not yet process is tested Bag.
In other embodiments of the present invention, version management unit 1 can also detect wherein by other means Whether it is preset with not yet through the beta version bag of detection, does not repeats them here.
In the preferred embodiment of the present invention, as in figure 2 it is shown, in above-mentioned version management unit 1 further Including:
First memory module 11, has wherein pre-saved multiple beta version bag.The present invention's is the most real Execute in example, the test system of the corresponding version of each beta version bag;
Editor module 12, connects the first memory module 11.In the preferred embodiment of the present invention, Bian Jimo Block 12 edits beta version bag for tester, and/or adds new test in the first memory module 11 Version bag;
Detection module 13, connects the first memory module 11.In the preferred embodiment of the present invention, detection Whether module 13 exists not yet through the beta version bag of test for periodic scanning, and exports corresponding inspection Survey result.In the preferred embodiment of the present invention, the mode of detection is as mentioned above it is possible, the most superfluous at this State.
In the preferred embodiment of the present invention, above-mentioned control end A also includes:
Test and management unit 2, connects above-mentioned version management unit 1.In the preferred embodiment of the present invention, Test and management unit 2 is preset with multiple test script.Further, the preferred embodiment of the present invention In, above-mentioned test and management unit 2 is preset with multiple test scripts of corresponding different test-types.On and Beta version bag described in literary composition, it is associated with corresponding test-types, i.e. can be according to beta version bag Determine in this test system, need to perform the automatic test of which type, therefore can be according to determining Test-types finds corresponding test script.In other words, in the preferred embodiment of the present invention, testing tube Reason unit can search and extract, according to the beta version bag being extracted, the multiple test scripts needing to perform. In the preferred embodiment of the present invention, test and management unit 2 issues not yet warp to corresponding mobile terminal B Cross the beta version bag of test, and control with the test script corresponding with beta version bag corresponding mobile whole End B carries out automatic test.
Further, in the preferred embodiment of the present invention, as it is shown on figure 3, above-mentioned test and management unit 2 include:
Version extraction module 21.In the preferred embodiment of the present invention, above-mentioned version extraction module 21 is used In extracting the corresponding beta version bag not yet passing through test according to testing result and exporting.
Second memory module 22.In the preferred embodiment of the present invention, as mentioned above it is possible, the second storage Module 22 pre-saves the test script of different test-types.In the preferred embodiment of the present invention, Second memory module 22 includes that test script may be considered for completing mobile terminal B In a functional module automatic test required for instruction set.Such as, mobile terminal B will be completed Test instruction required for the automatic test of call function is arranged in corresponding survey by default execution sequence In training originally;Or, need the function of receiving and sending short message of mobile terminal B is tested, then can be by Test instruction required for test short message transmission-receiving function is packaged in corresponding test according to default execution sequence In script.
Script extraction module 23, connects version extraction module 21 and the second memory module 22 respectively.This In bright preferred embodiment, as mentioned above it is possible, script extraction module 23 is for according to the survey being extracted This bag of test run, it is judged that need the test-types carried out, and extract corresponding types from the second memory module Test script also exports.
Test selects module 24, connects version extraction module 21.In the preferred embodiment of the present invention, on Stating test selects module 24 for selecting corresponding mobile terminal B to enter according to the beta version bag being extracted Row automatic test.In the preferred embodiment of the present invention, for each beta version bag, under Before sending out and performing test, it is necessary first to determine the mobile terminal B of this beta version bag applicable.Specifically, Such as, this beta version bag is the latest edition bag of an application software run under Android system, then need Select a mobile terminal B being equipped with Android system equally that this beta version bag could be installed;Example again As, in this test-types corresponding to beta version bag, including needing to carry out the test of short message receiving-transmitting test Script, it is therefore desirable to the mobile terminal B selecting a function of receiving and sending short message to open could install this beta version This bag.In the preferred embodiment of the present invention, above-mentioned test selects module 24 to wrap according in beta version bag The information included selects the mobile terminal B of one or more connections as test object, and output subsequently selects knot Really.
Version management module 25, connects version extraction module 22 respectively and test selects module 24.This In bright preferred embodiment, version management module 25 for selected mobile terminal B issue by The beta version bag extracted, tests system accordingly for mobile terminal B configuration.
In the preferred embodiment of the present invention, version management module 25 is to selected mobile terminal ( Or multiple) issue the beta version bag being extracted.The letter that mobile terminal includes according to this beta version bag Breath installs this beta version bag.
Further, in the preferred embodiment of the present invention, version management module 25 uses and issues AT life The mode of order issues beta version bag.Specifically, so-called AT order, refer to from terminal unit (such as Control end A) order that sends to data circuit termination equipment (such as mobile terminal B), control end A The functional module work of mobile terminal B bottom can be directly controlled by AT order, corresponding to perform Automatic test action.
In the preferred embodiment of the present invention, after mobile terminal B receives AT order, i.e. it is in download State.In other words, i.e. it is in torpor after mobile terminal B receives AT order and automatically downloads control The beta version bag that end A processed provides.So-called torpor, refers to the operation interface locking nothing of mobile terminal Method operates, and keyboard lockout cannot operate, but mobile terminal backstage is still within running status.Existing In technology, mobile terminal can only thoroughly shut down after (such as plugging battery), and start could be by beta version again Bag is brushed in mobile terminal, to support automatic test.But in the present invention, mobile terminal receives AT I.e. enter torpor after order, the most just can automatically download from the beta version bag controlling end A transmission And install, and the operation of shutdown start is manually performed without tester, greatly reduce manpower money The consuming in source.
In the preferred embodiment of the present invention, in the beta version bag that mobile terminal B downloads, except including Install outside the mount message of test system corresponding to this version bag, also include the configuration letter of this test system Breath.In other words, in technical solution of the present invention, support, when installing beta version bag, it is carried out necessity It is pre-configured with, therefore can support that some specifically needs to be pre-configured with the test-types that could perform, and Without bothering tester manually to arrange before testing, reduce the consuming of human resources in test process.
Test and management module 26, connects script extraction module 23 respectively and test selects module 24.This In bright preferred embodiment, test and management module 26 is for according to the test script being extracted, to selected The mobile terminal B selected issues and tests instruction accordingly, to control the corresponding automatization of mobile terminal B execution Test.
In the preferred embodiment of the present invention, test and management module 26 uses the side that AT order issues equally Formula issues to mobile terminal B and tests instruction accordingly.Mobile terminal B turns after receiving AT order automatically Enter torpor, and automatically download the test instruction that test and management module 26 provides.
In the preferred embodiment of the present invention, control end A and be also provided to mobile terminal B charge function.When When needing the most one or more mobile terminal B to issue corresponding beta version bag and test instruction, When i.e. controlling wherein one or more mobile terminals B execution automatic test, controlled one or more Mobile terminal B stops charging and proceeds to automatic test course, and remaining not selected mobile terminal B is still So it is in charged state.
In the preferred embodiment of the present invention, test and management module 26 is always according to the duration control being pre-configured with Mobile terminal B loop test processed.Such as, be pre-configured with time a length of 1 hour, then test and management module 26 circulated in 1 hour to mobile terminal B issue test instruction, to control mobile terminal B for this Beta version bag performs the automatic test of circulation.
In the preferred embodiment of the present invention, as it is shown in figure 1, above-mentioned control end A also includes:
Monitoring management unit 3, connects above-mentioned test and management unit 2.In the preferred embodiment of the present invention, Monitoring management unit 3 is monitored for the process that mobile terminal performs automatic test, and according to prison Control output control test and management unit is hung up or continues to run with.
Further, in the preferred embodiment of the present invention, above-mentioned control test and management unit is hung up or continues Reforwarding row is only the one of which function of monitoring management unit 3, hereinafter can be to monitoring management unit 3 Repertoire be specifically described.
In the preferred embodiment of the present invention, as described in Figure 4, above-mentioned monitoring management unit 3 specifically wraps Include:
First monitoring module 31.In the preferred embodiment of the present invention, the first monitoring module 31 is used for The first test that mobile terminal performs to monitor whether to make a difference test process during automatic test is different Often, there is the monitoring daily record that the first test is abnormal in record, and when occurring the first test abnormal by testing tube Reason unit is hung up, and will be arranged in Hold state by test and management unit.
In the preferred embodiment of the present invention, so-called first test is abnormal, refers to that being relevant to test process is The no exception that can be smoothed out, namely influences whether that the test of test process is abnormal.Such as mobile whole It is unsuccessful that end B downloads beta version bag, or mobile terminal B installation beta version bag is unsuccessful, or Mobile terminal B disconnects with control end A in test process.Occur that the test of the above-mentioned type is abnormal, Then represent that automatic test course may be interrupted (if occurring disconnecting even at the end of performing automatic test The exception connect, then test can be with normal termination, and it is abnormal that this exception is still classified as the first test).This In the preferred embodiment of invention, above-mentioned first monitoring module 31 actively monitors mobile terminal B in automatically Change above-mentioned first test occurred in test process abnormal, and when appearance the first test is abnormal by above-mentioned survey Examination administrative unit 3 is hung up, to wait that tester manually checks and processes.
In the preferred embodiment of the present invention, above-mentioned automatic test course is the concept that a comparison is wide in range, Receive AT order starting from mobile terminal B to download beta version and unwrap the beginning and complete to mobile terminal B Automatic test is also the process of automatic test till uploading journal file.
In the preferred embodiment of the present invention, when the first monitoring module 31 monitors mobile terminal B in certainly When dynamicization test process occurring above-mentioned first test abnormal, actively record corresponding monitoring daily record and export, Check for tester.
In the preferred embodiment of the present invention, above-mentioned monitoring management unit 3 also includes:
Second monitoring module 32.In the preferred embodiment of the present invention, the second monitoring module 32 is used for Obtain the journal file that mobile terminal produces after the process that mobile terminal has performed automatic test, analyze Journal file obtains corresponding test report to process and shows to tester.
Specifically, in the preferred embodiment of the present invention, it is preset with multiple in the second monitoring module 32 Keyword message, each keyword message tests exception corresponding to a class second.The present invention's is the most real Executing in example, so-called second test is abnormal, actual for the survey for representing the test performance of mobile terminal B own Examination is abnormal, such as in test process, mobile terminal B occurs that application does not responds that (keyword message corresponds to Anr) test is abnormal, or occurs that program exception exits the survey of (keyword message corresponds to Crash) Examination is abnormal, or the service of Frame layer is abnormal (keyword message corresponds to Watchdog), or Java Layer service is abnormal (keyword message corresponds to JavaCrasch), or other tests (are completely returned extremely Class is in the class second that corresponding keyword message is Others is tested extremely).
In the preferred embodiment of the present invention, the second monitoring module 32 first according to keyword message to master The journal file that the mobile terminal that dynamic monitoring obtains is uploaded after an automatic test terminates resolves (owing to multiple stage mobile terminal test once can be controlled, therefore can obtain multiple journal file), and Screening obtains including that (a usual journal file includes a plurality of day for all log recordings of keyword message Will record).Subsequently, the log recording that screening is obtained by the second monitoring module 32 according to keyword message enters Row classification, the classification of specially one the corresponding class log recording of keyword message.The present invention is preferably In embodiment, after classification, every class log recording is respectively processed by the second monitoring module 32, To obtain testing abnormal test result for every class second, and these test results are incorporated into one the most at last Show in individual test report.In the preferred embodiment of the present invention, test result can use more directly perceived Method for expressing such as graphic record or form illustrative method, consequently facilitating tester checks.
In the preferred embodiment of the present invention, each keyword message is associated with many sub-keyword messages, One second test during every sub-keyword message is tested extremely corresponding to an above-mentioned class second is abnormal.Example As under Anr to having Binder bust this, I/O operation exception and process surprisingly termination etc., Crash Under to triggering oom-killer (process is killed in triggering) etc., Watchdog when should have low internal memory and a low internal memory Under to should have Modem (baseband processor) occur assert (extremely) and Watchdog enter journey and carry Wake up, under JavaCrash, exceed virtual machine space and Window (window) lets out to program should be had to open Leakage etc..
Therefore, in the preferred embodiment of the present invention, the every class of above-mentioned correspondence second tests abnormal test knot In Guo, it is also possible to include the test result abnormal for each test, these test results are incorporated into one Rise and i.e. form a test report and export.
In the preferred embodiment of the present invention, above-mentioned second monitoring module 32 is also supported to report above-mentioned test Announcement is shown to tester and checks, and performs to upload the operations such as backup to above-mentioned test report.
In the preferred embodiment of the present invention, above-mentioned monitoring management unit 3 also includes:
Input module 33, connects above-mentioned second monitoring module 32.In the preferred embodiment of the present invention, The keyword message defaulted in monitoring management module 32 is edited by input module 33 for tester. Specifically, in the preferred embodiment of the present invention, keyword message is carried out editor and includes adding, deleting And amendment keyword message etc..So keyword message can be carried out edit-modify, it is possible to make up existing There is analytical tool correspondence canned software version in technology to solidify analysis information wherein, thus cause test The problem that the wide usage of anomaly analysis is narrower.
In the preferred embodiment of the present invention, above-mentioned monitoring management unit 3 also includes:
Abnormal submission module 34, connects above-mentioned second monitoring module 32.The preferred embodiment of the present invention In, abnormal submission module is additionally operable to according to the test in test report abnormal (failed case), automatically Submit corresponding exception reporting (bug report) to, and enclose corresponding to this test different in this exception reporting Normal log recording and/or the journal file at log recording place, it is simple to tester carries out track problems.
In the preferred embodiment of the present invention, still as it is shown in figure 1, above-mentioned control end A also includes:
Abnormal restoring unit 4, connects above-mentioned monitoring management unit 3.In the preferred embodiment of the present invention, In monitored results, abnormal restoring unit 4 is for representing that mobile terminal produces during automatic test in advance If test exception time issue and corresponding recover instruction and recover from test is abnormal to control mobile terminal, and Continue executing with automatic test.Specifically, such as, there is fixed screen, blank screen when mobile terminal, fall mouth etc. Time abnormal, this abnormal restoring unit 4 can automatically recover the automatic test course of mobile terminal, i.e. repair Multiple exception also proceeds test.
In sum, in technical solution of the present invention, one is used to control end A carry multiple stage mobile terminal B Mode perform mobile terminal B automatic test control:
First, control end A and judge whether the new beta version bag not yet passing through test, and extract Not yet through the beta version bag of test, control in the way of issuing AT order to corresponding mobile terminal This beta version bag is downloaded and installed to mobile terminal automatically, to form corresponding test environment;
Subsequently, control end A determines according to the beta version bag being extracted needs the type of test, and and then Determine the test script needing to perform, issue to mobile terminal according to test script and test instruction accordingly, Carry out automatic test with control mobile terminal, issue and still use the mode of AT order to carry out;
Finally, control end A and carry out actively monitoring during mobile terminal performs automatic test, with Monitoring obtains producing the abnormal corresponding monitoring daily record of test in test process, processes daily record to be formed Test report also shows, or judge test abnormal the need of control testing tool hang up with etc. to be tested Personnel's manual handle, thus complete the most complete automatic test course.
Above-mentioned automatic test scheme can get rid of the participation of tester in automatic test course as far as possible (such as according to redaction selection test assignment and restart mobile whole without tester without tester Hold redaction etc. is installed), greatly reduce the consuming of human resources in test process, promote testing efficiency, And tester can be supplied to and compare test report intuitively, promote experience.
In the preferred embodiment of the present invention, based on the above full-automatic test system, existing offer A kind of full-automatic testing method, its step is concrete as shown in Figure 4, including:
Step S1, whether detection controls to include not yet through the beta version bag of test in end, and is controlling End includes that the beta version bag not yet passing through test turns to step S2;
Step S2, controls end and extracts not yet through the beta version bag of test, and according to the test being extracted The test script corresponding to test-types obtaining needing to perform searched by version bag;
In the preferred embodiment of the present invention, as shown in Figure 6, above-mentioned steps S2 specifically includes:
Step S21, controls end and extracts not yet through the beta version bag of test;
Step S22, controls end and determines the test class needing to test according to the beta version bag being extracted Type;
Step S23, control end, according to the test-types determined, extracts corresponding multiple test script And export, then switch into step S3.
Step S3, controls end and issues the beta version bag being extracted to corresponding mobile terminal, and according to The test script being extracted issues to corresponding mobile terminal and tests instruction accordingly, to control mobile terminal Perform automatic test;
In the preferred embodiment of the present invention, as it is shown in fig. 7, above-mentioned steps S3 specifically includes:
Step S31, control end, according to the beta version bag being extracted, selects a shifting matched Dynamic terminal;
Step S32, controls end and issues the beta version bag being extracted to selected mobile terminal;
Step S33, controls end and issues to selected mobile terminal according to the test script being extracted Test instruction accordingly, then switch into step S4.
In the preferred embodiment of the present invention, in above-mentioned steps S3, control end under mobile terminal The mode sending out beta version bag and test instruction is and issues AT order to mobile terminal, to control shifting Dynamic terminal enters automatic download state (torpor) and automatically downloads above-mentioned beta version bag and test Instruction.
Step S4, controls end and is monitored during automatic test in mobile terminal, and according to prison Control output control test and management unit is hung up or continues to run with.
In the preferred embodiment of the present invention, as mentioned above it is possible, in above-mentioned steps S4, control end Control function is actual is divided into two pieces:
1) in automatic test course, monitor whether that the first test occurring affecting test process is abnormal, For example whether there is the failure of mobile terminal download version, or mobile terminal installs version failure, or moves The situations such as dynamic terminal and control end disconnect, generate corresponding abnormal monitoring daily record and upload, will simultaneously Testing tool is hung up and is waited that tester processes;
2) in automatic test course, mobile terminal produces corresponding journal file, controls end and oneself Dynamicization test process actively transfers journal file after terminating, and obtains corresponding according to keyword message screening Log recording, carries out classification process to log recording according to the keyword message wherein comprised, to obtain respectively Test result to corresponding each keyword message.All test results are incorporated in a test report also It is shown to tester check.
In the preferred embodiment of the present invention, in above-mentioned steps S4, would indicate that the survey that the second test is abnormal Test result forms an exception record with corresponding log entry correlation, and submits exception record to, for use Person carries out abnormal conditions tracking.
In the preferred embodiment of the present invention, represent that mobile terminal is in the mistake of automatic test in monitored results When journey produces default test exception, issue corresponding recovery instruction different from test to control mobile terminal Recover in often, and continue executing with automatic test.
The foregoing is only preferred embodiment of the present invention, not thereby limit embodiments of the present invention and Protection domain, to those skilled in the art, it should can appreciate that all utilization description of the invention And the equivalent done by diagramatic content and the scheme obtained by obvious change, all should comprise Within the scope of the present invention.

Claims (17)

1. a full-automatic test system, it is characterised in that include control end and respectively with described control end The multiple mobile terminals connected;
Described control end includes:
Version management unit, wherein prestores multiple beta version bag, described version management unit for Person adds described beta version bag, and detects whether to exist not yet through the beta version bag of test, output Corresponding testing result;
Test and management unit, is wherein preset with multiple test script, and described test and management unit connects described Version management unit, for according to described testing result, issues not yet warp to corresponding described mobile terminal Cross the described beta version bag of test, and control corresponding with the test script corresponding to described beta version bag Described mobile terminal carry out automatic test;
Monitoring management unit, connects described test and management unit, for performing described mobile terminal automatically The process changing test is monitored, and controls the hang-up of described test and management unit according to monitored results or continue Run.
2. full-automatic test system as claimed in claim 1, it is characterised in that described version management list Unit includes:
First memory module, has wherein pre-saved multiple described beta version bag, each described beta version The test system of the corresponding version of this bag;
Editor module, connects described first memory module, for beta version bag described in user editor, and/ Or in described first memory module, add new described beta version bag;
Whether detection module, connects described first memory module, exist not yet through surveying for periodic scanning The described beta version bag of examination, and export corresponding described testing result.
3. full-automatic test system as claimed in claim 1, it is characterised in that described test and management list Unit includes:
Version extraction module, corresponding not yet through described in test for extracting according to described testing result Beta version bag also exports;
Second memory module, wherein pre-saves the described test script of different test-types;
Script extraction module, connects described version extraction module and described second memory module respectively, is used for According to the described beta version bag being extracted, it is judged that need the described test-types that carries out, and from described the Two memory modules are extracted the described test script of corresponding types and exports;
Test selects module, connects described version extraction module, for according to the described beta version being extracted This bag selects corresponding described mobile terminal to carry out automatic test;
Version management module, connects described version extraction module respectively and described test selects module, is used for The described beta version bag being extracted is issued, for described mobile terminal to selected described mobile terminal Configure corresponding described test system;
Test and management module, connects described script extraction module respectively and described test selects module, is used for According to the described test script being extracted, issue to selected described mobile terminal and test instruction accordingly, To control the described mobile terminal corresponding automatic test of execution.
4. full-automatic test system as claimed in claim 3, it is characterised in that described test and management list Unit issues the mode of described beta version bag and described test instruction and is transmission AT order to accordingly Described mobile terminal, with control described mobile terminal enter downloading mode and automatically download be extracted described in Beta version bag and described test instruction.
5. full-automatic test system as claimed in claim 1, it is characterised in that described monitoring management list Unit includes:
First monitoring module, monitors whether during performing automatic test at described mobile terminal The first of the test process that makes a difference is tested abnormal, and record occurs the monitoring daily record of described first test exception, And when occurring described first test abnormal, described test and management unit is hung up;
Second monitoring module, for obtaining after described mobile terminal has performed the process of automatic test The journal file that described mobile terminal produces, analyzes described journal file and is tested report accordingly to process Accuse and show to user.
6. full-automatic test system as claimed in claim 5, it is characterised in that described second monitoring mould Being preset with multiple keyword message in block, each described keyword message is used for representing described corresponding to a class The second test that the systematic function of mobile terminal goes wrong is abnormal;
Described second monitoring module screening obtains described journal file and includes the daily record of described keyword message Record, and the described log recording obtained described screening according to described keyword message carries out classification process, The test result abnormal to respectively obtain the second test described in corresponding every class;
All described test results are incorporated in a test report and to user by described second monitoring module Display.
7. full-automatic test system as claimed in claim 6, it is characterised in that described monitoring management list Unit also includes:
Input module, connects described second monitoring module, defaults in described second monitoring for user editor Described keyword message in module.
8. full-automatic test system as claimed in claim 6, it is characterised in that described monitoring management list Unit also includes:
Abnormal submission module, connects described second monitoring module, is used for would indicate that described second test is abnormal Described test result form an exception record with corresponding described log entry correlation, and submit to described different Often record, carries out abnormal conditions tracking for user.
9. full-automatic test system as claimed in claim 1, it is characterised in that also include:
Abnormal restoring unit, connects described monitoring management unit, for representing described in described monitored results Mobile terminal issues when producing default test exception during automatic test and recovers instruction accordingly To control the recovery from described test is abnormal of described mobile terminal, and continue executing with automatic test.
10. a full-automatic testing method, it is characterised in that include controlling end with respectively and described control Multiple mobile terminals that end connects;
Described control end is preset with multiple beta version bag, and multiple surveys of corresponding different test-types Training originally, and supplies user editor and/or interpolation;
Described full-automatic testing method specifically includes:
Whether step S1, detect and include not yet through the described beta version bag of test in described control end, And include that the described beta version bag not yet passing through test turns to step S2 at described control end;
Step S2, described control end extracts not yet through the described beta version bag of test, and according to being carried The described test script corresponding to test-types obtaining needing to perform searched by the described beta version bag taken;
Step S3, described control end issues the described beta version being extracted to corresponding described mobile terminal Bag, and issue corresponding test according to the described test script being extracted to corresponding described mobile terminal Instruction, to control described mobile terminal execution automatic test;
Step S4, described control end is monitored during automatic test in described mobile terminal, And hang up according to the monitored results described test and management unit of control or continue to run with.
11. full-automatic testing methods as claimed in claim 10, it is characterised in that described step S2 Specifically include:
Step S21, described control end extracts not yet through the described beta version bag of test;
Step S22, described control end determines according to the described beta version bag being extracted needs the survey of test Examination type;
Step S23, described control end, according to the described test-types determined, extracts corresponding multiple test Script also exports, and then switches into described step S3.
12. full-automatic testing methods as claimed in claim 10, it is characterised in that described step S3 In, described control end controls described mobile terminal in the way of issuing AT order and enters download state, and Automatically described beta version bag and described test instruction that described control end issues are downloaded.
13. full-automatic testing methods as claimed in claim 10, it is characterised in that described step S3 Specifically include:
Step S31, described control end, according to the described beta version bag being extracted, selects one and matches Described mobile terminal;
Step S32, described control end issues the described test being extracted to selected described mobile terminal Version bag;
Step S33, described control end according to the described test script being extracted to selected described movement Terminal issues corresponding described test instruction, then switches into described step S4.
14. full-automatic testing methods as claimed in claim 10, it is characterised in that described step S4 In, described control end content of monitoring during described mobile terminal performs automatic test includes:
Monitor whether, during described mobile terminal performs automatic test, the test process that makes a difference First test is abnormal, and record occurs the monitoring daily record that described first test is abnormal, and is occurring described first When test is abnormal, described test and management unit is hung up;And/or
After described mobile terminal has performed the process of automatic test, obtain what described mobile terminal produced Journal file, analyzes described journal file and obtains corresponding test report to process and show to user.
15. full-automatic testing methods as claimed in claim 14, it is characterised in that be preset with multiple pass Key word information, each described keyword message is used for representing the systematicness of described mobile terminal corresponding to a class The second test that can go wrong is abnormal;
In described step S4, screening obtains described journal file and includes the daily record of described keyword message Record, and the described log recording obtained described screening according to described keyword message carries out classification process, The test result abnormal to respectively obtain the second test described in corresponding every class;
All described test results are incorporated in a test report and show to user.
16. full-automatic testing methods as claimed in claim 15, it is characterised in that described step S4 In, would indicate that the described test result of described second test exception and corresponding described log entry correlation shape Become an exception record, and submit described exception record to, carry out abnormal conditions tracking for user.
17. full-automatic testing methods as claimed in claim 10, it is characterised in that at described monitoring knot Fruit represents when described mobile terminal produces default test exception during automatic test, issues phase The recovery instruction answered recovers from described test is abnormal to control described mobile terminal, and continues executing with automatically Change test.
CN201510149115.1A 2015-03-31 2015-03-31 A kind of full-automatic test system and method for testing Pending CN106155885A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510149115.1A CN106155885A (en) 2015-03-31 2015-03-31 A kind of full-automatic test system and method for testing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510149115.1A CN106155885A (en) 2015-03-31 2015-03-31 A kind of full-automatic test system and method for testing

Publications (1)

Publication Number Publication Date
CN106155885A true CN106155885A (en) 2016-11-23

Family

ID=57338134

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510149115.1A Pending CN106155885A (en) 2015-03-31 2015-03-31 A kind of full-automatic test system and method for testing

Country Status (1)

Country Link
CN (1) CN106155885A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107908415A (en) * 2017-11-30 2018-04-13 北京小米移动软件有限公司 Processing method, device, equipment and storage medium
CN108199862A (en) * 2017-09-30 2018-06-22 海南电网有限责任公司 A kind of operation system, which reports an error, manages system and method
CN108241580A (en) * 2016-12-30 2018-07-03 深圳壹账通智能科技有限公司 The test method and terminal of client-side program
CN108415825A (en) * 2017-10-27 2018-08-17 平安科技(深圳)有限公司 electronic device, test method and storage medium
CN109446080A (en) * 2018-10-22 2019-03-08 网宿科技股份有限公司 APP test method and device
CN109960657A (en) * 2019-03-26 2019-07-02 浪潮商用机器有限公司 A kind of test environment dispositions method and relevant apparatus
CN110287090A (en) * 2019-05-08 2019-09-27 聚融医疗科技(杭州)有限公司 A kind of automated testing method and system of ultrasound software
CN111208363A (en) * 2019-12-13 2020-05-29 深圳市元征科技股份有限公司 Test method and electronic device

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1862508A (en) * 2005-05-13 2006-11-15 中兴通讯股份有限公司 Automatic testing system of person digital aid cell phone function and method thereof
US20080010553A1 (en) * 2006-06-14 2008-01-10 Manoj Betawar Method and apparatus for executing commands and generation of automation scripts and test cases
CN101272422A (en) * 2007-03-21 2008-09-24 中兴通讯股份有限公司 Mobile phone automatized test method
CN102141962A (en) * 2011-04-07 2011-08-03 北京航空航天大学 Safety distributed test framework system and test method thereof
CN102436416A (en) * 2011-09-17 2012-05-02 北京迈凯互动网络科技有限公司 Testing system and method for mobile equipment
CN102638603A (en) * 2011-02-11 2012-08-15 上海闻泰电子科技有限公司 Method for automatically testing power consumption of mobile phone through simulation key
CN103634441A (en) * 2012-08-24 2014-03-12 腾讯科技(深圳)有限公司 Method and device for testing mobile terminal
CN103744784A (en) * 2014-01-06 2014-04-23 中国移动(深圳)有限公司 Method and system for automatically testing mobile phone applications
CN104050076A (en) * 2013-03-12 2014-09-17 阿里巴巴集团控股有限公司 Testing method, device and system of application software on mobile terminal
CN104424095A (en) * 2013-08-26 2015-03-18 卓望数码技术(深圳)有限公司 Automatic testing method and system of mobile terminal

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1862508A (en) * 2005-05-13 2006-11-15 中兴通讯股份有限公司 Automatic testing system of person digital aid cell phone function and method thereof
US20080010553A1 (en) * 2006-06-14 2008-01-10 Manoj Betawar Method and apparatus for executing commands and generation of automation scripts and test cases
CN101272422A (en) * 2007-03-21 2008-09-24 中兴通讯股份有限公司 Mobile phone automatized test method
CN102638603A (en) * 2011-02-11 2012-08-15 上海闻泰电子科技有限公司 Method for automatically testing power consumption of mobile phone through simulation key
CN102141962A (en) * 2011-04-07 2011-08-03 北京航空航天大学 Safety distributed test framework system and test method thereof
CN102436416A (en) * 2011-09-17 2012-05-02 北京迈凯互动网络科技有限公司 Testing system and method for mobile equipment
CN103634441A (en) * 2012-08-24 2014-03-12 腾讯科技(深圳)有限公司 Method and device for testing mobile terminal
CN104050076A (en) * 2013-03-12 2014-09-17 阿里巴巴集团控股有限公司 Testing method, device and system of application software on mobile terminal
CN104424095A (en) * 2013-08-26 2015-03-18 卓望数码技术(深圳)有限公司 Automatic testing method and system of mobile terminal
CN103744784A (en) * 2014-01-06 2014-04-23 中国移动(深圳)有限公司 Method and system for automatically testing mobile phone applications

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108241580A (en) * 2016-12-30 2018-07-03 深圳壹账通智能科技有限公司 The test method and terminal of client-side program
CN108199862A (en) * 2017-09-30 2018-06-22 海南电网有限责任公司 A kind of operation system, which reports an error, manages system and method
CN108415825A (en) * 2017-10-27 2018-08-17 平安科技(深圳)有限公司 electronic device, test method and storage medium
WO2019080426A1 (en) * 2017-10-27 2019-05-02 平安科技(深圳)有限公司 Electronic apparatus, test method, system and storage medium
CN108415825B (en) * 2017-10-27 2021-01-19 平安科技(深圳)有限公司 Electronic device, test method, and storage medium
CN107908415A (en) * 2017-11-30 2018-04-13 北京小米移动软件有限公司 Processing method, device, equipment and storage medium
CN109446080A (en) * 2018-10-22 2019-03-08 网宿科技股份有限公司 APP test method and device
CN109960657A (en) * 2019-03-26 2019-07-02 浪潮商用机器有限公司 A kind of test environment dispositions method and relevant apparatus
CN110287090A (en) * 2019-05-08 2019-09-27 聚融医疗科技(杭州)有限公司 A kind of automated testing method and system of ultrasound software
CN111208363A (en) * 2019-12-13 2020-05-29 深圳市元征科技股份有限公司 Test method and electronic device
CN111208363B (en) * 2019-12-13 2022-06-17 深圳市元征科技股份有限公司 Test method and electronic device

Similar Documents

Publication Publication Date Title
CN106155885A (en) A kind of full-automatic test system and method for testing
CN109683899B (en) Software integration method and device
CN111459794A (en) Communication network testing method, device, computer equipment and storage medium
US9585033B2 (en) System and method for enhanced diagnostics on mobile communication devices
CN110765018B (en) Automatic interface testing method and equipment
CN108459951B (en) Test method and device
CN104424095A (en) Automatic testing method and system of mobile terminal
CN106502904A (en) A kind of UI automated testing methods of intelligent appliance equipment application
CN103973858B (en) The Auto-Test System of mobile terminal
CN112929236A (en) Broadband micropower wireless protocol interoperability test system for electricity consumption information acquisition system
CN111176910A (en) System function testing method and device
CN112073263B (en) Method, system, equipment and medium for testing and monitoring reliability of white box switch
CN108319240B (en) Method and system for collecting operation and maintenance knowledge base applied to field operation terminal
CN107015902B (en) Test method and test equipment
CN111026581A (en) Application program repairing method, device, system, storage medium and electronic device
CN108064054B (en) FTP file transmission monitoring method and system in LTE system
CN111078484A (en) Power-off test method, device, equipment and storage medium for system upgrading
CN112596750B (en) Application testing method and device, electronic equipment and computer readable storage medium
CN115391110A (en) Test method of storage device, terminal device and computer readable storage medium
CN114138587A (en) Reliability verification method, device and equipment for upgrading server power firmware
CN114650211A (en) Fault repairing method, device, electronic equipment and computer readable storage medium
CN111581042B (en) Cluster deployment method, deployment platform and server to be deployed
CN112114897A (en) Parameter configuration method and device based on industrial control screen and computer equipment
CN107193726A (en) A kind of terminal concurrence method of testing and device
CN114610329B (en) Solid state disk deployment method and device, readable storage medium and electronic equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161123

RJ01 Rejection of invention patent application after publication