CN105487977A - Agility-oriented automatic test management system and method - Google Patents
Agility-oriented automatic test management system and method Download PDFInfo
- Publication number
- CN105487977A CN105487977A CN201510857092.XA CN201510857092A CN105487977A CN 105487977 A CN105487977 A CN 105487977A CN 201510857092 A CN201510857092 A CN 201510857092A CN 105487977 A CN105487977 A CN 105487977A
- Authority
- CN
- China
- Prior art keywords
- test
- assignment
- test assignment
- execution
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses an agility-oriented automatic test management system and method. The system comprises that a test management front end is used for creating test tasks and sending the submitting instructions of the test tasks to a test control end, the submitting instructions of the test tasks comprise test executing ends distributed to the test tasks; the test control end is used for sending the test tasks to the test executing ends distributed to the test tasks according to the submitting instructions of the test tasks; the test executing ends are used for obtaining the distributed test tasks, invoking pre-created test task plug-ins to execute the distributed test tasks and returning the executing information to the test management front end through the test control end. The system provides an automatic test management platform applicable to an agile development model; the automatic tests operated in the project implementation process are effectively and flexibly managed through the platform; therefore, the test executing efficiency is improved, and the software quality and the issuing cycle are ensured.
Description
Technical field
The embodiment of the present invention relates to software testing technology field, particularly relates to a kind of automatic test management system and method for Agile.
Background technology
In agile development process, compared with conventional procedure, version is issued more frequent, and for tester, must test fast each issue, could rapid feedback product quality situation.In this case, test period is shortened accordingly along with the shortening of construction cycle, test frequency also increases thereupon, therefore, the demand of test can not be met only according to manual test, need lead-in surface to the automatic test of different test-types, have certain automatic test support at links simultaneously, it is very inconvenient that management is got up, and executive means also lacks dirigibility.
There is no the special unified instrument carrying out managing and perform for automatic test, particularly Agile exploitation aspect at present, make the test execution efficiency of the automatic test of Agile lower.
Summary of the invention
The invention provides a kind of automatic test management system and method for Agile, to improve the test execution efficiency of the automatic test of Agile.
On the one hand, embodiments provide a kind of automatic test management system of Agile, comprising:
Test and management front end, for creating test assignment, and sends the submission instruction of test assignment to test control end, the submission instruction of wherein said test assignment is included as the test execution end of described test assignment distribution;
Test control end, for the submission instruction according to described test assignment, sends to the described test execution end distributed for described test assignment by described test assignment;
Described test execution end, for obtaining the test assignment be assigned to, calling the test assignment plug-in unit be pre-created and performing the test assignment be assigned to, and execution information is returned to described test and management front end by described test control end.
On the other hand, embodiments provide a kind of automatic test management method of Agile, comprising:
Test and management front end creates test assignment, and sends the submission instruction of test assignment to test control end, and the submission instruction of wherein said test assignment is included as the test execution end of described test assignment distribution;
Described test assignment, according to the submission instruction of described test assignment, is sent to the described test execution end distributed for described test assignment by test control end;
Described test execution end obtains the test assignment be assigned to, and calls the test assignment plug-in unit be pre-created and performs the test assignment be assigned to, and execution information is returned to described test and management front end by described test control end.
The technical scheme that the embodiment of the present invention provides, created by test and management front end, management testing task, and the submission instruction of test assignment is sent to test control end, test assignment is distributed to test execution end according to the submission instruction received by test control end, test execution end performs the test assignment be assigned to, namely, provide the automatic test management platform of an applicable agile development pattern, effective by this platform, flexibly the automatic test used in the project implementation process is managed, thus reach raising test execution efficiency, ensure the effect of software quality and release cycle.
Accompanying drawing explanation
Fig. 1 a is the structural representation of the automatic test management system of a kind of Agile in the embodiment of the present invention one;
Fig. 1 b is the principle of work schematic diagram of the automatic test management system of Agile in the embodiment of the present invention one;
Fig. 2 a is the structural representation of the automatic test management system of a kind of Agile in the embodiment of the present invention two;
Fig. 2 b is the structural representation of the test and management front end in the embodiment of the present invention two;
Fig. 2 c is the schematic diagram of the task structure in the embodiment of the present invention two;
Fig. 2 d is the workflow schematic diagram of the automatic test management system of Agile in the embodiment of the present invention two;
Fig. 3 is the realization flow figure of the automatic test management method of a kind of Agile in the embodiment of the present invention three.
Embodiment
Below in conjunction with drawings and Examples, the present invention is described in further detail.Be understandable that, specific embodiment described herein is only for explaining the present invention, but not limitation of the invention.It also should be noted that, for convenience of description, illustrate only part related to the present invention in accompanying drawing but not entire infrastructure.
Embodiment one
Fig. 1 a is the structural representation of the automatic test management system of a kind of Agile in the embodiment of the present invention one.As shown in Figure 1a, this automatic test management system specifically can comprise: test and management front end, for creating test assignment, and send the submission instruction of test assignment to test control end, the submission instruction of wherein said test assignment is included as the test execution end of described test assignment distribution; Test control end, for the submission instruction according to described test assignment, sends to the described test execution end distributed for described test assignment by described test assignment; Described test execution end, for obtaining the test assignment be assigned to, calling the test assignment plug-in unit be pre-created and performing the test assignment be assigned to, and execution information is returned to described test and management front end by described test control end.
In the present embodiment, test and management front end provides the graphical user operation interface that basic information management, automatic test manage, test resource manages.Concrete, user creates in test and management front end, management testing task, is test assignment allocation for test actuating station, and submits test assignment to.After user submits test assignment to, test and management front end sends the submission instruction of test assignment to test control end, and described submission instruction comprises the test execution end that user distributes for test assignment.
Test control end and test execution end belong to rear end.Wherein test control end is for receiving test assignment, distribution test assignment, obtaining test execution client information, collecting test result, and pass through executing state, the test execution client information of API (ApplicationProgrammingInterface, application programming interface) the interface refresh test task of test and management front end.The order that test execution end primary recipient test control end sends, fill order, and the output information of order is returned to test control end.
Fig. 1 b is the principle of work schematic diagram of the automatic test management system of Agile in the embodiment of the present invention one.As shown in Figure 1 b, test and management front end and each test execution end are communicated to connect by test control end, test and management front end sends the submission instruction of test assignment to test control end, test control end is according to the test execution end submitting the test assignment association comprised in instruction to, the data of test assignment are sent to test execution end, test execution end performs test, and the output information of test process is returned to test and management front end by test control end.
The technical scheme that the embodiment of the present invention provides, provide a kind of automatic test management system of Agile exploitation of lightweight, mainly the automatic test in agile development process is managed, scheduled for executing, monitoring, management testing resource simultaneously, and test result is added up, effectively, flexibly the automatic test used in the project implementation process is managed by this system, reach and improve test execution efficiency, ensure the effect of software quality and release cycle.
Exemplary, test control end can comprise: data obtaining module, for obtaining the execution information of described test assignment from test execution end, described execution information comprises at least one in the status information of test mode, execution journal, test assignment result and test execution end; Information returns module, for the execution information according to test assignment, returns test assignment result and test mode by application programming interface to described test and management front end.
In the present embodiment, the major function of test control end receives test assignment, test assignment distribution, the execution result of collection test assignment and the status information of collection test execution end.Concrete, test control end, is sent to the test execution end of specifying by the test assignment from test and management front end receiver, perform test and execution result is returned to test control end by test execution end.
It should be noted that, the condition that test control end defines according to test and management front end user triggers the test assignment of specifying.Test control end manages all test execution ends simultaneously, and test control end communicates with test execution end, is connected by setting up one with each test execution end, is test execution end allocating task in this connection, receives the execution result of task.
In the present embodiment, test mode, execution journal, test assignment result, for performing test assignment, are sent to test control end by test execution end.Test execution end also needs timing to send status information to test control end, status information comprises heartbeat message and machine information, namely, timing sends the information such as CPU (CentralProcessingUnit, central processing unit), internal memory, disk, network utilization of test control end to test control end.
Exemplary, described test execution end determines the type of the test assignment be assigned to, according to the type of the test assignment determined, call the test assignment plug-in unit be pre-created and perform the test assignment be assigned to, wherein the type of test assignment comprises unit testing task, functional test task and continuous integrating task, and probe card comprises unit testing plug-in unit, functional test plug-in unit and continuous integrating plug-in unit.
Exemplary, described automatic test management system also comprises: version control server, for according to user operation, controls the version of the test script of described test assignment.Wherein, version control server stores the product of different editions, and the test script of different editions, for carrying out Version Control to product, test script.
Whether on the basis of above-described embodiment, test control end also comprises: version monitoring module, upgrade for the product version monitored in version control server, and triggers test assignment according to monitored results.
In order to improve testing efficiency, described test assignment comprises at least one test phase, and described test phase comprises at least one subtask, described test and management front end, specifically for sending the submission instruction of subtask to test control end.Concrete, when creating test assignment in test and management front end, a test assignment can be divided into different test phases, according to execution sequence, test phase be sorted, after the preceding test phase of sequence has been tested, just continue to perform the posterior test phase of sequence; When preceding test phase test test of sorting is interrupted, do not perform the posterior test phase of sequence.
Further, also a test phase can be divided into different subtasks, can test separately each subtask, the type of subtask can comprise unit testing task, functional test task and continuous integrating task, accordingly, described test and management front end sends the submission instruction of subtask to test control end.
Exemplary, the tasks carrying mode of described test execution end comprise serial, parallel and distributed in any one.Being that serial performs between the different test phases of same test assignment, is executed in parallel and/or distributed execution between test subtask.
Embodiment two
Fig. 2 a is the structural representation of the automatic test management system of a kind of Agile in the embodiment of the present invention two.As shown in Figure 2 a, this automatic test management system specifically can comprise: test and management front end, for creating test assignment, and send the submission instruction of test assignment to test control end, the submission instruction of wherein said test assignment is included as the test execution end of described test assignment distribution; Test control end, for the submission instruction according to described test assignment, sends to the described test execution end distributed for described test assignment by described test assignment; Described test execution end, for obtaining the test assignment be assigned to, calling the test assignment plug-in unit be pre-created and performing the test assignment be assigned to, and execution information is returned to described test and management front end by described test control end.
Fig. 2 b is the structural representation of the test and management front end in the embodiment of the present invention two.Composition graphs 2a and Fig. 2 b, test and management front end mainly comprises following function:
1) automatic test management: project personnel log in and after selecting the Related product of oneself, the test and management that can carry out the authority of being correlated with according to the role of oneself operates.Wherein, test and management operation mainly comprises case management, task management, machine handing, task result management etc., and project leader can also carry out project management simultaneously, is product dispensation personnel.
2) submitting test request to: after automatic test personnel and management of product personnel login system, can pass through system definition test assignment, needing to select corresponding test execution end when defining test assignment, while task result notifier can be set.Task definition is complete and after submitting task requests to, the submission instruction (i.e. task requests) of test assignment can be sent to test control end by test and management front end, is distributed to test execution end by test control end.
3) basic information management: be mainly supplied to system manager and provide service, it can carry out the management activity of being correlated with, as carried out user management and the management of product etc. by test and management front end.
Task management module is the nucleus module of test and management front end.Fig. 2 c is the schematic diagram of the task structure in the embodiment of the present invention two.As shown in Figure 2 c, test assignment is a Logic of Tasks assembled unit, and test assignment comprises essential information, for defining the title of test assignment, affiliated project, test result notifier, and the information such as triggering mode.
Test assignment comprises one or several test phases, and the operation logic between test phase is the linear relationship of serial.Test phase can comprise one or several subtasks, and the subtask operational relation in same test phase can be defined as serial or parallel, and only after whole subtask order end of run, this test phase is end of run.
Subtask is concrete test execution use-case set or command history, can arrange tasks carrying mode and test execution end in subtask.Wherein the test command of subtask be one can performance element, it comprises test execution client information and needs to run executable command (Shell/Batch), these executable commands are any executable programs in linux system or Windows system, they are with the form of easily extensible plug-in unit, are carried out the test assignment of running unit test and continuous integrating by parameters.Subtask comprises Three models: unit testing type, continuous integrating type and functional test type.
Can define the triggering mode of test assignment when creating test assignment in test and management front end, triggering mode mainly can comprise: manually run, after task creation is complete, and direct manual triggers test assignment; Version control server triggers, test control end monitor the product version stored in indicated release Control Server path have a change time, automatically can trigger test assignment; Clocked flip, triggers test assignment automatically at the task execution time point of specifying; API triggers, and can pass through HTTP (HyperTextTransferProtocol, HTML (Hypertext Markup Language)) API and trigger test assignment.
In test and management front end, test case management is used for management of test cases, and major function comprises adds use-case, renewal use-case and deletes the functions such as use-case.Use-case can be specified to specify affiliated project, use-case type, code address, method name etc. to test case when creating and upgrade use-case.According to different use-case types, this code address sum functions name can be obtained when test assignment performs, be passed to test execution end.
In test and management front end, resource management module is used for management testing actuating station.Actuating station is starting after after test execution end program and can remove connecting test control end according to the information in configuration file, after having new test execution end to connect upper test control end, test control end can notify that test execution end is added in test and management front end, and this test execution end can show in the actuating station list of test and management front end.
In test and management front end, user can check the implementation status of dissimilar subtask at the appointed time in the stage by Reports module, multiple subtasks of same type can be specified simultaneously, the implementation status of task can carry out adding up and analyzing by this module, and formation curve trend map is presented to user.Analysis result can also be sent to related personnel by lettergram mode by user.
In the present embodiment, test control end receives the task that test and management front end sends, and triggers according to the triggering mode of test and management front end definition, and the task after triggering is sent to the test execution end of specifying, and will obtain task action result.Control end server manages all test execution ends simultaneously, control end server is communicated with test execution end by Socket (socket), by setting up a TCP (TransmissionControlProtocol with each test execution end, transmission control protocol) connect, send order on which, receive command execution results.Task status forward end management system upgrades the most at last.
In the present embodiment, test execution end is arranged in test execution machine, for performing test assignment.Test assignment plug-in unit is also arranged on test execution machine, and after test execution end receives task, according to task type, initiating task performs plug-in unit and executes the task.With task type correspondingly, plug-in unit is mainly divided into unit testing plug-in unit, functional test plug-in unit and continuous integrating plug-in unit.
Wherein, unit testing task plug-in unit, is mainly used in performance element test assignment and coverage rate is collected, and can download test code, testing results code, produces the work such as coverage data from version control server.The Shell that Perl and shUnit2+shcov that Python, Test::Class that PHP, Python that the Java project that C/C++, Maven that the language supported has gcc/g++ to build build, PHPunit build build build builds.
Unit testing task plug-in unit mainly comprises in design: public part, comprises version control server related command, order performs, daily record is read and write; Process various linguistic unit part of detecting, this part comprises the processing section of a base class and other each supporting languages.Wherein base class major function has environmental preparation, version control server verification, installation to rely on bag, execution use-case, cleaning data; Base class is all inherited in the processing section of other each supporting languages; Performing intake section, is the execution entrance of all kinds task, and inlet portion branch judges the unit testing language that will perform and constructed type according to the parameter in order line, then calls the processing section execution test command of different language.
The performance element test of this plug-in unit and the process of collection coverage rate comprise: verification (checkout) item code; Perform the order of specifying, be generally compiling project, perform the orders such as use-case; Collecting code coverage information, is optional according to setting; Coverage data is preserved, and comprises and is saved to this locality and server; Data scrubbing.
The plug-in unit that the present embodiment provides considers extensibility in design, and unit testing and the coverage rate that can expand other types language are collected, and only need oneself to realize coverage rate Collection and preservation during expansion newspeak, plug-in unit base class inherited by other needs.
Wherein, functional test plug-in unit is mainly used in the automatic test cases that executive system creates, and user uses use-case pattern when creating test subtask, and the test case for existing in subtask selection platform.Test execution end carrys out the test case in subtasking by order line calling function test assignment plug-in script, the parameter of appointment instrument, URL (UniformResoureLocator, uniform resource locator), method name and use-case ID is needed in order line statement.
Can show during plug-in component operation in the first user name according to version control server in configuration file, password and order line specifies version control server address to verify in the working directory of this locality by test code, when performing the test code of these use-cases, plug-in unit can select corresponding startup and executive mode according to the attribute of the test frame of use-case or instrument.The framework of functional test plug-in unit support has Maven-Junit and Ant-Junit, and the automated test tool of support has Selenium.
Wherein, continuous integrating task plug-in unit is mainly used to the task of performing continuous integrating type, can download the work such as code, compiled code, packing, deployment, testing results code from version control server.This plug-in unit has a configuration file, comprising the information needed for continuous integrating, mainly comprises essential information configuration, unit testing configuration, structure configuration, deployment configuration and follow-up functional test configuration.This plug-in unit carries out parsing operation according to the configuration file content provided.
First, a config file can be defined when the task of continuous integrating type creates in front end, config file comprises the configuration of the work in each stage of will carrying out of task, mainly comprises and performs corresponding unit testing, structure, deployment and follow-up functional test stage.Also need when creation task to specify the stage that will perform simultaneously.
The script file that the task plug-in unit of the type mainly comprises can be divided into entrance script, unit testing script, structure script, deployment script, functional test script according to the stage.
After actuating station sends the order of execution continuous integrating mission script, it is as follows that plug-in unit performs step: the position obtaining config file from order line statement and the execute phase of specifying; Download config file in the tasks carrying temporary folder of execution machine, read config file; Then check the stage that will run, and the operation phase is set; Create and run catalogue; Call each task phase and perform script, execute the task the stage.
And, the layoutprocedure of plug-in unit is as follows: first need in the configuration of front end management system, point out the particular location of plug-in unit, then concrete plug-in card configuration item also needed for configuration plug-in is installed on test execution machine, the such as user name, password, test execution catalogue etc. of version control server verification, but for test execution machine, whole plug-in unit is installed not necessarily, only needs the plug-in unit required for this machine is installed.
Fig. 2 d is the workflow schematic diagram of the automatic test management system of Agile in the embodiment of the present invention two.As shown in Figure 2 b, the workflow of this system is as follows: test and management front end sends test request to test control end, and write new test request file, when test control end detects new test request file, receive task requests, and task requests is transmitted to the test execution end that test and management front end is task matching in advance, test execution end performs the test assignment received, and test execution state is sent to test control end, test control end is by test mode information write test mode file, the test mode information stored in the read test status file of test and management front end.
The technical scheme provided in the present embodiment, defines the structure of automatic test task, ensure that the support to multiple-task executive mode; Propose the triggering mode of multiple automatic test tasks carrying, ensure the dirigibility that task triggers and performs; Can version control server be monitored simultaneously, support continuous integrating and daily build; The automatic test after continuous integrating can be done by different trigger modes simultaneously; By performing probe card, supporting the execution of the test assignment of multiple test-types, supporting the test frame commonly used or instrument simultaneously; Support the monitoring to test execution resource, distribution and management; Real-time control and measuring tasks carrying situation, collect and process test assignment execution result, formation curve trend map, supports the Collection and analysis to test result, and can generate testing journal sheet.
Embodiment three
Fig. 3 is the process flow diagram of the automatic test management method of a kind of Agile in the embodiment of the present invention three, and as shown in Figure 3, the method can comprise the steps:
Step 301, test and management front end create test assignment, and send the submission instruction of test assignment to test control end, and the submission instruction of wherein said test assignment is included as the test execution end of described test assignment distribution.
In the present embodiment, test and management front end provides the graphical user operation interface that basic information management, automatic test manage, test resource manages.When creating test assignment, test assignment can be divided at least one test phase, test phase be divided at least one subtask, and being subtask nominative testing actuating station and triggering mode.
Described test assignment, according to the submission instruction of described test assignment, is sent to the described test execution end distributed for described test assignment by step 302, test control end.
In the present embodiment, test control end monitors submission instruction always, such as, whether there is new task requests file in the store path of the task requests file that control and measuring management front end is specified, if have, then test control end reads and resolves new task requests file, and according to task kind in analysis result, do different process.
Concrete, task kind be start perform test time, the actuating station information of acquisition task association, and perform following operation: exist in the actuating station of association, and be in upstate, and pending when not being timed task, task is inserted in tasks carrying list, and mission bit stream packing is sent to the actuating station of association; Exist in the actuating station of association, and be in upstate, and pending when being timed task, task is joined in timed task list, when arriving the fixed time of timed task, task is inserted in tasks carrying list, and mission bit stream packing is sent to the actuating station of association; When the actuating station associated does not exist or is unavailable, send miscue information to test and management front end, require that front end upgrades task status, front end upgrades task status according to error message.After task requests is disposed, test control end deletes task requests file.
Concrete, be when stopping test assignment in task kind, can determine whether the test execution end associated exists, if exist, then notify that the test execution end of specifying stops test assignment, and this test assignment is deleted executing the task in list; If test execution end does not exist, then stop the process to this test assignment.
Step 303, test execution end obtain the test assignment be assigned to, and call the test assignment plug-in unit be pre-created and perform the test assignment be assigned to, and execution information is returned to described test and management front end by described test control end.
After test execution termination receives task, different process functions can be specified to go forward side by side row relax according to the type of task.Concrete, the type of task be start perform test time, obtain task order information, promoter process is executed the task order, and subprocess according to the type of test assignment, can start corresponding tasks carrying plug-in unit and execute the task, simultaneously in task implementation, host process meeting monitor task state, and read task daily record, implement to send to control end server.When the type of task is stopping test assignment, test execution end finds corresponding test assignment plug-in unit process by process ID, and rev down process rev.
Exemplary, described test execution end calls the test assignment plug-in unit be pre-created and performs the test assignment be assigned to, and can comprise: test execution end determines the type of the test assignment be assigned to; Test execution end is according to the type of the test assignment determined, call the test assignment plug-in unit be pre-created and perform the test assignment be assigned to, wherein the type of test assignment comprises unit testing task, functional test task and continuous integrating task, and probe card comprises unit testing plug-in unit, functional test plug-in unit and continuous integrating plug-in unit.
Exemplary, test control end is according to the submission instruction of described test assignment, described test assignment is sent to the described test execution end distributed for described test assignment, can comprise: test control end obtains the execution information of described test assignment from test execution end, described execution information comprises at least one in the status information of test mode, execution journal, test assignment result and test execution end; Test control end, according to the execution information of test assignment, returns test assignment result and test mode by application programming interface to described test and management front end.
The automatic test management method of the Agile that the present embodiment provides, the automatic test management system of the Agile provided with any embodiment of the present invention belongs to same inventive concept, and the automatic test management system of the Agile provided by any embodiment of the present invention performs.The not ins and outs of detailed description in the present embodiment, the automatic test management system of the Agile that can provide see any embodiment of the present invention.
Note, above are only preferred embodiment of the present invention and institute's application technology principle.Skilled person in the art will appreciate that and the invention is not restricted to specific embodiment described here, various obvious change can be carried out for a person skilled in the art, readjust and substitute and can not protection scope of the present invention be departed from.Therefore, although be described in further detail invention has been by above embodiment, the present invention is not limited only to above embodiment, when not departing from the present invention's design, can also comprise other Equivalent embodiments more, and scope of the present invention is determined by appended right.
Claims (10)
1. an automatic test management system for Agile, is characterized in that, comprising:
Test and management front end, for creating test assignment, and sends the submission instruction of test assignment to test control end, the submission instruction of wherein said test assignment is included as the test execution end of described test assignment distribution;
Test control end, for the submission instruction according to described test assignment, sends to the described test execution end distributed for described test assignment by described test assignment;
Described test execution end, for obtaining the test assignment be assigned to, calling the test assignment plug-in unit be pre-created and performing the test assignment be assigned to, and execution information is returned to described test and management front end by described test control end.
2. system according to claim 1, it is characterized in that, described test execution end determines the type of the test assignment be assigned to, according to the type of the test assignment determined, call the test assignment plug-in unit be pre-created and perform the test assignment be assigned to, wherein the type of test assignment comprises unit testing task, functional test task and continuous integrating task, and probe card comprises unit testing plug-in unit, functional test plug-in unit and continuous integrating plug-in unit.
3. system according to claim 1, is characterized in that, test control end comprises:
Data obtaining module, for obtaining the execution information of described test assignment from test execution end, described execution information comprises at least one in the status information of test mode, execution journal, test assignment result and test execution end;
Information returns module, for the execution information according to test assignment, returns test assignment result and test mode by application programming interface to described test and management front end.
4. system according to claim 1, is characterized in that, also comprises:
Version control server, for according to user operation, controls the version of the test script of described test assignment.
5. system according to claim 4, is characterized in that, test control end also comprises:
Whether version monitoring module, upgrade for the product version monitored in version control server, and trigger test assignment according to monitored results.
6. system according to claim 1, is characterized in that, the tasks carrying mode of described test execution end comprise serial, parallel and distributed in any one.
7. system according to claim 1, is characterized in that, described test assignment comprises at least one test phase, and described test phase comprises at least one subtask,
Described test and management front end, specifically for sending the submission instruction of subtask to test control end.
8. an automatic test management method for Agile, is characterized in that, comprising:
Test and management front end creates test assignment, and sends the submission instruction of test assignment to test control end, and the submission instruction of wherein said test assignment is included as the test execution end of described test assignment distribution;
Described test assignment, according to the submission instruction of described test assignment, is sent to the described test execution end distributed for described test assignment by test control end;
Described test execution end obtains the test assignment be assigned to, and calls the test assignment plug-in unit be pre-created and performs the test assignment be assigned to, and execution information is returned to described test and management front end by described test control end.
9. method according to claim 8, is characterized in that, described test execution end calls the test assignment plug-in unit be pre-created and performs the test assignment be assigned to, and comprising:
Test execution end determines the type of the test assignment be assigned to;
Test execution end is according to the type of the test assignment determined, call the test assignment plug-in unit be pre-created and perform the test assignment be assigned to, wherein the type of test assignment comprises unit testing task, functional test task and continuous integrating task, and probe card comprises unit testing plug-in unit, functional test plug-in unit and continuous integrating plug-in unit.
10. method according to claim 8, is characterized in that, described test assignment, according to the submission instruction of described test assignment, is sent to the described test execution end distributed for described test assignment, comprises by test control end:
Test control end obtains the execution information of described test assignment from test execution end, and described execution information comprises at least one in the status information of test mode, execution journal, test assignment result and test execution end;
Test control end, according to the execution information of test assignment, returns test assignment result and test mode by application programming interface to described test and management front end.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510857092.XA CN105487977A (en) | 2015-11-30 | 2015-11-30 | Agility-oriented automatic test management system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510857092.XA CN105487977A (en) | 2015-11-30 | 2015-11-30 | Agility-oriented automatic test management system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105487977A true CN105487977A (en) | 2016-04-13 |
Family
ID=55674969
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510857092.XA Pending CN105487977A (en) | 2015-11-30 | 2015-11-30 | Agility-oriented automatic test management system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105487977A (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105933173A (en) * | 2016-07-10 | 2016-09-07 | 中山市厚源电子科技有限公司 | Electric power system intelligent device automatic testing system |
| CN106201618A (en) * | 2016-07-14 | 2016-12-07 | 中电长城网际系统应用有限公司 | A kind of APP task executing method based on plug-in mounting mechanism and system |
| CN107506294A (en) * | 2017-07-04 | 2017-12-22 | 深圳市小牛在线互联网信息咨询有限公司 | Visualize automated testing method, device, storage medium and computer equipment |
| CN107506342A (en) * | 2016-06-14 | 2017-12-22 | 鼎桥通信技术有限公司 | A kind of the offline of radio frequency unit does table method |
| CN107526679A (en) * | 2017-07-13 | 2017-12-29 | 深圳市小牛在线互联网信息咨询有限公司 | Automated test frame, the automated testing method based on thereon, storage medium and computer equipment |
| CN107678941A (en) * | 2017-08-31 | 2018-02-09 | 深圳市小牛在线互联网信息咨询有限公司 | Method and device, storage medium and the computer equipment of Application testing |
| CN107844428A (en) * | 2017-12-15 | 2018-03-27 | 四川汉科计算机信息技术有限公司 | Avionic software emulation testing management platform |
| CN108153595A (en) * | 2018-01-18 | 2018-06-12 | 成都无糖信息技术有限公司 | A kind of big data distributed task scheduling processing unit based on python |
| CN108564985A (en) * | 2018-03-16 | 2018-09-21 | 广州视源电子科技股份有限公司 | EMMC test methods, device, mobile terminal and storage medium |
| CN108664405A (en) * | 2018-05-17 | 2018-10-16 | 福建天泉教育科技有限公司 | A kind of automatic monitoring method and terminal based on funnel model |
| CN108845954A (en) * | 2018-08-31 | 2018-11-20 | 中国联合网络通信集团有限公司 | Method for testing pressure, system and storage medium |
| CN109753430A (en) * | 2018-12-19 | 2019-05-14 | 莱诺斯科技（北京）股份有限公司 | A kind of interface test method of Ground Data Processing System |
| CN109977012A (en) * | 2019-03-19 | 2019-07-05 | 中国联合网络通信集团有限公司 | Joint debugging test method, device, equipment and the computer readable storage medium of system |
| CN110471394A (en) * | 2019-07-30 | 2019-11-19 | 中车青岛四方机车车辆股份有限公司 | Task test method and device, system, storage medium and processor |
| TWI695284B (en) * | 2018-12-28 | 2020-06-01 | 中華電信股份有限公司 | Agile software development system and method thereof |
| CN111651349A (en) * | 2020-05-26 | 2020-09-11 | 泰康保险集团股份有限公司 | Test method and device |
| CN112256481A (en) * | 2020-10-26 | 2021-01-22 | 华泰证券股份有限公司 | Data recovery method and system in agile development |
| CN112954050A (en) * | 2021-02-07 | 2021-06-11 | 深圳市大梦龙途文化传播有限公司 | Distributed management method and device, management equipment and computer storage medium |
| CN113220562A (en) * | 2020-02-06 | 2021-08-06 | 北京沃东天骏信息技术有限公司 | Terminal testing method and device, computer storage medium and electronic equipment |
| CN113542796A (en) * | 2020-04-22 | 2021-10-22 | 腾讯科技（深圳）有限公司 | Video evaluation method and device, computer equipment and storage medium |
| CN113590475A (en) * | 2021-07-13 | 2021-11-02 | 北京快乐茄信息技术有限公司 | Joint debugging test method and joint debugging test device for online development platform |
| CN113722229A (en) * | 2021-09-06 | 2021-11-30 | 挂号网（杭州）科技有限公司 | Software testing method and device, electronic equipment and storage medium |
| CN117149665A (en) * | 2023-10-31 | 2023-12-01 | 芯瞳半导体技术(山东)有限公司 | Continuous integration method, control device, continuous integration system, and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101447898A (en) * | 2008-11-19 | 2009-06-03 | 中国人民解放军信息安全测评认证中心 | Test system used for network safety product and test method thereof |
| CN101540929A (en) * | 2009-04-23 | 2009-09-23 | 北京航空航天大学 | Synchronous time test system of digital television receiver and test method thereof |
| CN101998425A (en) * | 2009-08-13 | 2011-03-30 | 胡乐乐 | Method and system for testing wireless network optimization |
| US20110314339A1 (en) * | 2010-06-22 | 2011-12-22 | International Business Machines Corporation | Systems for agile error determination and reporting and methods thereof |
| CN103246604A (en) * | 2013-03-29 | 2013-08-14 | 北京京东尚科信息技术有限公司 | Soft testing system, soft testing method, controlling device and executing devices |
| CN103678093A (en) * | 2012-08-30 | 2014-03-26 | 腾讯科技（深圳）有限公司 | Automatic testing framework and testing method |
| CN103746885A (en) * | 2014-01-28 | 2014-04-23 | 中国人民解放军信息安全测评认证中心 | Test system and test method oriented to next-generation firewall |
| CN103916384A (en) * | 2014-01-21 | 2014-07-09 | 中国人民解放军信息安全测评认证中心 | Penetration testing method for GAP isolation and exchange device |
| CN103970627A (en) * | 2013-02-06 | 2014-08-06 | 深圳市杰和科技发展有限公司 | Automatic computer power supply switching test system and method |
-
2015
- 2015-11-30 CN CN201510857092.XA patent/CN105487977A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101447898A (en) * | 2008-11-19 | 2009-06-03 | 中国人民解放军信息安全测评认证中心 | Test system used for network safety product and test method thereof |
| CN101540929A (en) * | 2009-04-23 | 2009-09-23 | 北京航空航天大学 | Synchronous time test system of digital television receiver and test method thereof |
| CN101998425A (en) * | 2009-08-13 | 2011-03-30 | 胡乐乐 | Method and system for testing wireless network optimization |
| US20110314339A1 (en) * | 2010-06-22 | 2011-12-22 | International Business Machines Corporation | Systems for agile error determination and reporting and methods thereof |
| CN103678093A (en) * | 2012-08-30 | 2014-03-26 | 腾讯科技（深圳）有限公司 | Automatic testing framework and testing method |
| CN103970627A (en) * | 2013-02-06 | 2014-08-06 | 深圳市杰和科技发展有限公司 | Automatic computer power supply switching test system and method |
| CN103246604A (en) * | 2013-03-29 | 2013-08-14 | 北京京东尚科信息技术有限公司 | Soft testing system, soft testing method, controlling device and executing devices |
| CN103916384A (en) * | 2014-01-21 | 2014-07-09 | 中国人民解放军信息安全测评认证中心 | Penetration testing method for GAP isolation and exchange device |
| CN103746885A (en) * | 2014-01-28 | 2014-04-23 | 中国人民解放军信息安全测评认证中心 | Test system and test method oriented to next-generation firewall |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107506342A (en) * | 2016-06-14 | 2017-12-22 | 鼎桥通信技术有限公司 | A kind of the offline of radio frequency unit does table method |
| CN107506342B (en) * | 2016-06-14 | 2021-11-12 | 鼎桥通信技术有限公司 | Off-line tabulation method for radio frequency unit |
| CN105933173A (en) * | 2016-07-10 | 2016-09-07 | 中山市厚源电子科技有限公司 | Electric power system intelligent device automatic testing system |
| CN106201618B (en) * | 2016-07-14 | 2019-03-05 | 中电长城网际系统应用有限公司 | A kind of APP task executing method and system based on inserting mechanism |
| CN106201618A (en) * | 2016-07-14 | 2016-12-07 | 中电长城网际系统应用有限公司 | A kind of APP task executing method based on plug-in mounting mechanism and system |
| CN107506294A (en) * | 2017-07-04 | 2017-12-22 | 深圳市小牛在线互联网信息咨询有限公司 | Visualize automated testing method, device, storage medium and computer equipment |
| CN107526679A (en) * | 2017-07-13 | 2017-12-29 | 深圳市小牛在线互联网信息咨询有限公司 | Automated test frame, the automated testing method based on thereon, storage medium and computer equipment |
| CN107678941A (en) * | 2017-08-31 | 2018-02-09 | 深圳市小牛在线互联网信息咨询有限公司 | Method and device, storage medium and the computer equipment of Application testing |
| CN107844428A (en) * | 2017-12-15 | 2018-03-27 | 四川汉科计算机信息技术有限公司 | Avionic software emulation testing management platform |
| CN108153595A (en) * | 2018-01-18 | 2018-06-12 | 成都无糖信息技术有限公司 | A kind of big data distributed task scheduling processing unit based on python |
| CN108564985A (en) * | 2018-03-16 | 2018-09-21 | 广州视源电子科技股份有限公司 | EMMC test methods, device, mobile terminal and storage medium |
| CN108664405A (en) * | 2018-05-17 | 2018-10-16 | 福建天泉教育科技有限公司 | A kind of automatic monitoring method and terminal based on funnel model |
| CN108664405B (en) * | 2018-05-17 | 2021-11-09 | 福建天泉教育科技有限公司 | Automatic monitoring method and terminal based on funnel model |
| CN108845954A (en) * | 2018-08-31 | 2018-11-20 | 中国联合网络通信集团有限公司 | Method for testing pressure, system and storage medium |
| CN109753430A (en) * | 2018-12-19 | 2019-05-14 | 莱诺斯科技（北京）股份有限公司 | A kind of interface test method of Ground Data Processing System |
| CN109753430B (en) * | 2018-12-19 | 2022-07-29 | 莱诺斯科技（北京）股份有限公司 | Interface test method of ground data processing system |
| TWI695284B (en) * | 2018-12-28 | 2020-06-01 | 中華電信股份有限公司 | Agile software development system and method thereof |
| CN109977012A (en) * | 2019-03-19 | 2019-07-05 | 中国联合网络通信集团有限公司 | Joint debugging test method, device, equipment and the computer readable storage medium of system |
| CN110471394A (en) * | 2019-07-30 | 2019-11-19 | 中车青岛四方机车车辆股份有限公司 | Task test method and device, system, storage medium and processor |
| CN113220562A (en) * | 2020-02-06 | 2021-08-06 | 北京沃东天骏信息技术有限公司 | Terminal testing method and device, computer storage medium and electronic equipment |
| CN113542796A (en) * | 2020-04-22 | 2021-10-22 | 腾讯科技（深圳）有限公司 | Video evaluation method and device, computer equipment and storage medium |
| CN113542796B (en) * | 2020-04-22 | 2023-08-08 | 腾讯科技（深圳）有限公司 | Video evaluation method, device, computer equipment and storage medium |
| CN111651349A (en) * | 2020-05-26 | 2020-09-11 | 泰康保险集团股份有限公司 | Test method and device |
| CN112256481A (en) * | 2020-10-26 | 2021-01-22 | 华泰证券股份有限公司 | Data recovery method and system in agile development |
| CN112954050A (en) * | 2021-02-07 | 2021-06-11 | 深圳市大梦龙途文化传播有限公司 | Distributed management method and device, management equipment and computer storage medium |
| CN113590475A (en) * | 2021-07-13 | 2021-11-02 | 北京快乐茄信息技术有限公司 | Joint debugging test method and joint debugging test device for online development platform |
| CN113590475B (en) * | 2021-07-13 | 2024-05-31 | 北京快乐茄信息技术有限公司 | Joint debugging test method and joint debugging test device of online development platform |
| CN113722229A (en) * | 2021-09-06 | 2021-11-30 | 挂号网（杭州）科技有限公司 | Software testing method and device, electronic equipment and storage medium |
| CN117149665A (en) * | 2023-10-31 | 2023-12-01 | 芯瞳半导体技术(山东)有限公司 | Continuous integration method, control device, continuous integration system, and storage medium |
| CN117149665B (en) * | 2023-10-31 | 2024-02-20 | 芯瞳半导体技术(山东)有限公司 | Continuous integration method, control device, continuous integration system, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105487977A (en) | Agility-oriented automatic test management system and method | |
| CN109933522B (en) | Test method, test system and storage medium for automatic case | |
| CN105359102B (en) | Advanced customer support service-advanced support cloud portal | |
| Sampaio et al. | Supporting microservice evolution | |
| JP6346377B2 (en) | Method and system for movably deploying an application to one or more cloud systems | |
| US9485151B2 (en) | Centralized system management on endpoints of a distributed data processing system | |
| Zhang et al. | Compatibility testing service for mobile applications | |
| CN108255720A (en) | Software automatic test system based on cloud computing framework | |
| US10817819B2 (en) | Workflow compilation | |
| CN109634843A (en) | A kind of distributed automatization method for testing software and platform towards AI chip platform | |
| WO2013184140A1 (en) | Version management for applications | |
| CN106970880A (en) | A kind of distributed automatization method for testing software and system | |
| US20170220324A1 (en) | Data communication accelerator system | |
| CN113778486B (en) | Method, device, medium and equipment for containerization processing of code pipeline | |
| US20240045756A1 (en) | Structured Software Delivery And Operation Automation | |
| US20060120353A1 (en) | Systems and methods for VolP service delivery | |
| Aksakalli et al. | Systematic approach for generation of feasible deployment alternatives for microservices | |
| Vögler et al. | Non-intrusive monitoring of stream processing applications | |
| Inzinger et al. | Decisions, Models, and Monitoring--A Lifecycle Model for the Evolution of Service-Based Systems | |
| Admanski et al. | Autotest-testing the untestable | |
| Wang et al. | EPF4M: An evolution-oriented programming framework for microservices | |
| Karalis et al. | OpenRSM: a lightweight integrated open source remote management solution | |
| Stefanidis et al. | MELODIC: Selection and Integration of Open Source to Build an Autonomic Cross-Cloud Deployment Platform | |
| Gaikwad et al. | Pipeline Orchestration for Test Automation using Extended Buildbot Architecture | |
| WO2013019200A1 (en) | Systems and methods of knowledge transfer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160413 |
|
| RJ01 | Rejection of invention patent application after publication |