CN106502898A - Method of testing and test driver and test platform - Google Patents
Method of testing and test driver and test platform Download PDFInfo
- Publication number
- CN106502898A CN106502898A CN201610934302.5A CN201610934302A CN106502898A CN 106502898 A CN106502898 A CN 106502898A CN 201610934302 A CN201610934302 A CN 201610934302A CN 106502898 A CN106502898 A CN 106502898A
- Authority
- CN
- China
- Prior art keywords
- test
- case
- plan
- logic
- node server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of method of testing and driver and test platform.The test driver includes：Data load-on module, is configured to parse the test case of system under test (SUT), gives use-case object by the numerical value of the test case definition, and the numerical value of wherein described test case definition at least includes testing input value and desired output；And test logic module, the use-case object provided using the data load-on module is provided, the system under test (SUT) is tested according to presumptive test logic.Concept of the present invention based on driver model, achieve the separation of test data and test logic, and pass through distributed platform framework by whole test process service, improve the automaticity of test process, achieve the standardized management and use to testing user, thus reduce test and participate in difficulty, so as to improve testing efficiency, and then reduce testing cost.
Description
Technical field
Present invention relates in general to technical field of measurement and test, more particularly to a kind of method of testing by test process service
With driver and test platform.
Background technology
With the change speed of internet product more and more faster, in order to more quickly obtain the feedback to software product, real
More using the method that persistently pays in trampling.Persistently pay and may require that demand analyses, the Consumer's Experience of product and interaction, set
Role's close collaborations such as meter, exploitation, test, O＆M.Obviously, under the internet environment of this high speed development, traditional test
Method cannot adapt to current product development rhythm.
Quality assurance is not only to test the thing that single post is responsible for, with greater need for the same product understood by business and product
Product personnel and developer can participate in into, so as to the quality mind in more fully Improving The Quality of Products and all posies.So
And, in prior art, traditional other people from posies being difficult to allow based on the method for testing of script and instrument in addition to tester
Member is participated in test process.
In practice, the differentiation of Test Strategy and test case description also makes it difficult to carry out unitized management to which, by
This causes, and the artificial participation of test process is too high, and testing cost is higher but testing efficiency is relatively low.In addition, at present test data and
Coexisting for test logic is corresponding so that the internal relations of test case is complicated, and maintenance cost is high and is difficult to manage.Additionally, existing
Have in technology, tester not only needs to create test plan according to specific scene and demand, in addition it is also necessary to manage distributed tune
Degree, the concurrently loaded down with trivial details execution details such as operation.
Therefore, the automaticity of test process how is lifted, is reduced test case exploitation and is used threshold, be test skill
Art field problem in the urgent need to address.
Content of the invention
It is an advantage of the invention to provide a kind of by the method for testing and driver of test process service and test
System, to realize the standardized management to test case etc., reduces test and participates in difficulty, thus improve testing efficiency, reduce surveying
Examination cost.
To achieve these goals, concept of the method for testing of the invention based on driver model, realize test data and
The separation of test logic, is further write test logic so that the program norm of test case, after being easy to by model identical
Continuous management and multiplexing.On the other hand, distributed measuring system of the invention adopts the detached browser/server (B/ in front and back end
S) framework, realizes the United Dispatching to test assignment, by by whole test process service, allow test case management and
Using easily being used by more people, testing cost is thus substantially reduced.
It is pointed out that in this application, so-called test case not only includes traditional functional test,
And be intended to code compilation, static check, unit testing, deployed environment, smoke test, performance test, stability test, flow
Duplication, contrast verification, compliance test result, Outliers mining, version issue etc. all test processs be all defined as test case.User
Test plan can be created according to specific scene and demand, so as to used in the test process that persistently pays.
According to an aspect of the invention, there is provided a kind of method of testing, including：The test case of system under test (SUT) is carried out
The numerical value of the test case definition is given use-case object by parsing, and the numerical value of wherein described test case definition is at least wrapped
Include test input value and desired output；With using the use-case object, the system under test (SUT) is entered according to presumptive test logic
Row test.
Using this method, the separation of test data and test logic is realized, is thus easy to standardize test case
Management, thus reduces testing cost.
In one embodiment of the invention, the method for testing also includes：For the test case, arrange with described
The associated use-case of the executive mode of test case executes parameter, wherein, executes parameter according to the use-case, according to described predetermined
Test logic is tested to the system under test (SUT).In further embodiment of the present invention, the use-case executes parameter to be included
Any one or more in below：Feature and sandbox isolated execution feature are concurrently executed.
In one embodiment of the invention, the method for testing also includes：Analyze according to demand, design the pre- location survey
Examination logic；With based on the presumptive test logic, test plan of the design for the system under test (SUT), the test plan are corresponding
In one or more test cases.In further embodiment of the present invention, a test case is in multiple differences
It is multiplexed in the test plan.
In one embodiment of the invention, the form of the test case include following in any one or more：Text
Part folder, compressed file bag, so files, data-base recording and database table.In one embodiment of the invention, the survey
The numerical value of example definition on probation also includes execution condition.
According to another aspect of the present invention, there is provided a kind of test driver, including：Data load-on module, is configured to
The test case of system under test (SUT) is parsed, and use-case object is given by the numerical value of the test case definition, wherein described
The numerical value of test case definition at least includes testing input value and desired output；And test logic module, it is configured to utilize institute
The use-case object of data load-on module offer is provided, the system under test (SUT) is tested according to presumptive test logic.
In one embodiment of the invention, the test driver also includes：Use-case setup module, is configured to institute
Test case is stated, the use-case being associated with the executive mode of the test case is set and is executed parameter, wherein, the test logic
Module is configured to execute parameter according to the use-case, the system under test (SUT) is tested according to the presumptive test logic.?
In further embodiment of the present invention, the use-case execute parameter include following in any one or more：Feature is concurrently executed
And sandbox isolated execution feature.
In one embodiment of the invention, the test driver also includes：Test logical design module, is configured to root
According to demand analyses, the presumptive test logic is designed；With Test Sample Design module, it is configured to the presumptive test and patrols
Volume, test plan of the design for the system under test (SUT), the test plan correspond to one or more test cases.?
In further embodiment of the present invention, a test case is multiplexed in multiple different test plans.
In one embodiment of the invention, the form of the test case include following in any one or more：Text
Part folder, compressed file bag, so files, data-base recording and database table.In one embodiment of the invention, the survey
The numerical value of example definition on probation also includes execution condition.
In another aspect of the present invention, there is provided a kind of distributed measuring system, including：Main control server, described
Main control server receives the test plan and corresponding Test driver module for system under test (SUT), and the test plan corresponds to one
Individual or multiple test cases, wherein described Test driver module include data loading unit and test logical block；Test resource
Pond, the test resource pond include one or more node servers, and wherein, the main control server is configured to, according to pre-
Set pattern then, selects the node server for received test plan from the test resource pond, and wherein, selected
Node server be configured to：Using the data loading unit of the Test driver module, the test case is solved
The numerical value of the test case definition is given use-case object by analysis, and the numerical value of wherein described test case definition at least includes
Test input value and desired output；With according to described test logical block in presumptive test logic, using the use-case pair
As testing to the system under test (SUT).
Using above-mentioned distributed measuring system, it is achieved that the United Dispatching to test assignment, by by whole test process
Serviceization, allow test case management and using easily being used by more people, thus substantially reduce testing cost.
In one embodiment of the invention, the node server is additionally configured to：For the test case, arrange
The use-case being associated with the executive mode of the test case executes parameter；Parameter is executed with according to the use-case, according to described
Presumptive test logic, is tested to the system under test (SUT) using the use-case object.In further embodiment of the present invention,
The use-case execute parameter include following in any one or more：Feature and sandbox isolated execution feature are concurrently executed.
In one embodiment of the invention, the presumptive test logic is to analyze according to demand and design；And institute
State test plan to design based on the presumptive test logic.In further embodiment of the present invention, a survey
Example on probation is multiplexed in multiple different test plans, and/or, a Test driver module is in multiple different institutes
State in test case and be multiplexed.
In one embodiment of the invention, the multiple different presumptive tests for executing on the distributed measuring system
Logic is write using same designated mode.
In one embodiment of the invention, the test resource pond includes multiple test resource groups, each described test
Resource group is made up of one or more node servers, and wherein, the main control server is configured to：According to received
Test plan, determine for executing the test resource group of the test plan；Whole in test resource group determined by traversal
Node server, to determine the node server of the execution requirement for meeting the test plan；And will from the satisfaction execution
In the node server that asks, the node server of load minimum is selected, as the node server for the test plan.
Using the above embodiment of the present invention, the Optimum utilization of test resource can be realized.
In one embodiment of the invention, the main control server is configured to：It is used for the survey determining
In the case of not meeting the node server for executing and requiring in the test resource group of examination plan, by the tester
Draw and be put into task waiting list；Will with response to monitoring to have in the test resource group node server to meet the execution
Ask, select the node server, as the node server for the test plan.
In one embodiment of the invention, the test plan and corresponding Test driver module are the master control services
Device is received from user side by network interface.
In one embodiment of the invention, the form of the test case include following in any one or more：Text
Part folder, compressed file bag, so files, data-base recording and database table.In one embodiment of the invention, the survey
The numerical value of example definition on probation also includes execution condition.
In another aspect of the invention, there is provided a kind of distributed test method, including：Flat by distributed testing
The main control server of platform, receives the test plan and corresponding Test driver module for system under test (SUT), the test plan pair
Should be in one or more test cases, wherein described Test driver module includes data loading unit and test logical block；Institute
Main control server is stated according to pre-defined rule, is selected for received from the test resource pond of the distributed measuring system
The node server of test plan, wherein, the test resource pond includes one or more node servers；In selected node
On server, using the data loading unit of the Test driver module, the test case is parsed, by the survey
The numerical value of example definition on probation gives use-case object, and the numerical value of wherein described test case definition at least includes testing input value and phase
Hope output valve；And on selected node server, according to the presumptive test logic in the test logical block, using institute
State use-case object to test the system under test (SUT).
In one embodiment of the invention, described on selected node server according to described test logical block in
Presumptive test logic test carried out to the system under test (SUT) using the use-case object include：For the test case, if
Put the use-case being associated with the executive mode of the test case and execute parameter；Parameter is executed with according to the use-case, according to institute
Presumptive test logic is stated, the system under test (SUT) is tested using the use-case object.In further embodiment of the present invention
In, the use-case execute parameter include following in any one or more：Feature and sandbox isolated execution feature are concurrently executed.
In one embodiment of the invention, the presumptive test logic is to analyze according to demand and design；And institute
State test plan to design based on the presumptive test logic.In further embodiment of the present invention, a survey
Example on probation is multiplexed in multiple different test plans, and/or, a Test driver module is in multiple different institutes
State in test case and be multiplexed.
In one embodiment of the invention, the multiple different presumptive tests for executing on the distributed measuring system
Logic is write using same designated mode.
In one embodiment of the invention, the test resource pond of the distributed measuring system includes multiple test resources
Group, each described test resource group are made up of one or more node servers, and wherein, the main control server is according to pre-
Set pattern then selects the node serve for received test plan from the test resource pond of the distributed measuring system
Device includes：According to received test plan, determine for executing the test resource group of the test plan；Determined by traversal
Whole node servers in test resource group, to determine the node server of the execution requirement for meeting the test plan；With
And from the node server for meeting in the node server for executing and requiring, selecting load minimum, as described
The node server of test plan.
In one embodiment of the invention, the node server work for selecting load in the test resource group minimum
It is also to include for the node server of the test plan：In the test resource group for the test plan is determined
In the case of not meeting the node server for executing and requiring, the test plan is put into task waiting list；And sound
Ying Yu monitor to have in the test resource group node server meet described execute requirement, select the node server, as
Node server for the test plan.
In one embodiment of the invention, the test plan and corresponding Test driver module are the master control services
Device is received from user side by network interface.
In one embodiment of the invention, the form of the test case include following in any one or more：Text
Part folder, compressed file bag, so files, data-base recording and database table.In one embodiment of the invention, the survey
The numerical value of example definition on probation also includes execution condition.
The method of testing of the present invention and driver and test platform, the concept based on driver model, it is achieved that test number
According to the separation with test logic, and whole test process service is improved by test process by distributed platform framework
Automaticity, it is achieved that to testing the standardized management and use of user, thus reduce test and participate in difficulty, so as to improve
Testing efficiency, and then reduce testing cost.
Description of the drawings
Disclosure illustrative embodiments are described in more detail by combining accompanying drawing, the disclosure above-mentioned and its
Its purpose, feature and advantage will be apparent from, wherein, in disclosure illustrative embodiments, identical reference number
Typically represent same parts.
Fig. 1 shows the structural frames of the testing service platform based on driver model according to an embodiment of the invention
Figure.
Fig. 2 shows the flow process of the method for testing of the test platform for shown in Fig. 1 according to an embodiment of the invention
Figure.
Fig. 3 shows the flow process that main control server according to an embodiment of the invention selects the process of node server
Figure.
Fig. 4 shows the structured flowchart of test driver according to an embodiment of the invention.
Fig. 5 shows the stream of the method for testing of the test driver for shown in Fig. 4 according to an embodiment of the invention
Cheng Tu.
Fig. 6 shows an instantiation of the test case according to the present invention and test driver.
Specific embodiment
The preferred implementation of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Preferred implementation, however, it is to be appreciated that may be realized in various forms the disclosure and the embodiment party that should do not illustrated here
Formula is limited.Conversely, these embodiments are provided so that the disclosure is more thorough and complete, and can be by the disclosure
Scope intactly conveys to those skilled in the art.
As it was previously stated, for the automaticity for lifting test process, reduce test case exploitation and use threshold, this
Bright method of testing and test system, based on the concept of driver model, realize the separation of test data and test logic, and lead to
Distributed platform architecture is crossed by whole test process service, the standardized management and use to testing user, drop is achieved in
Low test participates in difficulty, so as to improve testing efficiency, and then reduces testing cost.
Embodiments of the invention are specifically described below with reference to Fig. 1 to Fig. 6.Fig. 1 is showed according to the present invention one
The structured flowchart of the testing service platform 100 based on driver model of embodiment.As shown in figure 1, test platform 100 is adopted
The detached B/S frameworks in front and back end.Test assignment is created in user side (that is, Web ends) 101, such as establishment Test driver module,
Management of test cases, establishment and design test plan etc..The test assignment for creating is transmitted to service via network interface 103
Device end 105.Server end 105 executes the test assignment for receiving.It should be appreciated that the test platform architecture block diagram shown in Fig. 1 is only
The purpose of example, rather than limitation of the scope of the invention are only in order at.Those skilled in the art can as needed, increase or
Replace miscellaneous part.
Network interface 103 enables user side 101 with server end 105 via one or more network services.These
The example of network includes the group of the communication network of LAN (LAN), wide area network (WAN), Personal Area Network (PAN) or such as the Internet
Close.Network interface 103 can be included in wired or wireless any kind of network interface (for example, NIC (NIC))
One or more, such as 802.11 WLANs of IEEE (WLAN) wave point, worldwide interoperability for microwave accesses (Wi-MAX)
Interface, Ethernet interface, USB (universal serial bus) (USB) interface, cellular network interface, blue tooth interface, near-field communication (NFC) connect
Mouthful, etc..
Fig. 2 shows the method for testing 200 of the test platform 100 based on shown in Fig. 1 according to an embodiment of the invention
Flow chart.Below in conjunction with Fig. 1 and Fig. 2, the process of the testing service platform of the present invention is described.
As shown in figure 1, server end 105 adopts distributed structure/architecture, including main control server 110 and test resource pond 130,
Test resource pond 130 includes one or more node servers 1311 to 134m.Main control server 110 receives metadata, that is, use
Test plan and corresponding Test driver module (the step of Fig. 2 S210) in system under test (SUT).Generally, a test plan is corresponding
In one or more test cases.Then, main control server 110 is selected to be used for from test resource pond 130 according to pre-defined rule
The node server (the step of Fig. 2 S220) of received test plan.Finally, survey is executed on the node server that selectes
Trial is engaged in (the step of Fig. 2 S230).
Specifically, main control server 110 provides such as RESTful api interfaces, undertakes the additions and deletions to metadata and changes and looks into behaviour
Make, and be responsible for receiving the outside test assignment that submits to and, there is provided unified scheduling feature.
In one embodiment of the invention, as shown in figure 1, test resource pond can be divided into multiple test resources according to function
Group 131 to 134, each test resource group is made up of one or more above-mentioned node servers.For example, test resource group 131 can
To carry out performance test, and test resource group 132 can carry out functional test.It is pointed out that typically, each test
Each node server in resource group can be substituted for each other, but not necessarily physically be deployed in same position.
In practice, user specifies according to test plan generally when test assignment is submitted to and is executed by which resource group.
Fig. 3 shows the flow chart that main control server according to an embodiment of the invention selects the process 300 of node server.At this
In embodiment, main control server 110 is configured to, and according to received test plan, determines for executing the test plan
Test resource group (the step of Fig. 3 S321).For convenience of description, for example, for a certain test assignment, select shown in Fig. 1
Test resource group 133 is used as execution resource group.
Then, the whole node serves in step S323, in the test resource group 133 that the traversal of main control server 110 is selected
Device (being node server 1331,1332 and 1333 in this example), to determine the node serve of the execution requirement for meeting test plan
Device.It is assumed here that node server 1331 and 1332 meets executes requirement.Then, in step S325, requirement is executed from meeting
In node server, the node server of load minimum is selected, as the node server for the test plan.In this example
In, if node server 1331 is more idle than node server 1332, node server 1331 is selected as executing service
Device.Using the above embodiment of the present invention, the Optimum utilization of test resource can be realized.
Further, if determining the execution for temporarily not meeting test plan in test resource group 133 in step S323
The node server of requirement, then main control server 110 can be configured to by test plan be put into task waiting list (Fig. 2's
Step S327).Then, in response to monitoring that having node server to meet in test resource group 133 executes requirement, then master control service
Device 110 selects the node server, used as the node server (the step of Fig. 2 S329) for test plan.
Using above-mentioned distributed measuring system, it is achieved that the United Dispatching to test assignment, by by whole test process
Serviceization, allow test case management and using easily being used by more people, thus substantially reduce testing cost.
It is described in detail in below with reference to Fig. 4 and Fig. 5 on selected node server and how executes test assignment.In order to
Reduce the development cost of test case, the present invention has taken out the concept of test driver, has been achieved in test data and test
The separation of logic, by the program norm to test case so that be easy to carry out follow-up management and multiplexing to which.Test driver
The DLL that device can be provided according to the enforcement engine of nominative testing resource group, and with reference to the exploitation of specific business scenario
Into.Test driver finally on the node server that selectes is completed to run by enforcement engine, and need not be concerned about distributed scheduling
Concurrently operation etc. runs details.
Fig. 4 shows the structured flowchart of test driver according to an embodiment of the invention 400.Fig. 5 shows root
Flow chart according to the method for testing 500 based on the test driver 400 shown in Fig. 4 of one embodiment of the invention.It may be noted that
It is that the functional module of the test driver 400 shown in Fig. 4 can be by hardware, software or the hardware for realizing the principle of the invention and soft
Being implemented in combination in for part, for example, realized by the one or more modal processors in the test platform 100 shown in Fig. 1.This
Art personnel it is understood that the functional module described by Fig. 4 can combine or be divided into submodule, so as to
Realize the principle of foregoing invention.Therefore, description herein can support any possible group to functions described herein module
Close or divide or further limit.
As shown in figure 4, test driver 400 includes data load-on module 410 and test logic module 430.Step in Fig. 5
Rapid S510, data load-on module 410 is configured to parse the test case of system under test (SUT), by the text in test case
Data are converted to machine recognizable use-case object.For example, data load-on module 410 is configurable to test case definition
Numerical value gives use-case object.The numerical value of test case definition at least includes testing input value and desired output.Further, test
The numerical value of use-case definition can also include the execution condition of the test case.
It is pointed out that running through the application, so-called test case not only includes traditional functional test,
And be intended to code compilation, static check, unit testing, deployed environment, smoke test, performance test, stability test, flow
Duplication, contrast verification, compliance test result, Outliers mining, version issue etc. all test processs be all defined as test case.
The form of test case according to specific test scene can include following in any one or more：File,
Compressed file bag, so files, data-base recording, database table, etc..In the testing service platform 100 shown in Fig. 1,
Test case for same text data type can be re-used in multiple different test plans.One test plan
Multiple test cases can be included.Test driver can also be re-used in multiple test cases.
In the diagram, test logic module 430 is configured to the use-case object provided using data load-on module 410, according to pre-
Location survey examination logic is tested (the step of Fig. 5 S530) to system under test (SUT).Here presumptive test logic can be developer
Designed according to specific scene and business demand.In the present invention, executed on the distributed measuring system 100 of Fig. 1 is multiple
Different presumptive test logics are write using same designated mode.Test driver 400 is compiled by providing simple driver
Journey interface, enabling reduce the development cost of driver, realizes the standardized management to test case and test logic and multiple
With.
In one embodiment of the invention, test driver 400 alternatively also includes testing 470 He of logical design module
Test Sample Design module 490.Test logical design module 470 is configured to analyze according to demand, design presumptive test logic (figure
5 the step of S570).The step of Fig. 5 in S590, Test Sample Design module 490 is configured to the presumptive test that designs
Logic, test plan of the design for system under test (SUT), test plan can include one or more test cases.
In one embodiment of the invention, alternatively, test driver 400 can also include use-case setup module 450,
Which is configured to test case, arranges the use-case being associated with its executive mode and executes parameter (the step of Fig. 5 S550).Use-case
Execute any one or more during parameter is for example included but is not limited to below：Feature, such as number of concurrent, and sandbox are concurrently executed
Isolated execution feature.Test logic module 430 is configured to execute parameter according to use-case, according to above-mentioned presumptive test logic to tested
System is tested.
An instantiation according to test case of the invention and test driver is described below with reference to Fig. 6.?
In this example, constructed test case is defined using the type of organization of JSON (JavaScript Object Notation)
Test input value input and desired output expect two values.
Data load-on module in corresponding test driver by parsing the test case, by input and
Expect is assigned to use-case case objects, completes the conversion from text data to case objects.Enforcement engine is will be all of
After case objects are converted, can be transferred to execute in queue by all case objects, while providing the concurrently execution of each case
Isolate with sandbox so that not only can guarantee that operational efficiency but also can guarantee that and be mutually independent of each other between use-case.
In this example, test logic module can extract after case objects are received, first input therein and
Expect numerical value.Then, according to presumptive test logic, system under test (SUT) is accessed using input values and obtain actual test result.Connect
, actual test result is compared with desired output expect, whether the function so as to judge tested service is correct.
In sum, method of testing of the invention and driver and test platform, based on the concept of driver model, realize
Test data and the separation of test logic, and whole test process service is improved by survey by distributed platform framework
The automaticity of examination process, it is achieved that to testing the standardized management and use of user, thus reduce test and participate in difficulty,
So as to improve testing efficiency, and then reduce testing cost.
Additionally, the method according to the invention is also implemented as a kind of computer program, the computer program include for
Execute the computer program code instruction of the above steps limited in the said method of the present invention.Or, according to the present invention's
Method is also implemented as a kind of computer program, and the computer program includes computer-readable medium, in the meter
Be stored with calculation machine computer-readable recording medium for execute the present invention said method in limit above-mentioned functions computer program.Ability
Field technique personnel will also understand is that, in conjunction with the various illustrative logical blocks described by disclosure herein, module, circuit and algorithm
Step may be implemented as the combination of electronic hardware, computer software or both.
Flow chart and block diagram in accompanying drawing shows the possibility reality of the system and method for the multiple embodiments according to the present invention
Existing architectural framework, function and operation.At this point, each square frame in flow chart or block diagram can represent module, a journey
Sequence section or a part for code, the part of the module, program segment or code is comprising one or more for realizing regulation
The executable instruction of logic function.It should also be noted that in some are as the realization that replaces, in square frame, the function of institute's labelling also may be used
To occur with the order for being different from institute's labelling in accompanying drawing.For example, two continuous square frames can essentially be executed substantially in parallel,
They can also be executed sometimes in the opposite order, and this is depending on involved function.It is also noted that block diagram and/or stream
The combination of each square frame and block diagram and/or the square frame in flow chart in journey figure, can use function or the operation for executing regulation
Special hardware based system realizing, or can combine to realize with specialized hardware and computer instruction.
It is described above various embodiments of the present invention, described above is exemplary, and non-exclusive, and
It is not limited to disclosed each embodiment.In the case of the scope and spirit without departing from illustrated each embodiment, for this skill
For the those of ordinary skill in art field, many modifications and changes will be apparent from.The selection of term used herein, purport
Best explain the principle of each embodiment, practical application or to market in technology improvement, or make the art
Other those of ordinary skill are understood that each embodiment disclosed herein.
Claims (26)
1. a kind of test driver, including：
Data load-on module, is configured to parse the test case of system under test (SUT), by the number of the test case definition
Value gives use-case object, and the numerical value of wherein described test case definition at least includes testing input value and desired output；With
Test logic module, is configured to the use-case object provided using the data load-on module, is patrolled according to presumptive test
Collect and the system under test (SUT) is tested.
2. test driver according to claim 1, also includes：
Use-case setup module, is configured to the test case, and setting is associated with the executive mode of the test case
Use-case executes parameter, wherein,
The test logic module is configured to execute parameter according to the use-case, according to the presumptive test logic to described tested
System is tested.
3. test driver according to claim 2, wherein, the use-case execute parameter include following in any one or
Multiple：Feature and sandbox isolated execution feature are concurrently executed.
4. test driver according to any one of claim 1 to 3, also includes：
Test logical design module, is configured to analyze according to demand, designs the presumptive test logic；With
Test Sample Design module, is configured to the presumptive test logic, tester of the design for the system under test (SUT)
Draw, the test plan corresponds to one or more test cases.
5. test driver according to claim 4, wherein, a test case is in multiple different testers
Multiplexing in drawing.
6. a kind of method of testing, including：
The test case of system under test (SUT) is parsed, and use-case object is given by the numerical value of the test case definition, wherein
The numerical value of the test case definition at least includes testing input value and desired output；With
Using the use-case object, the system under test (SUT) is tested according to presumptive test logic.
7. method of testing according to claim 6, also includes：
For the test case, the use-case being associated with the executive mode of the test case is set and executes parameter, wherein,
Parameter is executed according to the use-case, the system under test (SUT) is tested according to the presumptive test logic.
8. method of testing according to claim 7, wherein, the use-case execute parameter include following in any one or many
Individual：Feature and sandbox isolated execution feature are concurrently executed.
9. the method for testing according to any one of claim 6 to 8, also includes：
Analyze according to demand, design the presumptive test logic；With
Based on the presumptive test logic, test plan of the design for the system under test (SUT), the test plan correspond to one
Individual or multiple test cases.
10. method of testing according to claim 9, wherein, a test case is in multiple different testers
Multiplexing in drawing.
A kind of 11. distributed measuring systems, including：
Main control server, the main control server receive the test plan and corresponding Test driver module for system under test (SUT),
The test plan corresponds to one or more test cases, and wherein described Test driver module includes data loading unit and survey
Examination logical block；
Test resource pond, the test resource pond include one or more node servers,
Wherein, the main control server is configured to, and according to pre-defined rule, is selected for being received from the test resource pond
The node server of the test plan for arriving, also,
Wherein, selected node server is configured to：
Using the data loading unit of the Test driver module, the test case is parsed, the test is used
The numerical value of example definition gives use-case object, and the numerical value of wherein described test case definition at least includes testing input value and expects defeated
Go out value；With
According to the presumptive test logic in the test logical block, the system under test (SUT) is surveyed using the use-case object
Examination.
12. test platforms according to claim 11, wherein, the node server is additionally configured to：
For the test case, the use-case being associated with the executive mode of the test case is set and executes parameter；With
Parameter is executed according to the use-case, according to the presumptive test logic, using the use-case object to the system under test (SUT)
Tested.
13. test platforms according to claim 12, wherein, the use-case execute parameter include following in any one or
Multiple：Feature and sandbox isolated execution feature are concurrently executed.
14. test platforms according to any one of claim 11 to 13, wherein,
The presumptive test logic is to analyze according to demand and design；And
The test plan is designed based on the presumptive test logic.
15. test platforms according to claim 14, wherein, a test case is in multiple different testers
Multiplexing in drawing, and/or,
One Test driver module is multiplexed in multiple different test cases.
16. test platforms according to any one of claim 11 to 13, wherein, the test resource pond includes multiple
Test resource group, each described test resource group are made up of one or more node servers,
Wherein, the main control server is configured to：
According to the test plan for being received, determine for executing the test resource group of the test plan；
Whole node servers in test resource group determined by traversal, to determine the execution requirement for meeting the test plan
Node server；And
From the node server for meeting in the node server for executing and requiring, selecting load minimum, as institute
State the node server of test plan.
17. test platforms according to claim 16, wherein, the main control server is configured to：
The node server for executing and requiring is not met in the test resource group for the test plan is determined
In the case of, the test plan is put into task waiting list；With
In response to monitor to have in the test resource group node server meet described execute requirement, select the node serve
Device, used as the node server for the test plan.
18. test platforms according to claim 16, wherein, the test plan and corresponding Test driver module are institutes
State what main control server was received from user side by network interface.
A kind of 19. distributed test methods, including：
By the main control server of distributed measuring system, test plan and the corresponding Test driver for system under test (SUT) is received
Module, the test plan correspond to one or more test cases, and wherein described Test driver module includes that data loading is single
Unit and test logical block；
The main control server is selected for being connect from the test resource pond of the distributed measuring system according to pre-defined rule
The node server of the test plan for receiving, wherein, the test resource pond includes one or more node servers；
On selected node server, using the data loading unit of the Test driver module, the test case is entered
The numerical value of the test case definition is given use-case object by row parsing, and the numerical value of wherein described test case definition is at least
Including testing input value and desired output；And
On selected node server, according to the presumptive test logic in the test logical block, using the use-case pair
As testing to the system under test (SUT).
20. method of testings according to claim 19, wherein, described on selected node server according to the test
Presumptive test logic in logical block carries out test using the use-case object to the system under test (SUT) to be included：
For the test case, the use-case being associated with the executive mode of the test case is set and executes parameter；With
Parameter is executed according to the use-case, according to the presumptive test logic, using the use-case object to the system under test (SUT)
Tested.
21. method of testings according to claim 20, wherein, the use-case execute parameter include following in any one or
Multiple：Feature and sandbox isolated execution feature are concurrently executed.
22. method of testings according to any one of claim 19 to 21, wherein,
The presumptive test logic is to analyze according to demand and design；And
The test plan is designed based on the presumptive test logic.
23. method of testings according to claim 22, wherein, a test case is in multiple different testers
Multiplexing in drawing, and/or,
One Test driver module is multiplexed in multiple different test cases.
24. method of testings according to any one of claim 19 to 21, wherein, the survey of the distributed measuring system
Examination resource pool includes multiple test resource groups, and each described test resource group is made up of one or more node servers,
Wherein, the main control server is selected to be used for from the test resource pond of the distributed measuring system according to pre-defined rule
The node server of received test plan includes：
According to received test plan, determine for executing the test resource group of the test plan；
Whole node servers in test resource group determined by traversal, to determine the execution requirement for meeting the test plan
Node server；And
From the node server for meeting in the node server for executing and requiring, selecting load minimum, as institute
State the node server of test plan.
25. method of testings according to claim 24, wherein, the section for selecting load minimum in the test resource group
Point server also includes as the node server for the test plan：
The node server for executing and requiring is not met in the test resource group for the test plan is determined
In the case of, the test plan is put into task waiting list；With
In response to monitor to have in the test resource group node server meet described execute requirement, select the node serve
Device, used as the node server for the test plan.
26. method of testings according to claim 24, wherein, the test plan and corresponding Test driver module are institutes
State what main control server was received from user side by network interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610934302.5A CN106502898A (en) | 2016-10-25 | 2016-10-25 | Method of testing and test driver and test platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610934302.5A CN106502898A (en) | 2016-10-25 | 2016-10-25 | Method of testing and test driver and test platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106502898A true CN106502898A (en) | 2017-03-15 |
Family
ID=58320046
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610934302.5A Pending CN106502898A (en) | 2016-10-25 | 2016-10-25 | Method of testing and test driver and test platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106502898A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108268379A (en) * | 2018-02-02 | 2018-07-10 | 方欣科技有限公司 | A kind of distributed automatization test method and device |
| CN109240935A (en) * | 2018-10-11 | 2019-01-18 | 上海哔哩哔哩科技有限公司 | A kind of mobile phone games automated testing method, device and the storage medium of compatibility |
| CN109408381A (en) * | 2018-10-10 | 2019-03-01 | 四川新网银行股份有限公司 | A kind of product data automatic Verification platform and method based on data check template |
| CN109817273A (en) * | 2019-02-12 | 2019-05-28 | 记忆科技(深圳)有限公司 | A kind of NAND performance test methods and its system |
| CN110347433A (en) * | 2018-04-03 | 2019-10-18 | 京东方科技集团股份有限公司 | Method for parameter configuration, device and display device |
| CN110765009A (en) * | 2019-10-10 | 2020-02-07 | 南京创维信息技术研究院有限公司 | Automatic AI voice software testing framework of carrying out |
| CN111209216A (en) * | 2020-03-11 | 2020-05-29 | 山东汇贸电子口岸有限公司 | Distributed test framework based on plug-in and test method |
| CN111444102A (en) * | 2020-03-30 | 2020-07-24 | 吉林大学 | Method and system for testing off-line computing engine |
| CN111459815A (en) * | 2020-03-30 | 2020-07-28 | 吉林大学 | Real-time computing engine testing method and system |
| CN114090464A (en) * | 2022-01-24 | 2022-02-25 | 中国民航信息网络股份有限公司 | JSON format test case updating method and related device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1877543A (en) * | 2005-06-06 | 2006-12-13 | 华为技术有限公司 | Data-driven automatic testing system and method |
| CN101162426A (en) * | 2007-11-15 | 2008-04-16 | 中兴通讯股份有限公司 | Example design test method for testing based on data driving and automatically testing platform |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN103209180A (en) * | 2013-03-21 | 2013-07-17 | 大唐联仪科技有限公司 | Protocol conformance testing method and system |
| CN103441900A (en) * | 2013-08-27 | 2013-12-11 | 上海新炬网络技术有限公司 | Centralization cross-platform automated testing system and control method thereof |
-
2016
- 2016-10-25 CN CN201610934302.5A patent/CN106502898A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1877543A (en) * | 2005-06-06 | 2006-12-13 | 华为技术有限公司 | Data-driven automatic testing system and method |
| CN101162426A (en) * | 2007-11-15 | 2008-04-16 | 中兴通讯股份有限公司 | Example design test method for testing based on data driving and automatically testing platform |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN103209180A (en) * | 2013-03-21 | 2013-07-17 | 大唐联仪科技有限公司 | Protocol conformance testing method and system |
| CN103441900A (en) * | 2013-08-27 | 2013-12-11 | 上海新炬网络技术有限公司 | Centralization cross-platform automated testing system and control method thereof |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108268379A (en) * | 2018-02-02 | 2018-07-10 | 方欣科技有限公司 | A kind of distributed automatization test method and device |
| CN108268379B (en) * | 2018-02-02 | 2020-01-03 | 方欣科技有限公司 | Distributed automatic testing method and device |
| CN110347433A (en) * | 2018-04-03 | 2019-10-18 | 京东方科技集团股份有限公司 | Method for parameter configuration, device and display device |
| CN109408381A (en) * | 2018-10-10 | 2019-03-01 | 四川新网银行股份有限公司 | A kind of product data automatic Verification platform and method based on data check template |
| CN109240935A (en) * | 2018-10-11 | 2019-01-18 | 上海哔哩哔哩科技有限公司 | A kind of mobile phone games automated testing method, device and the storage medium of compatibility |
| CN109817273A (en) * | 2019-02-12 | 2019-05-28 | 记忆科技(深圳)有限公司 | A kind of NAND performance test methods and its system |
| CN110765009A (en) * | 2019-10-10 | 2020-02-07 | 南京创维信息技术研究院有限公司 | Automatic AI voice software testing framework of carrying out |
| CN110765009B (en) * | 2019-10-10 | 2023-09-05 | 南京创维信息技术研究院有限公司 | Automatic AI voice software test frame of execution |
| CN111209216A (en) * | 2020-03-11 | 2020-05-29 | 山东汇贸电子口岸有限公司 | Distributed test framework based on plug-in and test method |
| CN111444102A (en) * | 2020-03-30 | 2020-07-24 | 吉林大学 | Method and system for testing off-line computing engine |
| CN111459815A (en) * | 2020-03-30 | 2020-07-28 | 吉林大学 | Real-time computing engine testing method and system |
| CN111459815B (en) * | 2020-03-30 | 2022-06-14 | 吉林大学 | Real-time computing engine testing method and system |
| CN114090464A (en) * | 2022-01-24 | 2022-02-25 | 中国民航信息网络股份有限公司 | JSON format test case updating method and related device |
| CN114090464B (en) * | 2022-01-24 | 2022-04-26 | 中国民航信息网络股份有限公司 | JSON format test case updating method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106502898A (en) | Method of testing and test driver and test platform | |
| CN104679488B (en) | A kind of flow custom development platform and flow custom development approach | |
| US9507374B1 (en) | Selecting most compatible synchronization strategy to synchronize data streams generated by two devices | |
| CN109726132A (en) | A kind of method for testing software and software test automation management system | |
| Kerbrat et al. | Automated test generation from SDL specifications | |
| CN104750603B (en) | A kind of multi-core DSP software simulator and its physical layer software test method | |
| CN103984612B (en) | A kind of method of the unattended pressure test based on HPL instruments | |
| CN108958736A (en) | Page generation method, device, electronic equipment and computer-readable medium | |
| CN106339312A (en) | API (application programming interface) testing method and system | |
| CN110334021A (en) | Generation method, device, equipment and the storage medium of interface testing case | |
| CN104919445B (en) | Transformation generation system | |
| CN110377520A (en) | The test method and device, electronic equipment and readable storage medium storing program for executing for scene of trading | |
| CN106547681A (en) | The method and apparatus that data load simultaneously multiplexed analog service testing automatically | |
| CN108255707A (en) | Development roles creation method, device, equipment and the storage medium of test case | |
| CN108388515A (en) | Test data generating method, device, equipment and computer readable storage medium | |
| CN115129304A (en) | Zero-code-platform-based visual business service arrangement method and device | |
| CN109977012B (en) | Joint debugging test method, device, equipment and computer readable storage medium of system | |
| CN110297760A (en) | Building method, device, equipment and the computer readable storage medium of test data | |
| CN110083535A (en) | A kind of method for testing software and device | |
| CN103605606A (en) | Embedded software test case batch execution method capable of being automatically convertible | |
| CN108363660B (en) | Test program generation method and device | |
| CN108897695A (en) | A kind of the interconnection test method and system of demand side apparatus | |
| CN117235527A (en) | End-to-end containerized big data model construction method, device, equipment and medium | |
| CN112306850B (en) | Test case generation method, device and storage medium | |
| CN112817851A (en) | Service testing method, device, equipment, medium and computer program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170315 |