CN109977005A

CN109977005A - End-to-end test method, medium, device and calculating equipment

Info

Publication number: CN109977005A
Application number: CN201910113279.7A
Authority: CN
Inventors: 张焱
Original assignee: Netease Hangzhou Network Co Ltd
Current assignee: Hangzhou Netease Shuzhifan Technology Co ltd
Priority date: 2019-02-13
Filing date: 2019-02-13
Publication date: 2019-07-05
Anticipated expiration: 2039-02-13
Also published as: CN109977005B

Abstract

Embodiments of the present invention provide a kind of end-to-end test method, it include: the test claim information for obtaining test item, wherein the test claim information includes: the related information in multiple test nodes that test item is included between the parameter information and the multiple test node of each test node；Based on the test claim information, the candidate test node set of each test node and each test node is determined；Candidate test node set based on each test node and each test node constructs test trails figure, wherein the test trails figure includes a plurality of test trails for characterizing the cycle tests of the multiple test node；And it is based on the test trails figure, test operation corresponding with the multiple test node is executed, so that being traversed in the multiple test node from initial testing node to test node is terminated.Embodiments of the present invention additionally provide a kind of end-to-end test device, medium and calculate equipment.

Description

End-to-end test method, medium, device and calculating equipment

Technical field

Embodiments of the present invention are related to field of computer technology, arrive more specifically, embodiments of the present invention are related to end It holds test method, medium, device and calculates equipment.

Background technique

Background that this section is intended to provide an explanation of the embodiments of the present invention set forth in the claims or context.Herein Description recognizes it is the prior art not because not being included in this section.

Whether end-to-end test is consistent with original design intention for testing the process of a project from first to last.For example, one Using including multiple interfaces, the end-to-end test to the application is the survey of all combine scenes for the interface for being included to the application Examination.In the prior art, need to write multiple test cases, each test case characterizes the one kind for the interface that the application is included Combine scenes, the number of test case are equal to the total number of all combine scenes for the interface that the application is included.It is more writing After a test case, then it is based respectively on the test that each test case carries out each combine scenes.

As can be seen that existing end-to-end test scheme be substantially repeatedly for it is static, only cover single-pathway The test of test case, due to the complexity of end-to-end test scene, multiple test cases write and safeguard that needs are paid greatly The work of amount, inefficiency.

Summary of the invention

Thus, it is also very desirable to a kind of improved end-to-end test method, to improve end-to-end test efficiency.

In the present context, embodiments of the present invention are intended to provide a kind of end-to-end test method and apparatus.

In the first aspect of embodiment of the present invention, a kind of end-to-end test method is provided, comprising: obtain test item Purpose tests claim information, wherein the test item includes multiple test nodes, the test claim information packet of the test item It includes: the related information in the multiple test node between the parameter information of each test node and the multiple test node； Based on above-mentioned test claim information, each test node in the multiple test node and each test node are determined Candidate test node set；Candidate test node set based on above-mentioned each test node and each test node, building Test trails figure, the test trails figure include a plurality of test trails for characterizing the cycle tests of the multiple test node；And Based on a plurality of test trails in the test trails figure, test operation corresponding with the multiple test node is executed, so that institute It states in multiple test nodes and is traversed from initial testing node to test node is terminated.

In one embodiment of the invention, above-mentioned test claim information includes: to each in the multiple test node The first annotating data that the parameter information of test node is described and to the related information between the multiple test node into Second annotating data of row description.It is above-mentioned to be based on the test claim information, determine each test in the multiple test node The candidate test node set of node and each test node includes: to identify first annotating data, described in acquisition The parameter information of each test node in multiple test nodes；It identifies second annotating data, obtains the multiple test section Related information between point；And information and the related information based on the parameter, determine each test node and The neighboring candidate test node set of each test node.It is above-mentioned to be saved based on each test node and each test The candidate test set of point, building test trails figure include: for the multiple test node, by test node will it is described often A test node is connect with the neighboring candidate test node of each test node, obtains the test trails figure.

In another embodiment of the invention, the above-mentioned a plurality of test trails based in the test trails figure, execute with The corresponding test operation of the multiple test node includes: according to a plurality of test trails in the test trails figure, by test Execute to node test operation corresponding with the test node.Wherein, above-mentioned by test node execute is saved with the test The corresponding test operation of point includes: directly to execute when the test node is the initial testing node of the test trails figure Test operation corresponding with the test node, obtain initial testing as a result, according to the test trails figure from the test Determine another test node in the connected candidate test node of node, and based on the initial testing result execute with it is described another The corresponding test operation of test node；When the test node is the intermediate test node of the test trails figure, before being based on The test result of one test node executes test operation corresponding with the test node, the first test result is obtained, according to institute It states test trails figure and determines another test node from the candidate test node being connected with the test node, and based on described the One test result executes test operation corresponding with another test node；And when the test node is the test When the end test node of trajectory diagram, the test result based on previous test node executes test corresponding with the test node Operation, to obtain the second test result.

It is above-mentioned by test node to execute test behaviour corresponding with the test node in another embodiment of the present invention Make further include: if the test result of the test node does not meet preset condition, output indicates that the test node test is lost The warning message lost by test node executes and the survey since the initial testing node in the test trails figure again Try the corresponding test operation of node.

In one more embodiment of the present invention, the candidate test node of above-mentioned each test node and each test node Set includes the associated weights between each test node and the candidate test node of each test node, the survey Examination trajectory diagram also characterizes the associated weights between connected test node.Then it is above-mentioned according to the test trails figure from the survey Determine that another test node includes: according to each candidate being connected with the test node in the connected candidate test node of examination node Associated weights between test node and the test node are determined from each candidate test node being connected with the test node Another test node.

In the second aspect of embodiment of the present invention, a kind of end-to-end test device is provided, comprising: acquisition module, Determining module, building module and test module.Obtain the test claim information that module is used to obtain test item, wherein described Test item includes multiple test nodes, and the test claim information includes: each test node in the multiple test node Parameter information and the multiple test node between related information.Determining module is used to be based on the test claim information, Determine the candidate test node set of each test node and each test node in the multiple test node.Building Module is used for the candidate test node set based on each test node and each test node, constructs test rail Mark figure, wherein the test trails figure includes a plurality of test trails for characterizing the cycle tests of the multiple test node.And Test module is used to execute survey corresponding with the multiple test node based on a plurality of test trails in the test trails figure Examination operation, so that being traversed in the multiple test node from initial testing node to test node is terminated.

In one embodiment of the invention, above-mentioned test claim information includes: to each in the multiple test node The first annotating data that the parameter information of test node is described and to the related information between the multiple test node into Second annotating data of row description.Determining module includes the first identification submodule, the second identification submodule and determines submodule.The One identifies submodule first annotating data for identification, obtains the parameter of each test node in the multiple test node Information.Second identification submodule for identification believe by second annotating data, the association obtained between the multiple test node Breath.And determine submodule for information and the related information based on the parameter, determine each test node and The neighboring candidate test node set of each test node.Module is constructed to be specifically used for being directed to the multiple test node, Each test node is connect with the neighboring candidate test node of each test node by test node, obtains institute State test trails figure.

In another embodiment of the invention, test module is specifically used for according to a plurality of test in the test trails figure Track by test node executes test operation corresponding with the test node.Wherein, test module includes: execution submodule Block and decision submodule.Implementation sub-module is used for when the test node is the initial testing node of the test trails figure, Test operation corresponding with the test node is directly executed, initial testing result is obtained；For being institute when the test node When stating the intermediate test node of test trails figure, the test result based on previous test node executes corresponding with the test node Test operation, obtain the first test result；And for being tested when the end that the test node is the test trails figure When node, the test result based on previous test node executes test operation corresponding with the test node, obtains second and surveys Test result.Decision submodule is used for true from the candidate test node being connected with the test node according to the test trails figure Fixed another test node.And implementation sub-module is also used to hold based on the initial testing result or first test result Capable test operation corresponding with another test node.

In another embodiment of the present invention, test module further includes exception response submodule, for saving when the test When the test result of point does not meet preset condition, output indicates the warning message of the test node test crash, again from institute The initial testing node in test trails figure is stated to start by test node to execute test operation corresponding with the test node.

In one more embodiment of the present invention, the candidate test of each test node and each test node Node set includes the associated weights between each test node and the candidate test node of each test node, institute It states test trails figure and also characterizes associated weights between connected test node.Decision submodule is used to save according to the test Associated weights between the point each candidate test node being connected and the test node, from each candidate being connected with the test node Another test node is determined in test node.

In the third aspect of embodiment of the present invention, a kind of medium is provided, computer executable instructions are stored with, is referred to It enables when being executed by processor for realizing end-to-end test method described in any one of above-described embodiment.

In the fourth aspect of embodiment of the present invention, provide a kind of calculating equipment, comprising: memory, processor and Store the executable instruction that can be run on a memory and on a processor, realization when processor executes instruction: above-described embodiment Any one of described in end-to-end test method.

The end-to-end test method and apparatus of embodiment according to the present invention, building include that characterization test project is included The test trails figure of a plurality of test trails of the cycle tests of multiple test nodes, using the test trails figure as end-to-end test Unique test case in scene, the test case be it is dynamic, introduce probabilistic, end-to-end checkout area can be covered All test paths in scape.Greatly reduce test case in this way writes cost and maintenance cost, improves end-to-end Test case write and maintenance efficiency, improve end-to-end test efficiency.

Detailed description of the invention

The following detailed description is read with reference to the accompanying drawings, above-mentioned and other mesh of exemplary embodiment of the invention , feature and advantage will become prone to understand.In the accompanying drawings, if showing by way of example rather than limitation of the invention Dry embodiment, in which:

Fig. 1 schematically shows the applied field of the end-to-end test method and device thereof of embodiment according to the present invention Scape；

Fig. 2 schematically shows the flow charts of end-to-end test method according to an embodiment of the invention；

Fig. 3 A schematically shows multiple test nodes of a test item according to an embodiment of the invention Schematic diagram；

Fig. 3 B schematically shows the schematic diagram of test trails figure according to an embodiment of the invention；

Fig. 3 C schematically shows the partial log signal of building test trails figure according to an embodiment of the invention Figure；

Fig. 4 A schematically shows the partial code schematic diagram of user's announce step according to an embodiment of the invention；

Fig. 4 B schematically shows the partial code schematic diagram that user according to an embodiment of the invention states decision；

Fig. 4 C schematically shows the partial code schematic diagram according to an embodiment of the invention for executing a step；

Fig. 4 D schematically shows the partial log signal according to an embodiment of the invention for executing end-to-end test Figure；

Fig. 5 schematically shows the block diagram of end-to-end test device according to an embodiment of the invention；

Fig. 6 schematically shows the block diagram of end-to-end test device in accordance with another embodiment of the present invention；

Fig. 7 schematically shows the schematic diagram of the computer readable storage medium product of embodiment according to the present invention； And

Fig. 8 schematically shows the block diagram of the calculating equipment of embodiment according to the present invention.

In the accompanying drawings, identical or corresponding label indicates identical or corresponding part.

Specific embodiment

The principle and spirit of the invention are described below with reference to several illustrative embodiments.It should be appreciated that providing this A little embodiments are used for the purpose of making those skilled in the art can better understand that realizing the present invention in turn, and be not with any Mode limits the scope of the invention.On the contrary, these embodiments are provided so that this disclosure will be more thorough and complete, and energy It is enough that the scope of the present disclosure is completely communicated to those skilled in the art.

One skilled in the art will appreciate that embodiments of the present invention can be implemented as a kind of system, device, equipment, method Or computer program product.Therefore, the present disclosure may be embodied in the following forms, it may be assumed that complete hardware, complete software The form that (including firmware, resident software, microcode etc.) or hardware and software combine.

Embodiment according to the present invention proposes a kind of end-to-end test method, medium, device and calculates equipment.

Herein, it is to be understood that related term includes: that end-to-end (end-to-end) test is a kind of survey Method for testing, it is whether consistent with original design intention for testing the process of a project from first to last.It is to use from the angle of user The test method of all combine scenes of user is exposed in test item.The each test node for including in test item is end To the atomic operation of end test execution, the step (step) that can be analogous to tester's execution issues and holds such as calling interface Travel far and wide this, execute the operation of link detecting etc..Test claim information refers to the test that the user with testing requirement is stated The relevant information of project, the related information etc. between the parameter information of the test node for being included such as test item, test node. Test trails (track) refer to the set for constituting the test node of an End-to-end behavior, and test trails figure includes a plurality of test Track.In addition, any number of elements in attached drawing is used to example rather than limitation and any name are only used for distinguishing, and Without any restrictions meaning.

Below with reference to several representative embodiments of the invention, the principle and spirit of the present invention are explained in detail.

Summary of the invention

During realizing disclosure design, inventors have found that existing end-to-end test scheme is substantially multiple For it is static, only cover single-pathway test case test, due to the complexity of end-to-end test scene, multiple tests Use-case write and maintenance needs to pay a large amount of work, inefficiency.

For this purpose, the embodiment of the invention provides a kind of end-to-end test method and apparatus, this method comprises: obtaining test item Purpose tests claim information, wherein the test item includes multiple test nodes, and the test claim information includes: described Related information in multiple test nodes between the parameter information of each test node and the multiple test node；Based on described Claim information is tested, determines the candidate test of each test node and each test node in the multiple test node Node set；Candidate test node set based on each test node and each test node, building test Trajectory diagram, wherein the test trails figure includes a plurality of test trails for characterizing the cycle tests of the multiple test node；With And based on a plurality of test trails in the test trails figure, test operation corresponding with the multiple test node is executed, is made It obtains in the multiple test node and is traversed from initial testing node to test node is terminated.This programme building includes that characterization is surveyed The test trails figure of a plurality of test trails of the cycle tests for multiple test nodes that examination project is included, by the test trails figure As unique test case in end-to-end test scene, the test case be it is dynamic, introduce probabilistic, can cover All test paths in lid end-to-end test scene.Greatly reduce in this way test case write cost and maintenance at This, improve end-to-end test use-case write and maintenance efficiency, improve end-to-end test efficiency.

After introduced the basic principles of the present invention, lower mask body introduces various non-limiting embodiment party of the invention Formula.

Application scenarios overview

The application scenarios of the end-to-end test method and device thereof of the embodiment of the present invention are elaborated referring initially to Fig. 1.

Fig. 1 schematically shows the applied field of the end-to-end test method and device thereof of embodiment according to the present invention Scape may include terminal device 101,102,103, network 104 and server 105 in application scenarios shown in Fig. 1.

Network 104 between terminal device 101,102,103 and server 105 to provide the medium of communication link.Net Network 104 may include various connection types, such as wired, wireless communication link or fiber optic cables etc..

User can be used terminal device 101,102,103 and be interacted by network 104 with server 105, to receive or send out Send message etc..Various client applications, such as test class application, shopping class can be installed on terminal device 101,102,103 (only show using, web browser applications, searching class application, instant messaging tools, mailbox client, social platform software etc. Example).

Terminal device 101,102,103 can be the various electronic equipments with display screen and supported web page browsing, packet Include but be not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..

Server 105 can be to provide the server of various services, such as utilize terminal device 101,102,103 to user The website browsed provides the back-stage management server (merely illustrative) supported.Back-stage management server can be to the use received The data such as family request analyze etc. processing, and by processing result (such as according to user's request or the webpage of generation, believe Breath or data etc.) feed back to terminal device.

It should be noted that end-to-end test method provided by the embodiment of the present disclosure can generally be held by server 105 Row.Correspondingly, end-to-end test device provided by the embodiment of the present disclosure generally can be set in server 105.The disclosure End-to-end test method provided by embodiment can also by be different from server 105 and can with terminal device 101,102, 103 and/or server 105 communicate server or server cluster execute.Correspondingly, end provided by the embodiment of the present disclosure is arrived End test device also can be set in being different from server 105 and can be with terminal device 101,102,103 and/or server In the server or server cluster of 105 communications.

And/or end-to-end test method provided by the embodiment of the present disclosure can also by terminal device 101,102, One or more execution in 103.Correspondingly, end-to-end test device provided by the embodiment of the present disclosure also can be set in end In one or more of end equipment 101,102,103.

It should be understood that the number of terminal device, network and server in Fig. 1 is only schematical.According to realization need It wants, can have any number of terminal device, network and server.

Illustrative methods

Below with reference to the application scenarios of Fig. 1, the end of illustrative embodiments according to the present invention is described with reference to Fig. 2~Fig. 4 D To end test method.It should be noted that above-mentioned application scenarios are merely for convenience of understanding spirit and principles of the present invention and showing Out, embodiments of the present invention are not limited in this respect.On the contrary, embodiments of the present invention can be applied to it is applicable Any scene.

Fig. 2 schematically shows the flow charts of end-to-end test method according to an embodiment of the invention.Such as Fig. 2 institute Show, this method includes following operation:

In operation S201, the test claim information of test item is obtained.

Wherein, the test item includes multiple test nodes, and the test claim information includes: the multiple test section Related information in point between the parameter information of each test node and the multiple test node.

For example, Fig. 3 A schematically shows multiple test sections of a test item according to an embodiment of the invention The schematic diagram of point.

As shown in Figure 3A, a test item includes 5 test nodes (1~test node of test node 5), this 5 surveys Examination node constitutes the complete end-to-end test scene of the test item.Letter is stated in the test that this operation obtains the test item Breath, which includes: the parameter information and test node of each test node in 1~test node of test node 5 Between related information.

Then, in operation S202, it is based on the test claim information, determines each test section in the multiple test node The candidate test node set of point and each test node.

Example shown in Fig. 3 A is returned to, test claim information of this operation based on test item determines test node 1, surveys The candidate test node collection of examination node 1 is combined into { test node 2, test node 3 }；Determine test node 2, the time of test node 2 Test node collection is selected to be combined into { test node 3, test node 4, test node 5 }；Determine test node 3, the candidate of test node 3 Test node collection is combined into { test node 4, test node 5 }；Determine test node 4, the candidate test node set of test node 4 For { test node 5 }.It indicates in the end-to-end test scene corresponding to the test item, test corresponding with test node 1 After operation executes, test operation corresponding with test node 2 or test node 3, test corresponding with test node 2 can be executed After operation executes, test operation corresponding with test node 3, test node 4 or test node 5 can be executed, with test node 3 After corresponding test operation executes, test operation corresponding with test node 4 or test node 5 can be executed, with test node 4 After corresponding test operation executes, test operation corresponding with test node 5 can be executed.Based on this principle, it is known that with The corresponding test operation of each test node execute after next-hop test node, all next-hops test of each test node Node constitutes the candidate test node set of the test node.

Then, in operation S203, the candidate test section based on each test node and each test node Point set constructs test trails figure.

Wherein, the test trails figure includes a plurality of test trails for characterizing the cycle tests of the multiple test node.

Turn again to example shown in Fig. 3 A, this operation each test section in determining 1~test node of test node 10 After the candidate test node set of point and each test node, a plurality of cycle tests can be formed.

First cycle tests: 3 → test node of test node 1 → test node, 2 → test node 5.Second test Sequence: 1 → test node of test node, 3 → test node 5.Third cycle tests: 1 → test node of test node 2 → survey Try 4 → test node of node 5.4th cycle tests: 3 → test node of test node 1 → test node, 2 → test node 4 → test node 5.5th cycle tests: 4 → test node of test node 1 → test node, 3 → test node 5.

Above five cycle tests can be characterized with five test trails respectively, this operation building includes this five tests The test trails figure of track.

And it is executed and the multiple test in operation S204 based on a plurality of test trails in the test trails figure The corresponding test operation of node so that in the multiple test node from initial testing node to terminate test node by time It goes through.

Turn again to example shown in Fig. 3 A, five based on the phenogram 3A in constructed test trails figure of this operation Five test trails of cycle tests successively execute test behaviour corresponding with test node each in 1~test node of test node 5 Make.

As it can be seen that method shown in Fig. 2 determines that the test item is included more based on the test claim information of test item Each test node and its candidate test node set in a test node, and then construct comprising characterization about above-mentioned multiple tests The test trails figure of all cycle tests of node, based on the test trails figure can dynamic operation end to hold testing scheme, with time It goes through in test item from initial testing node to each test node terminated in test node, completes end-to-end test.

For example, a test item is load balancing project, which includes 8 business interfaces (“createLoadbalance”、“createTarget”、“updateTarget”、“deleteTarget”、 " getLoadbalance ", " deleteLoadbalance ", " createListener " and " deleteListener "), Corresponding to 8 test nodes (test node title is identical as business interface title).The test claim information packet of the test item It includes: the related information in above-mentioned 8 test nodes between the parameter information and 8 test nodes of each test node.

According to method shown in Fig. 2, the parameter of each test node in the test claim information based on the test item Related information between information and test node can determine test node " createLoadbalance ", test node " createTarget ", test node " updateTarget ", test node " deleteTarget ", test node " getLoadbalance ", test node " deleteLoadbalance ", test node " createListener " and test section Point " deleteListener ".

And the candidate test node collection of test node " createLoadbalance " is combined into test node " createTarget " and test node " getLoadbalance ", the candidate test node of test node " createTarget " Collection is combined into test node " updateTarget " and test node " createListener ", test node The candidate test node collection of " getLoadbalance " is combined into test node " createTarget " and test node The candidate test node collection of " deleteLoadbalance ", test node " updateTarget " are combined into test node The candidate test node collection of " deleteTarget ", test node " deleteTarget " are combined into test node The candidate test node collection of " getLoadbalance ", test node " createListener " are combined into test node " getLoadbalance " and test node " deleteListener ", the candidate test of test node " deleteListener " Node set is test node " getLoadbalance ".

Test trails figure corresponding with the test item is constructed based on identified information above.

Fig. 3 B schematically shows the schematic diagram of test trails figure according to an embodiment of the invention.Such as Fig. 3 B institute Show, includes the test trails figure for characterizing a plurality of test trails of cycle tests of above-mentioned 8 test nodes in the test trails figure. Wherein, test node " createLoadbalance " is the starting test node of the test item, test node " deleteLoadbalance " is the end test node of the test item.It is test case using the test trails figure, being based on should Test trails figure dynamically executes test operation corresponding with each test node, so that surveying in the multiple test node from initial Examination node is traversed to terminating test node, completes the end-to-end test of above-mentioned test item.

And the end-to-end test scheme according to the prior art needs to write following test case for above-mentioned test item:

Use-case 1:

“createLoadbalance”→“getLoadbalance”→“deleteLoadbalance”

Use-case 2:

“createLoadbalance”→“createTarget”→“createListener”→ “getLoadbalance”→“deleteLoadbalance”

Use-case 3:

“createLoadbalance”→“createTarget”→“createListener”→ “deleteListener”→“getLoadbalance”→“deleteLoadbalance”

Use-case 4:

“createLoadbalance”→“createTarget”→“updateTarget”→“deleteTarget”→ “getLoadbalance”→“deleteLoadbalance”

Etc., it no longer enumerates herein.After writing above-mentioned multiple test cases, then carried out respectively according to each test case Test.

As can be seen that the prior art only supports the chain type combination of test node that is static, determining, the test for needing to write The number of use-case is the total number for all test trails that test item is included.And end-to-end test side provided by the disclosure Method only needs that only one as shown in Figure 3A is dynamic, introduces probabilistic test case.Survey is greatly reduced in this way Example on probation writes cost and maintenance cost, improve end-to-end test use-case write and maintenance efficiency, improve end-to-end survey Try efficiency.

In one embodiment of the present disclosure, the test claim information of test item includes: to be included to test item The first annotating data and included to test item that the parameter information of each test node is described in multiple test nodes Multiple test nodes between the second annotating data for being described of related information.

On this basis, operation S202 is based on the test claim information, determines each survey in the multiple test node The candidate test node set of examination node and each test node includes: identification first annotating data, obtains institute State the parameter information of each test node in multiple test nodes；It identifies second annotating data, obtains the multiple test Related information between node；And information and the related information based on the parameter, determine each test node with And the neighboring candidate test node set of each test node.And operation S203 be based on each test node with And the candidate test set of each test node, building test trails figure includes: for the multiple test node, by survey Each test node is connect with the neighboring candidate test node of each test node examination node, obtains the survey Try trajectory diagram.

Pass through the note number pre-defined in the test claim information of test item according to embodiment of the disclosure The related information between the parameter information and test node of test node is stated according to (annotation).It is fixed in advance to be equivalent to The good unified expression-form of justice, then carries out mass expression using the unified expression-form in test claim information, can The property read is strong, and subsequent operation S202 is allowed to efficiently identify parameter information and related information expressed by test claim information. And it is also more convenient quick by annotating data expression test claim information for the user for providing test claim information.

For example, the user with testing requirement writes corresponding project file for load balancing project mentioned above, The project file includes test claim information, wherein the TableStep note pair under being explained using StepGroup predetermined The parameter information of test node is described, the RouteFrom note pair under being explained using DecisionGroup predetermined Related information between test node is described.After getting above-mentioned project file, 1~5 is performed the following operations:

1, the StepGroup scanned first in project file is explained, which beats on class, marks such for an end To the test node set at end.Then the TableStep for scanning StepGroup class is explained, and TableStep is explained to correspond to and is based on The end-to-end scene of figure.

2, it scans the DecisionGroup below engineering again to explain, which beats on class, and it is a series of for marking such The set of decision-making technique corresponding with test node.Then it scans the RouteFrom below class to explain, RouteFrom, which is explained, to be divided The corresponding test node of the decision-making technique is not marked, while the DecisionResult class the inside that this method returns is method meter It calculates result (information and parameter of the next test node of decision).

3, according to above-mentioned recognition result, each test node and the candidate test section of each test node are calculated Point set is calculated as variable choiceInstances.

4, operation 1~3 completes information loading procedure above, when user executes first test node of input, According to the information of first test node, 1~3 load of operation with more than, detailed test trails figure is constructed.

Fig. 3 C schematically shows the partial log signal of building test trails figure according to an embodiment of the invention Figure.

As shown in Figure 3 C, the first row expression building starting point of the log is test node " createLoadbalance ", eventually Point is test node " createTarget ", the directed line segment that weight is 100, and the second row indicates that building starting point is test node " createTarget ", terminal are test node " createListener ", the directed line segment that weight is 100, and fifth line indicates Test node " deleteLoadbalance " is the end test node of the test item, to test in test trails figure Node " deleteLoadbalance " is the directed line segment of starting point.And so on, it can be built into all comprising test item The complete test trails figure of test trails.

5, according to the code of test trails figure and test operation corresponding with each test node, test is executed, and is carried out Test operation corresponding with each test node is asserted.Track until finding the last one end point terminates this end and arrives End test.

Specifically, in one embodiment of the present disclosure, operation S204 is based on a plurality of test trails in test trails figure, Executing test operation corresponding with the multiple test node includes: according to a plurality of test trails in test trails figure, by survey Execute test operation corresponding with the test node to examination node.

Wherein, it is above-mentioned by test node execute test operation corresponding with the test node include: when one test When node A is the initial testing node of test trails figure, test operation corresponding with test node A is directly executed, is obtained just Beginning test result.Another test node is determined from the candidate test node being connected with test node A according to test trails figure B, and test operation corresponding with another test node B is executed based on initial testing result.It is above-mentioned according to test trails figure Another test node B is determined from the candidate test node being connected with test node A and to identified another test node B The process for transmitting initial testing result is decision (Decision) process corresponding with test node A.

When a test node B is the intermediate test node of test trails figure, the test knot based on previous test node Fruit executes corresponding with test node B test operation, the first test result of acquisition, according to test trails figure from the test section Determine another test node C in point B connected candidate test node, and based on first test result execute with it is described another The corresponding test operation of test node C.It is above-mentioned according to test trails figure from the candidate test node being connected with test node B It determines another test node C and is and test node B to the process that identified another test node C transmits the first test result Corresponding decision process.

When a test node C is the end test node of test trails figure, the test knot based on previous test node Fruit executes test operation corresponding with test node C, to obtain the second test result.Since test node C is to terminate test Node does not have candidate test node, and decision process corresponding with test node C can not find next test node, therefore straight Connect the second test result of output.

As can be seen that by test node executing test operation based on test trails figure, each test node is being executed After test operation, there is corresponding decision process, dynamically determines to execute next test node to be executed.With decision The increase of logic complexity, calculating are more and more heavier.Decision and test node are one-to-one relationships, can be by decision process It is interpreted as a test node to have executed, the test result based on test trails figure and test node is calculated, and is made certainly Plan.Next test phase that the main output of decision needs to be implemented, and be compared to needing to verify the data compared, judge It currently tests whether to execute and pass through.Uncertainty appropriate is introduced in end-to-end test scene, it is more flexible, there is Gao Lu Stick.

Wherein, above-mentioned by test node to execute survey corresponding with the test node as an optional embodiment Examination operation further include: if the test result of the test node does not meet preset condition, output indicates that the test node is surveyed The warning message of failure is tried, by test node is executed since the initial testing node in the test trails figure again and institute State the corresponding test operation of test node.

In one embodiment of the present disclosure, the candidate test of above-mentioned each test node and each test node Node set includes the associated weights between each test node and the candidate test node of each test node, institute It states test trails figure and also characterizes associated weights between connected test node.Then it is above-mentioned according to the test trails figure from institute State in the connected candidate test node of test node and determine that the decision process of another test node specifically includes: according to the survey Associated weights between the node each candidate test node being connected and the test node are tried, it is each from being connected with the test node Another test node is determined in candidate test node.

Below with reference to Fig. 4 A~Fig. 4 D, end-to-end test process shown in Fig. 2 is illustrated by specific embodiment:

In the embodiment shown in Fig. 4 A~Fig. 4 D, test node is referred to as step (step), step is end-to-end survey The atomic operation executed is tried, the test operation of a test node is equivalent to.User writes the test statement an of test item Information, test claim information include that user's announce step and user state decision.

Fig. 4 A schematically shows the partial code schematic diagram of user's announce step according to an embodiment of the invention.

As shown in Figure 4 A, user states 3 steps: first step " 1st-step- using TableStep note respectively Random ", second step " 2nd-step-random " and third step " 3rd-step-random ".Wherein first step The candidate step of " 1st-step-random " is second step " 2nd-step-random " and third step " 3rd-step- Random ", the candidate step of second step " 2nd-step-random " are third step " 3rd-step-random ", third step Suddenly the candidate step of " 3rd-step-random " is first step " 1st-step-random ".It can be seen that coming this is one Have and throws the abnormal test item that can just stop.

Fig. 4 B schematically shows the partial code schematic diagram that user according to an embodiment of the invention states decision. As shown in Figure 4 B, user states the corresponding decision-making technique of above-mentioned 3 steps using RouteFrom note respectively, for rear Path selection is carried out when the continuous progress end-to-end test based on test trails figure.

After getting test claim information, identify that above-mentioned user's announce step and user state decision, in response to executing The operation of the code of one step constructs test trails figure, executes end-to-end test based on the test trails figure.

Fig. 4 C schematically shows the partial code schematic diagram according to an embodiment of the invention for executing a step. As shown in Figure 4 C, this section of code is the code for executing above-mentioned first step " 1st-step-random ".It similarly, can also be from holding Other steps of row start, herein with no restrictions.

Fig. 4 D schematically shows the partial log signal according to an embodiment of the invention for executing end-to-end test Figure.

As shown in Figure 4 D, test trails figure is constructed, the test trails figure is based on, executes first step, obtains and surveys the first step Rapid test result executes the decision-making technique of first step, jumps to next step (second step or third step).If from First step jumps to second step, executes second step according to the test result of first step, obtains the test knot of second step Fruit executes the decision-making technique of second step, is transferred to next step (third step), is executed according to the test result of second step Third step obtains the test result of third step, executes the decision-making technique of third step, is transferred to the next step (first step Suddenly).If jumping to third step from first step, third step is executed according to the test result of first step, obtains third step Rapid test result executes the decision-making technique of third step, is transferred to next step (first step).It repeats the above process, when Alarm log is exported when the test result exception of certain step and jumps out the adjustment, is tested since first step again.

As it can be seen that the embodiment of the present disclosure proposes a kind of new end-to-end test scheme based on the operation of test trails figure, pass through Each point in test trails figure is collectively formed by decision and step, realizes the decoupling of step and step, and by holding Execution link to end test scene introduces appropriate uncertain, the end-to-end automation overall cost of solution and scene composition positive Cost is converted into and the positively related problem of increment scene by the problem of pass.

Exemplary means

After describing the method for exemplary embodiment of the invention, next, showing with reference to Fig. 5~Fig. 6 the present invention The end-to-end test device of example property embodiment is described in detail.

Fig. 5 schematically shows the block diagram of end-to-end test device according to an embodiment of the invention.Such as Fig. 5 institute Show, which includes: to obtain module 510, determining module 520, building module 530 and test module 540.

Obtain the test claim information that module 510 is used to obtain test item.Wherein, the test item includes multiple surveys Node is tried, the test claim information includes: the parameter information of each test node and described more in the multiple test node Related information between a test node.Determining module 520 is used to be based on the test claim information, determines the multiple test The candidate test node set of each test node and each test node in node.Building module 530 is for being based on The candidate test node set of each test node and each test node constructs test trails figure, wherein institute Stating test trails figure includes a plurality of test trails for characterizing the cycle tests of the multiple test node.And test module 540 For executing test operation corresponding with the multiple test node based on a plurality of test trails in the test trails figure, So that being traversed in the multiple test node from initial testing node to test node is terminated.

Fig. 6 schematically shows the block diagram of end-to-end test device in accordance with another embodiment of the present invention.Such as Fig. 6 institute Show, which includes: to obtain module 510, determining module 520, building module 530 and test module 540.

In the present embodiment, test claim information includes: the parameter to test node each in the multiple test node The first annotating data that information is described and the second note that the related information between the multiple test node is described Solve data.

Determining module 520 includes that the first identification submodule 521, second identifies submodule 522 and determines submodule 523.The One identifies first annotating data for identification of submodule 521, obtains each test node in the multiple test node Parameter information.Second identifies second annotating data for identification of submodule 522, obtains between the multiple test node Related information.And determine that submodule 523 for information and the related information based on the parameter, determines each survey Try the neighboring candidate test node set of node and each test node.On this basis, building module 530 is specifically used In be directed to the multiple test node, it is by test node that each test node is adjacent with each test node Candidate test node connection, obtains the test trails figure.

In one embodiment of the present disclosure, test module 540 is specifically used for according to a plurality of in the test trails figure Test trails by test node execute test operation corresponding with the test node.Wherein, test module 540 includes holding Row submodule 541 and decision submodule 542.

Implementation sub-module 541 is used for when the test node is the initial testing node of the test trails figure, directly Test operation corresponding with the test node is executed, initial testing result is obtained；For being the survey when the test node When trying the intermediate test node of trajectory diagram, the test result based on previous test node executes survey corresponding with the test node Examination operation, obtains the first test result；And for when the end test node that the test node is the test trails figure When, the test result based on previous test node executes test operation corresponding with the test node, obtains the second test knot Fruit.Decision submodule 542 is used for true from the candidate test node being connected with the test node according to the test trails figure Fixed another test node.And implementation sub-module 541 is also used to based on the initial testing result or first test result Execute test operation corresponding with another test node.

Further, in one embodiment of the present disclosure, test module 540 further includes exception response submodule 543, is used In when the test result of the test node does not meet preset condition, output indicates the alarm of the test node test crash Information by test node executes and the test node pair since the initial testing node in the test trails figure again The test operation answered.

In one embodiment of the present disclosure, the candidate test node of each test node and each test node Set includes the associated weights between each test node and the candidate test node of each test node, the survey Examination trajectory diagram also characterizes the associated weights between connected test node.Above-mentioned decision submodule 542 is specifically used for basis and institute Associated weights between the test node each candidate test node being connected and the test node are stated, are connected from the test node Each candidate test node in determine another test node.

It should be noted that in device section Example each module/unit/subelement etc. embodiment, the skill of solution Art problem, the function of realization and the technical effect reached respectively with the implementation of corresponding step each in method section Example Mode, the technical issues of solving, the function of realization and the technical effect that reaches are same or like, and details are not described herein.

Exemplary media

After describing the method and apparatus of exemplary embodiment of the invention, next, to the exemplary reality of the present invention Apply mode, be introduced for realizing the medium of end-to-end test method.

The embodiment of the invention provides a kind of media, are stored with computer executable instructions, above-metioned instruction is by processor For realizing end-to-end test method described in any one of above method embodiment when execution.

In some possible embodiments, various aspects of the invention are also implemented as a kind of shape of program product Formula comprising program code, when described program product is run on the computing device, said program code is for making the calculating Equipment executes described in above-mentioned " illustrative methods " part of this specification the end of various illustrative embodiments according to the present invention To the operation in the test method of end, for example, the calculating equipment can execute operation S201~S204 as shown in Figure 2.

Described program product can be using any combination of one or more readable mediums.Readable medium can be readable letter Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example may be-but not limited to-electricity, magnetic, optical, electromagnetic, red The system of outside line or semiconductor, device or device, or any above combination.The more specific example of readable storage medium storing program for executing (non exhaustive list) includes: the electrical connection with one or more conducting wires, portable disc, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc Read memory (CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.

Fig. 7 schematically shows the schematic diagram of the computer readable storage medium product of embodiment according to the present invention, As shown in fig. 7, the program product 70 for realizing end-to-end test method of embodiment according to the present invention is described, it can To use portable compact disc read only memory (CD-ROM) and including program code, and equipment can be being calculated, such as personal It is run on computer.However, program product of the invention is without being limited thereto, in this document, readable storage medium storing program for executing can be any packet Contain or store the tangible medium of program, which can be commanded execution system, device or device use or in connection It uses.

Readable signal medium may include in a base band or as the data-signal that carrier wave a part is propagated, wherein carrying Readable program code.The data-signal of this propagation can take various forms, including --- but being not limited to --- electromagnetism letter Number, optical signal or above-mentioned any appropriate combination.Readable signal medium can also be other than readable storage medium storing program for executing it is any can Read medium, the readable medium can send, propagate or transmit for by instruction execution system, device or device use or Program in connection.

The program code for including on readable medium can transmit with any suitable medium, including --- but being not limited to --- Wirelessly, wired, optical cable, RF etc. or above-mentioned any appropriate combination.

The program for executing operation of the present invention can be write with any combination of one or more programming languages Code, described program design language include object oriented program language --- and such as Java, C++ etc. further include routine Procedural programming language --- such as " C ", language or similar programming language.Program code can fully exist It executes in user calculating equipment, partly execute on a user device, executing, as an independent software package partially in user Upper side point is calculated to execute or execute in remote computing device or server completely on a remote computing.It is relating to And in the situation of remote computing device, remote computing device can pass through the network of any kind --- including local area network (LAN) Or wide area network (WAN) one is connected to user calculating equipment, or, it may be connected to external computing device (such as utilize internet Service provider is connected by internet).

Exemplary computer device

After method, medium and the device for describing exemplary embodiment of the invention, next, introducing according to this hair Bright another exemplary embodiment, calculating equipment for realizing end-to-end test method.

The embodiment of the invention also provides a kind of calculating equipment, comprising: memory, processor and storage are on a memory simultaneously The executable instruction that can be run on a processor, the processor are realized any in above method embodiment when executing described instruction End-to-end test method described in.

Person of ordinary skill in the field it is understood that various aspects of the invention can be implemented as system, method or Program product.Therefore, various aspects of the invention can be embodied in the following forms, it may be assumed that complete hardware embodiment, complete The embodiment combined in terms of full Software Implementation (including firmware, microcode etc.) or hardware and software, can unite here Referred to as circuit, " module " or " system ".

In some possible embodiments, according to the present invention can for realizing the calculating equipment of end-to-end test method To include at least at least one processing unit and at least one storage unit.Wherein, the storage unit is stored with program generation Code, when said program code is executed by the processing unit, so as to execute this specification above-mentioned " exemplary for the processing unit Operation in the end-to-end test method of various illustrative embodiments according to the present invention described in method " part.For example, institute Operation S201~S204 as shown in Figure 2 can be executed by stating processing unit.

The electronics based on instant messaging behavioral data of this embodiment according to the present invention is described referring to Fig. 8 Resource granting calculates equipment 80.Calculating equipment 80 as shown in Figure 8 is only an example, should not be to the function of the embodiment of the present invention Any restrictions can be brought with use scope.

It is showed in the form of universal computing device as shown in figure 8, calculating equipment 80.Calculate equipment 80 component may include But it is not limited to: at least one above-mentioned processing unit 801, at least one above-mentioned storage unit 802, connection different system components (packet Include storage unit 802 and processing unit 801) bus 803.

Bus 803 indicates one of a few class bus structures or a variety of, including memory bus or Memory Controller, Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.

Storage unit 802 may include the readable medium of form of volatile memory, such as random access memory (RAM) 8021 and/or cache memory 8022, it can further include read-only memory (ROM) 8023.

Storage unit 802 can also include program/utility with one group of (at least one) program module 8024 8025, such program module 8024 includes but is not limited to: operating system, one or more application program, other program moulds It may include the realization of network environment in block and program data, each of these examples or certain combination.

Calculating equipment 80 can also be with one or more external equipment 804 (such as keyboard, sensing equipment, bluetooth equipment etc.) Communication can also be enabled a user to communicate with the equipment that calculating equipment 80 interacts with one or more, and/or be set with to calculate The standby 80 any equipment (such as router, modem etc.) that can be communicated with one or more of the other calculating equipment are led to Letter.This communication can be carried out by input/output (I/0) interface 805.Also, calculating equipment 80 can also be suitable by network Orchestration 806 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public network, such as because of spy Net) communication.As shown, network adapter 806 is communicated by bus 803 with the other modules for calculating equipment 80.It should be understood that Although not shown in the drawings, other hardware and/or software module can be used in conjunction with equipment 80 is calculated, including but not limited to: micro- generation Code, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and data backup are deposited Storage system etc..

It should be noted that although being referred to the e-sourcing granting based on instant messaging behavioral data in the above detailed description Several units/modules or subelement/module of device, but it is this division be only exemplary it is not enforceable.It is practical On, the feature and function of embodiment according to the present invention, two or more above-described units/modules can be in a list It is embodied in member/module.Conversely, the feature and function of an above-described units/modules can be by more with further division A units/modules embody.

In addition, although describing the operation of the method for the present invention in the accompanying drawings with particular order, this do not require that or Hint must execute these operations in this particular order, or have to carry out shown in whole operation be just able to achieve it is desired As a result.Additionally or alternatively, it is convenient to omit multiple steps are merged into a step and executed by certain steps, and/or by one Step is decomposed into execution of multiple steps.

Although detailed description of the preferred embodimentsthe spirit and principles of the present invention are described by reference to several, it should be appreciated that, this It is not limited to the specific embodiments disclosed for invention, does not also mean that the feature in these aspects cannot to the division of various aspects Combination is benefited to carry out, this to divide the convenience merely to statement.The present invention is directed to cover appended claims spirit and Included various modifications and equivalent arrangements in range.

Claims

1. a kind of end-to-end test method, comprising:

Obtain the test claim information of test item, wherein the test item includes multiple test nodes, the test statement Information includes: the association in the multiple test node between the parameter information of each test node and the multiple test node Information；

Based on the test claim information, each test node and each test section in the multiple test node are determined The candidate test node set of point；

Candidate test node set based on each test node and each test node constructs test trails Figure, wherein the test trails figure includes a plurality of test trails for characterizing the cycle tests of the multiple test node；And

Based on a plurality of test trails in the test trails figure, test operation corresponding with the multiple test node is executed, So that being traversed in the multiple test node from initial testing node to test node is terminated.

2. according to the method described in claim 1, wherein:

The test claim information includes: that the parameter information of test node each in the multiple test node is described First annotating data and the second annotating data that the related information between the multiple test node is described；

It is described to be based on the test claim information, determine each test node and each survey in the multiple test node Examination node candidate test node set include:

It identifies first annotating data, obtains the parameter information of each test node in the multiple test node；

It identifies second annotating data, obtains the related information between the multiple test node；And

Information and the related information based on the parameter determine each test node and each test node Neighboring candidate test node set；

The candidate test set based on each test node and each test node, constructs test trails figure It include: for the multiple test node, by test node by each test node and each test node The connection of neighboring candidate test node, obtains the test trails figure.

3. according to the method described in claim 1, wherein, a plurality of test trails based in the test trails figure are held Corresponding with the multiple test node test operation of row includes:

According to a plurality of test trails in the test trails figure, survey corresponding with the test node by test node is executed Examination operation,

Wherein, described by test node to execute test operation corresponding with the test node and include:

When the test node is the initial testing node of the test trails figure, directly execute corresponding with the test node Test operation, obtain initial testing as a result, according to the test trails figure from the candidate test being connected with the test node It determines another test node in node, and test corresponding with another test node is executed based on the initial testing result Operation；

When the test node is the intermediate test node of the test trails figure, the test result based on previous test node Execute corresponding with test node test operation, the first test result of acquisition, according to the test trails figure from it is described Determine another test node in the connected candidate test node of test node, and based on first test result execute with it is described The corresponding test operation of another test node；And

When the test node is the end test node of the test trails figure, the test result based on previous test node Test operation corresponding with the test node is executed, to obtain the second test result.

4. described by test node to execute survey corresponding with the test node according to the method described in claim 3, wherein Examination operation further include:

If the test result of the test node does not meet preset condition, output indicates the report of the test node test crash Alert information, by test node executes and the test node since the initial testing node in the test trails figure again Corresponding test operation.

5. according to the method described in claim 3, wherein:

The candidate test node set of each test node and each test node includes each test section Associated weights between point and the candidate test node of each test node, the test trails figure also characterize connected survey Try the associated weights between node；And

It is described to determine another test section from the candidate test node being connected with the test node according to the test trails figure Point include: according to be connected with the test node it is each candidate test node and the test node between associated weights, from Another test node is determined in each candidate test node that the test node is connected.

6. a kind of end-to-end test device, comprising:

Module is obtained, for obtaining the test claim information of test item, wherein the test item includes multiple test sections Point, the test claim information includes: the parameter information of each test node and the multiple survey in the multiple test node Try the related information between node；

Determining module, for being based on the test claim information, determine in the multiple test node each test node and The candidate test node set of each test node；

Module is constructed, for the candidate test node set based on each test node and each test node, Test trails figure is constructed, wherein the test trails figure includes a plurality of test for characterizing the cycle tests of the multiple test node Track；And

Test module, for executing and the multiple test node pair based on a plurality of test trails in the test trails figure The test operation answered, so that being traversed in the multiple test node from initial testing node to test node is terminated.

7. device according to claim 6, in which:

The determining module includes:

First identification submodule, first annotating data, obtains each test section in the multiple test node for identification The parameter information of point；

Second identification submodule, second annotating data, obtains the association letter between the multiple test node for identification Breath；And

It determines submodule, for information and the related information based on the parameter, determines each test node and institute State the neighboring candidate test node set of each test node；

The building module, for being directed to the multiple test node, by test node by each test node and institute The neighboring candidate test node connection for stating each test node, obtains the test trails figure.

8. device according to claim 6, in which:

The test module, for according to a plurality of test trails in the test trails figure, by test node executing and institute The corresponding test operation of test node is stated,

Wherein, the test module includes:

Implementation sub-module, for when the test node be the test trails figure initial testing node when, directly execute and The corresponding test operation of the test node, obtains initial testing result；

For when the test node be the test trails figure intermediate test node when, the test based on previous test node As a result test operation corresponding with the test node is executed, the first test result is obtained；And

For when the test node be the test trails figure end test node when, the test based on previous test node As a result test operation corresponding with the test node is executed,

Obtain the second test result；

Decision submodule, for being determined from the candidate test node being connected with the test node according to the test trails figure Another test node；And

The implementation sub-module, be also used to execute based on the initial testing result or first test result with it is described another The corresponding test operation of test node.

9. device according to claim 8, wherein the test module further include:

Exception response submodule, described in when the test result of the test node does not meet preset condition, output is indicated The warning message of test node test crash, again by test node since the initial testing node in the test trails figure Ground executes test operation corresponding with the test node.

10. device according to claim 8, in which:

The decision submodule, for according to each candidate test node being connected with the test node and the test node it Between associated weights, determine another test node from each candidate test node being connected with the test node.

11. a kind of medium, be stored with computer executable instructions, described instruction when being executed by processor for realizing:

End-to-end test method as described in any one of claims 1 to 5.

12. a kind of calculating equipment, comprising: memory, processor and storage on a memory and can run on a processor can It executes instruction, the processor is realized when executing described instruction:

End-to-end test method as described in any one of claims 1 to 5.