CN106557414A - Application testing system and method - Google Patents

Application testing system and method Download PDF

Info

Publication number
CN106557414A
CN106557414A CN201510627937.6A CN201510627937A CN106557414A CN 106557414 A CN106557414 A CN 106557414A CN 201510627937 A CN201510627937 A CN 201510627937A CN 106557414 A CN106557414 A CN 106557414A
Authority
CN
China
Prior art keywords
application program
edition
mistake
node
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510627937.6A
Other languages
Chinese (zh)
Inventor
张沈斌
孙俊
皮冰锋
周恩策
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Priority to CN201510627937.6A priority Critical patent/CN106557414A/en
Publication of CN106557414A publication Critical patent/CN106557414A/en
Pending legal-status Critical Current

Links

Abstract

The present invention relates to the Application testing system and method based on distributed cloud environment platform.Application testing system based on distributed cloud environment platform of the invention includes acquiring unit, and for obtaining the first version and the second edition of application program, the wherein second edition is newer than first version;First signal generating unit, generating for the application program based on first version includes the first operation tree of multiple running nodes;Second signal generating unit, generating for the application program based on the second edition includes the second operation tree of multiple running nodes;Function determining unit, for comparing multiple running nodes of the first operation tree and multiple running nodes of the second operation tree, to determine New function and old function of the application program of the second edition relative to the application program of first version;And function regression test unit, for by using the multiple mobile devices on distributed cloud environment platform, carrying out regression test to the old function of the application program of the second edition.

Description

Application testing system and method
Technical field
The present invention relates to mobile test technical field, more particularly to answering based on distributed cloud environment platform With the system and method for program test.
Background technology
There is provided the background information relevant with the present invention, this is not necessarily prior art for this part.
Nowadays, mobile Internet becomes more and more numerous with the fast development of smart mobile phone and 3G/4G networks Honor, and people gradually begin to use smart mobile phone.There is thousands of application program app quilt daily Develop, user is extremely concerned about the quality of these application programs app, thus usually needs to answer these Tested with program app.However, due to lacking effective method of testing, city in mobile field at present On field, substantial amounts of application program app mass is not very high, and they cannot meet the demand of mobile subscriber. On the one hand, tester needs the quality of test application program app on different devices, but, mostly Number tester lacks enough equipment;On the other hand, the speed of application program app version updating is got over Come more frequent, tester cannot between different versions test application program app.
In traditional method, tester carrys out test application program using simulator or the prototype of oneself app.It is recently proposed the scheme of mobile cloud test and tests solving the problems, such as application program app.Dividing Thousands of prototype is provided on cloth cloud environment platform, user only needs to submit the application for needing test to Program app and test script, distributed cloud environment platform automatic running test script simultaneously provide test report. Distributed cloud environment platform solves the problems, such as that application program app is tested to a certain extent, but application The test of program app yet suffers from some problems.On the one hand, when the edition upgrading of application program app, meeting Some new functions are produced, these new functions operationally can sometimes cause the mistake of old function, If not carrying out regression test to old function, cannot just find these mistakes, therefore regression test to pass It is important.However, distributed cloud environment platform is not provided with regression tested function.On the other hand, such as Where mistake is tracked between application program app of different editions, and it is wrong timely and effectively to eliminate these It is also a challenge by mistake.Additionally, in existing technology, distributed cloud environment platform can only be from applying journey Sequence app store directly can not obtain feedback from user obtaining the feedback information of application program app Information, thus it is not accurate enough.The presence of above-mentioned these problems can all cause the quality of application program app low Under, poor user experience.
The content of the invention
This part provides the general summary of the present invention, rather than its four corner or its whole feature Full disclosure.
It is an object of the invention to provide a kind of Application testing system based on distributed cloud environment platform System and method.Application according to the present invention PTS and method, by comparing answering for different editions With the operation tree of program app come the New function of automatic detection application program app and old function, and can be with Regression test is carried out to old function, it is to reduce impact of the New function of application program app to old function, real The compatibility of existing different editions application program app.
According to an aspect of the present invention, there is provided a kind of application program based on distributed cloud environment platform is surveyed Test system, including:Acquiring unit, for obtaining the first version and the second edition of application program, wherein The second edition is newer than the first version;First signal generating unit, for based on the first version Application program generates the first operation tree for including multiple running nodes;Second signal generating unit, for based on institute The application program for stating the second edition generates the second operation tree for including multiple running nodes;Function determines single Unit, multiple operations of multiple running nodes and the second operation tree for comparison the first operation tree Node, to determine the application program of the second edition relative to the new of the application program of the first version Function and old function;And function regression test unit, for flat by using the distributed cloud environment Multiple mobile devices on platform, carry out regression test to the old function of the application program of the second edition.
According to a further aspect in the invention, there is provided a kind of application program based on distributed cloud environment platform Method of testing, including:The first version and the second edition of application program are obtained, wherein the second edition It is newer than the first version;Application program based on the first version is generated includes multiple running nodes First operation tree;Application program based on the second edition generates the second behaviour for including multiple running nodes Set;Multiple running nodes of comparison the first operation tree and multiple operation sections of the second operation tree Point, to determine new work(of the application program of the second edition relative to the application program of the first version Can be with old function;And by using the multiple mobile devices on the distributed cloud environment platform, to institute The old function of stating the application program of the second edition carries out regression test.
According to a further aspect in the invention, there is provided a kind of program product, the program product include being stored in Machine readable instructions code therein, wherein, the instruction code when by computer read and perform when, The computer can be made to perform the application program based on distributed cloud environment platform of the invention survey Method for testing.
According to a further aspect in the invention, there is provided a kind of machinable medium, root is carried thereon According to the program product of the present invention.
Using the Application testing system and method based on distributed cloud environment platform of the invention, Can in application program app version updating automatic detection New function, and old function can be carried out back Return test, the compatibility of different editions application program app can be realized, effectively solving application program app is surveyed The problem of examination, improves the quality of application program app, improves Consumer's Experience.
Description and specific examples in this summary is intended merely to the purpose illustrated, and is not intended to limit this Bright scope.
Description of the drawings
Accompanying drawing described here is intended merely to the purpose of the signal of selected embodiment and not all possible reality Apply, and be not intended to limit the scope of the present invention.In the accompanying drawings:
Fig. 1 is to be surveyed according to the application program based on distributed cloud environment platform of embodiments of the invention The structured flowchart of test system;
Fig. 2 is illustrated and is based on distributed cloud environment platform really according to an embodiment of the invention Determine the process of the New function and old function of application program;
Fig. 3 is to be surveyed according to the application program based on distributed cloud environment platform of embodiments of the invention The structured flowchart of the function determining unit of test system;
Fig. 4 is the application based on distributed cloud environment platform according to an alternative embodiment of the invention The structured flowchart of the function determining unit of PTS;
Fig. 5 is to be returned to survey according to the scene based on distributed cloud environment platform of embodiments of the invention The schematic diagram of examination;
Fig. 6 is the determination application journey based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the process of the different types of mistake of sequence;
Fig. 7 is the determination application journey based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the result of the different types of mistake of sequence;
Fig. 8 is the elimination application journey based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the process of the mistake of sequence;
Fig. 9 is the elimination application journey based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the result of the mistake of sequence;
Figure 10 illustrates answering based on distributed cloud environment platform according to an embodiment of the invention With the process of program testing method;
Figure 11 is to be surveyed according to the application program based on distributed cloud environment platform of embodiments of the invention The flow chart of method for testing;And
Figure 12 is can wherein to realize being based on distributed cloud environment platform according to an embodiment of the invention Application testing system and method general purpose personal computer example arrangement block diagram.
Although the present invention is subjected to various modifications and alternative forms, its specific embodiment is as example Son is shown in the drawings, and is described in detail here.It should be understood, however, that at this to particular implementation The description of example is not intended to limit the invention to disclosed concrete form, but on the contrary, mesh of the present invention Be intended to cover fall within the spirit and scope of the invention all modifications, it is equivalent and replace.It is noted that , through several accompanying drawings, corresponding label indicates corresponding part.
Embodiment
With reference now to accompanying drawing, it is described more fully the example of the present invention.Hereinafter describe and substantially simply show Example property, and be not intended to limit the present invention, application or purposes.
Example embodiment has been provided below, so that the present invention will become detailed, and will be to this area Technical staff fully passes on its scope.Elaborate numerous specific details such as discrete cell, device and side The example of method, to provide the detailed understanding to embodiments of the invention.To those skilled in the art It will be obvious that, it is not necessary to using specific details, example embodiment can be with many different forms To implement, they shall not be interpreted to limit the scope of the present invention.In some example embodiments, Well-known process, well-known structure and widely-known technique are not described in detail.
Fig. 1 is the Application testing system based on distributed cloud environment platform according to embodiments of the invention The structured flowchart of system.As shown in figure 1, the Application testing system 100 based on distributed cloud environment platform Acquiring unit 110, signal generating unit 120, signal generating unit 130,140 and of function determining unit can be included Function regression test unit 150.Distributed cloud environment platform in the present invention can test to service TaaS platforms.
Embodiments in accordance with the present invention, acquiring unit 110 can obtain the first version of application program app And the second edition, the wherein second edition is newer than first version.In one embodiment, acquiring unit 110 The first version and the second edition of application program app can be obtained from user.In another embodiment, Acquiring unit 110 can be from the database of the Application testing system based on distributed cloud environment platform Obtain the first version and/or the second edition of application program app, it is possible to application program app that will be obtained First version and the second edition be separately sent to signal generating unit 120 and signal generating unit 130.
Embodiments in accordance with the present invention, signal generating unit 120 can be based on application programs app of first version Generation includes the first operation tree of multiple running nodes, and what signal generating unit 130 can be based on the second edition should Being generated with program app includes the second operation tree of multiple running nodes.In one embodiment, generate single Unit 120 and signal generating unit 130 can obtain application program app of first version from acquiring unit 110 With application program app of the second edition, it is possible to which the first operation tree for generating and the second operation tree are sent To function determining unit 140.In the present invention, set visually to represent application program app with operation Operation structure.When user uses application program app, many operations can be carried out, each is operated Running node op is defined as, can travel through to generate application program app based on user interface UI Operation tree.In operation tree, different layers illustrates the operation location.For each version Application program app, can generate corresponding operation tree.
In the present invention, can be using below equation come the operation of definition application app.
Operation=(appVersion, view, activity, action, enable) (1)
Wherein, operation represents certain operation, and appVersion represents the version of application program app, View represents application program app control, and activity represents the page of the operation, and action represents the behaviour The concrete action made, for example, " click on ", and enable represents whether the operation can cause redirecting for the page.
Fig. 2 illustrates determination according to an embodiment of the invention based on distributed cloud environment platform should With the process of the New function and old function of program.In fig. 2, the left side is first version application program app Operation tree, the right for second edition application program app operation tree.As shown in Fig. 2 root is represented Root node, the operation tree of first version application program app have six running nodes of op1-op6, wherein Op1-op4 is located at the second layer of operation tree, and op5 and op6 is located at the third layer of operation tree.Such as the first edition Shown in the operation tree of application app, when first version application program app is run, application is opened The homepage of program app, can carry out the operation of op1-op4 tetra-, when having carried out op2 and having operated, can be with Op5 and op6 operations are carried out again.Similarly, the operation tree of second edition application program app have op1, Seven running nodes of op2 and op4-op8, wherein op1, op2 and op4 are located at the second layer of operation tree, Op5-op8 is located at the third layer of operation tree.As shown in the operation tree of second edition application program app, when Operation the second edition application program app when, open application program app homepage, can carry out op1, Tri- operations of op2 and op4, when op2 operations have been carried out, can carry out op5 and op6 operations again, When op4 operations have been carried out, op7 and op8 operations can be carried out again.
Present invention employs and operate the structure set to represent application program app, can clearly indicate that should With the relation between the operation structure and different operating of program app, it is easily understood.
Embodiments in accordance with the present invention, function determining unit 140 can compare multiple behaviour of the first operation tree Make multiple running nodes of node and the second operation tree, it is relative with application program app for determining the second edition In the New function and old function of application program app of first version.In the present invention, application program app Function can be some running node.In one embodiment, function determining unit 140 can be from Signal generating unit 120 and signal generating unit 130 obtain the first operation tree and the second operation tree respectively, it is possible to will It is determined that old function be sent to function regression test unit 150.In the present invention, function determining unit 140 New function and old function can be determined by default rule.As shown in Fig. 2 function determining unit 140 Multiple running nodes that relatively multiple running nodes of the first operation tree and the second operation are set, and by default Rule determine the second edition application program app relative to application program app of first version new work( Can be running node op6, op7 and op8, old function is running node op1, op2, op4 and op5.
Embodiments in accordance with the present invention, function regression test unit 150 can be by using distributed cloud rings Multiple mobile devices on the platform of border, carry out recurrence survey to the old function of application program app of the second edition Examination.In the present invention, regression test is referred in application program app of the second edition, is old function User interface UI traversal script is automatically generated, whether the operation for testing old function is correct.Implement at one In example, function regression test unit 150 can obtain the application of the second edition from function determining unit 140 The old function of program app, it is possible to regression tested result is sent to into this and is put down based on distributed cloud environment Other units of the Application testing system of platform carry out the operation such as interpretation of result, it is also possible to by regression test Result be sent to user.As shown in Fig. 2 application of the function regression test unit 150 to the second edition Old feature operation node op1, op2, op4 and op5 of program app carries out regression test.
As described above, using the Application testing system based on distributed cloud environment platform of the invention System and method, can in app version updatings automatic detection New function, and old function can be carried out Regression test, can realize the compatibility between different editions app, the problem of effectively solving app test, The quality of app is improved, improves Consumer's Experience.
Fig. 3 is the Application testing system based on distributed cloud environment platform according to embodiments of the invention The structured flowchart of the function determining unit of system.As shown in figure 3, in one embodiment, function determines single Unit 140 can include the first running node set determining unit 141 and New function determining unit 142.
In one embodiment, the first running node set determining unit 141 can determine the second operation tree In from the set of the different running node of running node in the first operation tree as the first running node collection Close.Example as shown in Figure 2, the running node of the first operation tree include op1-op6, the second operation tree Running node include op1, op2 and op4-op8, thus in the second operation tree with the first operation tree in The different running node of running node is op7 and op8, using the set of the two running nodes as first Running node set.In one embodiment, the first running node set determining unit 141 can be by really The first fixed running node set is sent to New function determining unit 142.
In one embodiment, New function determining unit 142 can be by the behaviour in the first running node set It is defined as the New function of the application program relative to the application program of first version of the second edition as node.Such as Example shown in Fig. 2, New function determining unit 142 is by running node op7 in the first running node set It is defined as the New function of application program app of the second edition with op8.In one embodiment, New function Determining unit 142 can obtain the first running node collection from the first running node set determining unit 141 Close.In one embodiment, function determining unit 140 can also include old function determining unit, be used for Running node in second operation tree in addition to New function is defined as into application program app of the second edition Relative to the old function of application program app of first version.
Fig. 4 is the application program based on distributed cloud environment platform according to an alternative embodiment of the invention The structured flowchart of the function determining unit of test system.As shown in figure 4, function determining unit 140 can be with Including the first running node set determining unit 141, New function determining unit 142, the second running node Gather determining unit 143, user interface UI image generation unit 144, comparing unit 145 and compare single Unit 146.
In this embodiment, the first running node set determining unit 141 and New function determining unit 142 The first running node set determining unit 141 as shown in Figure 3 and New function determining unit can be adopted 142, here is omitted.
In this embodiment, the second running node set determining unit 143 can determine the second operation tree In with first operation tree running node identical running node set as the second running node set. Example as shown in Figure 2, the running node of the first operation tree include op1-op6, the behaviour of the second operation tree Include op1, op2 and op4-op8 as node, thus the operation in tree in the second operation tree, is operated with first Node identical running node be op1, op2 and op4-op6, using the set of this five running nodes as Second running node set.In one embodiment, the second running node set determining unit 143 can be with The the second running node set for determining is sent to into user interface UI image generation unit 144.
In this embodiment, user interface UI image generation unit 144 can be for the second operation section A running node in point set, by using the multiple mobile devices on distributed cloud environment platform, The application program of first version is run to generate the first operation user interface UI image and first page user Interface UI images, and the application program of the second edition is run to generate the second operation user interface UI figure Picture and second page user interface UI image.In the present invention, for a specific operation, operation User interface UI image refers to the interface image related to the operation itself, page user interface UI figure As the interface image related to full page for referring to.For example, for touch-screen type mobile phone, when execution " wechat " When " payment " in application program app operates, operation user interface UI image can be " payment " The sectional drawing of this button, and page user interface UI image can be the sectional drawing of full page.Such as Fig. 2 Shown example, user interface UI image generation unit 144 is in op1, op2 and op4-op6 Each, run first version application program app with generate the first operation user interface UI image and First page user interface UI image, and application program app of the second edition is run to generate second Operation user interface UI image and second page user interface UI image.In one embodiment, user Interface UI image generation unit 144 can obtain second from the second running node set determining unit 143 Running node set, and the first operation user interface UI image for generating and the second operation can be used Family interface UI images are sent to comparing unit 145, by generate first page user interface UI image and Second page user interface UI image is sent to comparing unit 146.
In this embodiment, comparing unit 145 can compare the first operation user interface UI image and Second operation user interface UI image.In one embodiment, comparing unit 145 can compare this two Whether individual user interface UI image is identical.In one embodiment, comparing unit 145 can be from user Interface UI image generation unit 144 obtains first and operates user interface UI image and the second operation user circle Face UI images, and result of the comparison can be sent to New function determining unit 142.
In this embodiment, comparing unit 146 can compare first page user interface UI image and Second page user interface UI image.In one embodiment, comparing unit 146 can compare this two Whether individual user interface UI image is identical.In one embodiment, comparing unit 146 can be from user Interface UI image generation unit 144 obtains first page user interface UI image and second page user circle Face UI images, and result of the comparison can be sent to New function determining unit 142.
In this embodiment, when the comparative result of comparing unit 145 or comparing unit 146 is different, A running node in second running node set is defined as the second edition by New function determining unit 142 Application program relative to the application program of first version New function.Example as shown in Figure 2, it is assumed that The first operation user interface UI image of op6 and the second operation user interface UI image are different, Huo Zhe One page user interface UI image is different with second page user interface UI image, then New function is true Op6 is also defined as the New function of application program app of the second edition for order unit 142.Implement at one In example, New function determining unit 142 can be obtained from comparing unit 145 and comparing unit 146 and be compared Result.In one embodiment, the old function determining unit in function determining unit 140 is for by Application program app that running node in two operation trees in addition to New function is defined as the second edition is relative In the old function of application program app of first version.Example as shown in Figure 2, old function determining unit Op1, op2, op4 and op5 in second edition application program app can be defined as the second edition should With program app relative to first version application program app old function.
In another embodiment, function determining unit 140 can also include that the 3rd running node set is true Order unit, for determining running nodes different from the running node in the second operation tree in the first operation tree Set as the 3rd running node set, New function determining unit 142 can also be by the 3rd running node Running node in set is defined as second edition application program app relative to first version application program The New function of app.Example as shown in Figure 2, the 3rd running node set determining unit determine the first behaviour It is op3 to set from the different running nodes of running node in the second operation tree, New function determining unit 142 New functions that op3 is defined as second edition application program app.
In another embodiment, the Application testing system 100 based on distributed cloud environment platform is gone back Can include starting page generating unit, for application program app based on the second edition relative to first The New function of version application program app is generated and starts the page.In one embodiment, start the page to generate Unit can be from function determining unit 140 New function determining unit 142 obtain second edition application journey The New function of sequence app.Example as shown in Figure 2, for New function op7, starts page generating unit It is root-op4-op7 that the startup page can be generated.In another embodiment, start page generating unit New function can also be generated and introduce navigation page, make user more easily understand New function.
As described above, using the Application testing system based on distributed cloud environment platform of the invention System and method, can in app version updatings automatic detection New function, and can for New function from Dynamic generation starts the page.
In one embodiment, can also be wrapped based on the Application testing system of distributed cloud environment platform Include tracking report acquisition unit and scene regression test unit.
In one embodiment, follow the trail of report acquisition unit second can be obtained from the mobile device of user The tracking report of application program app of version.When application program app is published to application program app store When, in the mobile device that application program app can be downloaded to user to application program app store by user, Then which is installed and is used.During use, application program app it may happen that mistake, Scene information when occurring to these mistakes, i.e. context parameters are collected, the tracking report of application program Announcement just includes these scene informations.In one embodiment, can be by application program app Application program Trancking Software development kit SDK is obtaining the tracking of application program app of the second edition Report.The developer of application program app is embedded into application program tracking SDK in application program app, Then application program app store is published to, application program app that user downloads includes application program Follow the trail of SDK.When user uses application program app, application program is followed the trail of SDK and can record user The process of operation simultaneously automatically generates test script, and so as to collect the scene information for making a mistake, and generation should Followed the trail of with program app and reported.In one embodiment, following the trail of report acquisition unit can be by application program The tracking report of app is sent to scene regression test unit.
In one embodiment, scene regression test unit can be based on application program app of the second edition Tracking report scene regression test is carried out to application program app of the second edition.In the present invention, field Scape regression test refers to scene when making a mistake to application program app and reappears, and is set based on movement Standby parameter design is simulating context parameters, and then is tested.Fig. 5 is the enforcement according to the present invention The scene regression tested schematic diagram based on distributed cloud environment platform of example.As shown in figure 5, will cause The contextual information that application program app makes a mistake is divided into two kinds:Parameter based on equipment and based on application The parameter of program app.For the parameter simulation based on equipment, based on Android IDL AIDL Service simulating context, so as to change the context environmental of mobile device;For based on application program app Parameter simulation, extend tobotium test frames, so as to change the context ring of application program app Border.When scene regression test is carried out, follow the trail of in report from application program app and obtain application programming API data is injected test script by interface API information, is simulated new API and is carried out test application program app.In one embodiment, scene regression test unit can obtain the from report acquisition unit is followed the trail of The tracking report of application program app of two versions.
As described above, using the Application testing system based on distributed cloud environment platform of the invention System and method, can simulate generation wrong based on the actual parameter of the direct access from the mobile device of user Scene by mistake, and then carry out scene regression test, and be not from application program app business in conventional method City is obtaining these feedback informations, so that test is more authentic and valid.
In one embodiment, can also be wrapped based on the Application testing system of distributed cloud environment platform Include Error determining unit, judging unit and mistake and eliminate unit.
In one embodiment, whether Error determining unit can determine application program app of the second edition There is faulty operation node.It is mentioned above, when user uses application program app, may produces Mistake, Error determining unit may determine whether such faulty operation node.
In one embodiment, judging unit can work as the application program app presence mistake behaviour of the second edition When making node, it is determined that the type of mistake and wrong severity score, and the wrong severity based on mistake Score is judging whether to need to eliminate mistake.In one embodiment, judging unit can be from mistake determination Unit receives the information of the faulty operation node in application program app of the second edition, and can work as and sentence When disconnected needs eliminate mistake, type of error is sent to into mistake and eliminates unit.In the present invention, Ke Yiyong Below equation carrys out the mistake of definition application app:
Bug=(appVersion, errorType, errorReason, regressionSteps, context, device, errorSeverity) (2)
Wherein, appVersion represents the version of application program app for making a mistake, errorType tables Show the type of mistake, the reason for errorReason represents mistake, regressionSteps represents that generation is returned Operation step number of the running node of mistake to New function running node, context represent contextual information, Device represents mobile device information, and errorSeverity represents the severity score of mistake.
In one embodiment, the type of mistake includes returning mistake, context mistake, New function mistake With history mistake.The errorType values of different types of mistake are different.
In one embodiment, the recurrence for being carried out based on the old function of application program app to the second edition Test, judging unit can determine application program app of the second edition with the presence or absence of recurrence faulty operation section Point or history faulty operation node.In one embodiment, judging unit can be from function regression test list Unit 150 obtain regression tested result, and according to appVersion parameters come determine be return faulty operation Node or history faulty operation node.If appVersion represents that mistake occurs in current application journey In application program app of sequence app version, the i.e. second edition, then mistake belongs to recurrence mistake;If AppVersion represents that mistake occurs the application journey in application program app version before, i.e. first version In sequence app, then mistake belongs to history mistake.In this embodiment, the application journey to the second edition The regression test that the old function of sequence app is carried out assumes that what is carried out under identical scene.
In one embodiment, the scene regression test for being carried out based on application program app to the second edition, Judging unit can determine that application program app of the second edition whether there is context faulty operation node. In one embodiment, judging unit can obtain scene regression tested knot from scene regression test unit Really.
In one embodiment, can also be wrapped based on the Application testing system of distributed cloud environment platform New function test cell is included, for testing to the New function of application program app of the second edition, so The test that New function based on application program app to the second edition is carried out afterwards, judging unit can determine Application program app of the second edition whether there is New function faulty operation node.In one embodiment, New function test cell can be from function determining unit 140 New function determining unit 142 obtain second The New function of application program app of version, and which is tested.In this embodiment, to second The New function test that the New function of application program app of version is carried out is assumed that and is carried out under identical scene 's.
Fig. 6 is the determination application program based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the process of different types of mistake.As shown in fig. 6, the recurrence carried out under identical scene Test and New function test can determine New function mistake, return mistake and history mistake, and scene is returned Test can determine context mistake.
Fig. 7 is the determination application program based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the result of different types of mistake.As shown in fig. 7, in application program app to the second edition The regression test that carries out of old function op1 in be found that mistake, and this mistake from the second edition Application program app, then op1 belongs to recurrence mistake;In the old of application program app to the second edition It is found that mistake, and this mistake from the application of first version in the regression test that function op5 is carried out Program app, then op5 belongs to history mistake;In the New function of application program app to the second edition Mistake is found that in the New function test that op7 is carried out, then op7 belongs to New function mistake.
In one embodiment, obtained based on the popularity of the type of error score of mistake, faulty operation node The tree depth score with faulty operation node, judging unit is divided to can determine that the wrong severity of mistake is obtained Point.For example, the severity score of mistake can be determined by below equation, but the present invention is not limited In this.
ErrorSeverity=errorTypeScore* α+popularityScore* β+treeLevelScore* (1- alpha-betas) (3)
Wherein, errorSeverity represents the severity score of mistake, and errorTypeScore represents mistake Type of error score, popolarityScore represents the popularity score of faulty operation node, TreeLevelScore represents the tree depth score of faulty operation node, and α and β represents type of error score The ratio occupied in mistake in computation severity score with the popularity score of faulty operation node, and The scope of α and β is [0,1].
In one embodiment, the type based on mistake, judging unit can determine the type of error of mistake Score.It is noted above, the type of mistake can include returning mistake, context mistake, New function mistake By mistake with history mistake.Different type of error scores can be defined for different types of mistake.In table 1 An example for defining type of error score is shown, but the present invention is not limited to this.As shown in table 1, The type of error score respectively 100 of history mistake, New function mistake, recurrence mistake and context mistake, 75th, 50 and 25.
Table 1
Type of error Type of error score
History mistake 100
New function mistake 75
Return mistake 50
Context mistake 25
In one embodiment, reported based on the tracking of application program app of the second edition, judging unit Can determine the popularity score of each running node in the second operation tree.For example, can pass through following Formula determining the popularity score of each running node, but the present invention is not limited to this.
PopularityScore=activityStayTimeRate* α+clickTimesRate* β+operationWeight* (1- alpha-betas) (4)
Wherein, popularityScore represents the popularity score of running node, ActivityStayTimeRate represents that the time of staying of the corresponding operation of running node accounts for stopping for all operations The ratio of time, clickTimesRate is stayed to represent that the number of clicks of the corresponding operation of running node accounts for all The ratio of the number of clicks of operation, operationWeight represent the operating rights of the corresponding operation of running node Weight, can be by tester according to the definition of weight rule, the significance level self-defining of such as operation, α and β represent that parameter activityStayTimeRate and clickTimesRate are calculating popularity score When occupied ratio, and the scope of α and β is [0,1].
It is noted above, can be by the application program Trancking Software developing instrument in application program app Bag SDK is reported come the tracking for obtaining application program app of the second edition.The exploitation of application program app Person is embedded into application program tracking SDK in application program app, is then published to application program app Store, application program app that user downloads include application program and follow the trail of SDK.Answer when user uses During with program app, application program is followed the trail of SDK and can follow the trail of each operation, records stopping for each operation Stay time and number of clicks.When based on the Application testing system of distributed cloud environment platform obtain this After the tracking report of two version application programs app, the time of staying that can analyze each operation accounts for all The ratio and number of clicks of the time of staying of operation account for the ratio of the number of clicks of all operations.
In one embodiment, the Application testing system based on distributed cloud environment platform also includes stream Row function determining unit, determines the based on the popularity score of each running node in the second operation tree Popular function in application program app of two versions.In this embodiment, can be with setting operation node The threshold value of popularity score, when the popularity score of a running node is more than the threshold value, determines the behaviour Make popular function of the function corresponding to node for second edition application program app.
In another embodiment, the Application testing system based on distributed cloud environment platform can be with Including popular page determining unit, based on a page in application program app of the second edition The popularity score of all operations node is determining the popularity score of the page, and then determines the second edition The popular page in application program app.Likewise it is possible to the threshold value of page popularity score is set, when When the popularity score of one page is more than the threshold value, determine that the page is second edition application program app The popular page.For example, can be calculated by below equation in application program app of the second edition The popularity score of each page, but the present invention is not limited to this.
Wherein, the popularity score of popularityActivity representation pages, popularityScore (i) The popularity score of i-th running node on this page is represented, the scope of i is [1, n], and n is represented The number of running node on this page.
As the popularity score of running node is with user is in certain operational time of staying and clicks on secondary Number is relevant, therefore can reflect the popularity degree of this operation.And the popularity score of the page and the page On face, the popularity score of all of running node is relevant, therefore can reflect the popular journey of this page Degree.As described above, the Application testing system based on distributed cloud environment platform of the invention and Method, can find the popular function and the popular page of application program app automatically, and this is for application program The maintenance and renewal of app has vital effect.
In one embodiment, the position based on faulty operation node in the second operation tree, judging unit Can determine the tree depth score of faulty operation node.For example, mistake can be determined by below equation The tree depth score of maloperation node, but the present invention is not limited to this.
Wherein, treeLevelScore represents the tree depth score of faulty operation node, bugLevelDepth The tree depth of faulty operation node is represented, treeDepth represents the depth of operation tree, and 100 represent tree depth Score is hundred-mark system.In this embodiment, the tree depth representing faulty operation node of faulty operation node The number of plies in operation tree, the second operation tree as shown in Figure 2, op1 positioned at the second operation tree the Two layers, therefore the tree depth of op1 is 2.In this embodiment, the depth representing of operation tree is entirely grasped The number of plies that work is set, the second operation tree as shown in Figure 2, whole operation tree haves three layers, therefore operates tree Depth be 3.According to equation below it was determined that about 33.3 points of the tree depth score of op1.By Equation below can be seen that the running node for making a mistake the closer to root node root, and its tree depth is obtained Divide higher, represent that this mistake is more serious.
As described above, when application program app makes a mistake, judging unit can determine the mistake of mistake Severity score, is then based on the wrong severity score of the mistake to judge whether to need to eliminate the mistake By mistake.In one embodiment, the threshold value of a wrong severity score can be set, when certain mistake When mistake severity score is more than this threshold value, judging unit judges to need to eliminate the mistake.
As described above, the Application testing system based on distributed cloud environment platform of the invention and The mistake of application program app can be classified by method, and according to the wrong order of severity to mistake Scored, filtering out grave error carries out Processing for removing, grave error can then not select to ignore, It is possible thereby to the performance of application program app is improved, while reducing the quantity for processing.
In one embodiment, when mistake elimination unit can work as needs elimination mistake, according to the class of mistake Type is eliminating mistake.In one embodiment, mistake eliminates unit and can obtain mistake from judging unit Type information.
In one embodiment, for context mistake, mistake eliminates unit and can change shifting one by one The context parameters of dynamic equipment, until mistake elimination.For example, the whole world used in application program app Position system GPS is positioned and generates context mistake, then mistake eliminates unit and will forbid the application The GPS functions of program app are eliminating the context mistake.
In one embodiment, for mistake is returned, it is wrong that mistake elimination unit can calculate generation recurrence Recurrence step number of the running node to all of New function node, then according to returning step number from small to large by mistake Order New function running node is ranked up, next one by one delete New function running node, Until error disappearance.In the present invention, return step number refer to from occur return mistake running node to The step number that New function node needs.Operation tree as shown in Figure 7, from the running node for occurring to return mistake Op1 to the process of New function node op6 is:Op1-root-op2-op6, this process need 3 steps, because The recurrence step number of this op1 to op6 is 3.Similarly, the recurrence step number of op1 to op7 is arrived for 3, op1 The recurrence step number of op8 is also 3.
In one embodiment, for New function mistake, mistake eliminates unit and can delete generation New function The running node of mistake.
In one embodiment, for history mistake, mistake eliminates unit and can use than the second edition The running node corresponding with history faulty operation node in application program app that application program app updates To replace the history faulty operation node in second edition application program app.
Fig. 8 is the elimination application program based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the process of mistake.As shown in figure 8, when user is when using application program app, there occurs Mistake, Error determining unit can determine there is faulty operation node, and then being filtered out by judging unit needs Mistake to be eliminated, is eliminated unit according to wrong type to eliminate mistake, different types of mistake by mistake By mistake using different cancellations.After mistake is eliminated, application program app that generation does not have mistake is supplied User uses.
Fig. 9 is the elimination application program based on distributed cloud environment platform according to embodiments of the invention The schematic diagram of the result of mistake.As shown in figure 9, op1 belongs to recurrence faulty operation node, mistake is eliminated Unit calculates op1 and is 3, therefore one to the recurrence step number of New function node op6, op7 and op8 Individual deletion New function node, deletes op6 first, and now mistake is eliminated, then mistake eliminates process Stop.Op5 belongs to history faulty operation node, and mistake eliminates unit third edition application app In op5 replacing the op5 in second edition application program app, the wherein third edition originally to compare the second edition Newly.Op7 belongs to New function faulty operation node, and mistake eliminates unit and directly deletes op7.
As described above, the Application testing system based on distributed cloud environment platform of the invention and Method, can eliminate to different types of mistake, due to misregistration information and be sent to tester It is that, in running background, therefore user can not feel these mistakes, therefore, it is possible to obtain preferably use Experience at family.
Figure 10 illustrates application according to an embodiment of the invention based on distributed cloud environment platform The process of program testing method.As shown in Figure 10, distributed cloud environment platform can obtain different editions Application program app, and automatic detection goes out the New function of application program app, carries out new work(to New function Can test, and regression test is carried out to old function.The developer of application program app can be by application program Trancking Software development kit SDK realizes what application program app was followed the trail of in being embedded into application program app Function, and application program app is published in application program app store, user can download and use Application program app.On the one hand, application program Trancking Software development kit SDK can record user Operation, and then can analyze and find the popular function and the popular page of application program app;The opposing party Face, when mistake occurs in application program app, application program Trancking Software development kit SDK can The scenario parameters that record makes a mistake, and these scenario parameters are followed the trail of the shape of report with application program app Formula is sent to distributed cloud environment platform.On the one hand, distributed cloud environment platform can be according to application program App follows the trail of report and carries out scene regression test;On the other hand, distributed cloud environment platform is based on New function Test, regression test and scene regression test it can be found that the mistake of application program app, and according to difference Type of error come carry out mistake tracking and elimination.
Describe with reference to Figure 11 according to an embodiment of the invention based on distributed cloud environment platform Applied program testing method.As shown in figure 11, according to an embodiment of the invention based on distributed cloud ring The applied program testing method of border platform starts from step S1110.In step S1110, application is obtained The first version and the second edition of program, the wherein second edition are newer than first version.
Next, in step S1120, the application program based on first version is generated includes multiple operations First operation tree of node.
Next, in step S1130, the application program based on the second edition is generated includes multiple operations Second operation tree of node.
Next, in step S1140, comparing multiple running nodes and second operation of the first operation tree Multiple running nodes of tree, to determine the application program of the application program relative to first version of the second edition New function and old function.
Next, in step S1150, being set by using the multiple movements on distributed cloud environment platform It is standby, regression test is carried out to the old function of the application program of the second edition.After this, process terminates.
According to still another embodiment of the invention, multiple running nodes and second operation of the first operation tree are compared Multiple running nodes of tree are determining the application program of the application program relative to first version of the second edition New function and old function include:Running node in setting from the first operation in determining the second operation tree is different Running node set as the first running node set;By the operation section in the first running node set Point is defined as the New function of the application program relative to the application program of first version of the second edition.
According to still another embodiment of the invention, multiple running nodes and second operation of the first operation tree are compared Multiple running nodes of tree are determining the application program of the application program relative to first version of the second edition New function and old function include:The running node identical set with the first operation in determining the second operation tree The set of running node is used as the second running node set;Grasp in the second running node set Make node, by using the multiple mobile devices on distributed cloud environment platform, run answering for first version With program to generate the first operation user interface UI image and first page user interface UI image, and The application program of the second edition is run to generate the second operation user interface UI image and second page user Interface UI images;Relatively first operates user interface UI image and the second operation user interface UI image; Compare first page user interface UI image and second page user interface UI image;And work as above-mentioned ratio When relatively one of result is different, a running node in the second running node set is defined as into the second edition Application program relative to the application program of first version New function.
According to still another embodiment of the invention, it is flat based on distributed cloud environment according to an embodiment of the invention The applied program testing method of platform is further included:Answering for the second edition is obtained from the mobile device of user Reported with the tracking of program;And reported to the second edition based on the tracking of the application program of the second edition Application program carries out scene regression test.
According to still another embodiment of the invention, it is flat based on distributed cloud environment according to an embodiment of the invention The applied program testing method of platform is further included:Determine that the application program of the second edition whether there is mistake Running node;When there is faulty operation node in the application program of the second edition, it is determined that the type of mistake and Mistake severity score;Determine the need for eliminating mistake based on the wrong severity score of mistake;With And when needing to eliminate mistake, mistake is eliminated according to the type of mistake.
According to still another embodiment of the invention, the type of mistake includes returning mistake, context mistake, newly Capability error and history mistake, and wherein it is determined that the type of mistake includes:Based on to the second edition The regression test that the old function of application program is carried out whether there is back come the application program for determining the second edition Return faulty operation node or history faulty operation node;Based on the field that the application program to the second edition is carried out Scape regression test whether there is context faulty operation node come the application program for determining the second edition;And The New function of the application program of the second edition is tested, with determine the second edition application program whether There is New function faulty operation node.
According to still another embodiment of the invention, based on the type of error score of mistake, faulty operation node The tree depth score of popularity score and faulty operation node come determine mistake wrong severity score.
According to still another embodiment of the invention, obtained come the type of error for determining mistake based on the type of mistake Point, report to determine each the operation section in the second operation tree based on the tracking of the application program of the second edition The popularity score of point, and based on position of the faulty operation node in the second operation tree determining mistake The tree depth score of running node.
According to still another embodiment of the invention, it is flat based on distributed cloud environment according to an embodiment of the invention The applied program testing method of platform is further included:Stream based on each running node in the second operation tree Row degree score is determining the popular function in the application program of the second edition.
According to still another embodiment of the invention, developed by application program Trancking Software in the application Kit SDK is reported come the tracking for obtaining the application program of the second edition.
Applied program testing method based on distributed cloud environment platform according to an embodiment of the invention Detailed description was made before the various specific embodiments of above-mentioned steps, be not repeated.
As described above, the Application testing system based on distributed cloud environment platform of the invention and Method, is capable of the New function and old function of automatic detection application program app, and old function can be entered Row regression test.Then, be each version application program app marked erroneous so that tester These mistakes can easily be tracked.Additionally, when user is using application program app for inserting SDK When, the popular function of application program app can be found automatically, and when application program app makes a mistake When, scene information can be sent to distributed cloud environment platform so that tester can be to application program app Carry out scene regression test, at the same can based on the function of these wrong self-adaptative adjustment application programs app, The problem of application program app test until eliminating these mistakes, is efficiently solved, application program is improved The quality of app, improves the experience of user.
Obviously, the applied program testing method based on distributed cloud environment platform of the invention each Operating process can be with the computer executable program that is stored in various machine-readable storage mediums Mode is realized.
And, the purpose of the present invention can also be accomplished by:To be stored with above-mentioned executable journey During the storage medium of sequence code is directly or indirectly supplied to system or equipment, and the system or equipment Computer or CPU (CPU) read and perform said procedure code.Now, as long as The system or equipment have the function of configuration processor, then embodiments of the present invention are not limited to program, And the program can also be arbitrary form, for example, target program, interpreter perform program or It is supplied to shell script of operating system etc..
Above-mentioned these machinable mediums are included but is not limited to:Various memories and memory cell, half Conductor device, disk cell such as light, magnetic and magneto-optic disk, and other are suitable to medium of storage information etc..
In addition, computer is by the corresponding website that is connected on internet, and by the meter according to the present invention Then calculation machine program code performs the program in downloading and being installed to computer, it is also possible to realize the present invention's Technical scheme.
Figure 12 is can wherein to realize according to an embodiment of the invention based on distributed cloud environment platform The block diagram of the example arrangement of the general purpose personal computer of Application testing system and method.
As shown in figure 12, CPU 1201 according to the program stored in read-only storage (ROM) 1202 or from Storage part 1208 is loaded into the various process of program performing of random access memory (RAM) 1203. In RAM 1203, the number required when CPU 1201 performs various process etc. is stored also according to needs According to.CPU 1201, ROM 1202 and RAM 1203 are connected to each other via bus 1204.Input/ Output interface 1205 is also connected to bus 1204.
Components described below is connected to input/output interface 1205:Importation 1206 (includes keyboard, mouse Etc.), output par, c 1207 (include display, such as cathode-ray tube (CRT), liquid crystal display (LCD) Deng, and loudspeaker etc.), storage part 1208 (including hard disk etc.), communications portion 1209 (include NIC such as LAN card, modem etc.).Communications portion 1209 via network such as because Special net performs communication process.As needed, driver 1210 can be connected to input/output interface 1205. Detachable media 1211 such as disk, CD, magneto-optic disk, semiconductor memory etc. as needed by On driver 1210 so that the computer program for reading out is installed to storage as needed In part 1208.
In the case where above-mentioned series of processes is realized by software, from network such as internet or storage medium Such as detachable media 1211 installs the program for constituting software.
It will be understood by those of skill in the art that this storage medium is not limited to shown in Figure 12 wherein Have program stored therein, and equipment separately distribute to provide a user with the detachable media 1211 of program.Can The example of dismounting medium 1211 (is deposited comprising CD is read-only comprising disk (include floppy disk (registration mark)), CD Reservoir (CD-ROM) and digital universal disc (DVD)), magneto-optic disk (include mini-disk (MD) (registration mark)) And semiconductor memory.Or, storage medium can be ROM 1202, storage part 1208 in include Hard disk etc., wherein computer program stored, and be distributed to user together with comprising their equipment.
In the system and method for the present invention, it is clear that each unit or each step can be decompose and/or again Combination.These decompose and/or reconfigure should be regarded as the present invention equivalents.Also, perform above-mentioned The step of series of processes can order naturally following the instructions perform in chronological order, but and need not Necessarily perform sequentially in time.Some steps can be performed parallel or independently of one another.
Although combining accompanying drawing above describes embodiments of the invention in detail, it is to be understood that institute above The embodiment of description is only intended to the explanation present invention, and is not construed as limiting the invention.For this For the technical staff in field, above-mentioned embodiment can be made various changes and modifications without departing from The spirit and scope of the invention.Therefore, the scope of the present invention only by appended claim and its equivalent contains Justice is limiting.
With regard to the embodiment including above example, following note are also disclosed:
A kind of 1. Application testing systems based on distributed cloud environment platform are attached, including:
Acquiring unit, for obtaining the first version and the second edition of application program, wherein described second Version is newer than the first version;
First signal generating unit, generating for the application program based on the first version includes multiple operations First operation tree of node;
Second signal generating unit, generating for the application program based on the second edition includes multiple operations Second operation tree of node;
Function determining unit, for multiple running nodes and described second of comparison the first operation tree Multiple running nodes of operation tree, to determine the application program of the second edition relative to described first The New function of the application program of version and old function;And
Function regression test unit, for by using the multiple shiftings on the distributed cloud environment platform Dynamic equipment, carries out regression test to the old function of the application program of the second edition.
System of the note 2. according to note 1, wherein, the function determining unit includes:
First running node set determining unit, for determining in the second operation tree with described first The set of the running node for operating the running node in setting different is used as the first running node set;And
New function determining unit, for the running node in the first running node set is defined as New function of the application program of the second edition relative to the application program of the first version.
System of the note 3. according to note 2, the function determining unit are further included:
Second running node set determining unit, for determining in the second operation tree with described first The set of the running node identical running node of operation tree is used as the second running node set;
User interface UI image generation unit, for for a behaviour in the second running node set Make node, by using the multiple mobile devices on the distributed cloud environment platform, run described the The application program of one version is generating the first operation user interface UI image and first page user interface UI images, and the application program of the second edition is run to generate the second operation user interface UI Image and second page user interface UI image;
First comparing unit, for comparison the first operation user interface UI image and described second Operation user interface UI image;And
Second comparing unit, for the comparison first page user interface UI image and described second Page user interface UI image,
Wherein, when the comparative result of first comparing unit or second comparing unit is different When, the New function determining unit is by the one running node in the second running node set It is defined as the new work(of the application program relative to the application program of the first version of the second edition Energy.
System of the note 4. according to note 1 or 2, further includes:
Report acquisition unit is followed the trail of, for answering for the second edition is obtained from the mobile device of user Reported with the tracking of program;And
Scene regression test unit, the tracking report for the application program based on the second edition are right The application program of the second edition carries out scene regression test.
System of the note 5. according to note 4, further includes:
Error determining unit, for determining that the application program of the second edition whether there is faulty operation Node;
Judging unit, for when the application program of the second edition has faulty operation node, really The type of fixed mistake and wrong severity score;And based on it is described mistake wrong severity score come Judge whether to need to eliminate the mistake;And
Mistake eliminates unit, for when needing to eliminate described wrong, according to the type of the mistake come Eliminate the mistake.
System of the note 6. according to note 5, further includes:
New function test cell, for surveying to the New function of the application program of the second edition Examination,
Wherein, the type of the mistake includes returning mistake, context mistake, New function mistake and goes through History mistake, and
Wherein,
Based on the regression test that the old function of the application program to the second edition is carried out, the judgement Unit determines that the application program of the second edition is wrong with the presence or absence of recurrence faulty operation node or history Maloperation node,
The scene regression test carried out based on the application program to the second edition, the judging unit The application program of the second edition is determined with the presence or absence of context faulty operation node, and
The test that New function based on the application program to the second edition is carried out, the judging unit Determine that the application program of the second edition whether there is New function faulty operation node.
System of the note 7. according to note 6, wherein, obtained based on the type of error of the mistake Point, the tree depth score of the popularity score of the faulty operation node and the faulty operation node, The judging unit determines the wrong severity score of the mistake.
System of the note 8. according to note 7, wherein, it is based on the type of the mistake, described Judging unit determines the type of error score of the mistake,
Based on the tracking report of the application program of the second edition, the judging unit determines described the The popularity score of each running node in two operation trees, and
Based on position of the faulty operation node in the described second operation tree, the judging unit is true The tree depth score of the fixed faulty operation node.
System of the note 9. according to note 8, further includes:
Popular function determining unit, for the stream based on each running node in the described second operation tree Row degree score is determining the popular function in the application program of the second edition.
A kind of 10. applied program testing methods based on distributed cloud environment platform are attached, including:
The first version and the second edition of application program are obtained, wherein the second edition is than described first Version is new;
Application program based on the first version generates the first operation tree for including multiple running nodes;
Application program based on the second edition generates the second operation tree for including multiple running nodes;
Multiple running nodes of comparison the first operation tree and multiple operations of the second operation tree Node, to determine the application program of the second edition relative to the application program of the first version New function and old function;And
By using the multiple mobile devices on the distributed cloud environment platform, to the second edition The old function of application program carry out regression test.
Method of the note 11. according to note 10, wherein, it is many that comparison first operation is set Multiple running nodes that individual running node and second operation are set are to determine answering for the second edition Included with New function and old function of the program relative to the application program of the first version:
The operation for operating the running node in tree different from described first in determining the second operation tree The set of node is used as the first running node set;
Running node in the first running node set is defined as into the application of the second edition New function of the program relative to the application program of the first version.
Method of the note 12. according to note 10 or 11, wherein, comparison first operation Multiple running nodes that multiple running nodes of tree and second operation are set are to determine the second edition This application program includes relative to the New function and old function of the application program of the first version:
The running node identical operation section set with the described first operation in determining the second operation tree The set of point is used as the second running node set;
For a running node in the second running node set, by using the distributed cloud ring Multiple mobile devices on the platform of border, run the application program of the first version to generate the first operation User interface UI image and first page user interface UI image, and run the second edition Application program with generate the second operation user interface UI image and second page user interface UI figure Picture;
The comparison first operation user interface UI image and the second operation user interface UI figure Picture;
Relatively the first page user interface UI image and second page user interface UI are schemed Picture;And
When the described first operation user interface UI image and the second operation user interface UI image The different or first page user interface UI image and second page user interface UI figure As it is different when, the one running node in the second running node set is defined as into described the New function of the application program of two versions relative to the application program of the first version.
Method of the note 13. according to note 10 or 11, further includes:
The tracking report of the application program of the second edition is obtained from the mobile device of user;And
The application journey to the second edition is reported based on the tracking of the application program of the second edition Sequence carries out scene regression test.
Method of the note 14. according to note 13, further includes:
Determine that the application program of the second edition whether there is faulty operation node;
When there is faulty operation node in the application program of the second edition, it is determined that the type of mistake and Mistake severity score;
Determine the need for eliminating the mistake based on the wrong severity score of the mistake;And
When needing to eliminate described wrong, the mistake is eliminated according to the type of the mistake.
Method of the note 15. according to note 14, wherein, the type of the mistake includes returning Mistake, context mistake, New function mistake and history mistake, and
Wherein it is determined that the type of the mistake includes:
The regression test that carried out based on the old function of the application program to the second edition and to institute The application program for stating first version is tested to determine whether the application program of the second edition deposits Returning faulty operation node or history faulty operation node;
The scene regression test carried out based on the application program to the second edition is determining described The application program of two versions whether there is context faulty operation node;And
The New function of the application program of the second edition is tested, to determine the second edition Application program whether there is New function faulty operation node.
Method of the note 16. according to note 15, wherein, the type of error based on the mistake The tree depth score of score, the popularity score of the faulty operation node and the faulty operation node To determine the wrong severity score of the mistake.
Method of the note 17. according to note 16, wherein, the type based on the mistake is come really The type of error score of the fixed mistake,
Report to determine in the second operation tree based on the tracking of the application program of the second edition Each running node popularity score, and
The mistake is determined based on position of the faulty operation node in the described second operation tree The tree depth score of running node.
Method of the note 18. according to note 17, further includes:
Described the is determined based on the popularity score of each running node in the described second operation tree Popular function in the application program of two versions.
Method of the note 19. according to note 13, wherein, by the application program Application program Trancking Software development kit SDK is obtaining chasing after for the application program of the second edition Track is reported.
A kind of 20. machinable mediums are attached, are carried including the machine being stored therein thereon The program product of device readable instruction code, wherein, the instruction code is when by computer reading and execution When, the computer can be made to perform the method according to any one of note 10-19.

Claims (10)

1. a kind of Application testing system based on distributed cloud environment platform, including:
Acquiring unit, for obtaining the first version and the second edition of application program, wherein described second Version is newer than the first version;
First signal generating unit, generating for the application program based on the first version includes multiple operations First operation tree of node;
Second signal generating unit, generating for the application program based on the second edition includes multiple operations Second operation tree of node;
Function determining unit, for multiple running nodes and described second of comparison the first operation tree Multiple running nodes of operation tree, to determine the application program of the second edition relative to described first The New function of the application program of version and old function;And
Function regression test unit, for by using the multiple shiftings on the distributed cloud environment platform Dynamic equipment, carries out regression test to the old function of the application program of the second edition.
2. system according to claim 1, wherein, the function determining unit includes:
First running node set determining unit, for determining in the second operation tree with described first The set of the running node for operating the running node in setting different is used as the first running node set;And
New function determining unit, for the running node in the first running node set is defined as New function of the application program of the second edition relative to the application program of the first version.
3. system according to claim 2, the function determining unit are further included:
Second running node set determining unit, for determining in the second operation tree with described first The set of the running node identical running node of operation tree is used as the second running node set;
User interface UI image generation unit, for for a behaviour in the second running node set Make node, by using the multiple mobile devices on the distributed cloud environment platform, run described the The application program of one version is generating the first operation user interface UI image and first page user interface UI images, and the application program of the second edition is run to generate the second operation user interface UI Image and second page user interface UI image;
First comparing unit, for comparison the first operation user interface UI image and described second Operation user interface UI image;And
Second comparing unit, for the comparison first page user interface UI image and described second Page user interface UI image,
Wherein, when the comparative result of first comparing unit or second comparing unit is different When, the New function determining unit is by the one running node in the second running node set It is defined as the new work(of the application program relative to the application program of the first version of the second edition Energy.
4. system according to claim 1 and 2, further includes:
Report acquisition unit is followed the trail of, for answering for the second edition is obtained from the mobile device of user Reported with the tracking of program;And
Scene regression test unit, the tracking report for the application program based on the second edition are right The application program of the second edition carries out scene regression test.
5. system according to claim 4, further includes:
Error determining unit, for determining that the application program of the second edition whether there is faulty operation Node;
Judging unit, for when the application program of the second edition has faulty operation node, really The type of fixed mistake and wrong severity score;And based on it is described mistake wrong severity score come Judge whether to need to eliminate the mistake;And
Mistake eliminates unit, for when needing to eliminate described wrong, according to the type of the mistake come Eliminate the mistake.
6. system according to claim 5, further includes:
New function test cell, for surveying to the New function of the application program of the second edition Examination,
Wherein, the type of the mistake includes returning mistake, context mistake, New function mistake and goes through History mistake, and
Wherein,
Based on the regression test that the old function of the application program to the second edition is carried out, the judgement Unit determines that the application program of the second edition is wrong with the presence or absence of recurrence faulty operation node or history Maloperation node,
The scene regression test carried out based on the application program to the second edition, the judging unit The application program of the second edition is determined with the presence or absence of context faulty operation node, and
The test that New function based on the application program to the second edition is carried out, the judging unit Determine that the application program of the second edition whether there is New function faulty operation node.
7. system according to claim 6, wherein, obtained based on the type of error of the mistake Point, the tree depth score of the popularity score of the faulty operation node and the faulty operation node, The judging unit determines the wrong severity score of the mistake.
8. system according to claim 7, wherein, it is based on the type of the mistake, described Judging unit determines the type of error score of the mistake,
Based on the tracking report of the application program of the second edition, the judging unit determines described the The popularity score of each running node in two operation trees, and
Based on position of the faulty operation node in the described second operation tree, the judging unit is true The tree depth score of the fixed faulty operation node.
9. system according to claim 8, further includes:
Popular function determining unit, for the stream based on each running node in the described second operation tree Row degree score is determining the popular function in the application program of the second edition.
10. a kind of applied program testing method based on distributed cloud environment platform, including:
The first version and the second edition of application program are obtained, wherein the second edition is than described first Version is new;
Application program based on the first version generates the first operation tree for including multiple running nodes;
Application program based on the second edition generates the second operation tree for including multiple running nodes;
Multiple running nodes of comparison the first operation tree and multiple operations of the second operation tree Node, to determine the application program of the second edition relative to the application program of the first version New function and old function;And
By using the multiple mobile devices on the distributed cloud environment platform, to the second edition The old function of application program carry out regression test.
CN201510627937.6A 2015-09-28 2015-09-28 Application testing system and method Pending CN106557414A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510627937.6A CN106557414A (en) 2015-09-28 2015-09-28 Application testing system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510627937.6A CN106557414A (en) 2015-09-28 2015-09-28 Application testing system and method

Publications (1)

Publication Number Publication Date
CN106557414A true CN106557414A (en) 2017-04-05

Family

ID=58415729

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510627937.6A Pending CN106557414A (en) 2015-09-28 2015-09-28 Application testing system and method

Country Status (1)

Country Link
CN (1) CN106557414A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105389262A (en) * 2015-12-23 2016-03-09 北京奇虎科技有限公司 Method and device for generating test suggestions in allusion to interface tests
CN107733894A (en) * 2017-10-19 2018-02-23 携程旅游网络技术(上海)有限公司 Comparison method, system, equipment and the storage medium of logic interfacing message
CN107798400A (en) * 2017-11-15 2018-03-13 广东华仝九方科技有限公司 A kind of mobile phone client software quality matter method and device
CN109818778A (en) * 2018-12-21 2019-05-28 北京奇安信科技有限公司 A kind of automatic regression test method, system, equipment and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902619A (en) * 2011-07-29 2013-01-30 阿里巴巴集团控股有限公司 Method and device for regression testing of Web application programs
CN103577526A (en) * 2013-08-01 2014-02-12 星云融创(北京)信息技术有限公司 Method and system as well as browser for verifying page modification
CN103699488A (en) * 2013-12-30 2014-04-02 优视科技有限公司 Call relation dependence graph based regression testing method and system
CN104378252A (en) * 2014-08-26 2015-02-25 国家电网公司 Cloud testing service platform
CN104699602A (en) * 2013-12-06 2015-06-10 国际商业机器公司 Method for detecting influence and computer
WO2015127767A1 (en) * 2014-02-27 2015-09-03 中兴通讯股份有限公司 Method and device for generating discrete domain phase noise

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902619A (en) * 2011-07-29 2013-01-30 阿里巴巴集团控股有限公司 Method and device for regression testing of Web application programs
CN103577526A (en) * 2013-08-01 2014-02-12 星云融创(北京)信息技术有限公司 Method and system as well as browser for verifying page modification
CN104699602A (en) * 2013-12-06 2015-06-10 国际商业机器公司 Method for detecting influence and computer
CN103699488A (en) * 2013-12-30 2014-04-02 优视科技有限公司 Call relation dependence graph based regression testing method and system
WO2015127767A1 (en) * 2014-02-27 2015-09-03 中兴通讯股份有限公司 Method and device for generating discrete domain phase noise
CN104378252A (en) * 2014-08-26 2015-02-25 国家电网公司 Cloud testing service platform

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
罗清宙: ""基于回放机制的并发程序中的错误重现方法"", 《计算机工程与设计》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105389262A (en) * 2015-12-23 2016-03-09 北京奇虎科技有限公司 Method and device for generating test suggestions in allusion to interface tests
CN105389262B (en) * 2015-12-23 2019-02-15 北京奇虎科技有限公司 A kind of method and apparatus generating Test Suggestion for interface detection
CN107733894A (en) * 2017-10-19 2018-02-23 携程旅游网络技术(上海)有限公司 Comparison method, system, equipment and the storage medium of logic interfacing message
CN107733894B (en) * 2017-10-19 2019-12-10 携程旅游网络技术(上海)有限公司 Comparison method, system, equipment and storage medium of logical interface message
CN107798400A (en) * 2017-11-15 2018-03-13 广东华仝九方科技有限公司 A kind of mobile phone client software quality matter method and device
CN109818778A (en) * 2018-12-21 2019-05-28 北京奇安信科技有限公司 A kind of automatic regression test method, system, equipment and medium

Similar Documents

Publication Publication Date Title
Griebe et al. A model-based approach to test automation for context-aware mobile applications
Winchell et al. ArcSWAT interface for SWAT 2005
CN106557414A (en) Application testing system and method
US10537801B2 (en) System and method for decision making in strategic environments
CN109828750A (en) Auto-configuration data buries method, apparatus, electronic equipment and storage medium a little
Nusrat et al. How developers optimize virtual reality applications: A study of optimization commits in open source unity projects
CN114282752A (en) Method and device for generating flow task, electronic equipment and storage medium
CN110276387A (en) A kind of generation method and device of model
CN114048024A (en) Task deployment method, device, equipment, storage medium and product
Graniero et al. A probe mechanism to couple spatially explicit agents and landscape models in an integrated modelling framework
CN108132883A (en) A kind of software test data analysis method, device, system and storage medium
Thébaud et al. Evaluation of management strategies in Ningaloo Marine Park, Western Australia
Boottho et al. Automated evaluation of online mapping platforms
US9582614B2 (en) Method and system for site and built environment information modeling and management
Luppichini et al. CleverRiver: an open source and free Google Colab toolkit for deep-learning river-flow models
CN109918286A (en) A kind of processing method and processing device of static code analysis
CN109558153A (en) Version consistency determines method, apparatus and system
Schaller et al. GIS model applications for sustainable development and environmental planning at the regional level
Moreno A vector-based geographical cellular automata model to mitigate scale sensitivity and to allow objects’ geometric transformation
Sobotkova et al. Creating large, high-quality geospatial datasets from historical maps using novice volunteers
CN116109457B (en) Access system and method applied to interaction of multiple departments in smart city
Veloso et al. A WebGIS Interface Requirements Modeling Language
Sangermano et al. Linking land change model evaluation to model objective for the assessment of land cover change impacts on biodiversity
Di Giacomo et al. Tools for a New Urban Agenda
Stevenson Methods in spatially explicit capture-recapture

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170405

WD01 Invention patent application deemed withdrawn after publication