CN106557414A - Application testing system and method - Google Patents
Application testing system and method Download PDFInfo
- Publication number
- CN106557414A CN106557414A CN201510627937.6A CN201510627937A CN106557414A CN 106557414 A CN106557414 A CN 106557414A CN 201510627937 A CN201510627937 A CN 201510627937A CN 106557414 A CN106557414 A CN 106557414A
- Authority
- CN
- China
- Prior art keywords
- application program
- edition
- mistake
- node
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention relates to the Application testing system and method based on distributed cloud environment platform.Application testing system based on distributed cloud environment platform of the invention includes acquiring unit, and for obtaining the first version and the second edition of application program, the wherein second edition is newer than first version;First signal generating unit, generating for the application program based on first version includes the first operation tree of multiple running nodes;Second signal generating unit, generating for the application program based on the second edition includes the second operation tree of multiple running nodes;Function determining unit, for comparing multiple running nodes of the first operation tree and multiple running nodes of the second operation tree, to determine New function and old function of the application program of the second edition relative to the application program of first version;And function regression test unit, for by using the multiple mobile devices on distributed cloud environment platform, carrying out regression test to the old function of the application program of the second edition.
Description
Technical field
The present invention relates to mobile test technical field, more particularly to answering based on distributed cloud environment platform
With the system and method for program test.
Background technology
There is provided the background information relevant with the present invention, this is not necessarily prior art for this part.
Nowadays, mobile Internet becomes more and more numerous with the fast development of smart mobile phone and 3G/4G networks
Honor, and people gradually begin to use smart mobile phone.There is thousands of application program app quilt daily
Develop, user is extremely concerned about the quality of these application programs app, thus usually needs to answer these
Tested with program app.However, due to lacking effective method of testing, city in mobile field at present
On field, substantial amounts of application program app mass is not very high, and they cannot meet the demand of mobile subscriber.
On the one hand, tester needs the quality of test application program app on different devices, but, mostly
Number tester lacks enough equipment;On the other hand, the speed of application program app version updating is got over
Come more frequent, tester cannot between different versions test application program app.
In traditional method, tester carrys out test application program using simulator or the prototype of oneself
app.It is recently proposed the scheme of mobile cloud test and tests solving the problems, such as application program app.Dividing
Thousands of prototype is provided on cloth cloud environment platform, user only needs to submit the application for needing test to
Program app and test script, distributed cloud environment platform automatic running test script simultaneously provide test report.
Distributed cloud environment platform solves the problems, such as that application program app is tested to a certain extent, but application
The test of program app yet suffers from some problems.On the one hand, when the edition upgrading of application program app, meeting
Some new functions are produced, these new functions operationally can sometimes cause the mistake of old function,
If not carrying out regression test to old function, cannot just find these mistakes, therefore regression test to pass
It is important.However, distributed cloud environment platform is not provided with regression tested function.On the other hand, such as
Where mistake is tracked between application program app of different editions, and it is wrong timely and effectively to eliminate these
It is also a challenge by mistake.Additionally, in existing technology, distributed cloud environment platform can only be from applying journey
Sequence app store directly can not obtain feedback from user obtaining the feedback information of application program app
Information, thus it is not accurate enough.The presence of above-mentioned these problems can all cause the quality of application program app low
Under, poor user experience.
The content of the invention
This part provides the general summary of the present invention, rather than its four corner or its whole feature
Full disclosure.
It is an object of the invention to provide a kind of Application testing system based on distributed cloud environment platform
System and method.Application according to the present invention PTS and method, by comparing answering for different editions
With the operation tree of program app come the New function of automatic detection application program app and old function, and can be with
Regression test is carried out to old function, it is to reduce impact of the New function of application program app to old function, real
The compatibility of existing different editions application program app.
According to an aspect of the present invention, there is provided a kind of application program based on distributed cloud environment platform is surveyed
Test system, including:Acquiring unit, for obtaining the first version and the second edition of application program, wherein
The second edition is newer than the first version;First signal generating unit, for based on the first version
Application program generates the first operation tree for including multiple running nodes;Second signal generating unit, for based on institute
The application program for stating the second edition generates the second operation tree for including multiple running nodes;Function determines single
Unit, multiple operations of multiple running nodes and the second operation tree for comparison the first operation tree
Node, to determine the application program of the second edition relative to the new of the application program of the first version
Function and old function;And function regression test unit, for flat by using the distributed cloud environment
Multiple mobile devices on platform, carry out regression test to the old function of the application program of the second edition.
According to a further aspect in the invention, there is provided a kind of application program based on distributed cloud environment platform
Method of testing, including:The first version and the second edition of application program are obtained, wherein the second edition
It is newer than the first version;Application program based on the first version is generated includes multiple running nodes
First operation tree;Application program based on the second edition generates the second behaviour for including multiple running nodes
Set;Multiple running nodes of comparison the first operation tree and multiple operation sections of the second operation tree
Point, to determine new work(of the application program of the second edition relative to the application program of the first version
Can be with old function;And by using the multiple mobile devices on the distributed cloud environment platform, to institute
The old function of stating the application program of the second edition carries out regression test.
According to a further aspect in the invention, there is provided a kind of program product, the program product include being stored in
Machine readable instructions code therein, wherein, the instruction code when by computer read and perform when,
The computer can be made to perform the application program based on distributed cloud environment platform of the invention survey
Method for testing.
According to a further aspect in the invention, there is provided a kind of machinable medium, root is carried thereon
According to the program product of the present invention.
Using the Application testing system and method based on distributed cloud environment platform of the invention,
Can in application program app version updating automatic detection New function, and old function can be carried out back
Return test, the compatibility of different editions application program app can be realized, effectively solving application program app is surveyed
The problem of examination, improves the quality of application program app, improves Consumer's Experience.
Description and specific examples in this summary is intended merely to the purpose illustrated, and is not intended to limit this
Bright scope.
Description of the drawings
Accompanying drawing described here is intended merely to the purpose of the signal of selected embodiment and not all possible reality
Apply, and be not intended to limit the scope of the present invention.In the accompanying drawings:
Fig. 1 is to be surveyed according to the application program based on distributed cloud environment platform of embodiments of the invention
The structured flowchart of test system;
Fig. 2 is illustrated and is based on distributed cloud environment platform really according to an embodiment of the invention
Determine the process of the New function and old function of application program;
Fig. 3 is to be surveyed according to the application program based on distributed cloud environment platform of embodiments of the invention
The structured flowchart of the function determining unit of test system;
Fig. 4 is the application based on distributed cloud environment platform according to an alternative embodiment of the invention
The structured flowchart of the function determining unit of PTS;
Fig. 5 is to be returned to survey according to the scene based on distributed cloud environment platform of embodiments of the invention
The schematic diagram of examination;
Fig. 6 is the determination application journey based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the process of the different types of mistake of sequence;
Fig. 7 is the determination application journey based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the result of the different types of mistake of sequence;
Fig. 8 is the elimination application journey based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the process of the mistake of sequence;
Fig. 9 is the elimination application journey based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the result of the mistake of sequence;
Figure 10 illustrates answering based on distributed cloud environment platform according to an embodiment of the invention
With the process of program testing method;
Figure 11 is to be surveyed according to the application program based on distributed cloud environment platform of embodiments of the invention
The flow chart of method for testing;And
Figure 12 is can wherein to realize being based on distributed cloud environment platform according to an embodiment of the invention
Application testing system and method general purpose personal computer example arrangement block diagram.
Although the present invention is subjected to various modifications and alternative forms, its specific embodiment is as example
Son is shown in the drawings, and is described in detail here.It should be understood, however, that at this to particular implementation
The description of example is not intended to limit the invention to disclosed concrete form, but on the contrary, mesh of the present invention
Be intended to cover fall within the spirit and scope of the invention all modifications, it is equivalent and replace.It is noted that
, through several accompanying drawings, corresponding label indicates corresponding part.
Embodiment
With reference now to accompanying drawing, it is described more fully the example of the present invention.Hereinafter describe and substantially simply show
Example property, and be not intended to limit the present invention, application or purposes.
Example embodiment has been provided below, so that the present invention will become detailed, and will be to this area
Technical staff fully passes on its scope.Elaborate numerous specific details such as discrete cell, device and side
The example of method, to provide the detailed understanding to embodiments of the invention.To those skilled in the art
It will be obvious that, it is not necessary to using specific details, example embodiment can be with many different forms
To implement, they shall not be interpreted to limit the scope of the present invention.In some example embodiments,
Well-known process, well-known structure and widely-known technique are not described in detail.
Fig. 1 is the Application testing system based on distributed cloud environment platform according to embodiments of the invention
The structured flowchart of system.As shown in figure 1, the Application testing system 100 based on distributed cloud environment platform
Acquiring unit 110, signal generating unit 120, signal generating unit 130,140 and of function determining unit can be included
Function regression test unit 150.Distributed cloud environment platform in the present invention can test to service
TaaS platforms.
Embodiments in accordance with the present invention, acquiring unit 110 can obtain the first version of application program app
And the second edition, the wherein second edition is newer than first version.In one embodiment, acquiring unit 110
The first version and the second edition of application program app can be obtained from user.In another embodiment,
Acquiring unit 110 can be from the database of the Application testing system based on distributed cloud environment platform
Obtain the first version and/or the second edition of application program app, it is possible to application program app that will be obtained
First version and the second edition be separately sent to signal generating unit 120 and signal generating unit 130.
Embodiments in accordance with the present invention, signal generating unit 120 can be based on application programs app of first version
Generation includes the first operation tree of multiple running nodes, and what signal generating unit 130 can be based on the second edition should
Being generated with program app includes the second operation tree of multiple running nodes.In one embodiment, generate single
Unit 120 and signal generating unit 130 can obtain application program app of first version from acquiring unit 110
With application program app of the second edition, it is possible to which the first operation tree for generating and the second operation tree are sent
To function determining unit 140.In the present invention, set visually to represent application program app with operation
Operation structure.When user uses application program app, many operations can be carried out, each is operated
Running node op is defined as, can travel through to generate application program app based on user interface UI
Operation tree.In operation tree, different layers illustrates the operation location.For each version
Application program app, can generate corresponding operation tree.
In the present invention, can be using below equation come the operation of definition application app.
Operation=(appVersion, view, activity, action, enable) (1)
Wherein, operation represents certain operation, and appVersion represents the version of application program app,
View represents application program app control, and activity represents the page of the operation, and action represents the behaviour
The concrete action made, for example, " click on ", and enable represents whether the operation can cause redirecting for the page.
Fig. 2 illustrates determination according to an embodiment of the invention based on distributed cloud environment platform should
With the process of the New function and old function of program.In fig. 2, the left side is first version application program app
Operation tree, the right for second edition application program app operation tree.As shown in Fig. 2 root is represented
Root node, the operation tree of first version application program app have six running nodes of op1-op6, wherein
Op1-op4 is located at the second layer of operation tree, and op5 and op6 is located at the third layer of operation tree.Such as the first edition
Shown in the operation tree of application app, when first version application program app is run, application is opened
The homepage of program app, can carry out the operation of op1-op4 tetra-, when having carried out op2 and having operated, can be with
Op5 and op6 operations are carried out again.Similarly, the operation tree of second edition application program app have op1,
Seven running nodes of op2 and op4-op8, wherein op1, op2 and op4 are located at the second layer of operation tree,
Op5-op8 is located at the third layer of operation tree.As shown in the operation tree of second edition application program app, when
Operation the second edition application program app when, open application program app homepage, can carry out op1,
Tri- operations of op2 and op4, when op2 operations have been carried out, can carry out op5 and op6 operations again,
When op4 operations have been carried out, op7 and op8 operations can be carried out again.
Present invention employs and operate the structure set to represent application program app, can clearly indicate that should
With the relation between the operation structure and different operating of program app, it is easily understood.
Embodiments in accordance with the present invention, function determining unit 140 can compare multiple behaviour of the first operation tree
Make multiple running nodes of node and the second operation tree, it is relative with application program app for determining the second edition
In the New function and old function of application program app of first version.In the present invention, application program app
Function can be some running node.In one embodiment, function determining unit 140 can be from
Signal generating unit 120 and signal generating unit 130 obtain the first operation tree and the second operation tree respectively, it is possible to will
It is determined that old function be sent to function regression test unit 150.In the present invention, function determining unit 140
New function and old function can be determined by default rule.As shown in Fig. 2 function determining unit 140
Multiple running nodes that relatively multiple running nodes of the first operation tree and the second operation are set, and by default
Rule determine the second edition application program app relative to application program app of first version new work(
Can be running node op6, op7 and op8, old function is running node op1, op2, op4 and op5.
Embodiments in accordance with the present invention, function regression test unit 150 can be by using distributed cloud rings
Multiple mobile devices on the platform of border, carry out recurrence survey to the old function of application program app of the second edition
Examination.In the present invention, regression test is referred in application program app of the second edition, is old function
User interface UI traversal script is automatically generated, whether the operation for testing old function is correct.Implement at one
In example, function regression test unit 150 can obtain the application of the second edition from function determining unit 140
The old function of program app, it is possible to regression tested result is sent to into this and is put down based on distributed cloud environment
Other units of the Application testing system of platform carry out the operation such as interpretation of result, it is also possible to by regression test
Result be sent to user.As shown in Fig. 2 application of the function regression test unit 150 to the second edition
Old feature operation node op1, op2, op4 and op5 of program app carries out regression test.
As described above, using the Application testing system based on distributed cloud environment platform of the invention
System and method, can in app version updatings automatic detection New function, and old function can be carried out
Regression test, can realize the compatibility between different editions app, the problem of effectively solving app test,
The quality of app is improved, improves Consumer's Experience.
Fig. 3 is the Application testing system based on distributed cloud environment platform according to embodiments of the invention
The structured flowchart of the function determining unit of system.As shown in figure 3, in one embodiment, function determines single
Unit 140 can include the first running node set determining unit 141 and New function determining unit 142.
In one embodiment, the first running node set determining unit 141 can determine the second operation tree
In from the set of the different running node of running node in the first operation tree as the first running node collection
Close.Example as shown in Figure 2, the running node of the first operation tree include op1-op6, the second operation tree
Running node include op1, op2 and op4-op8, thus in the second operation tree with the first operation tree in
The different running node of running node is op7 and op8, using the set of the two running nodes as first
Running node set.In one embodiment, the first running node set determining unit 141 can be by really
The first fixed running node set is sent to New function determining unit 142.
In one embodiment, New function determining unit 142 can be by the behaviour in the first running node set
It is defined as the New function of the application program relative to the application program of first version of the second edition as node.Such as
Example shown in Fig. 2, New function determining unit 142 is by running node op7 in the first running node set
It is defined as the New function of application program app of the second edition with op8.In one embodiment, New function
Determining unit 142 can obtain the first running node collection from the first running node set determining unit 141
Close.In one embodiment, function determining unit 140 can also include old function determining unit, be used for
Running node in second operation tree in addition to New function is defined as into application program app of the second edition
Relative to the old function of application program app of first version.
Fig. 4 is the application program based on distributed cloud environment platform according to an alternative embodiment of the invention
The structured flowchart of the function determining unit of test system.As shown in figure 4, function determining unit 140 can be with
Including the first running node set determining unit 141, New function determining unit 142, the second running node
Gather determining unit 143, user interface UI image generation unit 144, comparing unit 145 and compare single
Unit 146.
In this embodiment, the first running node set determining unit 141 and New function determining unit 142
The first running node set determining unit 141 as shown in Figure 3 and New function determining unit can be adopted
142, here is omitted.
In this embodiment, the second running node set determining unit 143 can determine the second operation tree
In with first operation tree running node identical running node set as the second running node set.
Example as shown in Figure 2, the running node of the first operation tree include op1-op6, the behaviour of the second operation tree
Include op1, op2 and op4-op8 as node, thus the operation in tree in the second operation tree, is operated with first
Node identical running node be op1, op2 and op4-op6, using the set of this five running nodes as
Second running node set.In one embodiment, the second running node set determining unit 143 can be with
The the second running node set for determining is sent to into user interface UI image generation unit 144.
In this embodiment, user interface UI image generation unit 144 can be for the second operation section
A running node in point set, by using the multiple mobile devices on distributed cloud environment platform,
The application program of first version is run to generate the first operation user interface UI image and first page user
Interface UI images, and the application program of the second edition is run to generate the second operation user interface UI figure
Picture and second page user interface UI image.In the present invention, for a specific operation, operation
User interface UI image refers to the interface image related to the operation itself, page user interface UI figure
As the interface image related to full page for referring to.For example, for touch-screen type mobile phone, when execution " wechat "
When " payment " in application program app operates, operation user interface UI image can be " payment "
The sectional drawing of this button, and page user interface UI image can be the sectional drawing of full page.Such as Fig. 2
Shown example, user interface UI image generation unit 144 is in op1, op2 and op4-op6
Each, run first version application program app with generate the first operation user interface UI image and
First page user interface UI image, and application program app of the second edition is run to generate second
Operation user interface UI image and second page user interface UI image.In one embodiment, user
Interface UI image generation unit 144 can obtain second from the second running node set determining unit 143
Running node set, and the first operation user interface UI image for generating and the second operation can be used
Family interface UI images are sent to comparing unit 145, by generate first page user interface UI image and
Second page user interface UI image is sent to comparing unit 146.
In this embodiment, comparing unit 145 can compare the first operation user interface UI image and
Second operation user interface UI image.In one embodiment, comparing unit 145 can compare this two
Whether individual user interface UI image is identical.In one embodiment, comparing unit 145 can be from user
Interface UI image generation unit 144 obtains first and operates user interface UI image and the second operation user circle
Face UI images, and result of the comparison can be sent to New function determining unit 142.
In this embodiment, comparing unit 146 can compare first page user interface UI image and
Second page user interface UI image.In one embodiment, comparing unit 146 can compare this two
Whether individual user interface UI image is identical.In one embodiment, comparing unit 146 can be from user
Interface UI image generation unit 144 obtains first page user interface UI image and second page user circle
Face UI images, and result of the comparison can be sent to New function determining unit 142.
In this embodiment, when the comparative result of comparing unit 145 or comparing unit 146 is different,
A running node in second running node set is defined as the second edition by New function determining unit 142
Application program relative to the application program of first version New function.Example as shown in Figure 2, it is assumed that
The first operation user interface UI image of op6 and the second operation user interface UI image are different, Huo Zhe
One page user interface UI image is different with second page user interface UI image, then New function is true
Op6 is also defined as the New function of application program app of the second edition for order unit 142.Implement at one
In example, New function determining unit 142 can be obtained from comparing unit 145 and comparing unit 146 and be compared
Result.In one embodiment, the old function determining unit in function determining unit 140 is for by
Application program app that running node in two operation trees in addition to New function is defined as the second edition is relative
In the old function of application program app of first version.Example as shown in Figure 2, old function determining unit
Op1, op2, op4 and op5 in second edition application program app can be defined as the second edition should
With program app relative to first version application program app old function.
In another embodiment, function determining unit 140 can also include that the 3rd running node set is true
Order unit, for determining running nodes different from the running node in the second operation tree in the first operation tree
Set as the 3rd running node set, New function determining unit 142 can also be by the 3rd running node
Running node in set is defined as second edition application program app relative to first version application program
The New function of app.Example as shown in Figure 2, the 3rd running node set determining unit determine the first behaviour
It is op3 to set from the different running nodes of running node in the second operation tree, New function determining unit
142 New functions that op3 is defined as second edition application program app.
In another embodiment, the Application testing system 100 based on distributed cloud environment platform is gone back
Can include starting page generating unit, for application program app based on the second edition relative to first
The New function of version application program app is generated and starts the page.In one embodiment, start the page to generate
Unit can be from function determining unit 140 New function determining unit 142 obtain second edition application journey
The New function of sequence app.Example as shown in Figure 2, for New function op7, starts page generating unit
It is root-op4-op7 that the startup page can be generated.In another embodiment, start page generating unit
New function can also be generated and introduce navigation page, make user more easily understand New function.
As described above, using the Application testing system based on distributed cloud environment platform of the invention
System and method, can in app version updatings automatic detection New function, and can for New function from
Dynamic generation starts the page.
In one embodiment, can also be wrapped based on the Application testing system of distributed cloud environment platform
Include tracking report acquisition unit and scene regression test unit.
In one embodiment, follow the trail of report acquisition unit second can be obtained from the mobile device of user
The tracking report of application program app of version.When application program app is published to application program app store
When, in the mobile device that application program app can be downloaded to user to application program app store by user,
Then which is installed and is used.During use, application program app it may happen that mistake,
Scene information when occurring to these mistakes, i.e. context parameters are collected, the tracking report of application program
Announcement just includes these scene informations.In one embodiment, can be by application program app
Application program Trancking Software development kit SDK is obtaining the tracking of application program app of the second edition
Report.The developer of application program app is embedded into application program tracking SDK in application program app,
Then application program app store is published to, application program app that user downloads includes application program
Follow the trail of SDK.When user uses application program app, application program is followed the trail of SDK and can record user
The process of operation simultaneously automatically generates test script, and so as to collect the scene information for making a mistake, and generation should
Followed the trail of with program app and reported.In one embodiment, following the trail of report acquisition unit can be by application program
The tracking report of app is sent to scene regression test unit.
In one embodiment, scene regression test unit can be based on application program app of the second edition
Tracking report scene regression test is carried out to application program app of the second edition.In the present invention, field
Scape regression test refers to scene when making a mistake to application program app and reappears, and is set based on movement
Standby parameter design is simulating context parameters, and then is tested.Fig. 5 is the enforcement according to the present invention
The scene regression tested schematic diagram based on distributed cloud environment platform of example.As shown in figure 5, will cause
The contextual information that application program app makes a mistake is divided into two kinds:Parameter based on equipment and based on application
The parameter of program app.For the parameter simulation based on equipment, based on Android IDL AIDL
Service simulating context, so as to change the context environmental of mobile device;For based on application program app
Parameter simulation, extend tobotium test frames, so as to change the context ring of application program app
Border.When scene regression test is carried out, follow the trail of in report from application program app and obtain application programming
API data is injected test script by interface API information, is simulated new API and is carried out test application program
app.In one embodiment, scene regression test unit can obtain the from report acquisition unit is followed the trail of
The tracking report of application program app of two versions.
As described above, using the Application testing system based on distributed cloud environment platform of the invention
System and method, can simulate generation wrong based on the actual parameter of the direct access from the mobile device of user
Scene by mistake, and then carry out scene regression test, and be not from application program app business in conventional method
City is obtaining these feedback informations, so that test is more authentic and valid.
In one embodiment, can also be wrapped based on the Application testing system of distributed cloud environment platform
Include Error determining unit, judging unit and mistake and eliminate unit.
In one embodiment, whether Error determining unit can determine application program app of the second edition
There is faulty operation node.It is mentioned above, when user uses application program app, may produces
Mistake, Error determining unit may determine whether such faulty operation node.
In one embodiment, judging unit can work as the application program app presence mistake behaviour of the second edition
When making node, it is determined that the type of mistake and wrong severity score, and the wrong severity based on mistake
Score is judging whether to need to eliminate mistake.In one embodiment, judging unit can be from mistake determination
Unit receives the information of the faulty operation node in application program app of the second edition, and can work as and sentence
When disconnected needs eliminate mistake, type of error is sent to into mistake and eliminates unit.In the present invention, Ke Yiyong
Below equation carrys out the mistake of definition application app:
Bug=(appVersion, errorType, errorReason, regressionSteps, context, device, errorSeverity) (2)
Wherein, appVersion represents the version of application program app for making a mistake, errorType tables
Show the type of mistake, the reason for errorReason represents mistake, regressionSteps represents that generation is returned
Operation step number of the running node of mistake to New function running node, context represent contextual information,
Device represents mobile device information, and errorSeverity represents the severity score of mistake.
In one embodiment, the type of mistake includes returning mistake, context mistake, New function mistake
With history mistake.The errorType values of different types of mistake are different.
In one embodiment, the recurrence for being carried out based on the old function of application program app to the second edition
Test, judging unit can determine application program app of the second edition with the presence or absence of recurrence faulty operation section
Point or history faulty operation node.In one embodiment, judging unit can be from function regression test list
Unit 150 obtain regression tested result, and according to appVersion parameters come determine be return faulty operation
Node or history faulty operation node.If appVersion represents that mistake occurs in current application journey
In application program app of sequence app version, the i.e. second edition, then mistake belongs to recurrence mistake;If
AppVersion represents that mistake occurs the application journey in application program app version before, i.e. first version
In sequence app, then mistake belongs to history mistake.In this embodiment, the application journey to the second edition
The regression test that the old function of sequence app is carried out assumes that what is carried out under identical scene.
In one embodiment, the scene regression test for being carried out based on application program app to the second edition,
Judging unit can determine that application program app of the second edition whether there is context faulty operation node.
In one embodiment, judging unit can obtain scene regression tested knot from scene regression test unit
Really.
In one embodiment, can also be wrapped based on the Application testing system of distributed cloud environment platform
New function test cell is included, for testing to the New function of application program app of the second edition, so
The test that New function based on application program app to the second edition is carried out afterwards, judging unit can determine
Application program app of the second edition whether there is New function faulty operation node.In one embodiment,
New function test cell can be from function determining unit 140 New function determining unit 142 obtain second
The New function of application program app of version, and which is tested.In this embodiment, to second
The New function test that the New function of application program app of version is carried out is assumed that and is carried out under identical scene
's.
Fig. 6 is the determination application program based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the process of different types of mistake.As shown in fig. 6, the recurrence carried out under identical scene
Test and New function test can determine New function mistake, return mistake and history mistake, and scene is returned
Test can determine context mistake.
Fig. 7 is the determination application program based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the result of different types of mistake.As shown in fig. 7, in application program app to the second edition
The regression test that carries out of old function op1 in be found that mistake, and this mistake from the second edition
Application program app, then op1 belongs to recurrence mistake;In the old of application program app to the second edition
It is found that mistake, and this mistake from the application of first version in the regression test that function op5 is carried out
Program app, then op5 belongs to history mistake;In the New function of application program app to the second edition
Mistake is found that in the New function test that op7 is carried out, then op7 belongs to New function mistake.
In one embodiment, obtained based on the popularity of the type of error score of mistake, faulty operation node
The tree depth score with faulty operation node, judging unit is divided to can determine that the wrong severity of mistake is obtained
Point.For example, the severity score of mistake can be determined by below equation, but the present invention is not limited
In this.
ErrorSeverity=errorTypeScore* α+popularityScore* β+treeLevelScore* (1- alpha-betas) (3)
Wherein, errorSeverity represents the severity score of mistake, and errorTypeScore represents mistake
Type of error score, popolarityScore represents the popularity score of faulty operation node,
TreeLevelScore represents the tree depth score of faulty operation node, and α and β represents type of error score
The ratio occupied in mistake in computation severity score with the popularity score of faulty operation node, and
The scope of α and β is [0,1].
In one embodiment, the type based on mistake, judging unit can determine the type of error of mistake
Score.It is noted above, the type of mistake can include returning mistake, context mistake, New function mistake
By mistake with history mistake.Different type of error scores can be defined for different types of mistake.In table 1
An example for defining type of error score is shown, but the present invention is not limited to this.As shown in table 1,
The type of error score respectively 100 of history mistake, New function mistake, recurrence mistake and context mistake,
75th, 50 and 25.
Table 1
Type of error | Type of error score |
History mistake | 100 |
New function mistake | 75 |
Return mistake | 50 |
Context mistake | 25 |
In one embodiment, reported based on the tracking of application program app of the second edition, judging unit
Can determine the popularity score of each running node in the second operation tree.For example, can pass through following
Formula determining the popularity score of each running node, but the present invention is not limited to this.
PopularityScore=activityStayTimeRate* α+clickTimesRate* β+operationWeight* (1- alpha-betas) (4)
Wherein, popularityScore represents the popularity score of running node,
ActivityStayTimeRate represents that the time of staying of the corresponding operation of running node accounts for stopping for all operations
The ratio of time, clickTimesRate is stayed to represent that the number of clicks of the corresponding operation of running node accounts for all
The ratio of the number of clicks of operation, operationWeight represent the operating rights of the corresponding operation of running node
Weight, can be by tester according to the definition of weight rule, the significance level self-defining of such as operation,
α and β represent that parameter activityStayTimeRate and clickTimesRate are calculating popularity score
When occupied ratio, and the scope of α and β is [0,1].
It is noted above, can be by the application program Trancking Software developing instrument in application program app
Bag SDK is reported come the tracking for obtaining application program app of the second edition.The exploitation of application program app
Person is embedded into application program tracking SDK in application program app, is then published to application program app
Store, application program app that user downloads include application program and follow the trail of SDK.Answer when user uses
During with program app, application program is followed the trail of SDK and can follow the trail of each operation, records stopping for each operation
Stay time and number of clicks.When based on the Application testing system of distributed cloud environment platform obtain this
After the tracking report of two version application programs app, the time of staying that can analyze each operation accounts for all
The ratio and number of clicks of the time of staying of operation account for the ratio of the number of clicks of all operations.
In one embodiment, the Application testing system based on distributed cloud environment platform also includes stream
Row function determining unit, determines the based on the popularity score of each running node in the second operation tree
Popular function in application program app of two versions.In this embodiment, can be with setting operation node
The threshold value of popularity score, when the popularity score of a running node is more than the threshold value, determines the behaviour
Make popular function of the function corresponding to node for second edition application program app.
In another embodiment, the Application testing system based on distributed cloud environment platform can be with
Including popular page determining unit, based on a page in application program app of the second edition
The popularity score of all operations node is determining the popularity score of the page, and then determines the second edition
The popular page in application program app.Likewise it is possible to the threshold value of page popularity score is set, when
When the popularity score of one page is more than the threshold value, determine that the page is second edition application program app
The popular page.For example, can be calculated by below equation in application program app of the second edition
The popularity score of each page, but the present invention is not limited to this.
Wherein, the popularity score of popularityActivity representation pages, popularityScore (i)
The popularity score of i-th running node on this page is represented, the scope of i is [1, n], and n is represented
The number of running node on this page.
As the popularity score of running node is with user is in certain operational time of staying and clicks on secondary
Number is relevant, therefore can reflect the popularity degree of this operation.And the popularity score of the page and the page
On face, the popularity score of all of running node is relevant, therefore can reflect the popular journey of this page
Degree.As described above, the Application testing system based on distributed cloud environment platform of the invention and
Method, can find the popular function and the popular page of application program app automatically, and this is for application program
The maintenance and renewal of app has vital effect.
In one embodiment, the position based on faulty operation node in the second operation tree, judging unit
Can determine the tree depth score of faulty operation node.For example, mistake can be determined by below equation
The tree depth score of maloperation node, but the present invention is not limited to this.
Wherein, treeLevelScore represents the tree depth score of faulty operation node, bugLevelDepth
The tree depth of faulty operation node is represented, treeDepth represents the depth of operation tree, and 100 represent tree depth
Score is hundred-mark system.In this embodiment, the tree depth representing faulty operation node of faulty operation node
The number of plies in operation tree, the second operation tree as shown in Figure 2, op1 positioned at the second operation tree the
Two layers, therefore the tree depth of op1 is 2.In this embodiment, the depth representing of operation tree is entirely grasped
The number of plies that work is set, the second operation tree as shown in Figure 2, whole operation tree haves three layers, therefore operates tree
Depth be 3.According to equation below it was determined that about 33.3 points of the tree depth score of op1.By
Equation below can be seen that the running node for making a mistake the closer to root node root, and its tree depth is obtained
Divide higher, represent that this mistake is more serious.
As described above, when application program app makes a mistake, judging unit can determine the mistake of mistake
Severity score, is then based on the wrong severity score of the mistake to judge whether to need to eliminate the mistake
By mistake.In one embodiment, the threshold value of a wrong severity score can be set, when certain mistake
When mistake severity score is more than this threshold value, judging unit judges to need to eliminate the mistake.
As described above, the Application testing system based on distributed cloud environment platform of the invention and
The mistake of application program app can be classified by method, and according to the wrong order of severity to mistake
Scored, filtering out grave error carries out Processing for removing, grave error can then not select to ignore,
It is possible thereby to the performance of application program app is improved, while reducing the quantity for processing.
In one embodiment, when mistake elimination unit can work as needs elimination mistake, according to the class of mistake
Type is eliminating mistake.In one embodiment, mistake eliminates unit and can obtain mistake from judging unit
Type information.
In one embodiment, for context mistake, mistake eliminates unit and can change shifting one by one
The context parameters of dynamic equipment, until mistake elimination.For example, the whole world used in application program app
Position system GPS is positioned and generates context mistake, then mistake eliminates unit and will forbid the application
The GPS functions of program app are eliminating the context mistake.
In one embodiment, for mistake is returned, it is wrong that mistake elimination unit can calculate generation recurrence
Recurrence step number of the running node to all of New function node, then according to returning step number from small to large by mistake
Order New function running node is ranked up, next one by one delete New function running node,
Until error disappearance.In the present invention, return step number refer to from occur return mistake running node to
The step number that New function node needs.Operation tree as shown in Figure 7, from the running node for occurring to return mistake
Op1 to the process of New function node op6 is:Op1-root-op2-op6, this process need 3 steps, because
The recurrence step number of this op1 to op6 is 3.Similarly, the recurrence step number of op1 to op7 is arrived for 3, op1
The recurrence step number of op8 is also 3.
In one embodiment, for New function mistake, mistake eliminates unit and can delete generation New function
The running node of mistake.
In one embodiment, for history mistake, mistake eliminates unit and can use than the second edition
The running node corresponding with history faulty operation node in application program app that application program app updates
To replace the history faulty operation node in second edition application program app.
Fig. 8 is the elimination application program based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the process of mistake.As shown in figure 8, when user is when using application program app, there occurs
Mistake, Error determining unit can determine there is faulty operation node, and then being filtered out by judging unit needs
Mistake to be eliminated, is eliminated unit according to wrong type to eliminate mistake, different types of mistake by mistake
By mistake using different cancellations.After mistake is eliminated, application program app that generation does not have mistake is supplied
User uses.
Fig. 9 is the elimination application program based on distributed cloud environment platform according to embodiments of the invention
The schematic diagram of the result of mistake.As shown in figure 9, op1 belongs to recurrence faulty operation node, mistake is eliminated
Unit calculates op1 and is 3, therefore one to the recurrence step number of New function node op6, op7 and op8
Individual deletion New function node, deletes op6 first, and now mistake is eliminated, then mistake eliminates process
Stop.Op5 belongs to history faulty operation node, and mistake eliminates unit third edition application app
In op5 replacing the op5 in second edition application program app, the wherein third edition originally to compare the second edition
Newly.Op7 belongs to New function faulty operation node, and mistake eliminates unit and directly deletes op7.
As described above, the Application testing system based on distributed cloud environment platform of the invention and
Method, can eliminate to different types of mistake, due to misregistration information and be sent to tester
It is that, in running background, therefore user can not feel these mistakes, therefore, it is possible to obtain preferably use
Experience at family.
Figure 10 illustrates application according to an embodiment of the invention based on distributed cloud environment platform
The process of program testing method.As shown in Figure 10, distributed cloud environment platform can obtain different editions
Application program app, and automatic detection goes out the New function of application program app, carries out new work(to New function
Can test, and regression test is carried out to old function.The developer of application program app can be by application program
Trancking Software development kit SDK realizes what application program app was followed the trail of in being embedded into application program app
Function, and application program app is published in application program app store, user can download and use
Application program app.On the one hand, application program Trancking Software development kit SDK can record user
Operation, and then can analyze and find the popular function and the popular page of application program app;The opposing party
Face, when mistake occurs in application program app, application program Trancking Software development kit SDK can
The scenario parameters that record makes a mistake, and these scenario parameters are followed the trail of the shape of report with application program app
Formula is sent to distributed cloud environment platform.On the one hand, distributed cloud environment platform can be according to application program
App follows the trail of report and carries out scene regression test;On the other hand, distributed cloud environment platform is based on New function
Test, regression test and scene regression test it can be found that the mistake of application program app, and according to difference
Type of error come carry out mistake tracking and elimination.
Describe with reference to Figure 11 according to an embodiment of the invention based on distributed cloud environment platform
Applied program testing method.As shown in figure 11, according to an embodiment of the invention based on distributed cloud ring
The applied program testing method of border platform starts from step S1110.In step S1110, application is obtained
The first version and the second edition of program, the wherein second edition are newer than first version.
Next, in step S1120, the application program based on first version is generated includes multiple operations
First operation tree of node.
Next, in step S1130, the application program based on the second edition is generated includes multiple operations
Second operation tree of node.
Next, in step S1140, comparing multiple running nodes and second operation of the first operation tree
Multiple running nodes of tree, to determine the application program of the application program relative to first version of the second edition
New function and old function.
Next, in step S1150, being set by using the multiple movements on distributed cloud environment platform
It is standby, regression test is carried out to the old function of the application program of the second edition.After this, process terminates.
According to still another embodiment of the invention, multiple running nodes and second operation of the first operation tree are compared
Multiple running nodes of tree are determining the application program of the application program relative to first version of the second edition
New function and old function include:Running node in setting from the first operation in determining the second operation tree is different
Running node set as the first running node set;By the operation section in the first running node set
Point is defined as the New function of the application program relative to the application program of first version of the second edition.
According to still another embodiment of the invention, multiple running nodes and second operation of the first operation tree are compared
Multiple running nodes of tree are determining the application program of the application program relative to first version of the second edition
New function and old function include:The running node identical set with the first operation in determining the second operation tree
The set of running node is used as the second running node set;Grasp in the second running node set
Make node, by using the multiple mobile devices on distributed cloud environment platform, run answering for first version
With program to generate the first operation user interface UI image and first page user interface UI image, and
The application program of the second edition is run to generate the second operation user interface UI image and second page user
Interface UI images;Relatively first operates user interface UI image and the second operation user interface UI image;
Compare first page user interface UI image and second page user interface UI image;And work as above-mentioned ratio
When relatively one of result is different, a running node in the second running node set is defined as into the second edition
Application program relative to the application program of first version New function.
According to still another embodiment of the invention, it is flat based on distributed cloud environment according to an embodiment of the invention
The applied program testing method of platform is further included:Answering for the second edition is obtained from the mobile device of user
Reported with the tracking of program;And reported to the second edition based on the tracking of the application program of the second edition
Application program carries out scene regression test.
According to still another embodiment of the invention, it is flat based on distributed cloud environment according to an embodiment of the invention
The applied program testing method of platform is further included:Determine that the application program of the second edition whether there is mistake
Running node;When there is faulty operation node in the application program of the second edition, it is determined that the type of mistake and
Mistake severity score;Determine the need for eliminating mistake based on the wrong severity score of mistake;With
And when needing to eliminate mistake, mistake is eliminated according to the type of mistake.
According to still another embodiment of the invention, the type of mistake includes returning mistake, context mistake, newly
Capability error and history mistake, and wherein it is determined that the type of mistake includes:Based on to the second edition
The regression test that the old function of application program is carried out whether there is back come the application program for determining the second edition
Return faulty operation node or history faulty operation node;Based on the field that the application program to the second edition is carried out
Scape regression test whether there is context faulty operation node come the application program for determining the second edition;And
The New function of the application program of the second edition is tested, with determine the second edition application program whether
There is New function faulty operation node.
According to still another embodiment of the invention, based on the type of error score of mistake, faulty operation node
The tree depth score of popularity score and faulty operation node come determine mistake wrong severity score.
According to still another embodiment of the invention, obtained come the type of error for determining mistake based on the type of mistake
Point, report to determine each the operation section in the second operation tree based on the tracking of the application program of the second edition
The popularity score of point, and based on position of the faulty operation node in the second operation tree determining mistake
The tree depth score of running node.
According to still another embodiment of the invention, it is flat based on distributed cloud environment according to an embodiment of the invention
The applied program testing method of platform is further included:Stream based on each running node in the second operation tree
Row degree score is determining the popular function in the application program of the second edition.
According to still another embodiment of the invention, developed by application program Trancking Software in the application
Kit SDK is reported come the tracking for obtaining the application program of the second edition.
Applied program testing method based on distributed cloud environment platform according to an embodiment of the invention
Detailed description was made before the various specific embodiments of above-mentioned steps, be not repeated.
As described above, the Application testing system based on distributed cloud environment platform of the invention and
Method, is capable of the New function and old function of automatic detection application program app, and old function can be entered
Row regression test.Then, be each version application program app marked erroneous so that tester
These mistakes can easily be tracked.Additionally, when user is using application program app for inserting SDK
When, the popular function of application program app can be found automatically, and when application program app makes a mistake
When, scene information can be sent to distributed cloud environment platform so that tester can be to application program app
Carry out scene regression test, at the same can based on the function of these wrong self-adaptative adjustment application programs app,
The problem of application program app test until eliminating these mistakes, is efficiently solved, application program is improved
The quality of app, improves the experience of user.
Obviously, the applied program testing method based on distributed cloud environment platform of the invention each
Operating process can be with the computer executable program that is stored in various machine-readable storage mediums
Mode is realized.
And, the purpose of the present invention can also be accomplished by:To be stored with above-mentioned executable journey
During the storage medium of sequence code is directly or indirectly supplied to system or equipment, and the system or equipment
Computer or CPU (CPU) read and perform said procedure code.Now, as long as
The system or equipment have the function of configuration processor, then embodiments of the present invention are not limited to program,
And the program can also be arbitrary form, for example, target program, interpreter perform program or
It is supplied to shell script of operating system etc..
Above-mentioned these machinable mediums are included but is not limited to:Various memories and memory cell, half
Conductor device, disk cell such as light, magnetic and magneto-optic disk, and other are suitable to medium of storage information etc..
In addition, computer is by the corresponding website that is connected on internet, and by the meter according to the present invention
Then calculation machine program code performs the program in downloading and being installed to computer, it is also possible to realize the present invention's
Technical scheme.
Figure 12 is can wherein to realize according to an embodiment of the invention based on distributed cloud environment platform
The block diagram of the example arrangement of the general purpose personal computer of Application testing system and method.
As shown in figure 12, CPU 1201 according to the program stored in read-only storage (ROM) 1202 or from
Storage part 1208 is loaded into the various process of program performing of random access memory (RAM) 1203.
In RAM 1203, the number required when CPU 1201 performs various process etc. is stored also according to needs
According to.CPU 1201, ROM 1202 and RAM 1203 are connected to each other via bus 1204.Input/
Output interface 1205 is also connected to bus 1204.
Components described below is connected to input/output interface 1205:Importation 1206 (includes keyboard, mouse
Etc.), output par, c 1207 (include display, such as cathode-ray tube (CRT), liquid crystal display (LCD)
Deng, and loudspeaker etc.), storage part 1208 (including hard disk etc.), communications portion 1209 (include
NIC such as LAN card, modem etc.).Communications portion 1209 via network such as because
Special net performs communication process.As needed, driver 1210 can be connected to input/output interface 1205.
Detachable media 1211 such as disk, CD, magneto-optic disk, semiconductor memory etc. as needed by
On driver 1210 so that the computer program for reading out is installed to storage as needed
In part 1208.
In the case where above-mentioned series of processes is realized by software, from network such as internet or storage medium
Such as detachable media 1211 installs the program for constituting software.
It will be understood by those of skill in the art that this storage medium is not limited to shown in Figure 12 wherein
Have program stored therein, and equipment separately distribute to provide a user with the detachable media 1211 of program.Can
The example of dismounting medium 1211 (is deposited comprising CD is read-only comprising disk (include floppy disk (registration mark)), CD
Reservoir (CD-ROM) and digital universal disc (DVD)), magneto-optic disk (include mini-disk (MD) (registration mark))
And semiconductor memory.Or, storage medium can be ROM 1202, storage part 1208 in include
Hard disk etc., wherein computer program stored, and be distributed to user together with comprising their equipment.
In the system and method for the present invention, it is clear that each unit or each step can be decompose and/or again
Combination.These decompose and/or reconfigure should be regarded as the present invention equivalents.Also, perform above-mentioned
The step of series of processes can order naturally following the instructions perform in chronological order, but and need not
Necessarily perform sequentially in time.Some steps can be performed parallel or independently of one another.
Although combining accompanying drawing above describes embodiments of the invention in detail, it is to be understood that institute above
The embodiment of description is only intended to the explanation present invention, and is not construed as limiting the invention.For this
For the technical staff in field, above-mentioned embodiment can be made various changes and modifications without departing from
The spirit and scope of the invention.Therefore, the scope of the present invention only by appended claim and its equivalent contains
Justice is limiting.
With regard to the embodiment including above example, following note are also disclosed:
A kind of 1. Application testing systems based on distributed cloud environment platform are attached, including:
Acquiring unit, for obtaining the first version and the second edition of application program, wherein described second
Version is newer than the first version;
First signal generating unit, generating for the application program based on the first version includes multiple operations
First operation tree of node;
Second signal generating unit, generating for the application program based on the second edition includes multiple operations
Second operation tree of node;
Function determining unit, for multiple running nodes and described second of comparison the first operation tree
Multiple running nodes of operation tree, to determine the application program of the second edition relative to described first
The New function of the application program of version and old function;And
Function regression test unit, for by using the multiple shiftings on the distributed cloud environment platform
Dynamic equipment, carries out regression test to the old function of the application program of the second edition.
System of the note 2. according to note 1, wherein, the function determining unit includes:
First running node set determining unit, for determining in the second operation tree with described first
The set of the running node for operating the running node in setting different is used as the first running node set;And
New function determining unit, for the running node in the first running node set is defined as
New function of the application program of the second edition relative to the application program of the first version.
System of the note 3. according to note 2, the function determining unit are further included:
Second running node set determining unit, for determining in the second operation tree with described first
The set of the running node identical running node of operation tree is used as the second running node set;
User interface UI image generation unit, for for a behaviour in the second running node set
Make node, by using the multiple mobile devices on the distributed cloud environment platform, run described the
The application program of one version is generating the first operation user interface UI image and first page user interface
UI images, and the application program of the second edition is run to generate the second operation user interface UI
Image and second page user interface UI image;
First comparing unit, for comparison the first operation user interface UI image and described second
Operation user interface UI image;And
Second comparing unit, for the comparison first page user interface UI image and described second
Page user interface UI image,
Wherein, when the comparative result of first comparing unit or second comparing unit is different
When, the New function determining unit is by the one running node in the second running node set
It is defined as the new work(of the application program relative to the application program of the first version of the second edition
Energy.
System of the note 4. according to note 1 or 2, further includes:
Report acquisition unit is followed the trail of, for answering for the second edition is obtained from the mobile device of user
Reported with the tracking of program;And
Scene regression test unit, the tracking report for the application program based on the second edition are right
The application program of the second edition carries out scene regression test.
System of the note 5. according to note 4, further includes:
Error determining unit, for determining that the application program of the second edition whether there is faulty operation
Node;
Judging unit, for when the application program of the second edition has faulty operation node, really
The type of fixed mistake and wrong severity score;And based on it is described mistake wrong severity score come
Judge whether to need to eliminate the mistake;And
Mistake eliminates unit, for when needing to eliminate described wrong, according to the type of the mistake come
Eliminate the mistake.
System of the note 6. according to note 5, further includes:
New function test cell, for surveying to the New function of the application program of the second edition
Examination,
Wherein, the type of the mistake includes returning mistake, context mistake, New function mistake and goes through
History mistake, and
Wherein,
Based on the regression test that the old function of the application program to the second edition is carried out, the judgement
Unit determines that the application program of the second edition is wrong with the presence or absence of recurrence faulty operation node or history
Maloperation node,
The scene regression test carried out based on the application program to the second edition, the judging unit
The application program of the second edition is determined with the presence or absence of context faulty operation node, and
The test that New function based on the application program to the second edition is carried out, the judging unit
Determine that the application program of the second edition whether there is New function faulty operation node.
System of the note 7. according to note 6, wherein, obtained based on the type of error of the mistake
Point, the tree depth score of the popularity score of the faulty operation node and the faulty operation node,
The judging unit determines the wrong severity score of the mistake.
System of the note 8. according to note 7, wherein, it is based on the type of the mistake, described
Judging unit determines the type of error score of the mistake,
Based on the tracking report of the application program of the second edition, the judging unit determines described the
The popularity score of each running node in two operation trees, and
Based on position of the faulty operation node in the described second operation tree, the judging unit is true
The tree depth score of the fixed faulty operation node.
System of the note 9. according to note 8, further includes:
Popular function determining unit, for the stream based on each running node in the described second operation tree
Row degree score is determining the popular function in the application program of the second edition.
A kind of 10. applied program testing methods based on distributed cloud environment platform are attached, including:
The first version and the second edition of application program are obtained, wherein the second edition is than described first
Version is new;
Application program based on the first version generates the first operation tree for including multiple running nodes;
Application program based on the second edition generates the second operation tree for including multiple running nodes;
Multiple running nodes of comparison the first operation tree and multiple operations of the second operation tree
Node, to determine the application program of the second edition relative to the application program of the first version
New function and old function;And
By using the multiple mobile devices on the distributed cloud environment platform, to the second edition
The old function of application program carry out regression test.
Method of the note 11. according to note 10, wherein, it is many that comparison first operation is set
Multiple running nodes that individual running node and second operation are set are to determine answering for the second edition
Included with New function and old function of the program relative to the application program of the first version:
The operation for operating the running node in tree different from described first in determining the second operation tree
The set of node is used as the first running node set;
Running node in the first running node set is defined as into the application of the second edition
New function of the program relative to the application program of the first version.
Method of the note 12. according to note 10 or 11, wherein, comparison first operation
Multiple running nodes that multiple running nodes of tree and second operation are set are to determine the second edition
This application program includes relative to the New function and old function of the application program of the first version:
The running node identical operation section set with the described first operation in determining the second operation tree
The set of point is used as the second running node set;
For a running node in the second running node set, by using the distributed cloud ring
Multiple mobile devices on the platform of border, run the application program of the first version to generate the first operation
User interface UI image and first page user interface UI image, and run the second edition
Application program with generate the second operation user interface UI image and second page user interface UI figure
Picture;
The comparison first operation user interface UI image and the second operation user interface UI figure
Picture;
Relatively the first page user interface UI image and second page user interface UI are schemed
Picture;And
When the described first operation user interface UI image and the second operation user interface UI image
The different or first page user interface UI image and second page user interface UI figure
As it is different when, the one running node in the second running node set is defined as into described the
New function of the application program of two versions relative to the application program of the first version.
Method of the note 13. according to note 10 or 11, further includes:
The tracking report of the application program of the second edition is obtained from the mobile device of user;And
The application journey to the second edition is reported based on the tracking of the application program of the second edition
Sequence carries out scene regression test.
Method of the note 14. according to note 13, further includes:
Determine that the application program of the second edition whether there is faulty operation node;
When there is faulty operation node in the application program of the second edition, it is determined that the type of mistake and
Mistake severity score;
Determine the need for eliminating the mistake based on the wrong severity score of the mistake;And
When needing to eliminate described wrong, the mistake is eliminated according to the type of the mistake.
Method of the note 15. according to note 14, wherein, the type of the mistake includes returning
Mistake, context mistake, New function mistake and history mistake, and
Wherein it is determined that the type of the mistake includes:
The regression test that carried out based on the old function of the application program to the second edition and to institute
The application program for stating first version is tested to determine whether the application program of the second edition deposits
Returning faulty operation node or history faulty operation node;
The scene regression test carried out based on the application program to the second edition is determining described
The application program of two versions whether there is context faulty operation node;And
The New function of the application program of the second edition is tested, to determine the second edition
Application program whether there is New function faulty operation node.
Method of the note 16. according to note 15, wherein, the type of error based on the mistake
The tree depth score of score, the popularity score of the faulty operation node and the faulty operation node
To determine the wrong severity score of the mistake.
Method of the note 17. according to note 16, wherein, the type based on the mistake is come really
The type of error score of the fixed mistake,
Report to determine in the second operation tree based on the tracking of the application program of the second edition
Each running node popularity score, and
The mistake is determined based on position of the faulty operation node in the described second operation tree
The tree depth score of running node.
Method of the note 18. according to note 17, further includes:
Described the is determined based on the popularity score of each running node in the described second operation tree
Popular function in the application program of two versions.
Method of the note 19. according to note 13, wherein, by the application program
Application program Trancking Software development kit SDK is obtaining chasing after for the application program of the second edition
Track is reported.
A kind of 20. machinable mediums are attached, are carried including the machine being stored therein thereon
The program product of device readable instruction code, wherein, the instruction code is when by computer reading and execution
When, the computer can be made to perform the method according to any one of note 10-19.
Claims (10)
1. a kind of Application testing system based on distributed cloud environment platform, including:
Acquiring unit, for obtaining the first version and the second edition of application program, wherein described second
Version is newer than the first version;
First signal generating unit, generating for the application program based on the first version includes multiple operations
First operation tree of node;
Second signal generating unit, generating for the application program based on the second edition includes multiple operations
Second operation tree of node;
Function determining unit, for multiple running nodes and described second of comparison the first operation tree
Multiple running nodes of operation tree, to determine the application program of the second edition relative to described first
The New function of the application program of version and old function;And
Function regression test unit, for by using the multiple shiftings on the distributed cloud environment platform
Dynamic equipment, carries out regression test to the old function of the application program of the second edition.
2. system according to claim 1, wherein, the function determining unit includes:
First running node set determining unit, for determining in the second operation tree with described first
The set of the running node for operating the running node in setting different is used as the first running node set;And
New function determining unit, for the running node in the first running node set is defined as
New function of the application program of the second edition relative to the application program of the first version.
3. system according to claim 2, the function determining unit are further included:
Second running node set determining unit, for determining in the second operation tree with described first
The set of the running node identical running node of operation tree is used as the second running node set;
User interface UI image generation unit, for for a behaviour in the second running node set
Make node, by using the multiple mobile devices on the distributed cloud environment platform, run described the
The application program of one version is generating the first operation user interface UI image and first page user interface
UI images, and the application program of the second edition is run to generate the second operation user interface UI
Image and second page user interface UI image;
First comparing unit, for comparison the first operation user interface UI image and described second
Operation user interface UI image;And
Second comparing unit, for the comparison first page user interface UI image and described second
Page user interface UI image,
Wherein, when the comparative result of first comparing unit or second comparing unit is different
When, the New function determining unit is by the one running node in the second running node set
It is defined as the new work(of the application program relative to the application program of the first version of the second edition
Energy.
4. system according to claim 1 and 2, further includes:
Report acquisition unit is followed the trail of, for answering for the second edition is obtained from the mobile device of user
Reported with the tracking of program;And
Scene regression test unit, the tracking report for the application program based on the second edition are right
The application program of the second edition carries out scene regression test.
5. system according to claim 4, further includes:
Error determining unit, for determining that the application program of the second edition whether there is faulty operation
Node;
Judging unit, for when the application program of the second edition has faulty operation node, really
The type of fixed mistake and wrong severity score;And based on it is described mistake wrong severity score come
Judge whether to need to eliminate the mistake;And
Mistake eliminates unit, for when needing to eliminate described wrong, according to the type of the mistake come
Eliminate the mistake.
6. system according to claim 5, further includes:
New function test cell, for surveying to the New function of the application program of the second edition
Examination,
Wherein, the type of the mistake includes returning mistake, context mistake, New function mistake and goes through
History mistake, and
Wherein,
Based on the regression test that the old function of the application program to the second edition is carried out, the judgement
Unit determines that the application program of the second edition is wrong with the presence or absence of recurrence faulty operation node or history
Maloperation node,
The scene regression test carried out based on the application program to the second edition, the judging unit
The application program of the second edition is determined with the presence or absence of context faulty operation node, and
The test that New function based on the application program to the second edition is carried out, the judging unit
Determine that the application program of the second edition whether there is New function faulty operation node.
7. system according to claim 6, wherein, obtained based on the type of error of the mistake
Point, the tree depth score of the popularity score of the faulty operation node and the faulty operation node,
The judging unit determines the wrong severity score of the mistake.
8. system according to claim 7, wherein, it is based on the type of the mistake, described
Judging unit determines the type of error score of the mistake,
Based on the tracking report of the application program of the second edition, the judging unit determines described the
The popularity score of each running node in two operation trees, and
Based on position of the faulty operation node in the described second operation tree, the judging unit is true
The tree depth score of the fixed faulty operation node.
9. system according to claim 8, further includes:
Popular function determining unit, for the stream based on each running node in the described second operation tree
Row degree score is determining the popular function in the application program of the second edition.
10. a kind of applied program testing method based on distributed cloud environment platform, including:
The first version and the second edition of application program are obtained, wherein the second edition is than described first
Version is new;
Application program based on the first version generates the first operation tree for including multiple running nodes;
Application program based on the second edition generates the second operation tree for including multiple running nodes;
Multiple running nodes of comparison the first operation tree and multiple operations of the second operation tree
Node, to determine the application program of the second edition relative to the application program of the first version
New function and old function;And
By using the multiple mobile devices on the distributed cloud environment platform, to the second edition
The old function of application program carry out regression test.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510627937.6A CN106557414A (en) | 2015-09-28 | 2015-09-28 | Application testing system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510627937.6A CN106557414A (en) | 2015-09-28 | 2015-09-28 | Application testing system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106557414A true CN106557414A (en) | 2017-04-05 |
Family
ID=58415729
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510627937.6A Pending CN106557414A (en) | 2015-09-28 | 2015-09-28 | Application testing system and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106557414A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105389262A (en) * | 2015-12-23 | 2016-03-09 | 北京奇虎科技有限公司 | Method and device for generating test suggestions in allusion to interface tests |
CN107733894A (en) * | 2017-10-19 | 2018-02-23 | 携程旅游网络技术(上海)有限公司 | Comparison method, system, equipment and the storage medium of logic interfacing message |
CN107798400A (en) * | 2017-11-15 | 2018-03-13 | 广东华仝九方科技有限公司 | A kind of mobile phone client software quality matter method and device |
CN109818778A (en) * | 2018-12-21 | 2019-05-28 | 北京奇安信科技有限公司 | A kind of automatic regression test method, system, equipment and medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102902619A (en) * | 2011-07-29 | 2013-01-30 | 阿里巴巴集团控股有限公司 | Method and device for regression testing of Web application programs |
CN103577526A (en) * | 2013-08-01 | 2014-02-12 | 星云融创(北京)信息技术有限公司 | Method and system as well as browser for verifying page modification |
CN103699488A (en) * | 2013-12-30 | 2014-04-02 | 优视科技有限公司 | Call relation dependence graph based regression testing method and system |
CN104378252A (en) * | 2014-08-26 | 2015-02-25 | 国家电网公司 | Cloud testing service platform |
CN104699602A (en) * | 2013-12-06 | 2015-06-10 | 国际商业机器公司 | Method for detecting influence and computer |
WO2015127767A1 (en) * | 2014-02-27 | 2015-09-03 | 中兴通讯股份有限公司 | Method and device for generating discrete domain phase noise |
-
2015
- 2015-09-28 CN CN201510627937.6A patent/CN106557414A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102902619A (en) * | 2011-07-29 | 2013-01-30 | 阿里巴巴集团控股有限公司 | Method and device for regression testing of Web application programs |
CN103577526A (en) * | 2013-08-01 | 2014-02-12 | 星云融创(北京)信息技术有限公司 | Method and system as well as browser for verifying page modification |
CN104699602A (en) * | 2013-12-06 | 2015-06-10 | 国际商业机器公司 | Method for detecting influence and computer |
CN103699488A (en) * | 2013-12-30 | 2014-04-02 | 优视科技有限公司 | Call relation dependence graph based regression testing method and system |
WO2015127767A1 (en) * | 2014-02-27 | 2015-09-03 | 中兴通讯股份有限公司 | Method and device for generating discrete domain phase noise |
CN104378252A (en) * | 2014-08-26 | 2015-02-25 | 国家电网公司 | Cloud testing service platform |
Non-Patent Citations (1)
Title |
---|
罗清宙: ""基于回放机制的并发程序中的错误重现方法"", 《计算机工程与设计》 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105389262A (en) * | 2015-12-23 | 2016-03-09 | 北京奇虎科技有限公司 | Method and device for generating test suggestions in allusion to interface tests |
CN105389262B (en) * | 2015-12-23 | 2019-02-15 | 北京奇虎科技有限公司 | A kind of method and apparatus generating Test Suggestion for interface detection |
CN107733894A (en) * | 2017-10-19 | 2018-02-23 | 携程旅游网络技术(上海)有限公司 | Comparison method, system, equipment and the storage medium of logic interfacing message |
CN107733894B (en) * | 2017-10-19 | 2019-12-10 | 携程旅游网络技术(上海)有限公司 | Comparison method, system, equipment and storage medium of logical interface message |
CN107798400A (en) * | 2017-11-15 | 2018-03-13 | 广东华仝九方科技有限公司 | A kind of mobile phone client software quality matter method and device |
CN109818778A (en) * | 2018-12-21 | 2019-05-28 | 北京奇安信科技有限公司 | A kind of automatic regression test method, system, equipment and medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Griebe et al. | A model-based approach to test automation for context-aware mobile applications | |
Winchell et al. | ArcSWAT interface for SWAT 2005 | |
CN106557414A (en) | Application testing system and method | |
US10537801B2 (en) | System and method for decision making in strategic environments | |
CN109828750A (en) | Auto-configuration data buries method, apparatus, electronic equipment and storage medium a little | |
Nusrat et al. | How developers optimize virtual reality applications: A study of optimization commits in open source unity projects | |
CN114282752A (en) | Method and device for generating flow task, electronic equipment and storage medium | |
CN110276387A (en) | A kind of generation method and device of model | |
CN114048024A (en) | Task deployment method, device, equipment, storage medium and product | |
Graniero et al. | A probe mechanism to couple spatially explicit agents and landscape models in an integrated modelling framework | |
CN108132883A (en) | A kind of software test data analysis method, device, system and storage medium | |
Thébaud et al. | Evaluation of management strategies in Ningaloo Marine Park, Western Australia | |
Boottho et al. | Automated evaluation of online mapping platforms | |
US9582614B2 (en) | Method and system for site and built environment information modeling and management | |
Luppichini et al. | CleverRiver: an open source and free Google Colab toolkit for deep-learning river-flow models | |
CN109918286A (en) | A kind of processing method and processing device of static code analysis | |
CN109558153A (en) | Version consistency determines method, apparatus and system | |
Schaller et al. | GIS model applications for sustainable development and environmental planning at the regional level | |
Moreno | A vector-based geographical cellular automata model to mitigate scale sensitivity and to allow objects’ geometric transformation | |
Sobotkova et al. | Creating large, high-quality geospatial datasets from historical maps using novice volunteers | |
CN116109457B (en) | Access system and method applied to interaction of multiple departments in smart city | |
Veloso et al. | A WebGIS Interface Requirements Modeling Language | |
Sangermano et al. | Linking land change model evaluation to model objective for the assessment of land cover change impacts on biodiversity | |
Di Giacomo et al. | Tools for a New Urban Agenda | |
Stevenson | Methods in spatially explicit capture-recapture |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170405 |
|
WD01 | Invention patent application deemed withdrawn after publication |