CN110058991A - A kind of automatic test approach and system of application software - Google Patents
A kind of automatic test approach and system of application software Download PDFInfo
- Publication number
- CN110058991A CN110058991A CN201811459646.0A CN201811459646A CN110058991A CN 110058991 A CN110058991 A CN 110058991A CN 201811459646 A CN201811459646 A CN 201811459646A CN 110058991 A CN110058991 A CN 110058991A
- Authority
- CN
- China
- Prior art keywords
- test
- text information
- test target
- target
- text
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 239
- 238000013459 approach Methods 0.000 title description 5
- 230000009471 action Effects 0.000 claims abstract description 72
- 238000000034 method Methods 0.000 claims abstract description 42
- 238000004422 calculation algorithm Methods 0.000 claims description 23
- 238000010801 machine learning Methods 0.000 claims description 16
- 238000001514 detection method Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 238000003754 machining Methods 0.000 claims description 4
- 102100032202 Cornulin Human genes 0.000 claims 2
- 101000920981 Homo sapiens Cornulin Proteins 0.000 claims 2
- 238000013515 script Methods 0.000 abstract description 10
- 230000008569 process Effects 0.000 description 12
- 230000006870 function Effects 0.000 description 5
- BUGBHKTXTAQXES-UHFFFAOYSA-N Selenium Chemical compound [Se] BUGBHKTXTAQXES-UHFFFAOYSA-N 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 229910052711 selenium Inorganic materials 0.000 description 2
- 239000011669 selenium Substances 0.000 description 2
- 238000013522 software testing Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000012938 design process Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000013095 identification testing Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000002195 synergetic effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The present invention provides a kind of system and method tested automatically for application software, which includes receiving module, is configured as receiving the text information for indicating test target and corresponding test action；Picture recognition module is configured as identifying the test target in the view image of the application software and determines position of the test target in the view image；And calling module, it is configured as the test operation represented by the test target of the application program is called by the corresponding test action in the position based on the test target.User is not needed as a result, and encodes and application software can be tested automatically, that is, does not need user and have to write or generates the ability of script, in addition, also do not need that applied software development completion can start test script writes and record work.
Description
Technical field
The present invention relates to the testing fields of application software, more particularly to the automatic test that application software executes.
Background technique
Software test is to be examined using the mode of manual operation or software automatic running as defined in whether software meet
Demand or the process for understanding fully the difference between expected results and actual result.The automatic testing scheme of current application software includes
Selenium, Appium, Airtest and Sikuli etc..
The development of automation of Selenium and Appium mainly grab by target to be tested in the view to application software
It takes and positions, the code block of script can be used as keyword by the encapsulation of method or class and use for external scripts, but crucial
Word itself still needs to write script.
Airtext and Sikuli can be tested automatically by the mode of character and/or image recognition, but still be needed
Write or generate the script with visual aids, it is therefore desirable to which user has certain code capacity.
In addition, above-mentioned each software automatic test scheme is required to just can be carried out test foot after the completion of applied software development
This writes and records work, can not carry out in advance.
Summary of the invention
Present invention contemplates that providing the automatic test approach and system of a kind of application software, does not need user and encoded i.e.
Application software can be tested automatically, that is, not needing user has the ability for writing or generating script, in addition, also not needing to answer
Work is write and recorded with what software development was completed can to start test script.
According to one aspect, the present invention provides a kind of method tested automatically for application software.The method includes connecing
Receive the text information for indicating test target and corresponding test action；Receive the view image of the application software；In the view
The test target is identified in figure image and determines position of the test target in the view image；And based on described
Represented by the test target of the application program is called by the corresponding test action in the position of test target
Test operation.
Thus, it is only necessary to which user can input the text information for indicating test target and corresponding test action, according to this
The method of invention can execute automatically test to application software according to the requirement of user, not need user with code capacity.
In addition, due to having been able to determine that (such as " Login " etc. is pressed each test target in application software substantially in the design phase
Button) and test action (such as " click "), it is therefore not necessary to which applied software development is waited to complete, so that it may write be related to respectively in advance
Test script corresponding to a test moving-target and the test operation of test action, therefore, this makes test job and applies journey
The development of sequence can carry out parallel, may shift to an earlier date the issuing date of application program significantly.
In one embodiment, receiving one of in the following way indicates that the test target and the corresponding test are dynamic
The text information of work: user's input；Or the sequential selection from pre-generated list.Thus, on the one hand, user can be directly defeated
Enter test target and corresponding test action, on the other hand, it includes test target and correspondence that user, which can store pre-generated,
Test action list, the list is imported when needing, therefrom sequential selection test target and corresponding test action.This is to use
Family provides can be with the mode of operation of flexible choice.
In one embodiment, the method also includes receiving the text information of natural language description, the text information
Natural language description including indicating one or more test targets and corresponding test action；Based on predefined rule to institute
The natural language description in text information is stated to be parsed with the one or more of test targets of determination and the correspondence
Test action；Generate the list including one or more of test targets and the corresponding test action.
According to this embodiment, when user input be the natural language description that computer is unable to Direct Recognition text information
When, these text informations can be parsed, so that being converted to computer can be with the language of Direct Recognition.Such as when input
When being test case, which can be parsed, determine test target wherein included and corresponding test action,
List is generated, in case using when operation test.
In one embodiment, the method also includes identifying the text information of each element and position in the view image
Confidence breath；Wherein, by by the text information of each element compared with the text information for indicating the test target relatively come in institute
It states and identifies the test target in view image, and the location information by determining element corresponding with the test target
To determine the position of the test target.This make it possible to based on the received test target in the view image of application software from
The position of dynamic identification test target.
In a further embodiment, using the text detection algorithm based on machine learning, such as CTPN (Detecting
Text in Natural Image with Connectionist Text Proposal Network), detect the view
Character in image；The text filed of corresponding each element is determined based on the character detected；It text filed is cut into described
Indicate the subregion of each character；Use the character recognition algorithm based on machine learning, such as CRNN (Convolutional
Recurrent Neural Network), identify the character in each subregion to identify each member in the view image
The text information of element.
More accurate identification can be obtained and tie by carrying out text detection and character recognition using the algorithm based on machine learning
Fruit.
The present invention provides a kind of system tested automatically for application software, including receiving module according to another aspect,
It is configured as receiving the text information for indicating test target and corresponding test action；Picture recognition module is configured as
The test target is identified in the view image of the application software and determines the test target in the view image
Position；And calling module, the position based on the test target is configured as to described in the application program
Test target calling is by the test operation represented by the corresponding test action.
The present invention provides a kind of system tested automatically for application software according to another aspect,.The system comprises
Interface is configured from the external text information for receiving expression test target and corresponding test action；And processor, matched
It is set to the automatic test approach for executing each embodiment according to the present invention.
The present invention provides a kind of machine readable media according to another aspect, is stored with computer program code, the meter
Calculation machine program code executes the computer according to the present invention to application software to be tested
Each embodiment automatic test approach.
Detailed description of the invention
Fig. 1 shows the system 10 according to an embodiment of the invention that test automatically for application software；
Fig. 2 shows the signal scenes for combining forms sliding algorithm to handle the view image of application software；
Fig. 3 shows the method 100 according to an embodiment of the invention that test automatically for application software；
Fig. 4 shows the process 200 of the natural language parsing executed according to one embodiment of present invention；
Fig. 5 shows the process of application software testing according to an embodiment of the invention；
Fig. 6 shows the process of image recognition according to an embodiment of the invention.
Various aspects and features of the invention are described referring to above-mentioned attached drawing.Generally use the same or similar drawing reference numeral
To indicate identical component.Above-mentioned attached drawing is only schematical, and not restrictive.In the feelings for not departing from purport of the invention
Under condition, the size, shape of each element, label or appearance can change in above-mentioned attached drawing, without being limited to only
As only Figure of description is shown.
Specific embodiment
The embodiment of the present invention provides the system and method tested automatically for being used for application software.Application software includes but not
It is confined to mobile application, the equally applicable each embodiment of the invention of application software on computers is installed.
By means of the system and method for the embodiment of the present invention, only need to use when executing the automatic test to application software
Family, such as Test Engineer, input indicate the text information of test target and corresponding test action, so that it may automatically soft in application
The test target is identified in the view image of part, and to test target calling by the test operation represented by test action.By
This, realizes full automatic test process, alleviates the burden of user, does not need user's intervention during the test, and
Not needing user has the ability for writing or generating script, as long as he is capable of providing test target and movement.Furthermore due to
Test target is, for example, certain buttons on software interface, and test action is, for example, the click carried out to these buttons, cunning
Therefore the operation of dynamic, long-pressing etc., test target and test action are often just it is known that, use in the design process of application software
The system and method for embodiment according to the present invention, can software also it is untapped come out before, such as provide interaction design
It beginning to prepare test program relevant to each test action in the case where original text, this shortens the process of software development, so that
Software can be issued as early as possible.
Fig. 1 shows the system 10 according to an embodiment of the invention that test automatically for application software.It is described
System 10 includes receiving module 11, picture recognition module 13, calling module 14 and action executing module 15, preferably further includes solution
Analyse module 12.
Receiving module 11 is configured as receiving the text information for indicating test target and test action.Test target can be
Button on the interface of application software, text box etc..Test action includes but is not limited to click, input, sliding, long-pressing etc..
Receiving module 11 can input the interface of text information via user interface, such as user, receive text information.
Such as receiving module 11 receives user " Click ' the Login ID ' " that inputs via interface, " Input ' tngd0003 ' " and
Check ' Reload ' etc..For the application software of Chinese interface, receiving module 11 can receive the Chinese text letter of user's input
Breath, such as " clicking ' next step ' " this text information in the case where the view of application software is as shown in Figure 2, can be received.
Alternatively, receiving module 11 can import text information from the file that is stored in advance/generates, such as from pre-generated listing file
Import the list including test target and test action.Preferably, receiving module 11 can receive the view image of application software,
Such as screenshotss image.In the text information indicate test target text be not only limited to application software in the street in button
Title can also include the nickname that each button is arranged in user.
The system 10 preferably includes parsing module 12, when be not via the received text information of receiving module 11 can
By the text information of computer Direct Recognition, i.e., computer can not be directly determined test target by text information and test is dynamic
In the case where work, for example, user has input test target and the test action of natural language description, or packet has been imported from file
The test case of the natural language description to test target and test action is included, in order to by the test target of the natural language description
It is converted into the language that computer can identify with test action, parsing module 12 can be based on predefined rule to natural language
Description is parsed, so that it is determined that included one or more test targets and corresponding test action in text information.
These test targets and corresponding test action can be stored in a list.The parsing performed by parsing module 12
Operation will be specifically described later referring to embodiment shown in Fig. 4.
System 10 further includes picture recognition module 13, calling module 14 and action executing module 15.Passing through receiving module
11 receive or from as described above by the tab sequential that parsing module 12 generates selected test target and corresponding test action it
Afterwards, the processing that picture recognition module 13 carries out being preferably based on machine learning by the view image to application software is in the view figure
The test target is identified as in and determines position of the test target in view image.In one embodiment, image recognition
Module 13 can identify the text information and its location information of each element in view image, by by the text envelope of each element
Breath is compared with received test target, to identify the test target in view image, and then passes through the determining and test
The location information of the corresponding element of target determines the position of the test target.
In a preferred embodiment, picture recognition module 13 include character machining device 131, text filed determiner 132,
Character separator 133 and Character recognizer 134.Character machining device 131 is detected using the text detection algorithm based on machine learning
Character in view image out, it is preferred to use CTPN algorithm detects the character in view image.In one embodiment,
Character machining device 131 can slide algorithm in conjunction with forms to detect the character of each element in view image.Fig. 2 shows combine
The signal scene that forms sliding algorithm handles the view image of application software, arrow instruction forms therein are on the image
Sliding.Preferably, text filed determiner 132 determines text filed, the example of corresponding each element based on the character detected
Such as " next step ", this is text filed.This can be by carrying out expansion process to the character zone detected to form connected domain
To realize.Character separator 133 cuts the text filed of each element, obtains the subregion for indicating each character, this
Also algorithm can be slided in conjunction with forms to realize.Character recognizer 134 identifies the character execution character in each subregion and calculates
Method, to identify the text information of corresponding each element, such as " next step ".Preferably, using such as CRNN based on engineering
The character recognition algorithm of habit identifies the character in each subregion.It is expected that in some cases, it is convenient to omit text area
Domain determiner 132 and character separator 133, such as each region only include a character.
Picture recognition module 13 can also include identification module (not shown), by the text of each element of the correspondence identified
This information is compared with received test target, if the two matches, it is determined that the location information of the element, and then by this yuan
The location information of element determines the position of test target, i.e., position of the element in view image is determined as to the position of test target
It sets.
Calling module 14 receives corresponding with test target test action, based on the position of determining test target,
It executes in test process and test action institute corresponding with the test target is called to the test target in the view of application software
The test operation of expression.Test operation represented by each test action corresponding from different test targets can be compiled in advance
Journey is in action executing module 15, and when needing to be implemented test operation represented by a certain test action, calling module 14 is only needed
The correspondence submodule being invoked in the action executing module 15, that is, call corresponding test operation.
Have been described above with reference to fig. 1 it is according to an embodiment of the invention for application software test automatically be
System, it is also contemplated that realizing the various functions of the system by processor.For example, it is a kind of for application software test automatically be
System includes interface & processor, and processor executes above-mentioned receiving module 11, parsing module 12, picture recognition module 13, calls mould
The function of block 14 and action executing module 15.
Fig. 3 shows the method 100 according to an embodiment of the invention that test automatically for application software.According to
The embodiment receives the text information for indicating test target and corresponding test action, this may be such that computer 101
It is capable of the text information of Direct Recognition test target and test action.If computer can not directly be known according to text information
Other test target and corresponding test action, for example, providing the text information of natural language description, then 102, according to pre-
The rule of definition parses the natural language description in text information, so that it is determined that test target and corresponding test are dynamic
Make.This can be realized by parsing module 12.103, start application software, receives or store the view image of application software.Example
The view image at each interface of application software can such as be stored in advance before being tested.
Above step is related to the preparation tested application software.Although describing this method referring to preparing
100 step 101-103, it is contemplated that one or more of these steps can also execute when running test.Example
Such as, step 103 can be executed when executing test.
Following steps are related to running the test to application program.104, known in view image using image recognition algorithm
Other test target and the position for determining test target, it is preferable that the text information of each element and position in identification view image
Information, by relatively knowing the text information of each element in view image compared with the text information for indicating the test target
Other test target, and determine test target in view figure by determining the location information of element corresponding with test target
Position as in.105, the test target of application program is called by corresponding with test target in the position based on test target
Test action represented by test operation.
Fig. 4 shows the process 200 of natural language according to an embodiment of the invention parsing, this and the step in Fig. 2
Rapid 102 is corresponding, and can be executed by parsing module 12.Wherein, 201, the natural language description such as test case is received
Text information, and by i be set as 0, i be row serial number, indicate text information in the i-th row.When text information only
It can ignore when including a line.202, i+1 is assigned to i.203, judge whether gone to text information last 1
Row, n indicate total line number of text information.Terminate text resolution 204 if last 1 row for having gone to text information
And output listing；If going to last 1 row of the text not yet, the style of writing sheet is read 205, in 206 pairs of styles of writing
This is parsed, so that it is determined that test target included in it and corresponding test action.207, by identified test
List is added in target and corresponding test action.Then 202 are returned, next line text is parsed.
Above by reference to the mode parsed line by line, text resolution performed by parsing module 12 is illustrated, this is only one
Preferred embodiment is not limiting, and those skilled in the art can be considered to be solved with the other modes in addition to parsing line by line
Text information is analysed, this can be adjusted according to the feature of text information to be resolved.
Fig. 5 shows the process of application software testing according to an embodiment of the invention, the step in this corresponding diagram 2
104 and 105, and the operation executed by picture recognition module 13 and calling module 14 is related generally to, such as having received
By being executed after the determining list including test target and corresponding test action of natural language parsing.
Firstly, starting application software to be tested by user, it is assumed that exist in the list a series of test target and
Its corresponding test action, then line number can be similarly by i being initially set to 0, i 301, indicate multiple included in list
Test target and its row serial number of corresponding test action, it is also contemplated that it only indicates multiple test targets and its corresponding survey
The serial number of examination movement.302, i is assigned a value of i+1.303, judge whether i is greater than m, m indicates the test mesh for including in list
The sum of mark and corresponding test action, such as total line number of list are thereby determined whether for all test mesh in list
Mark and test action perform test.If all test targets and test action that have been directed in list perform test,
Then terminate to test and carry out resource reclaim 304, exports test report, carry out log upload.If not yet in list
All test targets and test action execute test, then 305 from list read row serial number i test target and correspondence
Test action.306, the view image of application software is received, which can be the screen picture of the software of interception,
Or the view image saved in advance.307, image recognition, such as picture recognition module 13 are carried out to received view image
It can identify the text information and its location information of each element in view image.308, by the text information of each element with
The test target read before compares, to identify in view image and the matched text information of the test target.Such as
Fruit has identified the text information to match with test target in view image, then 309, passes through the determining and test target
The location information of corresponding element determines the position of the test target.If not identifying and testing in view image
The text information that target matches, then return to 302, continues to read next test target and test action.This has been determined 309
After position of the test target in view image, can 310 check read it is corresponding with test target movement whether with
The movement that action executing module 15 is supported matches, if action executing module 15 does not include the journey for supporting the test action
Sequence continues to read next test target and test action then then returning to 302；If supported, held in 311 call actions
Correspondence test operation in row module 15 executes the correspondence test operation to the test target on the page of application program.
It is expected that in addition to starting software to be tested, each step is by picture recognition module in above-mentioned each step
13 and calling module 14 execute.It is also contemplated that realizing above-mentioned process using processor.
Fig. 6 shows the stream of the image recognition executed according to one embodiment of present invention by picture recognition module 13
Journey.401, algorithm is slided preferably in combination with forms come soft in application based on the text detection algorithm of machine learning using such as CTPN
Character is detected in the view image of part.402, image expansion is carried out to each character zone detected, forms connected domain, from
And it determines for the text filed of each element.403, to each text filed son for cutting, obtaining being directed to each character
Region.404, it is based on these subregions, execution character identification operation, such as use the algorithm based on machine learning of such as CRNN
To execute the character recognition.In addition to CTPN and CRNN, other word detection/recognition algorithms based on machine learning are also can be pre-
Phase.
Although illustrating each operation of the embodiment of the present invention with reference to above-mentioned each flow chart, those skilled in the art are answered
Work as understanding, this purpose being merely to illustrate that, rather than it is restrictive.Each step in above method process can be closed
And modify, change, even delete, to modify or omit corresponding function.
It is appreciated that the system/method tested automatically for application software of each embodiment of the invention can be by
Computer program/software is realized.These softwares can be loaded into the working storage of data processor, be used for when running
The method for executing each embodiment according to the present invention.
Following the two of exemplary embodiment covering of the invention: computer journey of the invention is created that/used from the beginning
Sequence/software, and switch to existing program/software using computer program/software of the invention by means of updating.In a reality
It applies in example, can be transformed on the basis of current open source test program/existing software to obtain reality according to the present invention
Apply the product of example.For example, being able to use the computer vision library such as OpenCV to realize that the image of various embodiments of the present invention is known
Other function, and then realize with other suites the system/method of various embodiments of the present invention.
Other embodiment according to the present invention provides a kind of machine (such as computer) readable medium, such as CD-ROM, wherein
The readable medium has the computer program element being stored in thereon, which is used to execute when running
The method of each embodiment according to the present invention.The machine readable media is, for example, together with other hardware or as other hardware
The optical storage medium or solid state medium of part supply.
The computer program for being used to execute the method for each embodiment according to the present invention can also be distributed otherwise,
Such as via internet or other wired or wireless telecommunication systems.Computer program also may be provided in such as WWW
On network, and can be from the working computer that such network is downloaded to data processor.
It must be noted that the embodiment of the present invention is described with reference to different themes.In particular, some embodiments are references
Method type claim describes, and other embodiments are reference device type claims to describe.However, this field skill
Art personnel will learn from described above and below, unless otherwise specified, in addition to belong to a type of theme feature it is any
Other than combination, be related to any combination between the feature of different themes be also regarded as by this application discloses.Further, it is possible to combine
Whole features provide the synergistic effect simply summed it up greater than feature.
The present invention is described above by reference to specific embodiment, it will be appreciated by those skilled in the art that without departing substantially from the present invention
Spirit and essential characteristics in the case where, can realize technical solution of the present invention in various ways.Specific embodiment is only
It is only illustrative, and not restrictive.In addition, between these embodiments can any combination, to achieve the object of the present invention.
Protection scope of the present invention is defined by appended claims.
One word of " comprising " in description and claims is not excluded for the presence of other element or steps.It says in the description
The function of each element that is bright or recording in the claims can also be split or combine, by corresponding multiple element or list
One element is realized.
Claims (14)
1. a kind of method tested automatically for application software, including
Receive the text information for indicating test target and corresponding test action；
Receive the view image of the application software；
The test target is identified in the view image and determines position of the test target in the view image；
And
It is called based on the test target of the position of the test target to the application program by the corresponding survey
The represented test operation of examination movement.
2. according to the method described in claim 1, wherein, receive indicates the test target and described one of in the following way
The text information of corresponding test action:
User's input；Or
The sequential selection from pre-generated list.
3. method according to claim 1 or 2 further includes
Receive the text information of natural language description, the text information includes indicating one or more test targets and corresponding
The natural language description of test action；
The natural language description in the text information is parsed based on predefined rule one with determination
Or multiple test targets and the corresponding test action；And
Generate the list including one or more of test targets and the corresponding test action.
4. method according to claim 1 or 2 further includes
Identify the text information and location information of each element in the view image；
Wherein, by by the text information of each element compared with the text information for indicating the test target relatively come in the view
The test target is identified in figure image, and by determining the location information of element corresponding with the test target come really
The position of the fixed test target.
5. according to the method described in claim 4, further including
The character in the view image is detected using the text detection algorithm based on machine learning；
The text filed of corresponding each element is determined based on the character detected；
Text filed be cut into is indicated into the subregion of each character；And
Using the character in the character recognition algorithm identification each subregion based on machine learning to identify the view image
In each element text information.
6. according to the method described in claim 5, wherein, the text detection algorithm based on machine learning includes CTPN, institute
Stating the character recognition algorithm based on machine learning includes CRNN.
7. a kind of system tested automatically for application software, including
Receiving module is configured as receiving the text information for indicating test target and corresponding test action；
Picture recognition module is configured as identifying the test target in the view image of the application software and determines institute
State position of the test target in the view image；And
Calling module is configured as the position based on the test target to the test target of the application program
Test operation represented by calling by the corresponding test action.
8. system according to claim 7, wherein obtain indicates the test target and described one of in the following way
The text information of corresponding test action:
User's input；Or
The sequential selection from pre-generated list.
9. system according to claim 7 or 8, wherein the receiving module is additionally configured to receive natural language description
Text information, the text information includes indicating that one or more test targets and the natural language of corresponding test action are retouched
It states；The Auto-Test System further include:
Parsing module is configured as carrying out the natural language description in the text information based on predefined rule
Parsing is with the one or more of test targets of determination and the corresponding test action；And it includes one or more for generating
The list of a test target and the corresponding test action.
10. system according to claim 7 or 8, wherein described image identification module is additionally configured to identify the view
The text information and location information of each element in image；Wherein, by by the text information of each element and indicating the survey
The text information of examination target identifies the test target compared to relatively in the view image, and passes through the determining and survey
The location information of the corresponding element of target is tried to determine the position of the test target.
11. system according to claim 10, wherein described image identification module includes
Character machining device is configured with the text detection algorithm based on machine learning and detects word in the view image
Symbol；
Text filed determiner is configured as determining the text filed of corresponding each element based on the character detected；
Character separator is configured as text filed be cut into indicating the subregion of each character；And
Character recognizer, the character being configured in the character recognition algorithm identification each subregion based on machine learning
To identify the text information of each element in the view image.
12. system according to claim 11, wherein the text detection algorithm based on machine learning includes CTPN,
The character recognition algorithm based on machine learning includes CRNN.
13. a kind of system tested automatically for application software, including
Interface is configured from the external text information for receiving expression test target and corresponding test action；With
Processor is configured as executing method according to claim 1 to 6.
14. a kind of machine readable media is stored with computer program code, the computer program code ought be on computers
The computer is made to execute method according to claim 1 to 6 to application software to be tested when operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811459646.0A CN110058991A (en) | 2018-11-30 | 2018-11-30 | A kind of automatic test approach and system of application software |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811459646.0A CN110058991A (en) | 2018-11-30 | 2018-11-30 | A kind of automatic test approach and system of application software |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110058991A true CN110058991A (en) | 2019-07-26 |
Family
ID=67315564
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811459646.0A Pending CN110058991A (en) | 2018-11-30 | 2018-11-30 | A kind of automatic test approach and system of application software |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110058991A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909739A (en) * | 2019-11-19 | 2020-03-24 | 广东润联信息技术有限公司 | Picture identification and operation method and device, computer equipment and storage medium |
| CN112363918A (en) * | 2020-11-02 | 2021-02-12 | 北京云聚智慧科技有限公司 | Automatic test method, device, equipment and storage medium for user interface AI |
| CN113836494A (en) * | 2021-09-13 | 2021-12-24 | 支付宝(杭州)信息技术有限公司 | Method, device, equipment and medium for auditing small program |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101526919A (en) * | 2009-04-29 | 2009-09-09 | 福建星网锐捷网络有限公司 | Method for generating script files to test Web application software and device thereof |
| CN103034856A (en) * | 2012-12-18 | 2013-04-10 | 深圳深讯和科技有限公司 | Method and device for locating text area in image |
| US20140258987A1 (en) * | 2013-03-08 | 2014-09-11 | Emc Corporation | Determining correctness of an application |
| CN105893953A (en) * | 2016-03-30 | 2016-08-24 | 上海博康智能信息技术有限公司 | Method and system for detecting two license plates of one vehicle |
| CN107871232A (en) * | 2017-10-19 | 2018-04-03 | 中国平安人寿保险股份有限公司 | A kind of generation method and its terminal of customer visit plan |
| CN108734159A (en) * | 2017-04-18 | 2018-11-02 | 苏宁云商集团股份有限公司 | The detection method and system of sensitive information in a kind of image |
| CN108763068A (en) * | 2018-05-15 | 2018-11-06 | 福建天泉教育科技有限公司 | A kind of automated testing method and terminal based on machine learning |
| CN108875722A (en) * | 2017-12-27 | 2018-11-23 | 北京旷视科技有限公司 | Character recognition and identification model training method, device and system and storage medium |
-
2018
- 2018-11-30 CN CN201811459646.0A patent/CN110058991A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101526919A (en) * | 2009-04-29 | 2009-09-09 | 福建星网锐捷网络有限公司 | Method for generating script files to test Web application software and device thereof |
| CN103034856A (en) * | 2012-12-18 | 2013-04-10 | 深圳深讯和科技有限公司 | Method and device for locating text area in image |
| US20140258987A1 (en) * | 2013-03-08 | 2014-09-11 | Emc Corporation | Determining correctness of an application |
| CN105893953A (en) * | 2016-03-30 | 2016-08-24 | 上海博康智能信息技术有限公司 | Method and system for detecting two license plates of one vehicle |
| CN108734159A (en) * | 2017-04-18 | 2018-11-02 | 苏宁云商集团股份有限公司 | The detection method and system of sensitive information in a kind of image |
| CN107871232A (en) * | 2017-10-19 | 2018-04-03 | 中国平安人寿保险股份有限公司 | A kind of generation method and its terminal of customer visit plan |
| CN108875722A (en) * | 2017-12-27 | 2018-11-23 | 北京旷视科技有限公司 | Character recognition and identification model training method, device and system and storage medium |
| CN108763068A (en) * | 2018-05-15 | 2018-11-06 | 福建天泉教育科技有限公司 | A kind of automated testing method and terminal based on machine learning |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909739A (en) * | 2019-11-19 | 2020-03-24 | 广东润联信息技术有限公司 | Picture identification and operation method and device, computer equipment and storage medium |
| CN112363918A (en) * | 2020-11-02 | 2021-02-12 | 北京云聚智慧科技有限公司 | Automatic test method, device, equipment and storage medium for user interface AI |
| CN112363918B (en) * | 2020-11-02 | 2024-03-08 | 北京云聚智慧科技有限公司 | User interface AI automatic test method, device, equipment and storage medium |
| CN113836494A (en) * | 2021-09-13 | 2021-12-24 | 支付宝(杭州)信息技术有限公司 | Method, device, equipment and medium for auditing small program |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4876511B2 (en) | Logic extraction support device | |
| US9569231B2 (en) | Device, system, and method for providing interactive guidance with execution of operations | |
| CN106095866B (en) | The optimization method and device of application program recommended method, program starting speed | |
| US10169853B2 (en) | Score weights for user interface (UI) elements | |
| CN102981954B (en) | The compatibility test method and electronic installation of a kind of input method | |
| CN110058991A (en) | A kind of automatic test approach and system of application software | |
| CN107622008B (en) | Traversal method and device for application page | |
| CN105843734A (en) | Automatic test method and device and computing device | |
| CN106598846B (en) | Application interface method of testing and device | |
| CN111091811B (en) | Method and device for processing voice training data and storage medium | |
| CN110442515B (en) | Application testing method, device, equipment and readable storage medium | |
| WO2017123203A1 (en) | Determining visual testing coverages | |
| CN110221959B (en) | Application program testing method, device and computer readable medium | |
| CN111324352A (en) | Code generation method of application page and related equipment | |
| CN110175609A (en) | Interface element detection method, device and equipment | |
| CN106982368A (en) | video response speed detection method and system | |
| JP2020106910A (en) | Animation generation system and animation generation method | |
| CN106959919B (en) | Software testing method and device based on testing path diagram | |
| KR20180129623A (en) | Apparatus for statically analyzing assembly code including assoxiated multi files | |
| CN117389890A (en) | Method and device for generating test case, electronic equipment and storage medium | |
| Bernal-Cárdenas et al. | Translating video recordings of complex mobile app ui gestures into replayable scenarios | |
| CN114897296A (en) | RPA flow labeling method, execution process playback method and storage medium | |
| CN113139096A (en) | Video data set labeling method and device | |
| CN103616962B (en) | A kind of information processing method and device | |
| CN115481025A (en) | Script recording method and device for automatic test, computer equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201012 Address after: English genus Applicant after: Innovative advanced technology Co.,Ltd. Address before: English genus Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20201012 Address after: English genus Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190726 |
|
| RJ01 | Rejection of invention patent application after publication |