CN108763068A - A kind of automated testing method and terminal based on machine learning - Google Patents
A kind of automated testing method and terminal based on machine learning Download PDFInfo
- Publication number
- CN108763068A CN108763068A CN201810461492.2A CN201810461492A CN108763068A CN 108763068 A CN108763068 A CN 108763068A CN 201810461492 A CN201810461492 A CN 201810461492A CN 108763068 A CN108763068 A CN 108763068A
- Authority
- CN
- China
- Prior art keywords
- interactive controls
- test
- machine learning
- current interface
- data record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Debugging And Monitoring (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The present invention provides a kind of automated testing method and terminal based on machine learning, use the current interface for the model inspection trial product to be measured that the training of machine learning frame is completed, determine current interface it is all can interactive controls, and by the current interface it is all can interactive controls circle elect；Receive by voice describe for one can interactive controls test case, convert the voice to word, and be data record by the text conversion according to preset format；According to described in the data record real-time calling can the corresponding operation code of interactive controls to it is described can interactive controls test, without writing test code, operating process can be described by voice, generate corresponding data record, real-time pair can interactive controls test, the time for writing interface detection automatized script is dramatically saved, testing efficiency is improved.
Description
Technical field
The present invention relates to software test field more particularly to a kind of automated testing methods and end based on machine learning
End.
Background technology
Automatization testing technique is widely used in software development at present, can greatly improve the efficiency of test,
The influence of human factor is reduced, software development cycle is shortened.Wherein, especially to use the interface automation of image matching technology to test
Technology is got growing concern for.Its test process is：Test Engineer writes automatic test cases, then to product
The operable control at interface carries out sectional drawing, then writes corresponding test code, starts.
But there is following deficiency in the existing interface automation test method using image matching technology：It needs to be directed to
The operable control of sectional drawing writes corresponding test code, and when research and development of products iteration is frequent, and interface variation is bigger, needs
It wants Test Engineer to remodify test case, and sectional drawing again is carried out for the operable control of Product Interface changing unit,
Modification test code, cumbersome, elapsed time, testing efficiency be not high.
Invention content
The technical problem to be solved by the present invention is to：A kind of high automation based on machine learning of testing efficiency is provided to survey
Method for testing and terminal.
In order to solve the above-mentioned technical problem, a kind of technical solution that the present invention uses for：
A kind of automated testing method based on machine learning, including step：
The current interface of S1, the model inspection trial product to be measured completed using the training of machine learning frame are determined current
Interface it is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
S2, receive by voice describe be directed to one can interactive controls test case, convert the voice to word,
And according to preset format by the text conversion be data record；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls interact control to described
Part is tested.
In order to solve the above-mentioned technical problem, the another technical solution that the present invention uses for：
A kind of automated terminal test based on machine learning, including memory, processor and it is stored in the storage
On device and the computer program that can run on the processor, the processor are realized following when executing the computer program
Step：
The current interface of S1, the model inspection trial product to be measured completed using the training of machine learning frame are determined current
Interface it is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
S2, receive by voice describe be directed to one can interactive controls test case, convert the voice to word,
And according to preset format by the text conversion be data record；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls interact control to described
Part is tested.
The beneficial effects of the present invention are：By model inspection go out trial product current interface to be measured can interactive controls, and
Can interactive controls carry out circle choosing, by circle choosing can interactive controls by speech recognition generate test case, without write test
Code can describe operating process by voice, generate corresponding data record, real-time pair can interactive controls test, pole
The earth saves the time for writing interface detection automatized script, improves testing efficiency.
Description of the drawings
Fig. 1 is a kind of flow chart of automated testing method based on machine learning of the embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram of automated terminal test based on machine learning of the embodiment of the present invention；
Fig. 3 is the schematic diagram at an interface of the trial product to be measured of the embodiment of the present invention；
Fig. 4 be the embodiment of the present invention trial product to be measured an interface in can interactive controls selected by frame after signal
Figure；
Fig. 5 is the interface schematic diagram of the automated test tool of the embodiment of the present invention；
Label declaration：
1, a kind of automated terminal test based on machine learning；2, memory；3, processor.
Specific implementation mode
To explain the technical content, the achieved purpose and the effect of the present invention in detail, below in conjunction with embodiment and coordinate attached
Figure is explained.
The design of most critical of the present invention is：By model inspection go out trial product current interface to be measured can interactive controls,
And can interactive controls carry out circle choosing, by circle choosing can interactive controls corresponding test case generated by speech recognition and carry out
Real-time testing.
Please refer to Fig. 1, a kind of automated testing method based on machine learning, including step：
The current interface of S1, the model inspection trial product to be measured completed using the training of machine learning frame are determined current
Interface it is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
S2, receive by voice describe be directed to one can interactive controls test case, convert the voice to word,
And according to preset format by the text conversion be data record；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls interact control to described
Part is tested.
Seen from the above description, the beneficial effects of the present invention are：Go out trial product current interface to be measured by model inspection
Can interactive controls, and can interactive controls carry out circle choosing, by circle choosing can interactive controls pass through speech recognition generate test use
Example, without writing test code, can describe operating process by voice, generate corresponding data record, real-time pair can interact
Control is tested, and is dramatically saved the time for writing interface detection automatized script, is improved testing efficiency.
Further, further include step before the step S1：
S01, treat test product all interfaces can interactive controls classify, write respectively with it is described sorted
It can the corresponding operation code of interactive controls；
S02, according to the classification, in all interfaces of the trial product to be measured can interactive controls carry out sectional drawing, point
The corresponding sectional drawing picture of each classification is not generated, and model is carried out to the corresponding sectional drawing picture of each classification using machine learning frame
Training is until the accuracy of detection of the model trained is more than a preset value.
Seen from the above description, before performing the testing, be detected Product Interface to be measured can interactive controls model
Training and can interactive controls for operation code write, improve the follow-up accuracy for carrying out automatic test with efficiently
Property.
Further, described in the step S1 by the current interface it is all can interactive controls circle elect including：
The all of the current interface of the trial product to be measured gone out by the model inspection are interacted into control by machine vision library
Part circle is elected, and show it is all can interactive controls control information, the control information include control identification title；
Voice described in the step S2 includes the control identification title.
Seen from the above description, it ensure that that identifies hands over by the combination of machine vision library and trained model
The accuracy of mutual control, by pair can the controls of interactive controls identify that title accurately show and ensure that subsequent linguistic identifies accurate
Property, so that it is guaranteed that the reliability of automatic test.
Further, in the step S3 to it is described can interactive controls test while it is recorded, test
The recorded file of the corresponding test case is generated after the completion, and the recorded file is stored.
Seen from the above description, while carrying out automatic test, recording is synchronized to the test, test is used
Example synchronizes storage, and subsequent calling is facilitated to play back.
Further, further include step after the step S3：
S4, the test case that the recording chosen is completed is received, according to the number for the test case that the recording of the selection is completed
According to record real-time testing trial product to be measured current interface in it is corresponding with the data record can interactive controls.
Seen from the above description, by being stored to the test case tested, the recording of storage can be completed
Test case be called playback, the corresponding data record of the test case may be directly applied to be tested interact
Control further saves the time for writing interface detection automatized script.
Please refer to Fig. 2, a kind of automated terminal test based on machine learning, including memory, processor and storage
On the memory and the computer program that can run on the processor, the processor execute the computer program
Shi Shixian following steps：
The current interface of S1, the model inspection trial product to be measured completed using the training of machine learning frame are determined current
Interface it is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
S2, receive by voice describe be directed to one can interactive controls test case, convert the voice to word,
And according to preset format by the text conversion be data record；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls interact control to described
Part is tested.
Seen from the above description, the beneficial effects of the present invention are：Go out trial product current interface to be measured by model inspection
Can interactive controls, and can interactive controls carry out circle choosing, by circle choosing can interactive controls pass through speech recognition generate test use
Example, without writing test code, can describe operating process by voice, generate corresponding data record, real-time pair can interact
Control is tested, and is dramatically saved the time for writing interface detection automatized script, is improved testing efficiency.
Further, further include step before the step S1：
S01, treat test product all interfaces can interactive controls classify, write respectively with it is described sorted
It can the corresponding operation code of interactive controls；
S02, according to the classification, in all interfaces of the trial product to be measured can interactive controls carry out sectional drawing, point
The corresponding sectional drawing picture of each classification is not generated, and model is carried out to the corresponding sectional drawing picture of each classification using machine learning frame
Training is until the accuracy of detection of the model trained is more than a preset value.
Seen from the above description, before performing the testing, be detected Product Interface to be measured can interactive controls model
Training and can interactive controls for operation code write, improve the follow-up accuracy for carrying out automatic test with efficiently
Property.
Further, described in the step S1 by the current interface it is all can interactive controls circle elect including：
The all of the current interface of the trial product to be measured gone out by the model inspection are interacted into control by machine vision library
Part circle is elected, and show it is all can interactive controls control information, the control information include control identification title；
Voice described in the step S2 includes the control identification title.
Seen from the above description, it ensure that that identifies hands over by the combination of machine vision library and trained model
The accuracy of mutual control, by pair can the controls of interactive controls identify that title accurately show and ensure that subsequent linguistic identifies accurate
Property, so that it is guaranteed that the reliability of automatic test.
Further, in the step S3 to it is described can interactive controls test while it is recorded, test
The recorded file of the corresponding test case is generated after the completion, and the recorded file is stored.
Seen from the above description, while carrying out automatic test, recording is synchronized to the test, test is used
Example synchronizes storage, and subsequent calling is facilitated to play back.
Further, further include step after the step S3：
S4, the test case that the recording chosen is completed is received, according to the number for the test case that the recording of the selection is completed
According to record real-time testing trial product to be measured current interface in it is corresponding with the data record can interactive controls.
Seen from the above description, by being stored to the test case tested, the recording of storage can be completed
Test case be called playback, the corresponding data record of the test case may be directly applied to be tested interact
Control further saves the time for writing interface detection automatized script.
Embodiment one
Please refer to Fig. 1, a kind of automated testing method based on machine learning, including step：
S01, treat test product all interfaces can interactive controls classify, write respectively with it is described sorted
It can the corresponding operation code of interactive controls；
S02, according to the classification, in all interfaces of the trial product to be measured can interactive controls carry out sectional drawing, point
The corresponding sectional drawing picture of each classification is not generated, and model is carried out to the corresponding sectional drawing picture of each classification using machine learning frame
Training is until the accuracy of detection of the model trained is more than a preset value；
The current interface of S1, the model inspection trial product to be measured completed using the training of machine learning frame are determined current
Interface it is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
Wherein, it is described by the current interface it is all can interactive controls circle elect including：
The all of the current interface of the trial product to be measured gone out by the model inspection are interacted into control by machine vision library
Part circle is elected, and show it is all can interactive controls control information, the control information include control identification title；
S2, receive by voice describe be directed to one can interactive controls test case, convert the voice to word,
And according to preset format by the text conversion be data record；
Wherein, the voice includes the control identification title；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls interact control to described
Part is tested.
Embodiment two
The present embodiment and the difference of embodiment one are：In the step S3 to it is described can interactive controls tested it is same
When it is recorded, the recorded file of the corresponding test case is generated after the completion of test, and carry out to the recorded file
Storage；
Further include step after the step S3：
S4, the test case that the recording chosen is completed is received, according to the number for the test case that the recording of the selection is completed
According to record real-time testing trial product to be measured current interface in it is corresponding with the data record can interactive controls；
By the data record preserved during the test, software test is can be applied not only to, is answered in subsequent software
In, common repetitive operation is executed if necessary, then can save to commonly use operation note, execute playback when needed.
Embodiment three
It please refers to Fig. 2, a kind of automated terminal test 1 based on machine learning, including memory 2, processor 3 and deposits
The computer program that can be run on the memory 2 and on the processor 3 is stored up, the processor 3 executes the calculating
Each step in embodiment one is realized when machine program.
Example IV
It please refers to Fig. 2, a kind of automated terminal test 1 based on machine learning, including memory 2, processor 3 and deposits
The computer program that can be run on the memory 2 and on the processor 3 is stored up, the processor 3 executes the calculating
Each step in embodiment two is realized when machine program.
Embodiment five
The above-mentioned automated testing method based on machine learning is applied to specific scene：
S01, treat test product all interfaces can interactive controls classify, write respectively with it is described sorted
Can the corresponding operation code of interactive controls, it is described can interactive controls may act on different platforms, such as computer end, mobile phone terminal
Deng, it is described can interactive controls classification include text box, button, check box etc., if than can interactive controls type be text box class
The control of type, then its operation code logic be：Mouse clicks text box coordinate, and the cursor of mouse will be transferred to text frame
In control, word input is executed；If for another example can interactive controls type be button, write encapsulation mouse-click operation generation
Code；
S02, according to the classification, in all interfaces of the trial product to be measured can interactive controls carry out sectional drawing, point
The corresponding sectional drawing picture of each classification is not generated, and model is carried out to the corresponding sectional drawing picture of each classification using machine learning frame
Training is until the accuracy of detection of the model trained is more than a preset value；
Specifically, can by each interface of trial product to be measured can interactive controls classify, such as production shown in Fig. 3
Product login interface, the interface can be classified as button class, text box class and check box class；
The each interface difference sectional drawing for treating test product, using general machine learning data set annotation tool, such as
Spirit mark assistant elects the control frame on each interface, stamps corresponding label, and label is the classification of control, such as " text
The classification such as this frame ", " button ", can get label file by aforesaid operations；
Product sectional drawing and label file are carried out to about 100,000 targets using machine learning frame, such as TensorFlow
The exact value of the model training of detection, model is more than 0.99, and model training is completed when missing value is less than 0.01, trains the mould come
Type can recognize it is all on Product Interface to be tested can interactive controls；
S03, write according to trained Model Identification go out on Product Interface to be tested can interactive controls scripted code,
Can use OPENCV machines library combined training complete model, by by the Model Identification to can interactive controls frame select
Come, and store it is corresponding can interactive controls control information, the control information includes control number title, control identification name
Title, control type and control coordinate information, and part control information can be shown on Product Interface to be tested, such as
Shown in Fig. 4, wherein control identification title is that the control for electing wire frame circle passes through OCR Text regions, and picture is converted to obtain
Identification title of the word as the control, as shown in figure 4, " account text box " its control after OCR Text regions is known
Alias claims that exactly " account please be inputted ", and type is " text box " type, and control coordinate position refers to being returned by OPENCV visions library
The coordinate of center position that the control returned is elected by wire frame circle, by write can interactive controls carry out OCR words
The code of identification can use text location to specific control；
S04, speech recognition development kit (such as Baidu's speech recognition developing instrument is accessed in the test frame built
Packet or HKUST News speech recognition development kit), for receiving user speech input, voice can be converted to word, used
The voice that family is inputted by microphone will be converted into word by speech recognition tools packet；
S05, write the scripted code that data record is generated according to word, data record similar to formatted database table,
It is directly recorded in text file, the code logic of the scripted code is：By control encoding name, the control in verbal description
Identification title, control type and control coordinate position and it is packaged it is corresponding can the operation codes of interactive controls closed
Connection generates the formatted data record that can be tested frame execution, as a data is recorded as：" text box please input account
Number, key in, 234695 "；
S06, the scripted code that operation playback is executed according to data record is write, such as can be by data record wherein one
Item record " text box please input account, key entry, 234695 " does following execution：According to the control information of the current interface of record
It is text box type to obtain in control, and control identifies that the control coordinate position of entitled " please input account ", program control mouse
Mark is clicked on the coordinate position automatically, and program control keyboard keys in " 234695 "；
Scripted code, operation code, the model of training completion and speech recognition described in above-mentioned steps S01-S06 is opened
Hair kit carries out being integrally formed an automated test frame；
After automated test frame is put up, when carrying out automatic test, it is generally divided into recording, playback, it is specific to grasp
Make as follows：
Test Engineer opens Product Interface to be tested, opens the testing tool that the test frame put up makes, such as
Shown in Fig. 5, when being tested：
The current interface for the model inspection trial product to be measured that testing tool is completed using the training of machine learning frame, is determined
Current interface it is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
Wherein, it is described by the current interface it is all can interactive controls circle elect including：
The all of the current interface of the trial product to be measured gone out by the model inspection are interacted into control by machine vision library
Part circle is elected, and show it is all can interactive controls control information, the control information include control identification title；
Test Engineer clicks " creating test case " button, and in the text box of pop-up after filling test case title
Speech identifying function is opened, describe in words specific test operating procedure, such as Test Engineer in certain instant messenger
The test case concrete operations that log-in interface is described by voice are described as " keying in 234695 that please input account text box；?
It please input cryptogram frame and key in 123456；Click Button Login "
Testing tool receive by voice describe be directed to one can interactive controls test case, convert the voice to
Word, and be data record by the text conversion according to preset format；
Wherein, the voice includes the control identification title；
Specifically, the voice that Test Engineer inputs is converted to by word by speech recognition developing instrument, and according to pre-
If format conversion be data record, wherein preset format can be set according to actual conditions, for example, general "
It please input account text box key entry 234695 " and be converted into " text box please input account, key entry, 234695 ", " will please input
Cryptogram frame keys in 123456 " and is converted into " text box please input password, key entry, 123456 ", " will click Button Login " and turn
It turns to " button is logged in, clicked "；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls interact control to described
Part is tested；
Following logic will be realized according to the data record：" text box please input account, key entry, 234695 " is converted
For " where the control for finding control identification entitled ' account please be input ' in the control that current page owns ' text box type '
Screen coordinate executes in this position and keys in word ' 234695 ' ", and aforesaid operations are executed in real time；Will " text box, please input it is close
Code, key in, 123456 " be converted into " " current page own ' text box type ' control in find control identification it is entitled
Screen coordinate where the control of ' please input password ' executes in this position and keys in word ' 123456 ', and executes above-mentioned behaviour in real time
Make；It converts " button is logged in, clicked " to and " finds control type as ' button ', and control identifies pressing for entitled ' logging in '
Button executes the behavior that mouse is clicked in this screen coordinate ", and aforesaid operations are executed in real time；
Wherein, to it is described can interactive controls test while it is recorded, corresponding institute is generated after the completion of test
The recorded file of test case is stated, and the recorded file is stored, such Test Engineer is recording automatic test
Do not have to write test code when script, test case, and the execution feelings of real-time verification test script can be completed in the same time
Condition；
The concrete operations of playback link are that Test Engineer opens Product Interface to be tested, opens and uses built survey
The testing tool of frame manufacture is tried, selection executes the test case to be replied, clicks playback button：
S4, testing tool receive the test case that the recording chosen is completed, the test completed according to the recording of the selection
It is corresponding with the data record in the current interface of the data record real-time testing trial product to be measured of use-case can interactive controls；
By the data record preserved during the test, software test is can be applied not only to, is answered in subsequent software
In, common repetitive operation is executed if necessary, then can save to commonly use operation note, execute playback when needed.
In conclusion a kind of automated testing method and terminal based on machine learning provided by the invention, pass through model
Detect trial product current interface to be measured can interactive controls, and can interactive controls carry out circle choosing, by circle choosing interact control
Part generates test case by speech recognition, and without writing test code, operating process can be described by voice, generates and corresponds to
Data record, real-time pair can interactive controls test, dramatically save the time for writing interface detection automatized script,
Improve testing efficiency, and while carrying out automatic test, to it is described test synchronize recording, to test case into
The synchronous storage of row, facilitates subsequent calling to play back, can be to the record of storage by being stored to the test case tested
The test case that system is completed is called playback, and the corresponding data record of the test case may be directly applied to be tested
Can interactive controls, further save the time for writing interface detection automatized script.
Example the above is only the implementation of the present invention is not intended to limit the scope of the invention, every to utilize this hair
Equivalents made by bright specification and accompanying drawing content are applied directly or indirectly in relevant technical field, include similarly
In the scope of patent protection of the present invention.
Claims (10)
1. a kind of automated testing method based on machine learning, which is characterized in that including step：
The current interface of S1, the model inspection trial product to be measured completed using the training of machine learning frame, determine current interface
It is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
S2, receive by voice describe be directed to one can interactive controls test case, convert the voice to word, and press
According to preset format by the text conversion be data record；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls to it is described can interactive controls into
Row test.
2. a kind of automated testing method based on machine learning according to claim 1, which is characterized in that the step
Further include step before S1：
S01, treat test product all interfaces can interactive controls classify, write sorted handed over described respectively
The corresponding operation code of mutual control；
S02, according to the classification, in all interfaces of the trial product to be measured can interactive controls carry out sectional drawing, give birth to respectively
At the corresponding sectional drawing picture of each classification, model training is carried out to the corresponding sectional drawing picture of each classification using machine learning frame
Until the accuracy of detection of the model trained is more than a preset value.
3. a kind of automated testing method based on machine learning according to claim 1, which is characterized in that the step
Described in S1 by the current interface it is all can interactive controls circle elect including：
It can interactive controls circle by all of the current interface of the trial product to be measured gone out by the model inspection by machine vision library
Elect, and show it is all can interactive controls control information, the control information include control identification title；
Voice described in the step S2 includes the control identification title.
4. a kind of automated testing method based on machine learning according to claim 1, which is characterized in that the step
In S3 to it is described can interactive controls test while it is recorded, the corresponding test case is generated after the completion of test
Recorded file, and the recorded file is stored.
5. a kind of automated testing method based on machine learning according to claim 4, which is characterized in that the step
Further include step after S3：
S4, the test case that the recording chosen is completed is received, the data for the test case completed according to the recording of the selection are remembered
Record real-time testing trial product to be measured current interface in it is corresponding with the data record can interactive controls.
6. a kind of automated terminal test based on machine learning, including memory, processor and it is stored in the memory
Computer program that is upper and can running on the processor, which is characterized in that the processor executes the computer program
Shi Shixian following steps：
The current interface of S1, the model inspection trial product to be measured completed using the training of machine learning frame, determine current interface
It is all can interactive controls, and by the current interface it is all can interactive controls circle elect；
S2, receive by voice describe be directed to one can interactive controls test case, convert the voice to word, and press
According to preset format by the text conversion be data record；
S3, according to described in the data record real-time calling can the corresponding operation code of interactive controls to it is described can interactive controls into
Row test.
7. a kind of automated terminal test based on machine learning according to claim 6, which is characterized in that the step
Further include step before S1：
S01, treat test product all interfaces can interactive controls classify, write sorted handed over described respectively
The corresponding operation code of mutual control；
S02, according to the classification, in all interfaces of the trial product to be measured can interactive controls carry out sectional drawing, give birth to respectively
At the corresponding sectional drawing picture of each classification, model training is carried out to the corresponding sectional drawing picture of each classification using machine learning frame
Until the accuracy of detection of the model trained is more than a preset value.
8. a kind of automated terminal test based on machine learning according to claim 6, which is characterized in that the step
Described in S1 by the current interface it is all can interactive controls circle elect including：
It can interactive controls circle by all of the current interface of the trial product to be measured gone out by the model inspection by machine vision library
Elect, and show it is all can interactive controls control information, the control information include control identification title；
Voice described in the step S2 includes the control identification title.
9. a kind of automated terminal test based on machine learning according to claim 6, which is characterized in that the step
In S3 to it is described can interactive controls test while it is recorded, the corresponding test case is generated after the completion of test
Recorded file, and the recorded file is stored.
10. a kind of automated terminal test based on machine learning according to claim 9, which is characterized in that the step
Further include step after rapid S3：
S4, the test case that the recording chosen is completed is received, the data for the test case completed according to the recording of the selection are remembered
Record real-time testing trial product to be measured current interface in it is corresponding with the data record can interactive controls.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810461492.2A CN108763068B (en) | 2018-05-15 | 2018-05-15 | Automatic testing method and terminal based on machine learning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810461492.2A CN108763068B (en) | 2018-05-15 | 2018-05-15 | Automatic testing method and terminal based on machine learning |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108763068A true CN108763068A (en) | 2018-11-06 |
| CN108763068B CN108763068B (en) | 2021-12-28 |
Family
ID=64006932
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810461492.2A Active CN108763068B (en) | 2018-05-15 | 2018-05-15 | Automatic testing method and terminal based on machine learning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108763068B (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109359056A (en) * | 2018-12-21 | 2019-02-19 | 北京搜狗科技发展有限公司 | A kind of applied program testing method and device |
| CN109871326A (en) * | 2019-02-13 | 2019-06-11 | 广州云测信息技术有限公司 | A kind of method and apparatus that script is recorded |
| CN109871316A (en) * | 2019-01-10 | 2019-06-11 | 北京云测信息技术有限公司 | A kind of control recognition methods and device |
| CN109947650A (en) * | 2019-03-20 | 2019-06-28 | 广州云测信息技术有限公司 | Script step process methods, devices and systems |
| CN110058991A (en) * | 2018-11-30 | 2019-07-26 | 阿里巴巴集团控股有限公司 | A kind of automatic test approach and system of application software |
| CN110399191A (en) * | 2019-06-28 | 2019-11-01 | 奇安信科技集团股份有限公司 | A kind of program graphic user interface automatic interaction processing method and processing device |
| CN110489350A (en) * | 2019-09-12 | 2019-11-22 | 苏州浪潮智能科技有限公司 | A kind of servomechanism test method based on NLP |
| CN111047049A (en) * | 2019-12-05 | 2020-04-21 | 北京小米移动软件有限公司 | Method, apparatus and medium for processing multimedia data based on machine learning model |
| CN111767228A (en) * | 2020-06-30 | 2020-10-13 | 平安国际智慧城市科技股份有限公司 | Interface testing method, device, equipment and medium based on artificial intelligence |
| CN111801731A (en) * | 2019-01-22 | 2020-10-20 | 京东方科技集团股份有限公司 | Voice control method, voice control device and computer-executable nonvolatile storage medium |
| CN111968624A (en) * | 2020-08-24 | 2020-11-20 | 平安科技（深圳）有限公司 | Data construction method and device, electronic equipment and storage medium |
| CN112100075A (en) * | 2020-09-24 | 2020-12-18 | 腾讯科技（深圳）有限公司 | User interface playback method, device, equipment and storage medium |
| CN112925701A (en) * | 2019-12-06 | 2021-06-08 | 北京车和家信息技术有限公司 | Test case editing method, vehicle testing method and device |
| CN113254338A (en) * | 2021-05-25 | 2021-08-13 | 深圳前海微众银行股份有限公司 | Test case generation method, device and equipment |
| CN113836037A (en) * | 2021-10-21 | 2021-12-24 | 中国平安人寿保险股份有限公司 | Interface interaction test method, device, equipment and storage medium |
| CN117234950A (en) * | 2023-11-13 | 2023-12-15 | 广州品唯软件有限公司 | Test case recording method and device, storage medium and computer equipment |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070263834A1 (en) * | 2006-03-29 | 2007-11-15 | Microsoft Corporation | Execution of interactive voice response test cases |
| CN104462262A (en) * | 2014-11-21 | 2015-03-25 | 北京奇虎科技有限公司 | Method and device for achieving voice search and browser client side |
| US20150149155A1 (en) * | 2011-09-24 | 2015-05-28 | Lotfi A. Zadeh | Methods and Systems for Applications for Z-numbers |
| CN104809062A (en) * | 2015-04-22 | 2015-07-29 | 北京京东尚科信息技术有限公司 | Test method and system of artificial intelligence answering system |
| CN105513594A (en) * | 2015-11-26 | 2016-04-20 | 许传平 | Voice control system |
| WO2017067673A1 (en) * | 2015-10-19 | 2017-04-27 | Leaptest A/S | Method, apparatus and system for task automation of computer operations based on ui control and image/text recognition |
| CN106649024A (en) * | 2016-09-22 | 2017-05-10 | 微梦创科网络科技（中国）有限公司 | Method and device for real-time monitoring of application performance |
| CN106649111A (en) * | 2016-12-17 | 2017-05-10 | 广州酷狗计算机科技有限公司 | Method and device for running test cases |
| CN106815000A (en) * | 2015-11-30 | 2017-06-09 | 北京奇虎科技有限公司 | A kind of code generating method and device |
| CN107133519A (en) * | 2017-05-15 | 2017-09-05 | 华中科技大学 | Privacy compromise detection method and system in a kind of Android application network communication |
| CN107608877A (en) * | 2017-08-11 | 2018-01-19 | 上海巍擎信息技术有限责任公司 | A kind of automation application program interface method of testing and test system based on machine learning |
| CN107622016A (en) * | 2017-09-25 | 2018-01-23 | 无线生活（杭州）信息科技有限公司 | A kind of page method of testing and device |
-
2018
- 2018-05-15 CN CN201810461492.2A patent/CN108763068B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070263834A1 (en) * | 2006-03-29 | 2007-11-15 | Microsoft Corporation | Execution of interactive voice response test cases |
| US20150149155A1 (en) * | 2011-09-24 | 2015-05-28 | Lotfi A. Zadeh | Methods and Systems for Applications for Z-numbers |
| CN104462262A (en) * | 2014-11-21 | 2015-03-25 | 北京奇虎科技有限公司 | Method and device for achieving voice search and browser client side |
| CN104809062A (en) * | 2015-04-22 | 2015-07-29 | 北京京东尚科信息技术有限公司 | Test method and system of artificial intelligence answering system |
| WO2017067673A1 (en) * | 2015-10-19 | 2017-04-27 | Leaptest A/S | Method, apparatus and system for task automation of computer operations based on ui control and image/text recognition |
| CN105513594A (en) * | 2015-11-26 | 2016-04-20 | 许传平 | Voice control system |
| CN106815000A (en) * | 2015-11-30 | 2017-06-09 | 北京奇虎科技有限公司 | A kind of code generating method and device |
| CN106649024A (en) * | 2016-09-22 | 2017-05-10 | 微梦创科网络科技（中国）有限公司 | Method and device for real-time monitoring of application performance |
| CN106649111A (en) * | 2016-12-17 | 2017-05-10 | 广州酷狗计算机科技有限公司 | Method and device for running test cases |
| CN107133519A (en) * | 2017-05-15 | 2017-09-05 | 华中科技大学 | Privacy compromise detection method and system in a kind of Android application network communication |
| CN107608877A (en) * | 2017-08-11 | 2018-01-19 | 上海巍擎信息技术有限责任公司 | A kind of automation application program interface method of testing and test system based on machine learning |
| CN107622016A (en) * | 2017-09-25 | 2018-01-23 | 无线生活（杭州）信息科技有限公司 | A kind of page method of testing and device |
Non-Patent Citations (1)
| Title |
|---|
| 梁刚强: ""图像识别在游戏自动化测试中的应用"", 《MTC.BAIDU.COM/ACADEMY/DETAIL/ARTICLE/68》 * |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110058991A (en) * | 2018-11-30 | 2019-07-26 | 阿里巴巴集团控股有限公司 | A kind of automatic test approach and system of application software |
| CN109359056A (en) * | 2018-12-21 | 2019-02-19 | 北京搜狗科技发展有限公司 | A kind of applied program testing method and device |
| CN109871316A (en) * | 2019-01-10 | 2019-06-11 | 北京云测信息技术有限公司 | A kind of control recognition methods and device |
| CN111801731B (en) * | 2019-01-22 | 2024-02-13 | 京东方科技集团股份有限公司 | Voice control method, voice control device, and computer-executable nonvolatile storage medium |
| CN111801731A (en) * | 2019-01-22 | 2020-10-20 | 京东方科技集团股份有限公司 | Voice control method, voice control device and computer-executable nonvolatile storage medium |
| CN109871326B (en) * | 2019-02-13 | 2022-03-15 | 北京云测信息技术有限公司 | Script recording method and device |
| CN109871326A (en) * | 2019-02-13 | 2019-06-11 | 广州云测信息技术有限公司 | A kind of method and apparatus that script is recorded |
| CN109947650A (en) * | 2019-03-20 | 2019-06-28 | 广州云测信息技术有限公司 | Script step process methods, devices and systems |
| CN109947650B (en) * | 2019-03-20 | 2022-04-29 | 北京云测信息技术有限公司 | Script step processing method, device and system |
| CN110399191A (en) * | 2019-06-28 | 2019-11-01 | 奇安信科技集团股份有限公司 | A kind of program graphic user interface automatic interaction processing method and processing device |
| CN110489350A (en) * | 2019-09-12 | 2019-11-22 | 苏州浪潮智能科技有限公司 | A kind of servomechanism test method based on NLP |
| CN111047049B (en) * | 2019-12-05 | 2023-08-11 | 北京小米移动软件有限公司 | Method, device and medium for processing multimedia data based on machine learning model |
| CN111047049A (en) * | 2019-12-05 | 2020-04-21 | 北京小米移动软件有限公司 | Method, apparatus and medium for processing multimedia data based on machine learning model |
| CN112925701B (en) * | 2019-12-06 | 2024-04-19 | 北京车和家信息技术有限公司 | Test case editing method, vehicle testing method and device |
| CN112925701A (en) * | 2019-12-06 | 2021-06-08 | 北京车和家信息技术有限公司 | Test case editing method, vehicle testing method and device |
| CN111767228A (en) * | 2020-06-30 | 2020-10-13 | 平安国际智慧城市科技股份有限公司 | Interface testing method, device, equipment and medium based on artificial intelligence |
| CN111767228B (en) * | 2020-06-30 | 2024-02-06 | 深圳赛安特技术服务有限公司 | Interface testing method, device, equipment and medium based on artificial intelligence |
| CN111968624B (en) * | 2020-08-24 | 2024-02-09 | 平安科技（深圳）有限公司 | Data construction method, device, electronic equipment and storage medium |
| CN111968624A (en) * | 2020-08-24 | 2020-11-20 | 平安科技（深圳）有限公司 | Data construction method and device, electronic equipment and storage medium |
| CN112100075A (en) * | 2020-09-24 | 2020-12-18 | 腾讯科技（深圳）有限公司 | User interface playback method, device, equipment and storage medium |
| CN112100075B (en) * | 2020-09-24 | 2024-03-15 | 腾讯科技（深圳）有限公司 | User interface playback method, device, equipment and storage medium |
| CN113254338B (en) * | 2021-05-25 | 2023-01-24 | 深圳前海微众银行股份有限公司 | Test case generation method, device and equipment |
| CN113254338A (en) * | 2021-05-25 | 2021-08-13 | 深圳前海微众银行股份有限公司 | Test case generation method, device and equipment |
| CN113836037A (en) * | 2021-10-21 | 2021-12-24 | 中国平安人寿保险股份有限公司 | Interface interaction test method, device, equipment and storage medium |
| CN113836037B (en) * | 2021-10-21 | 2024-04-05 | 中国平安人寿保险股份有限公司 | Interface interaction testing method, device, equipment and storage medium |
| CN117234950A (en) * | 2023-11-13 | 2023-12-15 | 广州品唯软件有限公司 | Test case recording method and device, storage medium and computer equipment |
| CN117234950B (en) * | 2023-11-13 | 2024-03-19 | 广州品唯软件有限公司 | Test case recording method and device, storage medium and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108763068B (en) | 2021-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108763068A (en) | A kind of automated testing method and terminal based on machine learning | |
| CN110275834B (en) | User interface automatic test system and method | |
| CN113391871B (en) | RPA element intelligent fusion picking method and system | |
| US9189377B1 (en) | Automation testing using descriptive maps | |
| CN109871326A (en) | A kind of method and apparatus that script is recorded | |
| CN107025165A (en) | Game automated testing method and relevant apparatus | |
| CN102567201B (en) | Method for automatically recovering cross-model GUI (graphic user interface) test scripts | |
| CN110223695A (en) | A kind of task creation method and mobile terminal | |
| CN111193834B (en) | Man-machine interaction method and device based on user sound characteristic analysis and electronic equipment | |
| CN104461863A (en) | Service system testing method, device and system | |
| CN109359043B (en) | Mobile game automatic testing method based on machine learning | |
| CN110610698B (en) | Voice labeling method and device | |
| CN109886110A (en) | Micro- expression methods of marking, device, computer equipment and storage medium | |
| CN112507376B (en) | Sensitive data detection method and device based on machine learning | |
| CN112232276B (en) | Emotion detection method and device based on voice recognition and image recognition | |
| CN107622017B (en) | Analysis method for universal automation software test | |
| CN113110995A (en) | System migration test method and device | |
| Sonnleithner et al. | Bad smells in industrial automation: Sniffing out feature envy | |
| CN109637536A (en) | A kind of method and device of automatic identification semantic accuracy | |
| Jaganeshwari et al. | an Automated Testing Tool Based on Graphical User Interface With Exploratory Behavioural Analysis | |
| CN110192250A (en) | Symbol sebolic addressing estimation in voice | |
| CN110221978A (en) | Method for generating test case and device | |
| CN110265062A (en) | Collection method and device after intelligence based on mood detection is borrowed | |
| CN109543048A (en) | A kind of notes generation method and terminal device | |
| CN114168470A (en) | Software system testing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |