CN111597116A - Mobile terminal UI automatic test method, system, storage medium and electronic equipment - Google Patents
Mobile terminal UI automatic test method, system, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN111597116A CN111597116A CN202010430351.1A CN202010430351A CN111597116A CN 111597116 A CN111597116 A CN 111597116A CN 202010430351 A CN202010430351 A CN 202010430351A CN 111597116 A CN111597116 A CN 111597116A
- Authority
- CN
- China
- Prior art keywords
- resolution
- mobile terminal
- screen
- picture
- gray level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010998 test method Methods 0.000 title claims abstract description 10
- 238000012360 testing method Methods 0.000 claims abstract description 37
- 238000000034 method Methods 0.000 claims abstract description 32
- 238000006243 chemical reaction Methods 0.000 claims abstract description 12
- 230000005540 biological transmission Effects 0.000 claims abstract description 4
- 238000004891 communication Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 4
- 230000003993 interaction Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 9
- 238000012827 research and development Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013522 software testing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Abstract
The invention discloses a mobile terminal UI automatic test method, a system, a storage medium and electronic equipment, belonging to the field of computer software test, aiming at solving the technical problem of efficiently and accurately compiling an automatic test script in the left-moving mobile terminal automatic test process, and adopting the technical scheme that: the method comprises the steps of converting a target picture carrying resolution and a real-time whole mobile terminal screen captured picture carrying mobile terminal resolution into uniform resolution, comparing through opencv, taking a coordinate point with the highest matching degree to return to a relative position, and interacting with a mobile terminal through minicap to realize automatic testing of a mobile terminal real machine. The system comprises a target picture acquisition unit, a service starting unit, a transmission unit, a resolution conversion unit, a comparison unit and a threshold value setting unit.
Description
Technical Field
The invention relates to the field of computer software testing, in particular to a mobile terminal UI automatic testing method, a system, a storage medium and electronic equipment.
Background
OpenCV is a BSD license (open source) based distributed cross-platform computer vision library that can run on Linux, Windows, Android, and Mac OS operating systems. The method is light and efficient, is composed of a series of C functions and a small number of C + + classes, provides interfaces of languages such as Python, Ruby, MATLAB and the like, and realizes a plurality of general algorithms in the aspects of image processing and computer vision. OpenCV is written in C + + language, and its main interface is also C + + language, but a large amount of C language interfaces are still reserved. The library also has a number of Python, Java and MATLAB/OCTAVE (version 2.5) interfaces. The API interface functions for these languages are available through online documentation. Support for C #, Ch, Ruby, GO is also provided today.
Along with the development of the society, mobile equipment becomes a necessary living article for people, the frequency of the mobile-end app used by people is higher and higher due to the convenience of the mobile-end app, so that research and development personnel can guarantee the quality of the mobile application, and a great deal of effort needs to be invested for testing before the mobile-end app is brought online.
Like the pc application testing technology, in order to save labor, time or hardware resources and improve testing efficiency, an automated testing concept is provided, but in the situation of left-shift testing, because the function just begins to be developed or the function does not yet begin to be developed, a traditional element-based mode needs the cooperation of testing and research and development personnel, which occupies the time of the research and development personnel and also influences the writing speed of a testing script, and in an element positioning mode, the implementation effect of the h5 page embedded in the mobile terminal is not good.
Therefore, how to efficiently and accurately compile an automatic test script in the automatic test process of a left-moving mobile terminal is a problem to be solved urgently at present.
Disclosure of Invention
The invention aims to provide a mobile terminal UI automatic test method, a system, a storage medium and electronic equipment, so as to solve the problem of efficiently and accurately compiling an automatic test script in the left-moving mobile terminal automatic test process.
The technical task of the invention is realized in the following way, the method is that a target picture carrying resolution and a real-time whole mobile terminal screen captured picture carrying the resolution of the mobile terminal are converted into uniform resolution, comparison is carried out through opencv, a coordinate point with the highest matching degree is taken to return to a relative position, and then interaction with the mobile terminal is realized by means of minisap, so that the automatic test of a mobile terminal real machine is realized.
Preferably, the method is specifically as follows:
s1, acquiring the target picture on the front end page: storing the directory structure according to the requirement on a server side, and recording the screen resolution of a mobile side for capturing the picture;
s2, putting the execution file and the so file under a mobile terminal file directory based on a minicap tool, and starting a socket service;
s3, the server side and the socket service of the mobile side carry out websocket communication, and the mobile side transmits the real-time screen captured picture to the server side;
s4, respectively converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to the respective screen resolution, and converting the standard resolution into a uniform resolution;
s5, comparing the two converted pictures by an opencv method, and finding all possible positions where target pictures can appear on the mobile terminal real-time screenshot;
s6, setting a similarity threshold, generating a list of coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning; the point list returned after the Opencv method is called contains the similarity percentage besides the position coordinates of the points, and the point with the best similarity percentage is the point with the highest matching degree.
Preferably, the conversion to the uniform resolution in step S4 is specifically as follows:
s401, defining a reference resolution, such as 1080 × 1920;
s402, acquiring the screen resolution of the mobile terminal real machine;
s403, judging whether the screen resolution of the mobile terminal true machine is the same as the reference resolution:
if the two resolutions are the same, the ratio of the reference resolution to the screen resolution of the mobile terminal true machine is 1: 1;
if not, executing step S404;
s404, calculating the ratio of the horizontal resolution and the vertical resolution, and then converting the ratio to calculate the position of the coordinate on the mobile terminal real machine under the reference resolution.
Preferably, the command for placing the execution file and the so file under the mobile terminal file directory based on the minicap tool in step S2 is as follows: adb push 1. so/data/.
Preferably, the two converted pictures are compared by an opencv method in step S5 as follows:
s501, reducing the sizes of a target picture and a screen captured picture, and only keeping basic information of structure and darkness;
s502, converting the target picture and the screen captured picture into a gray-scale image;
s503, calculating the gray level average value of the gray level image corresponding to the target image;
s504, comparing the gray levels of the pixels: comparing the gray level of each pixel in the screen captured picture with the average gray level value:
firstly, when the gray level of a picture pixel captured by a screen is greater than or equal to the average gray level value, the pixel is marked as 1;
secondly, when the gray level of a picture pixel captured by the screen is smaller than the average gray level value, the pixel is marked as 0;
and S505, comparing the target picture in which area of the compared screen captured picture according to the result of the step S504 and calculating the similarity ratio.
A mobile terminal UI automation test system comprises,
the target picture acquisition unit is used for acquiring a target picture on a front-end page, storing the target picture on the server according to a required directory structure and recording the screen resolution of a mobile terminal for capturing the picture;
the service starting unit is used for putting the execution file and the so file into a mobile terminal file directory based on a minicap tool and starting a socket service; the specific command is as follows: adb push 1. so/data/;
the transmission unit is used for performing websocket communication between the server and the socket service of the mobile terminal, and the mobile terminal transmits the real-time screenshot of the screen to the server;
the resolution conversion unit is used for respectively converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to respective screen resolutions and converting the standard resolution into a uniform resolution;
the comparison unit is used for comparing the two converted pictures by an opencv method to find all possible positions of the target picture on the real-time screenshot of the mobile terminal;
the threshold setting unit is used for setting a threshold of the similarity, generating a list of the coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning the coordinate; the point list returned after the Opencv method is called contains the similarity percentage besides the position coordinates of the points, and the point with the best similarity percentage is the point with the highest matching degree.
Preferably, the resolution converting unit includes,
a definition module for defining a base resolution, such as 1080 × 1920;
the resolution acquisition module is used for acquiring the screen resolution of the mobile terminal fax machine;
the judging module is used for judging whether the screen resolution of the mobile terminal fax machine is the same as the reference resolution or not;
and the conversion module is used for calculating the ratio of the horizontal resolution and the vertical resolution and then converting the ratio to calculate the position of the coordinate on the mobile terminal real machine under the reference resolution.
Preferably, the comparison unit comprises,
the reducing module is used for reducing the sizes of the target picture and the screen captured picture and only keeping basic information of the structure and the brightness;
the gray level processing module is used for converting the target picture and the screen captured picture into a gray level image;
the average value calculating module is used for calculating the gray average value of the gray image corresponding to the target picture;
the pixel gray level comparison module is used for comparing the gray level of each pixel in the screen captured picture with the average gray level value:
firstly, when the gray level of a picture pixel captured by a screen is greater than or equal to the average gray level value, the pixel is marked as 1;
secondly, when the gray level of a picture pixel captured by the screen is smaller than the average gray level value, the pixel is marked as 0;
and the area acquisition module is used for comparing the area of the target picture in the compared screen captured picture and calculating the similarity ratio.
A storage medium stores a plurality of instructions, and the instructions are loaded by a processor and execute the steps of the mobile terminal UI automation test method.
An electronic device, the electronic device comprising:
the storage medium described above; and
a processor to execute the instructions in the storage medium.
The mobile terminal UI automatic test method, the system, the storage medium and the electronic equipment have the following advantages:
the method comprises the steps of firstly, comparing a target screenshot with a real-time whole mobile phone screenshot through opencv, returning to a relative position, interacting with a mobile phone by means of minisap, and efficiently and accurately compiling an automatic test script in the automatic test process of a mobile terminal moving to the left;
secondly, the invention develops the automation script before or simultaneously with the function in the automated test after the left shift, and reduces the communication cost with people as much as possible;
thirdly, the invention adopts a picture recognition method to replace the prior element positioning, so that the tester can more easily operate, and the threshold of automatic testing entrance is reduced;
and fourthly, writing an automatic test script by adopting a picture identification method, wherein the automatic test script can be written after ui is drawn, the idea of testing left shift is met, and the problem of poor positioning after the attribute of the h5 page embedded in the mobile terminal is converted into the attribute of android is solved.
Drawings
The invention is further described below with reference to the accompanying drawings.
Fig. 1 is a flow chart of an automated testing method for a mobile terminal UI.
Detailed Description
The method, system, storage medium, and electronic device for automatically testing a mobile UI according to the present invention will be described in detail with reference to the drawings and specific embodiments.
Example 1:
as shown in the attached figure 1, the mobile terminal UI automatic test method of the invention is characterized in that a target picture carrying resolution and a real-time whole mobile phone screen captured picture carrying mobile phone resolution are converted into uniform resolution, comparison is carried out through opencv, a coordinate point with the highest matching degree is selected to return to a relative position, and then interaction with a mobile phone is carried out by means of minisap, so that automatic test of a real mobile phone is realized; the method comprises the following specific steps:
s1, acquiring the target picture on the front end page: storing the directory structure according to the requirement on a server side, and recording the screen resolution of the mobile phone for capturing the picture;
s2, putting the execution file and the so file under a mobile phone file directory based on a minicap tool, and starting a socket service; the command is: adb push 1. so/data/.
S3, the server side and the socket service of the mobile phone carry out websocket communication, and the mobile phone transmits the real-time screen captured picture to the server side;
s4, respectively converting the previous target picture and the screen capture picture transmitted by the mobile phone into a standard resolution according to the respective screen resolution, and converting the standard resolution into a uniform resolution; the method comprises the following specific steps:
s401, defining a reference resolution, such as 1080 × 1920;
s402, acquiring the screen resolution of the real mobile phone;
s403, judging whether the screen resolution of the real mobile phone is the same as the reference resolution:
if the reference resolution and the screen resolution of the real mobile phone are the same, the ratio of the reference resolution to the screen resolution of the real mobile phone is 1: 1;
if not, executing step S404;
s404, calculating the ratio of the horizontal resolution and the vertical resolution, and converting the ratio to calculate the position of the coordinate on the real mobile phone under the reference resolution.
S5, comparing the two converted pictures by an opencv method, and finding all possible positions where target pictures can appear on the mobile phone real-time screenshot; the method comprises the following specific steps:
s501, reducing the sizes of a target picture and a screen captured picture, and only keeping basic information of structure and darkness;
s502, converting the target picture and the screen captured picture into a gray-scale image;
s503, calculating the gray level average value of the gray level image corresponding to the target image;
s504, comparing the gray levels of the pixels: comparing the gray level of each pixel in the screen captured picture with the average gray level value:
firstly, when the gray level of a picture pixel captured by a screen is greater than or equal to the average gray level value, the pixel is marked as 1;
secondly, when the gray level of a picture pixel captured by the screen is smaller than the average gray level value, the pixel is marked as 0;
and S505, comparing the target picture in which area of the compared screen captured picture according to the result of the step S504 and calculating the similarity ratio.
S6, setting a similarity threshold, generating a list of coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning; the point list returned after the Opencv method is called contains the similarity percentage besides the position coordinates of the points, and the point with the best similarity percentage is the point with the highest matching degree.
Example 2:
the invention discloses a mobile end UI automatic test system, which comprises,
the target picture acquisition unit is used for acquiring a target picture on a front-end page, storing the target picture on the server according to a required directory structure and recording the screen resolution of the mobile phone for capturing the picture;
the service starting unit is used for putting the execution file and the so file into a mobile phone file directory based on a minicap tool and starting a socket service; the specific command is as follows: adb push 1. so/data/;
the transmission unit is used for the websocket communication between the server and the socket service of the mobile phone, and the mobile phone transmits the real-time screenshot of the screen to the server;
the resolution conversion unit is used for respectively converting the previous target picture and the screen capture picture transmitted by the mobile phone into a standard resolution according to respective screen resolutions and converting the standard resolution into a uniform resolution; the resolution conversion unit includes a resolution conversion unit including,
a definition module for defining a base resolution, such as 1080 × 1920;
the resolution acquisition module is used for acquiring the screen resolution of the real mobile phone;
the judging module is used for judging whether the screen resolution of the real mobile phone is the same as the reference resolution or not;
and the conversion module is used for calculating the ratio of the horizontal resolution and the vertical resolution and then converting the ratio to calculate the position of the coordinate on the real mobile phone under the reference resolution.
The comparison unit is used for comparing the two converted pictures by an opencv method to find all possible positions of the target picture on the mobile phone real-time screenshot; the comparison unit comprises a comparison unit and a comparison unit,
the reducing module is used for reducing the sizes of the target picture and the screen captured picture and only keeping basic information of the structure and the brightness;
the gray level processing module is used for converting the target picture and the screen captured picture into a gray level image;
the average value calculating module is used for calculating the gray average value of the gray image corresponding to the target picture;
the pixel gray level comparison module is used for comparing the gray level of each pixel in the screen captured picture with the average gray level value:
firstly, when the gray level of a picture pixel captured by a screen is greater than or equal to the average gray level value, the pixel is marked as 1;
secondly, when the gray level of a picture pixel captured by the screen is smaller than the average gray level value, the pixel is marked as 0;
and the area acquisition module is used for comparing the area of the target picture in the compared screen captured picture and calculating the similarity ratio.
The threshold setting unit is used for setting a threshold of the similarity, generating a list of the coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning the coordinate; the point list returned after the Opencv method is called contains the similarity percentage besides the position coordinates of the points, and the point with the best similarity percentage is the point with the highest matching degree.
Example 3:
the embodiment of the invention also provides a storage medium, wherein a plurality of instructions are stored in the storage medium, and the instructions are loaded by the processor, so that the processor executes the mobile terminal UI automatic test method in any embodiment of the invention. Specifically, a system or an apparatus equipped with a storage medium on which software program codes that realize the functions of any of the above-described embodiments are stored may be provided, and a computer (or a CPU or MPU) of the system or the apparatus is caused to read out and execute the program codes stored in the storage medium.
In this case, the program code itself read from the storage medium can realize the functions of any of the above-described embodiments, and thus the program code and the storage medium storing the program code constitute a part of the present invention.
Examples of the storage medium for supplying the program code include a floppy disk, a hard disk, a magneto-optical disk, an optical disk (e.g., CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-R handset UI automation test method, system, storage medium and electronic device M, DVD-RW, DVD + RW), a magnetic tape, a nonvolatile memory card, and a ROM. Alternatively, the program code may be downloaded from a server computer via a communications network.
Further, it should be clear that the functions of any one of the above-described embodiments may be implemented not only by executing the program code read out by the computer, but also by causing an operating system or the like operating on the computer to perform a part or all of the actual operations based on instructions of the program code.
Further, it is to be understood that the program code read out from the storage medium is written to a memory provided in an expansion board inserted into the computer or to a memory provided in an expansion unit connected to the computer, and then causes a CPU or the like mounted on the expansion board or the expansion unit to perform part or all of the actual operations based on instructions of the program code, thereby realizing the functions of any of the above-described embodiments.
Example 4:
an electronic apparatus of the present invention includes:
the storage medium; and
a processor for executing the instructions in the storage medium of embodiment 3 of the present invention.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A mobile terminal UI automatic test method is characterized in that a target picture carrying resolution and a real-time whole mobile terminal screen captured picture carrying the mobile terminal resolution are converted into uniform resolution, comparison is conducted through opencv, a coordinate point with the highest matching degree is selected to return to a relative position, and then interaction with a mobile terminal is achieved through minisap, so that automatic test of a mobile terminal real machine is achieved.
2. The method for automatically testing the mobile UI of claim 1, further comprising:
s1, acquiring the target picture on the front end page: storing the directory structure according to the requirement on a server side, and recording the screen resolution of a mobile side for capturing the picture;
s2, putting the execution file and the so file under a mobile terminal file directory based on a minicap tool, and starting a socket service;
s3, the server side and the socket service of the mobile side carry out websocket communication, and the mobile side transmits the real-time screen captured picture to the server side;
s4, respectively converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to the respective screen resolution, and converting the standard resolution into a uniform resolution;
s5, comparing the two converted pictures by an opencv method, and finding all possible positions where target pictures can appear on the mobile terminal real-time screenshot;
and S6, setting a similarity threshold, generating a list of coordinate points above the similarity threshold, selecting the coordinate with the highest matching degree from the list, and returning.
3. The method for automatically testing the mobile terminal UI according to claim 2, wherein the conversion to the uniform resolution in the step S4 is as follows:
s401, defining a reference resolution;
s402, acquiring the screen resolution of the mobile terminal real machine;
s403, judging whether the screen resolution of the mobile terminal true machine is the same as the reference resolution:
if the two resolutions are the same, the ratio of the reference resolution to the screen resolution of the mobile terminal true machine is 1: 1;
if not, executing step S404;
s404, calculating the ratio of the horizontal resolution and the vertical resolution, and then converting the ratio to calculate the position of the coordinate on the mobile terminal real machine under the reference resolution.
4. The method for automatically testing the UI of the mobile terminal according to claim 2, wherein the command for placing the execution file and the so file in the mobile terminal file directory based on the minicap tool in step S2 is: adb push 1. so/data/.
5. The method for automatically testing the mobile terminal UI according to claim 2, 3 or 4, wherein the two converted pictures are compared by an opencv method in step S5 as follows:
s501, reducing the sizes of a target picture and a screen captured picture, and only keeping basic information of structure and darkness;
s502, converting the target picture and the screen captured picture into a gray-scale image;
s503, calculating the gray level average value of the gray level image corresponding to the target image;
s504, comparing the gray levels of the pixels: comparing the gray level of each pixel in the screen captured picture with the average gray level value:
firstly, when the gray level of a picture pixel captured by a screen is greater than or equal to the average gray level value, the pixel is marked as 1;
secondly, when the gray level of a picture pixel captured by the screen is smaller than the average gray level value, the pixel is marked as 0;
and S505, comparing the target picture in which area of the compared screen captured picture according to the result of the step S504 and calculating the similarity ratio.
6. An automatic test system for mobile end UI is characterized in that the system comprises,
the target picture acquisition unit is used for acquiring a target picture on a front-end page, storing the target picture on the server according to a required directory structure and recording the screen resolution of a mobile terminal for capturing the picture;
the service starting unit is used for putting the execution file and the so file into a mobile terminal file directory based on a minicap tool and starting a socket service; the specific command is as follows: adb push 1. so/data/;
the transmission unit is used for performing websocket communication between the server and the socket service of the mobile terminal, and the mobile terminal transmits the real-time screenshot of the screen to the server;
the resolution conversion unit is used for respectively converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to respective screen resolutions and converting the standard resolution into a uniform resolution;
the comparison unit is used for comparing the two converted pictures by an opencv method to find all possible positions of the target picture on the real-time screenshot of the mobile terminal;
and the threshold setting unit is used for setting a threshold of the similarity, generating a list of the coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning the coordinate.
7. The mobile-end UI automation test system according to claim 6, wherein the resolution conversion unit comprises,
a definition module for defining a reference resolution;
the resolution acquisition module is used for acquiring the screen resolution of the mobile terminal fax machine;
the judging module is used for judging whether the screen resolution of the mobile terminal fax machine is the same as the reference resolution or not;
and the conversion module is used for calculating the ratio of the horizontal resolution and the vertical resolution and then converting the ratio to calculate the position of the coordinate on the mobile terminal real machine under the reference resolution.
8. The mobile-end UI automation test system according to claim 6 or 7, characterized in that the comparing unit comprises,
the reducing module is used for reducing the sizes of the target picture and the screen captured picture and only keeping basic information of the structure and the brightness;
the gray level processing module is used for converting the target picture and the screen captured picture into a gray level image;
the average value calculating module is used for calculating the gray average value of the gray image corresponding to the target picture;
the pixel gray level comparison module is used for comparing the gray level of each pixel in the screen captured picture with the average gray level value:
firstly, when the gray level of a picture pixel captured by a screen is greater than or equal to the average gray level value, the pixel is marked as 1;
secondly, when the gray level of a picture pixel captured by the screen is smaller than the average gray level value, the pixel is marked as 0;
and the area acquisition module is used for comparing the area of the target picture in the compared screen captured picture and calculating the similarity ratio.
9. A storage medium having stored therein a plurality of instructions, wherein the instructions are loaded by a processor and execute the steps of the method for automated testing of a mobile-end UI according to claims 1-5.
10. An electronic device, characterized in that the electronic device comprises:
the storage medium of claim 9; and
a processor to execute the instructions in the storage medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010430351.1A CN111597116B (en) | 2020-05-20 | 2020-05-20 | Mobile terminal UI automatic test method, system, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010430351.1A CN111597116B (en) | 2020-05-20 | 2020-05-20 | Mobile terminal UI automatic test method, system, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111597116A true CN111597116A (en) | 2020-08-28 |
| CN111597116B CN111597116B (en) | 2023-06-09 |
Family
ID=72185885
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010430351.1A Active CN111597116B (en) | 2020-05-20 | 2020-05-20 | Mobile terminal UI automatic test method, system, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111597116B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181838A (en) * | 2020-09-30 | 2021-01-05 | 无锡雪浪数制科技有限公司 | Automatic testing method based on image comparison |
| CN112732559A (en) * | 2020-12-30 | 2021-04-30 | 广东粤云工业互联网创新科技有限公司 | Picture comparison method, automatic dial testing method and system and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130004087A1 (en) * | 2011-06-30 | 2013-01-03 | American Express Travel Related Services Company, Inc. | Method and system for webpage regression testing |
| WO2014169565A1 (en) * | 2013-08-21 | 2014-10-23 | 中兴通讯股份有限公司 | Terminal testing method and device |
| US20150082280A1 (en) * | 2013-09-18 | 2015-03-19 | Yahoo! Inc. | Automatic verification by comparing user interface images |
| CN104866414A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method, device and system for testing application program |
| US9355122B1 (en) * | 2014-05-07 | 2016-05-31 | Amazon Technologies, Inc. | Filtering applications using runtime inspection |
| CN105868102A (en) * | 2016-03-22 | 2016-08-17 | 中国科学院软件研究所 | Computer vision based mobile terminal application testing system and method |
| US20180165264A1 (en) * | 2016-12-12 | 2018-06-14 | Wipro Limited | Method and system for automatically updating automation sequences |
| CN108509343A (en) * | 2018-04-04 | 2018-09-07 | 浙江小泰科技有限公司 | Automated testing method based on image recognition technology and system |
| CN110245068A (en) * | 2019-04-25 | 2019-09-17 | 深圳壹账通智能科技有限公司 | Automated testing method, device and the computer equipment of the H5 page |
| CN110851280A (en) * | 2019-11-13 | 2020-02-28 | 深圳航天智慧城市系统技术研究院有限公司 | Automatic data acquisition method based on distributed intelligent edge computing technology |
| CN110851368A (en) * | 2019-11-19 | 2020-02-28 | 天津车之家数据信息技术有限公司 | Multi-device collaborative testing method and device, computing device and system |
-
2020
- 2020-05-20 CN CN202010430351.1A patent/CN111597116B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130004087A1 (en) * | 2011-06-30 | 2013-01-03 | American Express Travel Related Services Company, Inc. | Method and system for webpage regression testing |
| WO2014169565A1 (en) * | 2013-08-21 | 2014-10-23 | 中兴通讯股份有限公司 | Terminal testing method and device |
| US20150082280A1 (en) * | 2013-09-18 | 2015-03-19 | Yahoo! Inc. | Automatic verification by comparing user interface images |
| CN104866414A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method, device and system for testing application program |
| US9355122B1 (en) * | 2014-05-07 | 2016-05-31 | Amazon Technologies, Inc. | Filtering applications using runtime inspection |
| CN105868102A (en) * | 2016-03-22 | 2016-08-17 | 中国科学院软件研究所 | Computer vision based mobile terminal application testing system and method |
| US20180165264A1 (en) * | 2016-12-12 | 2018-06-14 | Wipro Limited | Method and system for automatically updating automation sequences |
| CN108509343A (en) * | 2018-04-04 | 2018-09-07 | 浙江小泰科技有限公司 | Automated testing method based on image recognition technology and system |
| CN110245068A (en) * | 2019-04-25 | 2019-09-17 | 深圳壹账通智能科技有限公司 | Automated testing method, device and the computer equipment of the H5 page |
| CN110851280A (en) * | 2019-11-13 | 2020-02-28 | 深圳航天智慧城市系统技术研究院有限公司 | Automatic data acquisition method based on distributed intelligent edge computing technology |
| CN110851368A (en) * | 2019-11-19 | 2020-02-28 | 天津车之家数据信息技术有限公司 | Multi-device collaborative testing method and device, computing device and system |
Non-Patent Citations (4)
| Title |
|---|
| 侯津;顾乃杰;丁世举;杜云开;: "基于控件路径的跨设备UI自动化测试方法" * |
| 李昕宇;侯春萍;王宝亮;宁国津;于奎星;: "基于图像匹配的移动应用自动化测试方法研究" * |
| 赵崇裕;叶峰;郑炳坤;赖乙宗;: "基于uClinux的图像处理及Socket传输的实现" * |
| 郑强;: "自动视觉屏幕测试系统的开发和设计" * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181838A (en) * | 2020-09-30 | 2021-01-05 | 无锡雪浪数制科技有限公司 | Automatic testing method based on image comparison |
| CN112181838B (en) * | 2020-09-30 | 2022-08-30 | 无锡雪浪数制科技有限公司 | Automatic testing method based on image comparison |
| CN112732559A (en) * | 2020-12-30 | 2021-04-30 | 广东粤云工业互联网创新科技有限公司 | Picture comparison method, automatic dial testing method and system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111597116B (en) | 2023-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108564082B (en) | Image processing method, device, server and medium | |
| CN111291661B (en) | Method and equipment for identifying text content of icon in screen | |
| CN111597116A (en) | Mobile terminal UI automatic test method, system, storage medium and electronic equipment | |
| CN109472852B (en) | Point cloud image display method and device, equipment and storage medium | |
| CN109359043B (en) | Mobile game automatic testing method based on machine learning | |
| CN109285181B (en) | Method and apparatus for recognizing image | |
| CN112559341A (en) | Picture testing method, device, equipment and storage medium | |
| CN112612690A (en) | User interface information processing method and device, electronic equipment and storage medium | |
| CN111949509B (en) | Response time testing method, device and equipment of application software and storage medium | |
| CN108229270B (en) | Method, device and electronic equipment for identifying road from remote sensing image | |
| CN106682670B (en) | Station caption identification method and system | |
| CN112712121B (en) | Image recognition model training method, device and storage medium | |
| CN110119459A (en) | Image data retrieval method and image data retrieving apparatus | |
| CN116050445A (en) | Two-dimensional code identification method and equipment | |
| CN114972500A (en) | Checking method, marking method, system, device, terminal, equipment and medium | |
| CN113849415A (en) | Control testing method and device, storage medium and electronic equipment | |
| CN106775701B (en) | Client automatic evidence obtaining method and system | |
| CN108924905B (en) | Method, device and computer readable medium for generating wireless access point information | |
| CN113761968A (en) | Data processing method and device, electronic equipment and computer storage medium | |
| CN113516131A (en) | Image processing method, device, equipment and storage medium | |
| CN111292374A (en) | Method and equipment for automatically plugging and unplugging USB interface | |
| CN112446850A (en) | Adaptation test method and device and electronic equipment | |
| CN110010019B (en) | Control method and device for assembling LED screen | |
| CN115629993A (en) | Software testing method and device, computer equipment and readable storage medium | |
| CN114048128A (en) | System picture automatic testing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |