CN111597116B - Mobile terminal UI automatic test method, system, storage medium and electronic equipment - Google Patents
Mobile terminal UI automatic test method, system, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN111597116B CN111597116B CN202010430351.1A CN202010430351A CN111597116B CN 111597116 B CN111597116 B CN 111597116B CN 202010430351 A CN202010430351 A CN 202010430351A CN 111597116 B CN111597116 B CN 111597116B
- Authority
- CN
- China
- Prior art keywords
- resolution
- mobile terminal
- picture
- screen
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010998 test method Methods 0.000 title claims abstract description 14
- 238000000034 method Methods 0.000 claims abstract description 26
- 238000012360 testing method Methods 0.000 claims abstract description 26
- 238000006243 chemical reaction Methods 0.000 claims abstract description 9
- 230000003993 interaction Effects 0.000 claims abstract 2
- 238000004891 communication Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000013515 script Methods 0.000 abstract description 8
- 230000005540 biological transmission Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 10
- 238000011160 research Methods 0.000 description 3
- 239000010979 ruby Substances 0.000 description 2
- 229910001750 ruby Inorganic materials 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013522 software testing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a mobile terminal UI automatic test method, a system, a storage medium and an electronic device, belonging to the field of computer software test, and aiming at solving the technical problems of how to efficiently and accurately write an automatic test script in the left mobile terminal automatic test process, the adopted technical scheme is as follows: according to the method, a target picture with resolution and a real-time whole mobile terminal screen capture picture with mobile terminal resolution are converted into uniform resolution, then comparison is carried out through opencv, a coordinate point with highest matching degree is taken to return to a relative position, interaction with a mobile terminal is carried out by means of minicap, and automatic testing of a mobile terminal true machine is achieved. The system comprises a target picture acquisition unit, a service starting unit, a transmission unit, a resolution conversion unit, a comparison unit and a threshold setting unit.
Description
Technical Field
The invention relates to the field of computer software testing, in particular to a mobile terminal UI automatic testing method, a system, a storage medium and electronic equipment.
Background
OpenCV is a cross-platform computer vision library based on BSD license (open source) release that can run on Linux, windows, android and Mac OS operating systems. The system is lightweight and efficient, is composed of a series of C functions and a small number of C++ classes, provides interfaces of Python, ruby, MATLAB and other languages, and realizes a plurality of general algorithms in the aspects of image processing and computer vision. OpenCV is written in c++ language, its main interface is also c++ language, but a large number of C language interfaces remain. The library also has a number of interfaces Python, java and MATLAB/OCTAVE (version 2.5). The API interface functions of these languages may be obtained through online documents. Support for C#, ch, ruby, GO is also provided today.
Along with the development of society, mobile equipment becomes a necessary living article, and the convenience of mobile terminal apps also makes the frequency of being used by people higher and higher, and this is along with the assurance of mobile application quality for research personnel, makes the mobile terminal apps need to put into great effort to test before being on line.
In order to save manpower, time or hardware resources, and improve the testing efficiency, the pc also has the concept of automated testing, but in the scenario of left-hand movement of testing, because the function has just been developed or the function has not yet been developed, the traditional element-based mode needs the co-cooperation of testing and research personnel, which occupies the time of research personnel, affects the writing speed of testing scripts, and in the way of element positioning, the implementation effect is not very good for the h5 page embedded in the mobile terminal.
Therefore, how to efficiently and accurately write an automatic test script in the process of automatically testing the mobile terminal moving leftwards is a problem to be solved at present.
Disclosure of Invention
The technical task of the invention is to provide a mobile terminal UI automatic test method, a system, a storage medium and electronic equipment, so as to solve the problem of how to write an automatic test script efficiently and accurately in the left-moving mobile terminal automatic test process.
The technical task of the invention is realized in the following manner, namely, the mobile terminal UI automatic test method converts a target picture carrying resolution and a real-time whole mobile terminal screen capture picture carrying the resolution of the mobile terminal into uniform resolution, compares the uniform resolution with opencv, returns a coordinate point with the highest matching degree to a relative position, and interacts with the mobile terminal by means of minimap to realize automatic test of a mobile terminal true machine.
Preferably, the method is specifically as follows:
s1, acquiring a target picture on a front-end page: the directory structure according to the requirement is stored on a server side, and the screen resolution of a mobile side for intercepting pictures is recorded;
s2, placing the execution file and the so file under a mobile terminal file directory based on a miniprep tool, and starting a socket service;
s3, the server side performs websocket communication with socket service of the mobile side, and the mobile side transmits the real-time screen capturing picture to the server side;
s4, converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to the respective screen resolution, and converting the standard resolution into a uniform resolution;
s5, comparing the converted two pictures through an opencv method, and searching all possible positions of the target picture on the mobile terminal real-time screenshot;
s6, setting a threshold value of the similarity, generating a list of coordinate points above the threshold value, selecting the coordinate with the highest matching degree from the list, and returning the coordinate; the point list returned after the Opencv method is called has similarity percentages except for the position coordinates of the points, and the best similarity percentage is the point with the highest matching degree.
More preferably, the conversion to the uniform resolution in the step S4 is specifically as follows:
s401, defining a reference resolution, such as 1080×1920;
s402, acquiring screen resolution of a mobile terminal real machine;
s403, judging whether the screen resolution of the mobile terminal real machine is the same as the reference resolution:
(1) if the reference resolution and the screen resolution of the mobile terminal are the same, the ratio of the reference resolution to the screen resolution of the mobile terminal is 1:1;
(2) if the two types are different, executing step S404;
s404, calculating the ratio of the horizontal resolution to the vertical resolution, and then converting the ratio to the position of the coordinate on the mobile terminal machine under the reference resolution.
More preferably, in the step S2, the command of placing the execution file and the so file under the mobile terminal file directory based on the minirap tool is as follows: adb push 1.So/data/.
More preferably, in the step S5, the two converted pictures are compared by the opencv method as follows:
s501, reducing the sizes of a target picture and a screen capture picture, and only keeping basic information of structure and brightness;
s502, converting a target picture and a screen capture picture into a gray level image;
s503, calculating a gray average value of a gray map corresponding to the target picture;
s504, comparing the gray scale of the pixel: comparing the gray scale of each pixel in the screen capture picture with the average gray scale value:
(1) when the gray level of the screen capturing picture pixel is larger than or equal to the gray level average value, the pixel is marked as 1;
(2) when the gray level of the pixel of the screen capturing picture is smaller than the gray level average value, the pixel is recorded as 0;
s505, according to the result of the step S504, comparing the target picture in which region of the compared screen capturing picture and calculating the similarity ratio.
A mobile terminal UI automatic test system comprises,
the target picture acquisition unit is used for acquiring a target picture on a front-end page, storing the target picture on a server according to a directory structure required, and recording the screen resolution of a mobile terminal for intercepting the picture;
the service starting unit is used for placing the execution file and the so file under the mobile terminal file directory based on the miniata tool and starting a socket service; the specific commands are as follows: adb push 1.So/data/;
the mobile terminal is used for transmitting the real-time screenshot of the screen to the server terminal;
the resolution conversion unit is used for respectively converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to the respective screen resolution and converting the standard resolution into a uniform resolution;
the comparison unit is used for comparing the converted two pictures through an opencv method, and searching all possible positions of the target pictures on the mobile terminal real-time screenshot;
the threshold setting unit is used for setting a threshold of similarity, generating a list of coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning the coordinate; the point list returned after the Opencv method is called has similarity percentages except for the position coordinates of the points, and the best similarity percentage is the point with the highest matching degree.
Preferably, the resolution converting unit includes,
a definition module, configured to define a reference resolution, e.g. 1080×1920;
the resolution obtaining module is used for obtaining the screen resolution of the mobile terminal real machine;
the judging module is used for judging whether the screen resolution of the mobile terminal real machine is the same as the reference resolution;
and the conversion module is used for calculating the ratio of the transverse resolution to the longitudinal resolution, and then converting the ratio into the position of the coordinate on the mobile end machine under the reference resolution.
More preferably, the comparison unit comprises,
the shrinking module is used for shrinking the sizes of the target picture and the screen capture picture, and only retaining the basic information of the structure and the brightness;
the gray processing module is used for converting the target picture and the screen capture picture into a gray image;
the average value calculation module is used for calculating the gray average value of the gray image corresponding to the target image;
the pixel gray scale comparison module is used for comparing the gray scale of each pixel in the screen capture picture with the average gray scale value:
(1) when the gray level of the screen capturing picture pixel is larger than or equal to the gray level average value, the pixel is marked as 1;
(2) when the gray level of the pixel of the screen capturing picture is smaller than the gray level average value, the pixel is recorded as 0;
and the region acquisition module is used for comparing the regions of the target picture in the compared screen capture pictures and calculating the similarity ratio.
A storage medium having stored therein a plurality of instructions, the instructions being loaded by a processor, for performing the steps of the mobile end UI automation test method described above.
An electronic device, the electronic device comprising:
the storage medium described above; and
and a processor for executing the instructions in the storage medium.
The mobile terminal UI automatic test method, the system, the storage medium and the electronic equipment have the following advantages:
comparing the target screenshot with the real-time whole mobile phone screenshot through opencv, returning to the relative position, and interacting with the mobile phone by means of minicap, so that an automatic test script is written efficiently and accurately in the automatic test process of the mobile terminal moving leftwards;
secondly, the invention can develop the automatic script before the function or develop the automatic script simultaneously with the function in the automatic test after the left shift, and reduce the communication and communication cost with people as much as possible;
the method of picture identification is adopted to replace the prior element positioning, so that a tester can more easily get on hand, and the threshold for entering a door in an automatic test is reduced;
and fourthly, the automatic test script can be written after ui is mapped by adopting the picture identification method, the thought of left shift testing is met, and the problem that the h5 page attribute embedded in the mobile terminal is not well positioned after being converted into the android attribute is solved.
Drawings
The invention is further described below with reference to the accompanying drawings.
FIG. 1 is a flow chart diagram of a mobile terminal UI automated test method.
Detailed Description
The mobile terminal UI automation test method, system, storage medium and electronic device of the present invention are described in detail below with reference to the accompanying drawings and specific embodiments.
Example 1:
as shown in figure 1, the mobile terminal UI automatic test method of the invention converts a target picture with resolution and a real-time whole mobile phone screen interception picture with mobile phone resolution into uniform resolution, compares the uniform resolution with opencv, takes a coordinate point with highest matching degree to return to a relative position, and interacts with a mobile phone by means of minirap to realize automatic test of a mobile phone true machine; the method comprises the following steps:
s1, acquiring a target picture on a front-end page: the directory structure according to the requirement is stored on a server side, and the screen resolution of a mobile phone for intercepting pictures is recorded;
s2, placing the execution file and the so file under a mobile phone file directory based on a miniprep tool, and starting a socket service; the commands are: adb push 1.So/data/.
S3, the server side performs websocket communication with socket service of the mobile phone, and the mobile phone transmits the real-time screen capturing picture to the server side;
s4, converting the previous target picture and the screen capture picture transmitted by the mobile phone into a standard resolution according to the respective screen resolutions, and converting the standard resolution into a uniform resolution; the method comprises the following steps:
s401, defining a reference resolution, such as 1080×1920;
s402, acquiring screen resolution of a mobile phone true phone;
s403, judging whether the screen resolution of the mobile phone true phone is the same as the reference resolution:
(1) if the reference resolution and the screen resolution of the mobile phone are the same, the ratio of the reference resolution to the screen resolution of the mobile phone is 1:1;
(2) if the two types are different, executing step S404;
s404, calculating the ratio of the horizontal resolution to the vertical resolution, and then converting the ratio to the position of the coordinate on the mobile phone true machine under the reference resolution.
S5, comparing the converted two pictures through an opencv method, and searching all possible positions of the target picture on the mobile phone real-time screenshot; the method comprises the following steps:
s501, reducing the sizes of a target picture and a screen capture picture, and only keeping basic information of structure and brightness;
s502, converting a target picture and a screen capture picture into a gray level image;
s503, calculating a gray average value of a gray map corresponding to the target picture;
s504, comparing the gray scale of the pixel: comparing the gray scale of each pixel in the screen capture picture with the average gray scale value:
(1) when the gray level of the screen capturing picture pixel is larger than or equal to the gray level average value, the pixel is marked as 1;
(2) when the gray level of the pixel of the screen capturing picture is smaller than the gray level average value, the pixel is recorded as 0;
s505, according to the result of the step S504, comparing the target picture in which region of the compared screen capturing picture and calculating the similarity ratio.
S6, setting a threshold value of the similarity, generating a list of coordinate points above the threshold value, selecting the coordinate with the highest matching degree from the list, and returning the coordinate; the point list returned after the Opencv method is called has similarity percentages except for the position coordinates of the points, and the best similarity percentage is the point with the highest matching degree.
Example 2:
the mobile terminal UI automatic test system of the invention comprises,
the target picture acquisition unit is used for acquiring a target picture on a front-end page, storing the target picture on a server according to a directory structure required, and recording the screen resolution of a mobile phone for intercepting the picture;
the service starting unit is used for placing the execution file and the so file under the mobile phone file directory based on the miniprep tool and starting a socket service; the specific commands are as follows: adb push 1.So/data/;
the transmission unit is used for carrying out websocket communication between the server and socket service of the mobile phone, and the mobile phone transmits the real-time screenshot of the screen to the server;
the resolution conversion unit is used for respectively converting the previous target picture and the screen capture picture transmitted by the mobile phone into a standard resolution according to the respective screen resolution and converting the standard resolution into a uniform resolution; the resolution conversion unit includes a unit for converting the resolution of the image data,
a definition module, configured to define a reference resolution, e.g. 1080×1920;
the resolution obtaining module is used for obtaining the screen resolution of the mobile phone true mobile phone;
the judging module is used for judging whether the screen resolution of the mobile phone true mobile phone is the same as the reference resolution;
and the conversion module is used for calculating the ratio of the horizontal resolution to the vertical resolution, and then converting the ratio into the position of the coordinate on the mobile phone true machine under the reference resolution.
The comparison unit is used for comparing the converted two pictures through an opencv method, and finding all possible positions of the target pictures on the mobile phone real-time screenshot; the comparison unit comprises a comparison unit, wherein the comparison unit comprises a comparison unit,
the shrinking module is used for shrinking the sizes of the target picture and the screen capture picture, and only retaining the basic information of the structure and the brightness;
the gray processing module is used for converting the target picture and the screen capture picture into a gray image;
the average value calculation module is used for calculating the gray average value of the gray image corresponding to the target image;
the pixel gray scale comparison module is used for comparing the gray scale of each pixel in the screen capture picture with the average gray scale value:
(1) when the gray level of the screen capturing picture pixel is larger than or equal to the gray level average value, the pixel is marked as 1;
(2) when the gray level of the pixel of the screen capturing picture is smaller than the gray level average value, the pixel is recorded as 0;
and the region acquisition module is used for comparing the regions of the target picture in the compared screen capture pictures and calculating the similarity ratio.
The threshold setting unit is used for setting a threshold of similarity, generating a list of coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning the coordinate; the point list returned after the Opencv method is called has similarity percentages except for the position coordinates of the points, and the best similarity percentage is the point with the highest matching degree.
Example 3:
the embodiment of the invention also provides a storage medium, wherein a plurality of instructions are stored, and the instructions are loaded by the processor, so that the processor executes the mobile terminal UI automatic test method in any embodiment of the invention. Specifically, a system or apparatus provided with a storage medium on which a software program code realizing the functions of any of the above embodiments is stored, and a computer (or CPU or MPU) of the system or apparatus may be caused to read out and execute the program code stored in the storage medium.
In this case, the program code itself read from the storage medium may realize the functions of any of the above-described embodiments, and thus the program code and the storage medium storing the program code form part of the present invention.
Examples of storage media for providing program code include floppy disks, hard disks, magneto-optical disks, optical disks (e.g., CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-R cell phone UI automated test methods, systems, storage media, and electronic devices M, DVD-RW, DVD+RW), magnetic tapes, nonvolatile memory cards, and ROMs. Alternatively, the program code may be downloaded from a server computer by a communication network.
Further, it should be apparent that the functions of any of the above-described embodiments may be implemented not only by executing the program code read out by the computer, but also by causing an operating system or the like operating on the computer to perform part or all of the actual operations based on the instructions of the program code.
Further, it is understood that the program code read out by the storage medium is written into a memory provided in an expansion board inserted into a computer or into a memory provided in an expansion unit connected to the computer, and then a CPU or the like mounted on the expansion board or the expansion unit is caused to perform part and all of actual operations based on instructions of the program code, thereby realizing the functions of any of the above embodiments.
Example 4:
an electronic apparatus of the present invention includes:
the storage medium; and
a processor configured to execute the instructions in the storage medium of embodiment 3 of the present invention.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention.
Claims (5)
1. The method is characterized in that a target picture carrying resolution and a real-time whole mobile terminal screen capture picture carrying the resolution of a mobile terminal are converted into uniform resolution, then are compared through opencv, a coordinate point with highest matching degree is taken to return to a relative position, and interaction with the mobile terminal is realized by means of minirap, so that automatic testing of a real machine of the mobile terminal is realized; the method comprises the following steps:
s1, acquiring a target picture on a front-end page: the directory structure according to the requirement is stored on a server side, and the screen resolution of a mobile side for intercepting pictures is recorded;
s2, placing the execution file and the so file under a mobile terminal file directory based on a miniprep tool, and starting a socket service;
s3, the server side performs websocket communication with socket service of the mobile side, and the mobile side transmits the real-time screen capturing picture to the server side;
s4, converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to the respective screen resolution, and converting the standard resolution into a uniform resolution; the method comprises the following steps:
s401, defining a reference resolution;
s402, acquiring screen resolution of a mobile terminal real machine;
s403, judging whether the screen resolution of the mobile terminal real machine is the same as the reference resolution:
(1) if the reference resolution and the screen resolution of the mobile terminal are the same, the ratio of the reference resolution to the screen resolution of the mobile terminal is 1:1;
(2) if the two types are different, executing step S404;
s404, calculating the ratio of the horizontal resolution to the vertical resolution, and then converting the ratio to the position of the coordinate on the mobile terminal machine under the reference resolution;
s5, comparing the converted two pictures through an opencv method, and searching all possible positions of the target picture on the mobile terminal real-time screenshot;
the two converted pictures are compared through an opencv method, and the two converted pictures are specifically:
s501, reducing the sizes of a target picture and a screen capture picture, and only keeping basic information of structure and brightness;
s502, converting a target picture and a screen capture picture into a gray level image;
s503, calculating a gray average value of a gray map corresponding to the target picture;
s504, comparing the gray scale of the pixel: comparing the gray scale of each pixel in the screen capture picture with the average gray scale value:
(1) when the gray level of the screen capturing picture pixel is larger than or equal to the gray level average value, the pixel is marked as 1;
(2) when the gray level of the pixel of the screen capturing picture is smaller than the gray level average value, the pixel is recorded as 0;
s505, comparing the regions of the compared screen captured pictures of the target picture according to the result of the step S504, and calculating the similarity ratio;
s6, setting a threshold value of the similarity, generating a list of coordinate points above the threshold value, selecting the coordinate with the highest matching degree from the list, and returning.
2. The mobile terminal UI automation test method according to claim 1, wherein the command of placing the execution file and the so file under the mobile terminal file directory based on the minicap tool in step S2 is: adb push 1.So/data/.
3. A mobile terminal UI automatic test system is characterized in that the system comprises,
the target picture acquisition unit is used for acquiring a target picture on a front-end page, storing the target picture on a server according to a directory structure required, and recording the screen resolution of a mobile terminal for intercepting the picture;
the service starting unit is used for placing the execution file and the so file under the mobile terminal file directory based on the miniata tool and starting a socket service; the specific commands are as follows: adb push 1.So/data/;
the mobile terminal is used for transmitting the real-time screenshot of the screen to the server terminal;
the resolution conversion unit is used for respectively converting the previous target picture and the screen capture picture transmitted by the mobile terminal into a standard resolution according to the respective screen resolution and converting the standard resolution into a uniform resolution;
the comparison unit is used for comparing the converted two pictures through an opencv method, and searching all possible positions of the target pictures on the mobile terminal real-time screenshot;
the threshold setting unit is used for setting a threshold of similarity, generating a list of coordinate points above the threshold, selecting the coordinate with the highest matching degree from the list and returning the coordinate;
wherein the resolution converting unit includes,
a definition module for defining a reference resolution;
the resolution obtaining module is used for obtaining the screen resolution of the mobile terminal real machine;
the judging module is used for judging whether the screen resolution of the mobile terminal real machine is the same as the reference resolution;
the conversion module is used for calculating the ratio of the transverse resolution to the longitudinal resolution, and then converting the ratio into the position of the coordinate on the mobile terminal machine under the reference resolution;
the comparison unit comprises a comparison unit, wherein the comparison unit comprises a comparison unit,
the shrinking module is used for shrinking the sizes of the target picture and the screen capture picture, and only retaining the basic information of the structure and the brightness;
the gray processing module is used for converting the target picture and the screen capture picture into a gray image;
the average value calculation module is used for calculating the gray average value of the gray image corresponding to the target image;
the pixel gray scale comparison module is used for comparing the gray scale of each pixel in the screen capture picture with the average gray scale value:
(1) when the gray level of the screen capturing picture pixel is larger than or equal to the gray level average value, the pixel is marked as 1;
(2) when the gray level of the pixel of the screen capturing picture is smaller than the gray level average value, the pixel is recorded as 0;
and the region acquisition module is used for comparing the regions of the target picture in the compared screen capture pictures and calculating the similarity ratio.
4. A storage medium having stored therein a plurality of instructions, wherein the instructions are loaded by a processor to perform the steps of the mobile end UI automation test method of any one of claims 1-2.
5. An electronic device, the electronic device comprising:
the storage medium of claim 4; and
and a processor for executing the instructions in the storage medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010430351.1A CN111597116B (en) | 2020-05-20 | 2020-05-20 | Mobile terminal UI automatic test method, system, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010430351.1A CN111597116B (en) | 2020-05-20 | 2020-05-20 | Mobile terminal UI automatic test method, system, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111597116A CN111597116A (en) | 2020-08-28 |
| CN111597116B true CN111597116B (en) | 2023-06-09 |
Family
ID=72185885
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010430351.1A Active CN111597116B (en) | 2020-05-20 | 2020-05-20 | Mobile terminal UI automatic test method, system, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111597116B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181838B (en) * | 2020-09-30 | 2022-08-30 | 无锡雪浪数制科技有限公司 | Automatic testing method based on image comparison |
| CN112732559A (en) * | 2020-12-30 | 2021-04-30 | 广东粤云工业互联网创新科技有限公司 | Picture comparison method, automatic dial testing method and system and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014169565A1 (en) * | 2013-08-21 | 2014-10-23 | 中兴通讯股份有限公司 | Terminal testing method and device |
| CN104866414A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method, device and system for testing application program |
| US9355122B1 (en) * | 2014-05-07 | 2016-05-31 | Amazon Technologies, Inc. | Filtering applications using runtime inspection |
| CN105868102A (en) * | 2016-03-22 | 2016-08-17 | 中国科学院软件研究所 | Computer vision based mobile terminal application testing system and method |
| CN108509343A (en) * | 2018-04-04 | 2018-09-07 | 浙江小泰科技有限公司 | Automated testing method based on image recognition technology and system |
| CN110245068A (en) * | 2019-04-25 | 2019-09-17 | 深圳壹账通智能科技有限公司 | Automated testing method, device and the computer equipment of the H5 page |
| CN110851280A (en) * | 2019-11-13 | 2020-02-28 | 深圳航天智慧城市系统技术研究院有限公司 | Automatic data acquisition method based on distributed intelligent edge computing technology |
| CN110851368A (en) * | 2019-11-19 | 2020-02-28 | 天津车之家数据信息技术有限公司 | Multi-device collaborative testing method and device, computing device and system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8682083B2 (en) * | 2011-06-30 | 2014-03-25 | American Express Travel Related Services Company, Inc. | Method and system for webpage regression testing |
| US9135151B2 (en) * | 2013-09-18 | 2015-09-15 | Yahoo! Inc. | Automatic verification by comparing user interface images |
| US10204092B2 (en) * | 2016-12-12 | 2019-02-12 | Wipro Limited | Method and system for automatically updating automation sequences |
-
2020
- 2020-05-20 CN CN202010430351.1A patent/CN111597116B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014169565A1 (en) * | 2013-08-21 | 2014-10-23 | 中兴通讯股份有限公司 | Terminal testing method and device |
| CN104866414A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method, device and system for testing application program |
| US9355122B1 (en) * | 2014-05-07 | 2016-05-31 | Amazon Technologies, Inc. | Filtering applications using runtime inspection |
| CN105868102A (en) * | 2016-03-22 | 2016-08-17 | 中国科学院软件研究所 | Computer vision based mobile terminal application testing system and method |
| CN108509343A (en) * | 2018-04-04 | 2018-09-07 | 浙江小泰科技有限公司 | Automated testing method based on image recognition technology and system |
| CN110245068A (en) * | 2019-04-25 | 2019-09-17 | 深圳壹账通智能科技有限公司 | Automated testing method, device and the computer equipment of the H5 page |
| CN110851280A (en) * | 2019-11-13 | 2020-02-28 | 深圳航天智慧城市系统技术研究院有限公司 | Automatic data acquisition method based on distributed intelligent edge computing technology |
| CN110851368A (en) * | 2019-11-19 | 2020-02-28 | 天津车之家数据信息技术有限公司 | Multi-device collaborative testing method and device, computing device and system |
Non-Patent Citations (4)
| Title |
|---|
| 侯津 ; 顾乃杰 ; 丁世举 ; 杜云开 ; .基于控件路径的跨设备UI自动化测试方法.计算机系统应用.2018,(第10期),全文. * |
| 李昕宇 ; 侯春萍 ; 王宝亮 ; 宁国津 ; 于奎星 ; .基于图像匹配的移动应用自动化测试方法研究.计算机工程与应用.2015,(第13期),全文. * |
| 赵崇裕 ; 叶峰 ; 郑炳坤 ; 赖乙宗 ; .基于uClinux的图像处理及Socket传输的实现.计算机应用与软件.2015,(第04期),全文. * |
| 郑强 ; .自动视觉屏幕测试系统的开发和设计.科协论坛(下半月).2011,(第08期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111597116A (en) | 2020-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111597116B (en) | Mobile terminal UI automatic test method, system, storage medium and electronic equipment | |
| CN111291661B (en) | Method and equipment for identifying text content of icon in screen | |
| CN109472852B (en) | Point cloud image display method and device, equipment and storage medium | |
| CN109359043B (en) | Mobile game automatic testing method based on machine learning | |
| CN111949509B (en) | Response time testing method, device and equipment of application software and storage medium | |
| CN112712121B (en) | Image recognition model training method, device and storage medium | |
| EP3588325A1 (en) | Method, device and system for processing image tagging information | |
| CN101192153A (en) | Method and apparatus for obtaining user interface information from executable program code | |
| CN112559341A (en) | Picture testing method, device, equipment and storage medium | |
| CN112308069A (en) | Click test method, device, equipment and storage medium for software interface | |
| CN109840212B (en) | Function test method, device and equipment of application program and readable storage medium | |
| CN113761968A (en) | Data processing method and device, electronic equipment and computer storage medium | |
| CN111815748A (en) | Animation processing method and device, storage medium and electronic equipment | |
| CN115905016A (en) | BIOS Setup search function test method and device, electronic equipment and storage medium | |
| CN106775701B (en) | Client automatic evidence obtaining method and system | |
| CN111292374B (en) | Method and equipment for automatically plugging and unplugging USB interface | |
| CN114489903A (en) | Interface element positioning method and device, storage medium and electronic equipment | |
| CN114782822A (en) | Method and device for detecting state of power equipment, electronic equipment and storage medium | |
| CN113849415A (en) | Control testing method and device, storage medium and electronic equipment | |
| CN113821438A (en) | Application response performance test method and system and computing equipment | |
| CN112559340A (en) | Picture testing method, device, equipment and storage medium | |
| CN111860315A (en) | Method, device and equipment for detecting form line and storage medium | |
| CN111327745A (en) | Method and equipment for testing silencing key of mobile terminal | |
| CN111124862A (en) | Intelligent equipment performance testing method and device and intelligent equipment | |
| CN116401151A (en) | Precision testing method and system for picture identification algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |