CN112363919A - Automatic test method, device, equipment and storage medium for user interface AI - Google Patents
Automatic test method, device, equipment and storage medium for user interface AI Download PDFInfo
- Publication number
- CN112363919A CN112363919A CN202011205898.8A CN202011205898A CN112363919A CN 112363919 A CN112363919 A CN 112363919A CN 202011205898 A CN202011205898 A CN 202011205898A CN 112363919 A CN112363919 A CN 112363919A
- Authority
- CN
- China
- Prior art keywords
- application software
- page
- screenshot
- user interface
- similarity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010998 test method Methods 0.000 title claims description 10
- 238000012360 testing method Methods 0.000 claims abstract description 109
- 238000012545 processing Methods 0.000 claims abstract description 77
- 238000000034 method Methods 0.000 claims abstract description 34
- 238000004891 communication Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 9
- 238000000605 extraction Methods 0.000 claims description 7
- 238000013473 artificial intelligence Methods 0.000 description 46
- 230000008569 process Effects 0.000 description 11
- 238000000691 measurement method Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000013136 deep learning model Methods 0.000 description 3
- 238000010801 machine learning Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012015 optical character recognition Methods 0.000 description 2
- 235000007516 Chrysanthemum Nutrition 0.000 description 1
- 244000189548 Chrysanthemum x morifolium Species 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the application provides a method, a device, equipment and a storage medium for automatically testing a user interface AI. The method comprises the following steps: acquiring a current screenshot of a page of application software displayed on terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software; performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software; judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software; and when the page of the application software is in a stable state, carrying out preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface. The embodiment of the application can ensure the stability of the test, improve the test efficiency and reduce the time cost of test debugging.
Description
Technical Field
The present disclosure relates to the field of testing technologies, and in particular, to an automatic testing method for User Interface (UI) Artificial Intelligence (AI), an automatic testing apparatus for AI, an electronic device, and a computer-readable storage medium.
Background
User interface automated testing is primarily based on the functionality of the user interface. At present, when the page function is operated, due to factors such as the performance of the application software, network delay and the like, the functions needing to be operated are not completely loaded, that is, the page of the application software is in an unstable state, so that the automated test of the user interface fails.
In order to solve the problem, a step of displaying the waiting time needs to be actively added to ensure the stability of the user interface automation test. However, the addition of the step of displaying the waiting time may bring a certain influence on the efficiency of the automated testing of the user interface, and may increase the time cost for the automated testing and debugging of the user interface.
Disclosure of Invention
The embodiment of the application provides a user interface AI automatic test method, a user interface AI automatic test device, an electronic device and a computer readable storage medium, which realize intelligent waiting by determining the state of a page of application software, can ensure the stability of the user interface automatic test, improve the efficiency of the user interface automatic test and reduce the time cost of the user interface automatic test debugging.
In order to solve the above technical problem, the embodiment of the present application is implemented as follows:
in a first aspect, a method for automatically testing a user interface AI is provided, which includes:
acquiring a current screenshot of a page of application software displayed on terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software;
performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the two adjacent pages of the application software;
judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the two adjacent pages of the application software;
and under the condition that the page of the application software is in a stable state, carrying out preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface.
In a second aspect, there is provided a user interface AI automated testing apparatus, comprising:
the classification module is used for acquiring a current screenshot of a page of application software displayed on terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software;
the matching module is used for matching the current screenshot of the page of the application software with the previous screenshot of the page of the application software to obtain the similarity of the screenshots of two adjacent pages of the application software;
the judging module is used for judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of screenshots of two adjacent pages of the application software;
and the processing module is used for carrying out preset operation on the target object in the page of the application software to obtain the result of the automatic test of the user interface under the condition that the state of the page of the application software is a stable state.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus; the processor, the communication interface and the memory complete mutual communication through a bus; the memory is used for storing a computer program; the processor is configured to execute the program stored in the memory, so as to implement the automatic test method for the user interface AI according to the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for automatically testing the AI according to the first aspect.
According to the user interface AI automatic test method, the user interface AI automatic test device, the electronic equipment and the computer readable storage medium, the current screenshot of the page of the application software displayed on the terminal equipment is obtained, and the current screenshot of the page of the application software is identified to obtain the type of the page of the application software; performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software; judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software; under the condition that the page state of the application software is a stable state, performing preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface; the method has the advantages that the page of the application software displayed on the terminal equipment is identified by utilizing an AI technology, the page state of the application software is determined by combining with the similarity of screenshots of the pages of two adjacent application software, intelligent waiting is realized, the step of actively adding display waiting time is not needed, the stability of the automatic test of the user interface can be guaranteed, the efficiency of the automatic test of the user interface is improved, and the time cost of the automatic test and debugging of the user interface is reduced.
Drawings
In order to more clearly illustrate one or more embodiments of the present application or technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without inventive exercise.
FIG. 1 is a schematic flowchart of an implementation manner of a user interface AI automatic test method according to an embodiment of the present application;
FIG. 2 is a schematic flowchart illustrating another implementation manner of a user interface AI automatic testing method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating yet another implementation manner of a user interface AI automatic test method according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating an implementation manner of obtaining a type of a page of application software by identifying a screenshot of the page of the application software according to the embodiment of the present application;
FIG. 5 is a schematic flowchart of an implementation manner of obtaining similarity between page screenshots of two adjacent pieces of application software by performing image matching on the page screenshots of the application software according to the embodiment of the present application;
FIG. 6 is a schematic diagram of an application scenario of the method for automatically testing the user interface AI according to the embodiment of the present application;
FIG. 7 is a schematic structural diagram of an embodiment of an automatic test apparatus for a user interface AI;
fig. 8 is a schematic structural diagram of another configuration of the automatic user interface AI testing apparatus according to the embodiment of the present disclosure.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in one or more embodiments of the present application, the technical solutions in one or more embodiments of the present application will be clearly and completely described below with reference to the drawings in one or more embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments that can be derived by a person skilled in the art from one or more embodiments of the present application without inventive step shall fall within the scope of protection of this document.
Fig. 1 is a schematic flowchart of an implementation manner of a user interface AI automatic testing method according to an embodiment of the present disclosure, where the method shown in fig. 1 may be executed by a user interface AI automatic testing apparatus as an execution main body, and the user interface AI automatic testing apparatus may be installed in a general-purpose terminal device, such as a desktop computer, a notebook computer, a tablet computer, a mobile phone, a wearable device, and the like, or may be installed in a dedicated testing device, which is not limited in this embodiment of the present disclosure, and as shown in fig. 1, the automatic testing method at least includes:
s102, acquiring a current screenshot of the page of the application software displayed on the terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software.
In this embodiment of the application, an object of the ui automation test may be application software (application software) installed on a terminal device, for example, the terminal device may be a mobile phone, a tablet computer, a vehicle-mounted computer, a wearable device, and the like, and the application software may be life utility software, social contact software, efficiency office software, music video software, shopping software, travel software, and the like. Optionally, after the application software is opened on the terminal device, the terminal device may intercept the current screenshot of the page of the application software, send the current screenshot to the user interface AI automatic testing apparatus, and obtain the current screenshot of the page of the application software displayed on the terminal device; or, the user interface of the terminal device may be displayed on the user interface AI automatic test device, and after the application software on the terminal device is opened, the user interface AI automatic test device captures a current screenshot of a page of the application software, and obtains the current screenshot of the page of the application software displayed on the terminal device; the embodiment of the invention does not limit the implementation mode of obtaining the current screenshot of the page of the application software displayed on the terminal equipment.
In the embodiment of the present application, a page of application software includes page elements such as characters and icons, and the type of the page element is not limited in the embodiment of the present application, where the characters include numbers in the embodiment of the present application. After the current screenshot of the page of the application software displayed on the terminal device is obtained, the type of the page element in the page of the application software can be obtained by identifying the page element in the current screenshot of the page of the application software, and the type of the page of the application software can be determined according to the type of the page element in the page of the application software. Optionally, the current screenshot of the page of the application software may be identified through machine learning, for example, the machine learning may be a deep learning model, and an implementation manner of identifying the current screenshot of the page of the application software in the embodiment of the present application is not limited.
And S104, carrying out image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the two adjacent pages of the application software.
In the embodiment of the present application, an existing image matching algorithm may be adopted, and image matching processing is performed on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity between the screenshots of the pages of the two adjacent application software.
In some optional examples, the gray value of the current screenshot of the page of the application software and the gray value of the previous screenshot of the page of the application software are obtained, and the gray value of the current screenshot of the page of the application software is matched with the gray value of the previous screenshot of the page of the application software according to a preset similarity measurement method, so that the similarity of the screenshots of the pages of two adjacent application software is obtained; in other optional examples, the feature value of the current screenshot of the page of the application software and the feature value of the previous screenshot of the page of the application software may be obtained, and the feature value of the current screenshot of the page of the application software and the feature value of the previous screenshot of the page of the application software are matched according to a preset similarity measurement method to obtain the similarity of the screenshots of the two adjacent pages of the application software; the preset similarity measurement method adopted in the image matching process may be implemented by using an existing similarity measurement method, which is not limited in the embodiment of the present application.
And S106, judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software.
In the embodiment of the present application, the types of the pages of the application software may at least include: loading a middle page and a non-loading middle page; the similarity between the screenshots of the two adjacent application software pages at least comprises the following steps: the similarity of the screenshots of the two adjacent application software pages is consistent with the similarity of the screenshots of the two adjacent application software pages is inconsistent; however, the method is not limited in this embodiment, the type of the page of the application software may further include a specific type of the non-loaded page, and the similarity between the screenshots of two adjacent pages of the application software may further include a specific similarity value of the inconsistent screenshots of two adjacent pages of the application software. After the similarity between the type of the page of the application software and the screenshots of the two adjacent pages of the application software is obtained, whether the state of the page of the application software is a stable state or not can be judged according to the similarity between the type of the page of the application software and the screenshots of the two adjacent pages of the application software. Optionally, the state of the page of the application software is determined to be a stable state according to the fact that the type of the page of the application software is a non-loading page and the similarity of the screenshots of the pages of two adjacent application software is consistent; the embodiment of the present application does not limit the implementation manner of determining that the page state of the application software is the stable state.
And S108, under the condition that the page state of the application software is a stable state, performing preset operation on a target object in the page of the application software to obtain a result of the user interface automation test.
In this embodiment of the present application, the target object may be a page element such as a text or an icon that can be operated in a page of the application software, and the type of the target object is not limited in this embodiment of the present application. The operation performed on the target object may be preset according to the type of the target object, so that in a case that the state of the page of the application software is determined to be a stable state, the preset operation may be performed on the target object to obtain a result of the user interface automation test, for example, the preset operation performed on the target object may include one of the following operations: click operation, assignment operation, sliding operation and input operation. Optionally, when the page element in the current screenshot of the page of the application software is identified and the type of the page element in the page of the application software is obtained, the position information of the target object in the page of the application software is obtained, so that when the state of the page of the application software is determined to be a stable state, the target object can be subjected to preset operation according to the position information of the target object in the page of the application software, and a result of the user interface automation test is obtained. The embodiment of the present application does not limit an implementation manner of performing a preset operation on a target object in a page of application software when the state of the page of the application software is a stable state.
According to the automatic test method for the user interface AI, the current screenshot of the page of the application software displayed on the terminal equipment is obtained, and the current screenshot of the page of the application software is identified to obtain the type of the page of the application software; performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software; judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software; under the condition that the page state of the application software is a stable state, performing preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface; the method has the advantages that the page of the application software displayed on the terminal equipment is identified by utilizing an AI technology, the page state of the application software is determined by combining with the similarity of screenshots of the pages of two adjacent application software, intelligent waiting is realized, the step of actively adding display waiting time is not needed, the stability of the automatic test of the user interface can be guaranteed, the efficiency of the automatic test of the user interface is improved, and the time cost of the automatic test and debugging of the user interface is reduced.
The user interface AI automated testing method of the present application will be described in detail below with reference to the embodiments of fig. 2 to 6.
Fig. 2 is a schematic flowchart of another implementation manner of an automatic testing method for a user interface AI according to an embodiment of the present application, and as shown in fig. 2, the automatic testing method at least includes:
s202, acquiring a current screenshot of the page of the application software displayed on the terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software.
In this embodiment, the description of S202 can refer to the description of S102 in fig. 1, and therefore will not be repeated here.
And S204, carrying out image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the two adjacent pages of the application software.
In this embodiment, the description about S204 can refer to the description about S104 in fig. 1, and therefore, the description will not be repeated here.
And S206, judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software.
In this embodiment, the description about S206 can refer to the description about S106 in fig. 1, and therefore, the description will not be repeated here. Optionally, the page of the application software is determined to be a non-loaded page according to the type of the page of the application software, and the similarity of the screenshots of the pages of two adjacent application software is consistent, so that the page of the application software is determined to be in a stable state; the page state of the application software can be judged to be an unstable state according to the fact that the type of the page of the application software is a loading page or the similarity of screenshots of the pages of two adjacent application software is inconsistent; the embodiment of the present application does not limit the implementation manner of determining whether the page of the application software is in a stable state or an unstable state.
Executing S208 when the state of the page of the application software is a stable state; otherwise, if the state of the page of the application software is an unstable state, S202 is executed.
And S208, carrying out preset operation on the target object in the page of the application software to obtain the result of the automatic test of the user interface.
In this embodiment, the description about S208 can refer to the description about S108 in fig. 1, and therefore, the description will not be repeated here. In the present embodiment, in the case where the state of the page of the application software is determined to be the unstable state, it may return to S202, and S202, S204, and S206 may be executed in a loop from S202 until S208 is executed in the case where the state of the page of the application software is determined to be the stable state.
According to the method and the device for automatically testing the user interface, under the condition that the state of the page of the application software is judged to be an unstable state, the current screenshot of the page of the application software displayed on the terminal device is obtained, the current screenshot of the page of the application software is identified, the type of the page of the application software is obtained, the page of the application software starts to be executed circularly, the intelligent waiting time can be determined according to the time that the state of the page of the application software is the unstable state, the efficiency of automatic testing of the user interface is fully guaranteed, and the time cost of automatic testing and debugging of the user interface is effectively reduced.
Fig. 3 is a schematic flowchart of another implementation manner of the automatic testing method for the user interface AI according to the embodiment of the present application, and as shown in fig. 3, the automatic testing method at least includes:
s302, opening a page of application software on the terminal equipment, and starting timing through a timer.
In this embodiment, a timer may be set in the AI automatic testing apparatus, for example, the timer may be implemented in a hardware or software manner, and the implementation manner of the timer is not limited in this embodiment of the application. When the application software on the terminal equipment is opened, the timing can be started by the timer at the same time.
S304, acquiring the current screenshot of the page of the application software displayed on the terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software.
In this embodiment, the description of S304 can refer to the description of S102 in fig. 1, and therefore will not be repeated here.
And S306, carrying out image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the two adjacent pages of the application software.
In this embodiment, the description of S306 can refer to the description of S104 in fig. 1, and therefore will not be repeated here.
And S308, judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software.
In this embodiment, the description of S308 can refer to the description of S206 in fig. 2, and therefore will not be repeated here.
Executing S310 under the condition that the state of the page of the application software is a stable state; otherwise, if the state of the page of the application software is an unstable state, S312 is executed.
S310, carrying out preset operation on the target object in the page of the application software to obtain the result of the user interface automatic test.
In this embodiment, the description of S310 can refer to the description of S108 in fig. 1, and therefore will not be repeated here.
S312, acquiring the time of the timer, and judging whether the time of the timer is less than the preset overtime.
Executing S304 under the condition that the time of the timer is less than the preset overtime time; otherwise, in the case that the time of the timer is greater than or equal to the preset timeout time, S314 is performed.
And S314, returning prompt information of test failure.
In this embodiment, when the state of the page of the application software is determined to be an unstable state, the time of the timer may be obtained, the obtained time of the timer is compared with a preset timeout period, and whether the time of the timer is less than the preset timeout period is determined, where the timeout period may be preset according to a requirement of an automated test on a user interface, and the embodiment of the application is not limited thereto. In the case that the time of the determination timer is less than the preset timeout time, the process may return to S304, and S304, S306, and S308 may be executed in a loop from S304 until S310 is executed in the case that the state of the page of the application software is determined to be the stable state; when the time of the timer is determined to be greater than or equal to the preset timeout time, the test failure prompt message may be returned, the form of the returned test failure prompt message is not limited in this embodiment, for example, the test failure prompt message may be prompted by using a text and/or a prompt sound.
In the embodiment, when the page of the application software on the terminal device is opened, the timer is started, and the setting of the timeout time can be used for ending the automatic test of the user interface when the state of the page of the application software is an unstable state and the duration of the unstable state exceeds the timeout time, that is, the opening time of the page of the application software exceeds the timeout time, so that the efficiency of the automatic test of the user interface can be effectively ensured, and the time cost for the automatic test and debugging of the user interface is reduced.
Fig. 4 is a schematic flowchart of an implementation manner of obtaining a type of a page of application software by identifying a screenshot of the page of the application software in the embodiment of the present application, and as shown in fig. 4, obtaining a current screenshot of the page of the application software displayed on a terminal device, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software at least includes:
s402, intercepting the current screenshot of the page of the application software displayed on the terminal equipment.
In this embodiment, the screenshot of the current page of the application software displayed on the terminal device is obtained by displaying the user interface of the terminal device on the automatic user interface AI test apparatus, and after the application software on the terminal device is opened, intercepting the screenshot by the automatic user interface AI test apparatus.
S404, carrying out image recognition processing and/or character recognition processing on the page elements in the current screenshot of the page of the application software to obtain the types of the page elements in the page of the application software.
In this embodiment, the text Recognition processing may be performed on the text in the screenshot of the current page of the application software to obtain the content of the text in the page of the application software, for example, the text Recognition processing may be performed through Optical Character Recognition (OCR); the image recognition processing may be performed on an icon and the like in a screenshot of a current page of the application software to obtain a type of a page element such as the icon and the like in the page of the application software, for example, the image recognition processing may be performed through image matching, where the image matching may adopt algorithms such as template matching or feature matching, and the algorithm for implementing the image matching is not limited in the embodiment of the present application.
In some optional examples, the screenshot of the current page of the application software may be respectively subjected to a text recognition process and an image recognition process through two deep learning models; in other optional examples, the two deep learning models may be used to perform text detection processing and general object detection processing on the screenshot of the current page of the application software, respectively, to mark a text region and a general object region in the screenshot of the current page of the application software, and then perform text recognition processing and image recognition processing on the text region and the general object region marked in the screenshot of the current page of the application software, respectively; the embodiment of the application does not limit the implementation mode of performing character recognition processing and image recognition processing on the screenshot of the current page of the application software.
S406, determining the type of the page of the application software according to the type of the page element in the page of the application software.
In this embodiment, by performing image recognition processing and/or text recognition processing on a page element in a current screenshot of a page of application software, a type of the page of the application software may be determined according to types of page elements such as content of text and icons in the page of the application software. For example, when a page element in a current screenshot of a page of application software is subjected to image recognition processing and/or character recognition processing to obtain that the page of the application software contains a chrysanthemum icon and/or a "loading" character, it may be determined that the type of the page of the application software is a loading page.
According to the embodiment, the image recognition processing and/or the character recognition processing are/is carried out on the current screenshot of the page of the application software to obtain the type of the page element in the page of the application software, then the type of the page of the application software is determined according to the type of the page element in the page of the application software, the image recognition processing and/or the character recognition processing of the screenshot of the page of different application software of different terminal devices can be realized through the same image recognition processing and/or character recognition processing model, and the universality of the automatic user interface AI testing method is ensured.
Fig. 5 is a schematic flowchart of an implementation manner of obtaining similarity between page screenshots of two adjacent pieces of application software by performing image matching on the page screenshots of the application software in the embodiment of the present application, and as shown in fig. 5, the image matching processing is performed on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity between the screenshots of the two adjacent pages of the application software, where the similarity at least includes:
and S502, respectively carrying out feature extraction processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain feature data of the current screenshot of the page of the application software and the previous screenshot of the page of the application software.
In this embodiment, feature data of the current screenshot of the page of the application software and feature data of the previous screenshot of the page of the application software are obtained by respectively performing feature extraction processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software. In this embodiment, the feature data may include a feature vector, and the like, and the form of the feature data is not limited in this embodiment. Optionally, feature extraction processing may be performed on the current screenshot of the page of the application software and the previous screenshot of the page of the application software through machine learning; in some optional examples, the current screenshot of the page of the application software and the previous screenshot of the page of the application software may be subjected to feature extraction processing through a neural network, for example, the neural network may adopt a convolutional neural network; the implementation manner of performing the feature extraction processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software is not limited in the embodiment of the present application.
S504, matching the feature data of the current screenshot of the page of the application software with the feature data of the previous screenshot of the page of the application software, and determining the similarity of the screenshots of the two adjacent pages of the application software.
In this embodiment, after feature data of a current screenshot of a page of application software and feature data of a previous screenshot of the page of application software are obtained, matching is performed on the feature data of the current screenshot of the page of application software and the feature data of the previous screenshot of the page of application software according to a preset similarity measurement method, and similarity of the screenshots of two adjacent pages of application software is determined. In this embodiment, an existing similarity measurement method may be adopted to perform matching processing on feature data of a current screenshot of a page of the application software and feature data of a previous screenshot of the page of the application software, for example, the existing similarity measurement method may adopt an euclidean distance, which is not limited in this embodiment of the present application.
In the embodiment, the image matching processing is performed on the screenshots of the two adjacent application software pages through the characteristic points of the images, and the similarity of the screenshots of the two adjacent application software pages is determined, so that the calculated amount in the image matching process can be reduced, and the image matching precision is ensured.
Fig. 6 is a schematic view of an application scenario of the automatic user interface AI testing method according to the embodiment of the present application, and as shown in fig. 6, states of pages of an application software at 5 moments when the application software is opened are shown in fig. 6, and screenshots of the pages of the application software at 5 moments displayed on a mobile phone are sequentially obtained, so as to respectively identify and process the screenshots of the pages of the application software at 5 moments, and respectively obtain types of the pages of the application software at 5 moments. For example, by obtaining a screenshot of the page of the application software displayed on the mobile phone at the first time, and identifying and processing a page element in the screenshot of the page of the application software at the first time, the type of the page of the application software at the first time can be obtained as a loaded page, and at this time, the state of the page of the application software can be determined to be an unstable state according to the type of the page of the application software as the loaded page; therefore, the page element in the screenshot of the page of the application software at the second moment can be identified by acquiring the screenshot of the page of the application software at the second moment displayed on the mobile phone, so that the type of the page of the application software at the second moment can be obtained as a loaded page, and at the moment, the state of the page of the application software can be judged to be an unstable state according to the type of the page of the application software as the loaded page; therefore, the page element in the screenshot of the page of the application software at the third moment can be identified by acquiring the screenshot of the page of the application software at the third moment displayed on the mobile phone, so that the type of the page of the application software at the third moment can be obtained as a loaded page, and at the moment, the state of the page of the application software can be judged to be an unstable state according to the type of the page of the application software as the loaded page; therefore, the screenshot of the page of the application software displayed on the mobile phone at the fourth moment can be obtained, the page element in the screenshot of the page of the application software at the fourth moment is identified, the type of the page of the application software at the fourth moment is a non-loaded page, and at the moment, the similarity of the screenshots of two adjacent pages of the application software is inconsistent by performing image matching on the screenshot of the page of the application software at the fourth moment and the screenshot of the page of the application software at the third moment. Therefore, the state of the page of the application software can be judged to be an unstable state; therefore, the page elements in the screenshot of the page of the application software at the fifth moment can be identified by acquiring the screenshot of the page of the application software displayed on the mobile phone at the fifth moment, so that the type of the page of the application software at the fifth moment can be obtained as a non-loaded page, and at the moment, the similarity of the screenshots of two adjacent pages of the application software can be obtained by performing image matching on the screenshot of the page of the application software at the fifth moment and the screenshot of the page of the application software at the fourth moment. Therefore, the state of the page of the application software can be judged to be a stable state; therefore, the preset operation can be carried out on the target object in the page of the application software, and the result of the automatic test of the user interface is obtained.
Corresponding to the user interface AI automatic testing method described in fig. 1 to fig. 6, based on the same technical concept, an embodiment of the present application further provides a user interface AI automatic testing apparatus, which may be installed in a general terminal device, such as a desktop computer, a notebook computer, a tablet computer, a mobile phone, a wearable device, or a special testing device, and is not limited in this application, fig. 7 is a schematic structural diagram of the user interface AI automatic testing apparatus according to the embodiment of the present application, the user interface AI automatic testing apparatus is configured to execute the user interface AI automatic testing method described in fig. 1 to fig. 6, and as shown in fig. 7, the automatic testing apparatus at least includes: the device comprises a classification module 710, a matching module 720, a judgment module 730 and a processing module 740, wherein the classification module 710, the matching module 720, the judgment module 730 and the processing module 740 are sequentially connected, and the judgment module 730 is also connected with the classification module 710. Wherein,
the classification module 710 is configured to obtain a current screenshot of a page of application software displayed on the terminal device, and identify and process the current screenshot of the page of application software to obtain a type of the page of application software.
In the embodiment of the present application, the description of the classification module 710 can refer to the description of S102 in fig. 1, and therefore, the description will not be repeated here.
And the matching module 720 is used for matching the current screenshot of the page of the application software with the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the two adjacent pages of the application software.
In the embodiment of the present application, the description of the matching module 720 can refer to the description of S104 in fig. 1, and therefore, the description will not be repeated here.
The judging module 730 is configured to judge whether the page state of the application software is a stable state according to the type of the page of the application software and the similarity between the screenshots of two adjacent pages of the application software.
In the embodiment of the present application, the description of the determining module 730 can refer to the description of S106 in fig. 1, and therefore, the description is not repeated here.
The processing module 740 is configured to perform a preset operation on a target object in the page of the application software to obtain a result of the automated user interface test when the state of the page of the application software is a stable state.
In the embodiment of the present application, the description of the processing module 740 can refer to the description of S108 in fig. 1, and therefore, the description is not repeated here.
The automatic user interface AI testing device of the embodiment of the application identifies the current screenshot of the page of the application software by acquiring the current screenshot of the page of the application software displayed on the terminal equipment, so as to obtain the type of the page of the application software; performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software; judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software; under the condition that the page state of the application software is a stable state, performing preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface; the method has the advantages that the page of the application software displayed on the terminal equipment is identified by utilizing an AI technology, the page state of the application software is determined by combining with the similarity of screenshots of the pages of two adjacent application software, intelligent waiting is realized, the step of actively adding display waiting time is not needed, the stability of the automatic test of the user interface can be guaranteed, the efficiency of the automatic test of the user interface is improved, and the time cost of the automatic test and debugging of the user interface is reduced.
Optionally, the classification module 710 is further configured to, when the state of the page of the application software is an unstable state, obtain a current screenshot of the page of the application software displayed on the terminal device, and perform identification processing on the current screenshot of the page of the application software to obtain the type of the page of the application software.
Optionally, as shown in fig. 8, fig. 8 is another schematic structural diagram of the user interface AI automatic testing apparatus according to the embodiment of the present application, where the user interface AI automatic testing apparatus further includes a timer 750 and a prompting module 760, and the timer 750 and the prompting module 760 are respectively connected to the determining module 730. The timer 750 is used to start timing when a page of application software on the terminal device is opened. The determining module 730 is further configured to, when the state of the page of the application software is an unstable state, obtain the time of the timer, and determine whether the time of the timer is less than a preset timeout time. The classification module 710 is further configured to, when the time of the timer is less than a preset timeout time, obtain a current screenshot of a page of the application software displayed on the terminal device, and perform recognition processing on the current screenshot of the page of the application software to obtain a type of the page of the application software. And the prompt module 760 is configured to return a prompt message indicating that the test fails when the time of the timer is greater than or equal to the preset timeout time.
Optionally, the classification module 710 is configured to intercept a current screenshot of a page of application software displayed on the terminal device; carrying out image recognition processing and/or character recognition processing on page elements in a current screenshot of a page of the application software to obtain the types of the page elements in the page of the application software; and determining the type of the page of the application software according to the type of the page element in the page of the application software.
Optionally, the matching module 720 is configured to perform feature extraction processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software respectively to obtain feature data of the current screenshot of the page of the application software and the previous screenshot of the page of the application software; and matching the characteristic data of the current screenshot of the page of the application software with the characteristic data of the previous screenshot of the page of the application software, and determining the similarity of the screenshots of the two adjacent pages of the application software.
Optionally, the determining module 730 is configured to determine that the page of the application software is in an unstable state according to that the type of the page of the application software is a loading page, or that the similarity of the screenshots of the pages of two adjacent application software is inconsistent; and judging that the page state of the application software is a stable state according to the fact that the type of the page of the application software is a non-loading page and the similarity of the screenshots of the pages of two adjacent application software is consistent.
Optionally, the processing module 740 is configured to perform preset operations on the target object in the page of the application software, where the preset operations include at least one of the following operations: click operation, assignment operation, sliding operation and input operation.
Corresponding to the foregoing method for automatically testing the user interface AI described in fig. 1 to fig. 6, based on the same technical concept, an embodiment of the present application further provides an electronic device, where the electronic device includes: a processor, a communication interface, a memory, and a communication bus; the processor, the communication interface and the memory complete mutual communication through a bus; a memory for storing a computer program; a processor for executing the program stored in the memory, implementing the method of:
acquiring a current screenshot of a page of application software displayed on terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software;
performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software;
judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software;
and under the condition that the page of the application software is in a stable state, carrying out preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface.
The electronic equipment of the embodiment of the application identifies the current screenshot of the page of the application software by acquiring the current screenshot of the page of the application software displayed on the terminal equipment, so as to obtain the type of the page of the application software; performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software; judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software; under the condition that the page state of the application software is a stable state, performing preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface; the method has the advantages that the page of the application software displayed on the terminal equipment is identified by utilizing an AI technology, the page state of the application software is determined by combining with the similarity of screenshots of the pages of two adjacent application software, intelligent waiting is realized, the step of actively adding display waiting time is not needed, the stability of the automatic test of the user interface can be guaranteed, the efficiency of the automatic test of the user interface is improved, and the time cost of the automatic test and debugging of the user interface is reduced.
Based on the same technical concept, embodiments of the present application further provide a computer-readable storage medium storing a computer program, where the computer program, when executed by a processor, implements the following processes:
acquiring a current screenshot of a page of application software displayed on terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software;
performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software;
judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software;
and under the condition that the page of the application software is in a stable state, carrying out preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface.
The computer-readable storage medium of the embodiment of the application identifies the current screenshot of the page of the application software by acquiring the current screenshot of the page of the application software displayed on the terminal device, so as to obtain the type of the page of the application software; performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the pages of the two adjacent application software; judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the pages of the two adjacent application software; under the condition that the page state of the application software is a stable state, performing preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface; the method has the advantages that the page of the application software displayed on the terminal equipment is identified by utilizing an AI technology, the page state of the application software is determined by combining with the similarity of screenshots of the pages of two adjacent application software, intelligent waiting is realized, the step of actively adding display waiting time is not needed, the stability of the automatic test of the user interface can be guaranteed, the efficiency of the automatic test of the user interface is improved, and the time cost of the automatic test and debugging of the user interface is reduced.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
One or more embodiments of the present application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. One or more embodiments of the present application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only an example of this document and is not intended to limit this document. Various modifications and changes may occur to those skilled in the art from this document. Any modifications, equivalents, improvements, etc. which come within the spirit and principle of the disclosure are intended to be included within the scope of the claims of this document.
Claims (10)
1. An automatic test method for a user interface AI, which is characterized by comprising the following steps:
acquiring a current screenshot of a page of application software displayed on terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software;
performing image matching processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity of the screenshots of the two adjacent pages of the application software;
judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of the screenshots of the two adjacent pages of the application software;
and under the condition that the page of the application software is in a stable state, carrying out preset operation on a target object in the page of the application software to obtain a result of the automatic test of the user interface.
2. The automated testing method of claim 1, further comprising:
and under the condition that the page of the application software is in an unstable state, acquiring a current screenshot of the page of the application software displayed on the terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software.
3. The automated testing method of claim 2, further comprising:
opening a page of the application software on the terminal equipment, and starting timing through a timer;
under the condition that the page of the application software is in an unstable state, acquiring a current screenshot of the page of the application software displayed on a terminal device, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software, wherein the method comprises the following steps:
under the condition that the state of the page of the application software is an unstable state, acquiring the time of the timer, and judging whether the time of the timer is less than preset overtime time or not;
under the condition that the time of the timer is less than the preset overtime, acquiring a current screenshot of a page of the application software displayed on the terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software;
and returning a prompt message of test failure when the time of the timer is greater than or equal to the preset overtime.
4. The automated testing method according to any one of claims 1 to 3, wherein the obtaining a current screenshot of a page of application software displayed on a terminal device, and performing recognition processing on the current screenshot of the page of application software to obtain a type of the page of application software includes:
intercepting a current screenshot of the page of the application software displayed on the terminal equipment;
carrying out image recognition processing and/or character recognition processing on page elements in the current screenshot of the page of the application software to obtain the types of the page elements in the page of the application software;
and determining the type of the page of the application software according to the type of the page element in the page of the application software.
5. The automated testing method of claim 4, wherein the image matching processing is performed on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain the similarity between the screenshots of two adjacent pages of the application software, and the method comprises the following steps:
respectively carrying out feature extraction processing on the current screenshot of the page of the application software and the previous screenshot of the page of the application software to obtain feature data of the current screenshot of the page of the application software and the previous screenshot of the page of the application software;
and matching the characteristic data of the current screenshot of the page of the application software with the characteristic data of the previous screenshot of the page of the application software, and determining the similarity of the screenshots of two adjacent pages of the application software.
6. The automated testing method according to claim 5, wherein the determining whether the state of the page of the application software is a stable state according to the type of the page of the application software and the similarity between the screenshots of two adjacent pages of the application software comprises:
judging that the page of the application software is in an unstable state according to the fact that the type of the page of the application software is a loading page or the similarity of screenshots of two adjacent pages of the application software is inconsistent;
and judging that the page of the application software is in a stable state according to the fact that the page of the application software is a non-loading page and the similarity of the screenshots of two adjacent pages of the application software is consistent.
7. The automated testing method of claim 6, wherein the pre-set operation on the target object in the page of the application software comprises at least one of: click operation, assignment operation, sliding operation and input operation.
8. An automatic user interface (AI) testing device, comprising:
the classification module is used for acquiring a current screenshot of a page of application software displayed on terminal equipment, and identifying and processing the current screenshot of the page of the application software to obtain the type of the page of the application software;
the matching module is used for matching the current screenshot of the page of the application software with the previous screenshot of the page of the application software to obtain the similarity of the screenshots of two adjacent pages of the application software;
the judging module is used for judging whether the page state of the application software is a stable state or not according to the type of the page of the application software and the similarity of screenshots of two adjacent pages of the application software;
and the processing module is used for carrying out preset operation on the target object in the page of the application software to obtain the result of the automatic test of the user interface under the condition that the state of the page of the application software is a stable state.
9. An electronic device comprising a processor, a communication interface, a memory, and a communication bus; the processor, the communication interface and the memory complete mutual communication through a bus; the memory is used for storing a computer program; the processor is used for executing the program stored in the memory to realize the automatic test method for the user interface AI according to any one of the claims 1 to 7.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method for automated testing of a user interface AI according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011205898.8A CN112363919B (en) | 2020-11-02 | 2020-11-02 | User interface AI automatic test method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011205898.8A CN112363919B (en) | 2020-11-02 | 2020-11-02 | User interface AI automatic test method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112363919A true CN112363919A (en) | 2021-02-12 |
| CN112363919B CN112363919B (en) | 2024-02-13 |
Family
ID=74513351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011205898.8A Active CN112363919B (en) | 2020-11-02 | 2020-11-02 | User interface AI automatic test method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112363919B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113220379A (en) * | 2021-05-11 | 2021-08-06 | 中电金信软件有限公司 | Task processing method and device, electronic equipment and readable storage medium |
| TWI774258B (en) * | 2021-03-08 | 2022-08-11 | 瑞昱半導體股份有限公司 | Processing system and processing method for user interface |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102521284A (en) * | 2011-11-28 | 2012-06-27 | 优视科技有限公司 | Page screenshot processing method and device based on mobile terminal browser |
| CN104424092A (en) * | 2013-08-22 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Page loading time length testing method and device |
| CN104866414A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method, device and system for testing application program |
| CN105955884A (en) * | 2016-04-27 | 2016-09-21 | 上海携程商务有限公司 | Method and device for checking white screen of App (Application) page |
| CN106055475A (en) * | 2016-05-24 | 2016-10-26 | 广州视睿电子科技有限公司 | Version compatibility detection method and device |
| CN106971386A (en) * | 2016-01-14 | 2017-07-21 | 广州市动景计算机科技有限公司 | Judge method, device and the client device of image integrity degree and page loading degree |
| CN107783898A (en) * | 2017-07-24 | 2018-03-09 | 平安科技（深圳）有限公司 | The method of testing and test equipment of Mobile solution |
| CN109189682A (en) * | 2018-08-27 | 2019-01-11 | 广州云测信息技术有限公司 | A kind of script method for recording and device |
| CN109828926A (en) * | 2019-01-31 | 2019-05-31 | 广州云测信息技术有限公司 | It is a kind of to judge whether application interface loads exception, application testing method and device |
| CN110209539A (en) * | 2018-02-28 | 2019-09-06 | 华为技术有限公司 | A kind of test method, terminal device and tester |
| WO2019200783A1 (en) * | 2018-04-18 | 2019-10-24 | 平安科技（深圳）有限公司 | Method for data crawling in page containing dynamic image or table, device, terminal, and storage medium |
| CN111026648A (en) * | 2019-11-21 | 2020-04-17 | 汉海信息技术(上海)有限公司 | Application program page testing method and device, electronic equipment and storage medium |
| CN111767228A (en) * | 2020-06-30 | 2020-10-13 | 平安国际智慧城市科技股份有限公司 | Interface testing method, device, equipment and medium based on artificial intelligence |
-
2020
- 2020-11-02 CN CN202011205898.8A patent/CN112363919B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102521284A (en) * | 2011-11-28 | 2012-06-27 | 优视科技有限公司 | Page screenshot processing method and device based on mobile terminal browser |
| CN104424092A (en) * | 2013-08-22 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Page loading time length testing method and device |
| CN104866414A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method, device and system for testing application program |
| CN106971386A (en) * | 2016-01-14 | 2017-07-21 | 广州市动景计算机科技有限公司 | Judge method, device and the client device of image integrity degree and page loading degree |
| CN105955884A (en) * | 2016-04-27 | 2016-09-21 | 上海携程商务有限公司 | Method and device for checking white screen of App (Application) page |
| CN106055475A (en) * | 2016-05-24 | 2016-10-26 | 广州视睿电子科技有限公司 | Version compatibility detection method and device |
| CN107783898A (en) * | 2017-07-24 | 2018-03-09 | 平安科技（深圳）有限公司 | The method of testing and test equipment of Mobile solution |
| CN110209539A (en) * | 2018-02-28 | 2019-09-06 | 华为技术有限公司 | A kind of test method, terminal device and tester |
| WO2019200783A1 (en) * | 2018-04-18 | 2019-10-24 | 平安科技（深圳）有限公司 | Method for data crawling in page containing dynamic image or table, device, terminal, and storage medium |
| CN109189682A (en) * | 2018-08-27 | 2019-01-11 | 广州云测信息技术有限公司 | A kind of script method for recording and device |
| CN109828926A (en) * | 2019-01-31 | 2019-05-31 | 广州云测信息技术有限公司 | It is a kind of to judge whether application interface loads exception, application testing method and device |
| CN111026648A (en) * | 2019-11-21 | 2020-04-17 | 汉海信息技术(上海)有限公司 | Application program page testing method and device, electronic equipment and storage medium |
| CN111767228A (en) * | 2020-06-30 | 2020-10-13 | 平安国际智慧城市科技股份有限公司 | Interface testing method, device, equipment and medium based on artificial intelligence |
Non-Patent Citations (2)
| Title |
|---|
| 杨高明: "SQL注入的自动化检测技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》, no. 03, pages 138 - 141 * |
| 魏文晗: "网页篡改检测系统的研究与实现_", 《中国优秀硕士学位论文全文数据库 信息科技辑》, no. 02, pages 139 - 27 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI774258B (en) * | 2021-03-08 | 2022-08-11 | 瑞昱半導體股份有限公司 | Processing system and processing method for user interface |
| CN113220379A (en) * | 2021-05-11 | 2021-08-06 | 中电金信软件有限公司 | Task processing method and device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112363919B (en) | 2024-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180173618A1 (en) | Test method, system, and device, and readable storage medium | |
| CN109033772B (en) | Verification information input method and device | |
| CN109194689B (en) | Abnormal behavior recognition method, device, server and storage medium | |
| CN112363919A (en) | Automatic test method, device, equipment and storage medium for user interface AI | |
| CN112286485B (en) | Method and device for controlling application through voice, electronic equipment and storage medium | |
| CN105183630A (en) | Method and device for testing application program | |
| CN107765853A (en) | Using method for closing, device, storage medium and electronic equipment | |
| CN112052169A (en) | Test management method, system, device and computer readable storage medium | |
| CN112181835A (en) | Automatic testing method and device, computer equipment and storage medium | |
| CN112381092A (en) | Tracking method, device and computer readable storage medium | |
| CN105825172A (en) | Mobile-terminal-based multi-fingerprint matching method and system | |
| CN106789973B (en) | Page security detection method and terminal equipment | |
| CN113468048B (en) | System testing method, device, equipment and computer readable storage medium | |
| CN110231963A (en) | Application control method and relevant apparatus | |
| CN113821433A (en) | Method, device, equipment, medium and product for testing cloud mobile phone application program | |
| CN110706035B (en) | Updating effect evaluation method and device, storage medium and electronic equipment | |
| CN106162616A (en) | A kind of method and device of number call | |
| CN115291761A (en) | Information interaction method, device, equipment and storage medium | |
| CN113138702B (en) | Information processing method, device, electronic equipment and storage medium | |
| CN110515834B (en) | Interface testing method and device, mobile terminal and storage medium | |
| CN109084750B (en) | Navigation method and electronic equipment | |
| CN109739752B (en) | Built-in resource testing method and device, electronic equipment and readable storage medium | |
| CN108052525B (en) | Method and device for acquiring audio information, storage medium and electronic equipment | |
| CN113239180A (en) | Learning path generation method and device, electronic equipment and storage medium | |
| CN105306652A (en) | Smart phone acceleration sensor based dialing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |