CN114218107A - Interface detection method, device, equipment and storage medium - Google Patents

Interface detection method, device, equipment and storage medium Download PDF

Info

Publication number
CN114218107A
CN114218107A CN202111551926.6A CN202111551926A CN114218107A CN 114218107 A CN114218107 A CN 114218107A CN 202111551926 A CN202111551926 A CN 202111551926A CN 114218107 A CN114218107 A CN 114218107A
Authority
CN
China
Prior art keywords
template
interface
icon
information
detection result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111551926.6A
Other languages
Chinese (zh)
Inventor
王钰
潘文杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sankuai Online Technology Co Ltd
Original Assignee
Beijing Sankuai Online Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sankuai Online Technology Co Ltd filed Critical Beijing Sankuai Online Technology Co Ltd
Priority to CN202111551926.6A priority Critical patent/CN114218107A/en
Publication of CN114218107A publication Critical patent/CN114218107A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3692—Test management for test results analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses an interface detection method, an interface detection device, interface detection equipment and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: acquiring an interface screenshot of a target application program; identifying the interface screenshot through an element identification model to obtain an interface element in the interface screenshot, wherein the element identification model is used for identifying the interface element provided by the target application program; acquiring element template information corresponding to the interface screenshot, wherein the element template information represents the template requirements of interface elements in the interface screenshot; and detecting the interface screenshot based on the identified interface elements and the element template information to obtain a detection result, wherein the detection result indicates whether the interface elements in the interface screenshot meet the template requirements. The scheme realizes the automation and the intellectualization of the interface detection, does not need manual participation and reduces the cost of the interface detection.

Description

Interface detection method, device, equipment and storage medium
Technical Field
The present application relates to the field of computer technologies, and in particular, to an interface detection method, apparatus, device, and storage medium.
Background
In the development flow of the application program, after a designer completes a design draft of an interface, the design draft is handed over to a developer, and the developer develops the interface in accordance with the design draft according to the design draft. In order to avoid the inconsistency between the interface developed by the developer and the design draft, a designer or a tester may detect the interface of the application program according to the design draft, determine whether the interface of the application program is consistent with the design draft, and indicate the place in the interface inconsistent with the design draft so as to facilitate the developer to correct the interface. However, this is expensive because it costs a lot of human resources.
Disclosure of Invention
The embodiment of the application provides an interface detection method, device, equipment and storage medium, so that the automation and the intellectualization of interface detection are realized, and the cost of the interface detection is reduced. The technical scheme is as follows:
in one aspect, a method for detecting an interface is provided, where the method includes:
acquiring an interface screenshot of a target application program;
identifying the interface screenshot through an element identification model to obtain an interface element in the interface screenshot, wherein the element identification model is used for identifying the interface element provided by the target application program;
acquiring element template information corresponding to the interface screenshot, wherein the element template information represents the template requirements of interface elements in the interface screenshot;
and detecting the interface screenshot based on the identified interface elements and the element template information to obtain a detection result, wherein the detection result indicates whether the interface elements in the interface screenshot meet the template requirements.
In one aspect, an interface detecting apparatus is provided, the apparatus including:
the first acquisition module is used for acquiring an interface screenshot of a target application program;
the processing module is used for identifying the interface screenshot through an element identification model to obtain an interface element in the interface screenshot, and the element identification model is used for identifying the interface element provided by the target application program;
the second obtaining module is used for obtaining element template information corresponding to the interface screenshot, and the element template information represents the template requirements of the interface elements in the interface screenshot;
and the detection module is used for detecting the interface screenshot based on the identified interface elements and the element template information to obtain a detection result, and the detection result indicates whether the interface elements in the interface screenshot meet the template requirements or not.
In a possible implementation manner, the interface element includes an icon element, the processing module is configured to perform recognition processing on the interface screenshot through a first element recognition model to obtain an element identifier and position information of the icon element in the interface screenshot, where the element identifier is used to obtain element template information corresponding to the interface screenshot, and the element template information includes element template information corresponding to the icon element;
the detection module comprises:
the obtaining unit is used for obtaining the element information of the icon elements from the interface screenshot based on the position information;
and the detection unit is used for determining the detection result based on the template element information and the element information of the icon element, wherein the detection result is used for indicating whether the icon element meets the template requirement or not.
In one possible implementation manner, the element template information corresponding to the interface screenshot includes template display style information of the icon element, and the element information of the icon element includes display style information of the icon element;
the detection unit is used for determining the detection result based on the template display style information and the display style information of the icon element, and the detection result represents whether the display style of the icon element meets the requirement of the template.
In one possible implementation, the display style information includes color information of the icon element, and the template display style information includes template color information of the icon element; the detection unit is used for determining the detection result based on the template color information and the color information of the icon element, and the detection result represents whether the color of the icon element meets the requirement of the template or not; alternatively, the first and second electrodes may be,
the display style information includes size information of the icon element, and the template display style information includes template size information of the icon element; the detection unit is used for determining the detection result based on the template size information and the size information of the icon element, and the detection result represents whether the size of the icon element meets the requirement of the template.
In one possible implementation, the icon element is a plurality; the element template information includes template positional relationships between a plurality of icon elements, and the element information includes positional relationships between the plurality of icon elements;
the detection unit is used for determining the detection result based on the template position relationship and the position relationship among the icon elements, and the detection result represents whether the position relationship among the icon elements meets the requirement of the template.
In one possible implementation, the element template information includes at least one template icon content of the icon element, and the element information includes an icon content of the icon element;
the detection unit is used for determining the detection result based on at least one template icon content and icon content of the icon element, and the detection result represents whether the content of the icon element meets the requirement of the template.
In a possible implementation manner, the interface element includes a text element, the processing module is configured to perform recognition processing on the interface screenshot through a second element recognition model to obtain a font identifier of the text element in the interface screenshot, and the second element recognition model is configured to recognize the font of the text element; the element template information comprises at least one template font of the text element;
the detection module is configured to determine the detection result based on at least one template font and font identifier of the text element, where the detection result indicates whether the font of the text element meets the template requirement.
In one aspect, a computer device is provided and includes one or more processors and one or more memories, where at least one program code is stored in the one or more memories and loaded by the one or more processors and executed to implement the operations performed by the interface detection method according to any of the possible implementations described above.
In one aspect, a computer-readable storage medium is provided, in which at least one program code is stored, and the at least one program code is loaded and executed by a processor to implement the operations performed by the interface detection method according to any one of the above possible implementations.
In one aspect, there is provided a computer program or computer program product comprising: computer program code which, when executed by a computer, causes the computer to carry out operations performed by the interface detection method of any one of the possible implementations as described above.
The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:
according to the interface detection method, the device, the equipment and the storage medium provided by the embodiment of the application, the interface elements in the interface screenshot can be recognized through the element recognition model firstly when the interface test is carried out in consideration of different templates of different interface elements, and then the interface elements in the interface screenshot are detected based on the element template information, so that whether the interface elements in the interface screenshot meet the requirements of the templates or not can be accurately detected, the automation and the intellectualization of the interface detection are realized, the accuracy of the detection result is ensured, the detection process does not need manual participation, and the cost of the interface detection is reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic illustration of an implementation environment provided by an embodiment of the present application;
fig. 2 is a flowchart of an interface detection method provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of an interface detection apparatus according to an embodiment of the present disclosure;
FIG. 4 is a schematic structural diagram of another interface detection apparatus provided in the embodiments of the present application;
fig. 5 is a schematic structural diagram of a terminal provided in an embodiment of the present application;
fig. 6 is a schematic structural diagram of a server according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
It will be understood that the terms "first," "second," and the like as used herein may be used herein to describe various concepts, which are not limited by these terms unless otherwise specified. These terms are only used to distinguish one concept from another. For example, a first icon element may be referred to as a second icon element, and similarly, a second icon element may be referred to as a first icon element, without departing from the scope of the application.
As used herein, the term "at least one," "a plurality," "each," "any," at least one includes one, two, or more than two, and a plurality includes two or more than two, and each refers to each of the corresponding plurality, and any refers to any one of the plurality, for example, the plurality of icon elements includes 3 icon elements, and each refers to each of the 3 icon elements, and any refers to any one of the 3 icon elements, which may be the first, the second, or the third.
The interface detection method provided by the embodiment of the application is executed by computer equipment. In one possible implementation, the computer device is a terminal, for example, the terminal is any type of terminal such as a desktop computer, a tablet computer, or a mobile phone. In another possible implementation, the computer device is a server. For example, the server may be a server, a server cluster composed of several servers, or a cloud computing service center. In another possible implementation, the computer device includes a terminal and a server.
Fig. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application, and as shown in fig. 1, the implementation environment includes a terminal 101 and a server 102. The terminal 101 and the server 102 are connected by a wireless or wired network.
Alternatively, the terminal 101 is any type of terminal such as a desktop computer, a tablet computer, or a mobile phone. The server 102 is a server, or a server cluster composed of a plurality of servers, or a cloud computing service center.
The terminal 101 has installed thereon a target application program served by the server 102, by which the terminal 101 can implement functions such as data transmission, message interaction, and the like. Optionally, the target application is an application in the operating system of the terminal 101 or an application provided by a third party. The target application program may be any application program, and the target application program is not limited in the embodiment of the present application.
Optionally, the server 102 obtains an interface screenshot of the target application program in the running process of the target application program in the terminal 101, detects the interface screenshot, and determines whether an interface element in the interface screenshot meets a template requirement.
The interface detection method provided by the embodiment of the application can be applied to detection scenes of any application program.
For example, in the development scenario of an application.
In the development process of the application program, after the designer completes the design draft of the interface, the designer gives the design draft to the developer, and the developer develops the interface consistent with the design draft according to the design draft. If the interface detection method provided by the embodiment of the application is adopted, the interface screenshot of the application program can be detected according to the design draft, whether the interface elements in the interface screenshot are in accordance with the design draft or not is determined, manual participation is not needed in the detection process, and the cost of interface detection is reduced.
For example, the method is applied to detection after the application program is on line.
After the application program is online, the vision department can periodically perform vision walk-through on the interface in the application program to find out the vision problem in the application program. If the interface detection method provided by the embodiment of the application is adopted, the interface screenshot of the application program can be detected according to the element template information, whether the interface element in the interface screenshot meets the template requirement indicated by the element template information or not is determined, manual participation is not needed in the detection process, and the cost of interface detection is reduced.
It should be noted that, in the embodiment of the present application, an application scenario of the embodiment of the present application is only exemplarily described by taking a development scenario and a detection scenario after online as an example, but the application scenario of the embodiment of the present application is not limited.
Fig. 2 is a flowchart of an interface detection method according to an embodiment of the present application. In the embodiment of the present application, an execution subject is taken as an example of a computer device for exemplary explanation, and the embodiment includes:
201. the computer device obtains an interface screenshot of a target application program.
In the embodiment of the application, the interface screenshot is a picture obtained by screenshot of the interface presented by the target application program in the running process of the target application program. In one possible implementation, a computer device is installed with a target application program, and the computer device obtains an interface screenshot of the target application program, including: the computer equipment runs a target application program, responds to a screenshot instruction in the process of running the target application program, and captures a screen image to obtain an interface screenshot of the target application program. The screenshot instruction may be received by the computer device from other devices, or may be generated by the computer device. For example, the computer device generates a screenshot instruction every other first time length, so that the computer device can acquire an interface screenshot of the target application program every other first time length; for another example, the computer device updates the interface of the target application program in response to a trigger operation on the target application program, generates a screenshot instruction, and captures a screen image in response to the screenshot instruction to obtain an interface screenshot of the target application program. Therefore, when the interface provided by the target application program changes, the computer equipment can acquire the interface screenshot of the new interface in time, so that more interface screenshots with different contents can be detected during interface detection, and the accuracy of the interface detection is ensured.
In another possible implementation, the target application is installed on the other device. The method for acquiring the interface screenshot of the target application program by the computer equipment comprises the following steps: the computer equipment obtains the interface screenshot of the target application program from the terminal provided with the target application program.
Optionally, the obtaining, by the computer device, an interface screenshot of the target application from the terminal in which the target application is installed includes: the terminal provided with the target application program runs the target application program, and in the process of running the target application program, responding to a screenshot command, screenshot a screen image to obtain an interface screenshot of the target application program; the terminal sends the interface screenshot to the computer equipment, and the computer equipment receives the interface screenshot.
The screenshot instruction may be sent by the computer device to the terminal installed with the target application program, or may be generated by the terminal, which is not limited in this embodiment of the application. Moreover, the process of obtaining the interface screenshot of the target application program by the terminal screenshot screen image is the same as the process of obtaining the interface screenshot of the target application program by the screenshot screen image of the computer equipment, and the process is not repeated one by one.
202. And the computer equipment identifies the interface screenshot through an element identification model to obtain the interface element in the interface screenshot, wherein the element identification model is used for identifying the interface element provided by the target application program.
In the embodiment of the application, the interface screenshot includes interface elements, which may be icon elements, text elements, and the like, and the interface elements are not limited in the embodiment of the application. The text element is text in the interface screenshot, and the icon element may be other elements in the interface screenshot besides the text, such as a search box, a thumbs up button, and the like.
The element recognition model is a model obtained by training according to interface elements provided by a target application program and can recognize the interface elements provided by the target application program, and because the interface elements in the interface screenshot are provided by the target application program, the element recognition model can recognize the interface screenshot and recognize the interface elements in the interface screenshot.
In one possible implementation, the interface element includes an icon element; the computer equipment identifies the interface screenshot through the element identification model to obtain the interface element in the interface screenshot, and the method comprises the following steps: the computer equipment identifies the interface screenshot through a first element identification model to obtain an element identifier of the icon element in the interface screenshot, and the first element identification model is used for identifying the icon element provided by the target application program.
The element identifier is used to determine a unique icon element, for example, the element identifier is an element name of the icon element, a number of the icon element, and the like.
Optionally, the first element identification model can not only identify the icon element in the interface screenshot, but also mark the position of the icon element. For example, the computer device performs recognition processing on the interface screenshot through the first element recognition model to obtain the element identifier and the position information of the icon element in the interface screenshot. Optionally, when the first element recognition model is trained, the design draft of the target application program may be used as a sample image, or the interface screenshot of the target application program may be used as a sample image, the relevant person marks the element identifier of the icon element and the position information of the icon element in the sample image, and the element identifier and the position information of the icon element are used as a sample result of the sample image. And training the first element recognition model based on the sample image and the sample result until the first element recognition model can accurately recognize the icon elements provided by the target application program and the positions of the icon elements.
Optionally, the first element recognition model is a Natural Language Processing (NLP) algorithm model. The embodiment of the present application does not limit the first element identification model.
In one possible implementation, the interface element includes a text element; the computer equipment identifies the interface screenshot through the element identification model to obtain the interface element in the interface screenshot, and the method comprises the following steps: and the computer equipment identifies the interface screenshot through a second element identification model to obtain the font identification of the character element in the interface screenshot, and the second element identification model is used for identifying the font of the character element.
Optionally, the second element Recognition model is an OCR (Optical Character Recognition) algorithm model. The second element recognition model is not limited in the embodiment of the present application.
It should be noted that, in one possible implementation manner, the interface screenshot includes an icon element and a text element, and the element recognition model includes a first element recognition model and a second element recognition model. After obtaining the interface screenshot of the target application program, the computer device inputs the interface screenshot into the first element identification model and the second element identification model respectively, and continues to perform interface detection based on the identification result of the first element identification model and the identification result of the second element identification model.
203. And the computer equipment acquires element template information corresponding to the interface screenshot, wherein the element template information represents the template requirements of the interface elements in the interface screenshot.
In the embodiment of the application, the interface screenshot comprises an interface element, element template information corresponding to the interface screenshot comprises the element template information of the interface element in the interface screenshot, and the element template information represents the template requirement of the interface element in the interface screenshot. For example, the interface element is a search box, and the element template information of the interface element may be a size of the search box, a shape of the search box, and the like.
In addition, if the interface screenshot includes a plurality of interface elements, the element template information corresponding to the interface screenshot includes element template information of the plurality of interface elements, and the element template information corresponding to the interface screenshot represents template requirements of the plurality of interface elements in the interface screenshot.
In one possible implementation manner, the computer device obtains element template information corresponding to the interface screenshot based on the recognition result of the element recognition model. Optionally, the interface screenshot includes an icon element, and the computer device inputs the interface screenshot into the first element recognition model to obtain an element identifier of the icon element in the interface screenshot. The computer equipment acquires element template information corresponding to the interface screenshot, and the method comprises the following steps: and the computer equipment acquires element template information corresponding to the element identification based on the element identification of the icon element.
Optionally, the interface screenshot includes a text element, and the computer device obtains element template information corresponding to the interface screenshot, including: the computer equipment acquires element template information corresponding to the text elements, wherein the element template information is used for representing the template requirements of the text elements. For example, the element template information is used to indicate a font requirement, a font size requirement, a color requirement, a word duplication requirement, and the like of the text element, and the template requirement of the interface element is not limited in the embodiment of the present application.
It should be noted that the element template information in the embodiment of the present application may be formulated according to a design draft of a designer, so that, by detecting the interface screenshot according to the element template information, it can be known whether the interface presented by the target application is consistent with the design draft.
204. And the computer equipment detects the interface screenshot based on the identified interface element and element template information to obtain a detection result, wherein the detection result indicates whether the interface element in the interface screenshot meets the requirement of the template.
Because the element template information corresponding to the interface screenshot is the element template information of the interface element in the interface screenshot, the computer device can detect the identified interface element based on the element template information to determine whether the identified interface element meets the template requirement.
In a possible implementation manner, the interface element includes an icon element, the first element recognition model performs recognition processing on the interface screenshot to obtain an element identifier and position information of the icon element in the interface screenshot, the element identifier is used to obtain element template information corresponding to the interface screenshot, and the element template information includes element template information corresponding to the icon element; the position information is used for acquiring element information of the icon element from the interface screenshot so as to detect the interface screenshot based on the element template information. Optionally, the computer device detects the interface screenshot based on the identified interface element and element template information to obtain a detection result, including: the computer equipment acquires the element information of the icon element from the interface screenshot based on the position information of the icon element; and determining a detection result based on the template element information and the element information of the icon element, wherein the detection result is used for indicating whether the icon element meets the template requirement or not.
The element information of the icon elements and the template element information of the icon elements are the same type of information. Optionally, the obtaining, by the computer device, the element information of the icon element from the interface screenshot based on the position information of the icon element includes: and acquiring the element information of the icon element from the interface screenshot based on the template element information of the icon element and the position information of the icon element. Wherein the template element information of the icon element is used to indicate the type of element information acquired by the computer device. For example, if the template element information of the icon element includes size information of the icon element, the template element information of the icon element is used to instruct the computer device to acquire the size information of the icon element.
Optionally, the element template information corresponding to the interface screenshot includes template display style information of the icon element, and the element information of the icon element includes display style information of the icon element. The computer equipment determines a detection result based on the template element information and the element information of the icon element, and comprises the following steps: the computer device determines the detection result based on the template display style information and the display style information of the icon element, wherein the detection result represents whether the display style of the icon element meets the requirement of the template.
The display style information is used to indicate a display style of the icon element, for example, a size of the icon element, a color of the icon element, and the like. The template element information of the icon element is used to indicate the size required for the template, the color required for the template, and the like.
Optionally, the display style information includes color information of the icon element, and the template display style information includes template color information of the icon element; the computer device determines a detection result based on the template display style information and the display style information of the icon element, including: the computer device determines the detection result based on the template color information and the color information of the icon element, the detection result indicating whether the color of the icon element meets the template requirement.
Wherein the computer device determines the detection result based on the template color information and the color information of the icon element, including: the computer device determines whether the color information of the icon element is the same as the template color information of the icon element, and determines a first detection result if the color information of the icon element is the same as the template color information of the icon element, the first detection result indicating that the color of the icon element meets the template requirement. And if the color information of the icon element is different from the template color information of the icon element, determining a second detection result, wherein the second detection result indicates that the color of the icon element does not meet the requirement of the template.
It should be noted that one or more icon elements in the interface screenshot may be provided. When there are a plurality of icon elements in the interface screenshot, the icon elements in the interface screenshot may be the same color or different colors. In one possible implementation, the icon elements in the same interface screenshot are the same color, or the icon elements in the same interface screenshot are different colors. Optionally, the computer device determines the detection result based on the template color information and the color information of the icon element, including: and for each icon element, the computer equipment compares the template color information and the color information of the icon element to obtain a detection result, wherein the detection result indicates whether the color of each icon element meets the requirement of the template.
For example, the interface screenshot includes 3 icon elements: icon element 1, icon element 2, and icon element 3. The template color information of the 3 icon elements is yellow, wherein the color information of the icon element 1 is orange, and the color information of the icon element 2 and the icon element 3 is yellow. The computer device detects the interface screenshot based on the template color information and the color information of the 3 icon elements to obtain a detection result, wherein the detection result is as follows: the color of icon element 1 does not meet the template requirements and the colors of icon element 2 and icon element 3 meet the template requirements.
It should be noted that, in the embodiment of the present application, the detection result may be that the interface element meets the requirement of the template or that the interface element does not meet the requirement of the template. Optionally, in a case that some interface elements do not meet the template requirement, the detection result includes an element identifier of the interface element that does not meet the template requirement, so as to inform a relevant person which interface element does not meet the template requirement, so as to improve the target application program. Optionally, in a case that some interface elements do not meet the template requirements, the detection result includes specific requirements that the interface elements do not meet. For example, the color of the interface element does not meet the template requirements; as another example, the size of the interface element does not meet the template requirements. The embodiments of the present application are merely exemplary illustrations of detection results, and do not limit the detection results.
Optionally, the display style information includes size information of the icon element, and the template display style information includes template size information of the icon element; the computer device determines the detection result based on the template size information and the size information of the icon element, the detection result indicating whether the size of the icon element meets the template requirement.
Wherein the computer device determines the detection result based on the template size information and the size information of the icon element, including: the computer device determines whether the size information of the icon element is the same as the template size information of the icon element, and determines a first detection result if the size information of the icon element is the same as the template size information of the icon element, the first detection result indicating that the size of the icon element meets the template requirement. And if the size information of the icon element is different from the template size information of the icon element, determining a second detection result, wherein the second detection result indicates that the size of the icon element does not meet the requirement of the template.
It should be noted that one or more icon elements in the interface screenshot may be provided. When there are a plurality of icon elements in the interface screenshot, the icon elements in the interface screenshot may be the same size or different sizes. In one possible implementation, the icon elements in the same interface screenshot are the same size, or the icon elements in the same interface screenshot are different sizes. Optionally, the computer device determines the detection result based on the template size information and the size information of the icon element, including: and for each icon element, the computer equipment compares the template size information and the size information of the icon element to obtain a detection result of the interface screenshot, wherein the detection result indicates whether the size of each icon element meets the requirement of the template.
For example, the interface screenshot includes 3 icon elements: icon element 1, icon element 2, and icon element 3. The template size information of these 3 icon elements is length x and width y. The size information of the icon element 1 is length x and width z, and the size information of the icon elements 2 and 3 is length x and width y. The computer device detects the interface screenshot based on the template size information and the size information of the 3 icon elements to obtain a detection result, wherein the detection result is as follows: the size of icon element 1 does not meet the template requirements and the size of icon elements 2 and 3 meet the template requirements.
In one possible implementation, the display style information includes color information and size information of the icon elements. The computer device determines a detection result based on the template display style information and the display style information of the icon element, including: and the computer equipment compares the color information of the icon elements with the color information of the template, and compares the size information of the icon elements with the size information of the template to obtain a detection result, wherein the detection result indicates whether the color and the size of the icon elements meet the requirements of the template or not. When the icon elements are multiple, the manner of determining the detection result is the same as that when the display style information includes the color information of the icon elements, and when the icon elements are multiple, the manner of determining the detection result is not described herein again.
It should be noted that, in the embodiment of the present application, the display style information is only exemplified by the display style information including the color information of the icon element and the display style information including the size information of the icon element, and the display style information may further include shape information of the icon element, and the display style information is not limited in the embodiment of the present application.
In one possible implementation manner, the icon elements are multiple, the element template information includes template position relationships among the icon elements, and the element information includes position relationships among the icon elements; the computer device determines the detection result based on the template element information and the element information of the icon element, and comprises: the computer device determines the detection result based on the template position relationship and the position relationship among the plurality of icon elements, wherein the detection result indicates whether the position relationship among the plurality of icon elements meets the requirement of the template.
The computer equipment compares the position relation among the icon elements with the position relation of the template, and if the position relation among the icon elements is the same as the position relation of the template, a first detection result is determined, wherein the first detection result indicates that the position relation among the icon elements meets the requirement of the template; and if the position relation among the icon elements is different from the position relation of the template, determining a second detection result, wherein the second detection result indicates that the positions among the icon elements do not meet the requirement of the template.
The template position relationship may be a distance between any two icon elements in the plurality of icon elements, or may be an orientation relationship between any two icon elements in the plurality of icon elements, for example, icon element 1 is located right above icon element 2, icon element 2 is located on the left side of icon element 3, and icon element 4 is located on the right side of icon element 5.
For example, the search frame provided by the target application program comprises a plurality of icon elements, the template position relationship represents the template distance between any two icon elements in the plurality of icon elements, the computer device obtains the distance between any two icon elements in the plurality of icon elements based on the position information of the icon elements, and if the distance between the two icon elements is different from the template distance between the two icon elements, the distance between the two icon elements does not meet the requirement of the template; and if the distance between the two icon elements is the same as the template distance between the two icon elements, the distance between the two icon elements is in accordance with the template requirement.
In one possible implementation, the element template information includes at least one template icon content of the icon element, the element information includes an icon content of the icon element; the computer device determines the detection result based on the template element information and the element information of the icon element, and comprises the following steps: the computer device determines the detection result based on at least one template icon content and the icon content of the icon element, wherein the detection result represents whether the content of the icon element meets the requirement of a template.
For example, 10 template icon elements displayed in the interface when the page loading fails are provided in the design, where the 10 template icon elements are icon elements corresponding to the same element identifier, and the icon contents are different. When the page loading fails, the target application program displays an icon element for indicating the interface loading failure in the page, the computer equipment acquires the icon content of the icon element, compares the icon content of the icon element with the icon content of 10 template icon elements in the design draft, and determines a first detection result if the icon content of the icon element is the same as any icon content, wherein the first detection result indicates that the content of the icon element meets the requirement of the template. And if the icon content of the icon element is different from any icon content, determining a second detection result, wherein the second detection result indicates that the content of the icon element does not meet the requirement of the template.
It should be noted that, in the embodiment of the present application, the element information of the icon element is exemplarily illustrated by the display style information, the position relationship, the icon content, and the font identifier, where the element information may include at least one of the display style information, the position relationship, and the icon content, and the embodiment of the present application does not limit the element information.
In one possible implementation, the element template information includes at least one template font for the text element. The interface element comprises a character element, the interface screenshot is identified through a second element identification model, the font identification of the character element in the interface screenshot can be obtained, and the second element identification model is used for identifying the font of the character element. Optionally, the computer device detects the interface screenshot based on the identified interface element and element template information to obtain a detection result, including: determining a detection result based on at least one template font and font identification of the text element, wherein the detection result indicates whether the font of the text element meets the requirement of the template.
The computer equipment determines a first detection result under the condition that the font of the font element represented by the font identification is the same as the font of any template, wherein the first detection result represents that the font of the character element meets the requirement of the template; and the computer equipment determines a second detection result under the condition that the font of the font identification representing the font element is different from the font of any template, wherein the second detection result represents that the font of the character element does not meet the requirement of the template.
According to the interface detection method provided by the embodiment of the application, the interface elements in the interface screenshot can be recognized through the element recognition model when the interface test is performed according to the different templates of the different interface elements, and then the interface elements in the interface screenshot are detected based on the element template information, so that whether the interface elements in the interface screenshot meet the requirements of the templates can be accurately detected, the automation and the intellectualization of the interface detection are realized, the accuracy of the detection result is ensured, the detection process does not need manual participation, and the cost of the interface detection is reduced.
In addition, the icon elements and the character elements in the interface screenshot can be respectively identified through the first element identification model and the second element identification model, so that the icon elements and the character elements are detected, the interface is detected more comprehensively, and the detection result is more accurate.
Fig. 3 is a schematic structural diagram of an interface detection apparatus provided in an embodiment of the present application, and referring to fig. 3, the apparatus includes:
a first obtaining module 301, configured to obtain an interface screenshot of a target application;
a processing module 302, configured to perform recognition processing on the interface screenshot through an element recognition model to obtain an interface element in the interface screenshot, where the element recognition model is used to recognize the interface element provided by the target application program;
a second obtaining module 303, configured to obtain element template information corresponding to the interface screenshot, where the element template information represents a template requirement of an interface element in the interface screenshot;
and the detection module 304 is configured to detect the interface screenshot based on the identified interface element and the element template information to obtain a detection result, where the detection result indicates whether the interface element in the interface screenshot meets the template requirement.
As shown in fig. 4, in a possible implementation manner, the interface element includes an icon element, and the processing module 302 is configured to perform recognition processing on the interface screenshot through a first element recognition model to obtain an element identifier and position information of the icon element in the interface screenshot, where the element identifier is used to obtain element template information corresponding to the interface screenshot, and the element template information includes element template information corresponding to the icon element;
the detection module 304 includes:
an obtaining unit 3041, configured to obtain element information of the icon element from the interface screenshot based on the location information;
a detecting unit 3042, configured to determine the detection result based on the template element information and the element information of the icon element, where the detection result is used to indicate whether the icon element meets the template requirement.
In one possible implementation manner, the element template information corresponding to the interface screenshot includes template display style information of the icon element, and the element information of the icon element includes display style information of the icon element;
the detecting unit 3042 is configured to determine the detection result based on the template display style information and the display style information of the icon element, where the detection result indicates whether the display style of the icon element meets the requirement of the template.
In one possible implementation, the display style information includes color information of the icon element, and the template display style information includes template color information of the icon element; the detecting unit 3042, configured to determine the detection result based on the template color information and the color information of the icon element, where the detection result indicates whether the color of the icon element meets the template requirement; alternatively, the first and second electrodes may be,
the display style information includes size information of the icon element, and the template display style information includes template size information of the icon element; the detecting unit 3042 is configured to determine the detection result based on the template size information and the size information of the icon element, where the detection result indicates whether the size of the icon element meets the template requirement.
In one possible implementation, the icon element is a plurality; the element template information includes template positional relationships between a plurality of icon elements, and the element information includes positional relationships between the plurality of icon elements;
the detecting unit 3042 is configured to determine the detection result based on the template position relationship and the position relationship among the multiple icon elements, where the detection result indicates whether the position relationship among the multiple icon elements meets the requirement of the template.
In one possible implementation, the element template information includes at least one template icon content of the icon element, and the element information includes an icon content of the icon element;
the detecting unit 3042 is configured to determine the detection result based on at least one of the template icon content and the icon content of the icon element, where the detection result indicates whether the content of the icon element meets the requirement of the template.
In a possible implementation manner, the interface element includes a text element, the processing module 302 is configured to perform recognition processing on the interface screenshot through a second element recognition model to obtain a font identifier of the text element in the interface screenshot, where the second element recognition model is used to recognize the font of the text element; the element template information comprises at least one template font of the text element;
the detection module 304 is configured to determine the detection result based on at least one template font and font identifier of the text element, where the detection result indicates whether the font of the text element meets the template requirement.
It should be noted that: the interface detection apparatus provided in the above embodiment is illustrated by only dividing the functional modules when detecting the interface screenshot, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the computer device is divided into different functional modules to complete all or part of the functions described above. In addition, the interface detection apparatus and the interface detection method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.
In an exemplary embodiment, a computer device is provided, which comprises one or more processors and one or more memories, in which at least one program code is stored, which is loaded and executed by the one or more processors to implement the interface detection method as in the above embodiments.
Optionally, the computer device is provided as a terminal. Fig. 5 shows a block diagram of a terminal 500 according to an exemplary embodiment of the present application. The terminal 500 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 500 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, and the like.
The terminal 500 includes: a processor 501 and a memory 502.
The processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 501 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 501 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 501 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.
Memory 502 may include one or more computer-readable storage media, which may be non-transitory. Memory 502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 502 is used to store at least one program code for execution by the processor 501 to implement the interface detection method provided by the method embodiments herein.
In some embodiments, the terminal 500 may further optionally include: a peripheral interface 503 and at least one peripheral. The processor 501, memory 502 and peripheral interface 503 may be connected by a bus or signal lines. Each peripheral may be connected to the peripheral interface 503 by a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 504, display screen 505, camera 506, audio circuitry 507, positioning components 508, and power supply 509.
The peripheral interface 503 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 501 and the memory 502. In some embodiments, the processor 501, memory 502, and peripheral interface 503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 501, the memory 502, and the peripheral interface 503 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 504 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 504 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 504 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 504 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 504 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.
The display screen 505 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 505 is a touch display screen, the display screen 505 also has the ability to capture touch signals on or over the surface of the display screen 505. The touch signal may be input to the processor 501 as a control signal for processing. At this point, the display screen 505 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display screen 505 may be one, providing the front panel of the terminal 500; in other embodiments, the display screens 505 may be at least two, respectively disposed on different surfaces of the terminal 500 or in a folded design; in still other embodiments, the display 505 may be a flexible display disposed on a curved surface or on a folded surface of the terminal 500. Even more, the display screen 505 can be arranged in a non-rectangular irregular figure, i.e. a shaped screen. The Display screen 505 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.
The camera assembly 506 is used to capture images or video. Optionally, camera assembly 506 includes a front camera and a rear camera. The front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 506 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
Audio circuitry 507 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 501 for processing, or inputting the electric signals to the radio frequency circuit 504 to realize voice communication. For the purpose of stereo sound collection or noise reduction, a plurality of microphones may be provided at different portions of the terminal 500. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 501 or the radio frequency circuit 504 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, audio circuitry 507 may also include a headphone jack.
The positioning component 508 is used for positioning the current geographic Location of the terminal 500 for navigation or LBS (Location Based Service). The Positioning component 508 may be a Positioning component based on the united states GPS (Global Positioning System), the chinese beidou System, the russian graves System, or the european union's galileo System.
Power supply 509 is used to power the various components in terminal 500. The power source 509 may be alternating current, direct current, disposable or rechargeable. When power supply 509 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, terminal 500 also includes one or more sensors 510. The one or more sensors 150 include, but are not limited to: acceleration sensor 511, gyro sensor 512, pressure sensor 513, fingerprint sensor 514, optical sensor 515, and proximity sensor 516.
The acceleration sensor 511 may detect the magnitude of acceleration on three coordinate axes of the coordinate system established with the terminal 500. For example, the acceleration sensor 511 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 501 may control the display screen 505 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 511. The acceleration sensor 511 may also be used for acquisition of motion data of a game or a user.
The gyro sensor 512 may detect a body direction and a rotation angle of the terminal 500, and the gyro sensor 512 may cooperate with the acceleration sensor 511 to acquire a 3D motion of the user on the terminal 500. The processor 501 may implement the following functions according to the data collected by the gyro sensor 512: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.
The pressure sensor 513 may be disposed on a side frame of the terminal 500 and/or underneath the display screen 505. When the pressure sensor 513 is disposed on the side frame of the terminal 500, a user's holding signal of the terminal 500 may be detected, and the processor 501 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 513. When the pressure sensor 513 is disposed at the lower layer of the display screen 505, the processor 501 controls the operability control on the UI interface according to the pressure operation of the user on the display screen 505. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The fingerprint sensor 514 is used for collecting a fingerprint of the user, and the processor 501 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 514, or the fingerprint sensor 514 identifies the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 501 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 514 may be provided on the front, back, or side of the terminal 500. When a physical button or a vendor Logo is provided on the terminal 500, the fingerprint sensor 514 may be integrated with the physical button or the vendor Logo.
The optical sensor 515 is used to collect the ambient light intensity. In one embodiment, the processor 501 may control the display brightness of the display screen 505 based on the ambient light intensity collected by the optical sensor 515. Specifically, when the ambient light intensity is high, the display brightness of the display screen 505 is increased; when the ambient light intensity is low, the display brightness of the display screen 505 is reduced. In another embodiment, processor 501 may also dynamically adjust the shooting parameters of camera head assembly 506 based on the ambient light intensity collected by optical sensor 515.
A proximity sensor 516, also called a distance sensor, is provided at the front panel of the terminal 500. The proximity sensor 516 is used to collect the distance between the user and the front surface of the terminal 500. In one embodiment, when the proximity sensor 516 detects that the distance between the user and the front surface of the terminal 500 gradually decreases, the processor 501 controls the display screen 505 to switch from the bright screen state to the dark screen state; when the proximity sensor 516 detects that the distance between the user and the front surface of the terminal 500 becomes gradually larger, the display screen 505 is controlled by the processor 501 to switch from the breath screen state to the bright screen state.
Those skilled in the art will appreciate that the configuration shown in fig. 5 is not intended to be limiting of terminal 500 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.
Optionally, the computer device is provided as a server. Fig. 6 is a schematic structural diagram of a server according to an embodiment of the present application, where the server 600 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 601 and one or more memories 602, where the memory 602 stores at least one program code, and the at least one program code is loaded and executed by the processors 601 to implement the methods provided by the method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.
The server 600 is configured to perform the steps performed by the server in the above-described method embodiments.
In an exemplary embodiment, a computer-readable storage medium, such as a memory, including program code, which is executable by a processor in a computer device to perform the interface detection method in the above-described embodiments is also provided. For example, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, a computer program or a computer program product is also provided, which comprises computer program code, which, when executed by a computer, causes the computer to implement the interface detection method in the above-described embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (10)

1. An interface detection method, comprising:
acquiring an interface screenshot of a target application program;
identifying the interface screenshot through an element identification model to obtain an interface element in the interface screenshot, wherein the element identification model is used for identifying the interface element provided by the target application program;
acquiring element template information corresponding to the interface screenshot, wherein the element template information represents the template requirements of interface elements in the interface screenshot;
and detecting the interface screenshot based on the identified interface elements and the element template information to obtain a detection result, wherein the detection result indicates whether the interface elements in the interface screenshot meet the template requirements.
2. The method of claim 1, wherein the interface element comprises an icon element, and the identifying the interface screenshot through an element identification model to obtain the interface element in the interface screenshot comprises:
identifying the interface screenshot through a first element identification model to obtain an element identifier and position information of an icon element in the interface screenshot, wherein the element identifier is used for obtaining element template information corresponding to the interface screenshot, and the element template information comprises the element template information corresponding to the icon element;
the interface screenshot is detected based on the identified interface element and the element template information to obtain a detection result, and the detection result comprises:
acquiring element information of the icon elements from the interface screenshot based on the position information;
and determining the detection result based on the template element information and the element information of the icon element, wherein the detection result is used for indicating whether the icon element meets the template requirement or not.
3. The method of claim 2, wherein the element template information corresponding to the interface screenshot comprises template display style information of the icon element, and the element information of the icon element comprises display style information of the icon element;
the determining the detection result based on the template element information and the element information of the icon element includes:
and determining the detection result based on the template display style information and the display style information of the icon element, wherein the detection result represents whether the display style of the icon element meets the requirement of the template.
4. The method according to claim 3, wherein the determining the detection result based on the template display style information and the display style information of the icon element comprises:
the display style information includes color information of the icon element, and the template display style information includes template color information of the icon element; determining the detection result based on the template color information and the color information of the icon element, wherein the detection result represents whether the color of the icon element meets the requirement of the template; alternatively, the first and second electrodes may be,
the display style information includes size information of the icon element, and the template display style information includes template size information of the icon element; determining the detection result based on the template size information and the size information of the icon element, wherein the detection result represents whether the size of the icon element meets the requirement of the template.
5. The method of claim 2, wherein the icon element is plural; the element template information includes template positional relationships between a plurality of icon elements, and the element information includes positional relationships between the plurality of icon elements;
the determining the detection result based on the template element information and the element information of the icon element includes:
and determining the detection result based on the template position relationship and the position relationship among the icon elements, wherein the detection result represents whether the position relationship among the icon elements meets the requirement of the template.
6. The method of claim 2, wherein the element template information includes at least one template icon content of the icon element, and wherein the element information includes an icon content of the icon element;
the determining the detection result based on the template element information and the element information of the icon element includes:
determining the detection result based on at least one template icon content and icon content of the icon element, wherein the detection result represents whether the content of the icon element meets the requirement of the template.
7. The method of claim 1, wherein the interface element comprises a text element, and the identifying the interface screenshot through an element identification model to obtain the interface element in the interface screenshot comprises:
identifying the interface screenshot through a second element identification model to obtain a font identifier of the character element in the interface screenshot, wherein the second element identification model is used for identifying the font of the character element; the element template information comprises at least one template font of the text element;
the interface screenshot is detected based on the identified interface element and the element template information to obtain a detection result, and the detection result comprises:
and determining the detection result based on at least one template font and font identification of the character element, wherein the detection result represents whether the font of the character element meets the requirement of the template.
8. An interface detection apparatus, the apparatus comprising:
the first acquisition module is used for acquiring an interface screenshot of a target application program;
the processing module is used for identifying the interface screenshot through an element identification model to obtain an interface element in the interface screenshot, and the element identification model is used for identifying the interface element provided by the target application program;
the second obtaining module is used for obtaining element template information corresponding to the interface screenshot, and the element template information represents the template requirements of the interface elements in the interface screenshot;
and the detection module is used for detecting the interface screenshot based on the identified interface elements and the element template information to obtain a detection result, and the detection result indicates whether the interface elements in the interface screenshot meet the template requirements or not.
9. A computer device comprising one or more processors and one or more memories having at least one program code stored therein, the at least one program code loaded and executed by the one or more processors to perform operations performed by the interface detection method of any one of claims 1 to 7.
10. A computer-readable storage medium having stored therein at least one program code, the at least one program code being loaded into and executed by a processor to perform operations performed by the interface detection method according to any one of claims 1 to 7.
CN202111551926.6A 2021-12-17 2021-12-17 Interface detection method, device, equipment and storage medium Pending CN114218107A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111551926.6A CN114218107A (en) 2021-12-17 2021-12-17 Interface detection method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111551926.6A CN114218107A (en) 2021-12-17 2021-12-17 Interface detection method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114218107A true CN114218107A (en) 2022-03-22

Family

ID=80703607

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111551926.6A Pending CN114218107A (en) 2021-12-17 2021-12-17 Interface detection method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114218107A (en)

Similar Documents

Publication Publication Date Title
CN109815150B (en) Application testing method and device, electronic equipment and storage medium
CN110490179B (en) License plate recognition method and device and storage medium
CN109522863B (en) Ear key point detection method and device and storage medium
CN112581358B (en) Training method of image processing model, image processing method and device
CN111104980B (en) Method, device, equipment and storage medium for determining classification result
CN110321126B (en) Method and device for generating page code
CN110288689B (en) Method and device for rendering electronic map
CN110570460A (en) Target tracking method and device, computer equipment and computer readable storage medium
US20210134022A1 (en) Method and electronic device for adding virtual item
CN110705614A (en) Model training method and device, electronic equipment and storage medium
CN110647881A (en) Method, device, equipment and storage medium for determining card type corresponding to image
CN113627413A (en) Data labeling method, image comparison method and device
CN109189290B (en) Click area identification method and device and computer readable storage medium
CN112396076A (en) License plate image generation method and device and computer storage medium
CN111753606A (en) Intelligent model upgrading method and device
CN111857793A (en) Network model training method, device, equipment and storage medium
CN111586279A (en) Method, device and equipment for determining shooting state and storage medium
CN112819103A (en) Feature recognition method and device based on graph neural network, storage medium and terminal
CN112053360A (en) Image segmentation method and device, computer equipment and storage medium
CN110990728A (en) Method, device and equipment for managing point of interest information and storage medium
CN110163192B (en) Character recognition method, device and readable medium
CN112925922A (en) Method, device, electronic equipment and medium for obtaining address
CN113051485B (en) Group searching method, device, terminal and storage medium
CN114925667A (en) Content classification method, device, equipment and computer readable storage medium
CN114595019A (en) Theme setting method, device and equipment of application program and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination