CN116089256B

CN116089256B - Terminal testing method, device and storage medium

Info

Publication number: CN116089256B
Application number: CN202210521105.6A
Authority: CN
Inventors: 郭彪
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-05-13
Filing date: 2022-05-13
Publication date: 2024-03-12
Anticipated expiration: 2042-05-13
Also published as: CN116089256A

Abstract

A terminal test method, a device and a storage medium relate to the technical field of terminals, and the method comprises the following steps: acquiring a plurality of pairs of data of terminal equipment; any pair of data comprises a page screenshot and page layout information corresponding to the page screenshot in the terminal equipment, wherein the page layout information comprises position information of one or more buttons in a page and text information in each button; for any pair of data in the plurality of pairs of data, identifying text content in each button in the page screenshot of any pair of data, and obtaining text identification results of each button in the page screenshot of any pair of data; and judging according to the consistency of the text recognition result of each button in the page screenshot of any pair of data and the text information of each button in the page layout information of any pair of data, and obtaining a test result. The accuracy of text quality inspection in terminal test is effectively improved.

Description

Terminal testing method, device and storage medium

Technical Field

The present disclosure relates to the field of terminal technologies, and in particular, to a terminal testing method, a device, and a storage medium.

Background

Currently, the types of languages that can be supported in the terminal device are more and more, for example, multiple languages such as chinese, english, japanese, korean, etc. can be supported in the terminal device, and the user can set or switch the languages used by the terminal device based on the usage habits.

In some implementations, in the testing phase of the terminal device, a code-based inspection mechanism may be built to inspect multiple languages, inspecting the quality of language text from the code dimension. For example, code persistence integration (continuous integration, CI), pipelining, or multilingual E2E platform entry may be checked to test whether the text in each language meets quality requirements. The quality requirements may include, for example, whether the text has a misspelling, etc.

However, the inspection accuracy based on the above inspection method is low, resulting in quality problems such as text truncation or abnormal folding when the terminal device tested in the above inspection method is used.

Disclosure of Invention

The embodiment of the application provides a terminal test method, a terminal test device and a storage medium, relates to the technical field of terminals, and is beneficial to improving the precision of text quality inspection in terminal test.

In a first aspect, an embodiment of the present application provides a terminal testing method, where the method includes: acquiring a plurality of pairs of data of terminal equipment; any pair of data comprises a page screenshot and page layout information corresponding to the page screenshot in the terminal equipment, wherein the page layout information comprises position information of one or more buttons in a page and text information in each button; for any pair of data in the plurality of pairs of data, identifying text content in each button in the page screenshot of any pair of data, and obtaining text identification results of each button in the page screenshot of any pair of data; and judging according to the consistency of the text recognition result of each button in the page screenshot of any pair of data and the text information of each button in the page layout information of any pair of data, and obtaining a test result. Therefore, when the text is truncated or abnormally folded in the page displayed by the terminal equipment, the text recognition result of the button in the screenshot of the page is inconsistent with the text information in the button in the page layout information, so that the problems of text truncation and abnormal folding can be checked, and the accuracy of text quality check in the terminal test is improved.

In one possible implementation, acquiring multiple pairs of data of a terminal device includes: sending one or more instructions to the terminal equipment, wherein the one or more instructions are used for instructing the terminal equipment to carry out screenshot on a page in the target application and obtaining layout information corresponding to the screenshot page; a plurality of pairs of data from a terminal device is received. Therefore, the terminal equipment is instructed to capture the screen shot and obtain the layout information corresponding to the screen shot page, so that the screen shot of the page in the target application and the layout information corresponding to the screen shot page are obtained, manual operation is not needed in the middle, and the testing efficiency is effectively improved.

In one possible implementation, the one or more instructions include: an instruction for instructing the terminal device to call a target interface in the target application, an instruction for instructing the terminal device to capture a screenshot, an instruction for instructing the terminal device to randomly test in the target interface, and an instruction for instructing the terminal device to acquire layout information corresponding to a screenshot page; wherein one or more instructions are sent synchronously or asynchronously. The test equipment sends the terminal equipment an instruction containing instructions for indicating the terminal equipment to randomly test in the target interface, so that more pages in the target interface of the terminal equipment can be captured, the test coverage rate is effectively improved, the higher the coverage rate is, the wider the test range is, and the accuracy of text quality inspection in the terminal test can be effectively improved.

In one possible implementation, before sending one or more instructions to the terminal device, the method further includes: sending a first instruction to terminal equipment, wherein the first instruction is used for indicating the terminal equipment to acquire an interface name list of a target application; and receiving an interface name list corresponding to the target application from the terminal equipment. The test equipment can traverse the corresponding interface according to the interface name list of the target application.

In one possible implementation manner, before sending the first instruction to the terminal device, the method further includes: and acquiring an application list in the terminal equipment, wherein the target application is any application in the application list. The test device may generate an instruction instructing the terminal device to obtain the interface name list of each application in the application list according to the application list.

In one possible implementation manner, before acquiring the application list in the terminal device, the method further includes: a task is created for testing the target application. The user-created tasks may enable the test device to test the target application.

In one possible implementation, creating a task for testing a target application includes: displaying a first interface, wherein the first interface comprises a create task button; responding to the triggering operation of the creation task button, displaying a second interface, wherein the second interface comprises options for selecting terminal equipment to be tested; responding to the selected operation of the terminal equipment, displaying a third interface, wherein the third interface comprises a triggerable area for selecting applications, interfaces and/or languages; in response to a selection operation of the target application, an interface in the target application, and/or a language in the target application, a task for testing the target application is created. The visual interface may allow the user to flexibly select applications, interfaces, languages, etc. that need to be tested based on the requirements.

In one possible implementation, before acquiring the multiple pairs of data of the terminal device, the method further includes: acquiring multiple pairs of source data from terminal equipment; and de-duplicating the multiple pairs of source data to obtain multiple pairs of data. Thus, the received multiple pairs of data of the terminal equipment are subjected to the de-duplication treatment to obtain multiple pairs of data of the terminal equipment after the de-duplication treatment, so that the test equipment can not need to carry out repeated tests on the same page, thereby reducing the calculated amount of the test equipment and further improving the test efficiency.

In one possible implementation manner, for any pair of data in the plurality of pairs of data, identifying text content in each button in the page screenshot of any pair of data, and obtaining a text identification result of each button in the page screenshot of any pair of data, including: extracting position information of any button in page layout information of any pair of data in a plurality of pairs of data and text information in any button; obtaining a button screenshot corresponding to the position information of any button in the page screenshot according to the position information of any button; and identifying text content in the button screenshot to obtain a text identification result of any button. Therefore, recognition is performed after the dimension of the button is cut, other buttons in the page screenshot cannot interfere with the text recognition result in the currently recognized button due to the layout of the page screenshot, and the recognition accuracy of the text content in each button is effectively improved.

In one possible implementation manner, according to the consistency judgment of the text recognition result of each button in the screenshot of any pair of data and the text information in each button in the page layout information of any pair of data, obtaining a test result includes: if the text recognition result of any button is inconsistent with the text information in any button, the test result is abnormal, and the abnormality comprises cutting off and abnormal folding. Therefore, when the text is truncated or abnormally folded in the page displayed by the terminal equipment, the text recognition result of the button in the screenshot of the page is inconsistent with the text information in the button in the page layout information, so that the problems of text truncation and abnormal folding can be checked, and the accuracy of text quality check in the terminal test is improved.

In a second aspect, an embodiment of the present application provides a terminal testing apparatus, a processing unit, configured to obtain multiple pairs of data of a terminal device; any pair of data comprises a page screenshot and page layout information corresponding to the page screenshot in the terminal equipment, wherein the page layout information comprises position information of one or more buttons in a page and text information in each button; the processing unit is also used for identifying text content in each button in the page screenshot of any pair of data for any pair of data to obtain text identification results of each button in the page screenshot of any pair of data; and the processing unit is also used for judging the consistency of the text recognition result of each button in the page screenshot of any pair of data and the text information of each button in the page layout information of any pair of data to obtain a test result.

In a possible implementation manner, the processing unit is further configured to send one or more instructions to the terminal device, where the one or more instructions are configured to instruct the terminal device to perform screenshot on a page in the target application, and obtain layout information corresponding to the screenshot page; and the processing unit is also used for receiving the pairs of data from the terminal equipment.

In one possible implementation, the one or more instructions include: an instruction for instructing the terminal device to call a target interface in the target application, an instruction for instructing the terminal device to capture a screenshot, an instruction for instructing the terminal device to randomly test in the target interface, and an instruction for instructing the terminal device to acquire layout information corresponding to a screenshot page; wherein one or more instructions are sent synchronously or asynchronously.

In a possible implementation manner, the processing unit is further configured to send a first instruction to the terminal device, where the first instruction is used to instruct the terminal device to obtain an interface name list of the target application; and the processing unit is also used for receiving the interface name list corresponding to the target application from the terminal equipment.

In a possible implementation manner, the processing unit is further configured to obtain an application list in the terminal device, where the target application is any application in the application list.

In a possible implementation, the processing unit is further configured to create a task for testing the target application.

In one possible implementation, the display unit is configured to display a first interface, where the first interface includes a create task button; the processing unit is further used for responding to the triggering operation of the creation task button and displaying a second interface, and the second interface comprises options for selecting terminal equipment to be tested; the processing unit is further used for responding to the selected operation of the terminal equipment and displaying a third interface, and the third interface comprises a triggerable area for selecting applications, interfaces and/or languages; the processing unit is further used for responding to the selection operation of the target application, the interface in the target application and/or the language in the target application, and creating tasks for testing the target application.

In a possible implementation manner, the processing unit is further configured to acquire a plurality of pairs of source data from the terminal device; and the processing unit is also used for de-duplicating the multiple pairs of source data to obtain multiple pairs of data.

In a possible implementation manner, the processing unit is further configured to extract position information of any button in page layout information of any pair of data in the plurality of pairs of data, and text information in any button; the processing unit is also used for obtaining a button screenshot corresponding to the position information of any button in the page screenshot according to the position information of any button; and the processing unit is also used for identifying the text content in the button screenshot and obtaining a text identification result of any button.

In one possible implementation manner, the processing unit is further configured to obtain the test result as abnormal if the text recognition result of any button is inconsistent with the text information in any button, where the abnormal includes truncation and abnormal folding.

In a third aspect, embodiments of the present application provide an electronic device, including a processor and a memory, the memory configured to store code instructions; the processor is configured to execute code instructions to cause the electronic device to perform a terminal test method as described in the first aspect or any one of the possible implementations of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing instructions that, when executed, cause a computer to perform a terminal test method as described in the first aspect or any one of the possible implementations of the first aspect.

In a fifth aspect, a computer program product comprising a computer program which, when run, causes a computer to perform the terminal test method as described in the first aspect or any one of the possible implementations of the first aspect.

In a sixth aspect, the present application provides a chip or chip system comprising at least one processor and a communication interface, the communication interface and the at least one processor being interconnected by wires, the at least one processor being adapted to execute a computer program or instructions to perform the terminal test method described in the first aspect or any one of the possible implementations of the first aspect. The communication interface in the chip can be an input/output interface, a pin, a circuit or the like.

It should be understood that, the first aspect of the present application corresponds to the technical solutions of the second aspect to the sixth aspect of the present application, and the beneficial effects obtained by each aspect and the corresponding possible embodiments are similar, and are not repeated.

Drawings

FIG. 1 is a schematic diagram of an interface for a clock application stopwatch;

FIG. 2 is a schematic diagram of an interface for setting font and display size of an application;

FIG. 3 is an interface schematic of a clock application;

FIG. 4 is an interface schematic diagram of a terminal device screen;

FIG. 5 is an interface schematic of a terminal device calendar application;

FIG. 6 is a schematic diagram of an abnormal fold;

FIG. 7 is a schematic diagram of text truncation;

fig. 8 is a schematic view of a scenario suitable for use in the embodiments of the present application;

FIG. 9a is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9b is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9c is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9d is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9e is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9f is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9g is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9h is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9i is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9j is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

FIG. 9k is a schematic diagram of a visual interface according to an embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application;

fig. 11 is a schematic diagram of a hardware structure of a PC according to an embodiment of the present application;

fig. 12 is a flow chart of a terminal testing method provided in an embodiment of the present application;

FIG. 13 is a schematic diagram of a method for checking a cut-off or abnormal folding according to an embodiment of the present application;

fig. 14 is a flow chart of a method for obtaining multiple pairs of data of a terminal device according to an embodiment of the present application;

fig. 15 is a schematic diagram of a framework applicable to a multi-data obtaining method of a terminal device according to an embodiment of the present application;

fig. 16 is a schematic structural diagram of a terminal testing device according to an embodiment of the present application;

fig. 17 is a schematic diagram of a hardware structure of another PC according to an embodiment of the present application;

fig. 18 is a schematic structural diagram of a chip according to an embodiment of the present application.

Detailed Description

In order to facilitate the clear description of the technical solutions of the embodiments of the present application, the following simply describes some terms and techniques related to the embodiments of the present application:

1) Interface (activity): in the embodiment of the application, the interface can be an application interface of a system of the terminal equipment and interfaces of some three-party applications, and the switching of different interfaces in the terminal equipment can be used for acquiring richer materials by the terminal testing method provided by the embodiment of the application, so that the testing coverage rate is improved. Applications that the terminal device system is provided with can comprise, for example, a clock application, a desktop application, a setting application, a camera application, a file management application, a calendar application, etc., and three-party applications can comprise, for example, an office application, a shopping application, a social application, etc., some of which are installed in the terminal device at the time of testing.

In this embodiment of the present application, when the interface does not have a jump or slide operation, and the layout of the interface and the function of each area in the interface do not change, the interface is defined as the same interface. By way of example, fig. 1 shows a schematic diagram of an interface of a clock application stopwatch, such as the interface shown in a of fig. 1, comprising a chronograph watch face 10, a refresh button, a start/stop button 11, a pause button, an alarm button, a world clock button, a stopwatch button 12 and a timer button, wherein the stopwatch button 12 is in a selected state and the stopwatch is not started. In the interface shown in fig. 1 a, when the terminal device detects the clicking operation of the start/stop button 11 by the user, the timing dial 10 changes in timing, and the interface shown in fig. 1 b is displayed, and the timing is 00:04.97. The interface shown in the a of fig. 1 and the interface shown in the b of fig. 1 have no jump or slide, and the layout of the interface and the function of each area have no change, so that the interface where the stopwatch does not start timing in clock application and the interface after starting timing are the same interface; by way of example, fig. 2 shows a schematic diagram of an interface for setting fonts and display sizes of an application, such as the interface shown in a of fig. 2, where the interface includes: a font and display size preview box 20, a font size adjustment button 21, and a display size adjustment button 22, in which case the font size is standard. In the interface shown in a of fig. 2, when the terminal device detects a sliding operation of the user with respect to the font size adjusting button 21, the font size in the font size preview box 20 is changed, and the interface shown in b of fig. 2 is displayed. The interface shown in a of fig. 2 and the interface shown in b of fig. 2 have no jump or slide, and the layout of the interface and the function of each area have no change, so that the interface of the font in the application and the oversized font in the interface with the standard font is set to be the same interface.

When the interface has jump or sliding operation or the layout of the interface and the functions of the areas in the interface are changed, the interface is defined as different interfaces. For example, fig. 3 shows a schematic diagram of an interface of a clock application, such as the interface shown in a of fig. 3, where the interface includes a time plate 30, a user-set alarm clock, an alarm clock button 31, a world clock button, a stopwatch button 32, and a timer button, and the alarm clock button 31 is in a selected state. When the terminal device detects the clicking operation of the user on the stopwatch button 32, the terminal device displays an interface shown in b of fig. 3, where the content displayed in the interface may be referred to the interface shown in a of fig. 1 or the interface shown in b of fig. 1, which will not be described herein. Switching from the interface shown in a of fig. 3 to the interface shown in b of fig. 3, the jump of the interface occurs, and the layout and the function of the two interfaces are different, so that the two interfaces are different interfaces; by way of example, fig. 4 shows a schematic interface diagram of a screen of a terminal device, such as the interface shown in a of fig. 4, which may be a main screen interface of the terminal device, and a user sliding the interface shown in a of fig. 4 may cause the terminal device to display the interface shown in b of fig. 4, which may be a sub-screen interface of the terminal device. That is, the switching between the interface shown in a of fig. 4 and the interface shown in b of fig. 4 occurs the interface sliding operation, and thus, the two interfaces are different interfaces; by way of example, fig. 5 shows a schematic interface of a calendar application of a terminal device, such as the interface shown in a of fig. 5, which includes date information of the day, date information of the month, a "year" button, a "month" button, a "week" button, a "day" button, a "schedule button, a button 50 for a schedule search, and a button 51 for viewing more functions in a calendar. In the interface shown in a of fig. 5, when the terminal device detects a click operation of the button 51 by the user, the terminal device displays a menu pop-up 52 (or referred to as a pop-up 52) of the calendar, for example, the terminal device may display the interface shown in b of fig. 5. As shown in the interface b of fig. 5, the interface may include a popup window 52, and other contents displayed in the interface may be referred to as the interface a of fig. 5, which is not described herein. Wherein the popup window 52 may be an interface superimposed over the interface shown in fig. 5 b. The interface shown in fig. 5 b is one more interface than the interface shown in fig. 5 a, namely, the popup window 52, and thus the interface shown in fig. 5 a and the interface shown in fig. 5 b are two different interfaces. The above examples are not to be construed as limiting the embodiments of the present application.

2) Page: each interface corresponds to one or more different pages, and different states of the same interface are different pages, or any change in the same interface is different pages. For example, the interface shown in fig. 1 a is two different pages of the same interface as the interface shown in fig. 1 b. The same page refers to a single page.

3) A button: there may be multiple buttons in each page, the buttons being for receiving triggers, and then the page changes. In the embodiment of the present application, each element of the terminal test may be understood as a button, for example, a button of a battery in a mobile phone set, a secure button, a button of a mobile network, etc.

4) Other terms

In the embodiments of the present application, the words "first," "second," and the like are used to distinguish between identical or similar items that have substantially the same function and effect. For example, the first camera and the second camera are merely for distinguishing different cameras, and the sequence of the first camera and the second camera is not limited. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ.

It should be noted that, in the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a alone, a and B together, and B alone, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.

Currently, the terminal equipment can support more and more languages, such as multiple languages of Chinese, english, japanese, french, german, russian and the like, and a user can set or switch the languages used by the terminal equipment based on the use habit.

In some implementations, in the testing phase of the terminal device, a code-based inspection mechanism may be built to inspect the multi-language text, inspecting the quality of the language text from the code dimension.

For example, code persistence integration (continuous integration, CI), pipelining, or multilingual E2E platform entry may be checked to test whether the text in each language meets quality requirements. The quality requirements may include, for example, whether the text has a misspelling, etc.

However, when the page layout of the terminal device is determined, the original length of each button in the page is unchanged, but the lengths are different when words with the same meaning are displayed by texts with different languages, so when the language used by the terminal device is switched from one language to another language, the quality problems of text truncation or abnormal folding may occur on the terminal page after the language is switched due to the fact that the original length of the button is not equal to the text length corresponding to the language after the language is switched, but at this time, if the language is switched without the quality problems of misspelling, the text content is correct as a result of the examination in the code dimension, therefore, the examination precision based on the examination method is lower, and the terminal device tested in the examination method has the quality problems of text truncation or abnormal folding and the like when in use.

For example, fig. 6 shows a schematic diagram of abnormal folding, as shown in fig. 6, a text abnormal folding phenomenon 601 occurs on a page of the terminal device, which is caused by that the original length of a button of the text does not match the text length corresponding to the language set by the terminal device, so that a line feed occurs in the word. Fig. 7 shows a schematic diagram of text truncation, and as shown in fig. 7, a text truncation phenomenon 701 occurs on a page of a terminal device, and is also caused by incomplete word display because the original length of a button of the text does not match the text length corresponding to the language set by the terminal device.

In view of this, the embodiment of the present application provides a terminal test method, which compares a screenshot of a display page of a terminal device with corresponding layout information, so that when text truncation or abnormal folding occurs in the display page, the content of the display page and the layout information are inconsistent, so that the problems of text truncation and abnormal folding can be checked, thereby improving the accuracy of text quality inspection in terminal test.

Fig. 8 shows a schematic view of a scenario to which the embodiments of the present application are applicable. As shown in fig. 8, the terminal device 100 may be a mobile phone, and the test device 200 may be an electronic device with relatively high computing power.

In the test device 200, a visual interface may be provided, after the PC is connected to the mobile phone through a wired communication manner or a wireless communication manner, a user may create a task in the visual interface, and then the test device 200 may implement inspection of text quality in the terminal device 100 based on the terminal test method in the embodiment of the present application.

The embodiment of the present application is exemplified by taking the test apparatus 200 as a personal computer (personal computer, PC), which is not limited to the embodiment of the present application.

Exemplary, fig. 9a shows a schematic view of a visual interface provided in an embodiment of the present application.

When the PC is connected to the mobile phone through the wired communication method or the wireless communication method, if the PC detects an operation of opening the visual interface, the PC may display the interface as shown in fig. 9 a. The interface shown in fig. 9a may include: version viewing button 901, task list, refresh list button, create task button 902, task number, number of tasks per page, task page number, and text box for selecting task page number, wherein the task list is used for displaying information after creation of each task, the information includes information of serial number (number, no), identification number (identity document, id), inspection path, task type, task progress 903, cut-off line feed, creator, creation time, operation, etc., wherein version display button 901 is in a selected state.

Exemplary, fig. 9b shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9a, when the PC detects an operation to create a task, the PC may display the interface shown in fig. 9 b. For example, when the PC detects a trigger operation for the create task button 902, the PC may display an interface as shown in fig. 9 b. As shown in fig. 9b, the interface may include a prompt 904 to select a prototype, a prototype list 907, a "next" button 908, a prompt 905 to fill in information, a close button 906, and a complete prompt. As shown in fig. 9b, the prompt message 904 of the prototype is selected, and the model number, the system version number, and the product serial number (serial) of the mobile phone connected to the PC may be displayed in the prototype list 907. Wherein the interface shown in fig. 9b may be an interface displayed above the interface shown in fig. 9 a. After the mobile phone to be detected is selected in the interface, the next prompt message is entered, as shown in fig. 9b, and the mobile phone with the model of ELZ-NX9 is in the selected state.

Exemplary, fig. 9c shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9b, when the PC detects a trigger operation for the "next" button 908, the PC can display the interface shown in fig. 9 c. As shown in fig. 9c, the interface may include a task type 909, a check task 912, a language selection 918, a language display text box 919, a select language button 920, a "last" button, and a "next" button 921, wherein the task type 909 includes a screenshot 910 and a version check 911, the check task 912 includes a cut-off line, and the language display text box 919 is used to display the language selected by the user. Other contents displayed in the interface may be referred to as an interface shown in fig. 9b, and will not be described herein.

It should be noted that, in the embodiment of the present application, the version check 911 in the task type includes a screenshot function, so the user may not perform the operations of selecting the screenshot 910 before selecting the version check 911 when creating the task, and may directly select the version check 911.

Optionally, as shown in fig. 9c, the interface may further include: a designated application or interface 913, a designated application or interface display text box 914, a button 915 to select an application or interface, a unique identifier (database identifier, DBID) 914 to designate a database, and a DBID input box 917. The specified application or interface 913 is used to instruct the mobile phone to obtain a specified application or a specified page of the specified application, the specified DBID 914 is used to instruct the mobile phone to send a page screenshot containing specific information to the PC, the specific information may include a specific string and a specific ID, and the user may input the specific information of the required page screenshot in the DBID input box 917.

Exemplary, fig. 9d shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9c, when the PC detects a trigger operation for the button 915, the PC may display the interface shown in fig. 9 d. As shown in fig. 9d, the interface may include a selected button and a drop-down button corresponding to a memo application, a selected button 922 and a drop-down button 923 corresponding to a clock application, a selected button and a drop-down button corresponding to a desktop application, and a selected button and a drop-down button corresponding to a plurality of applications, and a determination button 924 and a cancel button, and may trigger a button corresponding to an application to be tested to specify the application to be tested, for example, a clock button, as shown in fig. 9d, where the clock application is in a selected state.

Exemplary, fig. 9e shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9d, when the PC detects a trigger operation for the ok button 924, the PC may display the interface shown in fig. 9 e. As shown in the interface of fig. 9e, the selected application is displayed in the designated application or the interface display text box 914, and other contents displayed in the interface may be referred to as the interface shown in fig. 9c, which is not described herein.

In the interface shown in fig. 9d, when the PC detects a pull-down button for an application to be tested, the interface of the application to be tested is specified. Exemplary, fig. 9f shows a schematic view of a visual interface provided in an embodiment of the present application. In the interface shown in fig. 9d, when the PC detects a trigger operation of the pull-down button 923 for the clock application, the PC may display the interface shown in fig. 9 f. Such as the interface shown in fig. 9f, which may include an alarm clock interface, a world clock interface, a stopwatch interface 925, a timer interface, and a confirm button 926, the name of the interface to be tested may be selected by itself, such as the stopwatch interface, as shown in fig. 9f, where the stopwatch interface 925 is in the selected state. Other contents displayed in the interface may be referred to as an interface shown in fig. 9d, and will not be described herein.

Exemplary, fig. 9g shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9f, when the PC detects a trigger operation for the ok button 926, the PC may display the interface shown in fig. 9 g. As shown in the interface of fig. 9g, the interface name of the selected application is displayed in the designated application or the interface display text box 914, and other contents displayed in the interface may be referred to as the interface shown in fig. 9c, which is not described herein.

Exemplary, fig. 9h shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9c, when the PC detects a trigger operation for the button 920, the PC may display the interface shown in fig. 9 h. As shown in fig. 9h, the interface may include a button corresponding to english, a button 927 corresponding to ame Ha Layu, a button corresponding to arabic, a button corresponding to german, and buttons corresponding to multiple languages, a determination button 928 and a cancel button, and may trigger buttons of one or more languages to be tested to perform language selection, for example, when the user needs to detect that the language of the mobile phone is set to english, the user triggers the button corresponding to english in the interface shown in fig. 9 h. Exemplary, fig. 9i shows a schematic view of a visual interface provided in an embodiment of the present application. In the interface shown in fig. 9h, after a button of a language to be tested is triggered, for example, a button 927 corresponding to an armer Ha Layu, if the PC detects a trigger operation for the determination button 928, the PC may display the interface shown in fig. 9 i. As shown in the interface of fig. 9i, the selected language "ame Ha Layu" is displayed in the language display text box 919, and other contents displayed in the interface may be referred to as the interface shown in fig. 9c, which is not described herein.

Exemplary, fig. 9j shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9i, after the PC detects the trigger operation for the "next" button 921, the PC may display the interface shown in fig. 9j, where the interface is used to indicate that the creation task is completed, and the PC may start to implement the inspection of the text quality based on the terminal test method in the embodiment of the present application, and the specific test method will be described in detail in the subsequent steps, which will not be described herein. As shown in fig. 9j, the interface includes a recreate button 929 and a view task button 930, the recreate button 929 may be used to recreate a task, and the view task button 930 is used to view a task state. In the interface shown in fig. 9j, a close button 906 (an upper right corner "x" button in the interface shown in fig. 9 j) may be triggered to close the interface shown in fig. 9 j.

By way of example, fig. 9k shows a schematic view of a visual interface provided in an embodiment of the present application.

In the interface shown in fig. 9i, when the PC detects a trigger operation for the "next" button 921, the PC can display the interface shown in fig. 9 k. The interface shown in fig. 9k includes the task information created by the prompt information, and when the PC test is completed and the task progress 903 is changed from "running" to "complete", the user may trigger the download report button 931 in the interface shown in fig. 9k to obtain the test result.

The terminal test method may include: the method comprises the steps that a PC obtains a page screenshot of a mobile phone application and page layout information corresponding to the page screenshot, the page layout information comprises position information of one or more buttons in a page and text information in each button, the PC identifies text content in each button of the obtained page screenshot of the mobile phone application to obtain text identification results of each button in the page screenshot, and the PC judges consistency of the text identification results of each button in the page screenshot and the text information in each button in the page layout information to obtain test results. Therefore, when the text is cut off or abnormally folded in the display page, the text recognition result of the button in the page screenshot is inconsistent with the text information in the button in the page layout information, so that the problems of cutting off and abnormally folding of the text can be checked, and the accuracy of text quality check in terminal test is improved.

Fig. 10 shows a schematic structural diagram of the terminal device 100.

It is understood that the terminal device may also be referred to as a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), etc. The terminal device may be a mobile phone (mobile phone) with a display screen, a smart tv, a wearable device, a tablet (Pad), a computer with a wireless transceiving function, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in an industrial control (industrial control), a wireless terminal in an unmanned (self-driving), a wireless terminal in a teleoperation (remote medical surgery), a wireless terminal in a smart grid (smart grid), a wireless terminal in a transportation security (transportation safety), a wireless terminal in a smart city (smart city), a wireless terminal in a smart home (smart home), or the like. The embodiment of the application does not limit the specific technology and the specific equipment form adopted by the terminal equipment.

As shown in fig. 10, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display 194, a user identification module (subscriber identification module, SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, terminal device 100 may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. For example, the method and the device can be used for storing the page screenshot and page layout information corresponding to the page screenshot in the embodiment of the application. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

It should be understood that the interfacing relationship between the modules illustrated in the embodiment of the present invention is only illustrative, and does not constitute a structural limitation of the terminal device 100. In other embodiments of the present application, the terminal device 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.

The terminal test method of the embodiment of the present application is described in detail below through specific embodiments. The following embodiments may be combined with each other or implemented independently, and the same or similar concepts or processes may not be described in detail in some embodiments.

By way of example, fig. 11 shows a hardware configuration diagram of a PC. Referring to fig. 11, a PC may include multiple subsystems that cooperate to perform, coordinate, or monitor one or more operations or functions of the PC. The PC includes a processor 210, an input surface 220, a coordination engine 230, a power subsystem 240, a power connector 250, a wireless interface 260, and a display 270.

Illustratively, coordination engine 230 may be used to communicate and/or process data with other subsystems of the PC; measuring and/or obtaining an output of one or more analog or digital sensors (such as touch sensors); the output of one or more sensor nodes of an array of sensor nodes (such as an array of capacitive sensing nodes) is measured and/or obtained.

The coordination engine 230 of the PC includes or is otherwise communicatively coupled to a sensor layer located below or integral with the input surface 220. For example, the sensor layer of the coordination engine 230 of the PC is a grid of capacitive sensing nodes arranged in columns and rows. More specifically, the array of column traces is arranged perpendicular to the array of row traces. The sensor layer may be separate from other layers of the PC, or the sensor layer may be disposed directly on another layer, such as but not limited to: display stack layers, force sensor layers, digitizer layers, polarizer layers, battery layers, structural or decorative housing layers, and the like.

In general, the processor 210 may be configured to perform, coordinate, and/or manage the functions of the PC. Such functions may include, but are not limited to: communication and/or transaction data with other subsystems of the PC, communication and/or transaction data with the terminal device 100, data communication and/or transaction data over a wireless interface, data communication and/or transaction data over a wired interface, facilitating power exchange over a wireless (e.g., inductive, resonant, etc.) or wired interface.

Processor 210 may be implemented as any electronic device capable of processing, receiving, or transmitting data or instructions. For example, the processor may be a microprocessor, a central processing unit, an application specific integrated circuit, a field programmable gate array, a digital signal processor, an analog circuit, a digital circuit, or a combination of these devices. The processor may be a single-threaded or multi-threaded processor. The processor may be a single core or multi-core processor.

During use, processor 210 may be configured to access a memory storing instructions. The instructions may be configured to cause the processor to perform, coordinate or monitor one or more operations or functions of the PC.

The instructions stored in the memory may be configured to control or coordinate the operation of other components of the PC, such as, but not limited to: another processor, analog or digital circuitry, a volatile or non-volatile memory module, a display, a speaker, a microphone, a rotational input device, buttons or other physical input devices, biometric sensors and/or systems, force or touch input/output components, a communication module (such as a wireless interface and/or power connector), and/or a haptic or tactile feedback device.

The memory may also store electronic data that may be used by the processor. For example, the memory may store electronic data or content (such as media files, documents, and applications), device settings and preferences, timing signals and control signals, or data for various modules, data structures or databases, and so forth. The memory may be configured as any type of memory. For example, the memory may be implemented as random access memory, read only memory, flash memory, removable memory, other types of storage elements, or a combination of such devices.

The PC also includes a power subsystem 240. The power subsystem 240 may include a battery or other power source. The power subsystem 240 may be configured to provide power to the PC. The power subsystem 240 may also be coupled to a power connector 250. The power connector 250 may be any suitable connector or port that may be configured to receive power from an external power source and/or to provide power to an external load. For example, in some embodiments, the power connector 250 may be used to recharge a battery within the power subsystem 240. In another embodiment, the power connector 250 may be used to transfer power stored (or available) within the power subsystem 240 to the terminal device 100.

The PC also includes a wireless interface 260 to facilitate electronic communications between the PC and the terminal device 100. In one embodiment, the PC may be configured to communicate with the terminal device 100 via a low energy bluetooth communication interface or a near field communication interface. In other examples, the communication interface facilitates electronic communication between the PC and an external communication network, device, or platform.

The wireless interface 260 (whether a communication interface between the PC and the terminal device 100 or another communication interface) may be implemented as one or more wireless interfaces, bluetooth interfaces, near field communication interfaces, magnetic interfaces, universal serial bus interfaces, inductive interfaces, resonant interfaces, capacitively coupled interfaces, wi-Fi interfaces, TCP/IP interfaces, network communication interfaces, optical interfaces, acoustical interfaces, or any conventional communication interfaces.

The PC also includes a display 270. The display 270 may be located behind the input surface 220 or may be integral therewith. A display 270 may be communicatively coupled to the processor 210. Processor 210 may present information to a user using display 270. In many cases, the processor 210 uses the display 270 to present an interface with which a user may interact.

It will be apparent to those skilled in the art that some of the specific details presented above with respect to a PC may not be required to practice a particular described embodiment or equivalent thereof. Similarly, other electronic devices may include a greater number of subsystems, modules, components, etc. Some of the sub-modules may be implemented as software or hardware, where appropriate. It should be understood, therefore, that the foregoing description is not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, many modifications and variations will be apparent to those of ordinary skill in the art in light of the above teachings.

Fig. 12 is a schematic flow chart of a terminal testing method according to an embodiment of the present application. As shown in fig. 12, the method may include:

s1201, acquiring a plurality of pairs of data of terminal equipment; any pair of data comprises a page screenshot and page layout information corresponding to the page screenshot in the terminal equipment, wherein the page layout information comprises position information of one or more buttons in a page and text information in each button.

In this embodiment of the present application, the page layout information may be information required when the terminal device displays the corresponding page, and the page layout information may include what buttons are located in the corresponding page, and text content in each button. The position information of the button may be position information of the button in the page screenshot, the position information may be, for example, coordinates of the button in the page screenshot, the coordinates may include coordinates of an upper left corner and coordinates of a lower right corner of a position occupied by the button in the page screenshot, and the text information may be text content corresponding to the button.

In a possible implementation, the terminal device obtains multiple pairs of data, where the multiple pairs of data include a page screenshot of the terminal device and page layout information corresponding to the page screenshot in the terminal device, the terminal device transmits the obtained multiple pairs of data to the test device, and a specific manner of obtaining the multiple pairs of data by the terminal device is described in detail in a subsequent step, which is not described herein. The terminal device may transmit the acquired pairs of data to the test device once after the acquisition of the pairs of data, or may transmit the acquired pairs of data to the test device in the process of acquiring the pairs of data, which is not specifically limited in this embodiment of the present application.

In the embodiment of the application, the terminal device and the test device are connected in a wired communication mode or a wireless communication mode, and after a user creates a task in a visual interface of the test device, the test device starts to acquire a plurality of pairs of data of the terminal device. The object tested by the embodiment of the application comprises a backbone version of the terminal equipment.

S1202, identifying text content in each button in the page screenshot of any pair of data for any pair of data, and obtaining text identification results of each button in the page screenshot of any pair of data.

The text recognition result of each button may be text content displayed in the screenshot of the page. In this embodiment of the present application, when text content in a button in a screenshot is two lines, a text recognition result corresponding to the text content is two character strings, and, for example, text content corresponding to an abnormal line folding phenomenon 60 in fig. 6 is "bildschimalayan lateral list" and displayed as two lines, and a text recognition result corresponding to the text content is "bildschimalayan lateral list" and "e" two character strings.

Note that, in any pair of data page shots, text content in each button corresponds to the position information of each button one by one, for example, when the text content in each button in the page shot is switched from small font display to large font display, the position information of the corresponding button also changes, that is, the text content in each button in the page shot and the position information of the corresponding button change synchronously.

In a possible implementation, the recognition tool is used for recognizing the text content in each button in the screenshot of any pair of data in the plurality of pairs of data, so as to obtain the text recognition result of each button.

Illustratively, text content in each button in the page screenshot of any pair of data is identified by an open-source optical character recognition (optical character recognition, OCR) tool, resulting in text recognition results for each button.

And S1203, judging according to consistency of text recognition results of all buttons in the page screenshot of any pair of data and text information of all buttons in the page layout information of any pair of data, and obtaining a test result.

The test result can be a normal result or an abnormal result, and the abnormal result can be text truncation or text abnormal folding.

In this embodiment of the present application, text content of each button in any pair of data page captures is displayed in a page of the terminal device according to text information in each button in corresponding page layout information, or it may be understood that text information in each button in any pair of data page layout information and text content of each button in corresponding page captures are both corresponding to the same button, text information in each button in any pair of data page layout information exists in a code, and text content of each button in any pair of data page captures is displayed in a page of the terminal device. It will be appreciated that the length of the text information of each button is not limited at the code level, so that the text information in each button in the page layout information of any pair of data has no text quality problems such as truncation or abnormal folding.

In a possible implementation, text information in each button in page layout information of any pair of data is taken as a standard, and text recognition results of each button in page screenshot of any pair of data are compared with corresponding standards, for example, whether the numbers of the text recognition results and the corresponding standards are the same is compared, and whether the numbers of lines of the text recognition results and the corresponding standards are the same is obtained.

In summary, in the embodiment of the present application, by acquiring multiple pairs of data of a terminal device, where any pair of data includes a page screenshot and page layout information corresponding to the page screenshot in the terminal device, the page layout information includes position information of one or more buttons in a page, and text information in each button, for any pair of data in multiple pairs of data, text content in each button in the page screenshot of any pair of data is identified, a text recognition result of each button in the page screenshot of any pair of data is obtained, and according to consistency judgment of the text recognition result of each button in the page screenshot of any pair of data and the text information in each button in the page layout information of any pair of data, a test result is obtained. Therefore, when the text is truncated or abnormally folded in the page displayed by the terminal equipment, the text recognition result of the button in the screenshot of the page is inconsistent with the text information in the button in the page layout information, so that the problems of text truncation and abnormal folding can be checked, and the accuracy of text quality check in the terminal test is improved.

Based on the above embodiment, in one possible implementation, S1202 may include:

s12021, extracting position information of any button in page layout information of any one pair of data of the plurality of pairs of data, and text information in each button; obtaining a button screenshot corresponding to the position information of any button in the page screenshot according to the position information of any button; and identifying text content in the button screenshot to obtain a text identification result of any button.

In a possible implementation, the test device extracts the position information of any button in the page layout information of any pair of data in the plurality of pairs of data and the text information in each button, cuts the screenshot corresponding to the page layout information according to the position information of any button in the page layout information of any pair of data in the plurality of pairs of data, obtains the screenshot of each button corresponding to the position information of each button, and identifies the text content in each button in the screenshot of each button through an identification tool to obtain the text identification result of each button in the screenshot of any pair of data.

In the embodiment of the application, the screenshot of each button is obtained by cutting the screenshot of any pair of data by the dimension of the button, the text content in each button in the screenshot of each button is identified, and the text identification result of each button in the screenshot of any pair of data is obtained. Therefore, recognition is performed after the dimension of the button is cut, other buttons in the page screenshot cannot interfere with the text recognition result in the currently recognized button due to the layout of the page screenshot, and the recognition accuracy of the text content in each button is effectively improved.

On the basis of the above embodiment, in one possible implementation, S1203 may include:

s12031, if the text recognition result of each button in the screenshot of any pair of data is inconsistent with the text information of each button in the page layout information of any pair of data, the output test result is abnormal, and the abnormality comprises cutting and abnormal folding.

In a possible implementation, the test device determines whether the number of characters of the character string of the text recognition result of each button in the page screenshot of any pair of data is consistent with the number of characters of the text information of each button in the corresponding page layout information, if not, the output test result is cut-off, or if the test device detects that the text recognition result of each button in the page screenshot of any pair of data has an ellipsis in addition to the character string, the output test result is cut-off. The test equipment also judges whether the number of character strings of the text recognition results of all buttons in the page screenshot of any pair of data is consistent with the number of lines of the text information in all buttons in the corresponding page layout information, and if not, the output test result is abnormal folding. It will be appreciated that the number of lines of text information in each button in the page layout information of any pair of data is one line.

By way of example, the output test results may be a report downloaded by the user in an interface as shown in fig. 9i, which may include the application of the test, the text language, the storage location of the screenshot file, the text content of the buttons in the screenshot, and the anomaly question, i.e., what anomaly is present in the report at which text content of which location of which application in which language is displayed, the user may verify the anomaly question based on which location in the report corresponds.

In this embodiment of the present application, if the text recognition result of each button in the screenshot of any pair of data is inconsistent with the text information in each button in the page layout information of any pair of data, the output test result is abnormal, and the abnormality includes truncation and abnormal folding. Therefore, when the text is truncated or abnormally folded in the page displayed by the terminal equipment, the text recognition result of the button in the screenshot of the page is inconsistent with the text information in the button in the page layout information, so that the problems of text truncation and abnormal folding can be checked, and the accuracy of text quality check in the terminal test is improved.

Fig. 13 is a schematic diagram illustrating a method for checking a truncated or abnormal fold according to an embodiment of the present application. As shown in fig. 13, the method includes: screenshot and layout information export; a control information extraction step; a control cutting step; an OCR extraction step; and a text comparison step.

The step of deriving the screenshot and the layout file information includes obtaining the screenshot of the mobile phone interface and the corresponding layout file information through an automatic screenshot tool, which may correspond to step S1201 in the above embodiment; the control information extraction step comprises extracting coordinates and text content 1 of a control containing text; the control cutting step comprises cutting the picture through specific coordinates; the OCR extracting step includes performing interface text recognition on the cut picture by using an open-source OCR tool to obtain text content 2, where the control information extracting step, the control cutting step, and the OCR extracting step may correspond to step S12021 in the foregoing embodiments; the text comparison step includes comparing the text content 1 and the text content 2, and if they are inconsistent, it is determined that there is a truncation or an abnormal fold, and this step may correspond to step S12031 in the above embodiment.

For example, in the diagram shown in fig. 13, a screenshot 1301 of a setting application is obtained, where the screenshot 1301 includes a plurality of buttons (the buttons may be understood as controls in fig. 13), and text contents corresponding to each of the buttons include "WLAN", "bluetooth", "mobile network" 1302, "more connections", and the like, where the buttons and the text contents are in one-to-one correspondence. For example, the test device extracts the coordinates of the button corresponding to the text content "mobile network" 1302 in the page screenshot 1301 and the text content 1 in the page layout information corresponding to the page screenshot 1301, the test device cuts the page screenshot 1301 according to the coordinates to obtain a button screenshot 1303, the test device recognizes the text content in the button screenshot 1303 through an OCR tool with an open source to obtain a text content 2, that is, the text recognition result of the button, and the test device compares the text content 1 with the text content 2, and if the text content 1 is inconsistent, it is determined that there is a cutoff or an abnormal folding.

In a possible implementation, based on fig. 12, a method for obtaining multiple pairs of data may be further included before S1201, and an exemplary flowchart of a method for obtaining multiple pairs of data of a terminal device provided in an embodiment of the present application is shown in fig. 14, and the method includes:

s1401, an application list in the terminal device is acquired.

The test device sends an instruction to the terminal device first to instruct the terminal device to acquire an application list in the terminal device, where the application list may be a list of all applications in the terminal device or a list of applications specified by a task created in a visual interface as shown in fig. 9, and the terminal device transmits the application list to the test device after acquiring the application list in the terminal device according to the instruction.

In this embodiment of the present application, after a user completes a task of creating in a visual interface of a test device, the test device starts to obtain an application list in a terminal device, and the test device may generate, according to the application list, an instruction indicating the terminal device to obtain an interface name list of each application in the application list.

S1402, a first instruction is sent to a terminal device, wherein the first instruction is used for instructing the terminal device to acquire an interface name list of a target application; receiving an interface name list corresponding to a target application from terminal equipment; the target application is any application in the application list.

The test device analyzes the obtained application list of the terminal device to generate an instruction for instructing the terminal device to obtain the interface name list of each application in the application list, and sends the instruction to the terminal device to instruct the terminal device to obtain the interface name list of all interfaces or the interface name list of the designated interface of the target application, wherein the target application is any application in the application list, and the terminal device transmits the interface name list of the target application to the test device after obtaining the interface name list of the target application according to the instruction.

The PC sends an instruction for obtaining an interface name list of the clock application to the mobile phone, where the interface name list of the clock application may include, for example, an alarm clock interface, a world clock interface, a stopwatch interface, and a timer interface, and the mobile phone obtains the interface name list of the clock application according to the instruction for obtaining the interface name list of the clock application, and then sends the interface name list of the clock application to the PC, and the PC traverses the alarm clock interface, the world clock interface, the stopwatch interface, and the timer interface of the clock application according to the interface name list.

In the embodiment of the application, the test device generates a corresponding instruction for acquiring the interface name list of the target application according to the acquired application list in the terminal device, transmits the instruction for acquiring the interface name list of the target application to the terminal device, and transmits the interface name list of the target application to the test device after the terminal device acquires the interface name list of the target application according to the instruction for acquiring the interface name list of the target application, and the test device traverses the corresponding interface according to the interface name list of the target application.

S1403, sending one or more instructions to the terminal equipment, wherein the one or more instructions are used for instructing the terminal equipment to perform screenshot on a page in the target application and obtaining layout information corresponding to the screenshot page; a plurality of pairs of data from a terminal device is received.

The one or more instructions sent by the test device to the terminal device may include an instruction instructing the terminal device to call up a target interface in the target application, an instruction instructing the terminal device to capture a screenshot, an instruction instructing the terminal device to randomly test in the target interface, and an instruction instructing the terminal device to obtain layout information corresponding to a screenshot page, where the one or more instructions are sent synchronously or asynchronously.

In a possible implementation manner, the test device sends an instruction to the terminal device, the instruction instructs the terminal device to call a target interface in the target application, and the terminal device calls a function of android debug software (android debug bridge, adb) to call the target interface in the target application according to the instruction.

The testing equipment sends an instruction for indicating the terminal equipment to randomly test in the target interface to the terminal equipment, and the terminal equipment switches pages in the called target interface according to the instruction and randomly triggers each button in the pages of each target application. It should be noted that, the target application portion target interface of the terminal device may be based on a function that is implemented after a certain interface is called up, for example, when the mobile phone account is in an unregistered state, some interfaces of the mobile phone cannot be called up, and a user may manually sign in the account in advance, so that the mobile phone may access more pages by using a random test instruction.

The test equipment sends an instruction for indicating the screenshot of the terminal equipment and an instruction for indicating the terminal equipment to acquire layout information corresponding to the screenshot page to the terminal equipment, and the terminal equipment calls a corresponding application programming interface (application programming interface, API) to perform the screenshot page according to the two instructions and acquires the layout information corresponding to the screenshot page.

The terminal equipment transmits the acquired page screenshot and layout information corresponding to the screenshot page to the test equipment, and the test equipment can perform text quality inspection according to the received page screenshot and the layout information corresponding to the screenshot page. The instruction for instructing the terminal device to call the target interface in the target application and the instruction for instructing the terminal device to randomly test in the target interface can simulate clicking of a person, so that pages of applications of a mobile phone connected with a PC can be automatically and continuously switched and changed, and a pause of 1 to 2 seconds occurs after each click is completed, during the pause, the mobile phone can perform a screenshot operation to acquire screenshot and layout file information of a current page of the mobile phone, and then the mobile phone stores the acquired screenshot and layout file information of the mobile phone page in the mobile phone, for example, the obtained screenshot and layout file information of the mobile phone can be stored in a memory card of the mobile phone. The screenshot of the mobile phone page corresponds to the layout file information one by one, and the screenshot and the layout file information appear in pairs, that is, a pair of data are acquired when one mobile phone page is stopped: and the mobile phone is provided with a screenshot page and layout file information. The mobile phone can acquire the screenshot and the layout file information of the mobile phone page and transmit the acquired screenshot and the layout file information of the mobile phone page to the PC, or can transmit the acquired screenshot and the layout file information of all the mobile phone pages to the PC after acquiring the screenshot and the layout file information of all the mobile phone pages.

It can be understood that the instruction for instructing the terminal device to randomly test in the target interface is used for instructing the terminal device to randomly trigger the buttons in the page of each target application, and the trigger has randomness and may trigger the same button in the same page multiple times, so that the test device receives repeated data in multiple pairs of data from the terminal device.

In another possible implementation, the receiving pairs of data from the terminal device in step S1403 may be replaced by: acquiring multiple pairs of source data from terminal equipment; and de-duplicating the multiple pairs of source data to obtain multiple pairs of data.

The multiple pairs of source data may be a screenshot of a page acquired by the terminal device and layout information corresponding to the screenshot page.

The terminal device transmits the acquired multiple pairs of source data to the test device, the test device calls an API interface to perform de-duplication on the multiple pairs of source data to obtain multiple pairs of de-duplicated data, and the terminal device performs text quality inspection according to the multiple pairs of de-duplicated data. It should be noted that after the terminal device transmits the acquired screenshot and the layout file information to the test device, the test device and the terminal device may not need to interact any more.

In the embodiment of the application, one or more instructions are sent to the terminal equipment through the test equipment, the one or more instructions are used for instructing the terminal equipment to perform screenshot on a page in the target application, and obtaining layout information corresponding to the screenshot page, and multiple pairs of data from the terminal equipment are received. Therefore, the terminal equipment is instructed to capture the screen shot and obtain the layout information corresponding to the screen shot page, so that the screen shot of the page in the target application and the layout information corresponding to the screen shot page are obtained, manual operation is not needed in the middle, and the testing efficiency is effectively improved. The test equipment can carry out de-duplication processing on multiple pairs of received data of the terminal equipment to obtain multiple pairs of de-duplicated data of the terminal equipment, so that the test equipment can not need to carry out repeated tests on the same page, thereby reducing the calculated amount of the test equipment and further improving the test efficiency. The test equipment sends the terminal equipment an instruction containing instructions for indicating the terminal equipment to randomly test in the target interface, so that more pages in the target interface of the terminal equipment can be captured, the test coverage rate is effectively improved, the higher the coverage rate is, the wider the test range is, and the accuracy of text quality inspection in the terminal test can be further improved.

Optionally, before acquiring the application list in the terminal device, the method further includes: a task is created for testing the target application.

In a possible implementation, the user creates a task in the visual interface, and specific content refers to the content corresponding to fig. 9a to 9k, which is not described herein again.

In the embodiment of the application, the task created by the user can enable the testing device to test the target application.

Optionally, creating a task for testing the target application includes:

displaying a first interface, wherein the first interface comprises a create task button; responding to the triggering operation of the creation task button, displaying a second interface, wherein the second interface comprises options for selecting terminal equipment to be tested; responding to the selected operation of the terminal equipment, displaying a third interface, wherein the third interface comprises a triggerable area for selecting applications, interfaces and/or languages; in response to a selection operation of the target application, an interface in the target application, and/or a language in the target application, a task for testing the target application is created.

The first interface may correspond to the interface shown in fig. 9a, the second interface may correspond to the interface shown in fig. 9b, and the third interface may correspond to the interface shown in fig. 9 c.

In the embodiment of the application, the visual interface can enable the user to flexibly select the application, the interface, the language and the like which need to be tested based on the requirement.

Fig. 15 is a schematic diagram of a framework applicable to a multi-data acquisition method for a terminal device according to an embodiment of the present application. As shown in fig. 15, includes: the visualization platform comprises a designation module and a designation DBID module, wherein a user creates tasks in the visualization platform, and specific contents refer to the contents corresponding to FIG. 9 and are not repeated here.

The algorithm scheduling comprises the steps of obtaining a software list installed on the mobile phone, obtaining an activity name list by the packageInfo, calling activity by the adb and designating running monkey in the activity. APIs, including screenshot APIs, layout acquisition APIs, and deduplication APIs.

The process of the test device obtaining the screenshot & layout file according to the algorithm scheduling, API and condition (1) and condition (2) in fig. 15 may correspond to the above steps S1401 to S1403, which are not described herein.

The method provided by the embodiment of the present application is described above with reference to fig. 12 to 15, and the device for performing the method provided by the embodiment of the present application is described below. As shown in fig. 16, fig. 16 is a schematic structural diagram of a terminal testing device provided in an embodiment of the present application, where the terminal testing device may be an electronic device in an embodiment of the present application, or may be a chip or a chip system in the electronic device.

As shown in fig. 16, a terminal test apparatus 1600 may be used in a communication device, a circuit, a hardware component, or a chip, the terminal test apparatus comprising: a display unit 1601 and a processing unit 1602. Wherein the display unit 1601 is for supporting an interface display of a creation task, the processing unit 1602 is for supporting a step of the terminal test apparatus to perform a terminal test, for example, the processing unit is for processing steps S1201 to S1203 in fig. 12.

The processing unit 1602 may be integrated with the display unit 1601, and communication may occur between the processing unit 1602 and the display unit 1601.

In one possible implementation manner, the terminal test device may further include: a storage unit 1604. The storage 1604 may include one or more memories, which may be one or more devices, circuits, or means for storing programs or data.

The storage unit 1604 may exist separately and is connected to the processing unit 1602 by a communication bus. The storage unit 1604 may also be integrated with the processing unit 1602.

Taking the example that the terminal test device may be a chip or a chip system of the terminal device in the embodiment of the present application, the storage unit 1604 may store computer-executed instructions of the method of the terminal device, so that the processing unit 1602 executes the method of the terminal device in the embodiment described above. The storage 1604 may be a register, a cache or random access memory (random access memory, RAM), etc., and the storage 1604 may be integral with the processing unit 1602. The storage unit 1604 may be a read-only memory (ROM) or other type of static storage device that may store static information and instructions, and the storage unit 1604 may be independent of the processing unit 1602.

In one possible implementation manner, the terminal test device may further include: a communication unit 1603. Wherein the communication unit 1603 is used for supporting the interaction of the terminal test apparatus with other devices. For example, when the terminal test apparatus is an electronic device, the communication unit 1603 may be a communication interface or an interface circuit. When the terminal test device is a chip or a chip system within an electronic apparatus, the communication unit 1603 may be a communication interface. For example, the communication interface may be an input/output interface, pins or circuitry, etc.

The apparatus of this embodiment may be correspondingly configured to perform the steps performed in the foregoing method embodiments, and the implementation principle and technical effects are similar, which are not described herein again.

Fig. 17 is a schematic diagram of a hardware structure of another PC according to an embodiment of the present application, as shown in fig. 17, where the PC includes a processor 1701, a communication line 1704 and at least one communication interface (illustrated in fig. 17 by taking a communication interface 1703 as an example).

The processor 1701 may be a general purpose central processing unit (central processing unit, CPU), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the programs of the present application.

Communication lines 1704 may include circuitry to communicate information between the components described above.

The communication interface 1703 uses any transceiver-like device for communicating with other devices or communication networks, such as ethernet, wireless local area network (wireless local area networks, WLAN), etc.

Possibly, the PC may also include a memory 1702.

The memory 1702 may be, but is not limited to, a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (random access memory, RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc-only memory (compact disc read-only memory) or other optical disk storage, a compact disc storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be separate and coupled to the processor via communication line 1704. The memory may also be integrated with the processor.

The memory 1702 is used for storing computer-executable instructions for executing the embodiments of the present application, and is controlled by the processor 1701 for execution. The processor 1701 is configured to execute computer-executable instructions stored in the memory 1702 to implement the methods provided by embodiments of the present application.

Possibly, the computer-executed instructions in the embodiments of the present application may also be referred to as application program code, which is not specifically limited in the embodiments of the present application.

In a particular implementation, process 1701 may include one or more CPUs, such as CPU0 and CPU1 of FIG. 17, as an embodiment.

In a particular implementation, as one embodiment, the PC may include multiple processors, such as processor 1701 and processor 1705 in FIG. 17. Each of these processors may be a single-core (single-CPU) processor or may be a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (e.g., computer program instructions).

Fig. 18 is a schematic structural diagram of a chip according to an embodiment of the present application. The chip 1800 includes one or more (including two) processors 1802 and communication interfaces 1803.

In some implementations, the memory 1804 stores the following elements: executable modules or data structures, or a subset thereof, or an extended set thereof.

In an embodiment of the application, the memory 1804 may include read only memory and random access memory, and provides instructions and data to the processor 1802. A portion of the memory 1804 may also include non-volatile random access memory (non-volatile random access memory, NVRAM).

In the illustrated embodiment, the memory 1804, the communication interface 1803, and the processor 1802 are coupled together by a bus system 1801. The bus system 1801 may include a power bus, a control bus, a status signal bus, and the like, in addition to a data bus. For ease of description, the various buses are labeled as bus system 1801 in FIG. 18.

The methods described in the embodiments of the present application may be applied to the processor 1802 or implemented by the processor 1802. The processor 1802 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the methods described above may be performed by integrated logic circuitry in hardware or instructions in software in the processor 1802. The processor 1802 described above may be a general-purpose processor (e.g., a microprocessor or a conventional processor), a digital signal processor (digital signal processing, DSP), an application specific integrated circuit (application specific integrated circuit, ASIC), an off-the-shelf programmable gate array (field-programmable gate array, FPGA) or other programmable logic device, discrete gates, transistor logic, or discrete hardware components, and the processor 1802 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the invention.

The steps of a method disclosed in connection with the embodiments of the present application may be embodied directly in hardware, in a decoded processor, or in a combination of hardware and software modules in a decoded processor. The software modules may be located in a state-of-the-art storage medium such as random access memory, read-only memory, programmable read-only memory, or charged erasable programmable memory (electrically erasable programmable read only memory, EEPROM). The storage medium is located in the memory 1804 and the processor 1802 reads the information in the memory 1804 and performs the steps of the method described above in connection with its hardware.

In the above embodiments, the instructions stored by the memory for execution by the processor may be implemented in the form of a computer program product. The computer program product may be written in the memory in advance, or may be downloaded in the form of software and installed in the memory.

The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL), or wireless (e.g., infrared, wireless, microwave, etc.), or semiconductor medium (e.g., solid state disk, SSD)) or the like.

Embodiments of the present application also provide a computer-readable storage medium. The methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Computer readable media can include computer storage media and communication media and can include any medium that can transfer a computer program from one place to another. The storage media may be any target media that is accessible by a computer.

As one possible design, the computer-readable medium may include compact disk read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disk memory; the computer readable medium may include disk storage or other disk storage devices. Moreover, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, digital versatile disc (digital versatiledisc, DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers.

Combinations of the above should also be included within the scope of computer-readable media. The foregoing is merely illustrative embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think about variations or substitutions within the technical scope of the present invention, and the invention should be covered. Therefore, the protection scope of the invention is subject to the protection scope of the claims.

Claims

1. A method for testing a terminal, the method comprising:

a first instruction is sent to terminal equipment, wherein the first instruction is used for indicating the terminal equipment to acquire an interface name list of a target application;

receiving an interface name list corresponding to the target application from the terminal equipment, so as to traverse a corresponding interface according to the interface name list corresponding to the target application;

sending one or more instructions to the terminal equipment, wherein the one or more instructions are used for instructing the terminal equipment to perform screenshot on a page in the target application and obtaining page layout information corresponding to the screenshot page; the page layout information comprises position information of one or more buttons in a page and text information in each button;

Receiving a plurality of pairs of data from the terminal device; any pair of data comprises page screenshots and page layout information corresponding to the page screenshots in the terminal equipment;

for any pair of data in the plurality of pairs of data, identifying text content in each button in the page screenshot of the any pair of data, and obtaining a text identification result of each button in the page screenshot of the any pair of data;

obtaining a test result according to consistency judgment of text recognition results of all buttons in the page screenshot of any pair of data and text information in all buttons in the page layout information of any pair of data; the test result is a normal result or an abnormal result, and the abnormal result comprises text truncation and text abnormal folding;

each interface corresponds to one or more different pages, and different states of the same interface are different pages.

2. The method of claim 1, wherein the one or more instructions comprise: an instruction for instructing the terminal device to call a target interface in the target application, an instruction for instructing the terminal device to capture a screenshot, an instruction for instructing the terminal device to randomly test in the target interface, and an instruction for instructing the terminal device to acquire layout information corresponding to a screenshot page;

Wherein the one or more instructions are sent synchronously or asynchronously.

3. The method of claim 2, wherein before the sending the first instruction to the terminal device, further comprises:

and acquiring an application list in the terminal equipment, wherein the target application is any application in the application list.

4. A method according to claim 3, characterized in that before said obtaining the list of applications in the terminal device, it further comprises:

a task is created for testing the target application.

5. The method of claim 4, wherein creating a task for testing the target application comprises:

displaying a first interface, wherein the first interface comprises a create task button;

responding to the triggering operation of the creation task button, and displaying a second interface, wherein the second interface comprises options for selecting terminal equipment to be tested;

responding to the selected operation of the terminal equipment, displaying a third interface, wherein the third interface comprises a triggerable area for selecting applications, interfaces and/or languages;

in response to a selection operation of the target application, an interface in the target application, and/or a language in the target application, a task for testing the target application is created.

6. The method according to any of claims 1-5, further comprising, prior to said receiving a plurality of pairs of data from said terminal device:

acquiring a plurality of pairs of source data from the terminal equipment;

and de-duplicating the pairs of source data to obtain the pairs of data.

7. The method according to any one of claims 1-6, wherein for any one of the plurality of pairs of data, identifying text content in each button in the page screen shot of the any one pair of data, and obtaining a text identification result of each button in the page screen shot of the any one pair of data, includes:

extracting position information of any button in page layout information of any pair of data in the plurality of pairs of data and text information in any button;

obtaining a button screenshot corresponding to the position information of any button in the page screenshot according to the position information of any button;

and identifying the text content in the button screenshot to obtain a text identification result of any button.

8. The method of claim 7, wherein obtaining the test result based on a consistency determination of the text recognition result for each button in the page screenshot of the any pair of data and the text information in each button in the page layout information of the any pair of data comprises:

And if the text recognition result of any button is inconsistent with the text information in any button, obtaining the test result as abnormal.

9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the computer program is caused by the processor to perform the method of any of claims 1-8.

10. A computer readable storage medium storing a computer program, which when executed by a processor causes a computer to perform the method of any one of claims 1-8.