CN114238119A

CN114238119A - Automatic testing method and system for android application and storage medium

Info

Publication number: CN114238119A
Application number: CN202111560629.8A
Authority: CN
Inventors: 殷铭; 何晔; 虞珍妮
Original assignee: China Telecom Corp Ltd
Current assignee: China Telecom Corp Ltd
Priority date: 2021-12-20
Filing date: 2021-12-20
Publication date: 2022-03-25

Abstract

The invention relates to an automatic testing method and system for android application and a storage medium. The method comprises the following steps: dividing a display screen of the test equipment into N click blocks, and generating a click position matrix by using elements including click position coordinate information corresponding to each click block; acquiring initial starting Activity, starting an application APP, and storing a current page screenshot; clicking N click blocks on a display screen according to a preset sequence to trigger a click event, and storing a page screenshot of Activity jumped to after clicking; comparing the page screenshots before and after clicking to determine the similarity between the two; under the condition that the similarity is smaller than a preset threshold value, storing the position coordinate information of the element in the click position matrix corresponding to the current click into a test case library; and under the condition that clicking on the N clicked blocks is judged to be finished or the page screen capture meeting the condition of stopping clicking is detected, collecting the position coordinate information in the test case library to form an effective click chain.

Description

Automatic testing method and system for android application and storage medium

Technical Field

The present disclosure relates to the field of network technology and security, and more particularly to automated testing of android applications.

Background

With the rapid development of internet technology, many game applications are developed for entertaining people. However, since many current game applications are developed by using game engines (for example, Unity3D, Cocos2D, UE, etc.), when performing functional tests on the developed game applications, a large number of automated test frameworks based on the UI automation android native control recognition technology cannot function on the market. Moreover, because the page of the game-like application is rendered by the engine and then presented on the page, there is often only one main Activity (Activity) in the manifest file, so that all application pages cannot be traversed by obtaining the Activity tag in the manifest file.

For this reason, some solutions have been explored in the prior art, but there are still disadvantages. The Monkey-based automated test can only randomly generate a large amount of behaviors of the simulation operation mobile phone, and is difficult to trigger and execute the complete function of the complex application. The page control is exposed based on a system/application instrumentation or third-party control embedding mode, and then the application function is traversed in a control stack forming mode, so that the difficulty that the use threshold is high and the code needs to be acquired to realize white box testing exists. The problem of poor universality exists when the automatic test is carried out based on the recording and playback mode, and the method is similar to the self-writing test case.

In order to overcome the above defects, it is necessary to provide an innovative automated testing method and system for android applications.

Disclosure of Invention

The following presents a simplified summary of the disclosure in order to provide a basic understanding of some aspects of the disclosure. However, it should be understood that this summary is not an exhaustive overview of the disclosure. It is not intended to identify key or critical elements of the disclosure or to delineate the scope of the disclosure. Its sole purpose is to present some concepts of the disclosure in a simplified form as a prelude to the more detailed description that is presented later.

According to one aspect of the present disclosure, there is provided an automated testing method for an android application, including: dividing a display screen of the test equipment into N clicking blocks, wherein N is an integer greater than 1, and generating a clicking position matrix by using elements including clicking position coordinate information corresponding to each clicking block; acquiring initial starting Activity, starting an application APP, and storing a current page screenshot; clicking N click blocks on a display screen according to a preset sequence to trigger a click event, and storing a page screenshot of Activity jumped to after clicking; comparing the screenshot of the page before clicking with the screenshot of the page obtained after clicking, and determining the similarity between the screenshot of the page and the screenshot of the page; under the condition that the similarity is judged to be smaller than the preset threshold value, storing the position coordinate information of the elements in the click position matrix corresponding to the current click into a test case library; and under the condition that clicking on the N clicked blocks is judged to be finished or the page screen capture conforming to the terminal clicking condition is detected, collecting the position coordinate information stored in the test case library to form an effective clicking chain, wherein each position coordinate information in the effective clicking chain corresponds to one Activity of the tested application.

According to a second aspect of the present disclosure, an automated testing system for android applications is provided, including a click position matrix generation unit configured to divide a display screen of a testing device into N click blocks, where N is an integer greater than 1, and generate a click position matrix based on an element including click position coordinate information corresponding to each click block; the click event triggering unit is used for triggering jump to Activity corresponding to the click position coordinate information of the click block by sequentially clicking the click blocks divided on the display screen; the storage unit is used for storing click position coordinate information of each click block of the display screen and an Activity page screenshot jumped to after clicking; the comparison unit is used for comparing the page screenshot before the click with the page screenshot obtained after the click to determine the similarity between the two, comparing the similarity with a preset threshold, and determining that the current click event is an effective click event when the similarity is lower than the preset threshold; and the test case library is used for storing the position coordinate information of the elements in the click position matrix corresponding to each effective click event and forming an effective click chain, wherein each position coordinate information of the effective click chain corresponds to one Activity of the tested application.

According to yet another aspect of the present disclosure, there is provided a computer-readable storage medium comprising computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform a method according to the above-mentioned aspect of the present disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description, serve to explain the principles of the disclosure.

The present disclosure may be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

FIG. 1 illustrates a general schematic diagram of an automated testing system for android applications, according to an embodiment of the present disclosure;

FIG. 2 illustrates a flow diagram of a method for automated testing of android applications, in accordance with an embodiment of the present disclosure; and

FIG. 3 illustrates an exemplary configuration of a computing device in which embodiments in accordance with the present disclosure may be implemented.

Detailed Description

FIG. 1 shows a schematic block diagram of an automated testing system 100 for android applications, in accordance with an embodiment of the present disclosure. The system 100 includes a click location matrix generating unit 101, a click event triggering unit 102, a storage unit 103, a comparing unit 104, and a test case library 105.

The click position matrix generating unit 101 is configured to divide a display screen of the test device into N click blocks (N is an integer greater than 1) by a predetermined number of pixels according to length and width dimensions of the display screen, and generate a click position matrix based on an element including click position coordinate information corresponding to each click block.

The click event triggering unit 102 is configured to trigger a jump to Activity corresponding to click position coordinate information of a click block by sequentially clicking the click block divided on the display screen.

The storage unit 103 is used for storing click position coordinate information of each click block of the display screen and a page screenshot of Activity skipped to after clicking.

The comparing unit 104 is configured to compare the page screenshot before the click with the page screenshot obtained after the click by using an image recognition technology to determine a similarity therebetween, and compare the similarity with a predetermined threshold. If the similarity is lower than the preset threshold, the current click event is determined to be a valid click event.

The test case library 105 is used to store the position coordinate information of the elements in the click position matrix corresponding to each valid click event and form a valid click chain, where each position coordinate information of the valid click chain corresponds to one Activity of the application under test.

A flow diagram of a method for automated testing of android applications in accordance with an embodiment of the present disclosure is now described with reference to fig. 2.

After the game application is developed or partially modified, the game application needs to be functionally tested.

When testing, it is first determined whether the android Application Package (APK) is a native android application package. Specifically, the APK directory name and the file name are traversed, and whether the APK is the native android application or not is judged by inquiring keywords such as unity, cos, ue4 and the like.

And under the condition that the android application package APK is judged to be the native android application package, testing the native android application package APK by using a common control identification testing method.

Under the condition that the android application package APK is judged to be a non-native android application package, the automatic testing method for the android application is utilized for testing.

First, in step S201, a display screen of the test apparatus is divided into N click blocks, and a click position matrix is generated from elements including click position coordinate information corresponding to each click block.

Specifically, a real machine/simulator device for automated testing is initialized, length and width dimensions of a display screen of the testing device are acquired, and the display screen is divided into N click blocks (N is an integer greater than 1) each having corresponding click position coordinate information by a predetermined number of pixels according to the length and width dimensions of the display screen. The click position matrix is generated such that each matrix element includes click position coordinate information corresponding to each click block. And storing the click position matrix in a storage unit.

According to the embodiment of the present disclosure, the display screen may be equally divided by the predetermined number of pixels according to the length and width sizes of the display screen such that the length and width sizes and the number of pixels included in each click block are equal to generate the click position matrix.

Alternatively, the display screen may be divided in any suitable form according to the length and width dimensions of the display screen and the number of pixels to generate the click position matrix.

Suppose the click location matrix has m rows and N columns of elements x, 1 ≦ m ≦ N, 1 ≦ N ≦ N, and mxn ≦ N.

Next, in step S202, the APK package name and the initial start Activity (Activity) are acquired, and the Application (APP) is started.

In step S203, the current page screen shot is stored in the storage unit.

In step S204, N click blocks on the display screen are clicked in a predetermined order to trigger a click event, and a screenshot of an Activity skipped to after the click is stored.

According to an embodiment of the present disclosure, the elements of the click position matrix are in a predetermined order, e.g., from the element of row 1, column 1 to the element of row m, column n, i.e., x_1,1，x_1,2，…，x_1,n，x_2,1，x_2,2，…，x_2,n，…，x_m,1，x_m,2，…，x_m,nStarting from a first click block corresponding to the element in the 1 st row and the 1 st column, sequentially clicking click blocks corresponding to the elements in the click position matrix on the display screen to trigger a click event, so that a page screenshot of Activity skipped to after clicking is presented on the display screen. And storing the clicked Activity page screenshot in the storage unit.

According to the embodiment of the disclosure, in the process of performing the automated test on the application, a condition for terminating the click and terminating the test may be preset. And stopping continuing clicking and finishing the test when detecting that the keywords associated with the preset condition of finishing clicking are included in the screenshot of the Activity skipped by clicking by the image recognition technology. For example, if the test requires that the test be ended upon accessing the login/registration page, in the process of traversing Activity by clicking each click block on the display screen, if keywords such as "login", "username", "password", etc. associated with the condition of ending the click are recognized in the page screenshot by the image recognition technology, the click is ended and the test is ended.

And if the condition for terminating the click and terminating the test is not set, automatically clicking the N click blocks corresponding to the elements in the click position matrix according to a preset sequence to traverse all Activities.

In step S205, the image recognition technology is used to compare the screenshot of the page before the click with the screenshot of the page after the click, and determine the similarity between the two. Specifically, the image characteristics of the page screenshot before the click and the image characteristics of the page screenshot obtained after the click, which are stored in the storage unit, are respectively extracted through an image recognition technology for comparison.

In step S206, it is determined whether the degree of similarity is greater than a predetermined threshold. If the similarity is greater than the preset threshold, the similarity of the screen capturing of the page before and after clicking is high, the current clicking event is determined to be invalid, the step S204 is returned to continue clicking the next clicking block k (k is an integer, 1< k is less than or equal to N), and the step S205 is executed again.

If the similarity is determined to be smaller than the predetermined threshold in step S206, it indicates that the similarity of the screen shots of the pages before and after the click is not high, and it is determined that the current click event is valid. Then, in step S207, the position coordinate information of the element in the click position matrix corresponding to the current click is stored in the test case library.

Then, in step S208, it is determined whether the clicking on the N click blocks has been completed, that is, whether k is equal to N, or whether a page shot conforming to a termination click condition is detected.

If it is determined that the click on the N click blocks has not been completed, that is, k < N, and the page screen shot meeting the termination click condition is not detected, it returns to step S203, and steps S204, S205, S206, and S207 are performed again.

If it is determined that the clicking on the N click blocks has been completed or the page screenshot meeting the termination click condition has been detected, the continuation of the clicking operation is stopped, and in step S209, the position coordinate information stored in the test case library corresponding to the valid click event is collected to form a valid click chain, where each position coordinate information of the valid click chain corresponds to one Activity of the application under test.

By utilizing the test case library constructed in the way, the corresponding click blocks on the display screen are automatically clicked according to the effective click chain, so that the Activity of the same or similar applications can be automatically traversed. Moreover, the test case library can be used repeatedly to save the test time of repeated tests.

In addition, the click coordinate position can be positioned on the display screen aiming at the specified Activity according to the corresponding relation between the click block and the corresponding Activity on the display screen. When the test is only needed for the designated Activity, the test can be carried out by clicking the corresponding click coordinate position, so that the quick test for the designated Activity is realized.

According to the system and the method for the automatic testing of the android application, the automatic testing can be performed on the android application developed by adopting a third-party game engine, and particularly, the automatic testing can be performed on the application which has no Activity switching and can not directly obtain a page control.

Fig. 3 illustrates an exemplary configuration of a computing device 300 capable of implementing embodiments in accordance with the present disclosure.

Computing device 300 is an example of a hardware device to which the above-described aspects of the disclosure can be applied. Computing device 300 may be any machine configured to perform processing and/or computing. Computing device 300 may be, but is not limited to, a tablet computer, a Personal Data Assistant (PDA), a smart phone, an in-vehicle computer, or a combination thereof.

As shown in fig. 3, computing device 300 may include one or more elements that may be connected to or in communication with bus 302 via one or more interfaces. Bus 302 can include, but is not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an enhanced ISA (eisa) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus, among others. Computing device 300 may include, for example, one or more processors 304, one or more input devices 306, and one or more output devices 308. The one or more processors 304 may be any kind of processor and may include, but are not limited to, one or more general purpose processors or special purpose processors (such as special purpose processing chips). The processor 302 may correspond to, for example, elements of the automated testing system for android applications of FIG. 1. Input device 306 may be any type of input device capable of inputting information to a computing device and may include, but is not limited to, a mouse, a keyboard, a touch screen, a microphone, and/or a remote control. Output device 308 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, a video/audio output terminal, a vibrator, and/or a printer.

The computing device 300 may also include or be connected to a non-transitory storage device 314, which non-transitory storage device 314 may be any non-transitory and may implement a storage device for data storage, and may include, but is not limited to, a disk drive, an optical storage device, a solid state memory, a floppy disk, a flexible disk, a hard disk, a magnetic tape, or any other magnetic medium, a compact disk, or any other optical medium, a cache memory, and/or any other memory chip or module, and/or any other medium from which a computer may read data, instructions, and/or code. Computing device 300 may also include Random Access Memory (RAM)310 and Read Only Memory (ROM) 312. The ROM 312 may store programs, utilities or processes to be executed in a nonvolatile manner. The RAM 310 may provide volatile data storage and store instructions related to the operation of the computing device 300. Computing device 300 may also include a network/bus interface 316 coupled to a data link 318. The network/bus interface 316 may be any kind of device or system capable of enabling communication with external devices and/or networks and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication device, and/or a chipset (such as a bluetooth (TM) device, an 802.11 device, a WiFi device, a WiMax device, a cellular communication infrastructure, etc.).

The present disclosure may be implemented as any combination of apparatus, systems, integrated circuits, and computer programs on non-transitory computer readable media. One or more processors may be implemented as an Integrated Circuit (IC), an Application Specific Integrated Circuit (ASIC), or a large scale integrated circuit (LSI), a system LSI, or a super LSI, or as an ultra LSI package that performs some or all of the functions described in this disclosure.

The present disclosure includes the use of software, applications, computer programs or algorithms. Software, applications, computer programs, or algorithms may be stored on a non-transitory computer readable medium to cause a computer, such as one or more processors, to perform the steps described above and depicted in the figures. For example, one or more memories store software or algorithms in executable instructions and one or more processors may associate a set of instructions to execute the software or algorithms to provide various functionality in accordance with embodiments described in this disclosure.

Software and computer programs (which may also be referred to as programs, software applications, components, or code) include machine instructions for a programmable processor, and may be implemented in a high-level procedural, object-oriented, functional, logical, or assembly or machine language. The term "computer-readable medium" refers to any computer program product, apparatus or device, such as magnetic disks, optical disks, solid state storage devices, memories, and Programmable Logic Devices (PLDs), used to provide machine instructions or data to a programmable data processor, including a computer-readable medium that receives machine instructions as a computer-readable signal.

By way of example, computer-readable media can comprise Dynamic Random Access Memory (DRAM), Random Access Memory (RAM), Read Only Memory (ROM), electrically erasable read only memory (EEPROM), compact disk read only memory (CD-ROM) or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired computer-readable program code in the form of instructions or data structures and which can be accessed by a general-purpose or special-purpose computer or a general-purpose or special-purpose processor. Disk or disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above are also included within the scope of computer-readable media.

The subject matter of the present disclosure is provided as examples of apparatus, systems, methods, and programs for performing the features described in the present disclosure. However, other features or variations are contemplated in addition to the features described above. It is contemplated that the implementation of the components and functions of the present disclosure may be accomplished with any emerging technology that may replace the technology of any of the implementations described above.

Additionally, the above description provides examples, and does not limit the scope, applicability, or configuration set forth in the claims. Changes may be made in the function and arrangement of elements discussed without departing from the spirit and scope of the disclosure. Various embodiments may omit, substitute, or add various procedures or components as appropriate. For example, features described with respect to certain embodiments may be combined in other embodiments.

Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, multitasking and parallel processing may be advantageous.

Claims

1. An automated testing method for android applications, comprising:

dividing a display screen of the test equipment into N clicking blocks, wherein N is an integer greater than 1, and generating a clicking position matrix by using elements including clicking position coordinate information corresponding to each clicking block;

acquiring initial starting Activity, starting an application APP, and storing a current page screenshot;

clicking N click blocks on a display screen according to a preset sequence to trigger a click event, and storing a page screenshot of Activity jumped to after clicking;

comparing the screenshot of the page before clicking with the screenshot of the page obtained after clicking, and determining the similarity between the screenshot of the page and the screenshot of the page;

under the condition that the similarity is judged to be smaller than the preset threshold value, storing the position coordinate information of the elements in the click position matrix corresponding to the current click into a test case library; and

under the condition that clicking of the N clicked blocks is judged to be finished or page screenshots meeting the condition of stopping clicking are detected, position coordinate information stored in the test case library is collected to form an effective click chain, wherein each position coordinate information in the effective click chain corresponds to one Activity of the tested application.

2. The method of claim 1, further comprising:

and setting a condition for ending the click, and ending the click and finishing the test when detecting that the keywords associated with the set condition for ending the click are included in the screenshot of the Activity skipped by the click.

3. The method of claim 1 or 2, wherein comparing the pre-click page screenshot to the post-click page screenshot comprises:

and respectively extracting the image characteristics of the page screenshot before clicking and the page screenshot obtained after clicking by an image recognition technology for comparison.

4. The method according to claim 1 or 2, wherein the display screen of the test device is divided into N click blocks, and generating a click position matrix from elements including click position coordinate information corresponding to each click block comprises the steps of:

initializing real machine/simulator equipment for automatic testing, and acquiring the length and width dimensions of a display screen of the testing equipment;

the display screen is divided equally by a predetermined number of pixels or in any suitable form according to its length and width dimensions; and

a click position matrix is generated from elements including click position coordinate information corresponding to each click block.

5. The method of claim 1 or 2, further comprising:

and automatically traversing the Activity of the same or similar application by automatically clicking the corresponding click blocks on the display screen according to the effective click chain.

6. The method of claim 1 or 2, further comprising:

and positioning a click coordinate position on the display screen according to the corresponding relation between the click block and the corresponding Activity on the display screen aiming at the specified Activity, and testing the specified Activity by clicking the positioned click coordinate position.

7. The method of claim 1 or 2, further comprising:

and traversing the APK directory name and the file name of the android application package, and judging whether the APK is the native android application package by inquiring the key words of unity, cos and ue 4.

8. An automated testing system (100) for android applications, comprising:

a click position matrix generation unit (101) for dividing a display screen of the test device into N click blocks, where N is an integer greater than 1, and generating a click position matrix based on elements including click position coordinate information corresponding to each click block;

a click event triggering unit (102) for triggering a jump to an Activity corresponding to click position coordinate information of a click block by clicking the click block divided on the display screen according to a predetermined order;

the storage unit (103) is used for storing click position coordinate information of each click block of the display screen and an Activity page screenshot jumped to after clicking;

the comparison unit (104) is used for comparing the page screenshot before the click with the page screenshot obtained after the click to determine the similarity between the two, comparing the similarity with a preset threshold, and determining that the current click event is an effective click event when the similarity is lower than the preset threshold; and

a test case library (105) for storing position coordinate information of elements in the click position matrix corresponding to each valid click event and forming a valid click chain, each position coordinate information of the valid click chain corresponding to one Activity of the application under test.

9. A computer readable storage medium having stored thereon instructions which, when executed by a processor, cause the processor to perform the method for automated testing of android applications of any of claims 1 to 7.