CN114168467B

CN114168467B - Software automatic testing method and system based on image recognition technology

Info

Publication number: CN114168467B
Application number: CN202111484047.6A
Authority: CN
Inventors: 罗维佳; 吴勇; 王富; 曹拓荒; 罗剑芳; 肖天梅
Original assignee: Guangzhou Zhangdong Intelligent Technology Co ltd
Current assignee: Guangzhou Zhangdong Intelligent Technology Co ltd
Priority date: 2021-12-07
Filing date: 2021-12-07
Publication date: 2022-07-01
Anticipated expiration: 2041-12-07
Also published as: CN114168467A

Abstract

The application discloses a software automatic test system and a method based on an image recognition technology, wherein the system comprises: the USB connection module comprises a first USB plug, an on-off control module, a second USB plug and a third USB plug, wherein the first USB plug and the second USB plug are connected through the on-off control module; the test module is used for displaying a software running area to be tested and a USB connection module operation area, recording a script according to an operation instruction aiming at the software running area to be tested and the USB connection module operation area, and playing back the script. According to the method and the device, the physical characteristic of the hardware mode USB fault can be utilized, and meanwhile, the action of triggering the USB can be input into the script, so that the operation is simpler.

Description

Software automatic testing method and system based on image recognition technology

Technical Field

The application relates to a testing technology and an image recognition technology, in particular to an automatic software testing system and method based on the image recognition technology.

Background

Software automatic testing usually realizes the purpose of repeatedly testing software to be tested by manually recording scripts and then restoring manual operation based on an image technology. Through the test, when the recorded script cannot be executed, the software is indicated to have errors, so that a related picture or log can be captured, and a tester is helped to locate the errors.

However, in some software tests, physical connections between devices are involved. For example, the test of software interconnecting a mobile phone and a computer involves the working condition of a hardware plug connection. The prior art generally only aims at software implementation and cannot cooperatively test the working condition caused by hardware. Part of software can simulate the plugging and unplugging functions of connectors such as USB and the like, and cannot automatically simulate the physical characteristics of hardware.

Disclosure of Invention

The present invention is directed to solving at least one of the problems of the prior art. Therefore, the invention provides a software automatic test system and a software automatic test method based on an image recognition technology, so as to conveniently simulate the physical characteristics of a hardware plug.

In one aspect, an embodiment of the present application provides an automatic software testing system based on an image recognition technology, including:

the USB connection module comprises a first USB plug, an on-off control module, a second USB plug and a third USB plug, wherein the first USB plug and the second USB plug are connected through the on-off control module;

the test module is used for displaying a to-be-tested software running area and a USB connection module operation area, recording a script according to an operation instruction aiming at the to-be-tested software running area and the USB connection module operation area, and playing back the script;

and the USB connection module operation area is used for controlling the on-off control module through the third USB plug.

In some embodiments, the USB connection module operation area is configured with a plurality of control status buttons, and each status control button corresponds to a status switching action of the on-off control module.

In some embodiments, the on-off control module comprises a plurality of controllable switches, a processor and a memory;

the test module is also used for inputting the configuration information of the state switching action into the memory;

the memory is provided with an index table of each state switching action, and the processor searches the configuration information of the corresponding state switching action from the index table according to the instruction sent by the test module and controls the on-off control module to execute the corresponding state switching action.

In some embodiments, the configuration information includes control timing information of each unit of the on-off control module;

in a configuration state, the test module is further configured to display a configuration interface, where a timing diagram of each group of pins is displayed in the configuration interface, and the configuration information is determined according to an operation instruction for the timing diagram.

In some embodiments, the abscissa of the timing chart is time, and the length of the abscissa expressed in unit length is determined for the operation instruction of the scale selection bar.

In some embodiments, when the test module records the script, the click operation of a mouse, the shortcut operation of a keyboard and the corresponding screen capture of each operation are recorded;

and when the test module plays back the script, executing corresponding operation according to the currently identified picture screenshot.

In some embodiments, the memory includes a default partition and a plurality of custom partitions, where the default partition stores configuration information of a preset state switching action, and the custom partition stores configuration information of a custom state switching action;

and the test module reads the configuration information in the corresponding custom partition according to the login account.

In some embodiments, the configuration module displays a control state button in the operation area of the USB connection module according to the read configuration information;

the state control buttons comprise a first state control button corresponding to the configuration information in the user-defined partition and a second state control button corresponding to the configuration information in the default partition.

In some embodiments, the order of the first state control button and the second state control button defaults to the first state control button being displayed in preference to the second state control button.

On the other hand, the embodiment of the application provides an automatic software testing method based on an image recognition technology, which is realized by the automatic software testing system based on the image recognition technology, and comprises the following steps:

connecting a first USB plug of the USB connecting module with first equipment, and connecting a second USB plug and a third USB plug with second equipment, wherein the second equipment runs with a testing module, and the testing module runs with software to be tested;

recording a script; the script comprises operations aiming at a software running area to be tested and a USB connection module operation area, and the on-off control module is triggered to switch the state aiming at the operations of the USB connection module operation area so as to simulate a USB physical change state;

and playing back the script to complete the test.

According to the embodiment of the application, the USB connecting module is arranged and comprises the first USB plug, the on-off control module, the second USB plug and the third USB plug, so that a user can simulate the physical state change of a USB interface through the USB connecting module when recording a script; moreover, the test module of the embodiment records the operation of software test and records the recording integration of hardware control through recording the operation area of the USB connection module, does not need to additionally configure related programs, does not need to be manually plugged and unplugged, has higher automation degree and is more convenient, thereby increasing the test efficiency, reducing the introduction of thought factors and improving the test quality.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a block diagram of a USB connection module according to an embodiment of the present disclosure;

FIG. 2 is a schematic interface diagram of a test module according to an embodiment of the present disclosure;

fig. 3 is a schematic configuration interface diagram of a test module according to an embodiment of the present disclosure.

Detailed Description

In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be clearly and completely described below through embodiments with reference to the accompanying drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Regarding automatic software testing, usually, a repeatability test is completed based on a script recording mode, and a BUG presented in a software testing process is identified in the repeatability test by acquiring a software log or a screenshot and the like.

Referring to fig. 1 and 2, the embodiment discloses an automatic software testing system based on an image recognition technology, which includes a USB connection module and a testing module.

The USB connecting module comprises a first USB plug, an on-off control module, a second USB plug and a third USB plug, wherein the first USB plug is connected with the second USB plug through the on-off control module, and the on-off control module controls the connection state of pins of the first USB plug and the second USB plug according to an instruction from the third USB plug. And the USB connection module operation area is used for controlling the on-off control module through the third USB plug.

It is to be understood that the USB connection module is a hardware module that includes three USB plugs, which may be configured as USB-type-A, USB-type-B or USB-type-C as desired. Wherein, the male head is generally adopted. In this embodiment, the USB connection module further includes an on-off control module for changing a connection state between the first USB plug and the second USB plug. It should be understood that, the pins of the first USB plug and the second USB plug are correspondingly connected according to the connection manner of the general USB data line. The on-off control module in this embodiment is used to control on-off of each line, which means that if the first USB plug and the second USB plug are of four-wire system, the on-off control module needs four analog switches to control on-off states of four wires. Of course, it is not necessary to provide one switch for each wire, and the number of switches may be less than the number of cables. Generally, the first USB plug is used for connecting to a lower computer such as a mobile phone, and the second USB plug are used for connecting to an upper computer such as a computer. In some scenarios, the software to be tested may be a mobile phone management software, and at this time, when testing functions related to mobile phone communication, the software needs to respond to functions of the software under the conditions that the connection of the mobile phone is physically interrupted and the like.

The test module is used for displaying a to-be-tested software running area and a USB connection module operation area, recording a script according to an operation instruction aiming at the to-be-tested software running area and the USB connection module operation area, and playing back the script.

In this embodiment, the test module may be a software module running on a computer, and as shown in fig. 2, the USB connection module operation area 100 and the to-be-tested software running area 200 are both areas where scripts are recorded. Then, when recording the script, the user may trigger the preset USB line state switching by way of a shortcut key or a mouse click. All or part of a plurality of wires in the USB connection can be selectively simulated to be disconnected, so that the physical performance is simulated. It should be understood that this process is recorded through a script, and the playback can be directly completed through software without additionally setting software to simulate a USB fault (or called a physical state change) during the playback process. This approach facilitates software testing without the user having to worry about how to handle synchronization issues when simulating USB failures, since the associated simulation actions are recorded in the script for playback testing by way of script recording. During testing, a user can play back the script by connecting the USB connection module and configuring the related script.

It can be understood that the scheme can carry out self-defined configuration on the condition needing simulation in the USB connection module, can be used across the test host through certain permission setting, and is more convenient in the process of replacing the test environment.

In the present embodiment, an example of a script is exemplarily given.

When map A is identified, click position (a1, b 1); the position (a1, b1) is positioned in the running area 200 for displaying the software to be tested;

when map B is identified, 100ms delay, click position (a2, B2); location (a2, b2) is in the USB connection module operating area 100;

as can be seen from the script example, when the script is generated, and the recorded operation instruction points to the USB connection module operation area 100, when the click instruction of the script is generated, a preset delay is added before the click instruction is executed. By increasing the preset delay, the situation that the instruction is executed too fast and cannot be expected is avoided, and the action clicked by the user is simulated more truly. In some cases, for example, software requires data loading, but may cause execution exceptions due to the fast triggering of USB state changes in the script. Therefore, in this embodiment, when executing the command for the USB connection module operating area, a delay is first set, and the delay can be adjusted according to the actual situation.

Referring to fig. 2, in some embodiments, the USB connection module operation area is configured with a plurality of control status buttons, and each status control button corresponds to a status switching action of the on-off control module.

A plurality of status buttons are visible in the USB connection module operating area 100, each of which triggers a status, it being understood that the status may be temporary or persistent (persistent until the next change). Take a pin connection in USB as an example. The pin connection can be switched from the connected state to the disconnected state by activating a particular button. In other examples, a pin connection is also operated, which may be temporary, such as being disconnected for 100ms, and then reconnected.

By the embodiment, a user can pre-configure the condition to be tested, and then click the corresponding button to trigger the relevant state when the script is recorded, so that the information simulated by the hardware can be also input into the script.

Referring to FIG. 1, in some embodiments, the on-off control module includes a plurality of controllable switches, a processor, and a memory. The memory can adopt e2prom, flash and other memory chips, and the controllable switches can be realized by adopting a plurality of paths of electronic switches.

In this embodiment, an index table is set in the memory, and the index table points the relevant instruction number to the corresponding configuration information position. And when the test module is initialized, the test module reads the configuration information from the index table and presents the configuration information to a user. When a user triggers a certain button, the test module sends a trigger instruction, and the processor acquires the index table from the memory according to the trigger instruction and then acquires the corresponding configuration information for execution. The configuration information is convenient to manage in an index table mode, the times of transmission of the configuration information are reduced, and simulation failure caused by errors in the transmission process is reduced.

Referring to fig. 3, in some embodiments, the configuration information includes control timing information of each unit of the on-off control module;

in a configuration state, the test module is further configured to display a configuration interface, where a timing diagram of each group of pins is displayed in the configuration interface, and the configuration information is determined according to an operation instruction for the timing diagram. The abscissa of the time chart is time, and the time length expressed in unit length of the abscissa is determined for the operation instruction of the scale selection bar.

In the test module, a configuration mode can be entered through a menu bar, and in the configuration mode, the USB switching state of each button can be configured, and a configuration interface 300 is shown in fig. 3. In timing, the timing of the pins in the switching state is changed by dragging or clicking the timing chart 301 of each pin. To accommodate more test scenarios, the length of time represented by each grid of the abscissa can be selected using the scale option 302.

In some embodiments, when the test module records the script, the click operation of a mouse, the shortcut operation of a keyboard and the corresponding picture screenshot of each operation are recorded;

It can be understood that, in the present embodiment, when the script is recorded, a picture of the current recording area is captured based on clicking or shortcut key operation. When the picture of the scratch area is detected at the time of playback, corresponding operation is executed.

the state control buttons comprise a first state control button corresponding to the configuration information in the user-defined partition and a second state control button corresponding to the configuration information in the default partition. Wherein the first state control button generally refers to a user-defined button and the second state button generally refers to a default button.

In this embodiment, in order to enable the USB connection module to be effectively shared and prevent users from interfering with the use of objects due to custom configuration, the memory in this embodiment is provided with a default partition and a plurality of custom partitions, and each custom partition is accessed based on account information set by a user. The configuration information stored in the default partition is a default centralized simulation state of the test module. The configuration information stored in the custom partition allows the user to customize the partition. Generally, when displaying, according to the configuration policy adopted by the user, a default switching state button may be preferentially displayed, or a custom switching state button may be preferentially displayed.

It should be understood that, through the customized partition configuration, a plurality of users can create and archive corresponding configuration information under their own accounts, and through configuring account information in the test module, mutual response can be avoided when a plurality of users share the USB connection module.

In some embodiments, the order of the first state control button and the second state control button defaults to the first state control button being displayed in preference to the second state control button. It will be appreciated that the default user-defined button takes precedence over the default button in the test module.

The embodiment of the application provides an automatic software testing method based on an image recognition technology, which is realized by the automatic software testing system based on the image recognition technology and comprises the following steps:

and playing back the script to complete the test.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. An automatic software testing system based on image recognition technology is characterized by comprising:

the USB connection module operation area is used for controlling the on-off control module through the third USB plug;

the USB connection module operation area is provided with a plurality of control state buttons, and each state control button corresponds to one state switching action of the on-off control module;

the on-off control module comprises a plurality of controllable switches, a processor and a memory;

the test module is also used for inputting the configuration information of the state switching action into the memory; the configuration information comprises control time sequence information of each unit of the on-off control module;

in a configuration state, the test module is further configured to display a configuration interface, where a timing diagram of each group of pins is displayed in the configuration interface, and configuration information is determined according to an operation instruction for the timing diagram; the abscissa of the timing diagram is time, and the time length expressed by the unit length of the abscissa is determined according to the operation instruction of the scale selection bar;

2. The automatic software testing system based on the image recognition technology as claimed in claim 1, wherein when the testing module records the script, the mouse click operation, the keyboard shortcut operation, and the corresponding screen shots of each operation are recorded;

3. The automatic software testing system based on the image recognition technology is characterized in that the memory comprises a default partition and a plurality of custom partitions, configuration information of preset state switching actions is stored in the default partition, and configuration information of the custom state switching actions is stored in the custom partitions;

4. The automatic software testing system based on the image recognition technology as claimed in claim 3, wherein the configuration module displays a control status button in the USB connection module operation area according to the read configuration information;

5. The automatic software testing system based on the image recognition technology as claimed in claim 4, wherein the sequence of the first state control button and the second state control button defaults to the first state control button being displayed in preference to the second state control button.