CN112306883A

CN112306883A - Software testing method, device and medium

Info

Publication number: CN112306883A
Application number: CN202011235432.2A
Authority: CN
Inventors: 景成新; 陈宗强; 李石磊
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-11-05
Filing date: 2020-11-05
Publication date: 2021-02-02

Abstract

The disclosure relates to a software testing method, device and medium. The method comprises the following steps: when it is monitored that the equipment to be tested is connected to the server, distributing a test task for the equipment to be tested; acquiring a test software package based on the test task, and installing the test software package on the equipment to be tested; and when the test software package is determined to be installed, acquiring the running information of the test software running by the equipment to be tested. By adopting the method, the daily test of the upper operating system and the system application of the intelligent terminal can be realized in an automatic mode, the manual labor and the cost are reduced, the test stability is improved, and the test efficiency is improved.

Description

Software testing method, device and medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a software testing method, apparatus, and medium.

Background

Along with the continuous popularization of the use of the intelligent terminal by people, the functions which can be realized by the intelligent terminal are more and more, and therefore more and more system applications are installed on the intelligent terminal. Some of these system applications are interdependent, and with the large number of cell phone models, daily refreshment is necessary.

However, repeated labor is required, and as the number of models of mobile phones increases, the application becomes complicated, and the testing task becomes more and more burdensome. Some more complicated test scenes require that testers have more abundant test experiences, which has higher requirements on the testers. In addition, the repeated manual labor can cause a job of paralysis, thereby increasing the risk of error.

Disclosure of Invention

To overcome the problems in the related art, the present disclosure provides a software testing method, apparatus, and medium.

According to a first aspect of the embodiments of the present disclosure, there is provided a software testing method applied to a server, the method including:

when it is monitored that the equipment to be tested is connected to the server, distributing a test task for the equipment to be tested;

acquiring a test software package based on the test task, and installing the test software package on the equipment to be tested;

and when the test software package is determined to be installed, acquiring the running information of the test software running by the equipment to be tested.

Wherein the obtaining of the test software package based on the test task comprises:

acquiring the information of the equipment to be tested;

determining the test software package based on the test task and the information of the equipment to be tested;

and acquiring the test software package.

Wherein determining the test software package based on the test task and the device under test information comprises:

determining whether to execute the test task for the device to be tested based on the test task and the device to be tested information;

and when the test task is determined to be executed, determining the test software package based on the test task and the information of the equipment to be tested.

and acquiring a test software package with a root authority function based on the test task.

After obtaining the running information of the device to be tested running the test software, the method further comprises:

and generating a test report based on the operation information.

Wherein, distributing the test task for the device to be tested comprises:

and distributing a development version software testing task and/or a stable version software testing task for the equipment to be tested.

According to a second aspect of the embodiments of the present disclosure, there is provided a software testing apparatus applied to a server, the apparatus including:

the task allocation module is set to allocate a test task to the equipment to be tested when the equipment to be tested is monitored to be connected to the server;

a download installation module configured to obtain a test software package based on the test task and install the test software package on the device under test;

and the running information acquisition module is set to acquire the running information of the test software run by the equipment to be tested when the test software package is determined to be installed.

Wherein the download installation module is further configured to:

acquiring the information of the equipment to be tested;

and acquiring the test software package.

Wherein the download installation module is further configured to:

Wherein the apparatus further comprises:

a report generation module configured to generate a test report based on the operation information.

Wherein the task allocation module is further configured to:

According to a third aspect of the embodiments of the present disclosure, there is provided a software testing apparatus including:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the following steps when executing the executable instructions:

According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer readable storage medium having instructions which, when executed by a processor of an apparatus, enable the apparatus to perform a software testing method, the method comprising:

The software testing method comprises the steps of distributing a testing task for the equipment to be tested when the equipment to be tested is monitored to be connected to the server, obtaining a testing software package based on the testing task, and installing the testing software package on the equipment to be tested. And when the test software package is determined to be installed, acquiring the running information of the equipment to be tested for running the test software. By the method, daily testing of the upper operating system and system application of the intelligent terminal can be achieved in an automatic mode, manual labor and cost are reduced, testing stability is improved, and testing efficiency is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

FIG. 1 is a flow chart illustrating a method of software testing according to an exemplary embodiment.

FIG. 2 is a flow chart illustrating a method of software testing according to an exemplary embodiment.

FIG. 3 is a block diagram illustrating a software testing device according to an exemplary embodiment.

FIG. 4 is a block diagram illustrating an apparatus in accordance with an example embodiment.

FIG. 5 is a block diagram illustrating an apparatus in accordance with an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

The operating system test and the system application test of the intelligent terminal usually need a large amount of repeated labor, and in many scenes, testers need to have richer test experiences, so that test cases for more complex test scenes can be compiled. In addition, the repeated manual labor inevitably carries a risk of error.

Some current test platforms cannot support daily flashing test of the intelligent terminal, and the situation that no test scene exists and related tests cannot be carried out is met. In addition, the test platform is generally required to be compatible with a plurality of test modes, so that the test stability is low, and more bugs are brought in the test.

The present disclosure provides a software testing method for testing an operating system and system applications installed on an intelligent terminal. The method comprises the steps of distributing a test task for the equipment to be tested when the condition that the equipment to be tested is connected to a server is monitored, acquiring a test software package based on the test task, and installing the test software package on the equipment to be tested. And when the test software package is determined to be installed, acquiring the running information of the equipment to be tested for running the test software. By the method, daily testing of the upper operating system and system application of the intelligent terminal can be achieved in an automatic mode, manual labor and cost are reduced, testing stability is improved, and testing efficiency is improved.

The intelligent terminal in the disclosure can be a mobile phone, a PAD, a wearable device, an intelligent television and the like. The software tested here includes an operating system installed on the smart terminal, and also includes system applications.

Fig. 1 is a flowchart illustrating a software testing method applied to a server according to an exemplary embodiment, where the method includes the following steps:

step 101, when it is monitored that a device to be tested is connected to the server, distributing a test task for the device to be tested;

102, acquiring a test software package based on the test task, and installing the test software package on the equipment to be tested;

step 103, acquiring the running information of the device to be tested running the test software when the test software package is determined to be installed.

In step 101, the server monitors whether the devices to be tested are accessed, for example, through the "adb devices" and "fastboot devices" commands, whether the devices are accessed to the server is monitored. When it is monitored that the device to be tested is accessed, a test task is distributed to the device to be tested, wherein the test task comprises a development version software test task and/or a stabilization version software test task, and the detailed description is combined with a specific implementation mode.

In step 102, based on the distributed test task, a test software package is obtained, that is, the required test software package is downloaded to the server, and then the test software package is installed on the connected device to be tested through the server, that is, the flashing process is executed. The flashing refers to refreshing and upgrading of an operating system of the intelligent terminal. The test software package may be an upgrade software package (also referred to as a rom package) of the operating system of the smart terminal.

In step 103, after the test software package is installed on the device under test, that is, after the device under test is booted, the device under test starts to run the upgraded software for testing. And generating operation information including an operation result, intermediate information in the operation process and related log information in the operation process during and after the operation of the software. And the server waits for the equipment to be tested to finish the operation of the upgrade software, and acquires the operation information of the software from the equipment to be tested for later use when a test report is generated.

By adopting the method, the daily test of the upper operating system and the system application of the intelligent terminal can be realized in an automatic mode, the manual labor and the cost are reduced, the test stability is improved, and the test efficiency is improved.

In an optional embodiment, the obtaining a test software package based on the test task includes:

acquiring the information of the equipment to be tested;

and acquiring the test software package.

In this embodiment, device information to be tested is acquired, where the device information to be tested includes, for example, information such as a device model. Because the test software packages required to be installed by the devices of different models are different, the test software packages are determined based on the distributed test tasks and the obtained information of the devices to be tested, and are obtained, namely downloaded.

Based on the test task and the information of the equipment to be tested, the test software package installed on the equipment to be tested can be determined more accurately, and the test efficiency is effectively improved.

In an optional embodiment, determining the test software package based on the test task and the information of the device under test includes:

The test task may be a development software test task or a stable software test task, but not all types of devices to be tested can perform the development software test task or the stable software test task, and therefore, it is further required to determine whether to execute the assigned test task on the device to be tested according to information (for example, a model of the device to be tested) of the device to be tested. For example, some models of devices under test do not support testing of the stable version of software, and further, for example, some models of devices under test do not support installing a version of software, in these cases, it is determined that the assigned test task is not performed on the devices under test, that is, the assigned test task is ignored, and the test process is ended.

By adopting the method, the condition of the equipment to be tested can be comprehensively considered, and unnecessary workload is avoided, so that the testing efficiency is improved.

In this embodiment, when acquiring a test software package, the test software package having a root authority function is acquired. The root authority is the highest authority of the system, such as stopping or starting a process, adding or deleting a user, disabling or adding hardware, and the like. With root authority, it is convenient to test various functions, otherwise some limited situations may be encountered, such as some system functions or functions of system applications cannot be tested. Therefore, a test software package with root authority function is needed to be obtained.

In an optional embodiment, after obtaining the running information of the device under test running the test software, the method further includes:

and generating a test report based on the operation information.

In this embodiment, the running information of the running test software may include a result obtained after the running is completed, intermediate information (including related screenshots, videos, and the like) in the running process, related log information, and the like. Based on the operational information, a test report is generated.

Through the operation information, a test report with more comprehensive evaluation can be generated so as to facilitate the further improvement and update.

In an optional embodiment, the allocating a test task to the device under test includes:

For example, when it is monitored that the device to be tested is connected to the server, relevant setting parameters may be acquired, and a test task may be assigned to the device according to the parameters. The parameters may be set in the server by the relevant program or command. For example, when the parameter is "dev" (representing the development edition), the development edition software testing task is distributed; when the parameter is "stable" (representing stable version), distributing the stable version software testing task; when the parameter is 'dev stable', a development version software testing task and a stable version software testing task are distributed.

In this embodiment, the allocation of the development version software test task and/or the stable version software test task to the device to be tested is based on the following considerations:

release development version software on workday: monday through Friday, since many departments will have code in due to work hours, the packing platform will pack the code in edition into a rom package on the second workday and provide a link for downloading the rom package. By the rule, the development version software is tested on a working day so as to find problems in time.

Release of stable version software on weekends: because the models of the intelligent terminal are numerous, the stable version entry time of each model is inconsistent, and accurate and uniform stable version test time cannot be obtained. And the stable version of software comes from the development version, so the stable version returns unnecessarily frequently. Therefore, only the latest version of the rom package of each model of the intelligent terminal needs to be brushed in on the weekend for testing.

Therefore, when a test task is allocated to the device to be tested, the development version software test task and/or the stable version software test task can be allocated to the device to be tested based on whether the development version software and the stable version software are available. It should be noted that, when the development software and the stable software can be obtained at the same time, the development software testing task and the stable software testing task can be distributed to the device to be tested at the same time.

By adopting the method in the embodiment, different types of software can be automatically tested according to the characteristics of software versions released on weekdays and weekends.

In addition, the development software and the stable software may be operating system software, or may be system application software, for example, application mall is checked on test cases, and when there is updatable software (development software and/or stable software) of an application, self-upgrade testing is performed.

Specific embodiments according to the present disclosure are described below in conjunction with specific application scenarios. In this embodiment, the smart terminal is a mobile phone, and the software for testing includes a mobile phone operating system and a system application. As shown in fig. 2, the method in this embodiment includes the steps of:

step 201, monitoring whether a mobile phone accesses a server through the 'adb devices' and 'fastboot devices' commands.

Step 202, when the mobile phone access server is monitored, a development version software test task and a stabilization version software test task are distributed for the mobile phone.

Step 203, obtaining model information of the mobile phone, and determining to execute the test task aiming at the mobile phone based on the model information and the distributed development version software test task and the stable version software test task.

And step 204, determining a test software package based on the mobile phone model information and the distributed development version software test task.

Step 205, downloading the test software package with the root authority function.

And step 206, installing the downloaded test software package on the mobile phone to be tested.

And step 207, the mobile phone to be tested runs the software package and obtains running information from the mobile phone to be tested.

And step 208, generating a test report based on the operation information.

In the method, the testing process of the operating system software and the system application software of the terminal is executed in an automatic mode, the equipment to be tested can be subjected to the flash test every day, and the test can be followed according to the change of product requirements. Compared with the existing public test platform, the test platform does not need to communicate with the outside during testing, so that the test safety is higher, a leak in the test platform cannot be introduced, and the test stability is higher. In addition, an automatic mode is adopted for testing, so that the test task is conveniently divided, the test speed is increased, and the test efficiency is improved. The method can also greatly reduce repeated manual labor and reduce the labor cost.

The present disclosure also provides a software testing apparatus applied to a server, as shown in fig. 3, the apparatus including:

the task allocation module 301 is configured to allocate a test task to the device to be tested when it is monitored that the device to be tested is connected to the server;

a download installation module 302 configured to obtain a test software package based on the test task and install the test software package on the device under test;

the running information obtaining module 303 is configured to obtain running information of the device under test running the test software when the test software package is determined to be installed.

In an alternative embodiment, the download installation module 302 is further configured to:

acquiring the information of the equipment to be tested;

and acquiring the test software package.

In an alternative embodiment, the apparatus further comprises:

In an alternative embodiment, the task assignment module 301 is further configured to:

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

In the method, the testing process of the operating system software and the system application software of the terminal is executed in an automatic mode, the equipment to be tested can be subjected to the flash test every day, and the test can be followed according to the change of product requirements. Compared with the existing public test platform, the test platform does not need to communicate with the outside during testing, so that the test safety is higher, a leak in the test platform cannot be introduced, and the test stability is higher. In addition, an automatic mode is adopted for testing, so that the test task is conveniently divided, the test speed is increased, and the test efficiency is improved.

FIG. 4 is a block diagram illustrating a software testing apparatus 400 according to an exemplary embodiment.

Referring to fig. 4, the apparatus 400 may include one or more of the following components: a processing component 402, a memory 404, a power component 406, a multimedia component 408, an audio component 410, an interface for input/output (I/O) 412, a sensor component 414, and a communication component 416.

The processing component 402 generally controls overall operation of the apparatus 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 402 can include one or more modules that facilitate interaction between the processing component 402 and other components. For example, the processing component 402 can include a multimedia module to facilitate interaction between the multimedia component 408 and the processing component 402.

The memory 404 is configured to store various types of data to support operations at the device 400. Examples of such data include instructions for any application or method operating on the device 400, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 404 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power components 406 provide power to the various components of device 400. Power components 406 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for apparatus 400.

The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 400 is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 410 is configured to output and/or input audio signals. For example, audio component 410 includes a Microphone (MIC) configured to receive external audio signals when apparatus 400 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 404 or transmitted via the communication component 416. In some embodiments, audio component 410 also includes a speaker for outputting audio signals.

The I/O interface 412 provides an interface between the processing component 402 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor component 414 includes one or more sensors for providing various aspects of status assessment for the apparatus 400. For example, the sensor component 414 can detect the open/closed state of the device 400, the relative positioning of components, such as a display and keypad of the apparatus 400, the sensor component 414 can also detect a change in the position of the apparatus 400 or a component of the apparatus 400, the presence or absence of user contact with the apparatus 400, orientation or acceleration/deceleration of the apparatus 400, and a change in the temperature of the apparatus 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 416 is configured to facilitate wired or wireless communication between the apparatus 400 and other devices. The apparatus 400 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 404 comprising instructions, executable by the processor 420 of the apparatus 400 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

A non-transitory computer readable storage medium having instructions therein which, when executed by a processor of a mobile terminal, enable the mobile terminal to perform a software testing method, the method comprising: when it is monitored that the equipment to be tested is connected to the server, distributing a test task for the equipment to be tested; acquiring a test software package based on the test task, and installing the test software package on the equipment to be tested; and when the test software package is determined to be installed, acquiring the running information of the test software running by the equipment to be tested.

FIG. 5 is a block diagram illustrating an apparatus 500 for software testing according to an exemplary embodiment. For example, the apparatus 500 may be provided as a server. Referring to fig. 5, the apparatus 500 includes a processing component 522 that further includes one or more processors and memory resources, represented by memory 532, for storing instructions, such as applications, that are executable by the processing component 522. The application programs stored in memory 532 may include one or more modules that each correspond to a set of instructions. Further, the processing component 522 is configured to execute instructions to perform the above-described method: when it is monitored that the equipment to be tested is connected to the server, distributing a test task for the equipment to be tested; acquiring a test software package based on the test task, and installing the test software package on the equipment to be tested; and when the test software package is determined to be installed, acquiring the running information of the test software running by the equipment to be tested.

The apparatus 500 may also include a power component 526 configured to perform power management of the apparatus 500, a wired or wireless network interface 550 configured to connect the apparatus 500 to a network, and an input/output (I/O) interface 558. The apparatus 500 may operate based on an operating system stored in the memory 532, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A software testing method is applied to a server, and is characterized by comprising the following steps:

2. The method of claim 1, wherein said obtaining a test software package based on said test task comprises:

acquiring the information of the equipment to be tested;

and acquiring the test software package.

3. The method of claim 2, wherein determining the test software package based on the test task and the device under test information comprises:

4. The method of claim 1, wherein said obtaining a test software package based on said test task comprises:

5. The method of claim 1, wherein after obtaining the running information that the device under test runs the test software, the method further comprises:

and generating a test report based on the operation information.

6. The method of claim 1, wherein said assigning a test task to the device under test comprises:

7. A software testing device applied to a server is characterized by comprising:

8. The apparatus of claim 7, wherein the download installation module is further configured to:

acquiring the information of the equipment to be tested;

and acquiring the test software package.

9. The apparatus of claim 8, wherein the download installation module is further configured to:

10. The apparatus of claim 7, wherein the download installation module is further configured to:

11. The apparatus of claim 7, wherein the apparatus further comprises:

12. The apparatus of claim 7, wherein the task allocation module is further configured to:

13. A software testing apparatus, comprising:

a processor;

a memory for storing processor-executable instructions;

14. A non-transitory computer readable storage medium in which instructions, when executed by a processor of an apparatus, enable the apparatus to perform a method of software testing, the method comprising: