WO2016119398A1

WO2016119398A1 - Method, apparatus and system for detecting suspension and runaway faults of tested device

Info

Publication number: WO2016119398A1
Application number: PCT/CN2015/083108
Authority: WO
Inventors: 尹永; 明义波
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-01-26
Filing date: 2015-07-01
Publication date: 2016-08-04
Also published as: CN105893236A

Abstract

Disclosed are a method, apparatus and system for detecting suspension and runaway faults of a tested device. The method comprises: acquiring a test plan and a test resource configured for a tested device (S11); parsing the test plan to acquire a test time, a product to be tested and a script to be tested (S13); and when a current time reaches the acquired test time, according to the product to be tested, the script to be tested and the test resource, detecting suspension and runaway faults, and obtaining a detection result (S15). In this solution, whether a tested device tested by a test script has suspension and runaway faults can be monitored in real time, and a related log is independently generated, thereby achieving the effect of quick announcement and quick treatment of the suspension and runaway faults, greatly bringing forward a fault locating and solving time point, improving the automatic test efficiency, quickening a product fault convergence velocity, and providing a good guarantee for timely product release.

Description

Method, device and system for detecting running fault of test equipment

Technical field

The present invention relates to the field of data communication technologies, and in particular, to a method, device and system for detecting a hang-up failure of a device under test.

Background technique

Suspending is a concept in the operating system that refers to the operating system suspending execution of a process. One of the reasons for the hang is the end user's request: when the end user finds a suspicious problem while his program is running, he wants to pause to stop his program. That is, the executing process is suspended; if the user process is in the ready state and not executed at this time, the process does not accept the scheduling for the user to study its execution or modify the program. We call this quiescent state a suspend state.

Running away is a concept in a computer program. When the system is subjected to some kind of interference, the value of the program counter (PC) deviates from the given unique change history, causing the program to run away from the normal running path. The factors and consequences of running the program are often unpredictable. In many cases, after the program runs, the system will enter an infinite loop and cause a crash.

Suspending and running are the higher priority faults in the automated test. If the fault occurs on the device under test, it will affect the normal release of the program version. However, the existing automated test system and method determine the success or failure of the script test by the return value of the script, generate the overall test success and failure result according to the return value of the script, generate a test log in the test, and then find the specific test problem by viewing the log. However, the hang-up runaway fault is not distinguished from other test faults, resulting in the discovery of a hang-up runaway fault at a point in time after the automated test is completed.

In addition, another automated test system proposes a database management method for logs. Although the efficiency of log management is improved, the processing of test failures including suspension of runaway faults is still not solved after suspending and running faults after the test is completed. Fast processing method.

It can be seen that the current automated test systems and methods do not propose related solutions in the rapid processing of suspension and runaway faults of the device under test.

Summary of the invention

The technical problem to be solved by the embodiments of the present invention is to provide a method, a device and a system for detecting a running failure of a device under test, which can check and quickly process the suspension and runaway faults of the device under test.

In order to solve the above technical problem, the embodiment of the present invention adopts the following technical solutions:

According to an aspect of the embodiments of the present invention, a method for detecting a running failure of a device under test includes: obtaining a test plan and a test resource configured for the device under test; and parsing the test plan to obtain a test time and to be tested The product and the script to be tested; when the current time reaches the obtained test time, the hang-up flight fault detection is performed according to the product to be tested, the script to be tested, and the test resource, and the detection result is obtained.

When the current time reaches the obtained test time, the step of suspending the running fault detection is performed according to the product to be tested, the script to be tested, and the test resource, and the step of obtaining the detection result includes: loading the product to be tested according to the acquired product. a corresponding test script to be tested; deploying the product to be tested according to the test resource to the configured plurality of devices under test, and acquiring an available device under test, and connecting the available device under test; Performing a test script to be tested on the test device; after any test to be tested completes the test, generating a test run log, and performing a pending runaway fault detection on the product to be tested by the device under test, generating a hang-up run Fault log.

The generating the hang-up flight fault log further includes: starting a socket service; when there is a hang-up flight failure, sending a fault detection email to the fault owner through the socket service.

The step of sending a fault detection email to the fault owner through the socket service when there is a pending runaway fault includes: obtaining a key segment of the fault information from the suspended runaway fault log, and matching according to the key segment The email address of the corresponding fault owner; the fault detection email is sent to the fault owner through the socket service.

After the step of sending the fault detection mail to the fault owner through the socket service, the method further includes: retaining the operating environment of the device under test when the pending runaway fault occurs, and the measured device is tested. The device is deleted from the test resource; another available device under test is obtained from the test resource, and the device under test is connected; the script to be tested is executed on another available device under test; After any of the to-be-tested scripts completes the test, the run-to-be-tested fault detection is performed on the to-be-tested product by another available device under test.

The obtaining the pending runaway fault detection result further includes: when there is no pending runaway fault, executing another script to be tested on the device under test; and after the test to be tested completes the test, passing the device under test Suspending and running fault detection of the product to be tested.

According to another aspect of the embodiments of the present invention, there is also provided a detecting device for suspending a running fault of a device under test, comprising: an obtaining module configured to acquire a test plan and a test resource configured for the device under test; and an analysis module, setting Obtaining test time, products to be tested, and scripts to be tested for parsing the test plan; fault detection module, When the current time reaches the obtained test time, the hang-up flight fault detection is performed according to the product to be tested, the script to be tested, and the test resource, and the detection result is obtained.

The fault detection module includes: a loading unit, configured to load a plurality of corresponding scripts to be tested according to the obtained product to be tested; and the connection unit is configured to deploy the product to be tested to the configured multiple according to the test resource. On the device, and obtain an available device under test, and connect the available device under test; an execution unit, configured to execute a script to be tested on the available device under test; After the test is completed, the test run log is generated, and the test device is hanged and the runaway fault detection is performed by the device under test, and the hanged runaway fault log is generated.

The fault detection module further includes: a startup unit configured to start a socket service; and a mail sending unit configured to send a fault detection email to the fault owner through the socket service when there is a pending runaway fault.

The mail sending unit is configured to: obtain a key segment of the fault information from the suspended runaway fault log, and match the email address of the corresponding fault owner according to the key segment; and the fault responsible person through the socket service Send a fault detection email.

The fault detection module further includes: a first processing unit, configured to: retain an operating environment of the device under test when the suspended runaway fault occurs, and use the device under test from the test resource Deleting; obtaining another available device under test from the test resource, and connecting the device under test; executing the to-be-tested script on another available device under test; when any of the to-be-tested scripts After the test is completed, the product to be tested is tested for suspension runaway fault by another available device under test.

The fault detection module further includes: a second processing unit, configured to: execute another script to be tested on the device under test when there is no pending runaway fault; and when the script to be tested completes the test The hang-up flight fault detection is performed on the product to be tested by the device under test.

According to another aspect of the embodiments of the present invention, there is also provided a detection system for a test device to suspend a runaway fault, comprising a plurality of products to be tested, a plurality of devices to be tested, and the device to be tested hangs and runs as described above. Flying fault detection device.

The beneficial effects of the embodiment of the present invention are: the detecting device of the device under test in the embodiment of the present invention suspends the detection method of the running fault, firstly obtaining the test plan and the test resource configured for the device under test; and then parsing the test plan and obtaining the test time therefrom The product to be tested and the script to be tested; finally, after the preset test time is reached, the running fault is suspended according to the product to be tested, the script to be tested and the test resource, and the test result is obtained.

Compared with the related art, the detecting device of the device under test in the embodiment of the present invention suspends the running fault detection method, and has the pending running check function in the test operation, and can find the suspended running fault of the tested device in advance, instead of merely relying on The script return value generates the result of the test success and failure and is manually viewed according to the log after the test is completed, and can monitor in real time whether the tested device tested by the test script generates a pending runaway fault. After obtaining the detection result, the output is timely, which achieves the effect of quickly notifying the fast-running and escaping flight failure, greatly delaying the fault location and solving the time point, improving the automation test efficiency, accelerating the product failure convergence speed, and providing timely release of the product. Better protection.

DRAWINGS

1 is a flow chart showing a method for detecting a running failure of a device under test according to an embodiment of the present invention;

2 is a schematic structural diagram of a device for detecting a running failure of a device under test according to an embodiment of the present invention;

3 is a schematic structural view of a fault detecting module;

FIG. 4 is a schematic diagram showing an application flow of a detection system for a running failure of a device under test according to an embodiment of the present invention.

detailed description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the embodiments of the present invention have been shown in the drawings, the embodiments Rather, these embodiments are provided so that this disclosure will be more fully understood and the scope of the disclosure will be fully disclosed.

Embodiment 1

According to an aspect of the embodiments of the present invention, a method for detecting a running failure of a device under test is provided, first obtaining a test plan and a test resource configured for the device under test; and then parsing the test plan to obtain a test time and waiting for Testing the product and the script to be tested; finally, when the current time reaches the obtained test time, the hang-up flight fault detection is performed according to the product to be tested, the script to be tested, and the test resource, and the detection result is obtained.

As shown in Figure 1, the method includes:

Step S11: Obtain a test plan and test resources configured for the device under test.

The test device of the embodiment of the present invention suspends the detection method of the runaway fault. Before the test, the test plan and the test resource need to be configured for the device under test, where the test plan carries the test time, the product to be tested, and the test Test script, the test resource carries the usage of multiple devices under test. The method of the embodiment of the invention detects the hanging and running fault of the product to be tested by detecting the device under test.

Step S13: Parse the test plan to obtain a test time, a product to be tested, and a script to be tested.

The test time is the startup time of the set automated test. The product to be tested refers to a product group with similar functions and certain differences. Such products can share the same set of common script libraries, and at the same time, due to certain differences in functions. There is also a script library that is only suitable for testing its own products.

Step S15: When the current time reaches the acquired test time, the hang-up flight fault detection is performed according to the product to be tested, the script to be tested, and the test resource, and the detection result is obtained.

The obtained detection result is an overall result display after the detection method of the hang-up failure detection of the device under test according to the embodiment of the present invention is completed, and is used for announcing the overall test situation of the current detection. Specifically, the output detection result includes a fault condition that occurs when each device under test detects the product to be tested by using multiple scripts, that is, from the output of the detection result, it is possible to clearly understand where each device under test is located. What happened after a script was tested.

In addition, the obtained test result can also be outputted in the form of an excel table. Of course, it can be understood that the method of the embodiment of the present invention is not limited to such an output mode.

Optionally, step S15 includes:

Loading a plurality of corresponding scripts to be tested according to the obtained product to be tested;

Deploying the product to be tested to the configured plurality of devices under test according to the test resource, and acquiring an available device under test, and connecting the available device under test;

Performing a test script to be tested on the available device under test;

After the test is completed, the test run log is generated, and the test device is hanged and the runaway fault detection is performed by the device under test, and the hanged runaway fault log is generated.

The generated hang-up flight fault log can be used as the detection result obtained after the hang-up flight fault detection. By suspending the running fault log, you can clearly understand the specific situation of the pending runaway fault, and thus help to eliminate the subsequent faults.

In the method for detecting a running fault of the device under test according to the embodiment of the present invention, the test to be tested may be selected by selecting a corresponding test script to be tested, wherein the test script provides a storage path that needs to be loaded, and is to be tested. Scripts can also be added, deleted, and modified.

Optionally, after obtaining the suspended running fault detection result, the method further includes:

Start the socket service;

When there is a pending runaway failure, the fault detection mail is sent to the fault owner through the socket service.

In the method for detecting a runaway fault of the device under test according to the embodiment of the present invention, when it is detected that there is a pending runaway fault, the fault detection email is sent to the fault owner through the opened socket service. The socket service includes a server socket and a client socket, and defines a socket request callback function when the socket is started. The function is called after receiving the socket request, and performs a mail sending function. After the socket service is started, it will wait for a socket request including the information of the hang-up flight failure and the fault owner's email address, and the socket service only needs to be started once to serve multiple fault detection processes at the same time.

Optionally, when there is a pending runaway fault, the step of sending the fault detection email to the fault owner through the socket service includes:

Obtaining a key field of the fault information from the suspended runaway fault log, and matching the email address of the corresponding fault owner according to the key segment;

The fault detection mail is sent to the fault owner through the socket socket service.

Therefore, in the detecting method for the running fault of the device under test according to the embodiment of the present invention, after each script test is completed, the hanging and running fault detection is performed, and finally the complete diary record and the pending running of the script test are generated. The special log records generated by the flight faults distinguish the pending runaway faults from other test faults, which enables a clearer understanding of the occurrence of the pending runaway faults and timely processing.

In the process of sending the fault detection email, after obtaining the key segment of the fault information, the email address of the matching fault owner may be queried from the database of the fault owner. Then, after the suspension flight failure information and the fault responsible person email address are organized, the related information is sent from the client socket to the server socket; after receiving the client socket request, the server socket calls the callback function, and the callback function is in the service. The terminal sends the fault information to the fault responsible person's email address through the Simple Mail Transfer Protocol (SMTP) service, and the corresponding fault owner logs in to the email address to receive the corresponding pending runaway fault detection email, and then processes the fault in time.

Optionally, when there is a pending runaway fault, the step of sending the fault detection email to the fault owner through the socket socket service further includes:

Retaining an operating environment of the device under test when a pending runaway failure occurs, and deleting the device under test from the test resource;

Obtaining another available device under test from the test resource, and connecting the device under test;

Executing the to-be-tested script on another available device under test;

After any of the to-be-tested scripts completes the test, the run-to-be-tested fault detection is performed on the to-be-tested product by another available device under test.

Since the hang-up flight fault is a higher-priority fault in the automatic test, if such a fault occurs, after the fault detection mail is sent, the hang-up flight fault detection method of the device under test according to the embodiment of the present invention needs to be retained. The operating environment when the device under test fails, which is convenient for the fault owner to connect to the device to locate the fault. In addition, it is necessary to remove the faulty device under test from the test resources, so as to facilitate the detection of the next available device under test.

When there is no pending runaway fault, another script to be tested is executed on the device under test;

After the test to be tested completes the test, the test device is suspended for running fault detection by the device under test.

Since each type of product to be tested corresponds to multiple scripts to be tested, if a test to be tested does not have a pending runaway failure after the test is completed, the next test to be tested needs to be continued until When the device under test has a pending runaway failure, the test of the subsequent test script is stopped, and the operating environment of the device under test is retained when the fault occurs.

Embodiment 2

According to another aspect of the embodiments of the present invention, there is also provided a detecting device for suspending a running fault of a device under test. As shown in FIG. 2, the device 200 includes:

The obtaining module 201 is configured to obtain a test plan and a test resource configured for the device under test;

The parsing module 203 is configured to parse the test plan to obtain a test time, a product to be tested, and a script to be tested;

The fault detection module 205 is configured to perform a pending runoff fault detection according to the to-be-tested product, the to-be-tested script, and the test resource when the current time reaches the acquired test time, and obtain the detection result.

Optionally, as shown in FIG. 3, the fault detection module 205 includes:

The loading unit 2051 is configured to load a plurality of corresponding scripts to be tested according to the obtained product to be tested;

The connecting unit 2052 is configured to deploy the product to be tested to the configured plurality of devices under test according to the test resource, and obtain an available device under test, and connect the available device under test;

The executing unit 2053 is configured to execute a script to be tested on the available device under test;

The obtaining unit 2054 is configured to generate a test running log after the test of the script to be tested is completed, and perform a pending runaway fault detection on the to-be-tested product by the device under test to generate a suspended running fault log.

Optionally, as shown in FIG. 3, the fault detection module 205 further includes:

The booting unit 2057 is configured to start a socket socket service;

The mail sending unit 2058 is configured to send a fault detection mail to the fault owner through the socket socket service when there is a pending runaway fault.

Optionally, the mail sending unit 2058 is further configured to:

The first processing unit 2059 is configured to:

Retaining an operating environment of the device under test when the suspended runaway fault occurs, and deleting the device under test from the test resource;

Executing the to-be-tested script on another available device under test;

The second processing unit 2056 is configured to:

Embodiment 3

When the device under test is used to suspend the detection system of the runaway fault, and the fault detection of the suspension runaway is performed, the same type or the same product to be tested is configured on multiple devices to be tested, that is, multiple threads are used for concurrent test. Device and load scripts on multiple devices under test.

Optionally, as shown in FIG. 4, the test plan and test resources are configured for the device under test, the test plan is parsed, the test time, the product to be tested, and the script to be tested are obtained. Further, it is determined whether the current time is the acquired test time. If not, the process continues; if yes, the storage path of the plurality of scripts to be tested is loaded. After the script is loaded, the product to be tested is deployed to the configured multiple devices under test according to the test resource, and an available device under test is obtained, and the available device under test is connected. After the connection is completed, one of the plurality of scripts to be tested is executed, and then it is judged whether the execution of the script is completed. If not, the execution of the script is waited for; if yes, the suspension run detection is performed.

If there is a pending runaway fault, a pending runaway fault log is generated, and then the socket service is started, and the key segment of the fault information is obtained from the fault log, and the corresponding fault responsible person email address is matched, and the fault detection is sent to the fault owner. The mail, then retains the operating environment of the device under test that has a pending runaway failure, and goes out of the test resource, and finally obtains the next available device under test to continue testing.

If the hang-up flight failure does not occur, execute the next test script on the device under test. After no test device is available or all the scripts are tested, the final test result can be output.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions. The foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing steps include the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. Within the scope of protection of the invention.

Industrial applicability

As described above, according to the above embodiment and the preferred embodiment, since the hang-up flight check function in the test operation is provided, the hang-up flight failure of the device under test can be found in advance, instead of merely generating the test success and failure according to the script return value. The result is manually viewed according to the log after the test is completed, and the device under test tested by the test script can be monitored in real time for a pending runaway failure. After obtaining the detection result, the output is timely, which achieves the effect of quickly notifying the fast-running and escaping flight failure, greatly delaying the fault location and solving the time point, improving the automation test efficiency, accelerating the product failure convergence speed, and providing timely release of the product. Better protection.

Claims

A method for detecting a running failure of a device under test, comprising:

Obtain test plans and test resources configured for the device under test;

Parsing the test plan to obtain test time, products to be tested, and scripts to be tested;

When the current time reaches the obtained test time, the hang-up flight fault detection is performed according to the product to be tested, the script to be tested, and the test resource, and the detection result is obtained.
The method of claim 1, wherein when the current time reaches the acquired test time, the hang-up flight fault detection is performed according to the product to be tested, the script to be tested, and the test resource, and the step of obtaining the detection result includes:

Loading a plurality of corresponding scripts to be tested according to the obtained product to be tested;

Deploying the product to be tested to the configured plurality of devices under test according to the test resource, and acquiring an available device under test, and connecting the available device under test;

Performing a test script to be tested on the available device under test;

After the test is completed, the test run log is generated, and the test device is hanged and the runaway fault detection is performed by the device under test, and the hanged runaway fault log is generated.
The method of claim 2, wherein the generating the pending runaway fault log further comprises:

Start the socket socket service;

When there is a pending runaway failure, the fault detection mail is sent to the fault owner through the socket socket service.
The method of claim 3, wherein when there is a pending runaway fault, the step of transmitting the fault detection mail to the fault owner via the socket socket service comprises:

Obtaining a key field of the fault information from the suspended runaway fault log, and matching the email address of the corresponding fault owner according to the key segment;

The fault detection mail is sent to the fault owner through the socket socket service.
The method of claim 3, wherein the step of transmitting the fault detection mail to the faulty person through the socket socket service after the step of suspending the runaway fault further comprises:

Retaining an operating environment of the device under test when a pending runaway failure occurs, and deleting the device under test from the test resource;

Obtaining another available device under test from the test resource, and connecting the device under test;

Executing the to-be-tested script on another available device under test;

After any of the to-be-tested scripts completes the test, the run-to-be-tested fault detection is performed on the to-be-tested product by another available device under test.
The method of claim 2, wherein the obtaining the pending runaway fault detection result further comprises:

When there is no pending runaway fault, another script to be tested is executed on the device under test;

After the test to be tested completes the test, the test device is suspended for running fault detection by the device under test.
A detecting device for suspending a running fault of a device under test, comprising:

Obtaining a module, configured to obtain a test plan and test resources configured for the device under test;

a parsing module configured to parse the test plan to obtain a test time, a product to be tested, and a script to be tested;

The fault detection module is configured to suspend the running fault detection according to the product to be tested, the script to be tested, and the test resource, and obtain the detection result when the current time reaches the obtained test time.
The apparatus of claim 7, wherein the fault detection module comprises:

a loading unit, configured to load a plurality of corresponding test scripts according to the obtained product to be tested;

a connecting unit, configured to deploy the product to be tested according to the test resource to the configured plurality of devices under test, and obtain an available device under test, and connect the available device under test;

An execution unit, configured to execute a script to be tested on the available device under test;

The obtaining unit is configured to generate a test running log after the test of the script to be tested is completed, and perform a pending runaway fault detection on the product to be tested by the device under test to generate a suspended running fault log.
The device of claim 8, wherein the fault detection module further comprises:

The boot unit is set to start the socket socket service;

The mail sending unit is configured to send a fault detection mail to the fault owner through the socket socket service when there is a pending runaway fault.
The apparatus of claim 9, wherein the mail transmitting unit is configured to:

Obtaining a key field of the fault information from the suspended runaway fault log, and matching the email address of the corresponding fault owner according to the key segment;

The fault detection mail is sent to the fault owner through the socket socket service.
The device of claim 9, wherein the fault detection module further comprises:

The first processing unit is set to:

Retaining an operating environment of the device under test when the suspended runaway fault occurs, and deleting the device under test from the test resource;

Obtaining another available device under test from the test resource, and connecting the device under test;

Executing the to-be-tested script on another available device under test;

After any of the to-be-tested scripts completes the test, the run-to-be-tested fault detection is performed on the to-be-tested product by another available device under test.
The device of claim 8, wherein the fault detection module further comprises:

The second processing unit is set to:

When there is no pending runaway fault, another script to be tested is executed on the device under test;

After the test to be tested completes the test, the test device is suspended for running fault detection by the device under test.
A detecting system for suspending a running fault of a device under test, comprising a plurality of products to be tested, a plurality of devices to be tested, and a detecting device for suspending a running fault of the device under test according to any one of claims 7 to 12. .