CN109388556B - Method and device for analyzing test process - Google Patents

Method and device for analyzing test process Download PDF

Info

Publication number
CN109388556B
CN109388556B CN201710686274.4A CN201710686274A CN109388556B CN 109388556 B CN109388556 B CN 109388556B CN 201710686274 A CN201710686274 A CN 201710686274A CN 109388556 B CN109388556 B CN 109388556B
Authority
CN
China
Prior art keywords
test
testing
video image
image
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710686274.4A
Other languages
Chinese (zh)
Other versions
CN109388556A (en
Inventor
任星旺
吴旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aisino Corp
Original Assignee
Aisino Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aisino Corp filed Critical Aisino Corp
Priority to CN201710686274.4A priority Critical patent/CN109388556B/en
Publication of CN109388556A publication Critical patent/CN109388556A/en
Application granted granted Critical
Publication of CN109388556B publication Critical patent/CN109388556B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3692Test management for test results analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items

Abstract

The application relates to the technical field of internet, in particular to an analysis method and device for a test process, which are used for solving the problem that the efficiency of analyzing and solving errors is low in the automatic test process in the prior art; the analysis method for the test process provided by the embodiment of the application comprises the following steps: when the testing machine receives the testing instruction, running at least one stored testing script to test the product to be tested; recording and storing a video image of the desktop of the testing machine when the at least one testing script runs; and analyzing the error generated by the at least one test script in the test process based on the video image, so that the video image of the desktop of the test machine when the test script runs is recorded in the test process, and the error generated by the test script in the test process can be analyzed according to the recorded video image, so that the efficiency of analyzing and solving the error is higher.

Description

Method and device for analyzing test process
Technical Field
The present application relates to the field of internet technologies, and in particular, to a method and an apparatus for analyzing a test procedure.
Background
With the rapid development of internet technology, internet products are increasing day by day, and almost any internet product needs to be tested, so that automatic testing is carried out in order to save manpower and improve testing efficiency in the testing process.
The automatic test usually needs to run a large number of test scripts to test the product to be tested, because the workload of the automatic test is large and the test time is flexible, for example, the test is often needed at night in order to not affect the normal operation of the test product, the process of running the test scripts is not monitored manually, thus, for errors generated in the test process, the test personnel is required to combine the test tool, the test scripts, log information, the process of running the test scripts and other factors to analyze and solve the errors after the test is finished, the process of running the test scripts among the factors can restore the most intuitive error scene for the test personnel, and is particularly important for the test personnel to rapidly analyze and solve the errors, but the test personnel needs to know the logic sequence of the test scripts at present and reason the running process of the test scripts, the technical requirements on testers are high, and the error solving efficiency is low.
Therefore, the automatic testing process in the prior art has the problem of low efficiency of analyzing and solving errors.
Disclosure of Invention
The embodiment of the application provides a method and a device for analyzing a test process, which are used for solving the problem that the efficiency of analyzing and solving errors is low in the automatic test process in the prior art.
The analysis method for the test process provided by the embodiment of the application comprises the following steps:
when the testing machine receives the testing instruction, running at least one stored testing script to test the product to be tested;
recording and storing a video image of the desktop of the testing machine when the at least one testing script runs;
analyzing errors generated by the at least one test script during the testing process based on the video image.
The analysis device of test process that this application embodiment provided includes:
the running module is used for running at least one stored test script to test the product to be tested when receiving the test instruction;
the recording module is used for recording and storing the video image of the desktop of the testing machine when the at least one test script runs;
an analysis module for analyzing errors generated by the at least one test script during the test process based on the video image.
The non-volatile computer storage medium provided by the embodiment of the application stores computer-executable instructions, and the computer-executable instructions are used for executing the flow of the analysis method of the test process.
The electronic device provided by the embodiment of the application comprises at least one processor and a memory which is in communication connection with the at least one processor; wherein:
the memory stores instructions executable by the at least one processor, which when executed by the at least one processor, cause the electronic device to perform the flow of the analysis method of the test procedure described above.
A computer program product provided by an embodiment of the present application includes a computer program stored on a non-transitory computer readable storage medium, the computer program including program instructions, wherein the program instructions, when executed by a computer, cause the computer to execute the flow of the analysis method of the test process.
In the embodiment of the application, when the test machine receives the test instruction, the at least one stored test script is operated to test a product to be tested, the video image of the desktop of the test machine when the test script is operated is recorded and stored in the test process, and then the error generated by the test script in the test process is analyzed based on the recorded video image.
Drawings
FIG. 1 is a flow chart of an analysis method of a test process provided by an embodiment of the present application;
FIG. 2 is a flow chart of an analysis method of another test process provided by an embodiment of the present application;
FIG. 3 is a block diagram of an analysis device for testing process according to an embodiment of the present disclosure;
fig. 4 is a schematic hardware structure diagram of an electronic device for implementing an analysis method of a test process according to an embodiment of the present application.
Detailed Description
In the embodiment of the application, when the test machine receives the test instruction, the at least one stored test script is operated to test a product to be tested, the video image of the desktop of the test machine when the test script is operated is recorded and stored in the test process, and then the error generated by the test script in the test process is analyzed based on the recorded video image.
The embodiments of the present application will be described in further detail with reference to the drawings attached hereto.
Example one
As shown in fig. 1, a flowchart of an analysis method of a test process provided in the embodiment of the present application includes the following steps:
s101: and when the testing machine receives the testing instruction, running at least one stored testing script to test the product to be tested.
In practical application, a plurality of sets of test flows can be pre-stored in the test machine, and each set of test flow comprises a large number of test scripts, so that when the test machine receives a test instruction, at least one test script corresponding to the test flow can be found according to the identification information of the test flow contained in the test instruction, and then the test scripts are operated to test a product to be tested.
S102: and recording and storing the video image of the desktop of the testing machine when the at least one testing script runs.
In the specific implementation process, for each test script, a video image of the desktop of the testing machine in the process of running the test script is recorded, and the video image corresponding to the test script is named and stored according to the time information of running the test script and the name of the test script.
For example, after the test1 ends, a test script test1 may name and store the video image of the desktop of the testing machine recorded in test1 in "test 1+ time when recording starts," in a format such as avi format.
Optionally, for each test script, the video image of the desktop of the testing machine may be recorded and stored during the process of running the test script, or may be stored after the video image corresponding to the test script is recorded, which is not limited herein.
S103: analyzing errors generated by the at least one test script during the testing process based on the recorded video image.
In a specific implementation process, if an error occurs in a test process, the test machine may receive error reporting information, then the test machine may obtain at least two frames of video images within a preset time period before a time point at which the error occurs from stored video images of a desktop of the test machine, then match the obtained at least two frames of video images with video images in a pre-stored image library, and if a video image matched with a certain frame of video image in the video library exists in the at least two frames of video images, may determine and store a cause of the error occurrence according to a pre-established correspondence between the video image and the cause of the error.
Optionally, after the cause of the error is analyzed, the testing machine may further process the error generated in the testing process according to a matching image, where any pair of matching images includes one of the at least two frames of video images and a video image corresponding to the video image in the video library.
For example, for any pair of matching images, if it is determined that the matching image in the image library is an image in which a browser is opened to a product to be tested and is dead, extracting a page link included in the matching image for the matching image in the at least two frames of video images, and then re-opening the page in which the browser is dead according to the page link, so that the testing process can be continued conveniently; if it is determined that the matching image in the image library is the desktop image of the testing machine before the testing of the testing machine, which indicates that the flow of the testing process is abnormally interrupted, the testing flow of the product to be tested can be restarted, for example, the testing flow can be restarted from the last completely executed testing script.
In the above process, before the tester processes the error, it may be determined that consecutive N frames of video images in the at least two frames of video images are matched with a frame of video image in the video library, at this time, the N frames of video images are all matched images, one frame of matched image may be selected from the N frames of video images, and then the error generated at this time is processed according to the matched image and the matched image in the image library, where if the at least two frames of video images are M frames of video images, N is less than or equal to M, and when N is less than M, the N frames of video images are N frames of video images close to the error time point in the M frames of video images, where M is a natural number greater than 1.
Optionally, for some types of errors in the test process, such as user login failure, database connection failure, and the like, the currently stored video image may be periodically extracted, the text information included in the video image is extracted for each extracted frame of video image, and if the text information includes preset keyword information, the video image and the time information when the video image is recorded are stored and presented to the tester.
For example, if the preset keyword information is user login failure, database connection timeout, and the like, and the text information extracted from a certain frame of video image is database connection timeout, it can be determined that a problem exists when the test machine is connected with the database in the test process, at this time, the test machine can store the video image and the time information when the video image is recorded, and then send the video image and the time information to the test staff in the form of a mail, so that the test staff can quickly determine the problem in the test process according to the information, and further optimize the test flow.
In addition, in order to save the storage space of the testing machine, after the video image of the desktop of the testing machine when each test script runs is recorded and stored, the running passing rate of each test script can be determined, and the video image corresponding to the test script with the running passing rate greater than or equal to the preset threshold value is deleted.
For example, if the test script does not report an error in the running process, the running passing rate of the test script may be determined to be 100%, otherwise, the running passing rate of the test script may be set to 0 (or the running passing rate may be determined according to the test progress of the test script), and then, the video image corresponding to the test script with the running passing rate of 100% may be deleted.
In the embodiment of the application, video images of the desktop of the testing machine in the running process of each testing script are recorded, and for some error types, such as browser page jamming, abnormal exit of the testing process and the like, the error reasons can be analyzed according to the recorded video images in the testing process and processed, so that the normal running of the testing process is ensured; for other errors, such as user login failure, excessive database connection and the like, when the error reasons are analyzed according to the recorded video images, the information can be stored and also can be sent to a tester, so that the subsequent tester can quickly search out specific error reasons according to the information and the video images corresponding to the test scripts executed during the errors, and then the test process is optimized.
In the embodiment of the application, when the test machine receives the test instruction, the at least one stored test script is operated to test a product to be tested, the video image of the desktop of the test machine when the test script is operated is recorded and stored in the test process, and then the error generated by the test script in the test process is analyzed based on the recorded video image.
Example two
As shown in fig. 2, a flowchart of an analysis method of another test procedure provided in the embodiment of the present application includes the following steps:
s201: and initializing video parameters when receiving the test instruction.
The video parameters include the storage location of the video image, the number of image frames recorded per second, the recording area in the desktop of the testing machine, and the like.
S202: and running the test scripts one by one according to the execution sequence of the test scripts.
S203: and recording and storing a video image of the desktop of the testing machine in the running process of each testing script, and analyzing errors generated by the testing scripts in the testing process.
The recorded and stored video image also comprises a motion track of the mouse and clicking actions of a left button and a right button of the mouse, so that a tester can better check the steps omitted in the test process.
In a specific implementation process, the tester can store errors occurring in the test process into an error log, rollback a video image for a period of time (for example, 20s), and store timestamp information of the error time and the 20s before the error time into an automatic report, so that a subsequent tester can quickly find a video segment related to the errors according to the information during playback. Meanwhile, the testing machine can also compare the video images (at least two frames of video images) captured 20s before the error with the preset video images, and analyze the error reason according to the comparison result.
Optionally, if a certain link in the page cannot be opened, a certain button in the page is clicked, no response is made, or the test machine fails to connect to the database for query, the test machine may preliminarily determine that an error is generated but a specific error type cannot be confirmed, at this time, the test machine may capture a video image 20s before the error, assume that 2 frames of video images are captured, if the 2 frames of video images are images of an IE browser opening web page, it may be determined that the product to be tested is jammed when the browser is opened, the error is due to a web server fault or a network fault of the test machine, at this time, any one frame of video image may be selected from the 2 frames of video images, the page link included in the video image is extracted, and then a page jammed by the browser is reopened according to the page link, so as to perform subsequent tests.
Optionally, if the start of the IE browser fails in the test process, the test machine may report an error that the IE browser cannot be started for performing the automated test, at this time, the test machine may capture a video image 20s before the error, assuming that 2 frames of video images are captured, if the 2 frames of video images are all desktop images of the pre-test machine captured in advance, it is determined that the test flow exits abnormally, and at this time, the test flow may be restarted.
In addition, for other types of errors in the test process, such as errors of user login failure, database connection failure and the like, the currently stored video image can be periodically extracted, the text information contained in the video image is extracted for each extracted frame of video image, and if the text information contains preset keyword information, the video image and the time information when the video image is recorded are stored in a test report, so that a subsequent tester can conveniently and quickly analyze the reason of the error.
Optionally, after the running of each test script file is finished, the video image corresponding to the test script is saved in a specified path, the file name is a combination of the name of the test script and the recording start time, and the saving format of the video is avi.
S204: and after the test is finished, deleting the video image corresponding to the test script with the running passing rate of 100%.
In a specific implementation process, after all the test scripts are run, the video image corresponding to the test script with the passing rate of 100% can be deleted, or the running passing rate of each test script can be determined after the test script is run, and if the running passing rate of the test script is 100%, the video image corresponding to the test script is deleted.
According to the method provided by the embodiment of the application, the function of recording videos is integrated into a testing machine, in the testing process, video images of a desktop of the testing machine are automatically recorded according to a testing script loaded by the testing machine, the video images comprise mouse tracks and left/right mouse click tracks, the recorded video images are analyzed by using an image processing algorithm, the video images within a period of error are analyzed according to error logs of an automatic execution report, the error reasons are simply analyzed, time stamp information in the error is intercepted and stored in the automatic execution report for subsequent testing personnel to review in a playback mode, and a good help effect is achieved for the auxiliary analysis of subsequent automatic results.
EXAMPLE III
Based on the same inventive concept, the embodiment of the present application further provides a device for analyzing a test process corresponding to the method for analyzing a test process, and because the principle of solving the problem of the device is similar to that of the method for analyzing a test process in the embodiment of the present application, the implementation of the device can refer to the implementation of the method, and repeated details are not repeated.
As shown in fig. 3, the structure diagram of the analysis apparatus for the test process provided in the embodiment of the present application includes:
the running module 301 is configured to run at least one stored test script to test a product to be tested when the test instruction is received;
a recording module 302, configured to record and store a video image of the desktop of the testing machine when the at least one test script is run;
an analyzing module 303, configured to analyze, based on the video image, an error generated by the at least one test script during the test.
Optionally, the analysis module 303 is specifically configured to:
if an error is generated in the testing process, acquiring at least two frames of video images within a preset time period before the time point of generating the error from the stored video images of the desktop of the testing machine;
matching the at least two frames of video images with video images in a pre-stored image library;
and analyzing and saving the reason of the error according to the matching image.
Further comprising: a processing module 304 for:
for any pair of matched images, if the matched images in the image library are determined to be images of a product to be tested which is stuck by a browser opened, extracting page links contained in the matched images from the at least two frames of video images; re-opening the dead browser page according to the page link so as to carry out subsequent testing;
and restarting the test flow for the product to be tested if the matched image in the image library is determined to be the desktop image of the testing machine before the testing of the testing machine.
Optionally, the analysis module 303 is specifically configured to:
periodically extracting currently stored video images of the desktop of the testing machine;
for each extracted frame of video image, extracting character information contained in the video image;
and if the text information contains preset keyword information, storing the video image and time information when the video image is recorded.
Optionally, for each test script, recording and storing a video image of the desktop of the testing machine in the process of running the test script; further comprising: a deletion module 305 to:
after recording and storing a video image of a desktop of the testing machine when the at least one testing script runs, determining the running passing rate of each testing script in the at least one testing script;
and deleting the video image corresponding to the test script with the running passing rate larger than or equal to the preset threshold value.
Example four
Embodiments of the present application provide a non-volatile computer storage medium, where a computer-executable instruction is stored, and the computer-executable instruction may execute an analysis method of a test process in any of the above method embodiments.
EXAMPLE five
Fig. 4 is a schematic diagram of a hardware structure of an electronic device for implementing an analysis method of a test procedure according to a fourth embodiment of the present invention, and as shown in fig. 4, the electronic device includes:
one or more processors 410 and a memory 420, with one processor 410 being an example in fig. 4.
The electronic device performing the analysis method of the test procedure may further include: an input device 430 and an output device 440.
The processor 410, the memory 420, the input device 430, and the output device 440 may be connected by a bus or other means, such as the bus connection in fig. 4.
The memory 420 is a non-volatile computer-readable storage medium, and can be used for storing non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules/units corresponding to the analysis method of the test procedure in the embodiment of the present application (for example, the running module 301, the recording module 302, and the analysis module 303 shown in fig. 3). The processor 410 executes various functional applications and data processing of the server or the smart terminal, i.e., an analysis method for implementing the test process of the above-described method embodiment, by executing the nonvolatile software program, instructions and modules/units stored in the memory 420.
The memory 420 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of an analysis device of a test procedure, or the like. Further, the memory 420 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 420 may optionally include memory located remotely from processor 410, which may be connected to the analysis device of the test procedure over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 430 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the analysis device of the test procedure. The output device 440 may include a display device such as a display screen.
The one or more modules are stored in the memory 420 and, when executed by the one or more processors 410, perform the analysis method of the test procedure in any of the method embodiments described above.
The product can execute the analysis method of the test process provided by the embodiment of the application, has the corresponding functional modules and beneficial effects of the analysis method of the test process, and the technical details which are not described in detail in the embodiment can be referred to the analysis method of the test process provided by the embodiment of the application.
The electronic device of the embodiments of the present application exists in various forms, including but not limited to:
(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.
(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.
(3) A portable entertainment device: such devices can display and play multimedia content. This type of device comprises: audio, video players (e.g., ipods), handheld game consoles, electronic books, and smart toys and portable car navigation devices.
(4) A server: the device for providing the computing service comprises a processor, a hard disk, a memory, a system bus and the like, and the server is similar to a general computer architecture, but has higher requirements on processing capacity, stability, reliability, safety, expandability, manageability and the like because of the need of providing high-reliability service.
(5) And other electronic devices with data interaction functions.
EXAMPLE six
The present application provides a computer program product, wherein the computer program product comprises a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, wherein the program instructions, when executed by a computer, cause the computer to perform the method of analyzing a test procedure of any one of the above method embodiments of the present application.
The analysis device for the test process provided by the embodiment of the application can be realized by a computer program. It should be understood by those skilled in the art that the above-mentioned module division is only one of many module division, and if the module division is divided into other modules or not, it should be within the scope of the present application as long as the analysis device of the test process has the above-mentioned functions.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (10)

1. A method of analyzing a test procedure, comprising:
when the testing machine receives the testing instruction, running at least one stored testing script to test the product to be tested;
recording and storing a video image of the desktop of the testing machine when the at least one testing script runs;
analyzing errors generated by the at least one test script during a test process based on the video image;
analyzing errors generated by the at least one test script during testing based on the video image, including:
if an error is generated in the testing process, acquiring at least two frames of video images within a preset time period before the time point of generating the error from the stored video images of the desktop of the testing machine;
matching the at least two frames of video images with video images in a pre-stored image library;
and analyzing and saving the reason of the error according to the matching image.
2. The method of claim 1, further comprising:
for any pair of matched images, if the matched images in the image library are determined to be images of a product to be tested which is stuck by a browser opened, extracting page links contained in the matched images from the at least two frames of video images; re-opening the dead browser page according to the page link so as to carry out subsequent testing;
and restarting the test flow for the product to be tested if the matched image in the image library is determined to be the desktop image of the testing machine before the testing of the testing machine.
3. The method of claim 1, wherein analyzing errors generated by the at least one test script during testing based on the video image comprises:
periodically extracting currently stored video images of the desktop of the testing machine;
for each extracted frame of video image, extracting character information contained in the video image;
and if the text information contains preset keyword information, storing the video image and time information when the video image is recorded.
4. The method of any of claims 1 to 3, wherein for each test script, recording and storing a video image of the tester desktop during running of the test script, and after recording and storing the video image of the tester desktop while running the at least one test script, further comprising:
determining the running passing rate of each test script in the at least one test script;
and deleting the video image corresponding to the test script with the running passing rate larger than or equal to the preset threshold value.
5. An apparatus for analyzing a test procedure, comprising:
the running module is used for running at least one stored test script to test the product to be tested when receiving the test instruction;
the recording module is used for recording and storing the video image of the desktop of the testing machine when the at least one test script runs;
an analysis module for analyzing errors generated by the at least one test script during a test process based on the video image;
the analysis module is specifically used for acquiring at least two frames of video images within a preset time period before a time point of generating an error from the stored video images of the desktop of the testing machine if the error is generated in the testing process; matching the at least two frames of video images with video images in a pre-stored image library; and analyzing and saving the reason of the error according to the matching image.
6. The apparatus of claim 5, further comprising: a processing module to:
for any pair of matched images, if the matched images in the image library are determined to be images of a product to be tested which is stuck by a browser opened, extracting page links contained in the matched images from the at least two frames of video images; re-opening the dead browser page according to the page link so as to carry out subsequent testing;
and restarting the test flow for the product to be tested if the matched image in the image library is determined to be the desktop image of the testing machine before the testing of the testing machine.
7. The apparatus of claim 5, wherein the analysis module is specifically configured to:
periodically extracting currently stored video images of the desktop of the testing machine;
for each extracted frame of video image, extracting character information contained in the video image;
and if the text information contains preset keyword information, storing the video image and time information when the video image is recorded.
8. The apparatus according to any one of claims 5 to 7, wherein, for each test script, a video image of the desktop of the testing machine during the running of the test script is recorded and saved; further comprising: a deletion module to:
after recording and storing a video image of a desktop of the testing machine when the at least one testing script runs, determining the running passing rate of each testing script in the at least one testing script;
and deleting the video image corresponding to the test script with the running passing rate larger than or equal to the preset threshold value.
9. A non-transitory computer storage medium storing computer-executable instructions for performing the method of any one of claims 1 to 4.
10. An electronic device comprising at least one processor, and a memory communicatively coupled to the at least one processor; wherein:
the memory stores instructions executable by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform the method of any of claims 1-4.
CN201710686274.4A 2017-08-11 2017-08-11 Method and device for analyzing test process Active CN109388556B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710686274.4A CN109388556B (en) 2017-08-11 2017-08-11 Method and device for analyzing test process

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710686274.4A CN109388556B (en) 2017-08-11 2017-08-11 Method and device for analyzing test process

Publications (2)

Publication Number Publication Date
CN109388556A CN109388556A (en) 2019-02-26
CN109388556B true CN109388556B (en) 2022-03-04

Family

ID=65415518

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710686274.4A Active CN109388556B (en) 2017-08-11 2017-08-11 Method and device for analyzing test process

Country Status (1)

Country Link
CN (1) CN109388556B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110569184B (en) * 2019-07-31 2023-06-16 重庆小雨点小额贷款有限公司 Test method and terminal equipment
CN110727446A (en) * 2019-09-25 2020-01-24 光通天下网络科技股份有限公司 Automatic deployment method, device, equipment and medium
CN110895509B (en) * 2019-11-15 2023-04-18 泰康保险集团股份有限公司 Test processing method and device, electronic equipment and storage medium
CN111026667B (en) * 2019-12-09 2023-05-05 北京乐学帮网络技术有限公司 Script execution method and device and electronic equipment
CN111694757B (en) * 2020-08-04 2023-05-30 抖音视界有限公司 Application program testing method and device, electronic equipment and computer readable storage medium
CN113434406B (en) * 2021-06-24 2023-06-16 青岛海尔科技有限公司 Function test method and device, storage medium and electronic equipment
CN114153726A (en) * 2021-11-25 2022-03-08 麒麟软件有限公司 Login test method and device based on linux desktop operating system
CN114662886B (en) * 2022-03-15 2023-09-19 江苏欧软信息科技有限公司 Cloud service system based on industrial Internet platform

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102439981A (en) * 2009-05-22 2012-05-02 S3研究与发展有限公司 A test system for a set-top box
CN103974061A (en) * 2014-05-27 2014-08-06 合一网络技术(北京)有限公司 Play test method and system
CN106445813A (en) * 2016-08-31 2017-02-22 福建联迪商用设备有限公司 Method and system for simulation automated testing of image algorithm
CN106528420A (en) * 2016-11-07 2017-03-22 中国工商银行股份有限公司 Automatic test method and device for software interface

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7844861B2 (en) * 2006-11-27 2010-11-30 Red Hat, Inc. Automatic generation of test cases from error data
US8140578B2 (en) * 2008-07-15 2012-03-20 International Business Machines Corporation Multilevel hierarchical associations between entities in a knowledge system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102439981A (en) * 2009-05-22 2012-05-02 S3研究与发展有限公司 A test system for a set-top box
CN103974061A (en) * 2014-05-27 2014-08-06 合一网络技术(北京)有限公司 Play test method and system
CN106445813A (en) * 2016-08-31 2017-02-22 福建联迪商用设备有限公司 Method and system for simulation automated testing of image algorithm
CN106528420A (en) * 2016-11-07 2017-03-22 中国工商银行股份有限公司 Automatic test method and device for software interface

Also Published As

Publication number Publication date
CN109388556A (en) 2019-02-26

Similar Documents

Publication Publication Date Title
CN109388556B (en) Method and device for analyzing test process
CN106202453B (en) Multimedia resource recommendation method and device
US10013329B2 (en) Dynamic tracing using ranking and rating
KR101881804B1 (en) Method and apparatus for automating game test
US8839203B2 (en) Code coverage-based taint perimeter detection
WO2018120721A1 (en) Method and system for testing user interface, electronic device, and computer readable storage medium
US10241897B2 (en) Identifying test gaps using code execution paths
US9703690B2 (en) Determining test case efficiency
CN107992415B (en) Fault positioning and analyzing method of transaction system and related server
CN104391765A (en) Method for automatically diagnosing boot failure of server
CN108241580B (en) Client program testing method and terminal
US20140365833A1 (en) Capturing trace information using annotated trace output
CN107590042A (en) A kind of server method for testing open/close machine and system based on linux system
CN105512562B (en) Vulnerability mining method and device and electronic equipment
CN109408361A (en) Monkey tests restored method, device, electronic equipment and computer readable storage medium
CN113590454A (en) Test method, test device, computer equipment and storage medium
CN115629968A (en) Test data recording method and device
CN110597704B (en) Pressure test method, device, server and medium for application program
US11604724B2 (en) Software application component testing
CN112507265A (en) Method and device for anomaly detection based on tree structure and related products
CN112434178A (en) Image classification method and device, electronic equipment and storage medium
CN110602483A (en) Video fault determination method, device and computer readable storage medium
CN113382268B (en) Live broadcast anomaly analysis method, live broadcast anomaly analysis device, computer equipment and storage medium
CN115700549A (en) Model training method, failure determination method, electronic device, and program product
KR20220091897A (en) Method and apparatus for analyzing pattern-based interaction failures in systems-of-systems

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant