CN115269443A - Software defect automatic positioning test method and system - Google Patents
Software defect automatic positioning test method and system Download PDFInfo
- Publication number
- CN115269443A CN115269443A CN202211197631.8A CN202211197631A CN115269443A CN 115269443 A CN115269443 A CN 115269443A CN 202211197631 A CN202211197631 A CN 202211197631A CN 115269443 A CN115269443 A CN 115269443A
- Authority
- CN
- China
- Prior art keywords
- test
- defect
- information
- software
- execution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000007547 defect Effects 0.000 title claims abstract description 257
- 238000010998 test method Methods 0.000 title claims abstract description 10
- 238000012360 testing method Methods 0.000 claims abstract description 260
- 238000000034 method Methods 0.000 claims abstract description 134
- 238000012544 monitoring process Methods 0.000 claims abstract description 79
- 238000013515 script Methods 0.000 claims abstract description 36
- 230000008569 process Effects 0.000 claims abstract description 31
- 238000012423 maintenance Methods 0.000 claims abstract description 11
- 230000008859 change Effects 0.000 claims abstract description 7
- 239000003795 chemical substances by application Substances 0.000 claims description 9
- 229910001316 Ag alloy Inorganic materials 0.000 claims description 2
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 claims description 2
- 238000007726 management method Methods 0.000 description 58
- 230000000875 corresponding effect Effects 0.000 description 14
- 238000013024 troubleshooting Methods 0.000 description 6
- 230000001276 controlling effect Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- FAPWRFPIFSIZLT-UHFFFAOYSA-M Sodium chloride Chemical compound [Na+].[Cl-] FAPWRFPIFSIZLT-UHFFFAOYSA-M 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000011835 investigation Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 239000011780 sodium chloride Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/3636—Software debugging by tracing the execution of the program
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/3644—Software debugging by instrumenting at runtime
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/366—Software debugging using diagnostics
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a software defect automatic positioning test method and a system, comprising the following steps: running software to be tested; monitoring and managing defects, namely acquiring running information and link calling information of software codes when the defects occur; analyzing codes, and acquiring maintainer information of each code method in the current version and a code method updated relative to the previous version; obtaining a test case, and selecting and obtaining the test case from a case library; automatic test management, compiling, debugging and running an automatic script, and configuring the script and the test case in an associated manner; managing a test plan, executing the test plan, and collecting defect information in the test process; defect management, summarizing the generation, viewing and state change information of the defects, and generating a detailed defect report; sending the defect report to corresponding maintenance personnel; the method and the system can accelerate the software debugging progress.
Description
Technical Field
The invention relates to the technical field of software development, in particular to a method and a system for automatically positioning and testing software defects.
Background
In the test, when a tester finds a defect, the operation condition of a code inside the software cannot be described usually, so that the validity of the submitted defect information is insufficient, the developer is inconvenient to be helped to directly position the problem code range, and the developer generally needs to execute a case again to reproduce the defect so as to position the problem code, so that the software debugging time is prolonged; especially for accidental defects, if the running information of related defect codes is not recorded during initial discovery, the running information can be difficult to reproduce subsequently, and the potential risk of software is further increased.
Disclosure of Invention
Therefore, it is necessary to provide a method and a system for testing software defects by automatic localization, which can accelerate the software debugging progress.
In one aspect, an embodiment of the present invention provides a method for automatically positioning and testing software defects, including the following steps:
running software to be tested;
monitoring and managing defects, namely acquiring running information and link calling information of software codes when the defects occur;
analyzing codes, and acquiring maintainer information of each code method in the current version and a code method updated relative to the previous version;
obtaining a test case, and selecting and obtaining the test case from a case library;
automatic test management, compiling, debugging and running an automatic script, and configuring the script and the test case in an associated manner;
managing a test plan, executing the test plan, and collecting defect information in the test process;
defect management, collecting the generation, viewing and state change information of the defect, and generating a detailed defect report;
and sending the defect report to corresponding maintenance personnel.
Preferably, before the software to be tested is run, the following steps are also required:
newly building a test case and a script;
adding a test plan;
and deploying a monitoring tool.
Preferably, the defect monitoring management is to acquire the running information and the link calling information of the software code when a defect occurs, and specifically includes:
before the software to be tested is started, an APM monitoring module agent is deployed on each container/host operated by a software system, monitoring parameter configuration is completed, and monitoring service is started;
when the software to be tested is started, parameters are added in a starting instruction, and a monitoring module is called to carry out instrumentation on the code so as to obtain dynamic running information of the code;
after the software to be tested is started, monitoring the link calling information of the software system through agents of the monitoring modules on the nodes.
Preferably, the code analysis is carried out, so that the information of maintenance personnel of each code method in the current version and the code method updated relative to the previous version are obtained; the method specifically comprises the following steps:
analyzing codes of historical versions of the code warehouse software and information of submitters, and tracking life cycles of all the methods, so as to obtain maintainers of each code method in the current version to be tested; and analyzing the code method with the updated current version and the updated previous version, and if the method appears in the defect positioning information, the method is considered to be the code method with the highest association degree with the defect, and the method can perform key marking in the defect information.
Preferably, the test cases are obtained, and the test cases can be obtained manually or automatically when being selected and obtained from the case base.
Preferably, the test management is automated, an automated script is compiled, debugged and operated, and the script and the test case are configured in a correlated manner; the method specifically comprises the following steps:
and providing a foreground page for a tester to maintain an automatic test script, performing multi-level management on projects, kits and cases, testing the execution mode of the script, and supporting the execution of a remote server and the local execution.
Preferably, managing a test plan, executing the test plan, and collecting defect information in the test process; the method specifically comprises the following steps:
controlling the execution of a group of test cases, wherein a module provides a foreground page for a tester to maintain a test plan, automatically loading an optional test case list from a case library when the test plan is newly built, adding the optional test case list in a single or batch selection mode, and specifying execution time, an execution mode and additional parameters for executing result notification;
in the test plan execution process, if the test case fails to be executed, determining that a defect exists;
and after the execution of the case is finished, acquiring the monitoring positioning information corresponding to the case, storing the monitoring positioning information in a test result, and executing a subsequent test plan after the execution is finished.
Preferably, the defect monitoring management is executed by the monitoring module, and the starting time and the ending time of each case test are notified to the monitoring module for triggering the monitoring slicing function and segmenting the monitoring positioning information according to the case execution process.
Preferably, the method comprises the steps of managing the defects, summarizing generation, viewing and state change information of the defects, identifying the information with the code method maintainer and the method with the highest correlation degree with the defects, and generating a detailed defect report so that the defects can be quickly matched with developers responsible for solving the defects; in particular to a method for preparing a high-performance nano-silver alloy,
after the execution of the test plan is finished, automatically summarizing and acquiring the execution data of the failure case in the test;
firstly, extracting test execution data from the execution data to generate defect description information;
then extracting defect location data from the execution data;
and finally, combining the defect description information and the processed defect positioning information into a complete defect record.
Preferably, the test execution data generating defect description information comprises preset conditions, test steps, test results and test screenshots;
the positioning data comprises defect related code operation data and internal and external node calling data on a link;
when the defect records in the test plan are completely processed, the execution result of the test plan and the defect records are automatically pushed to a tester, and each defect record is independently pushed to a developer related to the defect code.
The invention also provides a software defect automatic positioning test system, which comprises an APM monitoring module, a code analysis module, a test case management module, an automatic test management module, a test plan management module and a defect management module;
the APM monitoring module is used for acquiring the running information and the link calling information of the software codes when the defects occur;
the code analysis module is used for obtaining the maintainer information of each code method in the current version and the code method updated relative to the previous version;
the test case management module is used for uploading, compiling, modifying and inquiring test cases, and the case types support manual and automatic operation;
the automatic test management module is used for compiling, debugging and running an automatic script and the associated configuration of the script and the cases in the test case management module;
the test plan management module is used for creating, executing, suspending and deleting a test plan and selecting a case from the test case management module; in the test plan execution process, once defects are found, an APM module can be automatically called to trigger information collection operation;
the defect management module is used for automatically generating, checking and changing the state of the test defects, and after the execution of the test plan is finished, the defect management module can automatically collect the conventional description information and APM monitoring and positioning information of the defects, identify the code method maintainer in the positioning information and the method with the highest defect association degree, and generate a detailed defect report;
and sending the defect report to corresponding maintenance personnel.
The automatic positioning test method and the automatic positioning test system for the software defects can automatically acquire positioning information such as code logic and operation data related to the defects, link node calling and the like after the testers find the defects, automatically associate and maintain developer information of the related codes, combine the information into defect records together, and automatically push the information to the relevant personnel for troubleshooting, thereby greatly improving the effectiveness of the defect information, not only quickly determining the developers corresponding to the defects, but also saving the process of re-executing the cases to reappear the defects, reducing the code troubleshooting range of the developers and remarkably accelerating the software debugging progress.
Drawings
The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular description of preferred embodiments of the invention, as illustrated in the accompanying drawings. Like reference numerals refer to like parts throughout the drawings, and the drawings are not intended to be drawn to scale in actual dimensions, emphasis instead being placed upon illustrating the principles of the invention.
FIG. 1 is a diagram illustrating an architecture of a software defect automatic positioning and testing system according to an embodiment of the present invention;
FIG. 2 is a flowchart of a software defect automatic positioning test method according to an embodiment of the present invention;
FIG. 3 is a detailed flow diagram of the execution of the test plan of FIG. 2;
fig. 4 is a detailed flowchart of defect information sorting and automatic positioning in fig. 2.
Detailed Description
The technical solutions of the present invention are further described in detail with reference to the drawings and specific embodiments so that those skilled in the art can better understand the present invention and can implement the present invention, but the embodiments are not limited to the present invention.
As shown in fig. 1 to 4, an embodiment of the invention provides a software defect automatic positioning test method, which includes the following steps:
referring to fig. 3, software to be tested is run;
monitoring and managing defects, namely acquiring running information and link calling information of software codes when the defects occur;
analyzing codes, and acquiring maintainer information of each code method in the current version and a code method updated relative to the previous version;
obtaining a test case, and selecting and obtaining the test case from a case library;
automatic test management, compiling, debugging and running an automatic script, and associating a configuration script with a test case;
managing a test plan, executing the test plan, and collecting defect information in the test process;
defect management, summarizing the generation, viewing and state change information of the defects, and generating a detailed defect report;
and sending the defect report to corresponding maintenance personnel.
In a preferred embodiment, the defect monitoring management, when a defect occurs, acquires the running information and the link calling information of the software code, specifically:
before the software to be tested is started, an APM monitoring module agent is deployed on each container/host operated by a software system, monitoring parameter configuration is completed, and monitoring service is started;
when the software to be tested is started, parameters are added in a starting instruction, and a monitoring module is called to carry out instrumentation on the code so as to obtain dynamic running information of the code;
after the software to be tested is started, monitoring the link calling information of the software system through agents of the monitoring modules on all the nodes.
Referring to fig. 2, in the preferred embodiment, before running the software to be tested, the following steps are also performed:
newly building a test case and a script;
adding a test plan;
and deploying the monitoring tool.
And then executing a test plan, sorting the defect information, automatically positioning the position of the defect information, and finally accurately pushing the defect record to a maintenance worker.
In a preferred embodiment, code analysis obtains maintainer information for each code method in the current version, as well as code methods that are updated relative to previous versions; the method comprises the following specific steps:
analyzing codes of historical versions of the code warehouse software and information of submitters, and tracking life cycles of all the methods, so as to obtain maintainers of each code method in the current version to be tested; and analyzing the code method with the current version and the previous version updated, and if the method appears in the defect positioning information, considering the code method with the highest association degree with the defect, and performing key marking in the defect information.
In the preferred embodiment, the test cases are obtained, and the test cases can be obtained manually or automatically when selected and obtained from the case library.
In the preferred embodiment, the test management is automated, the automation script is compiled, debugged and operated, and the configuration script and the test case are associated; the method specifically comprises the following steps:
and providing a foreground page for a tester to maintain an automatic test script, performing multi-level management on projects, kits and cases, testing the execution mode of the script, and supporting the execution of a remote server and the local execution.
In a preferred embodiment, the test plan is managed, the test plan is executed, and defect information is collected during the test process; the method specifically comprises the following steps:
controlling the execution of a group of test cases, wherein a module provides a foreground page for a tester to maintain a test plan, automatically loading an optional test case list from a case library when the test plan is newly established, adding the optional test case list in a single or batch selection mode, and specifying execution time, an execution mode and additional parameters for notifying execution results;
in the execution process of the test plan, if the execution of the test case fails, judging that a defect exists;
and after the execution of the case is finished, acquiring the monitoring positioning information corresponding to the case, storing the monitoring positioning information in a test result, and executing a subsequent test plan after the execution is finished.
In a preferred embodiment, the defect monitoring management is executed by a monitoring module, and the starting time and the ending time of each use case test are notified to the monitoring module for triggering the monitoring slicing function and segmenting the monitoring positioning information according to the use case execution process.
In the preferred embodiment, the defect management is used for summarizing the generation, viewing and state change information of the defects, identifying the information with code method maintainers and the method with the highest defect association degree and generating a detailed defect report so that the defects can be quickly matched with developers in charge of solving the defects; in particular to a method for preparing a high-purity sodium chloride solution,
after the execution of the test plan is finished, automatically summarizing and acquiring the execution data of the failure case in the test;
firstly, extracting test execution data from the execution data to generate defect description information;
then extracting defect location data from the execution data;
and finally merging the defect description information and the processed defect positioning information into a complete defect record.
In a preferred embodiment, the test execution data generation defect description information comprises preset conditions, test steps, test results and test screenshots;
the positioning data comprises defect related code operation data and internal and external node calling data on a link;
when the defect records in the test plan are completely processed, the execution result of the test plan and the defect records are automatically pushed to a tester, and each defect record is independently pushed to a developer related to the defect code.
Referring to fig. 1, the present invention further provides an automatic software defect positioning and testing system, which includes an APM monitoring module, a code analysis module, a test case management module, an automatic test management module, a test plan management module, and a defect management module;
the APM monitoring module is used for acquiring the running information and the link calling information of the software codes when the defects occur; the code running information comprises code logic, method calling, running data and the like; the link calling information comprises calling sequences of internal and external service interfaces, middleware and all nodes of the database on the link, data circulation information and the like, and supports graphical display. In the embodiment shown in fig. 1, an automatic positioning and testing device for software defects is provided, which can automatically acquire positioning information such as code logic and running data related to defects and link node calling during the test execution process of testers, automatically associate and maintain developer information of related codes, combine the information into defect records together, analyze and label the defect information, and automatically push the information to corresponding developers for troubleshooting, so that the effectiveness of the defect information is greatly improved, the process of re-executing cases to reproduce defects is omitted, the code troubleshooting range of the developers is reduced, labels of code information needing to be preferentially checked are given, and the software debugging progress can be remarkably accelerated.
The code analysis module is used for acquiring the information of maintenance personnel of each code method in the current version and the code method updated relative to the previous version;
the test case management module is used for uploading, compiling, modifying and inquiring test cases, and the case types support manual operation and automation;
the automatic test management module is used for compiling, debugging and running an automatic script and the associated configuration of the script and the cases in the test case management module;
the test plan management module is used for creating, executing, suspending and deleting a test plan and selecting a case from the test case management module; in the execution process of the test plan, once defects are found, the APM module can be automatically called to trigger information collection operation; the use cases in the test plan need to be selected from the test case management module, and the type of the use cases can be manual or automatic.
The defect management module is used for automatically generating, checking and changing the state of the test defects, and after the execution of the test plan is finished, the defect management module can automatically collect the conventional description information and the APM monitoring and positioning information of the defects, identify the code method maintainer in the positioning information and the method with the highest defect association degree, and generate a detailed defect report; therefore, the defects can be quickly matched with developers in charge of solving the problems, and the developers can quickly position and solve the problems according to the defect positioning information.
In a preferred embodiment, the APM monitoring module is further specifically implemented as: before the software to be tested is started, an APM monitoring module agent is deployed on each container/host machine operated by a software system, monitoring parameter configuration is completed, and monitoring service is started; when the software to be tested is started, parameters are added in a starting instruction, and a monitoring module is called to perform instrumentation on codes so as to obtain dynamic running information of the codes, wherein the running information comprises code logic, method calling, running data and the like; after the software to be tested is started, monitoring the calling information of the software system link through the agent of the monitoring module on each node, wherein the calling information comprises the calling sequence and data flow information of each node such as an internal and external service interface, a middleware and a database on the link. The monitoring module has a monitoring slicing function, can independently acquire and derive monitoring data in a certain period of time, and sets monitoring start time and end time according to external interaction information.
In a preferred embodiment, the code analysis module is further specifically implemented as: analyzing codes of historical versions of the code warehouse software and information of submitters, and tracking life cycles (creation, updating and deletion) of each method, so as to obtain maintainers of each code method in the current version to be tested, wherein the maintainers of the code method default to the latest updater of the method and are responsible for troubleshooting and positioning defects related to the method; and analyzing the code method with the current version and the previous version updated, and if the method appears in the defect positioning information, considering the code method with the highest association degree with the defect, and performing key marking in the defect information.
In a preferred embodiment, the implementation manner of the test case management module is further specifically as follows: the module provides a foreground page for a tester to maintain a test case, supports multi-level management of projects, kits and cases, supports batch operation, and has to be associated with an automatic test script in the automatic test management module for an automatic case.
In a preferred embodiment, the implementation manner of the automatic test management module is further specifically that: the module provides a foreground page for a tester to maintain an automatic test script, supports multi-level management of projects, kits and cases, supports batch operation, compiles the case script to support an online mode and a lead-in mode, and supports remote server execution and local execution of the automatic test script.
In a preferred embodiment, the implementation manner of the test plan management module is further specifically: the test plan is mainly used for controlling the execution of a group of test cases, a module provides a foreground page for a tester to maintain the test plan, when the test plan is newly built, an optional test case list is automatically loaded from a test case management module, and the optional test case list is added in a single or batch selection mode, and additional parameters such as execution time, an execution mode, execution result notification and the like can also be specified; the test plan needs to interact with an APM monitoring module in the execution process, and the start time and the end time of each case test are notified to the monitoring module for triggering the monitoring slice function and segmenting monitoring positioning information according to the case execution process; once the test case fails to be executed, the defect is judged to exist, after the execution of the case is finished, the monitoring positioning information corresponding to the case is automatically obtained and stored in the test result, and the subsequent test plan is executed after the monitoring positioning information is stored in the test result; for a manual test case, a tester needs to find the test case in a foreground test plan, manually clicks a test start button and a test end button according to an actual test progress, fills in a test case execution result (text description, screenshot and the like) to trigger interaction with an APM monitoring module, and for an automatic test case, the generation of the test result and the interaction process with the APM can be automatically completed without manual intervention.
In a preferred embodiment, the implementation manner of the defect management module is further specifically: after the execution of the test plan is finished, the defect management module can automatically collect and obtain the execution data of the failure case in the test; firstly, extracting test execution data such as preset conditions, test steps, test results, test screenshots and the like from the execution data to generate defect description information; then extracting defect positioning data from the execution data, wherein the positioning data comprises defect related code operation data and internal and external node calling data on a link, only processing the defect code operation data, calling a code analysis module to obtain maintainers (i.e. developers) of each code method of the version of the software to be tested and code methods updated compared with the previous version, matching developers for all methods related to the defect code operation data after comparing the data, performing key identification on the code methods and the operation data updated in the current version, and marking the codes with the highest defect association degree so as to facilitate the preferential investigation of the developers; and finally, merging the defect description information and the processed defect positioning information into 1 complete defect record, then referring to the process to process the next defect record, and when the defect records in the test plan are completely processed, automatically pushing the execution result of the test plan and the defect records to a tester, and independently pushing each defect record to a developer related to the defect code.
And sending the defect report to corresponding maintenance personnel.
In the embodiment shown in fig. 2, the overall workflow in the embodiment of the present invention is clearly and completely described, and the detailed steps are as follows:
step one, creating a test case and a script: creating a test case in a test case management module in an online editing or file uploading mode; for an automation case, an automation script needs to be newly established in an automation test management module through an online editing or file uploading mode, and then the test case is associated to the corresponding automation script in the test case management module.
Step two, adding a test plan: and (3) creating a test plan in the test plan management module, adding cases to the test plan in a single or batch selection mode from the test case management module, and setting additional parameters such as execution time, an execution mode, execution result notification and the like.
Step three, deploying a monitoring tool: deploying agent service of the APM monitoring module to each container/host machine operated by the software to be detected, completing monitoring parameter configuration, and starting monitoring service; completing the preparation of the version and the environment of the software to be tested, adding parameters in a starting instruction, and calling a monitoring module to acquire software running data after starting: dynamic running information of the code, such as code logic, method call, running data and the like; the software system link call information includes call sequence of internal and external service interfaces, middleware, database and other nodes on the link, data flow information and the like.
Step four, executing a test plan: for the automatic test case, after the execution of the test plan is started, all cases are automatically executed according to the setting, once the execution of the test case fails, the defect is judged to exist, and after the execution of the case is finished, the monitoring positioning information and the defect description information corresponding to the case are automatically acquired; for the manual use case, after the test plan starts, the test personnel is required to identify the use case execution information item by item according to the execution sequence: the method comprises the steps of selecting a test case to be executed, manually clicking a test starting button, manually testing according to testing steps, filling information such as a test result, a case execution state and a screenshot in the test finished state, manually clicking a test finishing button, storing the test result of the case, continuing testing of the next case, and automatically acquiring defect positioning information and defect description information by the device and storing the defect positioning information and the defect description information in the test result if a defect is found, namely the test result does not pass.
Fifthly, defect information arrangement and automatic positioning: after the execution of the test plan is finished, the defect management module automatically collects the defect information in the test, analyzes and processes the defect information and generates a final defect record; the tester can check the defect record on the foreground of the defect management module, and can also jump to the defect management module to check the defect record from the execution result of the corresponding test plan on the foreground of the test plan management module; the detailed information of the defect entry is: defect description information, such as preset conditions, test steps, test results, test screenshots; and defect positioning data, such as defect-related code operating data and link calling data, and maintainer information corresponding to the defect code, wherein the code with the highest defect association degree is marked with emphasis.
In the embodiment shown in fig. 3, a defect information sorting and automatic positioning method is provided. The method comprises the following concrete implementation steps:
after the test plan is executed, the defect management module automatically collects and acquires the execution data of the failure case in the test, and the execution data comprises conventional defect description information, test steps, results, screenshots and the like.
And the APM monitoring module acquires the link calling and code running information corresponding to the defect to form original defect positioning information.
And the code analysis module is used for analyzing historical version codes and determining developers of each method, the method for updating the version to be tested and the developers.
The defect management module automatically acquires a case execution result of the test plan management module to generate conventional defect description information, performs key identification on a code method with the highest defect association degree, and matches developers for each method to form final defect positioning information; and merging the defect description information and the positioning information to generate a complete defect record.
In the embodiment shown in fig. 4, an automatic and accurate defect record pushing method is provided, so that the efficiency of positioning defects of developers is improved. The method comprises the following concrete implementation steps:
the defect management module extracts test execution data such as preset conditions, test steps, test results, test screenshots and the like from the execution data to generate defect description information;
and extracting defect positioning data from the execution data, wherein the positioning data comprises defect related code operation data and internal and external node calling data on a link, calling a code analysis module to obtain maintainers (i.e. developers) of each code method of the version of the software to be tested and code methods updated compared with the previous version, matching developers for all methods related to the defect code operation data after comparing the data, performing key identification on the code methods and the operation data updated in the version, and marking the codes with the highest defect association degree so as to facilitate the developers to perform preferential investigation.
3. And merging the defect description information and the processed defect positioning information into 1 complete defect record, then referring to the process to process the next defect record, and automatically and accurately pushing the defect record to developers responsible for maintaining related defect codes for processing when the defect records in the test plan are completely processed.
The invention has the beneficial effects that:
1. accelerating the software debugging progress: software defect related codes can be automatically matched with starting personnel, so that the analysis and judgment process of the personnel to which the defects belong is omitted; the use case does not need to be executed for the second time, and the detailed information required by defect positioning can be directly obtained from the defects, so that the time for environment preparation, use case execution and data acquisition is saved; by monitoring slicing according to use cases, the minimization and the precision of the acquired defect positioning information are ensured, no other irrelevant use cases or redundant information generated by operation steps is generated, the defect troubleshooting range of developers is reduced, and codes with the highest defect association degree in the defect positioning information are subjected to key identification, so that the developers can preferentially recognize and process the codes, the defect positioning efficiency of the developers is improved, and the software debugging progress is greatly accelerated;
2. the software quality is improved: the method can record detailed positioning information when the defect is found for the first time, is beneficial to the confirmation of a developer to the defect, avoids the risk that the individual accidental defect is ignored by the developer because the accidental defect is difficult to reproduce, and effectively improves the software quality.
3. The applicable test scene is wide: the system supports manual testing and automatic testing, has no additional requirements on testing personnel, and can be used in various tests;
4. the interference to the test is small: in the using process of the device, the original test execution process is not interfered, the function use of the software is not influenced, and the accuracy of the test result is not influenced.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An automatic positioning test method for software defects is characterized by comprising the following steps:
running software to be tested;
monitoring and managing defects, namely acquiring running information and link calling information of software codes when the defects occur;
analyzing codes, and acquiring maintainer information of each code method in the current version and a code method updated relative to the previous version;
obtaining a test case, and selecting and obtaining the test case from a case library;
automatic test management, compiling, debugging and running an automatic script, and configuring the script and the test case in an associated manner;
managing a test plan, executing the test plan, and collecting defect information in the test process;
recording and summarizing defect information, summarizing generation, viewing and state change information of defects, and generating a detailed defect report;
and pushing the defect information, and sending the defect report to corresponding maintenance personnel.
2. The method for automatically positioning and testing the software defect as claimed in claim 1, wherein before the software to be tested is run, the following steps are required:
newly building a test case and a script;
adding a test plan;
and deploying a monitoring tool.
3. The method for automatic positioning and testing of software defects according to claim 1, wherein defect monitoring management, when a defect occurs, obtains the running information and the link calling information of the software code, specifically:
before the software to be tested is started, an APM monitoring module agent is deployed on each container/host operated by a software system, monitoring parameter configuration is completed, and monitoring service is started;
when the software to be tested is started, parameters are added into a starting instruction, and a monitoring module is called to perform instrumentation on the codes so as to obtain dynamic running information of the codes;
after the software to be tested is started, monitoring the link calling information of the software system through agents of the monitoring modules on the nodes.
4. The software defect automatic positioning test method of claim 1, characterized in that, the code analysis obtains the maintainer information of each code method in the current version and the code method updated relative to the previous version; the method specifically comprises the following steps:
analyzing codes of historical versions of the code warehouse software and information of submitters, and tracking life cycles of all the methods, so as to obtain maintainers of each code method in the current version to be tested; and analyzing the code method with the updated current version and the updated previous version, and if the method appears in the defect positioning information, the method is considered to be the code method with the highest association degree with the defect, and the method can perform key marking in the defect information.
5. The method as claimed in claim 1, wherein the test cases are obtained manually or automatically when the test cases are selected from the case library.
6. The method of claim 1, wherein automated test management, compiling, debugging and running automated scripts, and configuring the scripts and the test cases in association; the method specifically comprises the following steps:
and providing a foreground page for a tester to maintain an automatic test script, performing multi-level management on the project, the suite and the use case, testing the execution mode of the script, and supporting the execution of a remote server and the local execution.
7. The software defect automatic positioning test method of claim 1, characterized in that the test plan is managed, the test plan is executed, and the defect information is collected during the test process; the method specifically comprises the following steps:
controlling the execution of a group of test cases, wherein a module provides a foreground page for a tester to maintain a test plan, automatically loading an optional test case list from a case library when the test plan is newly built, adding the optional test case list in a single or batch selection mode, and specifying execution time, an execution mode and additional parameters for executing result notification;
in the test plan execution process, if the test case fails to be executed, determining that a defect exists;
and after the execution of the use case is finished, acquiring the monitoring positioning information corresponding to the use case, storing the monitoring positioning information in a test result, and executing a subsequent test plan after the execution is finished.
8. The method according to claim 1, wherein the method comprises managing defects, summarizing information on generation, viewing and state change of defects, identifying the information with the code method maintainer and the method with the highest association degree with the defects, and generating a detailed defect report, so that the defects can be quickly matched with developers in charge of solving the defects; in particular to a method for preparing a high-performance nano-silver alloy,
after the execution of the test plan is finished, automatically summarizing and acquiring the execution data of the failure case in the test;
firstly, extracting test execution data from execution data to generate defect description information;
then extracting defect location data from the execution data;
and finally merging the defect description information and the processed defect positioning information into a complete defect record.
9. The software defect automatic positioning test method of claim 8, wherein the test execution data generating defect description information comprises preset conditions, test steps, test results and test screenshots;
the positioning data comprises defect related code operation data and internal and external node calling data on a link;
when the defect records in the test plan are completely processed, the execution result of the test plan and the defect records are automatically pushed to a tester, and each defect record is independently pushed to a developer related to the defect code.
10. An automatic positioning test system for software defects is characterized by comprising an APM monitoring module, a code analysis module, a test case management module, an automatic test management module, a test plan management module and a defect management module;
the APM monitoring module is used for acquiring the running information and the link calling information of the software codes when the defects occur;
the code analysis module is used for acquiring the information of maintenance personnel of each code method in the current version and the code method updated relative to the previous version;
the test case management module is used for uploading, compiling, modifying and inquiring test cases, and the case types support manual and automatic operation;
the automatic test management module is used for compiling, debugging and running the automatic script and configuring the script and the case in the test case management module in a correlation manner;
the test plan management module is used for creating, executing, suspending and deleting a test plan and selecting a case from the test case management module; in the test plan execution process, once defects are found, an APM module can be automatically called to trigger information collection operation;
the defect management module is used for automatically generating, checking and changing the state of the test defects, and after the execution of the test plan is finished, the defect management module can automatically collect the conventional description information and the APM monitoring and positioning information of the defects, identify the code method maintainer in the positioning information and the method with the highest defect association degree, and generate a detailed defect report;
and sending the defect report to corresponding maintenance personnel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211197631.8A CN115269443A (en) | 2022-09-29 | 2022-09-29 | Software defect automatic positioning test method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211197631.8A CN115269443A (en) | 2022-09-29 | 2022-09-29 | Software defect automatic positioning test method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115269443A true CN115269443A (en) | 2022-11-01 |
Family
ID=83757261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211197631.8A Pending CN115269443A (en) | 2022-09-29 | 2022-09-29 | Software defect automatic positioning test method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115269443A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117890765A (en) * | 2024-01-17 | 2024-04-16 | 张家港莱荟科技有限公司 | Continuous integrated circuit testing system and testing method thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136798A (en) * | 2007-10-16 | 2008-03-05 | 中兴通讯股份有限公司 | Data configuration automatized test system and method |
| CN107015908A (en) * | 2017-03-31 | 2017-08-04 | 广州慧睿思通信息科技有限公司 | A kind of computer application software test system and method |
| CN110221962A (en) * | 2019-04-28 | 2019-09-10 | 福建省农村信用社联合社 | A kind of centralization software testing management system and method |
| CN111209206A (en) * | 2020-01-13 | 2020-05-29 | 卡斯柯信号(北京)有限公司 | Automatic test method and system for software product |
| CN112286806A (en) * | 2020-10-28 | 2021-01-29 | 成都佰维存储科技有限公司 | Automatic testing method and device, storage medium and electronic equipment |
| CN114116505A (en) * | 2021-12-02 | 2022-03-01 | 北京达佳互联信息技术有限公司 | Code testing method and device |
-
2022
- 2022-09-29 CN CN202211197631.8A patent/CN115269443A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136798A (en) * | 2007-10-16 | 2008-03-05 | 中兴通讯股份有限公司 | Data configuration automatized test system and method |
| CN107015908A (en) * | 2017-03-31 | 2017-08-04 | 广州慧睿思通信息科技有限公司 | A kind of computer application software test system and method |
| CN110221962A (en) * | 2019-04-28 | 2019-09-10 | 福建省农村信用社联合社 | A kind of centralization software testing management system and method |
| CN111209206A (en) * | 2020-01-13 | 2020-05-29 | 卡斯柯信号(北京)有限公司 | Automatic test method and system for software product |
| CN112286806A (en) * | 2020-10-28 | 2021-01-29 | 成都佰维存储科技有限公司 | Automatic testing method and device, storage medium and electronic equipment |
| CN114116505A (en) * | 2021-12-02 | 2022-03-01 | 北京达佳互联信息技术有限公司 | Code testing method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117890765A (en) * | 2024-01-17 | 2024-04-16 | 张家港莱荟科技有限公司 | Continuous integrated circuit testing system and testing method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6948152B2 (en) | Data structures for use with environment based data driven automated test engine for GUI applications | |
| US20030056150A1 (en) | Environment based data driven automated test engine for GUI applications | |
| US7526498B2 (en) | Method for generating data structures for automatically testing GUI applications | |
| US20110107307A1 (en) | Collecting Program Runtime Information | |
| US20130024847A1 (en) | Software test automation systems and methods | |
| US20040153837A1 (en) | Automated testing | |
| CN110058998B (en) | Software testing method and device | |
| CN103631713A (en) | ERP software automated testing system and method | |
| CN112650688B (en) | Automated regression testing method, associated device and computer program product | |
| CN113342685A (en) | Precise test method and device, computer equipment and storage medium | |
| CN111462811A (en) | Automatic testing method and device, storage medium and electronic equipment | |
| CN112131116A (en) | Automatic regression testing method for embedded software | |
| CN112069073A (en) | Test case management method, terminal and storage medium | |
| CN115269443A (en) | Software defect automatic positioning test method and system | |
| CN111597104A (en) | Multi-protocol adaptive interface regression testing method, system, equipment and medium | |
| CN110990289B (en) | Method and device for automatically submitting bug, electronic equipment and storage medium | |
| CN114138670B (en) | Method based on integration of interface automation test and function, performance and safety test | |
| CN110633199A (en) | Testing apparatus, method, and medium for block chain supporting intelligent contract | |
| CN112612697A (en) | Software defect testing and positioning method and system based on byte code technology | |
| CN112783769A (en) | Self-defined automatic software testing method | |
| CN109634842B (en) | QT application-based test method and system | |
| CN110147313B (en) | Log output method and device | |
| CN111666200A (en) | Testing method and terminal for time consumption of cold start of PC software | |
| CN112148588B (en) | Automatic analysis method and test tool for object resources of automatic test | |
| CN113836036A (en) | Automatic testing method, system, equipment and storage medium for browser compatibility |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20221101 |