CN105653445A - Implementation method capable of meeting DO-178C test result - Google Patents
Implementation method capable of meeting DO-178C test result Download PDFInfo
- Publication number
- CN105653445A CN105653445A CN201510988295.2A CN201510988295A CN105653445A CN 105653445 A CN105653445 A CN 105653445A CN 201510988295 A CN201510988295 A CN 201510988295A CN 105653445 A CN105653445 A CN 105653445A
- Authority
- CN
- China
- Prior art keywords
- test
- test result
- result
- expected results
- procedure
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses an implementation method capable of meeting a DO-178C test result. The implementation method comprises the following steps: S1) inputting a software version to be tested, importing a corresponding test regulation and an expected result into a DO-178C test result management system; S2) according to the test regulation, generating a test result, and generating a test record file; S3) comparing the test result recorded in the test record file with the expected result, and judging that the test is qualified if the test result and the expected result are consistent, analyzing whether a difference generated by the test result is within a preset redundancy range or not if the test result and the expected result are inconsistent, judging that the test is qualified if the difference generated by the test result is within the preset redundancy range, and otherwise, judging that the test is not qualified; and S4) generating a test report, wherein the test report explains the defects and the problems of tested software. When the implementation method is applied, the test result can be guaranteed to be reasonably judged, and the difference between a practical result and the expected result can be guaranteed to be explained.
Description
Technical field
The present invention relates to software testing technology, specifically a kind of DO-178C of meeting test result realize method.
Background technology
DO-178C standard requires evaluation and analyzes test case, code and result, wherein, target for the checking of test result is to ensure that test result is correct, and ensure that the difference of actual result and expected results is explained, this target means need to test result be analyzed, the correctness of validation test result. Currently for the commonly used manual test of software test or the mode adopting automatic test, both test modes all cannot complete result and judge, it is clear that all can not meet the demand of DO-178C when both modes are applied.
Summary of the invention
It is an object of the invention to overcome the deficiencies in the prior art, it is provided that a kind of DO-178C of meeting test result realize method, can guarantee that test result is rationally judged during its application, and can guarantee that the difference of actual result and expected results is explained.
This invention address that the problems referred to above are achieved through the following technical solutions: a kind of DO-178C of meeting test result realize method, comprise the following steps:
Step one, input software version to be tested, and corresponding test procedure and expected results are imported in DO-178C test result management system;
Step 2, generate test result according to test procedure, and generate test log file;
Step 3, test result and the expected results recorded in test log file being contrasted, if test result is consistent with expected results, then discriminating test passes through; If test result is inconsistent with expected results, then analyze the difference of test result generation whether in the redundancy range set, if in redundancy range, it is determined that test is passed through, and otherwise discriminating test does not pass through;
Step 4, generation test report, wherein, illustrate defect and the Problems existing of tested software in test report.
Further, described step one needs test procedure to be designed and evaluates before importing test procedure.
Further, described DO-178C test result management system is based on WEBB/S architecture design. So, the DO-178C test result management system deployment of the present invention is simple, and by B/S architecture design, less for client requirements, tester can either directly through browser access system.
The present invention is in the specific implementation, it is contemplated that result can adopt the arbitrary format of system support to record, and for the ease of management and the preparation of expected results, further, described expected results adopts the form of text data, graph image or pdf document to record.
Further, the quantity of the test procedure imported in described step one is multiple, generates test result ID according to test procedure ID in step 2, in described step 4 after all of test procedure all completes result judgement, just generates test report. The present invention is when importing multiple test procedure, and after all test results in system all complete judgement, system just generates test report. System, when generating test report, adds up the quantity of unsanctioned test result, and system of enumerating is that each does not pass through questionnaire and the software defect reason that test procedure corresponding to discriminating test result generates.
Further, described step 3 is managed system by DO-178C test result in the specific implementation and test result and the expected results uploaded is displayed by the form of image, user is allowed to be identified on the display interface of expected results and test result, and using the content of mark as the basis judged.
Further, also including regression test step after described step 4, in described regression test step, DO-178C test result management system detects the test procedure of failure automatically, and allows user to add and perform to have passed through the test procedure of checking. Owing to there is unsanctioned test result in test, correspondence has the test procedure of failure, system using failed test procedure as regression tested test procedure. Meanwhile, system allows user to select those test procedures having been verified by as regression tested test procedure, and this is by whether the software after inspection reparation can impact previously those correct test procedures.
In sum, the method have the advantages that when (1) present invention applies by performing test procedure, record and import test result and complete to analyze, finally realizing and meet this target of DO-178C. So, can guarantee that test result is rationally judged, and can guarantee that the difference of actual result and expected results is explained.
(2) can based on requirement developing test procedure when the present invention applies, automatically generate the tracing matrix meeting DO-178C, so, reduce enterprise and meet the risk of airworthiness requirement, improve the economic benefit of enterprise, and the time of exploitation test procedure when the present invention applies, can be saved.
Accompanying drawing explanation
Fig. 1 is the structural representation of one specific embodiment of the present invention.
Detailed description of the invention
Below in conjunction with embodiment and accompanying drawing, the present invention is done detailed description further, but embodiments of the present invention are not limited to this.
Embodiment:
As it is shown in figure 1, a kind of DO-178C of meeting test result realize method, comprise the following steps: step one, input software version to be tested, and corresponding test procedure and expected results imported in DO-178C test result management system;Step 2, generate test result according to test procedure, and generate test log file; Step 3, test result and the expected results recorded in test log file being contrasted, if test result is consistent with expected results, then discriminating test passes through; If test result is inconsistent with expected results, then analyze the difference of test result generation whether in the redundancy range set, if in redundancy range, it is determined that test is passed through, and otherwise discriminating test does not pass through; Step 4, generation test report, wherein, illustrate defect and the Problems existing of tested software in test report. The software version typing information to be tested of the present embodiment input includes software version number, and software version number adopts the forms such as 1.0.0.001 to represent. The test procedure of the present embodiment develops based on test case, is used for software test step is described in detail, and wherein, test case is developed based on software requirement.
The present embodiment is in the specific implementation, step one needs test procedure to be designed and evaluates before importing test procedure, the quantity of the test procedure imported in step one is multiple, step 2 generates test result ID according to test procedure ID, in step 4 after all of test procedure all completes result judgement, just generate test report. The present embodiment is tested log file except recording actual test result, also can record test execution personnel, testing time, witness the information such as people.
The present embodiment is in the specific implementation, the DO-178C test result management system applied is based on WEBB/S architecture design, DO-178C test result management system is equipped with introducting interface, making it possess the import feature of test procedure, test procedure is managed system by DO-178C test result after importing and is managed. The present embodiment is in the specific implementation, DO-178C test result management system is also equipped with test result import feature, the artificial test result participating in and obtaining is needed for some, above-mentioned data are imported to DO-178C test result management system, in order to the later stage carries out test result judgement when the present embodiment is applied.
The DO-178C test result management system of the present embodiment is further equipped with test result decision-making function, and the step 3 of the present embodiment, when implementing, both can be carried out based on the test result decision-making function of system, it is possible to adopt the artificial mode judged to realize. when adopting the artificial mode judged, DO-178C test result management system provide judge conclusion (by or do not pass through) for tester select, tester is when judging, system is by demonstrating the contrast interface of expected results and test result, tester is by observing and contrast whether expected results shows consistent with test result, whether this includes numerical value the same, whether interface display element is equally etc., if consistent or deviation is in allowed band, then tester selects judgement to pass through, if inconsistent or deviation exceedes desired value, then tester selects inconsistent rectangular area at expected results interface and test result interface mouse, the position of this rectangular area will be stored in background data base, can follow-up again show. meanwhile, tester needs to fill in the reason judging not pass through, and this reason is as software defect reason, and the test procedure that system can be failed generates questionnaire. the reason that test is not passed through can be demonstrated in this way in a straightforward manner, the reliability judged can be promoted.
The present embodiment, after expected results imports, will be automatically set as guard mode, and not allow user to modify time during test execution.The expected results of the present embodiment adopts the form of text data, graph image or pdf document to record. The step 3 of the present embodiment is managed system by DO-178C test result in the specific implementation and test result and the expected results uploaded is displayed by the form of image, user is allowed to be identified on the display interface of expected results and test result, and using the content of mark as the basis judged. The present embodiment is additionally included in the regression test step carried out after step 4, and wherein, in regression test step, DO-178C test result management system detects the test procedure of failure automatically, and allows user to add and perform to have passed through the test procedure of checking.
Above content is the further description present invention made in conjunction with concrete preferred implementation, it is impossible to assert that the specific embodiment of the present invention is confined to these explanations. For general technical staff of the technical field of the invention, without departing from other embodiments drawn under technical scheme, should be included in protection scope of the present invention.
Claims (7)
1. one kind meet DO-178C test result realize method, it is characterised in that comprise the following steps:
Step one, input software version to be tested, and corresponding test procedure and expected results are imported in DO-178C test result management system;
Step 2, generate test result according to test procedure, and generate test log file;
Step 3, test result and the expected results recorded in test log file being contrasted, if test result is consistent with expected results, then discriminating test passes through; If test result is inconsistent with expected results, then analyze the difference of test result generation whether in the redundancy range set, if in redundancy range, it is determined that test is passed through, and otherwise discriminating test does not pass through;
Step 4, generation test report, wherein, illustrate defect and the Problems existing of tested software in test report.
2. a kind of DO-178C of meeting test result according to claim 1 realize method, it is characterised in that described step one needs test procedure to be designed and evaluates importing before test procedure.
3. a kind of DO-178C of meeting test result according to claim 1 realize method, it is characterised in that described DO-178C test result management system based on WEBB/S architecture design.
4. a kind of DO-178C of meeting test result according to claim 1 realize method, it is characterised in that described expected results adopts text data, the form of graph image or pdf document is recorded.
5. a kind of DO-178C of meeting test result according to claim 1 realize method, it is characterized in that, the quantity of the test procedure imported in described step one is multiple, step 2 generates test result ID according to test procedure ID, in described step 4 after all of test procedure all completes result judgement, just generate test report.
6. a kind of DO-178C of meeting test result according to claim 1 realize method, it is characterized in that, described step 3 is managed system by DO-178C test result in the specific implementation and test result and the expected results uploaded is displayed by the form of image, user is allowed to be identified on the display interface of expected results and test result, and using the content of mark as the basis judged.
7. a kind of DO-178C of the meeting test result according to any one in claim 1��6 realize method, it is characterized in that, regression test step is also included after described step 4, in described regression test step, DO-178C test result management system detects the test procedure of failure automatically, and allows user to add and perform to have passed through the test procedure of checking.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510988295.2A CN105653445B (en) | 2015-12-25 | 2015-12-25 | A kind of implementation method for meeting DO 178C test results |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510988295.2A CN105653445B (en) | 2015-12-25 | 2015-12-25 | A kind of implementation method for meeting DO 178C test results |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105653445A true CN105653445A (en) | 2016-06-08 |
| CN105653445B CN105653445B (en) | 2018-01-16 |
Family
ID=56476782
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510988295.2A Active CN105653445B (en) | 2015-12-25 | 2015-12-25 | A kind of implementation method for meeting DO 178C test results |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105653445B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10120785B2 (en) | 2016-10-21 | 2018-11-06 | Rosemount Aerospace Inc. | Automatic generation of data coupling and control coupling test conditions |
| CN109634846A (en) * | 2018-11-16 | 2019-04-16 | 武汉达梦数据库有限公司 | A kind of ETL method for testing software and device |
| CN114255155A (en) * | 2022-02-24 | 2022-03-29 | 荣耀终端有限公司 | Graphics processor testing method and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102455971A (en) * | 2010-10-28 | 2012-05-16 | 无锡江南计算技术研究所 | Application-level random instruction testing method, system and device |
| US20120198280A1 (en) * | 2011-01-28 | 2012-08-02 | International Business Machines Corporation | Test cases generation for different test types |
| CN102662846A (en) * | 2012-04-24 | 2012-09-12 | 广东欧珀移动通信有限公司 | Testing method combining automatic tool and testing case |
| CN104360940A (en) * | 2014-10-31 | 2015-02-18 | 北京交控科技有限公司 | DSU (Data Service Unit) test method and device |
-
2015
- 2015-12-25 CN CN201510988295.2A patent/CN105653445B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102455971A (en) * | 2010-10-28 | 2012-05-16 | 无锡江南计算技术研究所 | Application-level random instruction testing method, system and device |
| US20120198280A1 (en) * | 2011-01-28 | 2012-08-02 | International Business Machines Corporation | Test cases generation for different test types |
| CN102662846A (en) * | 2012-04-24 | 2012-09-12 | 广东欧珀移动通信有限公司 | Testing method combining automatic tool and testing case |
| CN104360940A (en) * | 2014-10-31 | 2015-02-18 | 北京交控科技有限公司 | DSU (Data Service Unit) test method and device |
Non-Patent Citations (1)
| Title |
|---|
| 邢亮，牟明: "DO-178/C目标分析及阶段介入评审过程研究", 《航空计算技术》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10120785B2 (en) | 2016-10-21 | 2018-11-06 | Rosemount Aerospace Inc. | Automatic generation of data coupling and control coupling test conditions |
| CN109634846A (en) * | 2018-11-16 | 2019-04-16 | 武汉达梦数据库有限公司 | A kind of ETL method for testing software and device |
| CN109634846B (en) * | 2018-11-16 | 2021-10-19 | 武汉达梦数据库股份有限公司 | ETL software testing method and device |
| CN114255155A (en) * | 2022-02-24 | 2022-03-29 | 荣耀终端有限公司 | Graphics processor testing method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105653445B (en) | 2018-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018010552A1 (en) | Test method and device | |
| US10127141B2 (en) | Electronic technology resource evaluation system | |
| CN108427632B (en) | Automatic test method and device | |
| Alegroth et al. | JAutomate: A tool for system-and acceptance-test automation | |
| CN110083340A (en) | Code generating method, device, computer equipment and storage medium | |
| CN104090776A (en) | Software development method and system | |
| Wang et al. | A systematic test case selection methodology for product lines: results and insights from an industrial case study | |
| US20120278708A1 (en) | Verifying configurations | |
| Muñoz et al. | A guidance to implement or reinforce a DevOps approach in organizations: A case study | |
| Farhan et al. | A methodology for enhancing software security during development processes | |
| CN104239206A (en) | Webpage test method and device | |
| CN111444051A (en) | Complete machine production testing method and system for product | |
| CN105653445A (en) | Implementation method capable of meeting DO-178C test result | |
| US20150234732A1 (en) | Executable software specification generation | |
| US9274933B2 (en) | Pretest setup planning | |
| Ikhsan et al. | Automatically: An automated refactoring method and tool for improving web accessibility | |
| Nietzio et al. | The unified Web evaluation methodology (UWEM) 1.2 for WCAG 1.0 | |
| KR101252358B1 (en) | Apparatus and method for testing plc command | |
| Flemström et al. | Exploring test overlap in system integration: An industrial case study | |
| Mead | Identifying security requirements using the security quality requirements engineering (SQUARE) method | |
| CN112015715A (en) | Industrial Internet data management service testing method and system | |
| CN111708698B (en) | Application program simulation recording method and related device | |
| Mead et al. | Software assurance curriculum project volume III: Master of software assurance course syllabi | |
| Gilly et al. | Comparison of predictive techniques in cluster-based network servers with resource allocation | |
| CN109669868A (en) | The method and system of software test |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |