KR101019166B1 - Automated testing method and system for embedded software - Google Patents

Abstract

PURPOSE: An automated testing method and a system for embedded software is provided to easily performing software test, and reduce the software developing costs by automatically creating PC simulation environment. CONSTITUTION: A test system generator(20) parses test case description and embedded software description, and extracts specific information. The test system generator creates test data, test ID/template, target system simulation module, and test ID/SUT(System Under Test) mapping information using the specific information. A tester(30) transmits test data and test ID/template to a target system(40), and decides the qualification based on the returned value received from the target system.

Description

Automated testing method and system for embedded software

The present invention relates to a test automation method and apparatus for embedded software, and more particularly, to a test automation method and apparatus for embedded software designed in a formal format based on TTCN-3.

Today's embedded systems are widely applied in automobiles, mobile phones, etc. to improve product performance and create new functions. In addition to modularizing and standardizing software to reuse software in embedded systems and improving reliability, the software design specification is formalized using XML. However, the design of the testing system is still largely manual by a test engineer and is not standardized. Therefore, the problem of reuse and reliability of the software testing environment still remains, and it takes a lot of time and effort to test.

 To test the embedded system in a PC environment, a simulation environment is required. Traditionally, such a simulation environment could not be easily created, making it difficult to test software early in development.

To solve this problem, Tree and Tabular Combined Notation (TTCN) has been proposed as an internationally standardized test language. If the description of the testing procedure and method is written using characters, communication between the engineer who designed the testing model and the engineer who actually performs the test may be misinterpreted so that the testing scheme can be expressed by symbolic notation. It became. Since the first version of TTCN-1, the notion of automatic coding of notations and automated execution has evolved to TTCN-3 (version 3).

SUMMARY OF THE INVENTION An object of the present invention for solving the above-mentioned problems is to provide a system and method for automatically generating a test apparatus capable of testing the software from an XML design specification of a formal embedded software based on TTCN-3.

A feature of the present invention for achieving the above-described technical problem relates to an embedded software test automation system that can automatically test the software under test using a test case specification and a built-in software specification input from the outside, the system is ,

A test system generator for parsing the test case specification and the embedded software specification, extracting specific information, and generating test data, test ID / template, target system simulation module, and test ID / SUT mapping information using the extracted information. ; A tester which transmits test data and a test ID / template input from the test system to a target system and receives a result value performed from the target system to determine whether the test result is passed; And a target system that performs the test target software using the test data and test ID / template input from the tester and transmits the result value to the tester.

The test case specification and the embedded software specification are written in an XML format, and it is preferable that a test system generator, a tester, and a target system operate based on TTCN-3.

An embedded software test automation system having the above-mentioned features, wherein the test system generator comprises: a test case parser for parsing a test case specification and converting the test case specification into a TTCN-3 based language; A test case specification information extractor extracting specific information from the test case specification converted into a TTCN-3 based language; A test data generator for generating test data using information extracted from a test case specification by the test case specification information extractor; A software specification parser for parsing the software design specification and converting the software design specification into a TTCN-3 based language; A software specification information extractor for extracting specific information from a software design specification converted into a language based on TTCN-3; A tester specification information generator for generating a test ID and a template using the information extracted from the software design specification by the software specification information extractor; A target system simulation generator for generating simulation modules using information extracted from a software design specification by the software specification information extractor; A target system specification information generator for generating scheduler specification and test ID / SUT mapping information of a target system using information extracted from the software design specification by the software specification information extractor, and automatically generated by the target system simulation generator. The generated simulation modules preferably include one or more of a Runtime Enviroment (RTE) module, an operating system module, a network communication module, and a hardware input / output module.

In the embedded software test automation system having the above-mentioned characteristics, the tester transmits test data and a test ID / template input from the test system generator to a target system and receives a result value performed from the target system to test results. A test component for determining whether the test passes; A codec for converting data transmitted and received between the tester and the target system; A communication interface for transmitting and receiving data between the tester and the target system; It is preferable to have a.

An embedded software test automation system having the above-mentioned features, the target system comprising: a simulation unit comprising simulation modules generated by the test system generation unit; An SUT interface unit which maps input / output of each buffer and test target software using test ID / SUT mapping information generated by the test system generator; A target codec that encodes data to be sent to the tester and decodes test data sent from the tester; A communication interface for transmitting and receiving data between the tester and the target system; And a scheduler for managing scheduling of the test target software and the target system by using the scheduler specification generated by the test system generator.

 The TTCN-3 based test system according to the present invention facilitates reuse of test cases and test environments between development stages, and also facilitates reusability between OEMs and component manufacturers. In addition, by automatically generating a PC simulation environment according to the present invention, software testing can be easily performed at an early stage of development, and software development costs can be reduced and reliability can be improved.

By the embedded software test automation system according to the present invention, it is possible to immediately perform the test and confirm the result. In addition, the present invention facilitates reuse of test cases and test execution environments by applying the TTCN-3 test standard, thereby reducing the time and effort required for testing.

Hereinafter, a test automation system of embedded software according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings. The test automation system according to the present invention is characterized in that it is based on TTCN-3.

1 is a block diagram showing an overall test automation system of embedded software according to a preferred embodiment of the present invention. As shown in FIG. 1, the test automation system 10 of embedded software according to a preferred embodiment of the present invention includes a test system generator 20, a tester 30, and a target system 40. The test system generator 20 extracts necessary information from a software design specification and a test case specification in XML format, and generates a module for the tester 30 and the target system 40 by using the extracted information. The tester 30 transmits a test input to the target system 40 and receives a result of the execution from the target system to determine whether the test has passed. The target system 40 receives a test input from the tester, performs a system under test (SUT), and transmits a result value to the tester. The data exchange between the tester 30 and the target system 40 uses communication protocols such as TCP / IP, UDP / IP, CAN, and the like.

Hereinafter, the structure and operation of the test system generator 20 according to the present invention will be described in detail with reference to FIGS. 1 to 3. 2 is a diagram exemplarily illustrating a process of generating test data by the test system generator 20 according to an exemplary embodiment of the present invention.

As shown in FIG. 1, the test system generator 20 according to the present invention includes a test case parser 200, a test case specification information extractor 210, a test data generator 220, a software specification parser 230, Software inventory information extractor 240, tester inventory information generator 250, target system simulation generator 260, and target system inventory information generator 270 are provided, from software design specifications and test case specifications in a particular format, such as XML. The necessary information is extracted, and the extracted information is used to generate modules for the tester 30 and the target system 40.

The test case parser 200 parses a test case specification written in an XML format and converts the test case specification into a TTCN-3 based language. The test case includes a test scenario.

The test case specification information extractor 210 may generate a test input signal and a value, an expected result signal and a value, a test case from a parsed test case specification provided from the test case parser for automatically generating test data based on TTCN-3. Extract time information and more.

The test data generator 220 generates test data using information extracted from the test case specification by the test case specification information extractor 210. The test data consists of files for test input and expected output for testing the system. (A) of FIG. 2 exemplarily shows the contents of the test case design specification, and FIG. 2 (b) exemplarily shows the contents of the test data generator. The data exemplarily showing the test data generated by the present invention. The tester 30 automatically performs a test on software by using the test data.

The software specification parser 230 parses a software design specification written in a specific format such as XML and converts it into a language based on TTCN-3.

The software specification information extractor 240 extracts the necessary information from the software design specification parsed by the software specification parser 230.

The tester specification information generator 250 generates a test ID and a template by using the information extracted from the software design specification by the software specification information extractor. FIG. 3 is a data exemplarily illustrating a test ID and a template generated by the test specification information generator 250 according to the present invention.

The target system simulation generator 260 automatically generates simulation modules using the information extracted from the software design specification by the software specification information extractor. Simulation modules automatically generated by the target system simulation generator 260 are modules capable of simulating hardware and hardware-related software required for testing the software under test in an early stage of development in which hardware is not yet developed. Runtime Enviroment) module, operating system module, network communication module, hardware input / output module.

The target system specification information generator 270 generates scheduler specification and test ID / SUT mapping information of the target system by using the information extracted from the software design specification by the software specification information extractor. 6 exemplarily illustrates test ID / SUT mapping information and a scheduler specification according to a preferred embodiment of the present invention.

Hereinafter, the structure and operation of the tester 30 according to the preferred embodiment of the present invention will be described in detail. The tester 30 according to the present invention includes a test component 300, a codec 310, and a communication interface 320, and test data a and test ID / template provided from the test system generator 20. b) is used to perform the test component 300.

The test component 300 transmits test data to the target system 40 and receives a result value performed from the target system 40 to determine whether the test result has passed. 4 is a diagram illustrating a test component 300 in accordance with a preferred embodiment of the present invention. The codec 310 is composed of an encoder and a decoder, the encoder encodes according to a communication protocol to transmit the TTCN-3 data type to the target system, and the decoder converts the data received from the target system into the TTCN-3 data type. . The communication interface 320 is responsible for data transmission and reception with the target system.

Hereinafter, the structure and operation of the target system 40 according to the preferred embodiment of the present invention will be described in detail. The target system 40 according to the present invention includes a system under test (SUT) 400, a simulation unit 410, an SUT interface unit 420, a target codec 430, and a communication interface 440. And a scheduler 450. 5 is a diagram illustrating in detail a part of a target system according to an exemplary embodiment of the present invention.

The simulation unit 410 is composed of simulation modules automatically generated from the software design specification by the target system simulation generator of the test system generator 20. The simulation modules constituting the simulation unit are modules capable of simulating hardware and hardware-related software required to perform the test software at the early stage of development in which the hardware to be tested is not yet developed. Runtime Environment (RTE) module and operating system module , Network communication modules, and hardware I / O modules.

The SUT interface unit 420 is a module for interconnection between the test target software and the target system, and each buffer using the test ID / SUT mapping information generated by the target system specification information generator of the test system generator 20. Map I / O to the software under test.

The target codec 430 includes an encoder and a decoder, encodes data transmitted to the tester 30, and decodes test data transmitted from the tester.

The communication interface 440 is responsible for data transmission and reception with the tester 30.

The scheduler 450 is responsible for scheduling the simulation unit, the SUT interface, the target codec, and the communication interfaces, as well as the ECU and network integrated scheduling of the test target software.

Although the present invention has been described above with reference to preferred embodiments thereof, this is merely an example and is not intended to limit the present invention, and those skilled in the art do not depart from the essential characteristics of the present invention. It will be appreciated that various modifications and applications which are not illustrated above in the scope are possible. And differences relating to such modifications and applications should be construed as being included in the scope of the invention as defined in the appended claims.

The test system according to the present invention can be widely used for testing embedded software used in electronic products in automobiles or IT fields.

1 is a block diagram showing an overall test automation system of embedded software according to a preferred embodiment of the present invention.

2 is a diagram exemplarily illustrating a process of generating test data by the test system generator 20 according to an exemplary embodiment of the present invention.

FIG. 3 is a data exemplarily illustrating a test ID and a template generated by the test specification information generator 250 according to the present invention.

4 is a diagram illustrating a test component 300 in accordance with a preferred embodiment of the present invention.

5 is a diagram illustrating in detail a part of a target system according to an exemplary embodiment of the present invention.

6 exemplarily illustrates test ID / SUT mapping information and a scheduler specification according to a preferred embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

10: test automation system of embedded software

20: test system generation unit

30: tester

40: target system

200: test case parser

210: test case specification information extractor

220: test data generator

230: Software Specification Parser

240: Software Specification Information Extractor

250: tester specification information generator

260: Target System Simulation Generator

270: target system specification information generator

300: test component

310: codec

320: communication interface

400: Software Under Test ('SUT')

410: simulation unit

420: SUT interface unit

430 target codec

440: communication interface

450: scheduler

Claims (6)

In the embedded software automation system that can automatically test the software under test using the test case specification and the embedded software specification input from the outside, A test system generator for parsing the test case specification and the embedded software specification, extracting specific information, and generating test data, test ID / template, target system simulation module, and test ID / SUT mapping information using the extracted information. ; A tester which transmits test data and a test ID / template input from the test system to a target system and receives a result value performed from the target system to determine whether the test result is passed; A target system that performs the test target software using the test data and test ID / template input from the tester and transmits a result value to the tester; Embedded software test automation system having a. 2. The embedded software test automation system of claim 1, wherein the test case specification and the embedded software specification are written in XML format. The method of claim 1, wherein the test system generating unit, A test case parser for parsing the test case specification and converting the test case specification into a TTCN-3 based language; A test case specification information extractor extracting specific information from the test case specification converted into a TTCN-3 based language; A test data generator for generating test data using information extracted from a test case specification by the test case specification information extractor; A software specification parser for parsing the software design specification and converting the software design specification into a TTCN-3 based language; A software specification information extractor for extracting specific information from a software design specification converted into a language based on TTCN-3; A tester specification information generator for generating a test ID and a template using the information extracted from the software design specification by the software specification information extractor; A target system simulation generator for generating simulation modules using information extracted from a software design specification by the software specification information extractor; A target system specification information generator for generating scheduler specification and test ID / SUT mapping information of a target system using information extracted from the software design specification by the software specification information extractor; Embedded software test automation system comprising a. 4. The simulation module of claim 3, wherein the simulation modules automatically generated by the target system simulation generator include one or more of a Runtime Enviroment (RTE) module, an operating system module, a network communication module, and a hardware input / output module. Embedded software test automation system. The method of claim 1, wherein the tester, A test component which transmits test data and a test ID / template input from the test system generator to a target system and receives a result value performed by the target system to determine whether the test result is passed; A codec for converting data transmitted and received between the tester and the target system; A communication interface for transmitting and receiving data between the tester and the target system; Embedded software test automation system comprising a. The method of claim 1, wherein the target system, A simulation unit composed of simulation modules generated by the test system generation unit; An SUT interface unit for mapping input / output of each buffer and test target software using test ID / SUT mapping information generated by the test system generator; A target codec that encodes data to be sent to the tester and decodes test data sent from the tester; A communication interface for transmitting and receiving data between the tester and the target system; A scheduler for managing scheduling of a test target software and a target system by using a scheduler specification generated by the test system generator; Embedded software test automation system comprising a.

Images