JPH0991031A - Automatic test device for control software, test plan input device, test execution device, test result evaluating device, and method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simply prepare a test plan, to make it possible to execute a test even for an equipment of which operation state is unstable in an unmanned state and to automatically evaluate a test result. SOLUTION: This automatic test device for control software is a device for automatically testing control software to be used for a controller to which an input device and an output device to be controlled are connected and is provided with a device body 1 and a microcomputer loading part 3. The device body 1 prepares a table format test plan for executing tests in order, judges and executes the test plan including time conditions and operation conditions and evaluates a test result including physical errors. The microcomputer loading part 3 has an I/O port for connecting peripheral simulators 4a to 4e for simulatively executing the operation of the input and output devices and is loaded with a controlling microcomputer 2. The device body 1, the microcomputer loading part 3 and the peripheral simulators 4a to 4e are connected to each other through optical loop networks 5a to 5c.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control software automatic test device for automatically testing control software used in a control device for controlling each control target of a product, a test plan input device, a test execution device, And a test result evaluation device and methods thereof.

[0002]

2. Description of the Related Art Recently, one-chip microcomputers for control (hereinafter referred to as microcomputers) and one-board microcomputers have been widely incorporated in home electric appliances such as system components and televisions. When the control software installed in this built-in microcomputer is completed, it is tested whether or not it operates according to design specifications using a test device for quality assurance. In recent years, with the background of miniaturization and high functionality of electrical appliances, the degree of functional dependency on this kind of embedded microcomputer is increasing. For this reason, the size of the control software stored in the memory of this type of embedded microcomputer increases rapidly, and a great deal of effort is required for the control software operation confirmation test for quality assurance.

At the time of the operation confirmation test of the control software, various peripheral simulators (devices that represent input / output devices such as actual motors, switches, and sensors in a simulated manner) are connected to the microcomputer for testing. And a microcomputer and a peripheral simulator are connected, the test plan (test program) written in order in absolute time is executed on the test computer, the test result is displayed on the monitor screen of the test computer, and the display result is visually observed. Have confirmed by.

As this type of test apparatus, a test program as a test program described in a dedicated language is known. This test plan is created, for example, by sequentially describing the input / output conditions of the peripheral simulator and the timing in absolute time in a dedicated language. When executing this test program, if there is a controlled object whose event change cannot be predicted in absolute time, the operator constantly monitors the state and inputs data whenever the event change occurs. For example, when testing the microcomputer for system components, if the motor performs the following control when the motor reaches a predetermined rotation speed, the operator monitors the rotation speed of the motor, and when the rotation speed reaches a predetermined value, data indicating that To the test computer.

Such data is transmitted from the test computer to the microcomputer and peripheral simulators, the peripheral simulators are sequentially operated under the control of the microcomputer, and the execution result data is received by the test computer. Then, the execution result data is displayed on, for example, a monitor. The operator visually confirms the execution result,
It is judged whether the test result is within a predetermined allowable range in consideration of error or the like. By repeating this operation, the execution results of all test contents are evaluated.

[0006]

When creating a test program, in the above-mentioned conventional configuration, since it has to be created using a dedicated language, specialized knowledge is required for the program, and the test program can be created easily. Can not. In addition, since the test program written in the dedicated language does not intuitively express the actual operation, it is difficult to understand the operation content and it is not suitable for describing the actual design specifications in time series. Therefore, much effort is required to complete the test program.

At the time of test execution, in the above conventional configuration,
When controlling a device whose operating status is not always the same every time (for example, an output device accompanied by mechanical operation such as an actuator of a motor, etc.), it is not intended to execute a test program that describes the input / output conditions in absolute time only. There is a problem of performing the action. That is, it is not possible to correctly process a signal whose time is not fixed, such as a motor stop time.

[0008] For example, it is assumed that, when testing the opening / closing door of the cassette, the operation of opening the door by the motor by pressing the open button immediately after the door is closed by the motor by pressing the close button is assumed. To do this test, generate a close button signal at absolute time 1,
After that, it is assumed that a test program is generated that generates a motor operation start signal at absolute time 2, a motor operation completion signal at absolute time 3, and an open button signal at absolute time 4. In this case, when the motor is delayed and the motor does not stop in the absolute time 3, an open signal is issued when the door is not fully closed, and then an operation completion signal is issued after the motor actually stops. is there.

Therefore, in such a case, as described above, the operator must monitor the state and manually input the operation completion signal. As described above, in the above-described conventional configuration, it is necessary for the operator to constantly monitor the state and input data (for example, operation completion signal) in accordance with a change in event (for example, completion of operation of the motor). Unattended test execution is not possible.

When some kind of problem arises and it is necessary to input another data, the test program of the dedicated language must be changed again, and the numerical values and signals are changed little by little to see the execution result. It is difficult to perform simulation operation. When the test result is evaluated, the operator basically evaluates the test result by visual observation in the conventional configuration. This is because, when mechanically checking the matching with the correct answer data, the value may fluctuate due to the A / D conversion resolution or hardware capability, the time lag due to the accuracy of the internal timer, the arrival delay due to the data transmission path or the communication speed, etc. This is because all test results including physical errors result in errors in evaluation.

As described above, in the above-mentioned conventional configuration, even though the test program can be created and the test can be executed by the test program, it is professional and difficult to create the test program, and the created program has intuitive test contents. It is difficult to understand. Moreover, since the test program describes the input / output conditions in absolute time, it is difficult to automatically test the output device whose operating condition is apt to change, and it is difficult to unmanned the test execution. Furthermore, it is not possible to automatically evaluate test results that include physical errors.

An object of the present invention is to provide a test plan input device and method which make it easy to understand the test content and easily create a test plan. Another object of the present invention is to provide a test execution device and method capable of automatically testing even a device whose operating condition changes. Another object of the present invention is to provide a test result evaluation apparatus and method that can evaluate the correctness of a test result even if the test result changes due to a physical factor.

Another object of the present invention is to provide an automatic test apparatus and method for control software, which can easily create a test plan, can perform an unattended test, and can automatically evaluate a test result.

[0014]

An automatic test apparatus for control software according to a first aspect of the present invention automatically executes a test of control software used in a control apparatus in which an input device and an output device to be controlled are connected. The device includes a test device body and a test target unit. The test equipment body creates a tabular test plan for executing the tests in sequence, judges and executes the test plan including time conditions and operating conditions, and executes the test results including physical errors. evaluate. The test target part has a port for connecting a peripheral simulator that simulates the operation of the input device and the output device, and a mounting part that mounts a control device that is operated by control software, and is connected to the test device main body. Has been done.

In this case, when the control unit is mounted on the mounting portion of the test target unit and the peripheral simulator is connected to the control unit and the apparatus main body, when the test plan is created in the table format in the apparatus main body, Is executed including the time condition and the operating condition, a signal is input / output to / from the peripheral simulator with respect to the control device, and information of the test result is input to the test device main body. In the test equipment body,
The correct answer information set in advance and the test result are collated and evaluated including a physical error. Here, since the test plan is created in the table format, the test plan can be easily created and the test contents can be intuitively understood. Further, since the test is executed including the operation condition in addition to the time condition, the test can be automatically executed even in the case of a device whose operation status is unstable. Further, since the test result is evaluated including the physical error, it can be automatically evaluated even if the test result physically changes.

According to a second aspect of the present invention, in the control software automatic test apparatus according to the first aspect, the test apparatus main body has an optical input / output board for connecting to a peripheral simulator and a test target section by an optical loop network. are doing. Here, since the data is input and output through the high-speed optical loop network, the test can be executed in real time.

According to a third aspect of the present invention, in the control software automatic test device according to the first or second aspect, the test device body creates a test plan in which the input condition and the output condition of the control device are associated with time data. And a means for executing control software and outputting a test result based on the created test plan, and an evaluation means for evaluating the test result output from the execution means.

A control software automatic test device according to a fourth aspect is a device for automatically executing a test of control software used in a control device in which an input device and an output device to be controlled are connected, It comprises means, execution means, and evaluation means. The creating means is means for creating a test plan in which the input condition and the output condition of the control device are associated with time data. The execution means executes the control software and outputs the test result based on the created test plan. The evaluation means evaluates the test result output from the execution means.

According to a fifth aspect of the present invention, in the control software automatic test apparatus according to the third or fourth aspect, the creating means includes a row and a column of a test plan in which an input condition and an output condition for the control device are associated with time data. The input means for inputting in the tabular form and the editing means for editing the input tabular test plan. According to a sixth aspect of the present invention, in the control software automatic test apparatus according to the fifth aspect, the creating means interprets and executes the relationship between the input conditions and the output conditions from the contents of the input test plan in the table format. It further comprises a conversion means for converting to a test file in the format.

According to a seventh aspect of the present invention, there is provided the control software automatic test apparatus according to the fifth or sixth aspect, wherein the creating means has a relationship between the input conditions and the output conditions based on the contents of the inputted tabular test plan. And a correct answer data generating means for interpreting and generating correct answer data for evaluating the test result. An automatic test device for control software according to claim 8 is the device according to any one of claims 5 to 7, wherein the input means is capable of inputting time data in consideration of time tolerance, and inputs a plurality of time data. Then, there is further provided a tolerance determining means for determining whether or not the time tolerances interfere with each other in the mutual time data.

An automatic test apparatus for control software according to a ninth aspect is the apparatus according to any one of the third to eighth aspects, wherein the executing means determines whether or not the output condition of the execution result satisfies a predetermined operation condition. The operating condition judging means for judging, the time condition judging means for judging whether or not the output condition satisfies a predetermined time condition, and the time for the output condition when either of the two condition judging means judges that the condition is satisfied. And a simulated input signal output means for inputting the input condition associated with the data to the control device.

According to a tenth aspect of the present invention, in the control software automatic test apparatus according to any one of the third to ninth aspects, the executing means further comprises a tabular format output means for outputting the test result in a tabular format. There is. An automatic test device for control software according to claim 11 includes:
0. In the apparatus described in any one of 0, the executing means is a test range specifying means for specifying a test range, a continuous test executing means for continuously testing the specified test range based on a test plan, and a specified input. And a single test execution means for executing only one condition or output condition.

An automatic test apparatus for control software according to a twelfth aspect is the apparatus according to any one of the third to eleventh aspects, in which the executing means specifies one or a plurality of test plans to be executed. And a test plan continuous execution means for continuously executing one or a plurality of designated test plans. An automatic test device for control software according to claim 13 is the device according to any one of claims 7 to 12, wherein the evaluation means includes evaluation reference data storage means for storing evaluation reference data including a physical error, The correct answer data created by the correct answer data creating means and the test result are matched based on the evaluation reference data to create the evaluation result data.

A control software automatic test device according to a fourteenth aspect is the device according to the thirteenth aspect, in which the evaluation result data created by the collating means are displayed side by side with the test result in the tabular format input. The display means is further provided. According to a fifteenth aspect of the present invention, in the control software automatic test apparatus according to the thirteenth or fourteenth aspect, the evaluation means further includes a thinning means for thinning out changing data among the changing test execution results.

An automatic test apparatus for control software according to a sixteenth aspect is the apparatus according to any one of the thirteenth to fifteenth aspects, wherein the collating means has a first collating means for collating the test result with the correct answer data and a pattern. A pattern search means for searching the first pattern of the continuous test results and a second matching means for matching the searched pattern with the subsequent continuous pattern are provided.

A control software test plan input device according to a seventeenth aspect is a device for inputting a test plan of control software used in a control device to which an input device and an output device are connected, and an input means, The editing means and the conversion means are provided. The input means is means for inputting a test plan in which input conditions and output conditions for the control device are associated with time data in a tabular form of rows and columns. The editing means is a means for editing the inputted tabular test plan. The conversion means is a means for converting a tabular test plan into an execution test file. Here, since the test plan in which the input condition and the output condition for the control device are associated with the time data is input in a table format, the test plan can be easily input and the test content can be intuitively determined.

A control software test execution device according to claim 18 is a device for automatically performing a test of control software used in a control device to which an input device and an output device are connected. And a time condition judging means and a simulated input condition outputting means. The operating condition determination means determines whether the output condition of the execution result satisfies a predetermined operating condition. The time condition determining means determines whether or not the output condition satisfies a predetermined time condition. The simulated input condition output means outputs the input condition associated with the output condition with the time data to the control device when one of the two condition determining means determines that the condition is satisfied. Here, in addition to the time condition, the operating condition is also determined and the input condition is output to the control device. Therefore, even if the operating condition is not stable, the operating condition can be determined automatically without monitoring. You can run the test.

A control software test result evaluation device according to a nineteenth aspect is a device for evaluating a test result of control software used in a control device to which an input device and an output device are connected, and a test result storage means, A correct answer data storage means, an evaluation reference data storage means, and a collation means are provided. The test result storage means stores the test result. The correct answer data storage means stores correct answer data. The evaluation reference data storage means stores the evaluation reference data including a physical error. The collating unit collates the correct answer data stored in the correct answer data storing unit with the test result stored in the test result storing unit based on the evaluation reference data to create evaluation result data. Here, since the correct answer data and the test result are collated based on the evaluation reference data including the physical error, the test result can be correctly evaluated even if the test result includes the physical error.

A control software automatic test method according to a twentieth aspect is a method for automatically testing control software used in a control device in which an input device and an output device to be controlled are connected to each other. A creation process that creates a tabular test plan that correlates input conditions and output conditions with time data, an execution process that executes the control software and outputs the test results based on the created test plan, and an output process. And an evaluation step for evaluating the test results.

A control software test plan input method according to a twenty-first aspect is a method for inputting a test plan of control software used in a control device to which an input device and an output device are connected. An input process for entering a test plan in which row and column tables are associated with conditions and output conditions by time data, and
It includes an editing process for editing the input tabular test plan and a conversion process for converting the tabular test plan into an executable test file.

A control software test execution method according to a twenty-second aspect is a method for automatically performing a test of control software used in a control device to which an input device and an output device are connected, and outputting an execution result. An operation condition determining step of determining whether a condition satisfies a predetermined operation condition, a time condition determining step of determining whether an output condition satisfies a predetermined time condition, or one of two condition determining steps. When it is determined that the condition is satisfied, the simulated input condition output step of outputting the input condition associated with the output condition with the time data to the control device is included.

A control software test result evaluation method according to a twenty-third aspect is a method for evaluating a test result of control software used in a control device to which an input device and an output device are connected, and is created based on a test plan. It includes a step of collating the correct answer data and the test result based on the evaluation reference data including a physical error, and a step of creating evaluation result data based on the collation result.

[0033]

1 is a block diagram showing an automatic test apparatus for control software according to an embodiment of the present invention. FIG.
In the above, the automatic test apparatus includes an apparatus body 1 and a microcomputer mounting section 3 in which, for example, a microcomputer 2 for controlling home electric appliances is mounted. The microcomputer 2 is equipped with a PROM storing control software to be tested.
The microcomputer mounting unit 3 includes a plurality of peripheral simulators 4a for simulating operations of input devices and output devices of home electric appliances.
4e are connected via an I / O port for connection. The peripheral simulator 4a simulates an input device such as a remote controller, and the peripheral simulator 4b
Is an output device such as a stepping motor, the peripheral simulator 4c is an analog input device such as a thermistor, the peripheral simulator 4d is an output device such as a buzzer, and the peripheral simulator 4e is a display device such as an LCD. . Microcomputer mounting part 3 and peripheral simulator 4
a to 4e are connected to the apparatus main body 1 by three optical loop networks 5a to 5c. Optical loop network 5
Reference numerals a to 5c are high-speed networks as disclosed in, for example, Japanese Patent Laid-Open No. 63-20936, and data input / output can be performed at high speed.

As shown in FIG. 2, the apparatus main body 1 is composed of a personal computer equipped with, for example, a Pentium (trademark) processor and adopting Windows (trademark) as an operation system, and a control unit main body including the Pentium (trademark) processor. It has a (CPU) 10. The control unit body 10 includes a keyboard 11, a mouse 12, a CRT display 13, a ROM and a RAM.
Is connected to a memory 14 including a hard disk drive, a floppy disk drive, a CDROM drive, and the like. An I / O driver 16 is also connected to the control unit 10. An optical I / O board 17 is connected to the I / O driver 16.
Three optical loop networks 5a-5c are connected to the optical I / O board 17, respectively. The peripheral simulators 4a to 4e and the microcomputer mounting unit 3 are connected to the photon stations in the optical loop networks 5a to 5c.

A directory structure as shown in FIG. 3 is constructed in, for example, a hard disk drive of the external storage device 15. That is, in the root directory,
The environment directory 20 is created, and the environment directory 20
A model name directory 21 is built in. The model name directory 21 is for storing various files for each model name. In the model name directory 21,
A check directory 22 and a result directory 23 are constructed. A transfer data definition file 30 is stored in the model name directory 21. The transfer data definition file 30 is used for creating a test execution file and a correct answer file from a check sheet file (a file in which a test plan indicating a test order can be edited in a table format), and a peripheral used for a test function or a collation function. This is a file that stores information for setting the simulator. The transfer data definition file 30 includes an output communication type, an output address (output data address from the device main body 1 to the peripheral simulator), an input address (input data address from the peripheral simulator to the device main body), and a peripheral simulator unit for each peripheral simulator. Information such as the delay time and the value tolerance is stored. In addition, data conversion pattern information, which is conversion information when generating an execution file or a correct answer file from data of a test plan (check sheet file) in a table format (check sheet format), is also stored.

The check directory 22 stores a timer table definition file 31, an item definition file 32, a peripheral simulator file 33, a check sheet file 34, an execution file 35, a correct answer file 36, an error output file 37 and a continuous execution file list 38. Has been done. A symbol directory 24 is constructed in the check directory 22. A symbol file 39 and a partial save file 40 are stored in the symbol directory 24.

The item definition file 32 stores information such as the number of input item definitions, the number of output item definitions, and the name of each item, which will be described later. Here, the item display portion of the check sheet, which will be described later, is set. The timer table definition file 31 stores timer table information used in the check sheet. Information such as the identification information of each timer, the timer name, its time unit, the set time, and the timer tolerance is stored therein. The speed table information is also stored in the timer table definition file 31. This speed table information is data for automatically calculating the change time from the start of the change of the numerical value to the end of the change only for the through data (for example, the temperature data of the thermistor) in which the changing numerical value has meaning.

The peripheral simulator file 33 stores various information of the peripheral simulators 4a to 4e. The check sheet file 34 stores the generated check sheet (test plan) information. The execution file 35 is a file converted from the check sheet, is a file that is described in an intermediate language, and stores a test program used during test execution. The correct answer file 36 is a file converted from the check sheet file, and is a file that stores correct answer data used at the time of result matching. Error output file 37
Is generated when an error occurs. The continuous execution file list 38 is a list in which the names of the check sheet files that are continuously executed when the test is continuously executed across a plurality of check sheet files are stored in the execution order. The symbol file 39 is a file in which an operation that changes periodically and a pattern operation that changes stepwise are symbolized and recorded. The partially saved file 40 stores a partially saved file.

The result directory 23 stores an execution result file 41, a collation result file 42 and a result evaluation file 43. The execution result file 41 is a file that stores the execution result of the test. The matching result file 42 is a file that stores the matching result. The result evaluation file 43 is a file that stores the evaluation result. Next, the operation of the automatic test apparatus 1 will be described with reference to FIGS.
A description will be given according to the control flowchart shown in FIG.

When the power is turned on, step S1 in FIG.
Initial settings are made with. In step S2, an initial screen as shown in FIG. 23 is displayed. On this initial screen, a check sheet, three buttons for test execution and result verification are displayed. In steps S3 to S5, it is determined which button has been operated. When the initial screen is displayed, the operator operates the mouse 12 to move the cursor to the button corresponding to the desired process and click the left button. In FIG. 4, for convenience of expression in the flowchart, it is displayed as if the three processes had priorities, but actually there is no priority. In the following flowcharts as well, there is no priority for button operation or menu selection.

If it is determined that the check sheet button has been operated, the process proceeds from step S3 to step S6. In step S6, check sheet processing is performed. The check sheet process is a process for describing the test procedure in a table format so that the test procedure can be intuitively determined. If it is determined that the test execution button has been operated, steps S4 to S4
Move to 7. In step S7, a test execution process is executed. The process proceeds from step S5, where it is determined that the result inquiry button has been operated, to step S8. In step S8, result collation processing is executed.

In the check sheet processing of step S8,
In step S11 of FIG. 5, the data input screen for the check sheet processing shown in FIG. 24 is displayed. In this data input screen, data such as model name, check sheet version, and sheet number are required input items. Also, at the bottom of the screen, there are four editors: an item editor for editing items on the check sheet, a sheet input for inputting on the check sheet, a sheet read for reading the check sheet, and an end for ending this process. The button is displayed. In steps S13 to S16, it is determined which of these four buttons has been operated.

If it is determined that the item editor button has been operated, the process proceeds from step S13 to step S17. In step S17, file item editing processing is performed.
By this file item editing process, the contents of the item definition file, the transfer data definition file, and the timer table definition file can be edited. If it is determined that the sheet input button has been operated, the process proceeds from step S14 to step S18, and sheet input processing is executed. If it is determined that the sheet reading button has been operated, steps S15 to S19
Move to and read the check sheet with the specified sheet number from the check sheet file. When it is determined that the end button has been operated, the process returns to the main routine.

In the sheet input process of step S18, it is checked in step S21 of FIG. 6 whether the input file is changed. In step S22, the read check sheet is displayed on the screen. This check sheet screen is shown in FIG. Here, four menus of file, option, display, and edit are displayed at the top of the screen. A registration button for registering a check sheet and an end button for ending this process are displayed at the bottom of the screen. Then, in the center of the screen, a tabular check sheet input screen for inputting the test program is displayed. Here, the tabular input screen is divided into input items for displaying input conditions, output items for displaying output conditions, time items for displaying time data, and remark items. Input items and output items defined in the item definition file are displayed in these input items and output items. Here, in the input item, an input signal (input condition) from a peripheral simulator simulating an input device such as a sensor or a remote controller to the microcomputer is shown. In the output item, an output signal (output condition) to the output device to be controlled such as a motor or LCD is shown. The time item is
This is a field for describing time data indicating the relationship between various output conditions and input conditions. This time data is described in the column direction (horizontal direction) of the table. The states of input items and output items are also displayed in the column direction of the table. The same column (vertical column) in each table shows the same time timing. Further, a cumulative data display column is provided next to the item name or every 20 columns. In this cumulative data display column, the status of the input / output conditions in the immediately preceding column is displayed.

In steps S23 to S28, it is determined whether each menu or button has been selected or operated. If these are not selected or operated, the process proceeds to step S29, and the input process is executed. When the file menu is selected, steps S23 to S3
Move to 0. In step S30, file processing is executed. When the option menu is selected, step S2
The process moves from step 4 to step S31. In step S31, optional processing is executed. When the display menu is selected, the process proceeds from step S25 to step S32. In step S32, display processing such as changing the display size and the display frame is performed. If it is determined that the edit menu is selected, the process proceeds from step S26 to step S33. Step S
At 33, edit processing is executed. If it is determined that the registration button has been operated, the process proceeds from step S27 to step S34. In step S34, the check sheet in which the data is input is registered in the check sheet file. When it is determined that the end button has been operated, the process returns to the check sheet processing routine.

In the file processing of step S30 of FIG. 6, the option menu of the file menu is displayed in step S41 of FIG. This option menu has 4 files for file registration, printing, addition and editing.
Two menus are displayed. In steps S42 to S45, it is determined which menu has been selected. When the registration menu is selected, the process proceeds from step S42 to step S34 in FIG. Then, the input check sheet is registered in the check sheet file. When the print menu is selected, the process proceeds from step S43 to step S46. In step S46, the print range is specified, the print style is specified, and print execution processing is performed. When the additional process is selected, the process proceeds from step S44 to step S47. In step S47, file addition processing is executed. If it is determined that the end menu is selected, the process proceeds from step S45 to FIG. 6 and returns to the check sheet processing routine.

In the option processing of step S31 of FIG. 6, the option menu of the option processing is displayed in step S51 of FIG. The option menu for option processing includes execution file creation, correct answer file creation,
Five menus are displayed: execution / correct answer file creation, cumulative check, and symbol processing. Steps S52-S
At 56, it is determined which option menu has been selected. If it is determined that the execution file creation menu is selected, the process proceeds from step S52 to step S57. In step S57, an execution file creation process described later is performed. When it is determined that the correct answer file creation menu is selected, the process proceeds from step S53 to step S58.
In step S58, a correct answer file creation process described later is performed. If it is determined that the execution / correct answer file creation menu is selected, the process proceeds from step S54 to step S59. In step S59, an execution file creation process is performed.
In step S60, a correct answer file creating process is performed.

When it is determined that the cumulative check menu is selected, the process proceeds from step S55 to step S61.
In step S61, cumulative check processing is performed. In this cumulative check processing, the display contents of the cumulative data display column are checked and displayed correctly. If it is determined that the symbol menu is selected, the process proceeds from step S56 to step S62. In step S62, symbol processing described later is executed.

In the editing process of step S33 of FIG. 6, the option menu of the editing process is displayed in step S71 of FIG. In this option menu, four menus of 1 row insert, 1 row delete, partial save, and insert read are displayed. In step S75, it is determined which menu has been selected. If it is determined that the one-row insertion menu is selected, the process proceeds from step S72 to step S76. Click the column number of the specified insertion column, and click Step S
By selecting the one-column insertion menu at 76, the columns after the designated column are moved to the right by one column. When the designated column has time data, the one-column insertion process such as automatically inserting the time data is executed by referring to the time data of the immediately preceding column.

When it is determined that the one-row delete menu is selected, the process proceeds from step S73 to step S77. By clicking the column number of the designated deletion column and selecting the one-column deletion menu in step S77, the columns subsequent to the designated column are moved to the left by one column. If the specified column has the start or end of time data, the time data is deleted. If it is determined that the partial save menu is selected, the process proceeds from step S74 to step S78. When the partial save menu is selected in step S78 after designating the start column and the end column, a dialog box is displayed, and the designated column range is displayed on the start / end page / column. Then, after inputting the file name of the partial save, the partial save button displayed in the dialog box is pressed to create the partial save file. This partial save file is stored in the symbol directory.

When the insertion read menu is selected after the insertion start column position is designated, the process proceeds from step S75 to step S79. In step S79, insertion reading processing is executed. In the insert read process, the insert read dialog box is displayed, and the start / end page / column of the specified column range is displayed. Next, select the file name and press the Insert Read button displayed in the dialog box to read the partially saved file starting at the specified position. Because you can edit the check sheet like this, if the input / output conditions are slightly different,
This can be easily handled by inserting / deleting rows and columns in the check sheet.

In the input processing of step S29 of FIG. 6, various input operations are determined by moving the mouse or pressing the click key in steps S81 to S84 of FIG. In step S85, another process is executed and the process ends. If the position of the cursor key or mouse is detected, step S
The process proceeds from step 81 to step S86. In step S86, cursor movement processing is performed. When the left mouse button is clicked while the cursor is at the column position, it is determined that there is a data input request, and the process proceeds from step S82 to step S87. In step S87, an input box is displayed. In step S88, the input data is stored in the check sheet. If the right button is double-clicked while the cursor is moved to the column position, it is determined that a delete request has been issued, and the process proceeds from step S83 to step S89. In step S89, a delete dialog box is displayed. In step S90, it is determined whether the delete button has been pressed. When the delete button is pressed, the process proceeds to step S91 and the data in the designated column is deleted.

After clicking the data that becomes the reference for time setting, click the data or column that becomes the reference for ending the time setting, move the cursor to the time item or time display field, and click the left button to display the time data. It is determined that the input request of
Move to 92. In step S92, a time input dialog box is displayed. This state is shown in FIG. When the time dialog box is displayed, the operator enters the timer name or time. When the timer name is input, the process proceeds from step S93 to step S94. In step S94, it is determined whether the input button has been pressed.
If the input button has not been pressed, the process proceeds to step S95. In step S95, it is determined whether the cancel button has been pressed. If the cancel button has not been pressed, the process returns to step S94. When the input button is pressed, the process proceeds from step S94 to step S96. In step S96, the input time is set on the check sheet. If the timer name is not input in step S93, the process proceeds to step S97. In step S97, it is determined whether time input has been performed. When the time is input, it is determined whether or not the unit is specified. If the time has been input, the process proceeds to step S94. If the time has not been input, step S93.
Return to In this way, the time can be arbitrarily entered in the table, so that the time data can be easily entered. As the timer name, the timer name registered in the timer table can be selected. This timer name usually contains the time tolerance.

In the time input process of step S96, the process shown in FIG.
In step S101 of 1, time data is registered on the check sheet. In steps S102 to S104,
Tolerance checks are made. This tolerance check is performed because the time data includes the tolerance, whereas the time data does not show the tolerance on the check sheet.

In step S102, when the time is set in the forward direction of the input position, the time data in the forward direction and the closest time data are obtained from the time data of each row. Then, the interference of the tolerance is checked between the time found in steps S103 and S104 and the input time. There are two possible cases where the tolerances interfere on the check sheet. Here, the time (time 2) that starts before the check target time (time 1) is the check target, and the time that starts after that is not the check target. First, as shown in FIG. 27A, time 1 and time 1
If the relationship with the time 2 that ends in the row before the end time of is time 1-tolerance 1 <time 2 + tolerance 2, secondly, as shown in FIG. , And the relationship with time 2 which ends in the column after the end time of time 1 is time 1 + tolerance 1> time 2−tolerance 2. These two cases are checked in steps S103 and S104.

If either of these two cases is applicable, the process proceeds to step S105. Step S105
Then, the input time displays an error dialog box indicating that the time tolerances interfere. At this time, the target time is also displayed. A forced input button and a cancel button are displayed in this dialog box. Step S1
At 06, it is determined whether the forced input button has been operated. When the forced input button is operated, the process proceeds from step S106 to step S109, the registered time data is displayed on the check sheet, and the process returns to the input routine. If the forced input button is not operated, step S10
The processing shifts from 6 to step S107. Step S107
Then, it is determined whether or not the cancel button is operated.
If the cancel button is operated, step S10
Move to 8. In step S108, step S10
Delete the time data registered in 1. If the cancel button has not been operated, the process returns to step S106.
If it is determined in steps S103 and S104 that there is no tolerance interference, the process proceeds to step S109, the registered time data is displayed on the check sheet, and the process returns to the input routine.

In the execution file creating process of step S57 of FIG. 8, the designated check sheet is read from the check sheet file in step S111 of FIG. In step S112, the format of the read check sheet is checked. In step S113, it is determined from the check result whether or not there is a format error. In the case of a format error, the process is interrupted and the process returns to the option processing routine. If it is not a format error, the process proceeds to step S114. Step S11
In step 4, the read check sheets are read column by column.

In step S115, it is determined whether or not the input condition is written in the read one column. If the input condition is written, the steps S115 to S115
Move to 116. In step S116, the output condition associated with the written input condition by the time data is searched and the relation between them is analyzed. If the input condition is not written, the process proceeds from step S115 to S117. In step S117, it is determined whether the output condition is written in one column of the read check sheet. If the output conditions are written, step S
The processing moves from 117 to S118. In step S118, it is determined whether or not the input condition associated with the time data is written in the written output condition. When the input condition is written, the process proceeds to step S116, and the output condition associated with the written input condition by the time data is searched and the relation between them is analyzed. When the analysis in step S116 is completed, the process proceeds to step S119, and based on the analysis result, pattern conversion processing is performed to convert the input condition and output condition on the check sheet into an intermediate language format program. Specifically, if the data conversion pattern information registered in the transfer data definition file is compared with the analysis result, and if there is only an input condition or if the output condition has an input condition associated with time data, Perform pattern conversion processing. When it is determined in step S117 that the output condition is not written, or when it is determined in step S118 that the input condition associated with the time data in the output condition is not written,
The analysis process and the pattern conversion process are not performed. That is, if there is only the output condition, the analysis process and the pattern conversion process are not performed, and the process proceeds to step S120.
Further, when the pattern conversion process is completed, the process proceeds to step S120.

In step S120, it is determined whether there is a next column. If there is a next column, step S11
Returning to step 4, the data in the next column is read. Step S12
If it is determined that there is no next row at 0, the process proceeds to step S121. In step S121, the converted intermediate language test program is written in the execution file 35. In this way, a test program for execution is created from the input conditions and output conditions described on the check sheet.

In the correct answer file creation process of step S58 of FIG. 8, steps S131 to S134 of FIG.
The check sheets read by the same processing as in steps S111 to S114 in step 2 are read column by column. In step S135, it is determined whether the input condition is written in the read one column. If the input condition is written, the process proceeds from step S135 to S136. In step S136, it is determined whether or not the written input condition is written with the output condition associated with the time data. If the output condition is written, the process proceeds to step S137, and the input condition related to the written output condition by the time data is searched and the relation between them is analyzed.

If it is determined in step S135 that the input condition is not written, the process proceeds to step S138. In step S138, it is determined whether the output condition is written in one column of the read check sheet. If the output condition is written, the process proceeds from step S138 to S139. In step S139, it is determined whether or not the input condition associated with the written output condition by the time data is written. When the input condition is written, the steps S139 to S1
In step 37, the output condition associated with the written input condition by the time data is searched and the relation between them is analyzed. If the input condition is not written, step S
The process moves from 139 to S140. In step S140, it is determined whether the written output condition is written with the output condition associated with the time data. If the output condition is written, the process proceeds from step S140 to S137, and the input condition associated with the written output condition by the time data is searched and the relation between them is analyzed.

When the analysis in step S137 is completed, the process proceeds to step S141, and pattern conversion processing is performed based on the analysis result to convert the input condition and output condition on the check sheet into an intermediate language format program. Specifically, the data conversion pattern information registered in the transfer data definition file is compared with the analysis result, and the pattern conversion process is performed only when the output condition is included.

On the other hand, if it is determined in steps S136, S138, and S140 that the output conditions are not written, the analysis process and the pattern conversion process are not performed, and the process proceeds to step S142. Further, when the pattern conversion process is completed, the process proceeds to step S142. Step S14
In S2 and S143, the same processing as in S120 and S121 is performed to create a correct answer file. Thus, when creating the correct answer file, the pattern conversion process is not performed when only the input condition is present, and the pattern conversion process is performed only when the output condition is included.

The execution file creation process and the correct answer file creation process are similarly performed in step S59 and step S60, respectively. In the symbol processing of step S62 of FIG. 8, step S151 of FIG.
To display the symbol processing option menu. The option menu displays five menus: an initial operation setting menu, a pattern operation setting menu, an end operation setting menu, a setting cancel menu, and a symbol registration menu. In step S152, the process waits until the start column and end column of the pattern data block are designated by the mouse. In step S153, it is determined whether the initial operation menu has been selected. In step S154, the selection of the pattern operation setting menu is waited for.
This pattern operation setting menu must be entered. When the pattern operation setting menu is selected, the process proceeds to step S155. In step S155, the pattern operation of the designated block is set. In step S156, it is determined whether the end operation designation menu has been selected. In step S157, it is determined whether the symbol registration menu is selected. It is determined whether another process is selected. If another process is selected, the process proceeds to step S159 and another process is executed.

When the initial operation setting menu is selected, the process proceeds from step S153 to step S160. In step S160, the initial operation is set. If it is determined that the end operation setting menu is selected, the process proceeds from step S156 to step S161. In step S161, the end operation is set. When these operations are completed, the operator selects the symbol registration menu. When the symbol registration menu is selected, the process proceeds from step S157 to step S162. In step S162, a symbol registration dialog box is displayed. Here, the operator inputs the symbol name. A cancel button and a registration button are displayed in the symbol registration dialog box. In step S163, it is determined whether the registration button has been operated. If the registration button has not been operated, the process proceeds to step S164. In step S164, it is determined whether the cancel button has been operated. If the cancel button has not been operated, step S16
Return to 3. If the registration button is operated, step S
The process moves from step 163 to step S165. Step S1
At 65, the time data displayed in the designated block is registered as pattern data in the pattern data file in the symbol directory.

In the test execution process of step S7 of FIG. 4, a data input screen for test execution is displayed in step S171 of FIG. This test screen is a screen similar to the data input screen for the check sheet data shown in FIG. 24, and an experiment start button and an end button are displayed at the bottom. Further, a data input screen such as the model name, check sheet version, PROM version, sheet number, etc. is displayed on the upper part. In step S172, the input of data on the data input screen is awaited. In step S173, it is determined whether or not the experiment start button has been operated. When the experiment start button is operated, steps S173 to S173
Moving to 174.

In step S174, it is determined whether or not the continuous execution file list 38 exists. That is, it is determined whether or not there are a plurality of check sheet files that are continuously executed. If there are no plural check sheet files to be continuously executed, the process proceeds from step S174 to S175. In step S175, a test process shown in FIG. 16 described later is executed. If there are a plurality of check sheet files to be continuously executed, the process proceeds from step S174 to S176. In step S176, the continuous execution file list 3
The check sheet file name is sequentially read from No. 8, and the check sheet having the check sheet file name is read from the check sheet file 38. In step S177, the continuous execution process of FIG. 18 described later is performed. Step S
At 178, it is determined whether all check sheet files to be continuously executed in the continuous execution file list 38 have been read. If the check sheet file still exists, the process returns to step S176. Here, by registering the names of a plurality of check sheet files in the execution sequence list 38 in the order of execution and executing them in order, it is possible to easily execute a test plan that spans a plurality of check sheet files. For this reason, by creating multiple check sheet files that are subroutines of the test plan,
Standardize test plans.

If it is determined in step S173 that the experiment start button has not been operated, or if it is determined in step S178 that all continuous execution files have been read, the process proceeds to step S179. In step S179, it is determined whether the end button has been operated. When the end button is operated, the process returns to the main routine, and when the end button is not operated, the process returns to step S172.

In the test process of step S175, the test process of FIG.
In step S181 of 6, a check sheet for test execution is displayed. An example of this display screen is shown in FIG. Here, the check sheet of the execution part is displayed on the left part of the screen, and the input item and output item currently being executed and its input data and output data are displayed on the right half. Further, at the bottom, seven buttons for M input (manual input), continuous execution, one-column execution, start column, breakpoint, execution interruption, and end are displayed.

In steps S182 to S188, it is determined which button has been operated. When it is determined that the M input has been operated, steps S182 to S1
Move to 90. In step S190, a manual input process described later is performed. This manual input process is performed when changing the data of the input item or the output item during execution. If this manual input is selected, new input can be made in the check sheet display field. If it is determined that the continuous execution button has been operated, the process proceeds from step S183 to step S191. In step S191, the continuous execution process shown in FIG. 18 is performed. If it is determined that the one-column execution processing button has been selected, steps S184 to S184
Move to 192. In step S192, the current line is set to 1
A one-column execution process for executing only columns is performed. If it is determined that the start row button has been operated, the process proceeds from step S185 to step S193. In step S193, a start column for continuous execution is designated. If it is determined that the break point button has been operated, the process proceeds from step S186 to step S194. In step S194, it is determined whether or not the start column is preset. When the start column is set, the specified column is set as the end column for continuous execution. You cannot set a breakpoint if the start column is not set. When another process is selected, the process proceeds from step S187 to step S196. In step S196, another selected process is executed.

In the manual input process of step S190, the manual input screen in which the lower buttons of FIG. 28 are different is displayed in step S201 of FIG. On this manual input screen, a one-row execution button and an end button are displayed at the bottom. In step S202, it is determined whether the one-row execution button has been operated. If it is determined that the 1-row execution button is not operated, the process proceeds to step S203. In step S203, input processing for the check sheet is performed. In step S204, it is determined whether the end button has been operated. If the end button has not been operated, the process returns to step S201. When the end button is operated, the process returns to the routine shown in FIG.

If it is determined that the one-column execution button has been operated, the process proceeds from step S202 to step S205. In step S205, the output signals from the peripheral simulators 4a to 4e are fetched. In step S206, a pattern conversion input signal is generated from the input contents of the check sheet. In step S207, the peripheral simulator 4
The generated input signals are output to a to 4e. The peripheral simulators 4a to 4e operate by this, and the operation result is recorded as an execution result record in step S208. As described above, in the manual input processing, the test program can be rewritten and the rewritten test program can be sequentially executed. Therefore, it is possible to easily perform a simulation operation in which the input condition and the output condition are changed little by little and the execution result is confirmed.

In the continuous execution processing of step S191 of FIG. 16, the execution file is read in step S211 of FIG. In step S212, it is determined whether the execution interruption button has been operated. When the execution suspend button is operated, the process is terminated and the process returns to the original routine. Step S213
Then, it is determined whether or not the file has ended. this is,
This is done by determining the EOF of the file. If it is determined that the file has not been completed, the process proceeds to step S214. In step S214, the peripheral simulator 4a
Capture the output signal from ~ 4e. In step S215, it is determined whether the operating condition is OK. Here, the operation condition is a condition for determining whether or not all values (including a range) of one or a plurality of operation results are correct. Step S21
At 6, it is determined whether the time condition is OK. If either the operating condition or the time condition is OK, step S2
Go to 17. In step S217, the input signals to the peripheral simulators 4a to 4e are output. Then, the peripheral simulators 4a to 4e operate by this, and the execution result is recorded in the execution result file column by column. The result of this execution is displayed momentarily in the right column of the display screen. As described above, by checking not only the time condition but also the operation condition, the operation time is different each time when controlling a device that performs a mechanism operation such as a stepping motor that operates regardless of input operation. However, you can test under the same conditions.

In the result collating process of step S8 of FIG.
In step S221 of FIG. 19, a data input screen for result matching is displayed. This data input screen is the same screen as the data input screen of the check sheet shown in FIG. However, a result collation button and an end button are displayed at the bottom. Further, a data input screen is displayed on the upper part. In step S222, the process waits until data is input on the data input screen. The data required here is the model name,
A check sheet version, a PROM version, and a sheet number. In step S223, it is determined whether or not the result matching button has been operated. In step S224, it is determined whether the end button has been operated. If it is determined that the result matching button has been operated, the process proceeds from step S223 to step S225. In step S225, it is determined whether the item file already exists. If the item file does not exist, the process moves to step S226 and the fact is output to the error output file. If there is an item file, the process proceeds to step S227, and collation processing is executed. When the end button is operated, the result matching process is ended and the process returns to the main routine.

In the collation processing in step S227, the process shown in FIG.
In step S231, the check sheet screen is displayed. This check sheet screen is displayed as shown in FIG.
The execution result is displayed in check sheet format on the left side, and the evaluation result is displayed in check sheet format on the right side. In addition, the front error button to move to the error point in the front direction at the bottom,
Backward error button to move to the backward error location, right / left alignment button to align the display column position on the right with the left screen as a reference, result display button to display the results, and data after exiting the verification screen Five buttons, which are end buttons for returning to the input screen, are displayed. Also on the top,
The option menu is displayed. As the option menu here, menus such as thinning processing, creation of a matching result file, reading of a log file, reading of a thinning file, reading of a CM file, etc. are displayed. In step S232, it is determined whether the option menu has been operated. In step S233, it is determined whether or not the previous error button has been operated. Step S23
In step 4, it is determined whether the back error button has been operated. In step S235, it is determined whether or not the result display button has been operated. In step S236, it is determined whether the end button has been operated. When it is determined that the end button has been operated, the original routine is returned to. Note that the description of the left / right alignment button is omitted here.

If it is determined that the option menu has been selected, the process proceeds from step S232 to step S233. In step S233, the matching option menu is displayed and any one of the selected menus is further executed. Detailed description thereof will be omitted. If it is determined that the previous error button has been operated, the process proceeds from step S233 to step S238. Step S
At 233, the cursor is moved to the error location in the forward direction. If it is determined that the rear error button has been operated, the process proceeds from step S234 to step S239. Step S
At 239, the cursor is moved to the error position in the backward direction. If it is determined that the result display button has been operated, the process proceeds from step S235 to step S240. Step S
At 240, a result display process described later is performed.

In the result display processing of step S240, the screen display shown in FIG. 29 is performed in step S241 of FIG. The execution evaluation result is displayed on the right side of the screen as described above. In step S242, thinning processing is executed. In this thinning-out process, for items whose values change continuously, as shown in FIG. 30A, only the data of the change point of the state is displayed. Thinning-out processing is performed for this display. For example, the apparatus body 1 receives all data as test result data when data is continuously transferred from the peripheral simulators 4a to 4e. This state is shown in FIG. Up to this point, all the test result data 2 to 10 result in an error when collating the results, so the data thinning process is performed according to the following rules.

(1) Information on a change point (change angle) is taken out using the thinning interval time (set in the transfer data conversion definition file) set for each data. (2) If the value does not change over the thinning interval time, it is considered stable and the value is confirmed. This state is shown in FIG.
It is shown in (C). In this way, the basic idea of thinning is to perform a range check by the thinning interval 1 and the value tolerance for each angle change point,
Small changes (changes in the value tolerance within the thinning interval of 1 hour) data are regarded as mid-change data and the values are thinned. That is, as shown in FIG. 30D, it is determined whether the data 2 is to be thinned out of the two data 2 and 3 within the thinning interval 1.
It is determined by looking at the values of data 1 and data 3 before and after and the direction. Here, thinning is performed in three stages. First of all
At the stage, in order to extract characteristic data, even minute data whose direction has changed is not thinned out. For example, in the thinning interval 1 in FIG. 30D, when the values of data 2 and data 3 are equal, data 3 is unconditionally thinned. In the second stage, if there is slight change data even if the direction changes, it is thinned out. For example, if the data 2 and the data 3 have the same value within the thinning interval 1 and the time interval is within the designated time (thinning interval 2), the data 3 is thinned. In the third stage, when the data 1, 2, 3 are the same, the data 2 is thinned out regardless of the thinning interval. Thus, the thinning process is performed in three stages.

In step S243, the thinned execution result is decomposed into item units and stored in the item unit result file. In step S244, it is determined whether reading of all execution result files has been completed. When the reading is completed, the process proceeds to step S245, the result file is subjected to reverse pattern conversion into the check sheet format, stored in the check sheet file, and displayed on the left side of the screen. In this case, refer to the conversion pattern definition file. If the file is not the end, the process moves to step S247.
In step S247, correct answer candidates are extracted from the execution result. In step S248, the value closest to the correct answer value among the obtained correct answer candidates is recognized as the correct answer. Step S
At 249, the periodic operation is extracted and its correct answer is determined. In step S250, correctness determination information is added to the result file. The added result file is stored in the matching result file.

In the periodic motion correct answer determination processing in step S249, it is determined in step S251 in FIG. 22 whether there is an initial motion definition. If there is an initial action definition, the process proceeds to step S252. In step S252, collation processing is performed to search for an initial operation until there is next output data or the end of the file. In step S253, it is determined whether there is a pattern action definition. If it is determined that there is a pattern operation definition, the process proceeds to step S254, and pattern start position data is searched until there is next output data or the end of the file. Step S22
At 5, it is determined whether or not there is start position data. If there is start position data, the pattern is confirmed, and the remaining data is applied to the confirmed pattern, as shown in FIG. In step S257, it is determined whether the pattern end position is reached. If it is not the pattern end position, step S
Move to 258. In step S258, the correctness determination is performed. If the answer is correct, the process returns to step S257 to repeat the correctness determination up to the pattern end position. If the answer is not correct, the process proceeds to step S259, the error output is output to the error file, and the process returns to step S257.

If it is determined that the pattern end position, step S
The processing moves from 257 to step S260. Step S2
At 60, it is determined whether or not there is an end action definition. If there is no end action definition, the process ends and returns to the result display routine, and if there is an end action definition, step S26.
Move to 1. In step S261, the end column is searched and the end operation is applied retroactively to the end operation time.

In this pattern operation matching process, the normal matching process is performed in the first stage, and the symbol matching process is performed in the second stage. For symbol matching, the initial operation is searched from the symbol start column. Also, the start data of the pattern operation is searched. Then, the pattern operation is confirmed and the remaining data is applied. The repeated pattern is searched up to the position where the next output data is entered, and if there is an end action definition, the end column is found, the end action time is reversed, and the end action is applied.

[0083]

According to the automatic test apparatus and method for control software of the present invention, since the test plan is created in the form of a table, the test plan can be easily created and the test contents can be intuitively understood. Further, since the test is executed including the operation condition in addition to the time condition, the test can be automatically executed even in the case of a device whose operation status is unstable.
Further, since the test result is evaluated including the physical error, it can be automatically evaluated even if the test result physically changes.

In the control software test plan input device and method according to the present invention, since the test plan in which the input condition and the output condition for the control device are associated with the time data is input in the form of a table, the test plan can be easily input. And can intuitively judge the test contents. In the control software test execution device and method according to the present invention,
In addition to the time condition, the operating condition is also judged and the input condition is output to the control device. Therefore, even if the operating condition is not stable, the operating condition can be judged to automatically test without monitoring. I can do it.

In the control software test result evaluation apparatus and method according to the present invention, the correct answer data and the test result are collated based on the evaluation reference data including the physical error, so that the test result has no physical error. Even if included, test results can be correctly and automatically evaluated.

[Brief description of drawings]

FIG. 1 is a block configuration diagram of an automatic test apparatus for control software according to an embodiment of the present invention.

FIG. 2 is a block diagram of a test apparatus body.

FIG. 3 is a diagram illustrating a file structure.

FIG. 4 is a flowchart of a main routine.

FIG. 5 is a flowchart of check sheet processing.

FIG. 6 is a flowchart of sheet input processing.

FIG. 7 is a flowchart of file processing.

FIG. 8 is a flowchart of option processing.

FIG. 9 is a flowchart of edit processing.

FIG. 10 is a flowchart of input processing.

FIG. 11 is a flowchart of time input processing.

FIG. 12 is a flowchart of an execution file creation process.

FIG. 13 is a flowchart of correct answer file creation processing.

FIG. 14 is a flowchart of symbol processing.

FIG. 15 is a flowchart of test execution processing.

FIG. 16 is a flowchart of test processing.

FIG. 17 is a flowchart of manual input.

FIG. 18 is a flowchart of continuous execution processing.

FIG. 19 is a flowchart of result matching processing.

FIG. 20 is a flowchart of matching processing.

FIG. 21 is a flowchart of a result display process.

FIG. 22 is a flowchart of periodic operation correct answer determination processing.

FIG. 23 is a diagram showing an initial screen.

FIG. 24 is a diagram showing a check sheet data input screen.

FIG. 25 is a diagram showing a check sheet editor screen.

FIG. 26 is a diagram showing a time input screen.

FIG. 27 is a diagram for explaining tolerance interference.

FIG. 28 is a diagram showing a check sheet screen when a test is executed.

FIG. 29 is a view showing a check sheet screen at the time of collation processing.

FIG. 30 is a diagram illustrating thinning processing.

FIG. 31 is a diagram illustrating correct answer determination when there is a timer tolerance.

FIG. 32 is a diagram showing pattern operation definition.

[Explanation of symbols]

 1 Test device main body 2 Microcomputer 3 Microcomputer mounting part 4a-4e Peripheral simulator 5a-5c Optical loop network 10 CPU 12 Mouse 13 CRT display 14 Memory 15 External storage device

Claims (23)

[Claims] 1. An automatic test device for control software, which automatically executes a test of control software used in a control device in which an input device and an output device to be controlled are connected, for executing the tests in sequence. A test apparatus main body for creating a test plan in the form of a table, determining and executing the test plan including a time condition and an operating condition, and evaluating a test result including a physical error, and the input device. And a port for connecting a peripheral simulator for simulating the operation of the output device, and a mounting part for mounting a control device operated by the control software, and a test target part connected to the test device main body. And an automatic control software tester equipped with. 2. The automatic test apparatus for control software according to claim 1, wherein the test apparatus main body has an optical input / output board for connecting to the peripheral simulator and the test target section by an optical loop network. 3. The test apparatus main body executes a control program based on the created test plan, and creating means for creating a test plan in which input conditions and output conditions for the control apparatus are associated with time data. 3. The control software automatic test apparatus according to claim 1, further comprising: an executing unit that outputs a test result and an evaluating unit that evaluates the test result output from the executing unit. 4. An automatic test device for control software, which automatically executes a test of control software used in a control device in which an input device and an output device to be controlled are connected to each other. Creating means for creating a test plan in which output conditions are associated with time data, executing means for executing the control software and outputting a test result based on the created test plan, and a test output by the executing means An automatic test device for control software, comprising: evaluation means for evaluating the result. 5. The creating means includes an input means for inputting the test plan in which input conditions and output conditions for the control device are associated with time data in a row and column table format, and an input table format of the input table format. 5. An automatic test apparatus for control software according to claim 3, further comprising an editing unit for editing a test plan. 6. The creating means further comprises a converting means for interpreting the content of the input test plan in the tabular format and interpreting the relevance of each input condition and output condition to convert the test file into an executable test file. An automatic test apparatus for control software according to claim 5. 7. The correct data generating means for generating correct answer data for evaluating the test result by interpreting the relationship between each input condition and output condition from the contents of the inputted tabular test plan. 6. The method according to claim 5, further comprising:
Alternatively, the control software automatic test device according to the item 6. 8. The input means is capable of inputting time data with a time tolerance added, and further comprises a tolerance determining means for determining whether or not the time tolerances of the input time data interfere with each other. An automatic test device for control software according to any one of claims 5 to 7, wherein: 9. The execution means determines an operation condition determining means for determining whether an output condition of the execution result satisfies a predetermined operation condition, and determines whether the output condition satisfies a predetermined time period. And a simulated input signal output means for inputting an input condition associated with the output condition with time data to the control device when either of the two condition determination means determines that the condition is satisfied. An automatic test apparatus for control software according to claim 3, further comprising: 10. The automatic test apparatus for control software according to claim 3, wherein the execution unit further includes a table format output unit that converts the test result into the table format and outputs the table result. 11. The pre-execution means includes a test range designation means for designating a test range, a continuous test execution means for continuously testing the designated test range based on the test plan, and a designated input condition or output. 11. The control software automatic test apparatus according to claim 3, further comprising a single test execution unit that executes only one condition. 12. The executing means comprises a test plan specifying means for specifying one or a plurality of test plans to be executed, and a test plan continuous executing means for continuously executing the specified one or a plurality of test plans. The automatic test apparatus for control software according to claim 3, further comprising: 13. The evaluation means includes an evaluation reference data storage means for storing evaluation reference data including a physical error, the correct answer data created by the correct answer data creating means, and the test result. 13. The control software automatic test device according to claim 7, further comprising a collating unit that collates based on the above, and creates evaluation result data. 14. The automatic control software according to claim 13, further comprising result display means for displaying the evaluation result data created by the collating means side by side with the input test result in the table format in a table format. Test equipment. 15. The automatic test apparatus for control software according to claim 13, wherein said evaluation means further comprises a thinning means for thinning out the changing data among the changing test execution results. 16. The matching means comprises a first matching means for matching a test result with correct answer data, a pattern searching means for searching a first pattern of a test result in which patterns are continuous, a searched pattern and a subsequent continuous pattern. 14. The second collation means for collating the pattern to be collated is provided.
6. The control software test apparatus according to any one of 5 above. 17. A test plan input device of control software for inputting a test plan of control software used in a control device to which an input device and an output device are connected, the input condition and the output condition for the control device being set. An input means for inputting the test plan associated with the time data in a row and column table format, an editing means for editing the input tabular test plan, and the tabular test plan in an execution format. A test plan input device for control software, comprising: a conversion means for converting into a test file. 18. A control software test execution device for automatically performing a test of control software used in a control device to which an input device and an output device are connected, the output result of the execution result being a predetermined operation condition. An operating condition determining means for determining whether or not the condition is satisfied, a time condition determining means for determining whether or not the output condition satisfies a predetermined time condition, and one of the two condition determining means satisfies the condition. A control software test execution device comprising: a simulated input condition output means for outputting to the control device an input condition associated with the output condition by time data when judged. 19. A test result evaluation device of control software for evaluating a test result of control software used in a control device to which an input device and an output device are connected, the test result storing means storing the test result, and a correct answer. Correct answer data storage means for storing data, evaluation reference data storage means for storing evaluation reference data including physical error, correct answer data stored in the correct answer data storage means, and test stored in the test result storage means A test result evaluation device for control software, comprising: a collating unit that collates the result with the evaluation standard data to create the evaluation result data. 20. A control software automatic test method for automatically testing control software used in a control device in which an input device and an output device to be controlled are connected, the input condition and the output condition for the control device. A test process that creates a tabular test plan that is associated with time data, an execution process that executes the control software and outputs test results based on the created test plan, and a test result that is output in the execution process. And an automatic test method of control software including an evaluation step for evaluating. 21. A control software test plan input method for inputting a test plan of control software used in a control device to which an input device and an output device are connected, comprising: inputting conditions and output conditions for the control device. An input process for entering a test plan associated with time data in a row and column table format, an editing process for editing the entered tabular test plan, and an execution process for executing the tabular test plan. A control software test plan input method including a conversion process of converting to a test file. 22. A control software test execution method for automatically performing a test of control software used in a control device to which an input device and an output device are connected, wherein an output condition of an execution result is a predetermined operation condition. An operation condition determining step of determining whether or not the condition is satisfied, a time condition determining step of determining whether the output condition satisfies a predetermined time condition, and one of the two condition determining steps satisfies the condition. When the determination is made, a control software test execution method including a simulated input condition output step of outputting to the control device an input condition associated with the output condition by time data. 23. A test result evaluation method of control software for evaluating a test result of control software used in a control device to which an input device and an output device are connected, comprising correct answer data and a test result created based on a test plan. And a step of matching based on the evaluation reference data including a physical error, and a step of creating evaluation result data based on the matching result,
Control software test result evaluation method including.