JPH06103114A - Method for evaluating test program - Google Patents

Abstract

PURPOSE:To evaluate whether the interference of all test programs is present or not without executing all test units and all test programs by altering a working HW(hardware) part whose initial value is indefinite, used by the test program, at the time of starting to execute a test. CONSTITUTION:An SW(software) simulator 13 detects the start notice of a test unit from the test unit start informing part 111 of a monitor 11, as a processing at the time of starting a test unit, and by an HW state setting part 132, whether the start notice of the test unit is present or not is detected, and in the case the start notice is not present, a processing is not executed, and in the case the start notice is prevent, a specific pattern is set to the working HW part of HW model information 131 in accordance with the instruction of a working HW instructing part 133. In this case, since the working HW part whose initial value is indefinite, for which a test program may be used is altered, when the test unit uses it and is not setting an expected initial value, an abnormal operation is generated, and it is decided that an interference problem is present on the test unit.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a test program evaluation method for testing an information processing system, and more particularly to a test program evaluation for confirming that there is no mutual interference between a plurality of test programs. Regarding the method.

[0002]

2. Description of the Related Art A conventional evaluation method for confirming that there is no mutual interference between test programs when testing an information processing system using a plurality of test programs is performed when one test program is executed. , To confirm that the test program does not affect other test programs, after executing the test unit to be checked, execute all the test units of the test program including the test unit, and After executing the test program to be confirmed, all test programs are executed to confirm that there is no abnormality.

[0003]

A conventional test program evaluation method for confirming that there is no mutual interference between test programs as described above is applied to evaluation in a software simulator (SW simulator).
Since the SW simulator is orders of magnitude slower than the execution time in hardware (HW), it takes a long turnaround time and requires a large amount of CPU resources, so that the evaluation cannot be realistically performed. It has the drawback of

An object of the present invention is to evaluate a mutual interference of test programs by using a SW simulator, which does not take a long turnaround time and requires a large amount of CPU resources. To provide.

[0005]

SUMMARY OF THE INVENTION A test program evaluation method according to the present invention comprises a software simulator having a monitor for executing a plurality of test programs having at least one test unit and an operating system for executing the software simulator as an application program. A method for evaluating a test program for evaluating mutual interference between programs, comprising a working hardware instruction section for designating to the software simulator working hardware model information with an undefined initial value used by the test program, and the working hardware. A hardware state setting unit that sets a specific pattern in a designated hardware portion in the model information is provided, and the monitor detects the start of the test unit and notifies the software simulator. A test unit start notification unit is provided, and when the software simulator receives a notification of the start of the test unit from the test unit start notification unit in the monitor, the hardware state setting unit causes the working hardware instruction unit to Setting the specific pattern in the working hardware portion of the test program according to an instruction, and further setting in the working hardware portion of the test program instructed by the working hardware instruction unit in the software simulator. A pattern designating section for designating a specific pattern is provided, and the particular pattern is set in the working hardware portion designated by the working hardware designating section at the start of the test unit. .

Further, the test program evaluation method of the present invention is such that mutual interference of the test programs is caused by an operating system which executes a software simulator having a monitor for executing a plurality of test programs having at least one test unit as an application program. A method for evaluating a test program for evaluating the hardware, wherein the software simulator sets a specific pattern in a specified hardware portion in working hardware model information with an undefined initial value used by the test program. Provide a state setting section,
The monitor is provided with a test unit start notification unit that detects the start of the test unit and notifies the software simulator, a disk device is connected to the software simulator, and the working hardware model information is specified to the disk device. When the software simulator receives a notification of the start of the test unit from the test unit start notification unit in the monitor, the working hardware instruction unit is provided by the hardware status setting unit. The setting of the specific pattern in the working hardware of the test program according to the instructions of the above, and further, the working hardware of the test program instructed by the working hardware instruction section in the software simulator. A pattern designating section for designating a specific pattern to be set in the part, so as to set the specific pattern in the working hardware section designated by the working hardware designating section at the start of the test unit. It was done.

Further, the test program evaluation method of the present invention is characterized in that a software simulator having a monitor for executing a plurality of test programs having at least one test unit executes mutual interference of the test programs by an operating system which executes the software simulator as an application program. A method of evaluating a test program for performing an evaluation, comprising: a working hardware instruction section that specifies working hardware model information with an undefined initial value used by the test program in the software simulator, and the working hardware model information. A hardware status setting unit that sets a specific pattern on a designated hardware part, a hardware status setting value that stores data to be set in the hardware status setting unit, and the hardware status. A hardware state set value setting unit that receives the notification of the start of the test unit when the set value does not store the data, extracts the state value of the hardware part, processes it, and stores it in the hardware state set value. And a test unit start notification unit that detects the start of the test unit and notifies the software simulator to the monitor, and the software simulator starts the test unit from the test unit start notification unit in the monitor. When the hardware state setting value is not stored, the hardware state setting value setting unit sets the data, and the hardware state setting unit sets the working hardware instruction unit to As specified in the working hardware part of the test program according to the instructions Including the setting of a pattern, further, the software simulator is provided with a processing instructing section for instructing a processing method when extracting and processing the state value of the hardware portion in the hardware state setting value setting section, When the software simulator receives a notification of the start of the test unit from the test unit start notification unit being monitored and sets the hardware state set value, the processing is performed by an instruction from the processing instruction unit. is there.

Further, the test program evaluation method of the present invention is such that mutual interference of the test programs is caused by an operating system that executes a software simulator having a monitor for executing a plurality of test programs having at least one test unit as an application program. A method for evaluating a test program for evaluating the hardware, wherein the software simulator sets a specific pattern in a specified hardware portion in working hardware model information with an undefined initial value used by the test program. When the status setting unit and the hardware status setting value do not store data, the status value of the hardware part is extracted and processed by receiving the notification of the start of the test unit and the hardware status setting value of the disk device is set. And a hardware status setting value setting section for storing the hardware status setting value, and a working hardware instruction section for connecting the disk apparatus to the software simulator to specify the working hardware model information to the disk apparatus and the hardware status setting section. The hardware state setting value for storing the data to be set is provided, and the monitor is provided with a test unit start notification unit that detects the start of the test unit and notifies the software simulator of the start of the test unit. When a notification of the start of the test unit is received from the test unit start notification unit being monitored, if no data is stored in the hardware state set value, the hardware state set value setting unit sets the data. The working status is set by the hardware status setting unit. It includes setting the specific pattern in the working hardware part of the test program according to the instruction of the hardware instructing part, and further, in the software simulator, the state value of the hardware part in the hardware state setting value setting part. A machining instructing section is provided for instructing a machining method when taking out and machining, and the software simulator receives the notification of the start of the test unit from the test unit start notifying section being monitored and sets the hardware state set value. In doing so, processing is performed according to an instruction from the processing instruction section.

[0009]

Embodiments of the present invention will now be described with reference to the drawings.

FIG. 1 is a schematic diagram showing the configuration of the first embodiment of the present invention, FIG. 9 is a block diagram showing the details of the test program of FIGS. 1 to 8, and FIG. 10 is a monitor of FIGS. FIG. 11 is a flowchart showing the operation, FIG. 11 is a flowchart showing the operation of the SW simulator of FIGS. 1 to 8, and FIG.
5 is a flowchart showing the operation of the HW state setting unit of the SW simulator of FIG.

In the embodiment shown in FIG. 1, the SW simulator 13 is used.
And an operating system (OS) 12. The SW simulator 13 is executed as an application program on the OS 12, and the monitor 11 is executed on the SW simulator 13. Further, the test program 91 is executed under the control of the monitor 11.

The SW simulator 13 includes hardware model information (HW model information) 131, a hardware state setting section (HW state setting section) 132, and a working hardware instruction section (working HW instruction section) 133. There is.

As shown in FIG. 9, the test program 91 is one of the test programs 91 to 9m and includes test units 911 to 91n.

The operation of the test units 911 to 91n first sets an environment for executing the test (step 9111), then executes the test (step 9112), as illustrated in step 1002 of FIG. A process is performed to restore the environment of the executed test so as not to affect the next test (step 9113).

The monitor 11 includes a test unit start notification unit 1
As shown in FIG. 10, after performing the step (monitor processing) 1001 commonly performed before the execution of the step (test unit) 1002, the test unit 911 of the step (test unit) 1002 is included. Is executed, and then a common monitor process after the execution of the test unit 911 is executed (step 1003).

In the monitor processing of step (monitor processing) 1001, the monitor 11 notifies the SW simulator 13 of the start of the test unit 911 by the test unit start notification unit 111. SW simulator 13 is H
The W state setting unit 132 is provided, and as shown in FIG. 11, the instruction counter (I
The instruction fetch process for fetching the instruction in the memory indicated by C) is performed (step 1101), the instruction decode process for checking the code of the fetched instruction is performed (step 1102), and then the instruction code is followed. Performs individual instruction processing to execute individual instructions (step 1
103) Next, the instruction word length of the instruction just executed is added to the IC (step 1104), and then events such as timer and program interrupt are checked and event polling processing for these events is performed (step 110).
5). The above process is repeated.

As shown in FIG. 12, the SW simulator 13 starts the test unit 911 from the test unit start notification unit 111 of the monitor 11 as the process at the time of starting the test unit in the event polling process in step 1105 described above. The notification is detected, and the presence or absence of the start notification of the test unit is detected by the HW state setting unit 132 (step 1201). If there is no start notification, the process at the start of the test is not performed and the next process is performed. If there is, a specific pattern is set in the working HW portion of the HW model information 131 according to the instruction of the working HW instruction unit 133 (step 1204).

In general, since the working HW part with an undefined initial value which may be used by the test program has been modified, the test unit 911 does not use this to set the desired initial value. Unit 9
It is understood that the test unit 911 has an interference problem because an abnormal operation such as an error detection report or an abnormal state occurs at 11. Test unit 9 eliminates this interference problem
It is possible to evaluate the interference of the test unit 911 by confirming that the test unit 911 normally terminates or by confirming that there is no interference problem originally. This process is also applied to other test units to evaluate interference of all test units.

FIG. 2 is a schematic diagram showing the configuration of the second embodiment of the present invention.

The embodiment of FIG. 2 has the same configuration as that of the embodiment of FIG. 1 except that a pattern designating section 236 is added to the SW simulator 23. The pattern designation unit 236 is a start parameter for starting the SM simulator 23 as an application program, or the SM simulator 2
HW as a parameter that 3 receives via OS12
The pattern setting unit 232 is designed to give a pattern instruction for setting a state for the working HW. By setting a specific pattern for the working HW portion in step 1204 of FIG. 12 based on this pattern instruction, the state setting intended by the evaluator of the test program is set, or the test program evaluation that allows evaluation by a plurality of patterns is performed. Become a system.

FIG. 3 is a schematic diagram showing the configuration of the third embodiment of the present invention.

In the embodiment of FIG. 3, the working HW instruction section 133 of the SM simulator 13 of the embodiment of FIG. 1 is deleted,
Instead, the disk device 14 is connected, and the disk device 14 is provided with a working HW instruction section 141. Since the working HW instruction unit 141 can be easily changed by using a standard tool such as an editor on the OS 12, even if the working HW unit with undefined initial values used by the monitor 11 or the test programs 91 to 9m changes. Thus, the test program evaluation system can be easily coped with without changing the SM simulator 33.

FIG. 4 is a schematic diagram showing the structure of the fourth embodiment of the present invention.

In the embodiment of FIG. 4, the working HW instructing section 133 of the SM simulator 23 of the embodiment of FIG. 2 is deleted,
Instead, the disk device 14 is connected and the working HW instructing section 141 is provided in the disk apparatus 14, and the pattern specifying section 236 is added to the embodiment of FIG. The pattern designation unit 236 is shown in FIG.
In the same manner as in the first embodiment, the HW state setting unit 232 sets the state for the working HW as a start parameter for starting the SM simulator 43 as an application program or a parameter received by the SM simulator 43 via the OS 12. This is a pattern instruction. By setting a specific pattern for the working HW portion in step 1204 of FIG. 12 based on this pattern instruction, the state setting intended by the evaluator of the test program is set, or the test program evaluation that allows evaluation by a plurality of patterns is performed. Become a system. The working HW instructing unit 141 can be easily changed by using a standard tool such as an editor on the OS 12 as in the embodiment of FIG. 3, so that the initial values used by the monitor 11 and the test programs 91 to 9m can be changed. Even if the indefinite working HW part changes, it is easy and SM simulator 4
It becomes a test program evaluation system that can cope with 3 changes.

FIG. 5 is a schematic diagram showing the structure of the fifth embodiment of the present invention.

In the embodiment shown in FIG. 5, the SW simulator 13 of the embodiment shown in FIG.
It may have a configuration in which a state setting value setting unit) 534 and a hardware state setting value (HW state setting value) 535 are added, and other configurations are the same as those in the embodiment of FIG. In the present embodiment, the process at the start of the test unit and the process shown in FIG.
As shown in step 3, when there is a notification of the start of the test (step 1
301), the status setting for the working HW is performed using the value of the HW status setting value 535 (step 1304).
At this time, when the value of the HW state set value 535 is not set (step 1302), the HW model state is extracted from the working HW portion of the HW model information 531 according to the instruction of the working HW instruction unit 533, and the HW state set value setting unit is set. At 534, processing such as writing inversion data is performed and H
The value is stored in the W state set value 535 (step 1303).

FIG. 6 is a schematic diagram showing the structure of the sixth embodiment of the present invention.

The embodiment of FIG. 6 has the same configuration as that of the embodiment of FIG. 5, except that a processing instruction section 637 is added to the SW simulator 63. The processing instruction unit 637 is a start parameter for starting the SM simulator 63 as an application program, or the SM simulator 63 is an OS.
As a parameter received via 12, the HW state set value setting unit 634 is instructed to process the pattern to be set to the HW state set value 535. Working HW instruction section 5
According to 33, the HW model state is taken out from the working HW part of the HW model information 131, based on the fetched data, processing is performed according to a designated processing rule such as inversion and the HW state set value 535 is set. Store. As a result, the test program evaluation system is capable of setting the state intended by the evaluator of the test program or performing evaluation based on a plurality of patterns.

FIG. 7 is a schematic diagram showing the structure of the seventh embodiment of the present invention.

In the embodiment of FIG. 7, the working HW instructing section 533 and the HW of the SM simulator 53 of the embodiment of FIG.
The status set value 535 is deleted, the disk device 74 is connected instead, and the working HW instruction unit 74 is connected to the disk device 74.
1 and the HW state set value 742 are provided. Further, even if the size is changed due to the change of the working HW instruction unit 741, the size of the HW state set value 742 can be expanded on the disk device 74 without changing the SM simulator 53. It may be defined as an area. At this time, it is possible to flexibly deal with the size change by setting a large area or adopting a dynamic assigning method.

FIG. 8 is a schematic diagram showing the structure of the eighth embodiment of the present invention.

In the embodiment of FIG. 8, the working HW instruction section 533 and the HW of the SM simulator 63 of the embodiment of FIG. 6 are used.
The status set value 535 is deleted, the disk device 74 is connected instead, and the working HW instruction unit 74 is connected to the disk device 74.
1 and the HW state set value 742 are provided, and the processing instruction section 637 is added to the embodiment of FIG. The processing instruction unit 637 is an SM as an application program, as in the embodiment of FIG.
As a starting parameter for starting the simulator 83 or a parameter received by the SM simulator 83 via the OS 12, the HW state set value setting unit 734 is instructed to process the pattern set to the HW state set value 742. The HW model state is extracted from the working HW section of the HW model information 131 according to the working HW instruction section 741, and based on the extracted data, processing is performed according to a specified processing rule such as inversion and the HW state is set. It is stored in the set value 742. As a result, the test program evaluation system is capable of setting the state intended by the evaluator of the test program or performing evaluation based on a plurality of patterns.
Further, the working HW instructing unit 741 can be easily changed by using a standard tool such as an editor on the OS 12 as in the embodiment shown in FIG. 7, and is therefore used by the monitor 11 and the test programs 91 to 9m. Even if the working HW part with undefined initial values changes, it is easy and the SM simulator 8
It becomes a test program evaluation system that can cope with 3 changes.

In each of the above-mentioned embodiments, by executing one test unit without executing all the test units and all the test programs as in the conventional case, the presence or absence of interference of all the test units, that is, all the test programs. The presence or absence of interference can be evaluated.

[0034]

As described above, the evaluation method of the test program of the present invention changes the working HW part with an undefined initial value by changing the working HW part with undefined initial value at the start of the test execution. Without setting, accidentally the expected value causes abnormal operation or abnormal status such as a normally ended test unit to report error detection, so all test units and all test programs are not executed. However, there is an effect that it is possible to evaluate the presence / absence of interference of all test units by executing one test unit, that is, the presence / absence of interference of all test programs. Therefore, a lot of CPU resources are not required and the turnaround time Has the effect of shortening Further, since the value is changed in one test unit and returned to the original value in the next test unit, there is an effect that it is possible to evaluate a case that cannot be found by the conventional evaluation method.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing a configuration of a first exemplary embodiment of the present invention.

FIG. 2 is a schematic diagram showing a configuration of a second exemplary embodiment of the present invention.

FIG. 3 is a schematic diagram showing a configuration of a third exemplary embodiment of the present invention.

FIG. 4 is a schematic diagram showing a configuration of a fourth exemplary embodiment of the present invention.

FIG. 5 is a schematic diagram showing a configuration of a fifth exemplary embodiment of the present invention.

FIG. 6 is a schematic diagram showing a configuration of a sixth exemplary embodiment of the present invention.

FIG. 7 is a schematic diagram showing a configuration of a seventh exemplary embodiment of the present invention.

FIG. 8 is a schematic diagram showing a configuration of an eighth exemplary embodiment of the present invention.

9 is a block diagram showing the test program of FIGS. 1 to 8. FIG.

FIG. 10 is a flowchart showing the operation of the monitor of FIGS.

FIG. 11 is a flowchart showing the operation of the SW simulator shown in FIGS.

FIG. 12 is a flowchart showing the operation of the HW state setting unit of the SW simulator shown in FIGS.

FIG. 13 is a flowchart showing the operations of the HW state setting unit and the HW state setting value setting unit of the SW simulator of FIGS.

[Explanation of symbols]

11 Monitor 12 Operating System (OS) 13.23.33.43.53.63.73.83
SW simulator 14 ・ 74 Disk device 91-9m Test program 111 Test unit start notification unit 131 ・ 531 Hardware model information (HW model information) 132 ・ 232 ・ 532 ・ 732 Hardware state setting unit (HW state setting unit) 133 ・141/533/741 Working hardware instruction section (working HW instruction section) 236 Pattern designation section 534/634/734 Hardware state set value setting section (HW state set value setting section) 535/742 Hardware state set value (HW State setting value) 637 Processing instruction section 911 to 91n Test program 1001 to 1003.1101 to 1105.1201.
1204/1301 to 1104/9111 to 9113
Step

Claims (8)

[Claims] 1. A test program evaluation method for evaluating mutual interference between test programs by an operating system executing a software simulator having a monitor for executing a plurality of test programs having at least one test unit as an application program. There is a specific pattern in the specified hardware part in the working hardware model information and the working hardware model information that specifies the working hardware model information in which the initial value is indefinite to be used by the test program in the software simulator. And a hardware state setting unit for setting, and a monitor unit start notification unit for detecting the start of the test unit and notifying the software simulator to the monitor. When the mirator receives the notification of the start of the test unit from the test unit start notification unit in the monitor, the hardware state setting unit causes the working hardware portion of the test program to follow the instruction of the working hardware instruction unit. A method for evaluating a test program, comprising setting the specific pattern. 2. A software simulator is provided with a pattern designating section for designating a specific pattern to be set in the working hardware portion of the test program designated by the working hardware designating section, and the working hardware is provided at the start of the test unit. The test program evaluation method according to claim 1, further comprising setting the specific pattern in the working hardware portion instructed by a war instruction unit. 3. A test program evaluation method for evaluating mutual interference between the test programs by an operating system executing a software simulator having a monitor for executing a plurality of test programs having at least one test unit as an application program. Therefore, the software simulator is provided with a hardware state setting unit for setting a specific pattern in a specified hardware portion in the working hardware model information of which the initial value is indefinite to be used by the test program, and the monitor is provided with the hardware state setting unit. A test unit start notification unit for detecting the start of a test unit and notifying the software simulator is provided, and a disk device is connected to the software simulator to connect the working hardware to the disk device. A working hardware instruction section for designating model information is provided, and when the software simulator receives a notification of the start of the test unit from the test unit start notification section being monitored, the working state is set by the hardware state setting section. An evaluation method of a test program, comprising setting the specific pattern in the working hardware of the test program according to an instruction of a hardware instruction unit. 4. The software simulator is provided with a pattern designating unit for designating a specific pattern to be set in the working hardware portion of the test program designated by the working hardware designating unit, and the working hardware is provided at the start of the test unit. 4. The test program evaluation method according to claim 3, further comprising setting the specific pattern in the working hardware portion instructed by a war instruction unit. 5. A test program evaluation method for evaluating mutual interference between test programs by an operating system executing a software simulator having a monitor for executing a plurality of test programs having at least one test unit as an application program. There is a specific pattern in the specified hardware part in the working hardware model information and the working hardware model information that specifies the working hardware model information in which the initial value is indefinite to be used by the test program in the software simulator. A hardware status setting unit that sets the value, a hardware status setting value that stores data to be set in the hardware status setting unit, and the data is not stored in the hardware status setting value. And a hardware state set value setting unit that receives the notification of the start of the test unit, extracts the state value of the hardware portion, processes it, and stores it in the hardware state set value, and provides the monitor with the hardware state set value setting unit. A test unit start notification unit that detects a start and notifies the software simulator is provided, and when the software simulator receives a notification of the start of the test unit from the test unit start notification unit in the monitor,
If no data is stored in the hardware status setting value, the hardware status setting value setting unit sets the data, and the hardware status setting unit operates the working hardware of the test program according to the instruction of the working hardware instruction unit. A method for evaluating a test program, comprising setting the specific pattern in a portion. 6. A software simulator is provided with a machining instructing section for instructing a machining method when a hardware state set value setting section takes out a state value of a hardware portion to machine the test, and the software simulator conducts a test under monitoring. When receiving the notification of the start of the test unit from the unit start notification unit and setting the hardware state setting value,
The evaluation method of a test program according to claim 5, further comprising processing according to an instruction from the processing instruction unit. 7. A test program evaluation method for evaluating mutual interference between the test programs by an operating system which executes a software simulator having a monitor for executing a plurality of test programs having at least one test unit as an application program. And a hardware state setting unit for setting a specific pattern in a specified hardware portion in the working hardware model information of which the initial value is indefinite which is used by the test program in the software simulator, and a hardware state setting A hardware status setting value setting section that receives the notification of the start of the test unit when the data is not stored in the value, extracts the status value of the hardware part, processes it, and stores it in the hardware status setting value of the disk device. And set The hardware state storing the data to be set in the working hardware instruction section for designating the working hardware model information in the disk apparatus by connecting the disk apparatus to the software simulator and the hardware state setting section. A set value is provided, and a test unit start notification unit that detects the start of the test unit and notifies the software simulator to the monitor is provided, and the software simulator notifies the test unit start notification unit in the monitor from the test unit start notification unit. Upon receiving the notification of the start of the test unit, if no data is stored in the hardware state set value, the hardware state set value setting unit sets the data, and the hardware state setting unit sets the working hardware instruction. Follow the instructions of the department Evaluation of the test program, characterized in that it comprises setting the specific pattern in the working hardware portion of the ram. 8. The software simulator is provided with a machining instructing unit for instructing a machining method when a hardware state set value setting unit extracts a state value of a hardware portion and performs machining, and the software simulator conducts a test under monitoring. When receiving the notification of the start of the test unit from the unit start notification unit and setting the hardware state setting value,
8. The test program evaluation method according to claim 7, further comprising: processing according to an instruction from the processing instruction unit.