JPH01118937A - Measurement system for program comprehension rate - Google Patents

Abstract

PURPOSE:To accurately grasp the degree of evaluation of a program to be evaluated by applying a system where the ratio is measured for the instructions carried out at least once or more during evaluation of said program. CONSTITUTION:A system comprises an input device 1 which performs the input operations, a program comprehension rate measuring device 2, a CPU 3, a main memory 4, and an output device 5. The executed instruction area information is successively stored in the executing process of a program PR to be evaluated by means of a branch instruction interruption. Then the ratio of the executed instructions of the PR after execution of the PR based on the stored executed instruction area information. Thus the ratio of the number of executed instructions is measured as a program comprehension rate. In such a way, the degree of evaluation of the PR can be accurately grasped. Furthermore the address of an unexecuted instruction is converted into a module name and an intra-module relative address for output. Thus an unexecuted instruction can be specified in a simple and accurate way.

Description

[Detailed Description of the Invention] [Field of Industrial Application] The present invention relates to a method for measuring program coverage in a computer system, and in particular, when a program to be evaluated consisting of multiple modules is executed, at least one
This invention relates to a method for measuring the ratio of instructions executed more than once to the total number of instructions.

[Conventional technology]

When a new program is developed, the program is evaluated using test data or the like in order to confirm whether the program achieves its intended purpose.

Normally, when evaluating this program, the person in charge of evaluation considers several evaluation items in advance so that all instructions in the program to be evaluated can be covered, and tests are performed on these evaluation items. The evaluation was considered complete when a satisfactory result was obtained.

[Problem that the invention seeks to solve]

However, it is extremely difficult to think of evaluation items in advance that can cover all the instructions in the program to be evaluated, and therefore it is considered that the evaluation of the program to be evaluated is complete when all the evaluation items that have been considered in advance are satisfied. The present invention was made in view of these circumstances,
The purpose of this is to provide a method for measuring the ratio of instructions executed at least once during the evaluation of a program to be evaluated, thereby making it possible to accurately determine the degree of evaluation of the program to be evaluated. .

[Means for solving problems]

In order to achieve the above object, the present invention executes a branch instruction in a program in response to the setting of a branch instruction interrupt mode, and sets a pre-branch address and a post-branch address before the first instruction after the branch is executed. In a computer system that has a branch instruction interrupt mechanism that stores internal interrupts and generates internal interrupts, it stores control information including module names, start addresses expressed as absolute addresses, and end addresses of all modules that make up the program to be evaluated. control information holding means; address conversion means for converting an absolute address into a module name and an intra-module relative address by referring to the control information held by the control information holding means; and a post-branch address for storing the post-branch address. address storage means; executed instruction area information storage means; when an internal interrupt occurs by the branch instruction interrupt mechanism, a pre-branch address held in the branch instruction interrupt mechanism and a pre-branch address stored in the post-branch address storage means; The range indicated by the post-branch address is stored as executed instruction area information in the executed instruction area information storage means, and the post-branch address held in the branch instruction interrupt mechanism is stored in the post-branch address storage means. a coverage measurement control means for storing the addresses of all the instruction words of the program to be evaluated on the main memory; and the executed instruction area information stored in the executed instruction area information storage means, calculate the ratio of executed instructions in the program to be evaluated.
outputting from the output device the address of the instruction word which has been converted into a module name and an intra-module relative address by the address conversion means so that executed instructions and unexecuted instructions can be distinguished. and measurement result editing/output control means for outputting from the device.

[Effect]

When a branch instruction in the program to be evaluated is executed, the branch instruction interrupt mechanism holds the pre-branch address and post-branch address and generates an internal interrupt. When this internal interrupt occurs, the ``fR control'' vehicle side control means uses the pre-branch address held in the branch instruction interrupt mechanism and the previous post-branch address stored in the post-branch address storage means. The range is stored as executed instruction area information in the executed instruction area information storage means, and the post-branch address held this time by the branch instruction interrupt mechanism is stored in the post-branch address storage means. Such processing is performed every time a branch instruction in the program to be evaluated is executed, and as a result, when the program to be evaluated finishes execution, information indicating the area of executed instructions in the area of the program to be evaluated is It will be stored in the completed instruction area information storage means. Thereafter, the measurement result editing output control means performs evaluation based on the addresses of all instructions of the evaluation target program obtained from the instruction word analysis means and the executed instruction area information stored in the executed instruction area information storage means. The ratio of executed instructions in the target program is calculated as the program coverage rate, and the instruction word is converted into a module name and an intra-module relative address by an address conversion means so that executed instructions and unexecuted instructions can be distinguished. address is output from the output device.

〔Example〕

Next, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram of an embodiment of the program coverage measurement method of the present invention. The program coverage measurement method of this embodiment is composed of an input device 1 on which input operations are performed, a program coverage measurement device 11t2, a central processing unit 3, a main storage device 4, and an output device 5. .

In the central processing unit 3, in response to the setting of the branch instruction interrupt mode including the specification of the priority level during program execution,
A branch instruction that maintains the priority level, pre-branch address, and post-branch address and generates an internal interrupt before the first instruction after the branch is executed by executing a branch instruction in the program with the specified priority level. An interrupt mechanism 30 is provided. The program coverage measurement device 2 also includes an input information analysis section 20, a coverage measurement control section 21, a post-branch address storage section 22 that can store post-branch addresses for each priority level, and an executed instruction area information storage section. unit 23, measurement result editing output control unit 24, instruction word analysis unit 25, w4i
It has a rate calculation section 26, an address conversion section 27, and a mosier control information section 2.

The main storage device 4 includes a plurality of modules 4L 42°...
・There is an evaluation target program PR consisting of 4n, and each module 4L 42. -..., 4
The starting address of n is 31, 32. . . , the Sn address, and the ending address is El, E2 . ..., En
It is a street address. Note that the priority level of the evaluation target program PR during program running is (1).

The module control information section 28 in the program coverage measuring device 2 contains modules 41, 42. ..., 4n module name (aaaaa, bbbbb, "', nnn
rln) and modules 41.42.・”, the start address of module 4n (31, S2゜-..., Sn) and the end address of module 41.42.-, 4n (El, E2
．． ..., En) are registered as control information,
It is referenced by the address conversion unit 27.

Next, the program of this example configured in this way! i
l! ! The operation of the vehicle-side measurement method will be explained.

In this embodiment, the program 'IJ4 coverage rates of a plurality of evaluation target programs existing in the main storage device 4 can be measured individually, and the coverage rates of a plurality of evaluation target programs with different priority levels can be measured simultaneously. You can also do that. Assume now that the program coverage rate of one evaluation target program PR is to be measured. In this case, the priority level (1) of the evaluation target program PR is notified to the coverage measurement control section 21 from the input bag W1 via the input information analysis section 20 of the program coverage measurement device 2.

Upon receiving this notification, the coverage measurement control unit 21 sets the priority level (11) to the branch instruction interrupt mode and activates the branch instruction interrupt mechanism 30, and also sets the priority level (11) to the branch instruction interrupt mode and activates the branch instruction interrupt mechanism 30. The rear address is initialized to 0. After this, the evaluation target program PR in the main storage device 4 is started.

When a branch instruction is executed during execution of the evaluation target program PR, the branch instruction interrupt mechanism 30 of the central processing unit 3 receives the running priority level (1) 1 post-branch address.

The pre-branch address is held, a branch instruction interrupt is generated at the branch destination address, and the coverage measurement control unit 21 of the program coverage measurement device 2 is operated.

The coverage measurement control unit 21 uses the priority level il+ held in the branch instruction interrupt mechanism 30, the pre-branch address which is the address of the branch instruction itself, and the post-branch address which is the branch destination of this branch instruction as a branch instruction interrupt. The range from the post-branch address corresponding to the priority level (11) to the currently received pre-branch address in the post-branch address storage unit 22 is stored as executed instruction area information in the executed instruction area information storage unit 23. At the same time, the currently received post-branch address is stored in the location within the post-branch address storage unit 22 corresponding to the currently received priority level (1).
At the time of the first branch instruction interrupt in which the post-branch address in the post-branch address storage unit 22 corresponding to the priority level number is initialized to zero, the branch-side specific control unit 21 receives a notification from the branch instruction interrupt mechanism 30. The post-branch address corresponding to the current priority level is simply stored in the post-branch address storage unit 22, and the executed instruction area information is not stored in the executed instruction area information storage unit 23. After performing the operation, the w4 vehicle side control unit 21 instructs the branch instruction interrupt mechanism 30 to resume execution from the post-branch address in the evaluation target program PR, and waits for the next branch instruction interrupt.

FIG. 2 explains the operation when storing executed instruction area information in the executed instruction area information storage unit 23, taking as an example the routine from address PO to address P4 of one module 41 that constitutes the evaluation target program PR. This is a diagram. In module 41, addresses PG, P1 . P
2. P3. P4 is the branch destination address (post-branch address) of the branch instruction, and addresses B1, B2 . B3. B4 is the address of the branch instruction itself (pre-branch address). First, when a branch instruction to branch to the address PO of the module 41 is executed, a branch instruction interrupt is generated by the branch instruction interrupt mechanism 30, and the coverage measurement control section 21 operates. lol
The 4fI rate measurement control unit 21 stores the post-branch address PO notified from the branch instruction interrupt mechanism 30 in the post-branch address storage unit 2.
2 is stored in correspondence with the priority level +11 (here,
(The explanation of the procedure for storing executed instruction area information before branching to address PO is omitted.)

Next, when the branch instruction at address B1 of the module 41 is executed and a branch instruction interrupt occurs at address P1, which is the branch destination, the coverage measurement control unit 21 receives the pre-branch address notified from the branch instruction interrupt mechanism 30. The range between B1 and the address PO stored in the post-branch address storage unit 22 in correspondence with the priority level (11) is stored in the executed instruction area information M.
1 in the executed instruction area information storage unit 23, and then the post-branch address P1 notified together with the pre-branch address B1 is set to the priority level of the post-branch address storage unit 22+11.
Store in the corresponding location. Similarly, address B2. B3.
By executing the branch instruction B4, addresses P2, P3, . A branch instruction interrupt occurs at P4, and the coverage measurement control unit 21 records executed instruction area information M2. M3
．． M4 is stored in the executed instruction area information storage section 23.

FIG. 3 is a diagram showing an example of the stored contents of the executed instruction area information storage section 23. As shown in FIG. The executed instruction area information storage unit 23 of this embodiment has bits that correspond one-to-one with each address in the main memory. For example, the bit number 00 bit is stored at address 0 in the main memory, and the bit number 100 corresponds to address 100 on the main memory.

Then, the bit of the bit number corresponding to the address of the execution method instruction is turned on, and the bit corresponding to the address of the unexecuted instruction is turned off. For example, taking module 41 as an example, its starting address on main memory is 8.
1 and the end address is address E1, the executed instruction area information of the module 41 is from bit number S1 to bit number E1 of executed instruction area information storage section 23 in FIG.
It is stored in the storage area 23-1 in the range of . The executed instruction area information storage area 23-1 stores executed instruction area information M1. M2. M3. M4 exists and executed instruction area information M1. M2. M3. All bits contained in M4 are on. Similarly, bits corresponding to other executed instruction areas of the module 41 in the executed instruction area information storage area 23-1 are also stored as executed instruction area information M1, M2. M3. Like M4, it is on, and the other bits, ie, the bits corresponding to the unexecuted instruction area of module 41, are off.

Now, in FIG. 1, after the execution of the evaluation target program PR is completed, a branch instruction interrupt mode release command of priority level fil is sent from the input device 1 via the input information analysis unit 20 to y4.
When the WIFI rate measurement control unit 21 is notified, the WIfI rate measurement control unit 21 cancels the branch instruction interrupt mode of the priority level (1) and stops the branch instruction interrupt mechanism 30, and also cancels the branch instruction interrupt mode of the priority level (1). ) to edit and output the measurement results for the evaluation target program PR.
instruct.

Upon receiving this instruction, the measurement result editing output control section 24 instructs the instruction word analysis section 25 to report the addresses of all instruction words from 811th left to address En. In response to this, the instruction word analysis section 25 interprets all the instruction words from the left of No. 311 to address En, and sequentially reports the addresses of all the instruction words to the measurement result editing output control section 24.

When the instruction word address is reported from the instruction word analysis section 25, the measurement result editing output control section 24 edits the bit based on the reported address and the state of the bit in the executed instruction area information storage section 23. Only addresses for which OFF is selected, that is, addresses of unexecuted instructions, are selected as addresses to be output. This selected address is an absolute address, and as will be described later, the address converter 27 is used to convert the absolute address into a module name and an intra-module relative address, and output from the output bag W5.

Furthermore, the measurement result editing output control section 24 controls the instruction word analysis section 2.
5 counts the number of instruction words that are sequentially reported, and also counts the number of times the bit in the executed instruction area information storage area corresponding to the address of the reported instruction word is on, that is, the number of execution method instruction words. Finally, based on these count values, the coverage calculation unit 26 calculates the ratio of the number of execution method command words to the total number of command words. The coverage calculation unit 26 calculates the result of dividing the number of execution method command words by the total number of command words, for example, in the form of a percentage based on the above-mentioned count value, and notifies the measurement result editing output control unit 24 .

The measurement result editing output control unit 24 outputs this calculation result to the output device 5 as a program coverage rate for the evaluation target program 41.

Next, we will explain the operation when converting an absolute address into a module name and a relative address within the module.
The start address S1 of the module is 1000, and the module 42
Assuming that the start address S2 of the file is address 1500, an example will be explained in which the absolute address address 1234 is to be converted.

The measurement result editing output control unit 24 uses the absolute address 1234
When converting an address, the absolute address 1234 is notified to the address conversion unit 27 to instruct conversion. When this instruction is given, the address converter 27 converts the start addresses St, 32 . ...,
3n and end address El.

E2. . . , with reference to En, the absolute address 123
Module name of module 41 including address 4 (aaaa
a) and the start address S1, calculate the intra-module relative address 234 (=1234-3l), and notify the measurement result editing output control unit 24 together with the start address S1.

The measurement result editing output control unit 24 performs the above processing,
This is repeated for all absolute addresses of unexecuted instructions.

The program coverage rate of the evaluation target program PR and the intra-module relative address and module name of unexecuted instructions obtained as described above are edited by the measurement result editing output control unit 24, and then are shown in FIG. 4, for example. It is output from the output device 5 in the format shown.

The above operation is an example of measuring the coverage rate of one evaluation target program, but in this embodiment, the post-branch address storage unit 22
Since the post-branch address can be stored for each priority level, by specifying multiple priority levels from the input device 1, multiple different addresses can be stored. It is possible to simultaneously measure the program coverage rate, etc. of the programs to be evaluated in advance. At this time, after the execution of the plurality of evaluation target programs is completed, branch instruction interrupt mode release commands of a plurality of priority levels are input from the input device 1, so that the mnn measurement control unit 21 sequentially updates the program coverage rate of each evaluation target program. , which controls the calculation process of unexecuted instruction addresses.

〔Effect of the invention〕

As explained above, the present invention uses branch instruction interrupts to sequentially store executed instruction area information during the execution process of the evaluation target program, and after the execution of the evaluation target program is completed, the executed instruction area information is stored in the stored executed instruction area. Based on the information, the ratio of executed instructions of the program to be evaluated is calculated, without any modification to the program to be evaluated.
The ratio of the number of executed instructions can be measured as the program coverage rate. Therefore, it is possible to accurately grasp the evaluation level of the program to be evaluated.

In addition to outputting the ratio of the number of executed instructions in the program to be evaluated, we also output the address of the instruction word so that executed instructions and unexecuted instructions can be distinguished. It is possible to determine whether the command is an unexecuted instruction, etc.

Therefore, in the next evaluation step, evaluation can be performed focusing on unexecuted instructions, and the degree of evaluation of the program can be efficiently improved.

Furthermore, since the address of an unexecuted instruction is output in a format converted into a module name and a relative address within the module, after searching for the start address of the module from the address map output by the linker, the relative address within the module is output. There is no need for manual calculation, and unexecuted instructions can be identified more easily and accurately.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of an embodiment of the present invention, FIG. 2 is an explanatory diagram of the operation when storing executed instruction area information in the executed instruction area information storage section 23, and FIG. 3 is an executed instruction area information storage FIG. 4 is a diagram showing an example of the storage contents of the unit 23, and FIG. 4 is a diagram showing an example of output of measurement results. In the figure, l...Input device 2...Program coverage measurement device 3...Central processing unit 4...Main storage device 5...Output device 20...Input information analysis unit 21... Coverage rate measurement control unit 22...Post-branch address storage unit 23...Executed instruction area information storage unit 24...Measurement result editing output control unit 25...Instruction word analysis unit 26...M@L Vehicle side output section 27...Address conversion section 28...Mosier control information section 30...Branch instruction interrupt mechanism 41 to 4n...Module PR...Evaluation target program

Claims (1)

[Claims] In response to the branch instruction interrupt mode setting, by executing a branch instruction in the program, the pre-branch address and post-branch address are held and internally stored before the first instruction after the branch is executed. In a computer system having a branch instruction interrupt mechanism that generates an interrupt, a control information holding means that holds control information including module names, a start address expressed as an absolute address, and an end address of all modules constituting an evaluation target program; , address conversion means for converting an absolute address into a module name and an intra-module relative address by referring to the control information held by the control information holding means; post-branch address storage means for storing the post-branch address; an executed instruction area information storage means; a pre-branch address held in the branch instruction interrupt mechanism when an internal interrupt occurs by the branch instruction interrupt mechanism; and a post-branch address stored in the post-branch address storage means; Coverage rate measurement in which the range indicated by is stored in the executed instruction area information storage means as executed instruction area information, and the post-branch address held in the branch instruction interrupt mechanism is stored in the post-branch address storage unit. control means; instruction word analysis means for obtaining addresses of all instruction words of the evaluation target program on main memory; addresses of all instruction words of the evaluation target program obtained by the instruction word analysis means; and the executed instructions. Based on the executed instruction area information stored in the area information storage means, the ratio of executed instructions in the evaluation target program is calculated as a program coverage rate and outputted from the output device, and the executed instructions and unexecuted instructions are calculated. and measurement result editing output control means for outputting from the output device the address of the instruction word converted by the address conversion means into a module name and an intra-module relative address so that the instruction word can be identified. Measurement method.