JP2014126900A - Program analysis device, program analysis method, and program analysis program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program analysis device which can optimize verification of validity of a program which has been modified.SOLUTION: A program analysis device comprises: find means which, on the basis of an execution path of a test item of which test result indicates an error in a first program, finds whether a second program including the same code as the first program has a second passage position corresponding to a first passage position on the execution path; and output means which, on the basis of presence of difference between a first part of the first program corresponding to the passage position after modification and a second part of the second program corresponding to the passage position before modification, outputs the first part or the second part.

Description

  The present invention relates to a program analysis apparatus, a program analysis method, and a program analysis program that extract program differences using test execution results.

  In software development, not only new development but also maintenance / improvement development of existing systems are often performed. In maintenance / improvement development, it is necessary to confirm that the parts whose specifications do not change due to maintenance / improvement operate the same before and after the software change. For this reason, the same test items as those performed before the change may be performed after the change. Such a test is called a regression test.

  The regression test is often automated by using a test support tool or the like. At this time, work (debugging work) for confirming the test result and identifying the cause of the error in the test result needs to be performed manually. Therefore, when many errors occur, there is a problem that a long time is required for debugging work.

  An example of the debugging support technique is disclosed in Patent Document 1. In the debugging support technology of Patent Document 1, the difference information between the source code that has been operating normally and the source code that has been changed to the source code that has been operating normally and that has generated an error during execution is obtained. By presenting it, the efficiency of the work which specifies the changed part which is the cause of the error of the test result is aimed at.

  Another example of the debugging support technique is disclosed in Patent Document 2. The test support system of Patent Document 2 includes a source code comparison unit, a source code storage unit before correction, a source code storage unit after correction, a passing module information storage unit, a test item extraction unit, a passing module information storage unit, Is provided. The test support system of Patent Document 2 operates as follows.

  The source code comparison means compares the pre-correction source code stored in the pre-correction source code storage means with the corrected source code stored in the post-correction source code storage means, and identifies the module in which the change has been made. The passing module information storage means, when a test of a plurality of test items is executed on the source code before correction, an instruction indicating a target to be executed passes, that is, a module that is called and executed as an execution target, Store in association with the test item. The test item extraction unit refers to the passing module information storage unit and extracts a test item that passes through the changed module.

  As described above, “the instruction indicating the execution target position moves” is referred to as “the process passes”. Therefore, “passing position” means “a position designated as an execution target in the past”. In addition, the sequence of passage positions when the partial processes constituting the program are traced as execution targets are hereinafter referred to as “execution paths”.

  As a result of the above operation, this test support system does not require detailed analysis of the program, and can extract test items to be executed on the modified source code without the user specifying a changed portion.

JP 2007-4255 A (page 4-10, FIG. 1) JP 2010-122959 A (page 4-5, FIG. 1)

  The technique disclosed in Patent Document 1 has a problem that it is necessary to extract only a related portion because information not related to the test item in which the test result is an error is also included in the difference information.

  The test support system disclosed in Patent Document 2 does not require detailed analysis of the program, and can extract test items to be executed on the modified source code without requiring the user to specify a changed portion. .

  By the way, when the program is changed, it is efficient if the validity of the changed program can be verified by paying attention to only the changed part of the changed program, that is, the difference of the program. However, the test support system of Patent Document 2 does not perform processing focusing on the difference between the source code before and after the correction. In the first place, the test support system of Patent Document 2 does not use the test results executed on the corrected source code.

  An object of the present invention is to provide a program analysis apparatus, a program analysis method, and a program analysis program that can efficiently verify the validity of a program after the change when the program is changed.

  The program analysis apparatus of the present invention includes a code common to the first program based on the execution path on the first program regarding the test item in which the result of the test performed on the first program results in an error. Search means for searching whether or not the second program includes a second passing position corresponding to the first passing position on the execution path, and a first program of the first program corresponding to the changed passing position Output means for outputting the first part or the second part based on whether there is a difference between the part and the second part of the second program corresponding to the pre-change passing position, To do.

  The program analysis method of the present invention includes a code common to the first program based on the execution path on the first program regarding the test item in which the result of the test performed on the first program results in an error. The second program searches for whether or not the second passage position corresponding to the first passage position on the execution path is included, and the first part of the first program corresponding to the changed passage position; The first part or the second part is output based on the presence or absence of a difference from the second part of the second program corresponding to the second passage position.

The program analysis program of the present invention includes a computer included in the program analysis device,
Based on the execution path on the first program regarding the test item in which the result of the test performed on the first program is an error, the execution path is transferred to the second program including the code common to the first program. Search means for searching whether or not the second passage position corresponding to the first passage position above is included, the first part of the first program corresponding to the changed passage position, and the second passage position Based on the presence or absence of a difference from the second part of the second program corresponding to, the output part outputs the first part or the second part.

  According to the present invention, there is an effect that it is possible to efficiently verify the validity of the changed program when the program is changed.

It is a block diagram which shows the structure of the program analysis apparatus in the 1st Embodiment of this invention. It is a figure which shows an example of the program before a change in the 1st Embodiment of this invention. It is a figure which shows an example of the program after a change in the 1st Embodiment of this invention. It is a figure which shows an example of the regression test item in the 1st Embodiment of this invention. It is a figure which shows an example of the execution path information in the 1st Embodiment of this invention. It is a figure which shows another example of the execution path information in the 1st Embodiment of this invention. It is a figure which shows an example of the difference information in the 1st Embodiment of this invention. It is a figure which shows another example of the difference information in the 1st Embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the program analysis apparatus in the 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the program analysis apparatus in the 1st Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In all the drawings, the same reference numerals are given to the same components, and the description will be omitted as appropriate.
(First embodiment)
FIG. 1 is a block diagram showing a configuration of a program analysis apparatus according to the first embodiment of the present invention.

  First, the premise for demonstrating the structure of a program analysis apparatus is demonstrated.

  It is assumed that a certain computer program (hereinafter referred to as “pre-change program”) is operable on the computer. When the pre-change program 130 is a source code or the like and is not operable on the computer as it is, the pre-change program 130 may be operated on the computer after being converted into an executable format. It has been confirmed that the pre-change program 130 operates normally for a group of test items.

  FIG. 2 is a diagram illustrating an example of a pre-change program in the present embodiment.

  The “Main.func” method is defined in lines 1 to 10, the “SubA.m” method is defined in lines 11 to 16, and the “SubB.m” method is defined in lines 17 to 22.

  It is assumed that there is another program (hereinafter referred to as “program after change”) in which a change is made to the pre-change program 130 and it can operate on the computer. If the changed program 150 is not operable on the computer as it is, the changed program 150 may be operated on the computer after being converted into an executable format. The language used for describing each of the pre-change program 130 and the post-change program 150 may be a common language or a separate language.

  FIG. 3 is a diagram showing an example of the changed program in the present embodiment.

  The “Main.func” method is not changed, the “SubA.m” method is changed in line 14, the “SubB.m” method is changed in line 20, and the “SubC.m” method is changed in lines 23 to 32. Is newly defined.

  Here, the description has been made assuming that the pre-change program is changed and the post-change program is created. However, the post-change program is not limited to a program created by changing the pre-change program. The first program has been confirmed to operate normally for a group of test items, and the second program has a portion where the code matches the first program and the code is If it can be divided into parts that do not match, it can be considered that the first program is changed and the second program is created. Accordingly, the first program and the second program may be two programs created independently.

  The pre-change program and the post-change program may be, for example, two programs created independently so as to include common method names and functions according to one application programming interface specification. In this case, if one of the programs is confirmed to operate normally for a group of test items, one program may be regarded as having been created by changing the other program. it can.

  For example, it is assumed that there is a first program created to include the method names and functions defined in the first application programming interface specification. It is also assumed that there is a second application programming interface specification that includes method names and functions in common with the first application programming interface specification. Further, it is assumed that there is a second program created independently of the first program so as to include the method names and functions defined in the second application programming interface specification. At this time, if one of the first program and the second program is confirmed to operate normally with respect to a group of test items, one program is changed to the other program. It can be considered as created.

  It has been confirmed that the post-change program 150 operates normally or abnormally with respect to some items (hereinafter referred to as “regression test items”) of a group of test items in which the pre-change program 130 has operated normally. . Each test item of the regression test item 170 may include, for example, a test content, an expected result when the test content is executed, and a test item name for identifying each test item.

  FIG. 4 is a diagram illustrating an example of regression test items in the present embodiment.

  In the regression test item 170 of FIG. 4, the third test item is a test executed with the test item name “3” and the test content given by the argument “−1” to the “Main.func” method. Indicates that the return value of the “Main.func” method is “2”.

  The execution path information 180 indicating the execution path on the post-change program 150 when the regression test item 170 is executed is recorded for each test item that operates abnormally. The execution path indicated by the execution path information 180 is a series of portions on the changed program 150 (hereinafter referred to as “changed passage position”) in which the changed program 150 is executed when the regression test item 170 is executed. Contains one or more. Each changed passage position is identified by a method name, a function name, a label name, a debug command statement, a line number, a range of line numbers, or a comment on the changed program 150 executed when the test item is executed. Also good. The execution path information 180 may further include a test item name and the like.

  For example, the name of the executed method is output by executing the “System.out.println” method in lines 3, 13, 19, and 25 in the modified program 150 shown in FIG. The The execution path information 180 can be obtained by recording a list of method names for abnormally operated test items.

  Alternatively, for example, when Java (registered trademark) is used as a programming language, a test tool such as JUnit can be used. In this case, the execution path information 180 can be obtained using a coverage tool such as jcoverage.

  FIG. 5 is a diagram illustrating an example of the execution path information 180 in the present embodiment.

  The execution path information 180 in FIG. 5 includes an execution path including the changed passage position of the “Main.func”, “SubB.m”, and “SubC.m” methods corresponding to the test item whose test item name is “3”. Indicates that

  The execution path information 180 may be generated only for a test item in which the post-change program 150 operates abnormally, or is generated for a test item in which the post-change program 150 operates normally or abnormally. May include information of either normal or abnormal (hereinafter referred to as “test result”).

  FIG. 6 is a diagram illustrating another example of the execution path information in the present embodiment.

  The execution path information 180 in FIG. 6 corresponds to the test item whose test item name is “3”, the test result is “NG”, and “Main.func”, “SubB.m”, “SubC.m” method Indicates that the execution path includes the changed passage position.

  Based on the above assumptions, the configuration of the program analysis apparatus will be described.

  The program analysis apparatus 100 according to the present embodiment includes passage position search means 110 and difference output means 120.

  Based on the input execution path information 180, the passage position search unit 110 determines, for each post-change passage position included in the execution path information 180, from the input pre-change program 130 before the change corresponding to the post-change passage position. A passing position on the program 130 (hereinafter referred to as “passing position before change”) is searched, and a set of a passing position after change and a passing position before change is output. The passage position search unit 110 ignores the execution path information for the test item for which the changed program 150 has operated normally. In addition, the pre-change pass position corresponding to the post-change pass position is the same as the post-change pass position on the pre-change program 130, the method name, function name, label name, debug command statement, line number, range of line numbers, Alternatively, the search may be performed based on whether there is a part having a comment or the like. When the pre-change passage position corresponding to the post-change passage position is not found, the passage position search means 110 outputs a value indicating “empty” as the pre-change passage position.

  First, the difference output means 120 is a part of the pre-change program 130 corresponding to the pre-change pass position based on the set of the post-change pass position and the pre-change pass position, the post-change program 150, and the pre-change program 130. And whether there is a difference between the changed program 150 corresponding to the changed passage position. If there is a difference, the difference output means 120 outputs difference information 190 including the part of the changed program 150 corresponding to the changed passage position. When the input pre-change passing position value is “empty”, the post-change program 150 corresponding to the post-change passing position is output. The difference information 190 may further include a part of the pre-change program 130 corresponding to the pre-change passing position, a test item name, and the like.

  The difference output means 120 may determine that there is no difference even if the code portions of the pre-change program 130 and the post-change program 150 do not completely match. For example, code differences that do not affect the execution result of the program, such as comments, spaces, tabs, and line breaks in the code, may be ignored.

  Further, the part of the post-change program 150 corresponding to the post-change passing position and the part of the pre-change program 130 corresponding to the pre-change passing position included in the difference information 190 need not be only parts having code differences. Good. For example, the difference information 190 may include the entire definition of a method having a code difference.

  FIG. 7 is a diagram illustrating an example of difference information in the present embodiment.

  In the difference information 190 of FIG. 7, the first difference information corresponds to the test item whose test item name is “3”, and the changed passage positions “Main.func”, “SubB.m”, “SubC.m”. Among the methods, the “SubB.m” and “SubC.m” methods have a difference between the part of the pre-change program 130 corresponding to the pre-change passing position and the part of the post-change program 150 corresponding to the post-change passing position. A corresponding post-change program 150 portion is included.

  FIG. 8 is a diagram illustrating another example of difference information in the present embodiment.

  In the difference information 190 of FIG. 8, the first difference information corresponds to the test item whose test item name is “3”, and the changed passage positions “Main.func”, “SubB.m”, “SubC.m”. Among the methods, the “SubB.m” and “SubC.m” methods have a difference between the part of the pre-change program 130 corresponding to the pre-change passing position and the part of the post-change program 150 corresponding to the post-change passing position. "SubB.m" method in which there is a difference between the corresponding post-change program 150 part and the pre-change program part 130 corresponding to the pre-change passing position and the post-change program 150 part corresponding to the post-change passing position The portion of the pre-change program 130 corresponding to is included.

  FIG. 9 is a block diagram illustrating an example of a hardware configuration of the program analysis apparatus according to the present embodiment.

  The program analysis device 907 includes a storage device 902, a CPU (Central Processing Unit) 903, a keyboard 904, a monitor 905, and an I / O (Input / Output) 908, which are connected via an internal bus 906. Yes. The storage device 902 stores an operation program for the CPU 903 such as the difference output unit 120. The CPU 903 controls the entire program analysis device 907, executes an operation program stored in the storage device 902, and executes programs such as the differential output means 120 and transmits / receives data via the I / O 908. The internal configuration of the program analysis device 907 is an example. The program analysis device 907 may include only the CPU 903 and operate using a storage device 902, a keyboard 904, a monitor 905, and an I / O 908 provided outside.

  Next, the operation of this embodiment will be described.

  FIG. 10 is a flowchart showing the operation of the program analysis apparatus according to this embodiment. However, an operation for one post-change passing position included in the execution route information 180 is shown. When the execution path information 180 includes a plurality of changed passage positions, the operation for one changed passage position is repeated.

  The passage position search means 110 searches the changed pre-change passage position corresponding to the post-change passage position from the input pre-change program 130 for each post-change passage position included in the input execution route information 180, and changes it. A set of the rear passage position and the pre-change passage position is output (step S110).

  The difference output means 120 checks the presence / absence of the pre-change passing position (step S120).

  If there is no pre-change passing position (step S120: No), the difference output means 120 proceeds to the next step S150.

  If there is a pre-change passing position (step S120: Yes), the difference output means 120 will convert the pre-change program 130 corresponding to the pre-change passing position and the post-change program 150 corresponding to the post-change passing position. It is checked whether or not there is a difference (step S130).

  If there is no difference (step S140: No), the difference output means 120 ends the process for the changed passing position.

  If there is a difference (step S140: Yes), the difference output means 120 outputs the difference information 190 including the part of the changed program 150 corresponding to the changed passage position.

  As described above, when an error occurs in a specific test item of the regression test, the program analysis apparatus 100 according to the present embodiment uses the execution path of the specific test item in the information on the difference between the programs before and after the change. Only the difference information of the included programs can be extracted. The reason is that the passage position search means 110 searches for a part of the program related to the specific test item, and the difference output means 120 detects the difference before and after the program change from the part of the program related to the specific test item. This is because a certain part is extracted.

  In addition, the program analysis apparatus 100 according to the present embodiment can be used to support the debugging work of the changed program when an error occurs in a specific test item of the regression test. The reason is that when an error occurs in a specific test item of the regression test, the program analysis apparatus 100 extracts only the information of the program difference before and after the change related to the specific test item. This is because it is possible to refer to information on differences in which bugs exist.

  In the present embodiment, the difference information 190 has been described as including the part of the changed program 150 corresponding to the changed passage position. However, the difference information 190 is not limited to the information including the part of the changed program 150 corresponding to the changed passage position. That is, the difference information 190 may include a part of the pre-change program 130 corresponding to the post-change passing position. In this case, the program analysis apparatus 100 can extract the portion of the pre-change program 130 that does not have a bug, corresponding to the portion of the post-change program 150 that has a bug. Therefore, the difference information 190 may include a part of the pre-change program 130 corresponding to the post-change passing position.

  In this embodiment, an example in which Java (registered trademark) is used as a programming language for describing a program has been described. However, the present invention is not limited to this, and any procedural programming language such as C or assembly language may be used. Good.

  In addition, this invention is not limited to the above-mentioned embodiment, It can implement in various changes and deformation | transformation in the range which does not deviate from the summary of this invention.

Claims (6)

Based on the execution path on the first program related to the test item in which the result of the test performed on the first program results in an error, the second program including a code common to the first program, Search means for searching whether a second passage position corresponding to the first passage position on the execution path is included;
Based on the presence / absence of a difference between the first part of the first program corresponding to the post-change passing position and the second part of the second program corresponding to the second passing position, Output means for outputting the first part or the second part;
A program analysis apparatus comprising: The program analysis apparatus according to claim 1, wherein the changed passage position is a definition part of a first method included in the first program. The program analysis apparatus according to claim 1, wherein the pre-change passing position is a definition part of a second method included in the second program. 4. The program analysis apparatus according to claim 3, wherein the pre-change passing position corresponding to the post-change passing position is a definition part of the second method having the same name as the first method. Based on the execution path on the first program related to the test item in which the result of the test performed on the first program results in an error, the second program including a code common to the first program, Searching whether a second passage position corresponding to the first passage position on the execution path is included;
Based on the presence / absence of a difference between the first part of the first program corresponding to the post-change passing position and the second part of the second program corresponding to the second passing position, A program analysis method comprising: outputting one part or the second part. A computer included in the program analysis device,
Based on the execution path on the first program related to the test item in which the result of the test performed on the first program results in an error, the second program including a code common to the first program, Search means for searching whether a second passage position corresponding to the first passage position on the execution path is included;
Based on the presence / absence of a difference between the first part of the first program corresponding to the post-change passing position and the second part of the second program corresponding to the second passing position, Output means for outputting the first part or the second part;
Program analysis program to function as

Images