JP6257236B2 - Data processing apparatus, data processing method, and program - Google Patents

Description

The present invention relates to a technique for verifying the influence of change processing performed on equipment (hardware) and software related to data processing.
Hereinafter, devices and software related to data processing are collectively referred to as a data system.

After a change process is performed on a device or software, it is necessary to perform a test to verify that the change process does not affect existing functions.
Generally, whether or not a response to an arbitrary operation by a tester is determined is compared with expected value data that is an expected response.

  Expected value data must be created for all test items, and in order to reduce this effort, the expected value data in the tester's operation on the data system after the change process is stored in the data system before the change process. A pass / fail determination that substitutes with a response obtained by executing a similar operation is often performed.

  However, if there is a time lag in the timing of the operation by the tester or the timing to save the response, the response before and after the change to be compared is obtained even if the expected operation is obtained in the data system after the change processing. Since they are different, there is a problem that they are determined to be inconsistent.

16 and 17 are diagrams for explaining this problem.
In FIG. 16, the solid line represents the temporal transition of the output value from the data system before the change process, and the broken line represents the temporal transition of the output value from the data system after the change process.
FIG. 17 shows the temporal transition of the difference value between the output value from the data system before the change process and the output value from the data system after the change process.
In the example of FIG. 16, the behavior is the same between the data system before the change process and the data system after the change process, but there is a time lag for some reason.
For this reason, as shown in FIG. 17, a very large difference value is temporarily detected.
In the example of FIG. 16, even if the behavior of the output with respect to the operation matches in this way, a difference is detected in the output value due to a time lag, so it is determined that there is a mismatch.

In Patent Document 1, among the data determined to be inconsistent, it has become different from the correct answer data due to a slight timing shift, but by adding and saving the data that should originally pass as correct answer data, A regression test apparatus that can reduce the number of test items is disclosed.
According to the regression test apparatus of Patent Document 1, it is possible to reduce the number of test items to be visually confirmed by a tester, and to perform pass / fail determination efficiently.

  Further, in Patent Document 2, when verification including new device output information is compared with existing device output information in the verification including the responsiveness of the new device, the output timing of the new device output information is the same as that of the existing device. There has been disclosed a test support apparatus that determines whether or not communication content and communication time are within the allowable range by determining whether or not the output information is within the allowable range of the output timing.

JP 2003-248597 A JP 2005-322157 A

As a means for avoiding inconsistencies in responses caused by time lag, correct pattern additional registration considering time lag is effective, but the above-described processing needs to be performed for each response to an arbitrary operation.
Therefore, if the number of test items and the number of responses to be confirmed for any test item are large, the number of registrations will be enormous, consuming a large amount of memory, and dealing with all inconsistent cases caused by time lags. There is a problem that it is difficult.

  Further, the automatic removal of the time lag due to the correct pattern addition registration and the advance setting once affects the subsequent pass / fail judgments once the wrong data is registered / set, and the test accuracy may be lowered.

  Also, if you want to confirm long-term changes in the response composed of outputs for multiple operations, such as regression tests, time lags occur at each timing when you input to the data system under test. It is difficult to uniquely set a correct pattern and an allowable error of time lag for continuously recorded responses.

  The present invention has been made in view of such circumstances, and it is a main object of the present invention to obtain a configuration in which various types of prior registration are unnecessary and response verification can be performed efficiently and with high accuracy.

The data processing apparatus according to the present invention
A signal value group from the data system before the change process is input as a signal value group before the change process, and a signal value group from the data system after the change process is input as a signal value group after the change A signal value input section;
A difference detector for detecting a difference between the signal value group before change and the signal value group after change;
A difference analysis unit that analyzes the difference detected by the difference detection unit and determines whether the cause of the difference is the change process or another factor.

  According to the present invention, the difference between the pre-change signal value group and the post-change signal value group is analyzed, and in order to determine whether the cause of the difference is the change process or other factors, Without registration, response verification can be performed efficiently and with high accuracy.

1 is a diagram illustrating a configuration example of a test apparatus according to Embodiment 1. FIG. FIG. 3 is a flowchart showing an operation procedure of the test apparatus according to the first embodiment. FIG. 3 shows an example of a signal data table according to the first embodiment. FIG. 4 is a diagram showing an example of a difference data table according to the first embodiment. FIG. 6 is a diagram illustrating an example of a difference analysis result according to the first embodiment. FIG. 3 is a flowchart showing an operation procedure of difference analysis according to the first embodiment. FIG. 3 is a flowchart showing an operation procedure of the display unit according to the first embodiment. FIG. 4 shows a configuration example of a test apparatus according to a second embodiment. FIG. 10 is a diagram illustrating an example of a result of difference analysis according to the second embodiment. FIG. 9 is a flowchart showing an operation procedure of the test apparatus according to the second embodiment. FIG. 6 shows an example of an input phase data table according to the second embodiment. FIG. 9 shows an example of a divided difference data table according to the second embodiment. FIG. 6 is a flowchart showing an operation procedure of a display unit according to the second embodiment. FIG. 6 is a flowchart showing an operation procedure of a display unit according to the second embodiment. FIG. 3 is a diagram illustrating a hardware configuration example of a test apparatus according to Embodiments 1 and 2. The figure explaining the problem in a prior art. The figure explaining the problem in a prior art.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
The present invention is not limited to the following embodiments.
In the drawings, the same or corresponding parts are denoted by the same reference numerals, and the description is not repeated.

Embodiment 1 FIG.
In the present embodiment, the tester is informed what the difference detected between the signal system output from each of the data system before the change process is performed and the data system after the change process is performed. A test apparatus that makes it possible to perform response verification efficiently and with high accuracy by eliminating the need for various prior registrations will be described.

FIG. 1 is a block diagram illustrating a configuration example of a test apparatus 1 according to the present embodiment.
The test apparatus 1 corresponds to an example of a data processing apparatus.

In FIG. 1, the response storage unit 5 inputs a signal value group from the pre-change data system 3 which is a data system before the change process is performed based on the tester's operation, and after the change process is performed. A signal value group is input from the post-change data system 4 which is a data system.
Hereinafter, the signal value group from the pre-change data system 3 is also referred to as a pre-change signal value group, and the signal value group from the post-change data system 4 is also referred to as a post-change signal value group.
The pre-change signal value group is, for example, a signal value group included in the solid line graph in FIG. 16, and the post-change signal value group is, for example, a signal value group included in the broken line graph in FIG.
The response storage unit 5 stores the input pre-change signal value group in the pre-change signal data table 10a.
Further, the response storage unit 5 stores the input changed signal value group in the changed signal data table 10b.
The response storage unit 5 is an example of a signal value input unit.
In FIG. 1, the pre-change data system 3 and the post-change data system 4 are shown together.
This is for ease of understanding. As described above, the pre-change data system 3 is a data system before the change process is performed, and the post-change data system 4 performs the change process on the same data system. Since this is the state after being performed, the pre-change data system 3 and the post-change data system 4 are not necessarily coexisting as shown in FIG.
The data system is a generic term for devices and software related to data processing, as described above.
Further, when the pre-change data system 3 and the post-change data system 4 are collectively expressed, they are simply referred to as a data system.

The pre-change signal data table 10a and the post-change signal data table 10b have, for example, the table format illustrated in FIG.
As shown in FIG. 3, the pre-change signal data table 10a and the post-change signal data table 10b include an output phase and a signal value.
In the example of FIG. 3, the pre-change signal data table 10a and the post-change signal data table 10b include signal values for T output phases with respect to M responses.
Each signal value is an output value of the pre-change data system 3 or the post-change data system 4 with respect to the input value from the tester.
Responses 1 to M represent types of responses from the pre-change data system 3 and the post-change data system 4.
In the example of FIG. 3, the pre-change data system 3 and the post-change data system 4 are each shown to perform M types of responses.
Output phase 1 to output phase T are times and steps (counts) at which signal values are recorded, and are in chronological order, and the passage of time is represented by output phase 1 to output phase T.
In the example of FIG. 3, for each of the M types of responses, signal values at T times or steps in time series are output from the pre-change data system 3 and the post-change data system 4. .

  The difference detection unit 6 detects a difference between the pre-change signal value group in the pre-change signal data table 10a and the post-change signal value group in the post-change signal data table 10b, and stores the difference value group in the difference data table 11. .

The difference data table 11 has, for example, a table format illustrated in FIG.
As shown in FIG. 4, the difference data table 11 includes an output phase and a difference value.
For example, the difference value 1 (1) is a difference value corresponding to the signal value 1 (1) shown in FIG.
That is, the difference between the signal value 1 (1) of the pre-change signal value group and the signal value 1 (1) of the post-change signal value group is the difference value 1 (1).

The difference analysis unit 7 analyzes the difference data generated by the difference detection unit 6 and analyzes the cause of the difference from the difference feature.
Specifically, the difference analysis unit 7 analyzes the difference and determines whether the cause of the difference is a change process performed on the post-change data system 4 or another factor.

  The display unit 8 displays difference data and analysis data.

  The user input unit 9 inputs a tester's operation instruction.

  Next, the operation of the test apparatus 1 according to the present embodiment will be described with reference to the flowchart of FIG.

  In step S101, the response storage unit 5 inputs a pre-change signal value group that is a response output from the pre-change data system 3 in response to the test procedure input of the tester, and stores it in the pre-change signal data table 10a.

  In step S102, the response storage unit 5 inputs a post-change signal value group that is a response output from the post-change data system 4 in response to the test procedure input of the tester, and stores it in the post-change signal data table 10b.

  In step S103, the difference detection unit 6 extracts the pre-change signal value group and the post-change signal value group from the pre-change signal data table 10a and the post-change signal data table 10b, and detects the signal value difference between the corresponding output phases. And stored in the difference data table 11.

In step S <b> 104, the difference analysis unit 7 extracts a difference value group from the difference data table 11, analyzes the feature of the difference value, generates analysis data, and stores the analysis data in the analysis data table 12.
The analysis data includes features of the difference value of responses and the number of responses classified into each feature.

  In step S105, the display unit 8 performs display of the number of responses classified into each difference feature, graph display of difference values, and the like.

  In step S106, when a display switching instruction is input from the tester in the user input unit 9, the process returns to step S105, and the display unit 8 switches display contents.

  FIG. 5 is an example of the cause of the difference analysis analyzed by the difference analysis unit 7 and the response signal data classified into each cause.

In FIG. 5, the difference due to the “time shift” is a difference due to a shift in timing for operating the data system.
That is, as described with reference to FIGS. 16 and 17, the “time shift” has the same behavior as a whole when comparing the signal data before and after the change process, but is a value unit along the time axis. In this comparison, a difference is detected.
FIG. 5 illustrates an example of a situation where the output data rises differently in the signal data before the change and the signal data after the change.
This is because, after the change process, (1) the timing when the tester operates the data system is later than before the change process, and accordingly, the increase in the output value is delayed, or (2) before the change process. It is conceivable that the memory of the output value was started at an early timing and extra memory was taken until the tester operated.

Further, in FIG. 5, the difference due to “noise / communication error” is a difference caused by a failure occurring in communication between the test apparatus 1 and the data system to be tested.
That is, the “noise / communication error” is (1) an error such as a fluctuation of a value or noise generated at the stage of transmitting the output of the data system to be tested to the response storage unit 5, or (2) an error caused by a transient state. It is.
Therefore, the “noise / communication error” may occur both in communication with the pre-change data system 3 and in communication with the post-change data system 4.

  Further, the difference due to “influence by the change process” is a difference resulting from the change process performed on the post-change data system 4.

Next, a method for analyzing the difference value (difference value stored in the difference data table 11) detected by the difference detection unit 6 will be described.
FIG. 6 is a flowchart showing a process of identifying the cause of the difference.
Note that the flow in FIG. 6 is performed for all responses (all of the responses 1 to M in FIG. 3).

In step S <b> 701, the difference analysis unit 7 extracts a difference value group (r ₁ , r ₂ ,... R _T ) of an arbitrary response r from the difference data table 11.
The difference value group (r ₁ , r ₂ ,... R _T ) is the signal value group (n ₁ , n ₂ ,... N _T ) in the pre-change signal data table 10a and the post-change signal data table. It is the difference value between the signal values in the corresponding output phase (1, 2,... T) of the signal value group (m ₁ , m ₂ ,... M _T ) in 10b.
The difference value r _T in the output phase t is calculated by the following equation.
_{r t = | n t -m t} | (1)

  In step S702, the difference analysis unit 7 determines whether all the difference values are zero.

  If all the difference values are 0 (YES in step S702), the difference analysis unit 7 determines “no difference” in step S704, and the number of responses classified as “no difference” in step S705. Increase the count by one and finish.

On the other hand, if there is a difference value other than 0 (NO in step S702), the difference analysis unit 7 determines in step S703 that the difference value other than 0 is as shown in the following expressions (2) and (3). It is determined whether or not the L ₀ norm representing the number of is less than or equal to the threshold Th ₁ .
The threshold Th ₁ is set to an appropriate value for determination.

When the number of difference values other than 0 is equal to or less than the threshold value Th ₁ (YES in step S703), the difference analysis unit 7 determines the difference value group (r ₁ , r ₂ ,... R _T ) in step S705. It determines whether the average value is within the threshold Th _2.

When the average value r _{avg of the} difference value group (r ₁ , r ₂ ,... R _T ) is not within the threshold Th ₂ (NO in step S705), the difference analysis unit 7 determines in step S708 that “by changing process” "Influence" is determined, the count of the number of responses classified as "influence by change process" is incremented by 1, and the process ends.

On the other hand, when the average value r _{avg of} the difference value group (r ₁ , r ₂ ,... R _T ) is within the threshold Th ₂ (YES in step S705), the difference analysis unit 7 determines in step S709 that “ “Noise / communication error” is determined, the number of responses classified as “noise / communication error” is incremented by 1, and the process ends.

When the number of difference values other than 0 is not equal to or smaller than the threshold Th ₁ (NO in step S703), the difference analysis unit 7 determines in step S706 the difference value group (r ₁ , r shown in the following equation (4)). ₂ ,..., R _T ), it is determined whether the variance value S ² is equal to or less than the threshold value Th ₃ .
The threshold Th ₃ is set to an appropriate value for determination.

When the variance value S ^{2 of the} difference value group (r ₁ , r ₂ ,... R _T ) is not equal to or less than the threshold Th ₃ (NO in step S706), the difference analysis unit 7 performs “time shift” in step S710. The number of responses classified as “time shift” is incremented by 1, and the process ends.

When the variance value S ^{2 of the} difference value group (r ₁ , r ₂ ,... R _T ) is equal to or less than the threshold Th ₃ (YES in step S706), the difference analysis unit 7 performs “change processing” in step S711. "Influence by" is determined, the count of the number of responses classified as "influence by change process" is incremented by 1, and the process ends.

In the flow of FIG. 6, if “Yes” in S <b> 703, it means that the signal value in which the difference is generated is small.
Further, in the case of No in S705, it means that each difference value has a certain size or more.
For this reason, if YES in S703 and NO in S705, a large difference value is detected in some signal values, and therefore, it is determined that “influence by change processing” (S708).
In the case of YES in S703 and Yes in S705, the signal value in which the difference is generated is small, and since each difference value is small, it can be determined as a minute error and determined as “noise / communication error” (S709). .
In the case of No in S703, it means that there are many signal values in which differences have occurred.
If NO in S706, it means that the variance value of the difference is equal to or greater than the threshold value, that is, the difference is biased.
Such a difference occurs when a “time shift” occurs, and as shown in FIG. 16, a difference in values appears at the beginning of the shift of the signal data, and thereafter a constant difference appears. .
Therefore, it is determined as “time shift” (S710).
In the case of No in S706, it means that the variance value of the difference is within the threshold value, that is, the difference value in the signal data is uniformly similar.
This is because there is a possibility that the output volume has changed due to the change processing, and it is determined that “the influence of the change processing” (S711).

  FIG. 7 is a flowchart showing a process until display of analysis data (data in the analysis data table 12) on the display unit 8 to the tester.

  First, in step S801, the display unit 8 extracts analysis data from the analysis data table 12.

  In step S <b> 802, the display unit 8 acquires the number data of responses classified by cause of difference generation by the difference analysis unit 7.

In step S803, the display unit 8 displays the response number data as a graph.
The graph is displayed using, for example, a two-dimensional bar graph of x and y, and the x-axis data items are “effects of change processing”, “time shift”, “noise and communication error”, and variables designated on the y-axis. Is the number of responses classified by cause of difference occurrence.
However, the display form described above is an example, and any display form may be used as long as similar contents can be presented to the examiner.

  Next, the display unit 8 extracts the difference data of the difference data table 11 in step S804.

  In step S805, the display unit 8 acquires, from the difference data, the difference value of the response classified as “influence by the change process” having the highest priority to be confirmed by the tester from the analysis data.

In step S806, the display unit 8 displays the obtained difference value of the response as a graph.
If there are multiple responses, they are displayed on the same graph.
The graph is displayed using, for example, a two-dimensional line graph of x and y, the x axis is the output phase, and the variable designated for the y axis is the difference value.
However, the display form described above is an example, and any display form may be used as long as similar contents can be presented to the examiner.

  In step S807, the user input unit 9 determines whether there is a display switching instruction from the tester.

  When there is a display request for the response classified as “time gap” from the tester, in step S808, the display unit 8 acquires all the difference values of the response classified as “time gap” from the difference data, The procedure returns to step S806.

  If there is a display request for a response classified as “noise or communication error” from the tester, in step S809, the display unit 8 obtains a difference value of the response classified as “noise / communication error” from the difference data. All are acquired, and the process returns to step S806.

  Since “time shift” and “noise / communication error” do not affect the test result, there is a high possibility of being a good decision, and “influence of change processing” is highly likely to be a negative decision. In this way, the confirmation priority is set in the order of “effect of change processing”, “time lag”, “noise and communication error”, and presented to the tester in order from the response with the highest priority difference occurrence cause. To do.

  In addition, when there are a plurality of responses to be verified with respect to an arbitrary test item, the difference analysis unit 7 classifies the responses according to the cause of the difference occurrence, and the display unit 8 collectively tests the responses with the difference caused by the same cause. Present it to the person.

  As described above, in the present embodiment, the difference between the response signal data output from the pre-change data system and the response signal data output from the post-change data system is analyzed, and the cause of the difference is generated. Is presented to the tester together with the difference value, so that the tester can easily perform pass / fail determination, and there is an effect of preventing an automatic determination error caused by prior correct pattern registration and setting.

  Further, in the present embodiment, the cause of the difference is assumed to be any one of “time shift”, “noise and communication error”, and “effect due to change processing”, and “change” is likely to be a negative determination. By presenting to the tester in order from the response that is the cause of the difference occurrence “effect due to processing”, there is an effect of preventing the response affected by the change from being overlooked.

  Also, in this embodiment, when there are multiple responses to be verified for an arbitrary test item, the responses are classified according to the cause of the difference occurrence, and the responses with the difference caused by the same cause are collectively presented to the tester. By doing so, it is possible to confirm a response having a common response change pattern with respect to an arbitrary input before and after changing the device.

Embodiment 2. FIG.
In this embodiment, when test procedures are continuously input to the data system, and response signal data output from the data system is continuously stored for a long time, By dividing the difference data at the input timing of the test procedure by the tester stored in the input phase storage unit 13 and analyzing the divided difference data, the “time shift” difference due to the timing shift of each input is obtained. It becomes possible to specify.
The other operations in the second embodiment are the same as those in the first embodiment.

FIG. 8 is a block diagram illustrating a configuration example of the test apparatus 1 according to the second embodiment.
The response storage unit 5, the difference detection unit 6, the difference analysis unit 7, the display unit 8, the user input unit 9, the pre-change signal data table 10a, the post-change signal data table 10b, the difference data table 11, and the analysis data table 12 are implemented. This is the same as that shown in the first embodiment.

The input phase storage unit 13 inputs input phase data (input timing information) indicating the input timing of the input value of the test procedure for the tester's pre-change data system 3 or post-change data system 4, and the input phase data table 15 To store.
The input phase storage unit 13 corresponds to an example of an information input unit.

The data dividing unit 14 divides the difference data at the input timing indicated by the input phase data, and stores the divided difference data that is the divided difference data in the divided difference data table 16.
That is, the data dividing unit 14 groups a plurality of difference values detected by the difference detecting unit 6 in association with the input timing indicated by the input phase data.
The data dividing unit 14 corresponds to an example of a grouping unit.

  In this embodiment, the difference analysis unit 7 analyzes the divided difference data and determines the cause of the difference in units of the divided difference data.

  FIG. 9 is an example of the difference generation cause analyzed by the difference analysis unit 7 in the second embodiment and the response signal data classified into each cause.

  Next, the operation of the test apparatus 1 according to the present embodiment will be described with reference to the flowchart shown in FIG.

In step S <b> 201, first, the input phase storage unit 13 inputs input phase data indicating the input timing of the test procedure for the tester's pre-change data system 3 and stores the input phase data in the input phase data table 15.
As shown in FIG. 11, the input phase data table 15 stores a plurality of input phase data.
Input phase data x, y, the input timing t _x the input timing shown in each of z, ty, that t _z.

Since steps S101 to S103 are the same as those described in the first embodiment, the description thereof is omitted.
After step S101 to step S103, in step S202, the data dividing unit 14 sets the difference value (r ₁ , r ₂ ,... R _T ) of an arbitrary response r to the input timing (t _x , t _y , t _z )) and is divided into a plurality of regions, and as shown in FIG. 12, (r ₁ ,..., r _x ), (r _x ,..., r _y ), (r _y ,..., r _z ) Divided difference data (r _z ,..., R _T ) is generated, and the generated divided difference data is stored in the divided difference data table 16.

Next, the difference analysis unit 7 acquires the divided difference data, analyzes the divided difference data according to the flowchart of FIG. 6 in step S203, and creates analysis data.
Thereafter, the processing of step S105 and step S106 is executed.

  FIGS. 13 and 14 are flowcharts showing a process until the display unit 8 displays analysis data (data in the analysis data table 12) to the tester.

  First, in step S801, the display unit 8 extracts analysis data from the analysis data table 12.

  In step S810, the display unit 8 acquires, from the analysis data, the number of response-specific data for each area divided in step S202.

Next, in step S803, the display unit 8 displays the response number data as a graph.
The graph is displayed using, for example, a two-dimensional stacked bar graph of x and y, the x-axis data item is each divided area, and the variable designated on the y-axis is the number of responses by feature in each area. .
However, the display form described above is an example, and any display form may be used as long as similar contents can be presented to the examiner.

  Next, in step S811, the display unit 8 extracts the divided difference data divided in step S202 from the divided difference data table 16.

  In step S812, the display unit 8 acquires divided difference data of all responses in all regions.

  In step S806, the display unit 8 displays the acquired divided difference data as a graph.

  In step S813, the display unit 8 displays the regions in the descending order of the number of responses classified as “influence by change processing” having the highest priority to be confirmed by the tester among all regions of the divided difference data. Sort.

  In step S814, it is determined by the user input unit 9 whether or not an area to be displayed is specified by the tester.

  When an area to be displayed is designated by the examiner, the display unit 8 acquires the corresponding area in step S815.

  When there is no designation of the area to be displayed by the tester, the display unit 8 acquires the areas sorted in step S813 in ascending order in step S816.

  In step S817, the display unit 8 acquires, from the difference data, the difference values of all responses classified as “influence by change processing” having the highest priority to be confirmed by the tester within the acquired area.

  In step S818, the display unit 8 closes up the area acquired in step S815 or step S816 in the displayed graph, and redisplays only the difference value of the response acquired in step S817.

  In step S807, the display unit 8 determines whether there is a display switching instruction from the tester.

  If there is a display request for a response classified as “time shift” from the tester, in step S808, the display unit 8 calculates a difference value of the response classified as “time shift” in the analysis data from the difference data. All are acquired, and the process returns to step S817.

  When there is a response display request classified as “noise / communication error” from the tester, in step S809, the display unit 8 determines from the difference data a response classified as “noise / communication error” in the analysis data. Are all obtained, and the process returns to step S817.

If there is no display switching instruction from the tester, it is determined in step S819 whether there is an instruction to end the analysis by the tester.
When the analysis is continued, the process returns to step S814.

  Thus, in the test apparatus of the present embodiment, in order to confirm long-term changes in responses to a plurality of inputs, the input timing of the test procedure for the data system is stored in advance and detected by the difference detection unit. After the difference data is divided into a plurality according to the input timing, the signal data in each divided region is analyzed and presented to the tester in order from the region having the highest probability of difference occurrence.

  In the present embodiment, by analyzing the difference data in each divided area, it is possible to detect a difference due to a time lag or a communication error that occurs at each timing of input to the data system.

Finally, a hardware configuration example of the test apparatus 1 shown in the first and second embodiments will be described with reference to FIG.
The test apparatus 1 is a computer, and each element of the test apparatus 1 can be realized by a program.
As a hardware configuration of the test apparatus 1, an arithmetic device 901, an external storage device 902, a main storage device 903, a communication device 904, and an input / output device 905 are connected to the bus.

The arithmetic device 901 is a CPU (Central Processing Unit) that executes a program.
The external storage device 902 is, for example, a ROM (Read Only Memory), a flash memory, or a hard disk device.
The main storage device 903 is a RAM (Random Access Memory).
The communication device 904 is, for example, a NIC (Network Interface Card).
The input / output device 905 is, for example, a mouse, a keyboard, a display device, or the like.

The program is normally stored in the external storage device 902, and is loaded into the main storage device 903 and sequentially read into the arithmetic device 901 and executed.
The program is a program that implements the functions described as “˜units” shown in FIGS. 1 and 8.
Further, an operating system (OS) is also stored in the external storage device 902. At least a part of the OS is loaded into the main storage device 903, and the arithmetic device 901 executes the OS as shown in FIG. 1 and FIG. Executes a program that realizes the function of "~ part".
In the description of the first and second embodiments, “determination of”, “determination of”, “detection of”, “analysis of”, “extraction of”, “generation of”, “ Information, data, signal values, and variable values indicating the results of the processing described as “input”, “output of”, and the like are stored in the main storage device 903 as files.
Further, the encryption key / decryption key, random number value, and parameter may be stored in the main storage device 903 as a file.

  Note that the configuration of FIG. 15 is merely an example of the hardware configuration of the test apparatus 1, and the hardware configuration of the test apparatus 1 is not limited to the configuration illustrated in FIG. 15, but may be other configurations. .

  Further, the data processing method according to the present invention can be realized by the procedure shown in the first and second embodiments.

  Embodiments 1 and 2 above are examples for efficiently confirming the difference between response signal data output to the same test procedure input between two different data systems. The data system is, for example, an existing device and a device after modification of installed software, a simulator device that simulates the operation of the existing device and the existing device, a new device that newly realizes the operation of the existing device and the existing device based on the model, Etc. are applicable.

Also, one of the first and second embodiments may be partially implemented.
Alternatively, the first and second embodiments may be partially combined.

  In addition, the above embodiment is an essentially preferable illustration, Comprising: It does not intend restrict | limiting the range of this invention, its application thing, or a use.

  DESCRIPTION OF SYMBOLS 1 Test apparatus, 3 before-change data system, 4 after-change data system, 5 response memory | storage part, 6 difference detection part, 7 difference analysis part, 8 display part, 9 user input part, 10a before-change signal data table, 10b after change Signal data table, 11 difference data table, 12 analysis data table, 13 input phase storage unit, 14 data division unit, 15 input phase data table, 16 division difference data table.

Claims (11)

A signal value group from the data system before the change process is input as a signal value group before the change process, and a signal value group from the data system after the change process is input as a signal value group after the change A signal value input section;
A difference detector for detecting a difference between the signal value group before change and the signal value group after change;
A difference analysis unit that analyzes a time-series feature of the difference detected by the difference detection unit and determines whether the cause of the difference is the change process or another factor. A data processing device. The difference analysis unit
From the plurality of difference values detected from the signal value group before change and the signal value group after change by the difference detection unit, a difference value other than 0 is extracted,
It is determined whether or not the number of extracted non-zero difference values is equal to or less than a first threshold value,
When the number of difference values other than 0 is equal to or less than the first threshold value, an average value of the plurality of difference values is calculated, and the pre-change signal value group and the post-change signal value are calculated based on the calculated average value. Determine whether the cause of the difference with the group is the change process or other factors,
When the number of difference values other than 0 exceeds the first threshold, a variance value in the plurality of difference values is calculated, and the pre-change signal value group and the post-change signal value group based on the calculated variance values 2. The data processing apparatus according to claim 1, wherein it is determined whether a cause of the difference between the two is the change process or another factor. The difference analysis unit
When calculating an average value among the plurality of difference values, it is determined whether the calculated average value is equal to or less than a second threshold;
When the average value is less than or equal to the second threshold, it is determined that the cause of the difference is the change process, and when the average value exceeds the second threshold, the cause of the difference is another It is determined to be a factor,
When calculating a variance value among the plurality of difference values, it is determined whether or not the calculated variance value is equal to or less than a third threshold;
When the variance value is less than or equal to the third threshold, it is determined that the cause of the difference is another factor, and when the variance value exceeds the third threshold, the cause of the difference is the change. The data processing apparatus according to claim 2, wherein the data processing apparatus is determined to be a process. The difference analysis unit
When the average value exceeds the second threshold, it is determined that the cause of the difference is communication between the data processing device and the data system;
4. The data processing apparatus according to claim 3, wherein when the variance value is equal to or less than the third threshold value, it is determined that the cause of the difference is at a timing of operating the data system. The signal value input unit is
Input a plurality of pre-change signal value groups and a plurality of post-change signal value groups corresponding to the plurality of pre-change signal value groups,
The difference detection unit
Detect the difference between the signal value group before change and the signal value group after change,
The difference analysis unit
For each pair of the pre-change signal value group and the post-change signal value group, analyze the time-series characteristics of the difference detected by the difference detection unit, and determine whether the cause of the difference is the change process. The data processing apparatus according to claim 1, wherein it is determined whether the factor is a factor. The data processing device further includes:
A display unit configured to display the number of cases where the difference analysis unit determines that the cause of the difference is the change process and the number of cases where the difference analysis unit determines that the cause of the difference is another factor; The data processing apparatus according to claim 5. The data processing device further includes:
Details of the pre-change signal value group and the post-change signal value group determined that the cause of the difference is the change process by the difference analysis unit, and that the cause of the difference is another factor by the difference analysis unit The data processing apparatus according to claim 5, further comprising a display unit that displays in priority over details of the determined pre-change signal value group and post-change signal value group. The data processing device further includes:
A grouping unit that groups a plurality of difference values detected from the pre-change signal value group and the post-change signal value group by the difference detection unit;
The difference analysis unit
Analyzing the time-series characteristics of the difference values detected by the difference detection unit in units of the difference values grouped by the grouping unit, the signal value group before change and the signal value after change The data processing apparatus according to claim 1, wherein a determination is made as to whether the cause of the difference from the group is the change process or another factor. The signal value input unit is
A time series output value group of the data system with respect to an input value to the data system before the change process is performed, is input as the signal value group before change,
A time series output value group of the data system with respect to an input value to the data system after the change process is performed, is input as the signal value group after change,
The data processing device further includes:
Input timing information indicating at least one of an input value input timing to the data system before the change processing and an input value input timing to the data system after the change processing is input Has an information input unit,
The grouping unit
Said by the difference detection unit and the pre-change signal value group a plurality of difference values detected from said changed signal value groups in correspondence with the input timing shown in the input timing information to group,
The difference analysis unit
Whether the cause of the difference between the pre-change signal value group and the post-change signal value group is the change process or another factor in units of difference values grouped by the grouping unit The data processing apparatus according to claim 8 , wherein the determination is performed. The computer inputs a signal value group from the data system before the change process is performed as a signal value group before the change process, and the signal value group from the data system after the change process is performed is the signal value group after the change A signal value input step to input as
A difference detection step in which the computer detects a difference between the signal value group before change and the signal value group after change;
A difference analysis step in which the computer analyzes a time-series feature of the difference detected in the difference detection step to determine whether the cause of the difference is the change process or another factor; A data processing method comprising:   A program causing a computer to function as the data processing apparatus according to claim 1.

Images