JP2019032656A - Verification system and verification method - Google Patents

Abstract

To make it easier to execute a regression test.SOLUTION: A verification system compares a current program with a new program. The current program is implemented in a detection device and executes processing on the basis of an input from a sensor. The new program executes the processing on the basis of the input and partly changes from the current program. The verification system comprises: a sensor; a storage unit which is incorporated in a detection device and stores the new program, wherein the detection device outputs a sensor output and a processing result obtained by the current program; and comparison determination means for determining whether or not the processing result of the current program and the processing result of the new program are identical except for the processing result relating to the change from the new program.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a verification system and a verification method.

  When making modifications such as improving the software or adding functions, it is necessary to perform a regression test to check whether the parts other than the modified part function in the same way as the current software. For example, Patent Document 1 discloses a regression test support system that compares execution results before and after program correction to determine a program defect.

Japanese Patent Laying-Open No. 2015-176455

  However, when such a regression test is executed for software using inputs such as a large number of sensors or a sensor having a large amount of information, there are a large number of combinations of sensor data. If such a combination of a large number of sensor data is used as an input in the regression test, the regression test takes time, and the regression test procedure becomes complicated.

  The present invention has been made in view of the above-described problems, and an object thereof is to facilitate execution of a regression test.

  The present invention adopts the following configuration as means for solving the above-described problems.

  As a first means, a current program that is mounted on the detection device and executes processing based on an input from a sensor, and a new program that executes processing based on the input and is partially modified from the current program Is a verification system for comparison with a sensor, and is incorporated in a detection device having a sensor and a processing means for outputting a sensor output and a processing result obtained by the current program, and a storage means for storing the new program; Except for the processing result related to the change from the new program, a configuration is adopted in which comparison determination means for determining whether the processing result of the current program is the same as the processing result of the new program is adopted.

  As a second means, a configuration is adopted in which the first means has a determination storage means for storing the determination result by the comparison determination means.

  As a third means, in the second means, the determination storage means stores the processing result of the current program and the new program when the determination result is not the same between the current program and the new program. A configuration is adopted in which the processing result is stored.

  As a fourth means, in the second or third means, the judgment storage means stores the sensor output when the judgment result is not the same in the current program and the new program. Adopt the configuration.

  As a fifth means, any one of the first to fourth means includes a communication means for transmitting the determination result by the comparison determination means to the outside.

  As a fifth means, a current program that is mounted on the detection device and executes processing based on an input from a sensor, and a new program that executes processing based on the input and is partially modified from the current program In the detection device, the processing by the current program and the new program are performed in parallel, the processing result of the processing by the current program, and the processing of the processing by the new program The configuration of comparing the results is adopted.

  According to the present invention, a verification system that stores a new program is incorporated in a detection apparatus that actually implements the current program, and the current program and the new program are processed in parallel using the input from the sensor. The processing results relating to the changes in the new program are excluded from the processing results of the current program and the new program obtained in this way, and the comparison / determination means compares them. Accordingly, the regression test can be performed based on the data from the sensor of the detection device that is actually operating, and it is not necessary to prepare the pattern of the input data, so that the regression test can be easily performed.

It is a block diagram of the obstacle detection apparatus and verification system in one embodiment of the present invention. It is a flowchart which shows operation | movement of the verification system in one Embodiment of this invention.

Hereinafter, an embodiment of a verification system 1 according to the present invention will be described with reference to the drawings.
The verification system 1 in the present embodiment is configured by cooperation of hardware such as a computer CPU and memory and software including a program.

  An autonomous driving vehicle A (detection device) in which the verification system 1 of this embodiment is incorporated together with the obstacle detection system 100 is an automobile that autonomously travels while detecting surrounding obstacles. The autonomous driving vehicle A has an obstacle detection system 100 and a verification system 1.

  The obstacle detection system 100 is mounted on the autonomous driving vehicle A, has a radar device 110 (sensor), a program processing unit 120 (processing means), and a storage unit 130, and is located in the vicinity of the autonomous driving vehicle A. This device detects the presence or absence of obstacles. The obstacle detection system 100 stores an obstacle detection program P1 (current program) for determining the presence or absence of an obstacle based on information from the radar device 110 in the storage unit 130. The obstacle detection program P1 is stored in the obstacle detection program P1. Obstacles are detected by executing. The obstacle detection system 100 outputs the processing result of the obstacle detection program P1 to the control system of the autonomous driving vehicle A when the regression test is executed.

  Such an obstacle detection system 100 is mounted on a plurality of autonomous driving vehicles A, and a regression test by the verification system 1 is executed in each of them. The obstacle detection program P1 and the new program P2 of the obstacle detection system 100 are installed in a processing computer mounted on the autonomous driving vehicle A.

  The verification system 1 is a system that performs a regression test between the obstacle detection program P1 and the new program P2, and includes a program processing unit 2, a program storage unit 3 (storage unit), and a comparison determination unit 4 (comparison determination unit). And a data storage unit 5 (determination storage means) and a communication unit 6. The program processing unit 2 acquires radar information from the radar device 110 and executes processing based on the new program P2 stored in the program storage unit 3. The program storage unit 3 stores a new program P2 to be subjected to a regression test. The new program P2 is a program obtained by modifying a part of the obstacle detection program P1, and uses data input of the radar apparatus 110.

  The comparison / determination unit 4 acquires radar information from the program processing unit 120 and the program processing unit 2 and compares the processing result of the obstacle detection program P1 with the processing result of the new program P2. Are verified, and the verification result is stored in the data storage unit 5.

  The data storage unit 5 stores a comparison result by the comparison determination unit 4. The data storage unit 5 also includes an output result of the obstacle detection program P1 and an output result of the new program P2 when the obstacle detection program P1 and the new program P2 have different processing results except for the modified portion, and a radar apparatus. 110 radar information is stored. The communication unit 6 is a wireless communication unit that periodically outputs data stored in the data storage unit 5 from the autonomous driving vehicle A to an external system 200 provided outside the vehicle.

  The external system 200 is mounted on a computer provided outside the autonomous driving vehicle A, and is a system that develops and corrects the new program P2 based on data acquired from the plurality of communication units 6.

  The plurality of autonomous driving vehicles A on which the obstacle detection system 100 is mounted are each driven in the same manner as usual. Thereby, the surrounding radar information acquired by the radar apparatus 110 is input to the obstacle detection program P1 and the new program P2 of each autonomous driving vehicle A. Since each autonomous driving vehicle A is driven by a different route or situation, different radar information is input to the obstacle detection program P1 and the new program P2 of each autonomous driving vehicle A.

Next, a verification method by the verification system 1 will be described with reference to the flowchart of FIG.
First, when parallel processing by the program processing unit 120 using the radar reception data acquired from the radar device 110 and the program processing unit 2 is completed, the comparison determination unit 4 performs processing of the obstacle detection program P1 and the new program P2. A result is acquired (step S1). And the comparison determination part 4 excludes the data regarding a modification location from the process result used as a comparison object based on the information of the modification location of the new program P2 memorize | stored beforehand (step S2).

  Next, the comparison / determination unit 4 compares the processing results from which the data related to the modified part (changed point) is excluded, and verifies whether all are the same (step S3). If the processing results are the same in step S3, that is, if the determination is YES, only the information “the processing results are the same” is stored in the data storage unit 5 (step S4). When the processing results are not the same, that is, when the determination is NO, the comparison / determination unit 4 determines that the information indicating that the processing results are not the same, the respective processing results of the obstacle detection program P1 and the new program P2. The radar information used for the processing is stored in the data storage unit 5 (step S5).

  The verification system 1 accumulates the results of a plurality of regression tests (verifications) in the data storage unit 5 by repeatedly executing such a flow. Furthermore, the verification system 1 uses the communication unit 6 to transmit the data including the determination result, the processing result, and the radar information stored in the data storage unit 5 at an arbitrary timing such as during maintenance of the autonomous driving vehicle A to the external system 200. Send to.

  Since the verification system 1 in this embodiment is mounted on the autonomous driving vehicle A, the radar information of the obstacle detection system 100 acquired along with the actual operation of the autonomous driving vehicle A is used as needed. The processing results of the parallel processing of the obstacle detection program P1 and the new program P2 can be compared and verified. Therefore, the verification system 1 can perform a regression test using radar information of various patterns as an input, and the regression test can be easily performed.

  Further, the verification system 1 according to the present embodiment stores the information that “the processing results are not the same” and the processing results of the obstacle detection program P1 and the new program P2 in the data storage unit 5. As a result, the data storage unit 5 can store the processing results when “the processing results are not the same”. Under what circumstances, the processing results differ between the obstacle detection program P1 and the new program P2. It can be confirmed and it becomes easy to correct the new program P2.

  Moreover, the verification system 1 in this embodiment has the communication part 6 which transmits a determination result to the external system 200 by radio | wireless communication. Thereby, even when the obstacle detection program P1 is implemented in a movable device such as the autonomous driving vehicle A or a device that is difficult to remove, the verification result of the verification system 1 can be easily collected. is there.

  As mentioned above, although preferred embodiment of this invention was described referring drawings, this invention is not limited to the said embodiment. Various shapes, combinations, and the like of the constituent members shown in the above-described embodiments are examples, and various modifications can be made based on design requirements and the like without departing from the spirit of the present invention.

  In the above embodiment, the verification system 1 compares the processing results of the obstacle detection program P1 and the new program P2, but the present invention is not limited to this. The type of program to be compared and verified by the verification system 1 is not limited as long as it performs processing using inputs from various sensors. Moreover, the apparatus in which the verification system 1 is mounted is not limited to the autonomous driving vehicle A, and may be, for example, a railroad crossing apparatus, a system for monitoring road conditions, or the like.

  In addition, the verification system 1 may store only the determination result by the comparison determination unit 4 in the data storage unit 5 and appropriately transmit by wireless communication by the communication unit 6. In this case, since the amount of data communication by the communication unit 6 can be reduced as compared with the above embodiment, it is possible to communicate with the external system 200 quickly.

  In the above embodiment, when the processing result of the obstacle detection program P1 and the processing result of the new program P2 are not the same, the processing results of the obstacle detection program P1 and the new program P2 are used for the processing. The radar information is stored in the data storage unit 5, but the present invention is not limited to this. The data storage unit 5 may store only the processing results of the obstacle detection program P1 and the new program P2 when the processing results are not the same. The data storage unit 5 may store only radar information when the processing results are not the same.

DESCRIPTION OF SYMBOLS 1 Verification system 2 Program processing part 3 Program storage part 4 Comparison determination part 5 Data storage part 6 Communication part 100 Obstacle detection system 110 Radar apparatus 120 Program processing part 130 Storage part 200 External system A Self-driving vehicle P1 Obstacle detection program P2 New program

Claims (6)

Verification that is implemented in the detection apparatus and that executes a process based on an input from a sensor, and compares the new program that executes a process based on the input and that is partially modified from the current program A system,
Incorporated in a detection device having a sensor and processing means for outputting a sensor output and a processing result obtained by the current program;
Storage means for storing the new program;
A verification system comprising: a comparison / determination unit that determines whether the processing result of the current program and the processing result of the new program are the same except for a processing result related to a change from the new program.   The verification system according to claim 1, further comprising a determination storage unit that stores a determination result by the comparison determination unit.   The processing result of the current program and the processing result of the new program when the determination result is not the same between the current program and the new program are stored in the determination storage unit. 2. The verification system according to 2.   The verification system according to claim 2 or 3, wherein the determination storage means stores the sensor output when the determination result is not the same between the current program and the new program.   The verification system according to claim 1, further comprising a communication unit that transmits a determination result by the comparison determination unit to the outside. Verification that is implemented in the detection apparatus and that executes a process based on an input from a sensor, and compares the new program that executes a process based on the input and that is partially modified from the current program A method,
In the detection apparatus, the processing according to the current program and the new program are performed in parallel, and the processing result of the processing by the current program is compared with the processing result of the processing by the new program. Method.

Images