JP5417196B2 - Automatic determination device and automatic determination method - Google Patents

Description

  The present invention relates to an automatic determination apparatus and an automatic determination method that can be processed in real time, are inexpensive, efficient, and highly accurate.

  An ATC test facility is used to verify the operation of an automatic train control device (ATC) in a railway. In this ATC test facility, a transponder signal on the ground, a vehicle speed signal, and the like are input as simulation (simulation) signals, and the operation of the ATC device with respect to these input signals is inspected.

  As one of the verification tests, a sensory test is incorporated in which an inspector monitors a display screen such as a speedometer output from the ATC device to determine whether the ATC device is good or bad. The ATC device is a kind of signal security device, and high reliability is required to ensure the safety of transportation. Therefore, the control software of the ATC device is also multiplexed (Diversification). The inspector compares and monitors the system 1 speed plan surface and the system 2 speed plan surface, and determines whether or not there is a difference that causes a problem in the control operation on both display screens.

However, the following problems have been pointed out in visual inspection by inspectors.
(1) There is a difference in the inspection results by the inspector. That is, the inspection results such as oversight of an abnormality and inaccuracies and misunderstandings are different depending on the inspector. (2) Since it is difficult to obtain evidence to support the test result, feedback of the test result to the ATC device tends to be insufficient. (3) For long-time inspections, the necessary number of examiners must be secured.
By the way, as a method for automatically comparing images, Patent Document 1 discloses a method of generating numerical information relating to a specific comparison item and comparing images for each of image portions of images to be compared.

JP 2006-85258 A

  In the image comparison method disclosed in Patent Document 1, a difference is extracted by paying attention to an image parameter which is a static characteristic of an image. However, in the visual inspection by the inspector, it is considered that the determination is made in consideration of the difference in the dynamic characteristics (dynamic characteristics) of the image. Therefore, the technique disclosed in Patent Document 1 is not sufficient.

  In the method described in Patent Document 1, since a plurality of images are processed to extract highly accurate numerical information, a processing time and a processing device are required. On the other hand, what is required in this verification test is a monitoring / judgment technique that can be processed in real time and has an accuracy capable of replacing an inexpensive and efficient inspector.

  The present invention has been made in view of such circumstances, and an object thereof is to provide an automatic determination apparatus and an automatic determination method that can be processed in real time, are inexpensive, efficient, and highly accurate.

In order to solve the above problems, the present invention is directed to two imaging devices that respectively capture two inspected objects that receive the same signal and output a processing result based on this signal, and the two imaging devices. Input means for inputting two images at a predetermined cycle, area setting means for setting at least a pair of comparison target areas from the two images input via the input means, and at least the pair of When a matching / mismatching is determined between corresponding pixels for a region, and a ratio determined to be matching among the total number of pixels included in the region is obtained, and the calculated ratio satisfies a predetermined criterion The first determination means for determining that the at least one pair of areas coincides with each other, and the number of times at least the pair of areas determined to be inconsistent by the first determination means continues for a predetermined number of times Storing the two images that are the photographed case stores the second judging means determines that mismatch, the determination result by the first determination result by the determination means and the second judging means for each of the predetermined cycle is automatic determination and means.

Further, the present invention provides a storage unit that stores a captured reference image, an imaging device that captures an object to be inspected, an input unit that inputs an image captured by the imaging device at a predetermined period, and the stored reference A region setting unit that sets at least a pair of regions to be compared from an image and an image input via the input unit, and the matching / non-coincidence determination is performed between corresponding pixels for the at least a pair of regions. First, a ratio determined to be coincident among the total number of pixels included in this area is obtained, and when the obtained ratio satisfies a predetermined criterion, it is determined that the at least a pair of areas coincide with each other. When the number of times at least a pair of areas determined to be inconsistent by the first determining means and the first determining means continues for a predetermined number of times, it is determined that the two captured images do not match That a second determination unit, an automatic determination apparatus having a storage means for storing the result of determination by the first determination result by the determination means and the second judging means for each of the predetermined cycle.

The present invention is the same signal is input, the steps of capturing the two inspection object respectively for outputting a processing result based on the signal in the two imaging devices, two taken by the two imaging devices A step of inputting an image at a predetermined period; a step of setting at least a pair of comparison target regions from the two input images ; and a determination of matching / mismatching between corresponding pixels in the at least one pair of regions And determining the proportion of the total number of pixels included in the region that is determined to be coincident, and determining that the at least one pair of regions coincides when the obtained proportion satisfies a predetermined criterion. The first determination step and the two times when the number of times at least a pair of areas determined to be inconsistent by the first determination step continues for a predetermined number of times or more. A second determination step of determining that the image does not match, in the automatic determination method includes a step of storing a determination result by the determination result and the second determination step by the first determination step of every predetermined period is there.

  According to the present invention, it is possible to provide an automatic determination device and an automatic determination method that can be processed in real time, are inexpensive, efficient, and highly accurate.

The figure which shows the structure of the automatic determination apparatus of 1st Embodiment, and its usage example. The figure which shows the structure of the test screen displayed on the display part of an automatic determination processing apparatus. The figure which shows the method of displaying a comprehensive determination result in a comprehensive determination result area. The figure which shows a parameter setting input screen. The flowchart which shows the general | schematic operation processing procedure in the test mode of an automatic determination processing apparatus. The flowchart which shows the outline operation | movement procedure in the browsing mode of an automatic determination processing apparatus. The figure which shows the structure of the browsing screen displayed on the display part of an automatic determination processing apparatus. The figure which shows the structure of the automatic determination apparatus of 2nd Embodiment, and its usage example. The figure which shows the structure of the automatic determination apparatus which concerns on the variation of 2nd Embodiment, and its usage example.

[First Embodiment]
FIG. 1 is a diagram illustrating a configuration of an automatic determination device 1 according to the first embodiment and an example of its use. In the following description, an example in which the automatic determination device 1 is applied to monitoring of the speed plan surface of the ATC device will be described, but the present invention is not limited to this embodiment.

  The automatic determination device 1 includes imaging devices 2a and 2b, a HUB 3, and an automatic determination processing device 4. The imaging devices 2a and 2b respectively capture images to be compared. The HUB 3 is a line concentrator that connects the imaging devices 2 a and 2 b to the automatic determination processing device 4 via a network. The automatic determination processing device 4 compares images based on the video signals from the imaging devices 2a and 2b. The processing result is displayed on a display unit provided in the automatic determination processing device 4.

An ATC device 6 is incorporated in the ATC test facility 5 and updates the first system speed planning surface 7a and the second system speed planning surface 7b in real time based on a simulation signal from the simulator.
The imaging device 2a captures the 1-system speed plan surface 7a, converts it into a video signal, and outputs it to the automatic determination processing device 4. The imaging device 2b captures the second system speed plan surface 7b, converts it into a video signal, and outputs it to the automatic determination processing device 4.

FIG. 2 is a diagram illustrating a configuration of the test screen 10 displayed on the display unit of the automatic determination processing device 4.
The test screen 10 includes a read image display area 11, a determination result display area 12, and an operation area 13. In the read image display area 11, a 1-system speed plan plane read image 11a and a 2-system speed plan plane read image 11b photographed by the imaging device are displayed. In the determination result display area 12, a detailed determination result area 12a, a comprehensive determination result area 12b, and a test status area 12c are displayed. Various buttons for the user to operate the determination operation are provided in the operation area 13.

Next, the screen configuration of the speed plan plane read image will be described with reference to the first system speed plan plane read image 11a.
The first system speed plan plane read image 11a is provided with first to sixth areas to be compared. In the figure, an area surrounded by a dotted line indicated by a circled number represents an area to be compared.

  In the first area, information on the train speed is displayed. In FIG. 1, a current speed of 200 km / h and a running speed of 180 km / h are displayed. The input signal is displayed in the second area. In FIG. 1, it is displayed that “empty line”, “simultaneous call”, and “individual call” signals are input.

  In the third area, the displayed speed is displayed large independently. In the fourth area, the current speed is indicated by an arrow and the traveling speed is indicated by a slide bar. In the fifth area, messages related to train travel control, error information, and the like are displayed. In the sixth area, the traveling speed is displayed as large independently.

  The display information of each of these areas changes in real time according to the input signal from the simulator and the control operation of the ATC device 6. As described above, the software of the ATC device 6 that generates the 1-system speed plan plane read image 11a and the 2 system speed plan plane read image 11b is different. Therefore, the operation of the ATC device including the software can be verified by monitoring the difference between the two display screens.

  Next, the configuration of the determination result display area 12 will be described.

  In the detailed determination result area 12a, determination results obtained by comparing the 1-system speed plan plane read image 11a and the 2 system speed plan plane read image 11b include items “area”, “result”, “determination value”, “determination data”. ”And“ NG number ”.

  In “Area”, an area number set in the speed plan plane reading image is displayed. As the “determination data”, a ratio of matching two images for each area is displayed. In “Result”, the result of comparing two images in each area is displayed as “OK” or “NG”. In “determination value”, a threshold value for setting the value of the determination data to “OK” or “NG” is displayed. “Number of NG” is the number of times the determination result is NG. However, this number exceeds the allowable number of mismatches (set value), and the number is incremented by 1 when mismatches occur continuously.

In the comprehensive determination result area 12b, a result determined by comprehensively determining the determination results of each area is displayed as “OK” or “NG”.
“OK” is (1) when all the determination results for each area are OK, or (2) there is one or more NG in the determination result for each area, but the allowable number of mismatch continuations is not exceeded. If displayed.
“NG” is displayed when there is one or more NG in the determination result of each area and the allowable number of mismatch continuations is exceeded.

  The test status area 12c displays the test status. The total number of tests is the number of times that the judgment is performed. The start time, the elapsed time, and the current time represent the time when the test is started, the elapsed time from the start of the test to the current time, and the current date and time, respectively.

  FIG. 3 is a diagram illustrating a method of displaying the comprehensive determination result in the comprehensive determination result area 12b. FIG. 3 shows a display example when 1 is set as the allowable number of mismatch continuations. In FIG. 3, time elapses from left to right. As this time elapses, No. 1 to No. The determination process up to 9 is executed.

  Determination processing No. In 1 and 2, since the determination results of all the areas are ◯, “OK” is displayed in the comprehensive determination result area 12b. Determination processing No. In case of 3, since the judgment result is inconsistent, the result is x, and the mismatch counter is incremented by one. However, since it does not exceed 1, which is the allowed number of mismatches, “OK” is displayed in the comprehensive determination result area 12b.

Determination processing No. In 4 and 5, since the judgment result is inconsistent, it becomes “x”, and the mismatch counter is incremented by 1 to become 2 and 3, respectively. Then, since “1”, which is the allowable number of mismatches, is exceeded, “NG” is displayed in the comprehensive determination result area 12b. Determination processing No. In FIG. 6, since the determination results of all the areas are ◯, “OK” is displayed in the comprehensive determination result area 12b. Since the mismatch does not continue, the mismatch counter is reset to zero.
Determination processing No. In 7 to 9, determination processing is performed in the same manner as the above-described algorithm.

Here, consider a case where a transition is made from a static first state in which no difference occurs between two images to a second state. If there is a difference in the dynamic operation during the transition, the state where the difference exists continues, and the difference disappears when the second state is reached.
Therefore, a difference in dynamic characteristics (dynamic characteristics) can be detected by incorporating the inconsistent continuation state into the determination logic as described above.

Subsequently, parameters for automatic determination will be described. This parameter is input in the preparation stage for automatic determination.
FIG. 4 is a diagram showing the parameter setting input screen 20. The parameter setting input screen 20 includes a common parameter setting screen 21 and an area-specific parameter setting screen 22. The common parameter setting screen 21 is always displayed, and the area-specific parameter setting screen 22 is switched by the operation button (not shown).

The parameters on the common parameter setting screen 21 will be described.
The “determination execution period” is a period for performing determination. That is, the 1-system speed plan surface read image 11a and the 2 system speed plan surface read image 11b are read and compared at each determination execution cycle. The “permissible number of mismatch continuations” is the number of times that mismatch between two images is allowed, and can be an index representing the above-described difference in dynamic characteristics (dynamic characteristics).

The parameters on the area-specific parameter setting screen 22 will be described.
“Area valid / invalid” is a setting as to whether or not the area is to be subjected to comparison determination. The “permissible number of mismatches” is the number of times that mismatches between two areas to be compared are allowed, and can be set for an area in the same manner as the above-described mismatches for images. The “determination value” is a threshold value (%) for determining a match / mismatch between two areas to be compared. If the value of the comparison result is equal to or greater than this set value, it is determined that the images are the same.

  “Rotation angle” represents an angle range in which rotation of an image is allowed. With this setting, even if there is a difference in inclination between images captured by the two imaging devices 2a and 2b, it can be determined that the images are the same. “Scale” represents a magnification range in which image expansion and contraction is allowed. With this setting, even if there is a difference in the size of images captured by the two imaging devices 2a and 2b, it can be determined that they are the same image. In “Image 1”, the position information of the rectangular area of the image 1 to be compared and determined is set by the xy coordinates, the width, and the height at the upper left. “Image 2” sets the position information of the rectangular area of image 2 to be compared and determined by the upper left xy coordinates, width, and height.

  Next, the operation in the test mode in which the display contents of the first system speed planning surface 7a and the second system speed planning surface 7b are compared and determined in real time will be described.

FIG. 5 is a flowchart showing a schematic operation processing procedure in the test mode of the automatic determination processing device 4.
When the user clicks a “start test” button (not shown) in the main dialog displayed on the display unit, the test mode operation is started.

  In step S01, the automatic determination processing device 4 reads video signals obtained by photographing the 1-system speed planning surface 7a and the 2-system speed planning surface 7b from the imaging devices 2a and 2b, respectively. In step S02, the automatic determination processing device 4 displays, in real time, the first system speed plan surface read image 11a and the second system speed plan surface read image 11b captured by the imaging device in the read image display area 11 of the test screen 10. . Furthermore, the automatic determination processing device 4 is a rectangle representing an area to be compared in accordance with the parameters set on the area-specific parameter setting screen 22 for each of the 1-system speed plan plane read image 11a and the 2 system speed plan plane read image 11b. Is displayed. The test screen 10 displayed in step S02 is a screen having the same configuration as the screen shown in FIG.

  In step S03, the automatic determination processing device 4 compares two images for each area. The comparison is executed by comparing the image data of the rectangular area for each pixel pixel and determining whether or not they match. For example, when the number of pixels to be compared is 1000 pixels and 980 pixels are matched, the matching rate is 980/1000 = 98%.

  In step S04, the matching rate calculated for each area is output. For example, it is displayed in the corresponding area column of “determination data” in the determination result display area 12 of FIG. Then, a determination result is obtained by comparing with the “determination value”. Further, the continuation state of the mismatch is examined and comprehensive determination is performed and output to the comprehensive determination result area 12b.

  In step S05, a test result file in which data such as a 1-system speed plan surface reading image 11a, a 2 system speed plan surface reading image 11b, a test result log, and setting parameters are recorded is stored in a predetermined test result folder.

  The automatic determination processing device 4 repeatedly executes the processes from step S01 to step S05 described above at the determination execution cycle. Then, the operation ends when the end button provided in the operation area 13 of the test screen 10 is operated.

  Subsequently, a browsing mode in which a test result file recorded during an automatic test is read after performing an automatic test in the test mode, and the state of the automatic test is reproduced will be described.

FIG. 6 is a flowchart showing a schematic operation processing procedure in the browsing mode of the automatic determination processing device 4.
When the user clicks a “browsing start” button (not shown) in the main dialog displayed on the display unit, the browsing mode operation is started. At this time, the test result folder storing the test result file is selected.

  In step S11, the automatic determination processing device 4 takes out a test result file from the selected test result folder, and displays a browsing screen in step S12. Similar to the test screen 10, the browsing screen displays a speed plan plane read image and a test result.

FIG. 7 is a diagram illustrating a configuration of the browsing screen 30 displayed on the display unit of the automatic determination processing device 4.
The browsing screen 30 has the same configuration as the test screen 10, and includes a result image display area 31, a determination result display area 32, and an operation area 33. In the result image display area 31, the stored 1-system speed plan surface read image 11a and 2 system speed plan surface read image 11b are displayed. In the determination result display area 32, a detailed determination result area 32a, a comprehensive determination result area 32b, and a test status area 32c are displayed. Various operation buttons are provided in the operation area 33.

Except for the test status area 32c, the configuration is the same as that of the test screen 10, and a detailed description thereof will be omitted.
The “total number of tests” in the test status area 32 c displays the displayed test number / total number of tests. “Disclosure time”, “end time”, and “determination time” indicate the date and time when the test was started, ended, and conducted, respectively.

In step S13 of FIG. 6, the test results are displayed in various manners according to the user's reproduction operation.
The browsing screen 30 is provided with a result reproduction dialog 35. By operating each button of the result reproduction dialog 35, the test result can be reproduced in various modes. For example, the test result can be reproduced in the forward or backward direction. Further, the test result 10 times before or 10 times after the currently displayed test result can be reproduced. Furthermore, a test result with a determination of NG can be retrieved in the forward or backward direction, and the test result can be reproduced therefrom. Accordingly, it is possible to immediately display the item that has become NG.

  The result file is not only displayed, but can also be printed out using commercially available application software.

[Second Embodiment]
The second embodiment is different from the first embodiment in that there is one imaging device and the images captured at different timings are compared. Accordingly, the same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

FIG. 8 is a diagram illustrating a configuration of the automatic determination device 1 according to the second embodiment and an example of its use.
In the first step, a reference image is taken by the imaging device 2. The captured image is recorded on a recording medium (not shown) of the automatic determination processing device 4.
In the second step, an image of the device under test is taken by the imaging device 2. The photographed image of the test object is displayed side by side on the recorded reference image and the test screen shown in FIG. 2, and the comparison result is determined.

FIG. 9 is a diagram illustrating a configuration of the automatic determination device 1 according to a variation of the second embodiment and an example of its use.
In the first step, a reference image is taken by the imaging device 2. The captured image is recorded on a recording medium (not shown) of the automatic determination processing device 4.
In the second step, an image to be determined among the recorded images, for example, an image in which the subject is dynamically changed, is selected as the reference image. The selected reference image is a determination target.

  Thereafter, as shown in the second step of FIG. 8, an image of the test object is taken by the imaging device 2. The captured image of the test object is displayed side by side on the recorded image and the test screen shown in FIG. However, the comparison result is determined in a state of comparison with a reference image selected in advance.

[Effect of the embodiment]
According to the automatic determination device of each embodiment described above, the following effects can be obtained.
(1) In the automatic determination device according to the present embodiment, the object to be tested is imaged by the imaging device, and the determination is performed according to the captured image. When comparing speed planning planes as in this embodiment, it is normal to directly capture and process video signals without going through an imaging device.

  However, in the mode in which the video signal is directly captured, it is necessary to modify the ATC device to be measured, and it is difficult to realize an inexpensive configuration. Moreover, since it becomes a modification according to each measuring object, it cannot be set as a general purpose structure. Therefore, it takes a period for creating a desired device, and it is difficult to apply the determination easily.

  As described above, the automatic determination device according to the present embodiment can perform determination inexpensively, simply and efficiently.

(2) Moreover, in the automatic determination apparatus of this Embodiment, the environment equivalent to what an inspector visually recognizes is implement | achieved by using an imaging device. That is, rather than making a determination with much higher accuracy than the inspector, the determination is made at a level that can replace the sensory test of the inspector. As a result, it is inexpensive and can be replaced by an inspector, and a stable inspection result can be obtained regardless of variations in inspector skills.
(3) In addition, the automatic determination device according to the present embodiment is configured to record the determination result and the video used for the determination every predetermined period and to view it. Therefore, the determination result can be left as evidence together with the monitoring video, and further the browsing can be performed, so that the result can be utilized in many ways.
(4) Moreover, in the automatic determination apparatus of this Embodiment, when mismatching has arisen in both to-be-tested objects, it is employ | adopted as a determination reference | standard whether the state continues. As a result, it is possible to detect a difference in dynamic operation between the test objects.

  (5) Further, in the automatic determination device according to the present embodiment, a reference video is stored in advance, and the video and the video taken by the imaging device are compared and determined. According to this embodiment, the application target can be expanded.

  (6) As described above, the labor of the inspector can be greatly reduced by using the automatic determination device of the present embodiment, and the efficiency of the inspection work can be improved.

  In the above-described embodiment, two imaging devices are used. However, the number is not limited to two, and three or more imaging devices may be used.

  Each function described in the above embodiment may be configured using hardware, or may be realized by reading a program describing each function into a computer using software. Each function may be configured by appropriately selecting either software or hardware.

  Furthermore, each function can be realized by causing a computer to read a program stored in a recording medium (not shown). Here, as long as the recording medium in the present embodiment can record a program and can be read by a computer, the recording format may be any form.

Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage.
Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

    DESCRIPTION OF SYMBOLS 1 ... Automatic determination apparatus, 2a, 2b ... Imaging device, 4 ... Automatic determination processing apparatus, 5 ... ATC test equipment, 6 ... ATC apparatus, 7a ... 1 system speed plan surface, 7b ... 2 system speed plan surface, 10 ... Test Screen 11, read image display area, 11 a, 1 system speed plan surface read image, 11 b, 2 system speed plan surface read image, 12, determination result display area, 12 a, detailed determination result area, 12 b, comprehensive determination result area, 12c ... Test status area, 13 ... Operation area, 20 ... Parameter setting input screen, 21 ... Common parameter setting screen, 22 ... Parameter setting screen for each area, 30 ... Viewing screen, 31 ... Result image display area, 32 ... Determination result display Area, 32a ... Detailed judgment result area, 32b ... Overall judgment result area, 32c ... Test status area, 33 ... Operation area, 35 ... Result playback dialog.

Claims (3)

Two imaging devices for imaging each of two inspected objects that receive the same signal and output a processing result based on the signal;
Input means for inputting two images taken by the two imaging devices at a predetermined period;
An area setting means for setting at least a pair of comparison target areas from the two images input via the input means;
For the at least one pair of regions, matching / mismatching is determined between corresponding pixels, and a ratio determined to be matching among the total number of pixels included in the region is obtained, and the obtained ratio satisfies a predetermined standard. First determination means for determining that the at least one pair of regions match when satisfied,
A second determination unit that determines that the two captured images do not match when the number of times that the first determination unit determines that at least a pair of regions are mismatched continues for a predetermined number of times;
An automatic determination apparatus comprising: a storage unit that stores a determination result by the first determination unit and a determination result by the second determination unit for each predetermined period. The storage means further stores two images taken by the two imaging devices,
The automatic determination apparatus according to claim 1, further comprising a browsing unit that displays the two images stored in the storage unit and the determination results of the first and second determination units on a display device. Judgment device. A step of photographing each of two inspected objects that receive the same signal and output a processing result based on the signal with two imaging devices;
Inputting two images captured by the two imaging devices at a predetermined period;
Setting at least a pair of comparison target regions from the two input images;
For the at least one pair of regions, matching / mismatching is determined between corresponding pixels, and a ratio determined to be matching among the total number of pixels included in the region is obtained, and the obtained ratio satisfies a predetermined standard. A first determination step for determining that the at least a pair of regions match when satisfied,
A second determination step for determining that the two photographed images are inconsistent when the number of times at least a pair of regions determined to be inconsistent by the first determination step continues for a predetermined number of times or more;
An automatic determination method comprising: a step of storing a determination result by the first determination step and a determination result by the second determination step for each predetermined period.

Images