JP2019197307A - Image processing system and abnormality detection method - Google Patents

Abstract

To provide an image processing system and an abnormality detection method capable of detecting a minor abnormality and identifying a problem portion when an abnormality occurs in image processing means.SOLUTION: A image processing system defines: an image Iorg, to be a test pattern; Iproc, to be an image subjected to image processing; Iorg_check, to be an image Iorg transmitted, and Iproc_check, to be a transmitted image Iproc, both via a component in the image processing system at the time of abnormality detection processing. The image processing system determines: that there is no abnormality when Iorg matches Iorg_check, and Iproc matches Iproc_check; that image processing means is abnormal when Iorg matches Iorg_check, but Iproc does not match Iproc_check; and that an inside of the image processing system is abnormal when Iorg does not match Iorg_check or Iproc does not match Iproc_check.SELECTED DRAWING: Figure 8

Description

  The present invention relates to an image processing system and an abnormality detection method for processing an image.

  As shown in FIG. 10, the conventional image processing system 101 includes an image output unit 102 that outputs a captured image, an image processing unit 103 that processes an image output from the image output unit 102, and an image processing unit 103. And an image receiving unit 104 for receiving an image processed by the above. In addition, the image processing system 101 includes a first image transmission unit 111 that transmits an image from the image output unit 102 to the image processing unit 103, and a second image transmission unit that transmits an image from the image processing unit 103 to the image reception unit 104. 112. Therefore, the image output unit 102 and the image processing unit 103 are connected by the first image transmission unit 111, and the image processing unit 103 and the image reception unit 104 are connected by the second image transmission unit 112.

The conventional image processing system 101 transmits images to the image receiving unit 104 in the following order.
(1) The image output unit 102 outputs a captured image.
(2) The first image transmission unit 111 transmits the image output from the image output unit 102 to the image processing unit 103.
(3) The image processing unit 103 receives an image transmitted via the first image transmission unit 111.
(4) The image processing unit 103 performs image processing on the received image.
(5) The image processing unit 103 outputs an image subjected to image processing.
(6) The second image transmission unit 112 transmits the image processed by the image processing unit 103 to the image reception unit 104.
(7) The image receiving unit 104 receives an image transmitted via the second image transmitting unit 112.

However, the conventional image processing system having such a configuration has the following problems.
That is, when an abnormality occurs in any of the image output unit, the image transmission unit, the image processing unit, and the image receiving unit, there is a problem that an abnormality occurs in the image (received image) received by the image receiving unit. As an abnormality of the image output unit, for example, there is a failure of a connector of the image output unit. When the connector fails, the pixel value information for one line is lost (missed). Further, if the image output unit itself fails, the pattern image becomes a random pattern. As an abnormality of the image processing unit, for example, when the image processing is edge processing (contour extraction processing), the edge stands out unnaturally, or conversely, the edge portion is blurred. In addition, the image receiving unit itself has no failure, but the connection destination of the image receiving unit may be a failure due to an application of a personal computer (PC) or a storage medium of the personal computer (PC).

  Thus, there is a medical image diagnostic apparatus that determines a failure mode by comparing a failure diagnosis image collected by X-ray imaging in the failure diagnosis mode with standard image data collected in advance (see, for example, Patent Document 1). In this way, it is possible to detect an abnormality by comparing the fault diagnosis image in the captured image with the standard image data. In addition, there is an inspection system for a medical device that transmits a certain test pattern and compares it with a test image (see, for example, Patent Document 2). In this case, the test raw data (a constant test pattern) is output, reconstruction (image processing) is performed, and the reconstructed image is compared with the test image stored in advance to detect abnormality. Is possible.

JP 2013-165957 A JP 2002-301060 A

However, the conventional image processing system having such a configuration has the following new problem.
That is, in the conventional image processing system, when a system abnormality is detected, it is difficult to determine which part of the image output unit, the image transmission unit, the image processing unit, or the image receiving unit is abnormal. . In addition, when a slight abnormality occurs in the received image due to a minor failure, it is difficult to detect the abnormality by visual recognition.

  The present invention has been made in view of such circumstances, an image processing system capable of detecting a minor abnormality and identifying a problem location when there is an abnormality in the image processing means, and an abnormality. An object is to provide a detection method.

In order to achieve such an object, the present invention has the following configuration.
In other words, the image processing system according to the present invention is an image processing system for processing an image, an image output means for outputting an image, an image processing means for processing an image output from the image output means, and the image An image receiving means for receiving an image processed by the processing means; an image transmitting means for transferring an image from the image output means to the image processing means; an image transmitting means from the image processing means to the image receiving means; and the image processing means. Image storage means for storing switching setting means for switching image processing to either valid or invalid, a test pattern image Iorg, and an image Iproc obtained by performing image processing on the test pattern image Iorg by the image processing means And an abnormality determining means for determining an abnormality in the image processing system, wherein the abnormality determining means is controlled by the switching setting means. The image Iorg is output by the image output means in a state where the image processing is disabled and the image Iorg_check received by the image receiving means via the image processing means and the image transmission means, and the switching setting means With the image processing being effectively switched by the above, the image Iproc_check received by the image receiving unit is stored in the image storage unit via the image processing unit and the image transmission unit, and the image Iorg and the image Iorg_check are stored. The image Iproc and the image Iproc_check are compared. (A) If the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, there is no abnormality. (B) If the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, the image processing means is abnormal It is determined that

  [Operation / Effect] According to the image processing system of the present invention, the test pattern is the image Iorg, the image Iorg without image processing is stored in advance in the image storage means, and image processing by the image processing means is performed on the image Iorg. The image with image processing performed is set as Iproc, and the image Iproc with image processing is stored in advance in the image storage means. Here, the process of storing the images Iorg and Iproc in advance in the image storage unit (pre-processing) may be performed when the system is shipped from the factory.

  Further, in order to identify a problem location in order to perform an abnormality determination in the image processing system, an image consisting of a test pattern stored during an abnormality detection process or automatic diagnosis described later is output from the image output means, and the image processing means and The image received by the image receiving means is stored in the image storage means via the image transmission means. On the other hand, in the case of preprocessing, an image Iorg consisting of a test pattern is output from the image output means, and the images Iorg and Iproc received by the image receiving means are stored in the image via the image processing means and the image transmission means. There is no need to memorize the means. The images Iorg and Iproc may be stored directly in the image storage means without transmitting the images Iorg and Iproc to each component. Of course, since no failure has occurred in each component during the pre-processing, the images Iorg and Iproc may be transmitted to each component and stored in the image storage unit.

  Iorg_check is the image Iorg without image processing received by the image receiving means via the image processing means and the image transmission means in the state where the image processing is switched to invalid by the switching setting means at the time of abnormality detection processing or automatic diagnosis. The image Iorg_check is stored in the image storage means. Similarly, the image Iproc with image processing received by the image receiving means via the image processing means and the image transmission means in a state where the image processing is effectively switched by the switching setting means at the time of abnormality detection processing or automatic diagnosis Is Iproc_check, and the image Iproc_check is stored in the image storage means. The order of the images Iorg_check and Iproc_check to the image storage means at the time of abnormality detection processing or automatic diagnosis is not particularly limited.

  Further, abnormality determination inside the image processing system may be performed during the abnormality detection processing. As the abnormality detection processing, an operator inputs a command for determining an abnormality in the image processing system, and the image processing is performed in synchronization with the command using the command as a trigger (which performs an abnormality determination in the image processing system). Perform internal abnormality judgment. Further, abnormality determination inside the image processing system may be performed during automatic diagnosis. As automatic diagnosis, a trigger for determining abnormality in the image processing system is periodically output, and abnormality determination in the image processing system is performed in synchronization with the trigger. In the case of the former abnormality detection process, the surgeon inputs a command at an arbitrary timing, so that an abnormality determination in the image processing system can be performed at an arbitrary timing. In the case of the latter automatic diagnosis, there is an effect that the abnormality determination inside the image processing system can be automatically performed periodically without an operator inputting a command.

  The abnormality determination unit compares the image Iorg (without image processing stored in advance in the image storage unit) with the image Iorg_check (without image processing stored in the image storage unit during abnormality detection processing or automatic diagnosis). To do. Similarly, the abnormality determination means includes an image Iproc (with image processing stored in advance in the image storage means) and an image Iproc_check (with image processing stored in the image storage means during abnormality detection processing or automatic diagnosis). And compare.

The abnormality determination means performs abnormality determination inside the image processing system using the above comparison result as follows.
That is, (a) if the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, it is determined that there is no abnormality. In the case of (a), the images Iorg and Iorg_check without image processing in the pre-processing / abnormality detection processing (or automatic diagnosis) match, and the pre-processing / abnormality detection processing (or automatic diagnosis) Since the images Iproc and Iproc_check with image processing in (1) match, it can be seen that no abnormality has occurred in the image processing system during abnormality detection processing or automatic diagnosis.

  (B) When the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, it is determined that the image processing means is abnormal. In the case of (b), the images Iorg and Iorg_check without image processing in the pre-processing / abnormality detection processing (or automatic diagnosis) match, and the pre-processing / abnormality detection processing (or automatic diagnosis) The image Iproc and Iproc_check with image processing in) do not match, so it can be seen that there is a mismatch between the image Iproc and Iproc_check with image processing due to the image processing means, and during abnormality detection processing or automatic diagnosis It can be seen that an abnormality has occurred in the image processing means.

  As described above, since the test pattern has no fluctuation of the pixel value (that is, statistical error), normality / abnormality can be accurately determined. Further, it is possible to detect a slight abnormality that is difficult to detect by visual recognition. In addition, since the abnormality determination unit is applied not only to an image with image processing but also to an image without image processing, it is possible to identify a problem location when there is an abnormality in the image processing unit.

  In addition, the abnormality determination means determines that the inside of the image processing system is abnormal when (c) the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match. May be. In the case of (c), the images Iorg and Iorg_check without image processing in the pre-processing / abnormality detection processing (or automatic diagnosis) do not match, and the pre-processing / abnormality detection processing (or automatic diagnosis) Since the images Iproc and Iproc_check with image processing at the same time do not match, it can be seen that an abnormality has occurred in the image processing system during abnormality detection processing or automatic diagnosis. In the case of (c), it is not specified up to which part the image processing system has a problem, but it is possible to detect a slight abnormality (difficult to detect by visual recognition) in the received image due to a minor failure. .

As described above, since the test pattern has no fluctuation (statistical error) of the pixel value, it is preferable to perform the specific determination of coincidence / non-coincidence as follows.
That is, the abnormality determination unit determines that the images Iorg and Iorg_check without image processing match if the pixel values of all the pixels in the images Iorg and Iorg_check without image processing match, and the images Iorg and Iorg_check without image processing match. If even at least one pixel does not match, it is determined that the images Iorg and Iorg_check without image processing do not match. Further, the abnormality determination means determines that the image Iproc and Iproc_check with image processing match if the pixel values in all the pixels match in the image Iproc and Iproc_check with image processing, and the image Iproc and Iproc_check with image processing match. If at least one pixel does not match the pixel value, it is determined that the images Iproc and Iproc_check with image processing do not match. In other words, if there is no fluctuation (statistical error) of the pixel value in the test pattern, the image (Iorg, Iproc) at the time of preprocessing and the received image (Iorg_check, Iproc_check) at the time of abnormality detection processing or automatic diagnosis Are not exactly the same (even if one pixel does not match the pixel value), it can be determined that the two images do not match. Of course, of the number of pixels whose pixel values do not match between the two images, a predetermined number is set as the threshold value, or a predetermined value is set as the threshold value among the absolute values of the difference values of the pixel values between the two images. If it is less than the threshold value, it is determined that both images match, and if the value is equal to or greater than the threshold value, it is determined that the images do not match, and an allowable range may be given.

  The abnormality detection method according to the present invention is an abnormality detection method for an image processing system that processes an image, and an image Iorg_check based on a test pattern image Iorg is synchronized with a trigger for determining an abnormality in the image processing system. An image storage step of storing in the image storage means an image Iproc_check based on the image Iproc obtained by performing image processing by the image processing means on the test pattern image Iorg, and an abnormality determination step of performing abnormality determination inside the image processing system In the image storage step, the image Iorg is output in a state where the image processing by the image processing unit is disabled, and the image Iorg_check received through the image processing unit and the image by the image processing unit are output. In a state where processing is effectively switched, the received image Iproc_check is stored in the image storage unit via the image processing unit, and the abnormality In the regular process, the image Iorg and the image Iorg_check are compared, and the image Iproc and the image Iproc_check are compared. If they match, it is determined that there is no abnormality. (B) If the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, the image processing means It is determined to be abnormal.

  [Operation / Effect] According to the abnormality detection method of the present invention, when the test pattern is the image Iorg, and the image with image processing obtained by performing image processing by the image processing means on the image Iorg is Iproc, the image processing system In synchronization with the trigger for determining the internal abnormality, in the image storage process, an image Iorg_check based on the test pattern image Iorg, and an image Iproc_check based on the image Iproc obtained by performing image processing by the image processing means on the test pattern image Iorg Is stored in the image storage means.

  Specifically, in a state where the image processing by the image processing means is switched to either valid or invalid, the image Iorg is transmitted to the image processing means, and further the image is transmitted to the image receiving means to be stored in the image storage means. Write and store. Similarly, with the image processing by the image processing means switched to either valid or invalid, the image Iorg is transmitted to the image processing means, and the image is further transmitted to the image receiving means and written to the image storage means. Remember. As described in the image processing system according to the present invention, image storage means for image Iorg_check without image processing during abnormality detection processing or automatic diagnosis, and image Iproc_check with image processing during abnormality detection processing or automatic diagnosis There is no particular limitation on the order.

  At the time of abnormality detection processing or automatic diagnosis, the image Iorg is output in a state where the image processing by the image processing means is disabled, and the received image Iorg_check is stored in the image storage means via the image processing means. Similarly, at the time of abnormality detection processing or automatic diagnosis, the received image Iproc_check is stored in the image storage means via the image processing means in a state where the image processing by the image processing means is effectively switched.

  In the abnormality determination step, the image Iorg (without image processing stored in advance in the image storage means) is compared with the image Iorg_check (without image processing stored in the image storage means during abnormality detection processing or automatic diagnosis). To do. Similarly, in the abnormality determination step, an image Iproc (with image processing stored in advance in the image storage means) and an image Iproc_check (with image processing stored in the image storage means during abnormality detection processing or automatic diagnosis) And compare.

  As described in the image processing system according to the present invention, abnormality determination inside the image processing system may be performed at the time of abnormality detection processing, or abnormality determination inside the image processing system may be performed at the time of automatic diagnosis. In the case of the former abnormality detection processing, first, in the command input process, a command for performing abnormality determination inside the image processing system is input. When a command is input in the command input process, the command in the command input process is used as a trigger (determining abnormality in the image processing system), and abnormality determination in the image processing system is performed in synchronization with the command (that is, image storage) Process and abnormality determination process).

In the abnormality determination step, abnormality determination in the image processing system is performed as follows using the above comparison result.
That is, as in the image processing system according to the present invention, (A) When the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, it is determined that there is no abnormality. To do. Also, (B) if the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, it is determined that the image processing means is abnormal.

  As described above, since the test pattern has no fluctuation of the pixel value (that is, statistical error), normality / abnormality can be accurately determined. Further, it is possible to detect a slight abnormality that is difficult to detect by visual recognition. In addition, since the abnormality determination in the abnormality determination step is applied not only to an image with image processing but also to an image without image processing, it is possible to specify a problem location when there is an abnormality in the image processing means.

  Similarly to the image processing system according to the present invention, (C) when the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match, You may determine that it is abnormal. As described above, in the case of (C), it is not specified which part of the image processing system has a problem, but a slight abnormality (difficult to detect by visual recognition) in a received image due to a minor failure is detected. Can do.

  (D) In the case of (B), it is displayed that the images with image processing do not match, and in the case of (C), the image with image processing does not match the image without image processing. Is displayed. Thereby, in the case of (B) and (C), the discrepancy of each image can be grasped from the display result.

  According to the image processing system and the abnormality detection method of the present invention, the image Iorg (without image processing stored in advance in the image storage means) and the image storage means stored during abnormality detection processing or automatic diagnosis are stored. Compare with image Iorg_check (without image processing). Similarly, the image Iproc (with image processing stored in advance in the image storage unit) is compared with the image Iproc_check (with image processing stored in the image storage unit during abnormality detection processing or automatic diagnosis). (A) When the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, it is determined that there is no abnormality ((A) in the abnormality detection method). Also, (b) if the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, it is determined that the image processing means is abnormal (in the abnormality detection method (B )). Since the test pattern has no fluctuation (statistical error) of the pixel value, normality / abnormality can be accurately determined. Further, it is possible to detect a slight abnormality that is difficult to detect by visual recognition. In addition, since abnormality determination is applied not only to an image with image processing but also to an image without image processing, it is possible to identify a problem location when there is an abnormality in the image processing means.

1 is a block diagram of an image processing system according to an embodiment. 1 is a block diagram of an image processing system including an imaging unit and a personal computer (PC). It is a flowchart of a series of abnormality detection methods according to the present embodiment. It is a block diagram of an image processing unit in which the flow of each image data at the time of abnormality detection processing is shown. It is a schematic diagram of the image which consists of a test pattern. It is a display mode of a command input screen on a monitor in a personal computer (PC). It is a schematic diagram for explaining the determination method of coincidence / mismatch of images at the time of pre-processing / abnormality detection processing using binary data, (a) is a schematic diagram showing the relationship between pixel values and binary data, (B) is a schematic diagram regarding comparison of binary data in images Iorg and Iorg_check without image processing. It is a table showing the presence or absence of abnormality determination at each determination result. It is a schematic diagram for explaining the determination method of image coincidence / non-coincidence at the time of pre-processing / abnormality detection processing according to a modified example, and a predetermined number of pixels out of the number of pixels whose pixel values do not match between the two images It is a schematic diagram at the time of setting as a threshold value. It is a block diagram of the conventional image processing system.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram of an image processing system according to the embodiment, and FIG. 2 is a block diagram of an image processing system including a photographing unit and a personal computer (PC). In the present embodiment, a case where an abnormality determination in the image processing system is performed during an abnormality detection process will be described as an example.

  As shown in FIG. 1, the image processing system 1 is processed by an image output unit 2 that outputs a captured image, an image processing unit 3 that processes an image output from the image output unit 2, and an image processing unit 3. And an image receiving unit 4 for receiving the processed image. In addition, the image processing system 1 includes a first image transmission unit 11 that transmits an image from the image output unit 2 to the image processing unit 3, and a second image transmission unit that transmits an image from the image processing unit 3 to the image reception unit 4. 12 and so on. The image output unit 2 corresponds to the image output unit in the present invention, the image processing unit 3 corresponds to the image processing unit in the present invention, the image receiving unit 4 corresponds to the image receiving unit in the present invention, and the first The image transmission unit 11 and the second image transmission unit 12 correspond to image transmission means in the present invention.

  Furthermore, in this embodiment, the image processing system 1 includes a switching setting unit 21 that switches between enabling and disabling image processing by the image processing unit 3, an image memory unit 22 that stores images, and an image memory unit. The comparator 23 that compares the image stored in advance in the image 22 with the image stored in the image memory unit 22 during the abnormality detection process, and the abnormality determination in the image processing system 1 using the comparison result in the comparator 23 And an abnormality determination unit 24 for performing The switch setting unit 21 corresponds to the switch setting unit in the present invention, the image memory unit 22 corresponds to the image storage unit in the present invention, and the comparator 23 and the abnormality determination unit 24 correspond to the abnormality determination unit in the present invention. To do.

  In the present embodiment, as shown in FIG. 2, the image output unit 2 (see FIG. 1) includes a connector 2 </ b> A, and the connector 2 </ b> A is electrically connected to the photographing unit 31. The imaging unit 31 includes a solid-state imaging device (CCD: Charge Coupled Device) or a flat panel X-ray detector (FPD: Flat Panel Detector). By connecting in this way, the image output unit 2 configured with the connector 2 </ b> A outputs an image photographed by the photographing unit 31.

  In the present embodiment, the first image transmission unit 11 (see FIG. 1) is configured by a cable 11A, and the cable 11A is electrically connected to the connector 2A and the image processing unit 3. By connecting in this way, the first image transmission unit 11 configured by the cable 11A transmits the image from the image output unit 2 configured by the connector 2A to the image processing unit 3.

  In this embodiment, the image processing unit 3 is configured by connecting a plurality of processing units 3A, 3B, 3C,... (Five processing units 3A, 3B, 3C, 3D, 3E in FIG. 2) in series. . Each image processing by the image processing unit 3 is not particularly limited as long as it is an image processing that matches the characteristics of the image, as exemplified by gain correction, lag correction, offset correction, gradation conversion, and the like. The image processing unit 3 includes a central processing unit (CPU). As for the image processing unit 3, a GPU (Graphics Processing Unit) or a programmable device (for example, an FPGA (Field Programmable Gate Array)) in which an internal hardware circuit (for example, a logic circuit) can be changed according to program data, etc. It may be constituted by.

  Similar to the first image transmission unit 11, the second image transmission unit 12 (see FIG. 1) is configured by a cable 12A. Like the image output unit 2, the image reception unit 4 (see FIG. 1) is a connector 4A. It consists of The cable 12A is electrically connected to the image processing unit 3 and the connector 4A. By connecting in this way, the second image transmission unit 12 configured by the cable 12A transmits the image from the image processing unit 3 to the image reception unit 4 configured by the connector 4A. The first image transmission unit 11 and the second image transmission unit 12 may be a wireless local area network (LAN) or may transmit an image wirelessly.

  The connector 4A is electrically connected to a personal computer (PC) 41. The PC 41 includes a CPU 42, a storage medium 43, and an input unit 44. The CPU 42 and the storage medium 43 in the PC 41 are electrically connected to the connector 4A.

  In this embodiment, the CPU 42 has functions of a switching setting unit 21 (see FIG. 1), a comparator 23 (see FIG. 1), and an abnormality determination unit 24 (see FIG. 1). These specific functions will be described later with reference to FIGS.

  The storage medium 43 is configured by a ROM (Read-only Memory), a RAM (Random-Access Memory), or the like. In the present embodiment, the storage medium 43 has the function of the image memory unit 22 (see FIG. 1). Specific functions of the image memory unit 22 will also be described later with reference to FIGS.

  The input unit 44 includes a pointing device represented by a mouse, a keyboard, a joystick, a trackball, a touch panel, and the like. In this embodiment, a button on the software (see the execution button 45A in FIG. 6) displayed on the monitor (not shown in FIGS. 1 and 2) in the PC 41 is pressed by the input unit 44 (the input unit 44 is a mouse). In this case, click to start abnormality determination.

  Next, a specific abnormality detection method will be described with reference to FIGS. FIG. 3 is a flowchart of a series of abnormality detection methods according to the present embodiment, FIG. 4 is a block diagram of an image processing unit in which the flow of each image data at the time of abnormality detection processing is shown, and FIG. FIG. 6 is a schematic diagram of an image composed of test patterns, FIG. 6 is a display mode of a command input screen on a monitor in a personal computer (PC), and FIG. 7 is a time of pre-processing and abnormality detection processing using binary data. FIG. 7A is a schematic diagram illustrating the relationship between pixel values and binary data, and FIG. 7B is a schematic diagram for explaining an image match / mismatch determination method in FIG. FIG. 8 is a schematic diagram regarding comparison of binary data in unprocessed images Iorg and Iorg_check, and FIG. 8 is a table showing the presence / absence of abnormality determination for each determination result.

  When the test pattern is an image Iorg and an image with image processing obtained by performing image processing on the image Iorg by the image processing unit 3 (see FIG. 1) is Iproc, the images Iorg and Iproc are set when the system is shipped from the factory. It is stored in advance in the image memory unit 22 (see FIG. 1). For example, as shown in FIG. 5, the image Iorg has a pattern in which the pixel value decreases stepwise as it goes to the center, and the pixel value increases stepwise as it goes to both ends. The image Iorg is not limited to the pattern shown in FIG. 5 as long as it is a predetermined pattern. Note that the timing at which the images Iorg and Iproc are stored in advance in the image memory unit 22 is not limited to when the system is shipped from the factory. The timing may be any time before the storage of the images Iorg_check and Iproc_check at the time of abnormality detection processing in step S2 described later.

  In the case of pre-processing, an image Iorg consisting of a test pattern is output from the image output unit 2 (see FIG. 1), and the first image transmission unit 11 (see FIG. 1) and the image processing unit 3 (see FIG. 1). 1 and FIG. 2) and the image Iorg and Iproc received by the image receiving unit 4 (see FIG. 1) via the second image transmission unit 12 (see FIG. 1) and the image memory unit 22 (see FIG. 1). Need not be memorized). For example, the images Iorg and Iproc may be stored in an external storage medium, and the images Iorg and Iproc stored in the external storage medium may be stored directly in the image memory unit 22.

(Step S1) Command Input As shown in FIG. 6, a command input screen is displayed on the monitor 45 in the PC 41 (see FIG. 2), and an execution button 45A on the command input screen (indicated as “Start” in FIG. 6). The operator presses the button) with the input unit 44 (see FIG. 2). When the input unit 44 is a mouse, the surgeon clicks the execution button 45A with the mouse, and when the input unit 44 is a touch panel, the surgeon touches the execution button 45A with a finger on the touch panel. In this way, by pressing the execution button 45A by the input unit 44, the surgeon inputs a command for performing abnormality determination inside the image processing system 1, and starts abnormality determination. Step S1 corresponds to a command input step in the present invention.

(Step S2) Image Storage When a command is input in step S1, each image is stored in the image memory unit 22 (see also FIG. 1) as shown in FIG. 4 during the abnormality detection process. During the abnormality detection process, the first image transmission unit 11 (FIG. 1) is displayed in a state where the image processing by the image processing unit 3 (see also FIGS. 1 and 2) is disabled by the switching setting unit 21 (see FIG. 1). The image Iorg without image processing received by the image receiving unit 4 (see also FIG. 1) via the image processing unit 3 and the second image transmission unit 12 (see also FIG. 1) as Iorg_check, and the image Iorg_check Is stored in the image memory unit 22. Similarly, during the abnormality detection process, the image processing by the image processing unit 3 is disabled by the switch setting unit 21 via the first image transmission unit 11, the image processing unit 3, and the second image transmission unit 12. The image Iproc with image processing received by the image receiving unit 4 is set as Iproc_check, and the image Iproc_check is stored in the image memory unit 22.

  The order of the images Iorg_check and Iproc_check to the image memory unit 22 during the abnormality detection process is not particularly limited. An image Iorg_check without image processing is stored in the image memory unit 22 in a state where image processing is disabled, and then an image Iproc_check with image processing is stored in the image memory unit 22 in a state where image processing is enabled. May be. On the contrary, after storing the image Iproc_check with image processing in the image memory unit 22 in a state where the image processing is effectively switched, the image Iorg_check without image processing is stored in the image memory unit 22 in a state where the image processing is switched off. May be stored. Step S2 corresponds to the image storing step in the present invention.

(Step S3) Image Comparison The image Iorg without image processing stored in advance in the image memory unit 22 is compared with the image Iorg_check without image processing stored in the image memory unit 22 at the time of abnormality detection in step S2. Similarly, the image Iproc with image processing stored in advance in the image memory unit 22 is compared with the image Iproc_check with image processing stored in the image memory unit 22 during the abnormality detection process in step S2.

  The test pattern shown in FIG. 5 has no pixel value fluctuation (statistical error). Therefore, the comparator 23 (see FIG. 1) determines that the images Iorg and Iorg_check without image processing match if the pixel values of all the pixels in the images Iorg and Iorg_check without image processing match, and there is no image processing. If the pixel value does not match even at least one pixel in the images Iorg and Iorg_check, it is determined that the images Iorg and Iorg_check without image processing do not match. Further, the comparator 23 determines that the images Iproc and Iproc_check with image processing match if the pixel values of all the pixels in the images Iproc and Iproc_check with image processing match, and the images Iproc and Iproc_check with image processing match. If at least one pixel does not match the pixel value, it is determined that the images Iproc and Iproc_check with image processing do not match.

  As shown in FIG. 7, the pixel value is represented by binary data. In FIG. 7, the pixel value is represented by 8 bits. That is, the pixel value is in the range of 0 to 255 in decimal. In FIG. 7A, pixels are arranged every 8 bits, “00001111” is a decimal number and the pixel value is “15”, and “00000111” is a decimal number and the pixel value is “7”. Therefore, “0000111100000111” means that pixels having a pixel value of “15” in decimal and pixels having a pixel value of “7” in decimal are arranged.

  As shown in FIG. 7B, the binary data in the image Iorg without image processing is compared with the binary data in the image Iorg_check without image processing. If binary data matches in all bits, it is determined that pixel values in all pixels match in images Iorg and Iorg_check without image processing. As a result, it is determined that the images Iorg and Iorg_check without image processing match. Even if 1 bit does not match the binary data, it is determined that the pixel value does not match even in at least one pixel in the images Iorg and Iorg_check without image processing. As a result, it is determined that the images Iorg and Iorg_check without image processing do not match. Similarly, when determining whether or not the images Iproc and Iproc_check with image processing match, the binary data in the image Iproc with image processing is compared with the binary data with the image Iproc_check with image processing. The method for determining whether image Iproc and Iproc_check with binary image data match or not match is the same as the method for determining whether image Iorg_check matches or does not match image data using binary data. Is omitted.

(Step S4) Abnormality Determination In step S3, the abnormality determination unit 24 (see FIG. 1) that performs abnormality determination inside the image processing system 1 using the comparison result of the comparator 23 determines as shown in FIG. In FIG. 8, if the pixel values of all the pixels match in the images Iorg and Iorg_check without image processing, it is determined as “◯”, and at least one pixel in the images Iorg and Iorg_check without image processing must match. Is determined as “×”. Similarly, if the pixel values in all the pixels match in the images Iproc and Iproc_check with image processing, it is determined as “◯”, and even if at least one pixel in the images Iproc and Iproc_check with image processing does not match. It is determined as “X”.

  As shown in the table of FIG. 8, the abnormality determination unit 24 performs abnormality determination inside the image processing system 1 (see FIGS. 1 and 2). The images Iorg and Iorg_check without image processing match (see “◯” in the second column of the “no image processing” row in FIG. 8), and the images Iproc and Iproc_check with image processing match (see FIG. 8). In the case of “image processing” row (see “◯” in the second column), it is determined that there is no abnormality (see “abnormality” in the second column of the “abnormality judgment” row in FIG. 8). ).

  The images Iorg and Iorg_check without image processing match (see “◯” in the third column of the “no image processing” row in FIG. 8), and the images Iproc and Iproc_check with image processing do not match (see FIG. 8). In the case of “x” in the third column of the row “with image processing”), it is determined that the image processing unit 3 (see also FIGS. 1, 2 and 4) is abnormal (see “X” in FIG. 8). (Refer to “Image processing unit abnormality” in the third column of the row of “abnormality determination”).

  The images Iorg and Iorg_check without image processing do not match (see “x” in the fourth column of the “no image processing” row in FIG. 8), and the images Iproc and Iproc_check with image processing do not match (FIG. 8 In the case of “X” in the fourth column of the “image processing present” row of FIG. 8, it is determined that the inside of the image processing system 1 is abnormal (the fourth column of the “abnormal judgment” row of FIG. 8). (See “Image Processing System Abnormality”). Steps S3 and S4 correspond to the abnormality determination step in the present invention.

  In FIG. 8, when the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match as shown in the second column of FIG. 8, the images with image processing match. Display not to do. The display mode is not particularly limited. For example, a message “Only images with image processing do not match” is displayed in a dialog box of the monitor. Of course, instead of “Only images with image processing do not match”, a message “Image processing unit is abnormal” may be displayed in a dialog box of the monitor. In other words, content synonymous with the fact that images with image processing do not match (the image processing unit is abnormal) may be displayed.

  Similarly, if the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match as shown in the third column of FIG. 8, the image with image processing and no image processing Display that the images of do not match. The display mode is not particularly limited. For example, a message “Image with image processing and image without image processing do not match” is displayed in a dialog box of the monitor. Of course, instead of “the image with image processing does not match the image without image processing”, a message “the image processing system is abnormal” may be displayed on the monitor dialog box. In other words, the same content as the fact that the image with image processing and the image without image processing do not match may be displayed (the inside of the image processing system is abnormal).

  According to the image processing system 1 according to the present embodiment, the test pattern is the image Iorg, the image Iorg without image processing is stored in the image memory unit 22 in advance, and the image processing by the image processing unit 3 is performed on the image Iorg. The image with image processing performed is set as Iproc, and the image Iproc with image processing is stored in the image memory unit 22 in advance. Here, as described in the section “Means for Solving the Problem” and a specific abnormality detection method, the process of storing the images Iorg and Iproc in the image memory unit 22 in advance (pre-processing) is performed by the system. It may be performed at the time of factory shipment.

  In addition, in order to identify a problem location in order to perform abnormality determination in the image processing system 1, an image composed of a test pattern stored at the time of abnormality detection processing is output from the image output unit 2, and the first image transmission unit 11, image The image received by the image receiving unit 4 is stored in the image memory unit 22 via the processing unit 3 and the second image transmission unit 12. On the other hand, in the case of pre-processing, as described in the “Means for Solving Problems” column and the specific abnormality detection method, an image Iorg consisting of a test pattern is output from the image output unit 2. The images Iorg and Iproc received by the image receiving unit 4 via the first image transmitting unit 11, the image processing unit 3, and the second image transmitting unit 12 do not need to be stored in the image memory unit 22. The images Iorg and Iproc may be directly stored in the image memory unit 22 without transmitting the images Iorg and Iproc to each component. Of course, since no failure has occurred in each component during the pre-processing, the images Iorg and Iproc may be transmitted to each component and stored in the image memory unit 22.

  During the abnormality detection process, the image receiving unit 4 receives the image processing unit 11 via the first image transmission unit 11, the image processing unit 3, and the second image transmission unit 12 in a state where the image processing is switched to invalid by the switching setting unit 21. The image Iorg without image processing is set as Iorg_check, and the image Iorg_check is stored in the image memory unit 22. Similarly, during the abnormality detection process, the image receiving unit 4 is passed through the first image transmission unit 11, the image processing unit 3, and the second image transmission unit 12 in a state where the image processing is effectively switched by the switching setting unit 21. The image Iproc with image processing received in step 1 is set as Iproc_check, and the image Iproc_check is stored in the image memory unit 22. As described in the section “Means for Solving the Problem” and a specific abnormality detection method, the order of the images Iorg_check and Iproc_check to the image memory unit 22 in the abnormality detection process is not particularly limited.

  In the present embodiment, the abnormality determination in the image processing system 1 is performed during the abnormality detection process. As the abnormality detection process, the operator inputs a command for determining an abnormality in the image processing system 1 as in step S1, and the command is used as a trigger (which performs an abnormality determination in the image processing system 1). An abnormality in the image processing system 1 is determined in synchronization with the command. In the case of the abnormality detection process of the present embodiment, there is an effect that abnormality determination in the image processing system 1 can be performed at an arbitrary timing when the operator inputs a command at an arbitrary timing.

  The comparator 23 compares the image Iorg (without image processing stored in advance in the image memory unit 22) with the image Iorg_check (without image processing stored during the abnormality detection processing) in the image memory unit 22. Similarly, the comparator 23 obtains an image Iproc (with image processing stored in advance in the image memory unit 22) and an image Iproc_check (with image processing stored in the image memory unit 22 during abnormality detection processing). Compare.

The abnormality determination unit 24 performs abnormality determination inside the image processing system 1 using the above comparison result as follows.
That is, (a) when the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, it is determined that there is no abnormality (see the second column in FIG. 8). . In the case of (a), images Iorg and Iorg_check without image processing at the time of pre-processing and abnormality detection processing match, and images Iproc and Iproc_check with image processing at the time of pre-processing and abnormality detection processing are the same. Since they match, it can be seen that no abnormality has occurred in the image processing system 1 during the abnormality detection process.

  (B) When the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, it is determined that the image processing unit 3 is abnormal (the third column in FIG. 8). reference). In the case of (b), the images Iorg and Iorg_check without image processing at the time of pre-processing and abnormality detection processing match, and the images Iproc and Iproc_check with image processing at the time of pre-processing and abnormality detection processing are the same. Since they do not match, it can be seen that there is a mismatch between only the images Iproc and Iproc_check with image processing due to the image processing unit 3, and it is found that an abnormality has occurred in the image processing unit 3 during the abnormality detection process.

  As described above, since the test pattern has no fluctuation of the pixel value (that is, statistical error), normality / abnormality can be accurately determined. Further, it is possible to detect a slight abnormality that is difficult to detect by visual recognition. Further, since the abnormality determination unit 24 is applied not only to an image with image processing but also to an image without image processing, it is possible to identify a problem location when there is an abnormality in the image processing unit 3.

  In this embodiment, the abnormality determination unit 24 (c) if the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match, the inside of the image processing system 1 is abnormal. It is determined that it exists (see the fourth column in FIG. 8). In the case of (c), images Iorg and Iorg_check without image processing at the time of pre-processing and abnormality detection processing do not match, and images Iproc and Iproc_check with image processing at the time of pre-processing and abnormality detection processing Therefore, it can be seen that an abnormality has occurred in the image processing system 1 during the abnormality detection process. In the case of (c), the problem location of the image processing system 1 is not specified, but a slight abnormality (difficult to detect by visual recognition) in the received image due to a minor failure can be detected. it can.

As described above, since the test pattern has no fluctuation (statistical error) of the pixel value, it is preferable to perform specific determination of coincidence / non-coincidence as shown in FIG.
That is, the comparator 23 determines that the images Iorg and Iorg_check without image processing match if the pixel values in all the pixels match in the images Iorg and Iorg_check without image processing, and the images Iorg and Iorg_check without image processing match. If even at least one pixel does not match, it is determined that the images Iorg and Iorg_check without image processing do not match. Further, the comparator 23 determines that the images Iproc and Iproc_check with image processing match if the pixel values of all the pixels in the images Iproc and Iproc_check with image processing match, and the images Iproc and Iproc_check with image processing match. If at least one pixel does not match the pixel value, it is determined that the images Iproc and Iproc_check with image processing do not match. In other words, if there is no fluctuation of the pixel value (statistical error) in the test pattern, the image (Iorg, Iproc) at the time of preprocessing and the received image (Iorg_check, Iproc_check) at the time of abnormality detection processing are exactly the same If not (even if one pixel does not match the pixel value), it can be determined that the two images do not match.

Here, each prior art document and the characteristic part of this invention are described.
In Japanese Patent Laid-Open No. 2013-165957, a failure mode is determined by comparing a failure diagnosis image collected by X-ray imaging in the failure diagnosis mode with standard image data collected in advance. As described above, Patent Document 1: Japanese Patent Application Laid-Open No. 2013-165957 is characterized in that abnormality detection is performed by comparing the failure diagnosis image in the captured image with the standard image data.

  On the other hand, the present invention is different from Japanese Patent Application Laid-Open No. 2013-165957 in that an image to be diagnosed is not an image taken for diagnosis but a fixed test pattern. As a result, there is a specific effect of specializing in the failure determination of the image processing unit. Further, since the test pattern has no fluctuation (that is, statistical error) of the pixel value, normality / abnormality can be accurately determined.

  On the other hand, Patent Document 2: Japanese Patent Application Laid-Open No. 2002-301060 is common to the present invention in that it is a diagnostic device that transmits a fixed test pattern. Patent Document 2: Japanese Patent Laid-Open No. 2002-301060 outputs test raw data (constant test pattern), performs reconstruction (image processing), and reconstructed image and test image stored in advance And performing abnormality detection.

  On the other hand, in the present invention, not only the image Iproc that has been subjected to image processing but also the image Iorg that has not been subjected to image processing is transmitted via the image transmission unit: Japanese Patent Application Laid-Open No. 2002-301060. It differs from the publication. As a result, it is possible to distinguish between cases where there is an abnormality in the image processing unit and cases where there is an abnormality in any component of the image processing system.

  Further, according to the abnormality detection method according to the present embodiment, assuming that the test pattern is an image Iorg and an image with image processing obtained by performing image processing by the image processing unit 3 on the image Iorg is Iproc, the image processing system 1 In step S2 (corresponding to an image storage process) in synchronization with a trigger for determining internal abnormality, image processing by the image processing unit 3 is performed on the image Iorg_check based on the test pattern image Iorg and the test pattern image Iorg. The image Iproc_check based on the image Iproc is stored in the image memory unit 22.

  Specifically, in a state where the image processing by the image processing unit 3 is switched to either valid or invalid, the image Iorg is transmitted to the image processing unit 3, and further the image is transmitted to the image receiving unit 4. Write and store in the memory unit 22. Similarly, in a state where the image processing by the image processing unit 3 is switched to either valid or invalid, the image Iorg is transmitted to the image processing unit 3, and further the image is transmitted to the image receiving unit 4, and the image memory unit Write to 22 and store. As described in the image processing system 1 in the present embodiment, the order of the image Iorg_check without image processing at the time of abnormality detection processing and the image Iproc_check with image processing at the time of abnormality detection processing to the image memory unit 22 is particularly great. It is not limited.

  At the time of abnormality detection processing, the image Iorg is output in a state where the image processing by the image processing unit 3 is switched to invalid, and the received image Iorg_check is stored in the image memory unit 22 via the image processing unit 3. Similarly, during the abnormality detection process, the received image Iproc_check is stored in the image memory unit 22 via the image processing unit 3 in a state where the image processing by the image processing unit 3 is effectively switched.

  In step S3 (corresponding to the abnormality determination step), an image Iorg (without image processing stored in advance in the image memory unit 22) and (without image processing stored in the image memory unit 22 during abnormality detection processing) Compare image Iorg_check. Similarly, in step S3 (abnormality determination step), the image Iproc (with image processing stored in advance in the image memory unit 22) and the image processing stored in the image memory unit 22 during abnormality detection processing are performed. Compare image Iproc_check.

  As described in the image processing system 1 according to the present embodiment, the abnormality determination in the image processing system 1 is performed during the abnormality detection process. In the case of the abnormality detection process of the present embodiment, first, in step S1 (corresponding to a command input process), the operator inputs a command for determining an abnormality in the image processing system 1. When a command is input in step S1 (command input process), the command in step S1 (command input process) is used as a trigger (performs an abnormality determination in the image processing system 1) and is synchronized with the command. (That is, step S2 corresponding to the image storing step and steps S3 and S4 corresponding to the abnormality determining step are performed).

In step S4 (corresponding to the abnormality determination step), abnormality determination in the image processing system 1 is performed as follows using the above comparison result.
That is, as with the image processing system 1 according to the present embodiment, (A) when the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, there is no abnormality. (See the second column in FIG. 8). Also, (B) if the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, it is determined that the image processing unit 3 is abnormal (3 columns in FIG. 8). See eye).

  As described above, as described in the image processing system 1 according to the present embodiment, since the test pattern does not have pixel value fluctuations (that is, statistical errors), normality / abnormality can be accurately determined. Further, it is possible to detect a slight abnormality that is difficult to detect by visual recognition. Further, since the abnormality determination in the abnormality determination step (step S4) is applied not only to the image with image processing but also to the image without image processing, the problem location is specified when there is an abnormality in the image processing unit 3. Is possible.

  Similarly to the image processing system 1 according to the present invention, (C) when the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match, Is abnormal (see the fourth column in FIG. 8). As described above, in the case of (C), it is not specified which part of the image processing system has a problem, but a slight abnormality (difficult to detect by visual recognition) in a received image due to a minor failure is detected. Can do.

  (D) In the case of (B), it is displayed that the images with image processing do not match, and in the case of (C), the image with image processing does not match the image without image processing. Is displayed. Thereby, in the case of (B) and (C), the discrepancy of each image can be grasped from the display result.

  The present invention is not limited to the above embodiment, and can be modified as follows.

  (1) In the above-described embodiments, the present invention is applied to an image processing system in a medical apparatus such as a medical image diagnostic apparatus. However, the image processing system is not limited to an image processing system in a medical apparatus as long as the image processing system processes a captured image. For example, the present invention may be applied to an image processing system in an industrial apparatus such as a nondestructive inspection apparatus.

  (2) In the above-described embodiment, if at least one pixel does not match in the images Iorg and Iorg_check without image processing, it is determined that the images Iorg and Iorg_check without image processing do not match, and there is image processing. If at least one pixel in the images Iproc and Iproc_check does not match the pixel value, it is determined that the images Iproc and Iproc_check with image processing do not match, but the following allowable ranges may be provided. For example, as shown in FIG. 9, a predetermined number is set as a threshold value among the number of pixels whose pixel values do not match between the two images (the number of pixels marked with ◯ in FIG. 9). It is determined that the two images match, and if they are equal to or greater than the threshold, it is determined that the two images do not match. Alternatively, a predetermined value is set as a threshold value among the absolute values of the pixel value difference between the two images, and if both are less than the threshold, it is determined that the two images match. Judge that not. In this way, the allowable range may be less than the threshold value. In addition, a predetermined number of pixels whose pixel values do not match between the two images set as threshold values (threshold value regarding the number) and an absolute value (pixel value) of a predetermined difference value of pixel values between the two images set as threshold values If, for example, it is less than the threshold for the number and less than the threshold for the pixel value, it may be determined that the two images match.

  (3) In the above-described embodiment, the abnormality determination inside the image processing system is performed during the abnormality detection process. However, the abnormality determination inside the image processing system may be performed during the automatic diagnosis. As automatic diagnosis, a trigger for determining abnormality in the image processing system is periodically output, and abnormality determination in the image processing system is performed in synchronization with the trigger. In the case of the automatic diagnosis of the modified example (3), there is an effect that the abnormality determination inside the image processing system can be automatically performed periodically without an operator inputting a command.

  (4) In the above-described embodiment, as shown in the fourth column of FIG. 8, (c) When the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match Determines that the inside of the image processing system is abnormal ((C) in the abnormality detection method), but does not necessarily perform the determination in (c) (determination (C) in the abnormality detection method). As described above, in the case of (c) ((C) in the abnormality detection method), it is not specified to which part the problem part of the image processing system is. Therefore, (a) if the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, it is determined that there is no abnormality ((A) in the abnormality detection method), (B) When the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match, it is determined that the image processing means (image processing unit 3 in the embodiment) is abnormal. It is possible to accurately determine the normality / abnormality of the image processing means (image processing unit 3) only by performing (B in the abnormality detection method).

  As described above, the present invention is suitable for an image processing system in a medical device or an industrial device.

DESCRIPTION OF SYMBOLS 1 ... Image processing system 2 ... Image output part 3 ... Image processing part 4 ... Image receiving part 11 ... 1st image transmission part 12 ... 2nd image transmission part 21 ... Switch setting part 22 ... Image memory part 23 ... Comparator 24 ... Abnormality judgment unit
Iorg… (pre-stored) image without image processing
Iproc… (pre-stored) image with image processing
Iorg_check ... Image without image processing (stored during abnormality detection processing)
Iproc_check ... Image with image processing (stored during abnormality detection processing)

Claims (7)

An image processing system for processing an image,
Image output means for outputting an image;
Image processing means for processing the image output from the image output means;
Image receiving means for receiving an image processed by the image processing means;
Image transmitting means for transmitting an image from the image output means to the image processing means, and from the image processing means to the image receiving means;
Switching setting means for switching the image processing by the image processing means to either valid or invalid;
Image storage means for storing a test pattern image Iorg and an image Iproc obtained by performing image processing on the test pattern image Iorg by the image processing means;
An abnormality determination means for determining an abnormality in the image processing system,
The abnormality determining means includes
The image Iorg is output by the image output means in a state where the image processing is switched to invalid by the switching setting means, and the image Iorg_check received by the image receiving means via the image processing means and the image transmission means ,
In a state where the image processing is effectively switched by the switching setting means, the image Iproc_check received by the image receiving means via the image processing means and the image transmitting means is stored in the image storage means,
Compare image Iorg and image Iorg_check, compare image Iproc and image Iproc_check,
(A) When the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, it is determined that there is no abnormality,
(B) An image processing system that determines that the image processing means is abnormal when the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match. The image processing system according to claim 1,
The abnormality determining means includes
(C) An image processing system that determines that the inside of the image processing system is abnormal when the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match. The image processing system according to claim 1 or 2,
The abnormality determining means includes
If the pixel values of all the pixels in the images Iorg and Iorg_check without image processing match, it is determined that the images Iorg and Iorg_check without image processing match, and even at least one pixel value in the images Iorg and Iorg_check without image processing If they do not match, it is determined that the images Iorg and Iorg_check without image processing do not match,
If the pixel values of all the pixels in the images Iproc and Iproc_check with the image processing match, it is determined that the images Iproc and Iproc_check with the image processing match, and the pixel value of at least one pixel in the images Iproc and Iproc_check with the image processing If these do not match, the image processing system determines that the images Iproc and Iproc_check with image processing do not match. An abnormality detection method for an image processing system for processing an image,
Image Iorg_check based on test pattern image Iorg and image Iproc_check based on image Iproc obtained by performing image processing by image processing means on test pattern image Iorg in synchronization with a trigger that performs abnormality determination inside the image processing system An image storage step of storing in the storage means;
An abnormality determination process for determining an abnormality in the image processing system,
In the image storing step,
In a state where the image processing by the image processing means has been disabled, the image Iorg is output, and the received image Iorg_check via the image processing means,
In a state where the image processing by the image processing means is effectively switched, the received image Iproc_check is stored in the image storage means via the image processing means,
In the abnormality determination step,
Compare image Iorg and image Iorg_check, compare image Iproc and image Iproc_check,
(A) If the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing match, it is determined that there is no abnormality,
(B) An abnormality detection method for determining that the image processing means is abnormal when the images Iorg and Iorg_check without image processing match and the images Iproc and Iproc_check with image processing do not match. In the abnormality detection method according to claim 4,
A command input process for inputting a command for performing an abnormality determination inside the image processing system,
An abnormality detection method in which the image storage step and the abnormality determination step are performed in synchronization with the command by using the command in the command input step as the trigger. In the abnormality detection method according to claim 4 or 5,
In the abnormality determination step,
(C) An abnormality detection method for determining that the inside of the image processing system is abnormal when the images Iorg and Iorg_check without image processing do not match and the images Iproc and Iproc_check with image processing do not match. In the abnormality detection method according to claim 6,
(D) In the case of (B), it is displayed that the images with image processing do not match, and in the case of (C), it is displayed that the image with image processing does not match the image without image processing. Yes Anomaly detection method.

Images