US20190082172A1

US20190082172A1 - Image processing apparatus and failure diagnosis control method

Info

Publication number: US20190082172A1
Application number: US15/901,515
Authority: US
Inventors: Yoshiharu Uetani
Original assignee: Toshiba Corp; Toshiba Electronic Devices and Storage Corp
Current assignee: Toshiba Corp; Toshiba Electronic Devices and Storage Corp
Priority date: 2017-09-11
Filing date: 2018-02-21
Publication date: 2019-03-14
Also published as: EP3454555A1; CN109495663A; US10911746B2; US10694176B2; JP2019049884A; US20200275090A1

Abstract

Certain embodiments provide an image processing apparatus including an image processing circuit configured to perform image processing on continuously captured image data frame by frame, a failure diagnosis processing circuit configured to diagnose a failure of the image processing circuit, and a failure diagnosis control circuit configured to control whether to perform failure diagnosis at an arbitrary frame.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2017-174039 filed in Japan on Sep. 11, 2017; the entire contents of which are incorporated herein by reference.

FIELD

Embodiments described herein relate generally to an image processing apparatus and a failure diagnosis control method.

BACKGROUND

There is a conventional image processing apparatus that can perform image processing on a captured image frame by frame and diagnose a failure of an image processing circuit frame by frame. The image processing apparatus performs the failure diagnosis during an idle time for the image processing by the image processing circuit after completion of the image processing for an arbitrary frame before starting image processing for a subsequent frame. The failure diagnosis of the image processing circuit includes transmitting a scan test pattern to the image processing circuit and comparing the scan test result obtained from the image processing circuit with an expected value.
The time required for image processing on image data of one frame is variable depending on congestion of a system bus. For example, when abnormal interrupt processing or the like arises, the timing when the image processing completes may be greatly delayed due to the congestion of the system bus. When the completion timing of the image processing is delayed, the failure diagnosis cannot be completed before the timing to start the image processing for the subsequent frame, and will be stopped. If the scan test is discarded when the failure diagnosis is not able to be completed, the failure diagnosis is useless and becomes a cause of power waste. As an alternative way, when the failure diagnosis processing is interrupted in the image processing of subsequent frame, it may be possible to continue the failure diagnosis processing after the image processing of the subsequent frame. However, in such a case, an appropriate circuit will be additionally required to save the uncompleted scan test result of each register of the image processing circuit. In addition, another circuit will be required to return the uncompleted scan test result to each register of the image processing circuit before continuing the failure diagnosis processing. As a result, a problem that the circuit scale becomes larger arises.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an exemplary configuration of an image processing apparatus according to a first embodiment.

FIG. 2 illustrates an exemplary configuration of a failure diagnosis control circuit according to the first embodiment.

FIG. 3A is a flowchart illustrating a failure diagnosis control circuit according to the first embodiment.

FIG. 3B is a flowchart illustrating the failure diagnosis control circuit according to the first embodiment.

FIG. 4 illustrates the failure diagnosis control circuit according to the first embodiment.

FIG. 5 illustrates various signals and operational states of the failure diagnosis control circuit according to the first embodiment.

FIG. 6 illustrates the failure diagnosis control circuit according to the first embodiment.

FIG. 7 illustrates an exemplary configuration of a failure diagnosis control circuit according to a modified example 1.

FIG. 8 illustrates the failure diagnosis control circuit according to the modified example 1.

FIG. 9 is a flowchart illustrating a failure diagnosis control circuit according to a second embodiment.

FIG. 10 is a flowchart illustrating a failure diagnosis control circuit according to a third embodiment.

DETAILED DESCRIPTION

Certain embodiments provide an image processing apparatus including an image processing circuit configured to perform image processing on continuously captured image data frame by frame, a failure diagnosis processing circuit configured to diagnose a failure of the image processing circuit frame by frame, and a failure diagnosis control circuit configured to control whether to perform the failure diagnosis for an arbitrary frame.
Hereinafter, image processing apparatuses according to preferred embodiments will be described in detail below with reference to attached drawings.

First Embodiment

An image processing apparatus according to the first embodiment is, for example, an in-vehicle camera or another apparatus configured to perform image processing, such as luminance correction, on continuously captured image data frame by frame, and has a function of diagnosing a failure of an image processing circuit frame by frame. The purpose of diagnosing the failure of the image processing circuit frame by frame is to confirm the reliability of image data subjected to image processing and to prevent erroneous image information from being used in a drive assist control.
An image processing apparatus 1, as illustrated in FIG. 1, includes a failure diagnosis control circuit 10, an image processing circuit 11, a failure diagnosis processing circuit 12, an interrupt control circuit 13, a system control circuit 14, and a storage circuit 15. The image processing circuit 11, the failure diagnosis processing circuit 12, the interrupt control circuit 13, the system control circuit 14, and the storage circuit 15 are connected with each other via a system bus 16.
The storage circuit 15 includes a random access memory (RAM), a read only memory (ROM), and a semiconductor memory and the like. The storage circuit 15 stores image data processed by the image processing circuit 11, scan test data to be used by the failure diagnosis processing circuit 12, and an expected value thereof.
The image processing circuit 11 includes a digital signal processing circuit (DSP) and the like. The image processing circuit 11, for example, performs image processing according to parameters having been set by the system control circuit 14. The image processing circuit 11 receives image data frame by frame from an imaging apparatus (not illustrated) and performs image processing. Although the contents of the image processing are not limited, the image processing circuit 11 may perform image processing, such as, color space conversion processing for conversion from RGB to YUV, luminance correction processing suitable for image recognition including amplifying or attenuating the luminance, edge emphasis processing, and zooming processing for changing the size of an object. The image processing circuit 11 stores the image data subjected to the image processing, via the system bus 16, in the storage circuit 15.
Further, the image processing circuit 11, at the timing to start image processing for one frame, sends a frame image processing start signal (image processing start information) to the failure diagnosis control circuit 10. Further, the image processing circuit 11, upon completion of the image processing for one frame, sends a frame image processing completion signal to the failure diagnosis control circuit 10.
The failure diagnosis processing circuit 12 includes a DSP and the like. The failure diagnosis processing circuit 12, under the control of the failure diagnosis control circuit 10, performs processing for diagnosing a failure of the image processing circuit 11 frame by frame in a dormant period during which the image processing circuit 11 is not performing the image processing. More specifically, the failure diagnosis processing circuit 12 sends scan test data to the image processing circuit 11, and acquires a scan test result from the image processing circuit 11. The value of the scan test result is already known when the scan test data has been normally subjected to image processing circuit 11. The failure diagnosis processing circuit 12 or the storage circuit 15 has beforehand an expected value corresponding to the scan test data. The failure diagnosis processing circuit 12 compares the scan test result of the image processing circuit 11 with the expected value. The failure diagnosis processing circuit 12 determines that the image processing circuit 11 is operating normally if the scan test result coincides with the expected value. And the failure diagnosis processing circuit 12 determines that the image processing circuit 11 has failure if they do not coincide with each other.
The failure diagnosis processing circuit 12 performs the failure diagnosis processing only when a failure diagnosis processing request signal is received from the failure diagnosis control circuit 10. The failure diagnosis processing circuit 12, in response to the diagnosis processing request signal received from the failure diagnosis control circuit 10, returns a response signal to the failure diagnosis control circuit 10. In addition, the failure diagnosis processing circuit 12 sends a failure detection signal to the interrupt control circuit when the diagnosis result indicates that the image processing circuit 11 has failure.
The interrupt control circuit 13 sets respective cause registers based on a later-described image processing start signal and a failure diagnosis start signal for a related frame received from the failure diagnosis control circuit 10 and the failure detection signal received from the failure diagnosis processing circuit 12. The interrupt control circuit 13 notifies the system control circuit 14 of the setting of the cause registers by assertion of an interrupt signal. When the system control circuit 14 confirms these causes via the system bus 16 and clears the cause registers, the interrupt signal is deasserted. The interrupt control circuit 13 can be configured to include an OR logic circuit to which outputs from a plurality of cause registers are supplied.
The system control circuit 14 includes a central processing circuit (CPU) and the like, and controls various operations to be performed by the image processing apparatus 1. The system control circuit 14, for example, when the interrupt control circuit 13 has confirmed the cause of a failure interrupt, or when the failure diagnosis start signal has not been confirmed before starting image processing for a subsequent frame, controls each apparatus in a vehicle in such a way as to prevent image data of a related frame from being used in recognition processing and the like. Further, the system control circuit 14 may control each apparatus in the vehicle in such a way as to perform a display operation to inform the occurrence of a failure in the image processing circuit 11 or unsuccessful execution of the failure diagnosis. Further, the system control circuit 14 may have a function of analyzing the cause of a failure with reference to information obtainable from various sensors in the apparatus. Then, the system control circuit 14 may cause a display circuit (not illustrated) to display the cause of the failure.
The failure diagnosis control circuit 10 controls whether to perform failure diagnosis after completing image processing for an arbitrary frame. More specifically, the failure diagnosis control circuit 10 determines whether the failure diagnosis processing to be performed after the image processing for an arbitrary frame can be completed before starting image processing for a subsequent frame. Then, the failure diagnosis control circuit 10, if it is determined that the failure diagnosis processing cannot be completed, controls the failure diagnosis processing circuit 12 not to perform the failure diagnosis processing after completing the image processing for the arbitrary frame. In detail, if image processing completion information about an arbitrary frame is not received from the image processing circuit 11 until a pre-set time elapses since the start of the image processing for the arbitrary frame, the failure diagnosis control circuit 10 controls the failure diagnosis processing circuit 12 not to perform the failure diagnosis processing after completing the image processing for the arbitrary frame.
FIG. 2 illustrates an exemplary configuration of the failure diagnosis control circuit 10. As illustrated in FIG. 2, the failure diagnosis control circuit 10 includes a timing generation circuit 10 a, a set/reset type flip-flop 10 b, an AND circuit 10 c, and a set/reset type flip-flop 10 d. The timing generation circuit 10 a can be configured to include a shift register, a counter, or a timer element and the like.
Next, operations of the failure diagnosis control circuit 10 will be described with reference to FIGS. 3 to 5. FIGS. 3A and 3B are flowcharts illustrating the failure diagnosis control circuit according to the first embodiment. FIG. 3A is a flowchart illustrating failure diagnosis execution control processing. FIG. 3B is a flowchart illustrating frame image processing completion status control processing. The failure diagnosis execution control processing illustrated in FIG. 3A and the frame image processing completion status control processing illustrated in FIG. 3B can be performed in parallel. FIG. 4 is a time chart illustrating the failure diagnosis processing. FIG. 5 is a time chart illustrating a case where the failure diagnosis processing is not performed.
In the failure diagnosis execution control processing, upon completing initial settings for the image processing apparatus 1 (step S10), the imaging apparatus (not illustrated) sequentially input image data to the image processing circuit 11 at intervals of time T. For example, when the image capturing speed of the imaging apparatus is 30 frames per second, the image processing circuit 11 acquires image data of one frame at intervals of approximately 33 msec. The image processing circuit 11 sends the frame image processing start signal to the failure diagnosis control circuit 10 at the timing to start image processing for one frame. If the failure diagnosis control circuit 10 confirms reception of the frame image processing start signal (Yes in step S11), the failure diagnosis control circuit 10 activates the counter of the timing generation circuit 10 a illustrated in FIG. 2 (step S12).
In parallel with the above-mentioned processing, in the frame image processing completion status control processing, initial settings (step S20) and acquisition and monitoring of the frame image processing start signal (step S21) are performed. Step S11 and step S21 are common processing. If the frame image processing start signal is acquired (Yes in step S21), the failure diagnosis control circuit 10 sets a Q output (completion status) of the flip-flop 10 b to low-level as illustrated in FIG. 4 (step S22).
In the failure diagnosis execution control processing, the timing generation circuit 10 a illustrated in FIG. 2, upon receiving the frame image processing start signal, activates the counter of the timing generation circuit 10 a (step S12). Then, the timing generation circuit 10 a compares a counter value with a setting value having been set beforehand and continues the counting operation until a predetermined time t1 elapses (step S13). The timing generation circuit 10 a, upon elapse of the predetermined time t1 (Yes in step S13), deactivates and initializes the counter and generates a failure diagnosis execution timing signal (step S14). The predetermined time t1 is set beforehand as a time obtainable by subtracting a value equal to or longer than the time required for the failure diagnosis processing from the time of a frame image processing start period. More specifically, as illustrated in FIG. 4, the predetermined time t1 is determined to be equal or less than a value obtainable by subtracting response time t2 required for the failure diagnosis processing circuit 12 to return a response signal and time t3 required for the failure diagnosis processing from time T of the frame image processing start period.
In parallel with the above-mentioned processing, in the frame image processing completion status control processing, the image processing circuit 11, upon completion of the image processing for one frame, sends the frame image processing completion signal to the failure diagnosis control circuit 10. The failure diagnosis control circuit 10, if the frame image processing completion signal is received (Yes in step S23), sets the Q output (completion status) of the flip-flop 10 b to high-level, as illustrated in FIG. 4 (step S24). The image processing circuit 11, upon completing the storage of all the image data subjected to the image processing into the storage circuit 15 via the system bus 16, outputs the frame image processing completion signal. Accordingly, in a case where the system bus 16 is congested due to some reason, the timing to output the frame image processing completion signal may be delayed. The duration in which the Q output of the flip-flop 10 b remains at low-level is equal to the duration in which the image processing circuit 11 is performing the image processing for one frame.
Subsequently, the failure diagnosis control circuit 10, as part of the failure diagnosis execution control processing, determines whether the frame image processing completion signal has been received prior to the generation of the failure diagnosis execution timing signal by the timing generation circuit 10 a (step S15). If the frame image processing completion signal has been received prior to the generation of the failure diagnosis execution timing signal by the timing generation circuit 10 a (Yes in step S15), the Q output (completion status) of the flip-flop 10 b turns into high-level before the failure diagnosis execution timing signal output from the timing generation circuit 10 a illustrated in FIG. 2 turns into high-level, as illustrated in FIG. 4. Accordingly, as output of the AND circuit 10 c, a signal having the same waveform as the failure diagnosis execution timing signal is output. Using this signal as a trigger, the flip-flop 10 d outputs the failure diagnosis processing request signal.
The failure diagnosis processing circuit 12, upon receiving the failure diagnosis processing request signal, returns a response signal to the failure diagnosis control circuit 10. The response signal resets the flip-flop 10 d. The duration in which the failure diagnosis processing request signal (i.e., the Q output of the flip-flop 10 d) remains at high-level is the response time t2 of the failure diagnosis processing circuit 12.
In response to the failure diagnosis processing request signal, the failure diagnosis processing circuit 12 diagnoses a failure of the image processing circuit 11 (step S16). More specifically, the failure diagnosis processing circuit 12 transmits scan test data to the image processing circuit 11. The image processing circuit 11 performs a scan test with the received scan test data. The failure diagnosis processing circuit 12 receives a scan test result from the image processing circuit 11. Then, the failure diagnosis processing circuit 12 compares the scan test result with the expected value. The failure diagnosis processing circuit 12, if the scan test result coincides with the expected value, determines that the image processing circuit 11 has no failure. Further, the failure diagnosis processing circuit 12, if the scan test result does not coincide with the expected value, determines that the image processing circuit 11 has failure, and sends the failure detection signal to the interrupt control circuit 13.
On the other hand, if the frame image processing completion signal is received after the generation of the failure diagnosis execution timing signal by the timing generation circuit 10 a (No in step S15), the Q output of the flip-flop 10 b remains at low-level when the failure diagnosis execution timing signal output by the timing generation circuit 10 a turns into high-level, as illustrated in FIG. 5. Therefore, the signal of the Q output of the AND circuit 10 c remains at low-level. Because of the absence of a trigger by the signal from the Q output of the AND circuit 10 c, no failure diagnosis processing request signal is output from the flip-flop 10 d. Accordingly, the failure diagnosis processing circuit 12 does not perform the failure diagnosis processing (No in step S15).
In the failure diagnosis execution control processing, after terminating the processing in step S15 (branched to No) or step S16, the failure diagnosis control circuit 10 repeats for a subsequent frame the processing in step S11 to step S15 (branched to No) or step S16. Further, in the frame image processing completion status control processing, after terminating the processing in step S23 (branched to No) or step S24, the failure diagnosis control circuit 10 repeats for the subsequent frame the processing in step S21 to step S23 (branched to No) or step S24.
As mentioned above, as illustrated in FIG. 6, if the frame image processing completion signal is received from the image processing circuit 11 before the predetermined time t1 elapses since reception of the frame image processing start signal for an arbitrary frame from the image processing circuit 11, the failure diagnosis control circuit 10 controls the failure diagnosis processing circuit 12 in such a way as to perform failure diagnosis after completing image processing for the corresponding frame. Further, if the frame image processing completion signal is not received from the image processing circuit 11 before the predetermined time t1 elapses since reception of the frame image processing start signal for an arbitrary frame from the image processing circuit 11, the failure diagnosis control circuit 10 controls the failure diagnosis processing circuit 12 in such a way as not to perform failure diagnosis after completing image processing for the corresponding frame, thereby preventing interruption of the failure diagnosis caused by lack of processing time. In addition, as the failure diagnosis result obtained during the processing is never discarded, it is feasible to prevent any useless processing and contribute to saving of electric power consumption.
Further, as the failure diagnosis control circuit 10 can be configured to be able to avoid halfway discard during the failure diagnosis with a small-scale circuit configuration illustrated in FIG. 2, it is feasible to downsize the apparatus and realize electric power saving.

MODIFIED EXAMPLE 1

In the above description, the circuit illustrated in FIG. 2 merely shows one possible configuration of the failure diagnosis control circuit 10. The failure diagnosis control circuit 10 is not limited to the above configuration. For example, a circuit configuration illustrated in FIG. 7 can be employed to realize similar functions. FIG. 8 illustrates an exemplary operation of the failure diagnosis control circuit 10 according to the modified example 1. As illustrated in FIG. 8, the Q output of the flip-flop 10 b turns into low-level at the timing when the frame image processing start signal turns into high-level. Further, the Q output of the flip-flop 10 b turns into high-level at the timing when the frame image processing completion signal turns into high-level.
When the Q output of the flip-flop 10 b remains at high-level when the failure diagnosis execution timing signal is output from the timing generation circuit 10 a, a high-level signal is generated from a Q output of a flip-flop 10 f. Further, when the Q output of the flip-flop 10 b remains at low-level when the failure diagnosis execution timing signal is output from the timing generation circuit 10 a, a low-level signal is generated from the Q output of the flip-flop 10 f. More specifically, in a case where the image processing by the image processing circuit 11 is greatly delayed more than a predetermined time, the Q output of the flip-flop 10 b remains at low-level at the timing to output the failure diagnosis execution timing signal and therefore the low-level signal is generated from the Q output of the flip-flop 10 f. When the Q output of the flip-flop 10 f remains at low-level, the failure diagnosis processing request signal is not output because the flip-flop 10 d is not set, and accordingly the failure diagnosis processing is not executed. In order to perform the above-mentioned processing frame by frame, the flip-flop 10 f resets beforehand the frame image processing start signal.

MODIFIED EXAMPLE 2

As described above, the first embodiment and the modified example 1 employ a logic circuit to realize the failure diagnosis control circuit 10. Alternatively, software processing may be employed to realize the functions of the failure diagnosis control circuit 10. For example, it can be realized by monitoring, with the software, the order of reception between the frame image processing completion signal output from the image processing circuit 11 and the failure diagnosis execution timing signal output from the timing generation circuit 10 a, illustrated in FIG. 6. More specifically, a monitoring flag for monitoring the state of image processing can be provided. The frame image processing start signal sets the monitoring flag to 1, and the frame image processing completion signal resets the monitoring flag to 0. The CPU can be configured to read the monitoring flag at the reception timing of the failure diagnosis execution timing signal, and can be configured to perform the failure diagnosis processing if the monitoring flag is 0 and skip the failure diagnosis processing if the monitoring flag is 1. Using the software processing as mentioned above can realize functions similar to those realized by the hardware.

Second Embodiment

The example of the failure diagnosis control processing described with reference to FIGS. 3A and 3B in the first embodiment is characterized by processing, in parallel, the failure diagnosis execution control processing and the frame image processing completion status control processing. In the second embodiment, an example of the failure diagnosis control processing characterized by performing, in series, the failure diagnosis execution control processing and the frame image processing completion status control processing will be described with reference to FIG. 9.
In the example of the failure diagnosis control processing illustrated in FIG. 9, if the failure diagnosis control circuit 10 receives the frame image processing start signal from the image processing circuit 11 (Yes in step S11), the failure diagnosis control circuit 10 activates the counter in the failure diagnosis control circuit 10 (step S12) and clears the completion status in the failure diagnosis control circuit 10 (step S22). If the frame image processing completion signal is received from the image processing circuit 11 (Yes in step 23) before the counter value reaches the setting value (No in step S13), the failure diagnosis control circuit 10 sets the completion status (step S24). If the frame image processing completion signal is not received (No in step S23), the failure diagnosis control circuit 10 does not set the completion status.
When the counter in the failure diagnosis control circuit 10 reaches the setting value (Yes in step S13), the failure diagnosis control circuit 10 deactivates and initializes the counter (step S14). Subsequently, the failure diagnosis control circuit 10 confirms whether the completion status is set (step S15). The failure diagnosis control circuit 10, if the completion status is not set in step S15 (No in step S15), does not output the failure diagnosis processing request signal. The failure diagnosis control circuit 10, if the completion status is set (Yes in step S15), outputs the failure diagnosis processing request signal and performs the failure diagnosis processing (step S16). The failure diagnosis control circuit 10, upon terminating the processing in step S15 (branched to No) or step S16, repeats for a subsequent frame the processing in step S11 to step S15 (branched to No) or step S16.

Third Embodiment

In the third embodiment, another example of the failure diagnosis control processing characterized by performing, in series, the failure diagnosis execution control processing and the frame image processing completion status control processing will be described with reference to FIG. 10. Explanations similar to those in the second embodiment will not be repeated.
In the example of the failure diagnosis control processing illustrated in FIG. 10, the failure diagnosis control circuit 10, if the frame image processing start signal is received from the image processing circuit 11 (Yes in step S11), activates the counter in the failure diagnosis control circuit 10 (step S12). The failure diagnosis control circuit 10, if the frame image processing completion signal is received from the image processing circuit 11 (Yes in step 23) before the counter reaches the setting value (No in step S13), outputs the failure diagnosis processing request signal and performs the failure diagnosis (step S16). The failure diagnosis control circuit 10, if the counter reaches the setting value or more in a state where the frame image processing completion signal is not received (Yes in step S13), does not output the failure diagnosis processing request signal.
The failure diagnosis control circuit 10, in response to the counter value reaching the setting value (Yes in step S13), or after outputting the failure diagnosis processing request signal, deactivates and initializes the counter (step S17). The failure diagnosis control circuit 10, upon terminating the processing in step S17, repeats for a subsequent frame the processing in step S11 to step S17.
In the above description, the image processing circuit 11, the failure diagnosis processing circuit 12, and the system control circuit 14 illustrated in FIG. 1 are respectively configured to include the DSP or the CPU. However, the hardware configuration is not limited to the above-mentioned examples. For example, a plurality of CPUs or a single CPU may be used to perform all of the required processing.
Further, in the above description, the failure diagnosis processing circuit 12 is configured to use the scan test pattern and the expected value to perform the failure diagnosis. However, the contents of the failure diagnosis are not limited to the examples described above. The image processing circuit 11 may be configured to execute some processing within a predetermined time and perform failure diagnosis based on the execution result.
Further, although the descriptions referring to FIGS. 2 and 7 are mainly based on the positive logic, the way of combining the logic circuits is various. For example, the above-mentioned configuration may be replaced by a negative logic circuit or a combination of positive and negative logic circuits. As a result, the AND circuit 10 c illustrated in FIG. 2 may be replaced by a NAND circuit, an OR circuit, or a NOR circuit. Further, the logic circuit can be configured without using any flip-flop. The positive logic means to constitute a logic circuit by expressing true (e.g., a function exerting state) as 1 (high-level) and false as 0 (low-level).
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and sprit of the inventions.

Claims

What is claimed is:

1. An image processing apparatus, comprising:

an image processing circuit configured to perform image processing on continuously captured image data;

a failure diagnosis processing circuit configured to diagnose a failure of the image processing circuit frame by frame; and

a failure diagnosis control circuit configured to control whether to perform failure diagnosis at an arbitrary frame.

2. The image processing apparatus according to claim 1, wherein the failure diagnosis processing circuit transmits a scan test pattern to the image processing circuit and compares a scan test result of the image processing circuit with an expected value so as to diagnose a failure of the image processing circuit, the failure diagnosis control circuit determines whether failure diagnosis processing to be performed frame by frame can be completed before starting image processing for a subsequent frame, and if it is determined that the failure diagnosis processing cannot be completed for the related frame before starting image processing for the subsequent frame, the failure diagnosis processing circuit is controlled so as not to perform the failure diagnosis processing in the related frame.

3. The image processing apparatus according to claim 1, wherein if image processing completion information about an arbitrary frame is not received from the image processing circuit until a pre-set time elapses after an image processing start information about the arbitrary frame is received from the image processing circuit, the failure diagnosis control circuit controls the failure diagnosis processing circuit so as not to perform the failure diagnosis processing of the arbitrary frame.

4. The image processing apparatus according to claim 2, wherein if image processing completion information about an arbitrary frame is not received from the image processing circuit until a pre-set time elapses after an image processing start information about the arbitrary frame is received from the image processing circuit, the failure diagnosis control circuit controls the failure diagnosis processing circuit so as not to perform the failure diagnosis processing of the arbitrary frame.

5. The image processing apparatus according to claim 1, wherein the failure diagnosis control circuit includes a timing generation circuit configured to measure the pre-set time after the image processing start information about the arbitrary frame is received, and controls the failure diagnosis processing circuit so as not to perform the failure diagnosis processing at the arbitrary frame if the image processing completion information about the arbitrary frame is not received before the timing generation circuit completes the measurement of the pre-set time.

6. The image processing apparatus according to claim 2, wherein the failure diagnosis control circuit includes a timing generation circuit configured to measure the pre-set time after the image processing start information about the arbitrary frame is received, and controls the failure diagnosis processing circuit so as not to perform the failure diagnosis processing at the arbitrary frame if the image processing completion information about the arbitrary frame is not received before the timing generation circuit completes the measurement of the pre-set time.

7. The image processing apparatus according to claim 3, wherein the failure diagnosis control circuit includes a timing generation circuit configured to measure the pre-set time after the image processing start information about the arbitrary frame is received, and controls the failure diagnosis processing circuit so as not to perform the failure diagnosis processing at the arbitrary frame if the image processing completion information about the arbitrary frame is not received before the timing generation circuit completes the measurement of the pre-set time.

8. A failure diagnosis control method for an image processing apparatus that includes an image processing circuit configured to perform image processing on continuously captured image data frame by frame, diagnoses a failure of the image processing circuit through a scan test in a duration in which the image processing circuit is not performing image processing for each frame, and controls whether to perform failure diagnosis at an arbitrary frame, the failure diagnosis control method comprising:

determining whether failure diagnosis processing for the arbitrary frame can be completed before starting image processing for a subsequent frame; and

controlling whether to perform the failure diagnosis processing for the arbitrary frame based on a determination result.

9. The failure diagnosis control method according to claim 5, wherein the determining includes

starting a measurement of a pre-set time in response to reception of image processing start information about the arbitrary frame as a trigger, and

determining whether image processing completion information about the arbitrary frame has been received before completing the measurement of the pre-set time in the measurement,

wherein, in the determining, if the image processing completion information about the arbitrary frame has not been received before completing the measurement of the pre-set time, it is determined that the failure diagnosis processing at the arbitrary frame cannot be completed before starting the image processing for the subsequent frame, and

the controlling performs a control so as not to perform the failure diagnosis processing for the arbitrary frame, if it is determined that the failure diagnosis processing cannot be completed in the determining.