JP2008283431A - Image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus for detecting an abnormal operation that an image memory is not updated, and preventing a video image different from a video image being photographed by a camera, from being transmitted to a user or an image signal processing apparatus. <P>SOLUTION: A determination part 6 detects abnormal updating in an image memory 2 by comparing frame information in a current frame information acquisition means 4 for acquiring frame information from the latest image signal obtained in the image memory 2, with that in a previous frame information storage means 5 storing previous frame information, and an image processing means 3 outputs an image signal generated by a warning image generation means 7 to a display device 8 or an external video signal processing apparatus instead of an image signal obtained from an onboard camera 1 when the abnormality is detected. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that stores a video signal captured by a camera (for example, an in-vehicle camera) in an image memory and processes the obtained signal information. By monitoring the signal information in the image memory, the image memory The present invention relates to an image processing apparatus that detects an abnormal operation in which an image signal is not updated due to a malfunction (hereinafter referred to as a freeze state).

  In recent years, the vehicle surroundings are photographed with an in-vehicle camera, and the video is displayed on a display to assist the driver, the camera system that records the driving situation of the vehicle, or signal processing to warn of danger. Camera systems, such as a system that monitors white lines on roads and automatically warns or assists when a car is about to leave the lane, are beginning to become widespread.

  In such a camera system, it is necessary to determine whether or not the image taken by the camera and taken into the image processing apparatus is correct.

FIG. 5 is a diagram showing a conventional in-vehicle image processing apparatus. As shown in FIG. 5, this in-vehicle image processing device processes an image memory 102 that stores a video signal from the video camera 101 and an image signal obtained via the image memory 102 to an image display device 108. The image processing means 103 for displaying, the input processing means 106 for receiving the input signals from the vehicle speed sensor 104 and the lamp switch (SW) 105, and the determination means 107 for judging the abnormality of the image signal are configured. The signal level of the image signal obtained through the vehicle is below a certain set value, and it is recognized from the input signals from the vehicle speed sensor 104 and the lamp SW 105 that the headlamp is OFF and the vehicle is running. The image signal from the video camera is determined to be abnormal, and the alarm means 109 operates to display a warning (for example, Patent reference 1).
Japanese Patent Laid-Open No. 2001-204012

  As described above, in the conventional in-vehicle image processing apparatus, it is determined whether or not the video of the video camera is normal.

  Therefore, when the connection between the video camera 101 and the controller is normal, and an image signal exceeding the standard determined by the determination unit 107 as normal operation is obtained in the image memory 102, the image memory 102 is in a frozen state. In this case, the signal level of the image signal obtained from the image memory 102 is always determined to be equal to or higher than the determination criterion, and an abnormal operation cannot be detected.

  In addition, since the video signal is not updated, the video displayed on the display device continues to display the same image. For this reason, there is a problem in that the video captured by the in-vehicle camera is not updated on the information around the vehicle or in the vehicle interior, and the driver or an external video signal processing device misrecognizes by outputting erroneous information. It was.

  The present invention has been made in order to solve the above-described conventional problems, can detect an abnormal operation in which the image memory is not updated, and displays an image different from the image captured by the camera by a user or an external device. An object of the present invention is to provide an image processing apparatus capable of preventing transmission to a video signal processing apparatus.

  The image processing apparatus of the present invention includes an image memory for storing video from a camera, an image processing means for processing an image signal obtained in the image memory, a determination means for detecting an update abnormality of the image memory, And a warning unit that issues a warning when the determination unit detects an update abnormality of the image memory.

  With this configuration, it is possible to detect whether or not the image signal obtained in the image memory has been updated, and in the event of an abnormal operation in which the image memory is not updated, a warning operation is performed, so that the situation of shooting with the camera It is possible to prevent an image different from the change from being transmitted to the user or an external video signal processing device.

  Here, the determination means includes current frame information acquisition means for storing the latest frame information of the video from the camera, and previous frame information storage means for storing the previous frame information. By comparison, the configuration is such that the update of the image memory is monitored.

  With this configuration, it is detected whether the image memory is updated by comparing the images of two frames, and an abnormal operation in which the image memory is not updated can be detected.

  Further, the previous frame information storage means also stores frame information two or more frames before the latest frame information, and the determination means monitors the update of the image memory by comparing the frame information. did.

  With this configuration, it is detected whether the image memory is updated by comparing images of three frames or more, and an abnormal operation in which the image memory is not updated can be detected more reliably.

  Here, as the frame information, the luminance level of each pixel obtained in the image memory for each frame is digitized and compared.

  With this configuration, it is possible to detect whether or not the image memory is updated by digitizing the luminance level of each pixel of each frame and comparing the frames.

  Further, as the frame information, the luminance level and color information of each pixel obtained in the image memory for each frame are digitized and compared.

  With this configuration, the luminance level and color information of each pixel in each frame are digitized, the frames are compared, and it can be detected whether the image memory is updated more accurately.

  Further, as the frame information, an average value obtained by quantifying the luminance levels of all the pixels obtained in the image memory for each frame is compared.

  With this configuration, frames are compared with an average value obtained by quantifying the luminance levels of all the pixels in each frame, and processing can be reduced.

  Further, as the frame information, the luminance level of each pixel obtained in the image memory for each frame is digitized, and the checksum is obtained and compared.

  With this configuration, the luminance level of each pixel in each frame is digitized, and the frames are compared using the checksum, thereby reducing processing.

  Further, the determination means is configured to provide a threshold value for the luminance level of each pixel to be compared, and to compare the frame information only when a video signal within a certain threshold value is obtained.

  With this configuration, when the video signal level is the black level or the white level, the image memory update abnormality is not detected, and erroneous detection in an image having no change in the black level or the white level can be avoided.

  In addition, the determination means includes a vehicle speed sensor for a mounted vehicle, and compares the frame information of the previous frame and the current frame when it is determined that the vehicle is traveling.

  According to this configuration, detection of an update abnormality of the image memory is performed only when the vehicle is traveling, and erroneous detection in an image that does not change while the vehicle is stopped can be avoided.

  The determination means has a function of writing specific data to the image memory and reading the written data during a blanking period of the video from the camera, and compares the written data with the read data. Thus, the image memory update is monitored.

  With this configuration, it is possible to detect update abnormality of the image memory by comparing the write data to the image memory and the read data.

  The image memory is provided with a counter whose counter value is incremented during the blanking period of the video from the camera, and the determination unit monitors the update of the image memory by monitoring the counter value. The configuration.

  With this configuration, it is possible to detect an abnormal update of the image memory based on the counter value incremented during the blanking period of the video provided in the image memory.

  The warning means includes warning image generation means, and displays an image for warning generated by the warning image generation means on the display instead of video from the camera at the time of update abnormality determination of the image memory. It was set as the structure to do.

  With this configuration, a warning can be given to the user and display of a video signal that is different from a change in the situation of shooting with the camera can be stopped.

  The warning means includes warning image generation means, and at the time of update abnormality determination of the image memory, the warning image generation means generates a warning determination image that allows the video signal processing apparatus to grasp a failure, and the video signal processing apparatus To notify the abnormal operation.

  With this configuration, it is possible to notify the video signal processing apparatus of an abnormal operation and to stop displaying video signals that are different from changes in the situation of shooting with the camera.

  Further, the warning means is configured to give a warning by a warning sound or a warning lamp at the time of determining the update abnormality of the image memory.

  With this configuration, the user is notified of the abnormal operation by a warning sound or a warning light, and the user who is not viewing the display screen can be notified of the abnormal operation.

  The camera has a plurality of cameras.

  With this configuration, it is possible to detect whether or not the image signal obtained in the image memory has been updated even when having a plurality of cameras, and by performing a warning operation in the case of an abnormal operation in which the image memory is not updated, It is possible to prevent a video different from the change in the situation being photographed by the camera from being transmitted to the user or an external video signal processing device.

  According to the present invention, by providing the determination means for monitoring the image signal obtained in the image memory and detecting the update abnormality of the image memory, the signal information of the image memory obtained from the video signal from the camera is An abnormal operation that is not updated due to a frozen state of the memory can be detected.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram of an in-vehicle image processing apparatus according to the first embodiment of the present invention.

  As shown in FIG. 1, this in-vehicle image processing apparatus is mounted on a vehicle, and includes an in-vehicle camera 1 that captures video information around the vehicle or in a vehicle interior, and an image memory 2 that stores a video signal obtained from the in-vehicle camera 1. The image memory 2 is provided with an image processing means 3 for processing the image signal obtained, the current frame information obtaining means 4 for obtaining frame information from the latest image signal obtained in the image memory 2, and the previous frame Comparing the frame information from the previous frame information storage means 5 for storing the frame information, it comprises a determination means 6 for determining the freeze state of the image memory 2, and a warning image when it is determined that the image memory 2 is in a freeze state The warning image generation means 7 for generating the image and the display 8 for displaying the image after image processing or the generated warning image depending on the result of the determination means 6. . The image processing means 3 may output the image signal after the image processing or the image signal of the generated warning image to an external video signal processing device.

  The current frame information acquisition unit 4 digitizes the luminance level of each pixel of the image signal obtained from the image memory 2 and stores it in a built-in memory. The stored data of each pixel is transferred to the previous frame information storage means 5 as needed before acquiring the next frame information.

  When the next frame information is stored in the current frame information acquisition unit 4, the determination unit 6 compares the data of both.

  Usually, since random noise is added to the video signal, the luminance value of each pixel is not exactly the same for each frame. Accordingly, when the signal levels of the pixels of the previous frame and the current frame are compared and are equal, the determination means 6 determines that the image signal has not been updated, and the image memory 2 is in a frozen state. Is detected.

  Further, if the vehicle is traveling, the signal level of the previous frame and the current frame are not the same value, and the determination means 6 is traveling based on the information from the vehicle speed sensor 9 as shown in FIG. Only when it is determined that it is, the specification for detecting an abnormality may be used. In this way, abnormality detection is not performed while the vehicle is stopped, and it is possible to avoid erroneous detection of abnormality due to a stationary image while the vehicle is stopped.

  Further, for example, when the video signal level from the in-vehicle camera 1 is a black level or a white level, a threshold value may be provided for the luminance level to be compared, such as not comparing the signal level with the previous frame. In this way, it is possible to avoid erroneous detection of an abnormality by an image having no change in black level or white level.

  When an abnormality is detected, the image processing means 3 outputs the image signal output to the display 8 or the video signal processing device of the external camera system, not the image signal obtained from the in-vehicle camera 1, but the warning image generating means 7 Image signal generated on the screen, for example, an image signal of a warning display screen that can notify the user of an abnormality such as a blue display on one side, and that the video signal processing device can grasp the abnormality such as a display of a preset pattern Is output.

  The warning display screen may have a specification for outputting warning characters, or may have a specification for notifying abnormality detection by a warning sound such as a buzzer or a warning light such as an LED (Light-Emitting Diode). In this way, it is possible to notify the user who has not seen the display 8 of the abnormality.

  In this embodiment, each pixel is compared using data of two frames of the previous frame and the current frame, but determination may be performed using frame information of three or more frames. In this way, an abnormality can be detected more reliably.

  In this embodiment, the luminance level of each pixel is compared. However, the specification may be such that the color level of each pixel is compared. In this way, it can be detected whether the image memory has been updated more accurately.

  Further, a method of comparing by a checksum of a signal for each frame or an average luminance value of the frame may be used. In this way, it is possible to reduce processing for detecting whether the image memory 2 has been updated.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to the drawings. FIG. 3 shows a block diagram of an in-vehicle image processing apparatus according to the second embodiment of the present invention.

  As shown in FIG. 3, this in-vehicle image processing apparatus includes an in-vehicle camera 1 that captures video information around the vehicle or in a vehicle interior, an image memory 2 that stores a video signal obtained from the in-vehicle camera 1, and an image memory 2. The image processing means 3 for processing the obtained image signal, the judgment data writing means 21 for writing judgment data for judging the freeze state in the image memory 2, and the freeze of the image memory 2 in response to the result A determination unit 22 for determining the state, and a warning image generation unit 7 for generating a warning image when it is determined that the image memory 2 is in a frozen state; A display 8 for displaying the warning image is provided. The image processing means 3 may output the image signal after the image processing or the image signal of the generated warning image to an external video signal processing device.

  During the blanking period of the video signal from the in-vehicle camera 1, the determination data writing means 21 writes specific data to the image memory 2, and the area and data value that has been written to the determination means 22. Output.

  The determination means 22 reads from the area based on the information on the area where the data is written from the determination data writing means 21.

  The judging means 22 compares the value of the data written in each area of the image memory 2 with the value of the data read again, and if it does not match, it cannot write in that area. It is determined that the signal has not been updated, and an abnormality is detected assuming that the image memory is in a frozen state.

  When an abnormality is detected, the image processing means 3 uses the warning image generation means 7 instead of the image signal obtained from the in-vehicle camera 1 as the image signal output to the display 8 or the video signal processing device of the external camera system. An image signal of the generated screen, for example, an image signal of a warning display screen that can notify the user of an abnormality such as a blue display on one side, and that the video signal processing device can grasp the abnormality such as a display of a preset pattern. Output.

  The warning display screen may have a specification for outputting a warning character, or may have a specification for notifying abnormality detection by a warning sound such as a buzzer or a warning light such as an LED. In this way, it is possible to notify the user who has not seen the display 8 of the abnormality.

  The specific data to be written need not be the only data, and may be a specification that switches to a different value for each frame. In this way, it can be detected whether the image memory has been updated more accurately.

(Third embodiment)
Hereinafter, a third embodiment of the present invention will be described with reference to the drawings. FIG. 4 shows a block diagram of an in-vehicle image processing apparatus according to the third embodiment of the present invention.

  As shown in FIG. 4, the in-vehicle image processing apparatus includes an in-vehicle camera 1 that captures video information around the vehicle or in a vehicle interior, an image memory 2 that stores a video signal obtained from the in-vehicle camera 1, and an image memory 2. Image processing means 3 for processing the obtained image signal, an image memory update counter 31 provided in the image memory 2, and a determination means 32 for judging the freeze state of the image memory 2 in response to the result. A warning image generation unit 7 that generates a warning image when it is determined that the image memory is in a frozen state, and a display 8 that displays an image after image processing or a generated warning image depending on the result of the determination unit 32. I have. The image processing means 3 may output the image signal after the image processing or the image signal of the generated warning image to an external video signal processing device.

  An image memory update counter 31 that is updated during the blanking period of the image signal from the in-vehicle camera 1 is set in a partial area of the image memory 2 by a DSP (Digital Signal Processor) that performs control for writing the image signal to the image memory 2 Keep it. The image memory update counter 31 is incremented every time one frame of image signal is completed.

  The determination means 32 compares the counter value between the previous frame and the current frame, and if they are the same value, determines that the image signal has not been updated, and detects that the image memory 2 is in a frozen state.

  When an abnormality is detected, the image processing means 3 uses the warning image generation means 7 instead of the image signal obtained from the in-vehicle camera 1 as the image signal output to the display 8 or the video signal processing device of the external camera system. An image signal of the generated screen, for example, an image signal of a warning display screen that can notify the user of an abnormality such as a blue display on one side, and that the video signal processing device can grasp the abnormality such as a display of a preset pattern. Output.

  The warning display screen may have a specification for outputting a warning character, or may have a specification for notifying abnormality detection by a warning sound such as a buzzer or a warning light such as an LED. In this way, it is possible to notify the user who has not seen the display 8 of the abnormality.

  Further, in the present embodiment, the counter is set in the video blanking period for each frame and the counter value is incremented for each frame. However, the counter is set in the video blanking period for each line. A specification that compares the counter value for each line may be used. In this way, it can be detected whether the image memory has been updated more accurately.

  Although the first to third embodiments of the present invention have been described with a single camera, the same applies to specifications equipped with a plurality of in-vehicle cameras.

  The same applies to an image processing apparatus that processes camera video without mounting the display 8.

  As described above, the image processing apparatus according to the present invention can detect an abnormal operation in which the signal information of the image memory obtained from the video signal from the camera is not updated due to the frozen state of the image memory. It is useful as an image processing apparatus or the like that stores a video signal captured by a camera (for example, an in-vehicle camera) in an image memory and processes the obtained signal information.

1 is a block diagram of an in-vehicle image processing apparatus according to a first embodiment of the present invention. The other block diagram of the vehicle-mounted image processing apparatus in the 1st Embodiment of this invention The block diagram of the vehicle-mounted image processing apparatus in the 2nd Embodiment of this invention. The block diagram of the vehicle-mounted image processing apparatus in the 3rd Embodiment of this invention. Block diagram of a conventional in-vehicle image processing device

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Car-mounted camera 2 Image memory 3 Image processing means 4 Current frame information acquisition means 5 Previous frame information storage means 6 Judgment means 7 Warning image generation means 8 Display 9 Vehicle speed sensor 21 Judgment data writing means 22 Judgment means 31 Image memory update Counter 32 judgment means

Claims (15)

An image memory for storing video from the camera, an image processing means for processing an image signal obtained in the image memory, a determination means for detecting an update abnormality of the image memory, and the determination means updating the image memory An image processing apparatus comprising: a warning unit that issues a warning when an abnormality is detected. The determination means has current frame information acquisition means for storing the latest frame information of the video from the camera, and previous frame information storage means for storing the previous frame information, and compares the frame information. The image processing apparatus according to claim 1, wherein update of the image memory is monitored. The previous frame information storage means also stores frame information two or more frames before the latest frame information, and the determination means monitors the update of the image memory by comparing the frame information. The image processing apparatus according to claim 2. 4. The image processing apparatus according to claim 2, wherein the brightness level of each pixel obtained in the image memory for each frame is digitized and compared as the frame information. 5. The image processing apparatus according to claim 2 or 3, wherein as the frame information, the luminance level and color information of each pixel obtained in an image memory for each frame are digitized and compared. 4. The image processing apparatus according to claim 2, wherein an average value obtained by quantifying luminance levels of all pixels obtained in an image memory for each frame is compared as the frame information. 5. 4. The image processing apparatus according to claim 2, wherein the frame information is converted into a numerical value of a luminance level of each pixel obtained in an image memory for each frame, and a checksum is obtained and compared. 8. The determination unit according to claim 4, wherein the determination unit sets a threshold value for the luminance level of each pixel to be compared, and compares frame information only when a video signal within a certain threshold value is obtained. The image processing apparatus according to any one of the above. The said determination means is provided with the vehicle speed sensor of the mounted vehicle, and when it determines with the said vehicle driving | running | working, the frame information of a front frame and the present frame is compared, The claim from Claim 4 characterized by the above-mentioned. Item 8. The image processing device according to any one of Item 7. The determination means has a function of writing specific data into the image memory and reading the written data during a blanking period of the video from the camera, and comparing the written data with the read data. The image processing apparatus according to claim 1, wherein the update of the image memory is monitored. The image memory is provided with a counter whose counter value is incremented during the blanking period of the video from the camera, and the determination means monitors the update of the image memory by monitoring the counter value. The image processing apparatus according to claim 1, wherein: The warning means includes warning image generation means, and displays an image for warning generated by the warning image generation means on the display instead of video from the camera at the time of update abnormality determination of the image memory. The image processing apparatus according to claim 1, wherein: The warning unit includes a warning image generation unit, and generates a warning determination image by which the video signal processing device can grasp a failure when the update abnormality of the image memory is determined, and transmits the warning determination image to the video signal processing device. The image processing apparatus according to claim 1, wherein an abnormal operation is notified. The image processing apparatus according to any one of claims 1 to 11, wherein the warning means issues a warning by a warning sound or a warning lamp when an update abnormality of the image memory is determined. The image processing apparatus according to claim 1, wherein the camera includes a plurality of cameras.

Images