JP4941247B2 - Image display system for vehicles - Google Patents

Description

  The present invention relates to an image display system for a vehicle that displays an image photographed by a photographing device provided in a vehicle on a display device mounted on the vehicle.

  2. Description of the Related Art Conventionally, in a vehicle, for the purpose of supporting safe operation, for example, an image around a vehicle photographed by a camera is displayed on a display device (for example, a liquid crystal display panel) provided inside the vehicle. Yes.

  Generally, an image captured by a camera is converted into a composite video signal such as NTSC (National Television Standards Committee) and transmitted, and the composite video signal is displayed on a display LSI provided in the vehicle. take in. For example, the video signal is captured in units of frames, and the video signal in units of frames is hereinafter also referred to as an image frame.

  The display LSI sequentially stores the captured image frames in the frame buffer. The image frames stored in the frame buffer are subjected to predetermined processing such as color conversion, enlargement, or reduction, and are sequentially input to the display device in synchronization. Thereby, the photographed image of the camera is displayed on the display device.

  In such a system, for example, when the camera freezes (stops operation), the display image on the display device is fixed without being changed (freeze state). In this case, the display image on the display device does not change even if the vehicle moves. Then, for example, even though the vehicle has approached an obstacle or a pedestrian, the driver believes the image on the display device (the image in the frozen state), so that there is no obstacle or pedestrian around the vehicle. There is a risk of misrecognition.

Therefore, for example, in Patent Document 1, when an abnormality of a camera is detected, the fact that the abnormality has been detected is displayed on a display device to notify the driver.
JP 2004-214970 A

  By the way, in the vehicle image display system, there is a concern that the display device may be frozen due to some abnormality other than the abnormality of the camera. For example, software malfunction or malfunction due to noise or the like can be considered. More specifically, image frame capture abnormalities, storage abnormalities, read abnormalities, and the like are conceivable.

  In this regard, in the above-mentioned Patent Document 1, when an abnormality occurs in a portion other than the camera, the driver is not notified of this, so the driver believes the image on the display device and surrounds the vehicle as described above. The problem of misrecognizing that there are no obstacles or pedestrians still remains.

  The present invention has been made in view of such a problem, and in an image display system for a vehicle that performs traveling support by displaying an image photographed by a photographing device provided in a vehicle on a display device mounted on the vehicle. The purpose is to ensure the safety of the driver more reliably.

  In order to achieve the above-mentioned object, the invention according to claim 1 is provided such that an image captured by an imaging device provided in a vehicle is displayed on a display device that is mounted on the vehicle and displays an image represented by input image data. An image display system for a vehicle to be displayed, wherein a capturing unit that captures image data representing an image captured by the capturing device from a capturing device, a storage unit that stores image data captured by the capturing unit, A vehicle image display system comprising: transmission means for inputting image data stored in the storage means (hereinafter referred to as captured storage image data) to a display device.

  This vehicle image display system extracts predetermined data components from image data captured by the capturing means, and inputs image data composed of the extracted data components (hereinafter referred to as extracted image data) to the transmission means. An extracted image data input means, and an abnormality detection means for detecting a transmission abnormality of the image data captured by the capture means. When the abnormality is detected by the abnormality detection means, the transmission means captures the stored image Instead of data, extracted image data input from the extracted image data input means is input to the display device.

  In the vehicle image display system according to the first aspect, apart from the image data transmission path of capture means → storage means → transmission means → display device, capture means → (extracted image data input means) → transmission means → display A transmission path called a device is established.

  For example, when an abnormality is detected in the original transmission path (the former transmission path of the above two transmission paths), the transmission unit inputs the extracted image data to the display apparatus. Freezing can be avoided. In other words, even when the image represented by the image data captured by the capturing unit cannot be displayed on the display device due to some abnormality, the extracted image data can be displayed on the display device instead. Here, as examples of abnormalities, there are possible abnormalities in capturing by the capturing means, abnormalities related to storage in the storing means, abnormalities in the transmitting means, and the like.

  The extracted image data includes predetermined data components extracted from the image data captured by the capturing unit, and simply represents an image represented by the image data captured by the capturing unit, for example. is there. For this reason, the amount of data is kept low. As the predetermined data component, for example, a luminance component (luminance signal) can be considered. According to this, the amount of data to be transmitted can be suppressed as compared with the case where the image data captured by the capturing unit is transmitted as it is, and the processing load can be suppressed.

  As described above, according to the vehicle image display system of claim 1, even when the image represented by the image data captured by the capturing unit cannot be displayed on the display device (or when the image is frozen), Instead, a freeze in the display device can be avoided by displaying an image represented by the extracted image data with a reduced data amount (in other words, an image representing the minimum information) on the display device.

  Therefore, it is possible to prevent the driver of the vehicle from misrecognizing the surrounding situation based on an erroneous image (frozen image), and to ensure the safety of the vehicle and the driver more reliably.

  According to a second aspect of the present invention, there is provided a vehicle image display in which an image captured by a photographing device provided in the vehicle is displayed on a display device that is mounted on the vehicle and displays an image represented by input image data. A system, a capturing unit that captures image data representing an image captured by the photographing apparatus from a photographing device, a storage unit that stores image data captured by the capturing unit, and a capturing unit that captures the image data. And a transmission means for inputting the image data stored in the storage means (hereinafter referred to as captured storage image data) to the display device.

In particular, in this vehicle image display system, the image data is composed of a plurality of frames, and the storage means stores in advance image data different from the captured storage image data (hereinafter referred to as initial image data). And an abnormality detecting means for detecting an abnormal transmission of the image data captured by the capturing means, and the transmission means replaces the initial stored image data when the abnormality is detected by the abnormality detecting means. Is input to the display device. The abnormality detection unit detects a difference value between at least two frames when the storage unit stores the image data and when the transmission unit inputs the image data to the display device. Are determined to match, and if they do not match, it is determined to be abnormal.

  According to this, when an abnormality is detected by the abnormality detection means, the image represented by the initial image data stored in advance in the storage means is displayed on the display device, so that the freeze on the display device is avoided. Can do. In other words, even when the image represented by the image data captured by the capturing unit cannot be displayed on the display device due to some abnormality, the initial image data can be displayed on the display device instead. Here, as examples of abnormalities, there are possible abnormalities in capturing by the capturing means, abnormalities related to storage in the storing means, abnormalities in the transmitting means, and the like. Further, as an example of the initial image data, data such as characters and illustrations for notifying that there is an abnormality can be considered.

  Thus, according to the vehicle image display system of claim 2, even when the image represented by the image data captured by the capturing means cannot be displayed on the display device (or when the image is frozen), Instead, the image represented by the initial image data is displayed on the display device, so that the freeze on the display device can be avoided. In addition, the driver can be notified of the abnormality.

  Therefore, it is possible to prevent the driver of the vehicle from misrecognizing the surrounding situation based on an erroneous image (frozen image), and to ensure the safety of the vehicle and the driver more reliably.

Next, the vehicle image display system according to claim 1 may be specifically configured as in claim 3.
A vehicle image display system according to a third aspect is the vehicle image display system according to the first aspect, wherein the image data is composed of a plurality of frames, and the abnormality detection means is configured so that the storage means stores the image data and the transmission means. When each of the image data is input to the display device, a difference value between at least two frames is detected, and it is determined whether or not the detected difference values match each other. It is supposed to be.

  According to this, even if some abnormality (for example, data error, data loss, noise superimposition) occurs in the frame in the transmission path of the image data (frame), the abnormality can be detected. Further, even when an abnormality occurs such that the same image data is captured or the same image data is read at a certain point in time, such an abnormality can be detected based on the difference value of the image data. When such an abnormality is detected, the image represented by the extracted image data or the image represented by the initial image data is displayed on the display device, and an unintended image is displayed on the display device. It can be avoided.

Further, the vehicle image display system according to claims 1 to 3 may be configured as in claim 4.
A vehicle image display system according to a fourth aspect of the present invention is the vehicle image display system according to any one of the first to third aspects, wherein the vehicle image display system includes a counter that performs a count operation every time image data is captured by the capture unit. Each time it is fetched, it has an adding means for adding the count value of the counter at the time of fetching to each of the fetched image data, and the storage means stores the image data after the count value is added by the adding means. The abnormality detection means detects the count value added to the captured storage image data when the transmission means inputs the captured storage image data to the display device. When it is detected consecutively, it is determined that there is an abnormality.

  According to this, an abnormality in which image data is not normally captured due to some abnormality and only the same image data is input to the display device (that is, the same image is displayed on the display device, in other words, in a frozen state) Abnormality) can be detected.

  According to a fifth aspect of the present invention, there is provided a vehicle image display in which an image captured by a photographing device provided in the vehicle is displayed on a display device that is mounted on the vehicle and displays an image represented by input image data. A system for capturing image data representing an image photographed by the photographing device from the photographing device, and image data captured by the capturing device (hereinafter referred to as captured image data). In the vehicle image display system, the image data (hereinafter referred to as an extracted image) composed of the extracted data components is extracted from the image data captured by the capturing means. Data extraction) to the transmission means, and an abnormality detection means for detecting an abnormal transmission of the image data captured by the capture means. It means, when the abnormality by the abnormality detection means is detected, instead of the captured image data, and inputs the extracted image data inputted from the extracted image data input means on a display device.

According to this, the same effect as described in claim 1 can be obtained.
According to a sixth aspect of the present invention, there is provided a vehicle image display in which an image captured by a photographing device provided in the vehicle is displayed on a display device that is mounted on the vehicle and displays an image represented by input image data. A system for capturing image data representing an image photographed by the photographing device from the photographing device, and image data captured by the capturing device (hereinafter referred to as captured image data). In the vehicular image display system, the image data is composed of a plurality of frames , and the storage stores in advance image data different from the captured image data (hereinafter referred to as initial image data). means, and an abnormality detecting means for detecting a transmission error of the image data captured by the capturing means, the abnormality detecting means, at each of different timings from each other Detecting a difference value between the at least two frames, it is determined whether or not the difference value detected match in each abnormality determination when they do not match, transmitting means, abnormality is detected by the abnormality detecting means Then, instead of the captured image data, the initial image data stored in the storage means is input to the display device.

According to this, the same effects as those described in claims 2 and 3 can be obtained.
Next, a vehicle image display system according to a seventh aspect is the vehicle image display system according to the fifth aspect, wherein the image data is composed of a plurality of frames, and the abnormality detection means has at least two different timings at different timings. A difference value between the frames is detected, and it is determined whether or not the difference values detected in each frame match. If they do not match, it is determined that there is an abnormality.

According to this, the same effect as described in claim 3 can be obtained.
Next, a vehicle image display system according to an eighth aspect of the present invention is the vehicle image display system according to any one of the fifth to seventh aspects, further comprising a counter that performs a count operation every time image data is captured by the capture unit. Each time image data is fetched, each fetched image data is provided with an adding means for adding the count value of the counter at the time of fetching, and the abnormality detecting means is added with the count value added by the adding means. The count value added to the captured image data is detected from each of the captured image data, and when the same value is continuously detected a plurality of times, it is determined that there is an abnormality.

  According to this, the same effect as described in claim 4 can be obtained.

Embodiments of the present invention will be described below with reference to the drawings.
[First Embodiment]
First, the first embodiment will be described.

FIG. 1 is a configuration diagram of a vehicle image display system 1 according to the first embodiment.
In this vehicle image display system 1, the display LSI 2 captures image data representing an image captured by the camera 4, accumulates the captured image data in the frame buffer 6, and sequentially stores the stored image data on the display 8. To enter. That is, the display LSI 2 displays an image taken by the camera 4 on the display 8.

  The display LSI 2 includes an AD conversion circuit (hereinafter referred to as ADC) 10 that performs analog / digital conversion, an NTSC decoder 12 that performs demodulation, a signal conversion circuit 14, a downscaler 16, an upscaler 18, and an adjustment. The circuit 20, the synthesis circuit 22, the line buffer 28, the multiplication circuit 30, the frequency dividing circuits 32 and 34, the selector 36, the synchronization generation circuit 38, the CPU abnormality detection circuit 40, and the selector 42 are provided. ing.

The NTSC decoder 12 includes a low-pass filter (hereinafter referred to as LPF) 24 and a synchronization detection circuit 26.
Image data (signal) representing an image captured by the camera 4 is input to the ADC 10. A signal input from the camera 4 to the ADC 10 of the display LSI 2 is an NTSC (National Television Standards Committee) composite video signal. It is also composed of a plurality of frames. The ADC 10 receives a 27 MHz dot clock, and the ADC 10 captures image data according to the dot clock. The dot clock is an index indicating how fast a 1-dot signal can be sent to the display 8.

  Specifically, the ADC 10 samples the image data (video signal) from the camera 4 at a predetermined sampling frequency (27 MHz in this example), digitizes the sampled signal, and converts the numerical value into a digital code.

  The signal after AD conversion by the ADC 10 is input to the NTSC decoder 12 and the LPF 24 and the synchronization detection circuit 26 included in the NTSC decoder 12. A luminance signal (Y signal) is extracted via the LPF 24, and a synchronization signal is extracted via the synchronization detection circuit 26. The extracted luminance signal and synchronization signal are input to the line buffer 28.

On the other hand, the NTSC decoder 12 demodulates the signal input from the ADC 10 and inputs the demodulated signal to the signal conversion circuit 14.
The signal conversion circuit 14 converts a YCbCr signal composed of a luminance signal and a color signal into an RGB signal represented by three primary colors of R (red), G (green), and B (blue). The RGB signal after being converted by the signal conversion circuit 14 is input to the downscaler 16.

The downscaler 16 compresses (reduces) the input RGB signal. The signal after being compressed (reduced) is input to the frame buffer 6.
The signal input to the frame buffer 6 is taken into the upscaler 18 and expanded (enlarged) in the upscaler 18. The expanded (enlarged) signal is input to the adjustment circuit 20.

The adjustment circuit 20 is a circuit that adjusts gain, contrast, and the like. The signal after adjustment in the adjustment circuit 20 is input to the synthesis circuit 22.
In the synthesis circuit 22, image data representing an image to be displayed on the display 8 is synthesized. The image data synthesized by the synthesis circuit 22 is input to the selector 42.

  Here, the dot clock of 27 MHz described above is input to the multiplication circuit 30. In this example, the dot clock input to the multiplication circuit 30 is multiplied by 16 by the multiplication circuit 30.

  The dot clock after being multiplied by the multiplication circuit 30 is input to the frequency dividing circuits 32 and 34. In this example, the frequency dividing circuit 32 divides the input signal (dot clock) by 13 and the frequency dividing circuit 34 divides the input signal (dot clock) by 54. Yes. The signal after frequency division by the frequency dividing circuits 32 and 34 is input to the selector 36. With such a configuration, two types of dot clocks are generated according to the specifications of the display 8. In this example, it is assumed that a plurality of types (for example, two types) of displays are provided (FIG. 1 shows only one type of display 8).

  The selector 36 receives a switching signal for switching the output from the switching circuit 44. The selector 36 outputs either a signal (dot clock) input from the frequency dividing circuit 32 or a signal (dot clock) input from the frequency dividing circuit 34 according to the signal from the switching circuit 44. That is, one of two types of dot clocks is output under the control of the switching circuit 44. A signal output from the selector 36 is input to the synchronization generation circuit 38, the line buffer 28, and the selector 42.

The switching signal from the switching circuit 44 is also input to the synchronization generation circuit 38.
The synchronization generation circuit 38 generates a synchronization signal according to the input dot clock (that is, according to the specification of the display 8). The synchronization signal generated by the synchronization generation circuit 38 is input to the line buffer 28 and the selector 42.

Then, the image data is output from the line buffer 28 to the selector 42 in accordance with the dot clock from the selector 36 and the synchronization signal from the synchronization generation circuit 38.
The selector 42 selects either image data input from the combining circuit 22 (hereinafter referred to as normal image data) or image data input from the line buffer 28 (hereinafter referred to as simple image data). Switch to input to the display 8.

  Here, the abnormality detection signal from the CPU abnormality detection circuit 40 is input to the selector 42. When the CPU is normal, specifically, when the abnormality detection signal is not input from the CPU abnormality detection circuit 40, the selector 42 inputs the normal image data input from the synthesis circuit 22 to the display 8. On the other hand, when the CPU is abnormal, the selector 42 inputs the simple image data from the line buffer 28 to the display 8 when an abnormality detection signal is input from the CPU abnormality detection circuit 40.

2 to 4 are flowcharts showing the processing realized in the vehicle image display system 1 of FIG. 1 (specifically, realized in the display LSI 2).
First, the normal video processing of FIG. 2 will be described. 2 is realized by the hardware configuration of the vehicle image display system 1 of FIG. 1 (specifically, the hardware configuration of the display LSI 2).

In this process, first, in S110, a camera image of the camera 4 (which is an NTSC system signal, hereinafter also referred to as an NTSC signal) is captured.
Next, in S120, the NTSC signal is converted into a signal composed of a luminance signal and a color signal (hereinafter also referred to as YUV signal).

In step S130, the YUV signal is converted into an RGB signal representing the three primary colors R (red), G (green), and B (blue).
Next, in S140, the image data represented by the RGB signal is scaled down (reduced).

Next, in S150, the image data scaled down in S140 is stored in the frame buffer 6.
Next, in S160, the image data stored in the frame buffer 6 in S150 is read out.

Next, in S170, the image data read from the frame buffer 6 in S160 is scaled up (enlarged).
Next, in S180, the color of the image data scaled up in S170 is adjusted.

Next, in S190, display timing control for displaying an image on the display 8 is performed.
In S200, the image data (video signal) is output to the selector 42. Thereafter, the process is terminated.

Next, the simple video processing of FIG. 3 will be described. This simple video processing is realized by the hardware configuration of the display LSI 2.
In this process, first, the camera video (NTSC signal) of the camera 4 is captured in S210.

Next, in S220, a synchronization signal included in the NTSC signal is detected.
Next, in S230, a luminance signal (Y signal) representing the luminance included in the NTSC signal is separated.

Next, at 240, the separated Y signal is stored in the line buffer 28.
Next, in S250, it is determined whether or not the type of the display 8 is 1. In this example, it is assumed that there are two types of displays, and they are distinguished as type 1 and type 2, respectively. If it is determined that the type of the display 8 is 1 (S250: YES), the display timing for type 1 is generated in S260. Specifically, a type 1 dot clock and a synchronization signal are generated and output.

  Next, in S280, image data (simple image data) represented by the Y signal stored in the line buffer 28 is output to the selector 42 based on the dot clock and the synchronization signal generated in S160. Thereafter, the process is terminated. Note that an image composed of a Y signal (luminance signal) is a so-called monochrome image.

  On the other hand, if it is determined in S250 that the type is not 1, that is, the type is 2 (S250: NO), the display timing for type 2 is generated in S270. Specifically, a type 1 dot clock and a synchronization signal are generated and output.

  Next, in S280, image data (simple image data) represented by the Y signal stored in the line buffer 28 is output to the selector 42 based on the dot clock and the synchronization signal generated in S270. Thereafter, the process is terminated.

Next, the monitor display video selection process of FIG. 4 will be described. This monitor display video selection process is realized by the hardware configuration of the display LSI 2.
In this process, first, in S310, it is determined whether or not the CPU is abnormal.

  If it is determined that the CPU is not abnormal (S310: NO), normal image data (that is, image data output from the frame buffer 6 to the selector 42 by the processing of FIG. 2) is selected in S320.

  On the other hand, if it is determined that the CPU is abnormal (S310: YES), simple image data (that is, image data output from the line buffer 28 to the selector 42 by the processing of FIG. 3) is selected in S330. .

  Next, in S340, the normal image data selected in S320 or the simple image data selected in S330 is output to the display 8. Thereafter, the process is terminated.

  Thus, when the CPU is not abnormal (normal), a normal image represented by the normal image data is displayed on the display 8, and when the CPU is abnormal, the image represented by the simple image data (in this example, a monochrome image) ) Is displayed on the display 8.

  As described above, in this embodiment, even when a CPU abnormality is detected by the CPU abnormality detection circuit 40 of the display LSI 2, simple image data is input to the display 8, and the simple image represented by the simple image data is displayed. (In this example, a monochrome image) is displayed on the display 8. For this reason, the freeze in the display 8 can be avoided. Further, when the monochrome image is displayed on the display 8, the driver can know that an abnormality has occurred.

In this embodiment, the ADC 10 corresponds to capture means, the frame buffer 6 corresponds to storage means, the selector 42 corresponds to transmission means, and the LPF 24, the synchronization detection circuit 26, and the line buffer 28 are used to input extracted image data. The CPU abnormality detection circuit 40 corresponds to the abnormality detection means, the image data captured from the camera 4 corresponds to the captured storage image data, and the image data input from the line buffer 28 to the selector 42 is the extracted image. It corresponds to data.
[Second Embodiment]
Next, a second embodiment will be described.

  FIG. 5 is a configuration diagram of the vehicle image display system 1 according to the second embodiment. In the vehicle image display system 1 (FIG. 5) according to the second embodiment, the same components as those in the vehicle image display system 1 (see FIG. 1) according to the first embodiment are denoted by the same reference numerals.

  Compared with the vehicle image display system 1 of the first embodiment, the vehicle image display system 1 of the second embodiment includes an LPF 24, a synchronization detection circuit 26, a line buffer 28, a multiplier circuit 30, a frequency divider circuit 32, 34, the selector 36, the synchronization generation circuit 38, the CPU abnormality detection circuit 40, the selector 42, and the switching circuit 44 are not provided. Further, the difference is that an abnormality detection circuit 50 is provided. Further, the difference is that motion detection is realized in the NTSC decoder 12 and the upscaler 18. Although the motion detection will be described later, the abnormality detection circuit 50 determines an abnormality based on the motion detection results of the NTSC decoder 12 and the upscaler 18.

  Next, the vehicle image display system 1 according to the second embodiment is different from the first embodiment in that the normal video processing of FIG. 6 is realized instead of the normal video processing of FIG. Yes. Note that the processing of FIGS. 3 and 4 is the same as in the first embodiment. In the normal video processing of FIG. 6, the same steps as those in the normal video processing of FIG.

Here, motion detection will be described.
In the vehicle image display system 1 of FIG. 5, the NTSC decoder 12 and the upscaler 18 detect, for example, two predetermined frames among the frames constituting the input image data, and the difference between the two frames. Calculate the value. Similarly, in the upscaler 18, for example, a difference value between two predetermined frames is calculated. For example, the difference value between the frame A and the frame B is calculated in the NTSC decoder 12, and the difference value between the frame A and the frame B is calculated similarly in the upscaler 18.

The difference value calculated by the NTSC decoder 12 and the upscaler 18 is input to the abnormality detection circuit 50.
The abnormality detection circuit 50 compares the difference values calculated by the NTSC decoder 12 and the upscaler 18 and determines that the two are in agreement, and determines that the two are in agreement.

Next, the normal video processing of FIG. 6 will be described. This process is realized by the hardware configuration of the display LSI 2 in FIG.
In the normal video processing of FIG. 6, when the camera video of the camera 4 is captured in S110, next, motion detection is performed in S400. Here, motion detection is performed in the NTSC decoder 12. The motion detection is as described above. Hereinafter, the detection value in S400 is referred to as detection value 1.

Next, the process proceeds to S120, but the processes in S120 to S160 are the same as those in FIG.
When the image data is read from the frame buffer 6 in S160, the motion detection of the read image data (frame) is performed in S410. Here, motion detection is performed in the upscaler 18. Hereinafter, the detection value in S420 is referred to as detection value 2.

  Next, in S420, it is determined whether or not detection value 1 = detection value 2, and if it is determined that detection value 1 = detection value 2 is not satisfied (S420: NO), the process proceeds to S430, and an abnormality notification is made. The Thereafter, the process is terminated. The abnormality notification may be any method. For example, it may be displayed on the display 8 that it is abnormal, or it may be notified that it is abnormal by voice or light.

  On the other hand, if it is determined in S420 that the detection value 1 = the detection value 2 (S420: YES), the process proceeds to S170. Note that the processing of S170 to S200 is the same as that in FIG. 2, and a description thereof will be omitted here.

As described above, in the second embodiment, an abnormality is detected based on motion detection. Specifically, it is determined whether or not the difference values between the frames constituting the image data match before and after the frames are stored in the frame buffer 6. If they do not match, it is determined that there is an abnormality. Yes. According to this, an abnormality such that only the same image data (frame) is captured, or an abnormality such that only the same image data (frame) is read from the frame buffer 6 is reliably detected. At the same time, such an abnormality is notified to the driver, which is safe for the driver.
[Third Embodiment]
Next, a third embodiment will be described.

  FIG. 7 is a configuration diagram of the vehicle image display system 1 according to the third embodiment. In the vehicle image display system 1 (FIG. 7) according to the third embodiment, the same components as those in the vehicle image display system 1 (FIGS. 1 and 5) according to the first and second embodiments are denoted by the same reference numerals. is doing.

  The vehicle image display system 1 according to the third embodiment is different from the vehicle image display system 1 according to the second embodiment in that motion detection is not performed. Further, the difference is that a counter code addition circuit 52 and a counter code detection circuit 54 are provided.

  Further, in the vehicle image display system 1 of the third embodiment, the normal image processing of FIG. 8 is realized in place of the normal image processing of FIG. 6 as compared with the vehicle image display system 1 of the second embodiment. Is different. 3 and 4 is the same as in the first and second embodiments. Further, in the normal video processing of FIG. 8, the same steps as those of the normal video processing of FIGS.

  The counter code addition circuit 52 includes a counter. The counter performs a counting operation for each unit data stored in the frame buffer 6. The counter code adding circuit 52 adds the counter code of the counter for each image data stored in the frame buffer 6. That is, a different counter code is added for each image data stored in the frame buffer 6.

  Each time the image data is read from the frame buffer 6, the counter code detection circuit 54 detects a counter code added to the image data. The detection result is output to the abnormality detection circuit 50.

  The abnormality detection circuit 50 determines whether or not the counter codes sequentially input from the counter code detection circuit 54 match. For example, if the counter code matches a plurality of times, the abnormality detection circuit 50 determines that there is an abnormality.

Next, the normal video processing of FIG. 8 will be described. This process is realized by the hardware configuration of the display LSI 2 in FIG.
In the normal video processing of FIG. 8, first, the processing of S110 to S140 is the same as that of FIG.

When the scale-down (reduction) is completed in S140, a count code is added to the scaled-down image data in S500.
In S150, the image data to which the count code is added is stored in the frame buffer 6.

  When image data is read from the frame buffer 6 in S160, it is next determined in S510 whether or not the counter code is abnormal. Specifically, if the same counter code is detected continuously, it is determined as abnormal.

  If it is determined that there is an abnormality in S510 (S510: YES), an abnormality notification is made in S520. Thereafter, the process is terminated. The abnormality notification may be any method.

  On the other hand, if it is determined in S510 that the counter code is not abnormal (that is, normal) (S510: NO), the process proceeds to S170. Note that the processing of S170 to S200 is the same as that in FIG. 2 (or FIG. 6), and description thereof is omitted here.

As described above, in the third embodiment, a counter code is added to each image data stored in the frame buffer 6, and an abnormality is detected based on the counter code. For example, when the same counter code is detected, it is understood that new image data is not updated and stored in the frame buffer 6 (that is, the same image data is continuously stored). In this case, abnormalities in image data capture, transmission abnormalities, memory abnormalities, and the like are suspected. However, in the third embodiment, such abnormalities are reliably detected, so that it is safe for the driver.
[Fourth Embodiment]
Next, a fourth embodiment will be described.

  FIG. 9 is a configuration diagram of the vehicle image display system 1 according to the fourth embodiment. In the vehicle image display system 1 (FIG. 9) according to the fourth embodiment, the same configuration as the vehicle image display system 1 (FIGS. 1, 5, and 7) according to the first, second, and third embodiments is described. Are given the same reference numerals.

  The vehicle image display system 1 according to the fourth embodiment is different from the vehicle image display system 1 according to the second embodiment in that a switching circuit 44 is provided. Further, the display LSI 2 is different in that a display start address changing circuit 56 is provided. Further, the difference is that the initial image data 6a is stored in a predetermined area of the frame buffer 6 in advance. A plurality of types of initial image data are stored according to the type of the display 8. The initial image data is image data representing an abnormality.

  Next, in the vehicle image display system 1 of the fourth embodiment, the normal image processing of FIG. 10 is realized in place of the normal image processing of FIG. 6 as compared with the vehicle image display system of the second embodiment. Is different. In the normal video processing of FIG. 10, the same steps as those of the normal video processing of FIG.

The normal video processing in FIG. 10 differs from the normal video processing in FIG. 6 in that the processing of S600, S610, and S620 is realized.
In the normal video processing of FIG. 10, if it is determined in S420 that the detected value 1 is not 2 (S420: NO), it is determined in S600 whether the type of the display 8 is 1.

  If it is determined in S600 that the type is 1 (S600: YES), the image data read address in the frame buffer 6 is changed to the address in which the initial image data 6a for type 1 is stored in S610. . Then, the process returns to S160. Specifically, the initial image data 6a for type 1 is read. In this case, the read initial image data 6a is output to the display 8 (S200).

  On the other hand, if it is determined in S600 that the type is not 1, that is, the type is 2 (S600: NO), the read address of the image data in the frame buffer 6 is the initial image data 6a for type 2 in S620. Is changed to the stored address. Then, the process returns to S160. Specifically, the initial image data 6a for type 2 is read. In this case, the read initial image data 6a is output to the display 8 (S200).

  Here, the operation will be described with reference to FIG. 10. The display start address change circuit 56 changes the read address to the address where the initial image data 6a is stored based on the signal from the abnormality detection circuit 50, and from the switching circuit 44. Based on the switching signal, the read address is switched to either the address where the initial image data 6a for type 1 is stored or the address where the initial image data 6a for type 2 is stored. Then, the initial image data 6 a stored at the address designated by the switching is read and input to the display 8.

As described above, in the fourth embodiment, the initial image data 6a is stored in the frame buffer 6 in advance, and when an abnormality is detected by motion detection, that is, the image data capture abnormality or transmission of the camera 4 is detected. When an abnormality, memory abnormality, or the like is detected, the initial image data 6a is read and displayed on the display 8. For this reason, the freeze in the display 8 can be avoided. Further, since the initial image data 6a is image data representing an abnormality, the driver is notified that the abnormality is abnormal, and the driver is safe.
[Fifth Embodiment]
Next, a fifth embodiment will be described.

  FIG. 11 is a configuration diagram of the vehicle image display system 1 of the fifth embodiment. In the vehicle image display system 1 of the fifth embodiment (FIG. 11), the vehicle image display system 1 of the first, second, third, and fourth embodiments (FIGS. 1, 5, 7, and 9). The same components as those in FIG.

  The vehicle image display system 1 according to the fifth embodiment is different from the vehicle image display system 1 according to the third embodiment in that a switching circuit 44 is provided. Further, the display LSI 2 is different in that a display start address changing circuit 56 is provided. Further, the difference is that the initial image data 6a is stored in a predetermined area of the frame buffer 6 in advance. A plurality of types of initial image data are stored in accordance with the type of the display 8. Note that the initial image data is image data representing an abnormality.

  Next, the vehicle image display system 1 according to the fifth embodiment is different in that the normal video processing of FIG. 12 is realized instead of the normal video processing of FIG. In the normal video processing in FIG. 12, the same steps as those in the normal video processing in FIG.

The normal video processing of FIG. 12 is different from the normal video processing of FIG. 8 in that the processing of S600, S610, and S620 is realized.
Specifically, if it is determined in S510 that the counter code is abnormal (S510: YES), it is determined in S600 whether the monitor type is 1.

  If it is determined in S600 that the monitor type is 1 (S600: YES), the image data read address in the frame buffer 6 is changed to the address in which the initial image data 6a for type 1 is stored in S610. The Then, the process returns to S160. Specifically, the initial image data 6a for type 1 is read. In this case, the read initial image data 6a is output to the display 8 (S200).

  On the other hand, when it is determined in S600 that the type is not 1, that is, the type is 2 (S600: NO), in S620, the read-out address of the image data in the frame buffer 6 is the initial image data 6a for type 1. Is changed to the stored address. Then, the process returns to S160. Specifically, the initial image data 6a for type 2 is read. In this case, the read initial image data 6a is output to the display 8 (S200).

  Here, the operation will be described with reference to FIG. 11. The display start address changing circuit 56 changes the read address in the frame buffer 6 to the address in which the initial image data 6a is stored based on the signal from the abnormality detection circuit 50. Based on the switching signal from the switching circuit 44, the read address is switched to either the address where the initial image data 6a for type 1 is stored or the address where the initial image data 6a for type 2 is stored. Then, the initial image data 6 a stored at the address designated by the switching is read and input to the display 8.

  As described above, in the fourth embodiment, when the initial image data 6a is stored in the frame buffer 6 in advance and an abnormality is detected by the counter code detection, that is, the image data capturing error of the camera 4 is detected. When a transmission abnormality, storage abnormality, or the like is detected, the initial image data 6a is read and displayed on the display 8. For this reason, the freeze in the display 8 can be avoided. Further, since the initial image data 6a is image data representing an abnormality, the driver is notified that the abnormality is abnormal, and the driver is safe.

As mentioned above, although one Embodiment of this invention was described, this invention is not limited to the said embodiment, A various form can be taken within the technical scope of this invention.
For example, the configuration of motion detection in the second embodiment may be combined with the first embodiment. Specifically, in the first embodiment, an abnormality may be detected by motion detection, and a simple image represented by the simple image data may be displayed on the display 8 when the abnormality is detected.

  Further, the counter code detection configuration in the third embodiment may be combined with the first embodiment. Specifically, in the first embodiment, an abnormality may be detected by detecting a counter code, and a simple image represented by simple image data may be displayed on the display 8 when an abnormality is detected.

Further, both the motion detection configuration and the counter code detection configuration may be combined with the first embodiment. According to this, an abnormality can be detected more reliably.
In the above embodiment, it goes without saying that the configuration of motion detection and the configuration of counter code detection may be combined. For example, in the second embodiment or the third embodiment, both motion detection and counter code detection may be realized. A flowchart in this case is shown in FIG.

  The same applies to the fourth and fifth embodiments, and the configuration of motion detection and the configuration of counter code detection may be combined. For example, in the fourth embodiment or the fifth embodiment, both motion detection and counter code detection may be realized. A flowchart in this case is shown in FIG.

  In the fourth and fifth embodiments, the initial image data may be any image data, not image data representing an abnormality. For example, image data representing a landscape, an illustration, or the like may be used.

It is a lineblock diagram of image display system 1 for vehicles of a 1st embodiment. It is a flowchart showing the normal video process implement | achieved in the image display system 1 for vehicles of 1st Embodiment. It is a flowchart showing the simple image process implement | achieved in the image display system 1 for vehicles of 1st Embodiment. It is a flowchart showing the monitor display image | video selection process implement | achieved in the image display system 1 for vehicles of 1st Embodiment. It is a block diagram of the image display system 1 for vehicles of 2nd Embodiment. It is a flowchart showing the normal video process implement | achieved in the image display system 1 for vehicles of 2nd Embodiment. It is a block diagram of the vehicle image display system 1 of 3rd Embodiment. It is a flowchart showing the normal video process implement | achieved in the vehicle image display system 1 of 3rd Embodiment. It is a block diagram of the image display system 1 for vehicles of 4th Embodiment. It is a flowchart showing the normal video process implement | achieved in the vehicle image display system 1 of 4th Embodiment. It is a block diagram of the vehicle image display system 1 of 5th Embodiment. It is a flowchart showing the normal video process implement | achieved in the vehicle image display system 1 of 5th Embodiment. It is a flowchart showing the normal video process of a modification (the 1). It is a flowchart showing the normal video process of a modification (the 2).

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Image display system for vehicles, 2 ... Display LSI, 4 ... Camera, 6 ... Frame buffer, 6a ... Initial image data, 8 ... Display, 12 ... NTSC decoder, 14 ... Signal conversion circuit, 16 ... Downscaler, 18 ... Upscaler, 20 ... Adjustment circuit, 22 ... Composition circuit, 26 ... Synchronization detection circuit, 28 ... Line buffer, 28 ... Synchronization detection circuit 26 and line buffer, 30 ... Multiplication circuit, 32 ... Division circuit, 34 ... Division Peripheral circuit 36 ... selector 38 ... synchronization generating circuit 40 ... CPU abnormality detecting circuit 42 ... selector 44 ... switching circuit 50 ... abnormality detecting circuit 52 ... counter code adding circuit 54 ... counter code detecting circuit 56 ... Display start address change circuit.

Claims (8)

An image display system for a vehicle that displays an image photographed by a photographing device provided in the vehicle on a display device that is mounted on the vehicle and displays an image represented by input image data,
Capture means for capturing image data representing an image captured by the imaging device from the imaging device;
Storage means for storing image data captured by the capture means;
Transmission means for inputting image data stored in the storage means (hereinafter referred to as captured storage image data) to the display device;
In a vehicle image display system comprising:
Extracted image data input means for extracting predetermined data components from the image data captured by the capturing means and inputting image data composed of the extracted data components (hereinafter referred to as extracted image data) to the transmission means. When,
An abnormality detecting means for detecting a transmission abnormality of the image data captured by the capturing means,
When the abnormality is detected by the abnormality detection unit, the transmission unit inputs the extracted image data input from the extracted image data input unit to the display device instead of the captured storage image data. An image display system for a vehicle. An image display system for a vehicle that displays an image photographed by a photographing device provided in the vehicle on a display device that is mounted on the vehicle and displays an image represented by input image data,
Capture means for capturing image data representing an image captured by the imaging device from the imaging device;
Storage means for storing the image data captured by the capture means;
Transmission means for inputting the image data captured by the capture means and stored in the storage means (hereinafter referred to as capture storage image data) to the display device;
In a vehicle image display system comprising:
The image data is composed of a plurality of frames,
The storage means stores in advance image data different from the captured storage image data (hereinafter referred to as initial image data),
An abnormality detecting means for detecting an abnormality in transmission of the image data captured by the capturing means is provided. The abnormality detecting means stores the image data in the display device when the storage means stores the image data. At each time of input, a difference value between at least two frames is detected, it is determined whether or not the difference value detected in each matches, and if they do not match, it is determined as abnormal,
The transmission means is configured to input the initial image data to the display device instead of the captured storage image data when an abnormality is detected by the abnormality detection means. Image display system. The vehicle image display system according to claim 1 ,
The image data is composed of a plurality of frames,
The abnormality detecting means detects a difference value between at least two frames when the storage means stores image data and when the transmission means inputs image data to the display device. A vehicular image display system characterized by determining whether or not the detected difference values match, and determining that there is an abnormality if they do not match. The vehicle image display system according to any one of claims 1 to 3,
A counter that performs a count operation every time image data is captured by the capturing unit; and each time the image data is captured by the capturing unit, each of the captured image data includes the counter at the time of capturing And adding means for adding the count value of
The storage means stores the image data after the count value is added by the addition means,
The abnormality detection unit detects the count value added to the captured storage image data when the transmission unit inputs the captured storage image data to the display device, and the same value is continuously detected a plurality of times. An image display system for a vehicle characterized in that an abnormality is determined when detected. An image display system for a vehicle that displays an image photographed by a photographing device provided in the vehicle on a display device that is mounted on the vehicle and displays an image represented by input image data,
Capture means for capturing image data representing an image captured by the imaging device from the imaging device;
Transmission means for inputting the image data captured by the capture means (hereinafter referred to as captured image data) to the display device;
In a vehicle image display system comprising:
Extracted image data input means for extracting predetermined data components from the image data captured by the capturing means and inputting image data composed of the extracted data components (hereinafter referred to as extracted image data) to the transmission means. When,
An abnormality detecting means for detecting a transmission abnormality of the image data captured by the capturing means,
When an abnormality is detected by the abnormality detection unit, the transmission unit inputs the extracted image data input from the extracted image data input unit to the display device instead of the captured image data. An image display system for a vehicle. An image display system for a vehicle that displays an image photographed by a photographing device provided in the vehicle on a display device that is mounted on the vehicle and displays an image represented by input image data,
Capture means for capturing image data representing an image captured by the imaging device from the imaging device;
Transmission means for inputting the image data captured by the capture means (hereinafter referred to as captured image data) to the display device;
In a vehicle image display system comprising:
The image data is composed of a plurality of frames,
Storage means for storing in advance image data different from the captured image data (hereinafter referred to as initial image data);
An abnormality detecting means for detecting a transmission abnormality of the image data captured by the capturing means,
The abnormality detection means detects a difference value between at least two frames at different timings, determines whether or not the difference values detected in each match, and determines an abnormality if they do not match. ,
The transmission means is configured to input the initial image data stored in the storage means to the display device instead of the captured image data when an abnormality is detected by the abnormality detection means. The image display system for vehicles characterized. The vehicle image display system according to claim 5 ,
The image data is composed of a plurality of frames,
The abnormality detection means detects a difference value between at least two frames at different timings, determines whether or not the difference values detected in each match, and determines that there is an abnormality if they do not match An image display system for a vehicle. The vehicle image display system according to any one of claims 5 to 7,
A counter that performs a count operation every time image data is captured by the capturing unit; and each time the image data is captured by the capturing unit, each of the captured image data includes the counter at the time of capturing And adding means for adding the count value of
The abnormality detecting means detects the count value added to the captured image data from each of the captured image data after the count value is added by the adding means, and the same value is continuously repeated a plurality of times. And a vehicular image display system that determines that an abnormality is detected.

Images