JP5073207B2 - In-vehicle camera device - Google Patents

In-vehicle camera device Download PDF

Info

Publication number
JP5073207B2
JP5073207B2 JP2006007292A JP2006007292A JP5073207B2 JP 5073207 B2 JP5073207 B2 JP 5073207B2 JP 2006007292 A JP2006007292 A JP 2006007292A JP 2006007292 A JP2006007292 A JP 2006007292A JP 5073207 B2 JP5073207 B2 JP 5073207B2
Authority
JP
Japan
Prior art keywords
color
color information
detection frame
white balance
vehicle camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2006007292A
Other languages
Japanese (ja)
Other versions
JP2007189595A (en
Inventor
勝美 嶋貫
知行 倉重
治子 柴▲さき▼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Advanced Digital Inc
Original Assignee
Hitachi Advanced Digital Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Advanced Digital Inc filed Critical Hitachi Advanced Digital Inc
Priority to JP2006007292A priority Critical patent/JP5073207B2/en
Publication of JP2007189595A publication Critical patent/JP2007189595A/en
Application granted granted Critical
Publication of JP5073207B2 publication Critical patent/JP5073207B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)

Description

本発明は、自動車の周囲監視あるいは運転補助を目的として自動車に固定設置された車載カメラ装置に係り、特に、画像の一部に自動車ボディが撮像されるカメラにおいて、正確な自動色温度補正制御、所謂オートホワイトバランス制御を行うことに配慮した車載カメラ装置に関する。   The present invention relates to an in-vehicle camera device fixedly installed in an automobile for the purpose of monitoring the surroundings of the automobile or driving assistance.In particular, in a camera in which an automobile body is imaged in a part of an image, accurate automatic color temperature correction control, The present invention relates to an in-vehicle camera device that takes into account so-called auto white balance control.

汎用ビデオカメラには、動作中の連続的なフィードバック制御によって撮像の明るさを自動的に適正値に制御する自動露光制御機能と、光源色温度変化による色相の変化を自動的に補正するオートホワイトバランス制御機能が一般的に備えられている。以下において、このオートホワイトバランス制御機能の原理と基本的な動作について説明する。光の色合いは、光源に含まれる、青紫光と赤色光の相対的な強さを表す数値である色温度(単位:ケルビン)で評価される。我々の標準的な生活圏においては、白熱灯の光が最も色温度が低い(赤い)部類の光源であり、その色温度は約2000〜2500°ケルビン程度であり、逆に曇天下の太陽光が色温度の最も高い(青い)光源であり、約8000〜10000°ケルビン程度である。   General-purpose video cameras have an automatic exposure control function that automatically controls the brightness of the image to an appropriate value by continuous feedback control during operation, and auto white that automatically corrects hue changes due to light source color temperature changes. A balance control function is generally provided. The principle and basic operation of this auto white balance control function will be described below. The color of light is evaluated by a color temperature (unit: Kelvin) that is a numerical value representing the relative intensity of blue-violet light and red light included in the light source. In our standard living sphere, incandescent light is the light source with the lowest color temperature (red), the color temperature is about 2000-2500 ° Kelvin, and conversely the sunlight under cloudy sky Is the light source with the highest color temperature (blue), which is about 8000 to 10,000 degrees Kelvin.

これらの光で照らされた被写体は、被写体固有の反射率に応じた反射光を発し、この反射光がビデオカメラに入射され、ビデオカメラは入射光の色合いに応じた色再現を行うため、被写体の色が有彩色と無彩色の如何に関らず、ビデオカメラが再生する被写体の色は、被写体を照らす光源の色温度に影響を受ける。同様のことは我々の眼においても生じているが、我々の眼(あるいは脳)は、光源色温度が変化しても、物体の色が常に一定に見えるような補正を行いつつ「見る」という作業を行うため、ビデオカメラが撮影した映像が、我々にとって正常な(自然な)色合いであるように見せるためには、ビデオカメラ自身が人間の目同様の色温度補正制御を行う必要がある。   The subject illuminated with these lights emits reflected light according to the reflectance specific to the subject, and this reflected light is incident on the video camera, and the video camera performs color reproduction according to the hue of the incident light. The color of the subject reproduced by the video camera is affected by the color temperature of the light source that illuminates the subject, regardless of whether the color of the subject is chromatic or achromatic. The same thing happens in our eyes, but our eyes (or brains) say “see” while making corrections so that the color of the object always looks constant even when the light source color temperature changes. In order to perform the work, the video camera itself needs to perform color temperature correction control similar to that of the human eye in order for the video captured by the video camera to appear to be normal (natural) hues for us.

本色温度補正制御を自動的に行う機能をオートホワイトバランス制御機能といい、今日のビデオカメラにおける同機能は、基本的には撮像素子が入力した映像信号内の赤色成分と青色成分の多寡を常時判定し、その多寡を打ち消し、画面内の赤色と青色信号の総和量を一定バランスに維持させるように、信号処理回路内の赤色信号増幅器と青色信号増幅器の利得を制御するようなフィードバックループを構成することで実現されている。   The function that automatically performs this color temperature correction control is called the auto white balance control function. Basically, this function in today's video cameras always changes the amount of red and blue components in the video signal input by the image sensor. A feedback loop that controls the gain of the red signal amplifier and blue signal amplifier in the signal processing circuit is configured so that the amount of red and blue signals in the screen is maintained at a constant balance. It is realized by doing.

しかしながらビデオカメラは、極言すれば、例えば「赤い色の被写体」と、「赤い光で照らされている白い被写体」を厳格に判定することができないため、上記したような基本的制御方法だけでは、判定ミスによる、一般に「誤ひきこみ」と呼ばれる、誤った制御を行う場合がある。そのため、様々な手法でそのような誤った制御を防止して、異なる撮影シーンで安定したホワイトバランス制御を行うための手法が講じられており、これらは例えば特開2003−259189号公報などに開示されている。

特開2003−259189号公報
However, since the video camera cannot strictly determine, for example, “a subject of red color” and “a white subject illuminated by red light”, only the basic control method as described above can be used. There is a case where an erroneous control, generally referred to as “mistake-in”, is performed due to a determination error. For this reason, various methods have been used to prevent such erroneous control and to perform stable white balance control in different shooting scenes, which are disclosed in, for example, Japanese Patent Application Laid-Open No. 2003-259189. Has been.

JP 2003-259189 A

近年、カメラの高性能化、小型化、低価格化を背景に、バックモニタリングやブラインド(死角)モニタリングといった目的のために、カメラを自動車に設置することが一般的になってきた。さらに最近では、より広い視野を確保する目的から、カメラに設けるレンズを、100°以上の広角レンズとする場合が多い。しかし一方で、広角レンズを使用した場合、視野は広がるものの、撮像画枠内に自動車自身のボディがはいってくるケースも増大し、そうした場合、自動車の車体色(ボディカラー)が、オートホワイトバランスの制御結果に少なからず影響を与えてしまう。   In recent years, it has become common to install cameras in automobiles for purposes such as back monitoring and blind (blind spot) monitoring against the backdrop of higher performance, smaller size, and lower prices of cameras. Furthermore, recently, in order to secure a wider field of view, the lens provided in the camera is often a wide-angle lens of 100 ° or more. However, when a wide-angle lens is used, the field of view expands, but the number of cases where the body of the car itself gets into the image frame increases. In such cases, the car body color (body color) is set to auto white balance. It will affect the result of the control.

そのような課題に対処する有効な手段のひとつは、上記特開2003−259189号公報にあるように、撮像画枠内のなかで、自動車自身のボディの映りこむエリアを、色情報検出枠から除外するか、あるいは当該エリアの色情報の制御結果に対する重み付け(重要度)を小さくすることである。しかしながら、オートホワイトバランス制御の本質が、被写体反射光の色情報から、その被写体を照らす光源の色温度を間接的に判定することであることを考えれば、より広いエリアに写った複数種の被写体の反射光から、総合的に光源色温度を判定できるようにするほうが有利であることは明らかで、色情報検出エリアを小さくすることは、制御上好ましいことではない。   One effective means for dealing with such a problem is that, as described in Japanese Patent Application Laid-Open No. 2003-259189, the area where the body of the car is reflected in the captured image frame is determined from the color information detection frame. Either to exclude or to reduce the weight (importance) on the control result of the color information of the area. However, considering that the essence of auto white balance control is to indirectly determine the color temperature of the light source that illuminates the subject from the color information of the subject reflected light, multiple types of subjects appearing in a wider area It is clear that it is advantageous to be able to determine the light source color temperature comprehensively from the reflected light, and reducing the color information detection area is not preferable in terms of control.

以上に記載した課題解決の手段を提供するために、本発明においては、以下の手段を用いる。
(1)少なくとも2つ以上の色情報検出枠を設け、それら複数の色情報検出枠を、該自動車ボディの結像する部分と一致ないし近似する検出枠Aと、そうではない検出枠Bに分類する。
(2)カメラ内の不揮発性記憶媒体に自動車ボディ色に相当する色情報をあらかじめ記憶する。
(3)上記検出枠Aから得られた色情報と、上記あらかじめ記憶された自動車ボディ色に相当する色情報との比較結果に基づく判定結果1と、該検出枠Bから得られた色情報に基づく通常のオートホワイトバランス制御の判定結果2と、を用いて光源の色温度を判定し、当該光源の色温度に応じて赤色信号増幅率と青色信号増幅率とを決定し、オートホワイトバランス制御を行う。
In order to provide means for solving the problems described above, the following means are used in the present invention.
(1) At least two or more color information detection frames are provided, and the plurality of color information detection frames are classified into a detection frame A that matches or approximates an imaged portion of the automobile body and a detection frame B that does not. To do.
(2) Color information corresponding to the car body color is stored in advance in a nonvolatile storage medium in the camera.
(3) Determination result 1 based on the comparison result between the color information obtained from the detection frame A and the color information corresponding to the car body color stored in advance, and the color information obtained from the detection frame B Based on the normal auto white balance control determination result 2 based on the above, the color temperature of the light source is determined, the red signal amplification factor and the blue signal amplification factor are determined according to the color temperature of the light source, and auto white balance control is performed. I do.

本発明によれば、通常のホワイトバランス制御に加えて、あらかじめ記憶された自動車ボディ色に相当する色情報と、自動車ボディが結像する画像枠内の各画素からの色情報とを比較する制御を行い、その結果も制御結果に反映させるため、より精度が高く安定なホワイトバランス制御を行う車載カメラ装置を提供することができる。   According to the present invention, in addition to the normal white balance control, the color information corresponding to the car body color stored in advance is compared with the color information from each pixel in the image frame formed by the car body. Since the result is also reflected in the control result, it is possible to provide an in-vehicle camera device that performs more accurate and stable white balance control.

以下、本発明の1実施例を図1、図2、図3を用いて説明する。
図1は本発明のカメラのブロック図であり、図2はカメラの自動車への設置例と、設置例における撮像画像のイメージ図、図3は、色情報検出枠の一例を示す図である。たとえば、バックモニタリングを目的として、図2に示す位置に設置したカメラの画像には、同図の203;撮像表示画面に示すように画像下部に自動車ボディが映し出される。なお、同図において、自動車ボディが映し出される部分を歪んでいるように描いているのは、カメラレンズに広角レンズを使用した場合に、レンズ歪みによって実際にこのような撮像状態になるためである。
Hereinafter, an embodiment of the present invention will be described with reference to FIGS. 1, 2, and 3. FIG.
FIG. 1 is a block diagram of a camera according to the present invention, FIG. 2 is an example of installation of a camera in an automobile, an image diagram of a captured image in the installation example, and FIG. 3 is an example of a color information detection frame. For example, for the purpose of back monitoring, an image of a camera installed at the position shown in FIG. 2 shows a car body at the bottom of the image as shown in 203; In addition, in the same figure, the part in which the automobile body is projected is depicted as being distorted because, when a wide-angle lens is used as the camera lens, this imaging state is actually caused by lens distortion. .

もちろん、カメラの取り付け角度に留意すれば、ボディが写りこむ部分を無くすことも可能であるが、運転者が障害物と車体との距離を認知するには、画像内に車体が映し出されている部分が存在するほうが望ましく、また、車体左右の幅を充分にカバーできる画角を得るために広角レンズを使用した場合は、事実上、自動車ボディが映し出される部分を無くすことは難しい。   Of course, if the camera mounting angle is taken into account, it is possible to eliminate the part where the body is reflected, but in order for the driver to recognize the distance between the obstacle and the vehicle body, the vehicle body is shown in the image. It is desirable that there is a portion, and when a wide-angle lens is used to obtain an angle of view that can sufficiently cover the width of the left and right sides of the vehicle body, it is practically difficult to eliminate the portion where the automobile body is projected.

一方上述したように、カメラのホワイトバランスは、色情報検出枠内の映像信号の赤色成分と青色成分の多寡を判定し、赤色と青色信号の総和量を一定バランスに維持させるように赤色信号増幅器と青色信号増幅器の利得を制御するため、ボディが写りこんだエリアと、色情報検出枠とが重なっていた場合、ホワイトバランス制御は自動車ボディの色の影響を受け、たとえば同じカメラであっても、赤い自動車に実装した場合と、青い自動車に実装した場合とで、最終的なカメラ出力映像の色合いが異なってしまうといった場合も有り得る。   On the other hand, as described above, the white balance of the camera determines the amount of red and blue components of the video signal in the color information detection frame, and the red signal amplifier so as to maintain the total amount of red and blue signals in a constant balance. In order to control the gain of the blue signal amplifier, if the area where the body is reflected and the color information detection frame overlap, the white balance control is affected by the color of the car body, In some cases, the color of the final camera output video differs depending on whether it is mounted on a red car or a blue car.

そこで、本実施例においては、カメラに以下の手段を設ける。
(1)画面を、図3に示すようにA-F列、1-6行からなる36個のエリアに分割し、それぞれのエリアの色情報を個別に積算してデータ化する手段を設ける。
(2)上記36個のエリアのうち、自動車ボディが映し出されるエリアと一致、ないし自動車ボディが映し出される部分が支配的であるE列とF列のエリアから得られた色情報を、不揮発性記憶媒体にあらかじめ記憶された、自動車ボディ色を示す色情報と比較し、比較結果をホワイトバランス制御に反映させる手段を設ける。
(3)自動車ボディが映し出される部分と一致しないA列〜C列、およびD-2〜D-5から得られた色情報を、公知のホワイトバランス制御のように、エリア内の赤色信号と青色信号の多寡を判定し、判定結果をホワイトバランス制御に反映させる手段を設ける。
(4)上記(2)(3)の、2つの結果から、最終的な赤信号増幅率(ゲイン)と青信号増幅率(ゲイン)を決定し、決定結果を信号処理回路に反映させる手段を設ける。
Therefore, in this embodiment, the camera is provided with the following means.
(1) As shown in FIG. 3, the screen is divided into 36 areas consisting of AF columns and 1-6 rows, and color information for each area is individually integrated and converted into data.
(2) Of the above 36 areas, non-volatile storage of color information obtained from the E and F row areas that match the area where the car body is projected or where the car body is projected Means is provided for comparing with the color information indicating the automobile body color stored in advance in the medium and reflecting the comparison result in the white balance control.
(3) The color information obtained from the columns A to C and D-2 to D-5 that do not match the portion where the car body is projected is used for the red signal and the blue color in the area as in the known white balance control. Means are provided for determining the number of signals and reflecting the determination result in white balance control.
(4) A means for determining a final red signal amplification factor (gain) and a blue signal amplification factor (gain) from the two results (2) and (3) and reflecting the determination result in the signal processing circuit is provided. .

以下、図1を用いて、実際のカメラ構成に従って本実施例の説明を行う。
撮像素子101から出力された映像信号は、信号増幅器及びAD変換器102を介して、信号処理LSI 111に入力される。信号処理LSIでは、映像信号を輝度信号と色信号に分離し、分離された色信号は、色信号増幅器114を介して、信号合成器及び変調器116において、多くの場合、色差信号に加工された後に再び輝度信号と合成されてビデオ出力端子117に出力される。
Hereinafter, the present embodiment will be described according to an actual camera configuration with reference to FIG.
The video signal output from the image sensor 101 is input to the signal processing LSI 111 via the signal amplifier and AD converter 102. In the signal processing LSI, the video signal is separated into a luminance signal and a color signal, and the separated color signal is often processed into a color difference signal by the signal synthesizer and modulator 116 via the color signal amplifier 114. After that, it is again combined with the luminance signal and output to the video output terminal 117.

ここで、色信号増幅器114の出力信号であるR(赤)信号、B(青)信号は、それぞれ分枝されて、検波回路115に入力される。同検波回路115では、図3に示す36個のエリアそれぞれの位置におけるR(赤)信号、B(青)信号の総和値データを、マイクロプロセッサ(マイコン)121に出力する。同マイクロプロセッサ(マイコン)121では、まず検出枠の画面内位置による分類処理122を行い、本例では、E列とF列のエリアのデータは記憶情報との比較処理ブロック123に送り、A列〜C列、およびD-2〜D-5エリアのデータは、R・B信号の多寡判定処理ブロック124に送る。記憶情報との比較処理ブロック123では、入力された各エリアの色情報が、不揮発性記憶媒体127に記憶された車体色情報128と比較され、比較結果が算出される。R・B信号の多寡判定ブロック124では、公知のホワイトバランス制御のように、エリア内の赤色信号青色信号の多寡が算出される。それぞれの算出結果は、光源色温度判定処理ブロック125に送られ、色信号利得決定処理126を介して、色信号増幅器114に利得設定値として帰還される。   Here, the R (red) signal and the B (blue) signal that are output signals of the color signal amplifier 114 are branched and input to the detection circuit 115. The detection circuit 115 outputs the sum value data of the R (red) signal and B (blue) signal at the positions of the 36 areas shown in FIG. 3 to the microprocessor (microcomputer) 121. The microprocessor (microcomputer) 121 first performs a classification process 122 based on the position of the detection frame in the screen. In this example, the data in the areas of the E column and the F column are sent to the comparison processing block 123 with the stored information, and the A column The data in the .about.C column and the areas D-2 to D-5 are sent to the R / B signal number determination processing block 124. FIG. In the comparison processing block 123 with the stored information, the input color information of each area is compared with the vehicle body color information 128 stored in the nonvolatile storage medium 127, and a comparison result is calculated. In the R / B signal number determination block 124, the number of red signals and blue signals in the area is calculated as in the known white balance control. Each calculation result is sent to the light source color temperature determination processing block 125, and is fed back to the color signal amplifier 114 as a gain setting value via the color signal gain determination processing 126.

上記本実施例によれば、通常公知のホワイトバランス制御に加えて、あらかじめ記憶された自動車ボディ色に相当する色情報と、自動車ボディが結像する画像枠内の各画素からの色情報とを比較する制御を行い、その結果も制御結果に反映させるため、より精度が高く安定なホワイトバランス制御を行う車載カメラ装置を提供することができる。
なお、本実施例においては、通常ホワイトバランス制御とはあまり重要な関係のない色信号である緑(G)信号については記述を割愛したが、同信号を制御に反映させる場合も同様の構成で実現可能である。
According to the present embodiment, in addition to the generally known white balance control, the color information corresponding to the car body color stored in advance and the color information from each pixel in the image frame formed by the car body are obtained. Since the comparison control is performed and the result is also reflected in the control result, it is possible to provide an in-vehicle camera device that performs more accurate and stable white balance control.
In this embodiment, the description of the green (G) signal, which is a color signal that is not so important to the normal white balance control, is omitted, but the same configuration is used when the signal is reflected in the control. It is feasible.

図4を用いて、本発明の別の実施例について説明する。
本実施例は、基本的には上記実施例1の改良例であって、一般的に車体色に光沢色が使用される場合が多いため、光源が車体に反射して、ホワイトバランス制御に悪影響を与える場合のあることに配慮したものである。図4に示すようにE-1、およびE-2エリアに光源からの直接反射光が存在した場合、当該部分の色情報(赤信号と青信号のバランス)が、通常とかけはなれたものとなるため、誤判定により、ホワイトバランス制御に悪影響を与える場合がある。
Another embodiment of the present invention will be described with reference to FIG.
The present embodiment is basically an improved example of the first embodiment, and generally a glossy color is often used as the vehicle body color. Therefore, the light source is reflected on the vehicle body and adversely affects white balance control. It is intended to give some. As shown in FIG. 4, when there is direct reflected light from the light source in the areas E-1 and E-2, the color information (the balance between the red signal and the blue signal) of the part is different from the normal one. Therefore, white balance control may be adversely affected due to erroneous determination.

そのため、本実施例では、上記直接反射光の影響を受けるエリアを制御対象から除外して、全体の制御に悪影響を与えないようにするため、図1の記憶情報との比較処理ブロック123において、閾値を設定し、ブロックに入力された色情報が、不揮発性記憶媒体127に記憶された車体色情報128に対して、上記閾値以上の差異を有する場合は、制御対象から除外して、全体の制御に影響を与えないようにする。   Therefore, in the present embodiment, in order to exclude the area affected by the directly reflected light from the control target so as not to adversely affect the overall control, in the comparison processing block 123 with the stored information in FIG. When the threshold value is set and the color information input to the block has a difference equal to or greater than the threshold value with respect to the vehicle body color information 128 stored in the nonvolatile storage medium 127, it is excluded from the control target and Do not affect the control.

なお本方式では、上記直接反射光部分面積が小さい場合には充分な対応ができないが、これには、本例では36個のエリアに分割した色情報検出エリア数を増大させれば対応できることは自明であり、さらに同様の処理を、図1の検波回路115内に設け、同回路に車体色情報128、および閾値を設定するとともに、輝度情報も入力させ、ハードウェア的に処理しても同様の効果を達成可能である。本実施例によれば、車体に映りこむ光源の直接反射光の影響を減じて、より精度が高く安定なホワイトバランス制御を行う車載カメラ装置を提供することができる。   In this method, it is not possible to adequately cope with the case where the directly reflected light partial area is small, but in this example, this can be accommodated by increasing the number of color information detection areas divided into 36 areas. It is self-evident, and the same processing is provided in the detection circuit 115 in FIG. 1, and the body color information 128 and the threshold value are set in the same circuit, and luminance information is also input, and the same processing is performed by hardware. The effect can be achieved. According to the present embodiment, it is possible to provide an in-vehicle camera device that performs highly accurate and stable white balance control by reducing the influence of the directly reflected light of the light source reflected on the vehicle body.

本発明の一実施例に係るカメラのブロック図。1 is a block diagram of a camera according to an embodiment of the present invention. 本発明の一実施例に係るカメラの自動車への設置例および表示画面例。2 shows an example of installation of a camera according to an embodiment of the present invention in an automobile and an example of a display screen. 本発明の一実施例に係る色情報検出枠例。4 is a color information detection frame example according to an embodiment of the present invention. 本発明の一実施例に係る色情報検出枠例。4 is a color information detection frame example according to an embodiment of the present invention.

符号の説明Explanation of symbols

101…撮像素子
102…信号増幅器及びAD変換器
111…信号処理LSI
112…輝度信号処理回路
113…色分離処理回路
114…色信号増幅器
115…検波回路
116…信号合成器及び変調器

117…ビデオ出力端子
121…マイクロプロセッサ(マイコン)
122…検出枠の画面内位置による分類処理
123…記憶情報との比較
124…R・B信号の多寡判定
125…光源色温度判定
126…色信号利得決定
127…不揮発性記憶媒体
128…車体色情報
DESCRIPTION OF SYMBOLS 101 ... Imaging device 102 ... Signal amplifier and AD converter 111 ... Signal processing LSI
DESCRIPTION OF SYMBOLS 112 ... Luminance signal processing circuit 113 ... Color separation processing circuit 114 ... Color signal amplifier 115 ... Detection circuit 116 ... Signal synthesizer and modulator

117 ... Video output terminal 121 ... Microprocessor (microcomputer)
122: Classification processing based on position of detection frame in screen 123: Comparison with stored information 124: Determination of multiple R / B signals 125 ... Light source color temperature determination 126 ... Color signal gain determination 127 ... Non-volatile storage medium 128 ... Body color information

Claims (2)

自動車の周囲監視あるいは運転補助を目的として自動車に固定設置された車載カメラ装置であり、該車載カメラ装置には、撮像素子に結像した画像枠内の一定枠を色情報検出枠とし、該色情報検出枠内から得られる色情報から、自動的に色温度補正を行う所謂オートホワイトバランス制御機能が具備され、かつ該撮像素子に結像した画像枠内の一部に自動車の躯体、所謂ボディが結像する自動車の位置に設置された車載カメラ装置において、少なくとも2つ以上の色情報検出枠を設け、それら複数の色情報検出枠を、該自動車ボディの結像する部分と一致ないし近似する検出枠Aと、そうではない検出枠Bに分類する手段と、自動車ボディ色に相当する色情報をあらかじめ記憶する手段とを設け、該検出枠Aから得られた色情報と該あらかじめ記憶された自動車ボディ色に相当する色情報との比較結果に基づく判定結果1と、該検出枠Bから得られた色情報に基づく通常のオートホワイトバランス制御の判定結果2と、を用いて光源の色温度を判定し、当該光源の色温度に応じて赤色信号増幅率と青色信号増幅率とを決定し、オートホワイトバランス制御を行うことを特徴とした車載カメラ装置。 An in-vehicle camera apparatus fixedly installed in an automobile for the purpose of monitoring the surroundings of the automobile or driving assistance. The in-vehicle camera apparatus uses a certain frame in an image frame formed on an image sensor as a color information detection frame, and the color A so-called auto white balance control function that automatically corrects the color temperature from color information obtained from the information detection frame is provided, and an automobile casing, so-called body, is partially formed in the image frame formed on the image sensor. In the in-vehicle camera device installed at the position of the vehicle on which the image is formed, at least two or more color information detection frames are provided, and the plurality of color information detection frames coincide with or approximate to the image forming portion of the vehicle body. Means for classifying into detection frame A, detection frame B that is not so, and means for storing color information corresponding to the car body color in advance, color information obtained from detection frame A and the pre-stored The determination result 1 based on the comparison result with the color information corresponding to the automobile body color and the determination result 2 of the normal auto white balance control based on the color information obtained from the detection frame B are used. An in-vehicle camera device that determines a color temperature, determines a red signal amplification factor and a blue signal amplification factor according to the color temperature of the light source, and performs auto white balance control. 上記請求項1の車載カメラ装置であって、該検出枠A内の各エリアの色情報が前記あらかじめ記憶された自動車ボディ色に相当する色情報に対して所定の閾値以上の差異を有する場合、当該差異を有するエリアから得られた色情報を、オートホワイトバランス制御の判定対象から除外することを特徴とした車載カメラ装置。 The in-vehicle camera device according to claim 1, wherein the color information of each area in the detection frame A has a difference equal to or greater than a predetermined threshold with respect to the color information corresponding to the car body color stored in advance. An in-vehicle camera device, wherein color information obtained from an area having the difference is excluded from a determination target of auto white balance control.
JP2006007292A 2006-01-16 2006-01-16 In-vehicle camera device Expired - Fee Related JP5073207B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2006007292A JP5073207B2 (en) 2006-01-16 2006-01-16 In-vehicle camera device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2006007292A JP5073207B2 (en) 2006-01-16 2006-01-16 In-vehicle camera device

Publications (2)

Publication Number Publication Date
JP2007189595A JP2007189595A (en) 2007-07-26
JP5073207B2 true JP5073207B2 (en) 2012-11-14

Family

ID=38344447

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2006007292A Expired - Fee Related JP5073207B2 (en) 2006-01-16 2006-01-16 In-vehicle camera device

Country Status (1)

Country Link
JP (1) JP5073207B2 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5716944B2 (en) * 2009-06-25 2015-05-13 アイシン精機株式会社 In-vehicle camera device
DE102012007982A1 (en) 2012-04-20 2013-10-24 Connaught Electronics Ltd. Method for white balance of an image taking into account the color of the motor vehicle
JP6536032B2 (en) * 2014-12-24 2019-07-03 株式会社富士通ゼネラル In-vehicle camera
JP6413830B2 (en) * 2015-02-24 2018-10-31 株式会社富士通ゼネラル Car camera
JP2019169788A (en) * 2018-03-22 2019-10-03 カルソニックカンセイ株式会社 Image display device

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0546242A (en) * 1991-08-09 1993-02-26 Toshiba Corp White line detecting device
JPH0686314A (en) * 1992-08-31 1994-03-25 A W New Hard:Kk White balance correcting device
JPH10257518A (en) * 1997-03-07 1998-09-25 Fuji Photo Film Co Ltd Automatic image pickup device and automatic image pickup method
JP4499200B2 (en) * 1998-02-26 2010-07-07 ソニー株式会社 Color signal processing circuit, processing method therefor, and camera system
JP4649734B2 (en) * 2000-12-08 2011-03-16 株式会社ニコン Video signal processing apparatus and recording medium on which video signal processing program is recorded
JP2003057358A (en) * 2001-08-13 2003-02-26 Honda Motor Co Ltd Product discrimination device and product discrimination method
JP2004276165A (en) * 2003-03-14 2004-10-07 Sony Corp Robot apparatus and image signal processing method in robot apparatus
JP2005079776A (en) * 2003-08-29 2005-03-24 Fuji Photo Film Co Ltd Image generation apparatus, image generation method and program
JP3839429B2 (en) * 2003-09-29 2006-11-01 三菱電機株式会社 Imaging processing device
JP4159965B2 (en) * 2003-10-14 2008-10-01 シャープ株式会社 Image processing device

Also Published As

Publication number Publication date
JP2007189595A (en) 2007-07-26

Similar Documents

Publication Publication Date Title
US20170330053A1 (en) Color night vision system and operation method thereof
US9088737B2 (en) Method and device for visualizing the surroundings of a vehicle by fusing an infrared image and a visual image
EP2471691B1 (en) Obstacle detection device, obstacle detection system provided therewith, and obstacle detection method
US20070009245A1 (en) Imaging apparatus and imaging method
JP4611899B2 (en) Camera lens dirt detection device and image display system
JP3747909B2 (en) Pixel defect detection correction apparatus and pixel defect detection correction method
US20160105656A1 (en) White balance method in multi-exposure imaging system
US8373769B2 (en) Imaging apparatus, imaging processing method and recording medium
WO2014129319A1 (en) Imaging device
JP6029954B2 (en) Imaging device
JP2009171122A (en) Optical source color temperature estimation method, white balance adjustment apparatus, and image recognition apparatus
JP5073207B2 (en) In-vehicle camera device
US10110828B2 (en) Photographing apparatus and method for controlling photographing apparatus
CN105453532A (en) Imaging device, imaging method, and on-board imaging system
US20200154083A1 (en) Image processing device, image processing method, program, and imaging device
JP2016226059A (en) Image processing device, imaging apparatus, and image processing method
US20210160432A1 (en) Image processing device
JP2021114762A (en) Low-light imaging system
US11094037B2 (en) Semiconductor device, image processing system, image processing method and computer readable storage medium
US20230188859A1 (en) Image capturing apparatus
US11805326B2 (en) Image processing apparatus, control method thereof, and storage medium
JP2020101624A (en) Imaging apparatus, electronic apparatus, and control method and program of imaging apparatus
US20200389607A1 (en) Image processing apparatus and method, and imaging apparatus
US20210407058A1 (en) Image processing device, imaging system, moving body, image processing method and storage medium
US20230291880A1 (en) Image processing apparatus

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20081218

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20090106

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20090106

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20101022

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20101102

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20101224

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20110920

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20111117

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20120807

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20120822

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20150831

Year of fee payment: 3

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

LAPS Cancellation because of no payment of annual fees