JPS61135842A - Substance recognition system for a car - Google Patents

Substance recognition system for a car

Info

Publication number
JPS61135842A
JPS61135842A JP59256519A JP25651984A JPS61135842A JP S61135842 A JPS61135842 A JP S61135842A JP 59256519 A JP59256519 A JP 59256519A JP 25651984 A JP25651984 A JP 25651984A JP S61135842 A JPS61135842 A JP S61135842A
Authority
JP
Japan
Prior art keywords
distance
vehicle
recognition
substance
sampling points
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP59256519A
Other languages
Japanese (ja)
Inventor
Norimasa Kishi
則政 岸
Kazunori Noso
千典 農宗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nissan Motor Co Ltd
Original Assignee
Nissan Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nissan Motor Co Ltd filed Critical Nissan Motor Co Ltd
Priority to JP59256519A priority Critical patent/JPS61135842A/en
Publication of JPS61135842A publication Critical patent/JPS61135842A/en
Pending legal-status Critical Current

Links

Landscapes

  • Navigation (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

PURPOSE:To enable an accurate distance recognition to a substance from a car, by changing substance recognition area according to the running condition such as the car speed and the steering angle. CONSTITUTION:A forward distance equal to the safety interval distance responding to a car speed, read by the speed sensor 1 is a focusing distance. Here, focus distance is calculated comparing the forward substance recognition distance and the focusing distance. Then zooming regulation is carried out to seek for the focus distance TV cameras 4 and 5 have decided to get sampling points. The distance between the sampling points is decided according to the substance between the sampling points is decided according to the substance recognition distance. Moreover, when turning a curve, the zooming is carried out to expand the field of view according to the steering angle. The data of interval between the sampling points is delivered to the delaying circuit 10 through a microcomputer 3. Thus, substance recognition in a given extent around the center of the forward recognition point is being possible.

Description

【発明の詳細な説明】 (イ)産業上の利用分野 本発明は車両の走行状態が変化しても車両周辺の物体の
認識が適確にできるようにした車両用物体認識装置に関
する。
DETAILED DESCRIPTION OF THE INVENTION (A) Field of Industrial Application The present invention relates to an object recognition device for a vehicle that can accurately recognize objects around a vehicle even when the running condition of the vehicle changes.

(ロ)従来技術 最近車両の前方や周辺の状況を認識し判断しながら走二
lテする無人車が考えられている。
(b) Prior Art Recently, unmanned vehicles that drive around while recognizing and making judgments about the situation in front of and around the vehicle are being considered.

従来のこの種の自動車では前方の車両や障害物を認識す
るのく上下に配置した2台のテレビカメラを用い、映像
の明暗変化点を利用し且つカメラの光軸の交差する位置
にある物体の映像だけが2台のテレビカメラの映像面を
比較すると重な)合うことを利用している(たとえば特
公昭−48−2979号)。
Conventional cars of this type use two television cameras placed above and below to recognize vehicles and obstacles in front, and use the points where the brightness and darkness of the image changes to detect objects located at the intersection of the optical axes of the cameras. It takes advantage of the fact that only the images of the two television cameras overlap when the image planes of the two television cameras are compared (for example, Japanese Patent Publication No. 48-2979).

このような物体認識装置を搭載すれば緩やかなカーブや
低速での走行時に前方や後方の車両あるいは障害物を認
識することができ、運転者や自動操縦にとって部会がよ
いが、固定焦点カメラを用いているためにたとえば高速
走行時のように比較的遠くを見ようとすると2台のテレ
ビカメラによる画像間の差異が少さくなって、ノイズ等
の影響も受けやすくこのため障害物検知ができない。
If such an object recognition device is installed, it will be possible to recognize vehicles or obstacles in front or behind when driving on gentle curves or at low speeds, which is good for drivers and autopilots, but it is better to use a fixed-focus camera. Therefore, when trying to see a relatively far distance, such as when driving at high speed, the difference between the images taken by the two television cameras becomes small, making it susceptible to noise and the like, making it impossible to detect obstacles.

(ハ)発明の目的および構成 本発明は上記の点にかんがみてなされたもので、車両周
辺の物体の認識が適確にできるようにすることを目的と
し、この目的を達成するために、車速や操舵角などの走
行状態に基づいて認識領域を変更するよ、うに構成した
(c) Object and structure of the invention The present invention has been made in view of the above points, and aims to enable accurate recognition of objects around a vehicle. The recognition area is configured to change based on driving conditions such as steering angle and steering angle.

第1図は本発明による車両用物体認識装置の全体構成を
示しておシ、車速センサや操舵角センサによシ車両の走
行状態を検出し、検出した走行状態に基づいて車両から
物体認識位置までの距離を認識領域制御手段で演算し、
その演算した距離に基づいて物体の認識領域を変更する
ように構成した。
FIG. 1 shows the overall configuration of an object recognition device for a vehicle according to the present invention, which detects the running state of the vehicle using a vehicle speed sensor and a steering angle sensor, and locates the object recognition position from the vehicle based on the detected running state. The recognition area control means calculates the distance to
The object recognition area is changed based on the calculated distance.

に)実施例 以下本発明を図面に基づいて説明する。) Example The present invention will be explained below based on the drawings.

第2図は本発明による車両用物体認識装置の一実施例の
ブロック線図でちゃ、1は車両の速度を検出する車速セ
ンサ、2は車両の操舵角を検出する操舵角センサ、3は
CPU 、メモリなどで構成さλLだマイクロコンピュ
ータ、4および5は電動のズーム機構およびピント機構
を備えたテレビカメラ、6.7はテレビカメラ4.5か
ら出力する映像信号を微分する微分回路、8.9は微分
回路6.7の出力を波形整形する波形整形回路、10は
一方の微分出カケ他方の微分出力よシ可変量だけ遅延す
る遅延回路、11は遅延された微分出力と遅延されない
微分出力との論理積をとるM山口路、12はテレビカメ
ラ4.5で写した路上物体の映像を監視するモニタテレ
ビである。
FIG. 2 is a block diagram of an embodiment of the vehicle object recognition device according to the present invention, in which 1 is a vehicle speed sensor that detects the speed of the vehicle, 2 is a steering angle sensor that detects the steering angle of the vehicle, and 3 is a CPU. , a λL microcomputer consisting of memory, etc.; 4 and 5 a television camera equipped with an electric zoom mechanism and a focusing mechanism; 6.7 a differentiation circuit for differentiating the video signal output from the television camera 4.5; 8. 9 is a waveform shaping circuit that shapes the output of the differentiating circuits 6 and 7; 10 is a delay circuit that delays one differential output by a variable amount than the other differential output; 11 is a delayed differential output and an undelayed differential output. 12 is a monitor television that monitors images of objects on the road captured by a television camera 4.5.

上記物体認識装置の物体認識の基本動作は本発明の要旨
ではないし、前述した特公昭48−2979号に詳述さ
れているので略述する。
The basic operation of object recognition by the object recognition apparatus described above is not the gist of the present invention and is described in detail in the aforementioned Japanese Patent Publication No. 48-2979, so a brief description thereof will be provided.

2台のテレビカメラ4.5により3次元の対象空間を1
次元の時間関数としての映像信号として取シ出し、微分
回路6.7で微分してパルス列信号とする。パルス列信
号は明暗が激しく変化する場所に対応している。これら
系列のパルス列信号を波形整形回路8.9で波形整形し
た後その一方を遅延回路10である時間だけ遅延させて
AND回路11に入れ論理積をとると、その出力は遅延
量に相当する前方距離Xのところに高さ方向に分布して
いる明暗変化点に対応する。遅延回路10での遅延量を
任意に変えれば、その遅延量に相当する距離のところの
簡さ方向の明暗点変化が抽出でき、これはと)もなおさ
ずその位置に立体物が存在することを意味する。もし路
上に立体物が存在しなければ高さ方向の明暗点変化はな
いのでMΦ回路11の出力は1個のパルスのみになる。
A three-dimensional target space is captured by two TV cameras 4.5
A video signal as a dimensional time function is extracted and differentiated by a differentiating circuit 6.7 to obtain a pulse train signal. The pulse train signal corresponds to a place where brightness changes drastically. After shaping the waveforms of these series of pulse train signals in the waveform shaping circuit 8.9, one of them is delayed by a certain amount of time in the delay circuit 10, and then inputted into the AND circuit 11 to perform the logical product. This corresponds to brightness change points distributed in the height direction at a distance X. By arbitrarily changing the amount of delay in the delay circuit 10, it is possible to extract changes in light and dark spots in the direction of the distance at a distance corresponding to the amount of delay, which also indicates that a three-dimensional object exists at that position. means. If there is no three-dimensional object on the road, there will be no change in bright and dark spots in the height direction, so the output of the MΦ circuit 11 will be only one pulse.

次に本発明に係る動作を第3図のフローチャートによシ
説明する。
Next, the operation according to the present invention will be explained with reference to the flowchart of FIG.

物体をg識するに当って初期設定するとともに物体認識
距離X(7’tとえば120 m )を設定する(F−
1)。次に車速センサ1によシ車速V。
When g-identifying an object, initial settings are made and the object recognition distance X (for example, 120 m) is set (F-
1). Next, the vehicle speed V is determined by the vehicle speed sensor 1.

を、そして操舵角センサ2によシ操舵角θを読み込む(
F−2)。車速に対する安全車間距離は第4図のような
関係にあるので、読み込んだ車速v1に対する安全車間
距離lを求める。この安全車間距離に相当する前方距離
がピント距離Pになる(F−3)。ここで車両前方の物
体認識距離とピント距#pとを比較しくF−4)、P 
) xならばXをPとしくF−5)、P≦XならばPを
そのまま用いて次の式に従って焦点距離fを演算する(
F−6)。
and read the steering angle θ by the steering angle sensor 2 (
F-2). Since the safe inter-vehicle distance with respect to vehicle speed has a relationship as shown in FIG. 4, the safe inter-vehicle distance l with respect to the read vehicle speed v1 is determined. The distance ahead corresponding to this safe inter-vehicle distance becomes the focus distance P (F-3). Here, compare the object recognition distance in front of the vehicle and the focus distance #p.
) If x, set X to P and calculate the focal length f using the following formula (F-5); if P≦X, use P as is (
F-6).

f=」旦−3θ ll ここでdはレンズの画角、WHは認識位置での撮影幅、
θは操舵角、aは定数である。この式かられかるように
、操舵角θが大きくなると焦点距離fが小さくなる。
f=”tan-3θ ll where d is the angle of view of the lens, WH is the shooting width at the recognition position,
θ is a steering angle, and a is a constant. As can be seen from this equation, as the steering angle θ increases, the focal length f decreases.

テレビカメラ4.5の焦点距離がこうして求めた焦点距
離fになるようにズーム調整を行ない、サンプリング点
を決定する(F−7)。サンプリング点間隔は物体認識
距離Xに応じて決定される。たとえば (1)認識したい位t1tまでの距離Xが50m未満の
とき ここでX = 10 mを例にして説明すると、第5図
に示すようにL1= 5 mからり、5= 20 mま
での間を1m間隔で16の帯状領域に分けて認識する。
The zoom is adjusted so that the focal length of the television camera 4.5 becomes the focal length f thus determined, and the sampling point is determined (F-7). The sampling point interval is determined according to the object recognition distance X. For example, (1) When the distance X to the point t1t that you want to recognize is less than 50 m. Taking X = 10 m as an example, as shown in Figure 5, from L1 = 5 m to 5 = 20 m, The area is recognized by dividing it into 16 band-shaped areas at intervals of 1 m.

図中Gはガードレールを示し、白い部分は視野外を表わ
している。
In the figure, G indicates a guardrail, and the white part indicates the outside of the field of view.

以上を式で示せば (ただし、nは画面上の分割数)。If we express the above in a formula, (However, n is the number of divisions on the screen.)

(2)認識したい位置までの距離Xが50m以上のとき ここでX = 50 mを例にして説明すると、第6図
に示すようにり、=25mからり1. = 100 m
までのWlを、L、= 25 mからLa” 50 m
 ’Jでの認識する。
(2) When the distance X to the position you want to recognize is 50 m or more. Taking X = 50 m as an example, as shown in Fig. 6, from = 25 m, 1. = 100 m
From Wl to L, = 25 m to La” 50 m
'Recognize in J.

以上を式で示せば(nを画面上の分割数で表わす) 五 Li=Li−1+□ ただしくi>−)旦      
2 となシ、帯状領域の幅はそれぞれ また、カーブ時は操舵角θに応じて、視野が広くなるよ
うにズーミングを行なう。
Expressing the above as a formula (n is expressed as the number of divisions on the screen), 5 Li = Li - 1 + □ where i > -)
2. Also, the width of the band-shaped area is adjusted according to the steering angle θ when making a curve, and zooming is performed to widen the field of view.

このようなサンプリング点間隔のデータLiはマイクロ
コンピュータ3から遅延回路10に送られ、波形整形回
路8の出力はこのliに応じた遅延時間だけ遅延される
。こうして車両前方の認識位置を中心とする所定範囲内
の領域の内の物体の認識が可能になる(F−8)。
Data Li having such a sampling point interval is sent from the microcomputer 3 to the delay circuit 10, and the output of the waveform shaping circuit 8 is delayed by a delay time corresponding to this li. In this way, it becomes possible to recognize objects within a predetermined range centered on the recognition position in front of the vehicle (F-8).

認識領域の画像はモニタテレビ12に映し出され(F−
9)、車両から物体までの距離が計算される(F−10
)。
The image of the recognition area is displayed on the monitor television 12 (F-
9), the distance from the vehicle to the object is calculated (F-10
).

こうして求められた物体までの距離情報を新たなピント
距離Pとして焦点距離fを計算し直し、物体の認識を行
なう構成にすれば常に適確な認識ができるようになる。
If the distance information to the object obtained in this manner is used as a new focal length P to recalculate the focal length f and the object is recognized, accurate recognition will always be possible.

(ホ)発明の詳細 な説明したように、本発明は、車両に装設した撮像手段
によシ撮像した車両周辺の映像情報から車両周辺の物体
を認識する車両用物体認識装置において、車速や操舵角
などの走行状態に基づいて認識領域を変更するように構
成したので、高速走行時やコーナリング走行時に前方車
両やガードレールまたは交通標識などの道路付設物など
の物体を正確に認識できそれまでの距離を適葎に知るこ
とができ、安全運動上好ましい。
(E) Detailed Description of the Invention As described above, the present invention provides an object recognition device for a vehicle that recognizes objects around the vehicle from video information around the vehicle captured by an imaging means installed in the vehicle. Since the recognition area is configured to change based on driving conditions such as the steering angle, it is possible to accurately recognize objects such as vehicles in front and road fixtures such as guardrails or traffic signs when driving at high speeds or when cornering. It is possible to accurately determine the distance, which is preferable for safety reasons.

【図面の簡単な説明】[Brief explanation of drawings]

第1図は本発明による車両用物体認識装置の全体構成図
、第2図は本発明による車両用物体認識装置の一実施例
のブロック線図、第3図は本発明による認識領域の変更
制御動作を示すフローチャート、第4図は車両の車速と
安全車間距離との関係を示す特性図、第5図および第6
図は本発明による画像認識領域の2つの異なる例である
。 1・・・車速センサ、2・・・操舵角センサ、3・・・
マイクロコンピュータ、4.5・・・テレビカメラ、6
.7・・・微分回路、8.9・・・波形整形回路、10
・・・遅延回路、11・・・瓜回路 第1@ 第4図 車速 W 第21!I 第311
FIG. 1 is an overall configuration diagram of a vehicle object recognition device according to the present invention, FIG. 2 is a block diagram of an embodiment of a vehicle object recognition device according to the present invention, and FIG. 3 is a recognition area change control according to the present invention. Flowchart showing the operation, Figure 4 is a characteristic diagram showing the relationship between vehicle speed and safe inter-vehicle distance, Figures 5 and 6 are
The figures are two different examples of image recognition areas according to the invention. 1...Vehicle speed sensor, 2...Steering angle sensor, 3...
Microcomputer, 4.5...TV camera, 6
.. 7... Differential circuit, 8.9... Waveform shaping circuit, 10
...Delay circuit, 11... Melon circuit No. 1 @ Figure 4 Vehicle speed W No. 21! I No. 311

Claims (1)

【特許請求の範囲】[Claims]  車両に装設した撮像手段により撮像した車両周辺の映
像情報から車両周辺の物体を認識する車両用物体認識装
置において、車両の走行状態を検出する検出手段と、該
検出手段により検出された走行状態に基づいて認識領域
を変更する認識領域制御手段とを設けたことを特徴とす
る車両用物体認識装置。
A vehicle object recognition device that recognizes objects around a vehicle from video information around the vehicle captured by an imaging means installed in the vehicle includes a detection means for detecting a running state of the vehicle, and a running state detected by the detection means. 1. A vehicle object recognition device, comprising: a recognition area control means for changing a recognition area based on.
JP59256519A 1984-12-06 1984-12-06 Substance recognition system for a car Pending JPS61135842A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP59256519A JPS61135842A (en) 1984-12-06 1984-12-06 Substance recognition system for a car

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP59256519A JPS61135842A (en) 1984-12-06 1984-12-06 Substance recognition system for a car

Publications (1)

Publication Number Publication Date
JPS61135842A true JPS61135842A (en) 1986-06-23

Family

ID=17293751

Family Applications (1)

Application Number Title Priority Date Filing Date
JP59256519A Pending JPS61135842A (en) 1984-12-06 1984-12-06 Substance recognition system for a car

Country Status (1)

Country Link
JP (1) JPS61135842A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02147446A (en) * 1988-11-30 1990-06-06 Hitachi Ltd Car-mounted image displaying device
JPH0858470A (en) * 1994-08-24 1996-03-05 Alpine Electron Inc Rear view confirmation device
JP2003186075A (en) * 2001-12-20 2003-07-03 Omron Corp On-vehicle image reader
JP2006285422A (en) * 2005-03-31 2006-10-19 Denso It Laboratory Inc Scene-estimating device, scene-image extracting method, and sound-reproducing apparatus
JP2009009209A (en) * 2007-06-26 2009-01-15 Nippon Soken Inc Image recognition device and image recognition processing method
JP2009169776A (en) * 2008-01-18 2009-07-30 Hitachi Ltd Detector
US7995095B2 (en) 2001-10-18 2011-08-09 Autoliv Development Ab Night vision device for a vehicle
JP2011193631A (en) * 2010-03-15 2011-09-29 Mitsubishi Fuso Truck & Bus Corp Notification device of motor-driven vehicle
US8471911B2 (en) 2000-10-26 2013-06-25 Autoliv Development Ab Night vision arrangement
US20160131633A1 (en) * 2014-11-06 2016-05-12 Moba Mobile Automation Ag Device and method for determining the temperature of a road building material applied by a construction machine, and construction machine comprising such a device

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02147446A (en) * 1988-11-30 1990-06-06 Hitachi Ltd Car-mounted image displaying device
JPH0858470A (en) * 1994-08-24 1996-03-05 Alpine Electron Inc Rear view confirmation device
US8471911B2 (en) 2000-10-26 2013-06-25 Autoliv Development Ab Night vision arrangement
US7995095B2 (en) 2001-10-18 2011-08-09 Autoliv Development Ab Night vision device for a vehicle
US8228379B2 (en) 2001-10-18 2012-07-24 Autoliv Development Ab Night vision device for a vehicle
JP2003186075A (en) * 2001-12-20 2003-07-03 Omron Corp On-vehicle image reader
JP2006285422A (en) * 2005-03-31 2006-10-19 Denso It Laboratory Inc Scene-estimating device, scene-image extracting method, and sound-reproducing apparatus
JP4634842B2 (en) * 2005-03-31 2011-02-16 株式会社デンソーアイティーラボラトリ Landscape estimation device
JP2009009209A (en) * 2007-06-26 2009-01-15 Nippon Soken Inc Image recognition device and image recognition processing method
JP2009169776A (en) * 2008-01-18 2009-07-30 Hitachi Ltd Detector
JP2011193631A (en) * 2010-03-15 2011-09-29 Mitsubishi Fuso Truck & Bus Corp Notification device of motor-driven vehicle
US20160131633A1 (en) * 2014-11-06 2016-05-12 Moba Mobile Automation Ag Device and method for determining the temperature of a road building material applied by a construction machine, and construction machine comprising such a device
US10473637B2 (en) * 2014-11-06 2019-11-12 Moba-Mobile Automation Ag Device and method for determining the temperature of a road building material applied by a construction machine, and construction machine comprising such a device

Similar Documents

Publication Publication Date Title
US6812831B2 (en) Vehicle surroundings monitoring apparatus
CN100472322C (en) Front image taking device
KR100250323B1 (en) Image processing device and method
JP3452268B2 (en) Rear side monitoring method for vehicles
EP2383713B1 (en) Detecting and recognizing traffic signs
EP2950521B1 (en) Camera capable of reducing motion blur in a low luminance environment and vehicle including the same
US5530771A (en) Image tracking device and image tracking method
US10798319B2 (en) Camera device and method for capturing a surrounding region of a vehicle in a situation-adapted manner
EP1895766B1 (en) Camera with two or more angles of view
KR101999993B1 (en) Automatic traffic enforcement system using radar and camera
US20100123395A1 (en) Headlamp control device for vehicle
KR20090092602A (en) System of Traffic Regulation Using Image Fusion
JPS62131837A (en) Recognition device for driven vehicle
JPS61135842A (en) Substance recognition system for a car
EP3888977A1 (en) Image processing device, imaging device, moving body and image processing method
JPH1114346A (en) Vehicular obstacle detecting device
JP3464368B2 (en) Rear side monitoring device for vehicles
US7057502B2 (en) Vehicle drive assist apparatus
JPH0552562A (en) Vehicular gap detector for tracking advance vehicle
JPH04193641A (en) Obstacle detection device for vehicle
JPH06281456A (en) Obstacle detecting device
JPH11185194A (en) Vehicle detector
KR100507062B1 (en) Lane Departure Warning System
KR20160092403A (en) Driver assistance apparatus and Control Method Thereof
JPH0755451Y2 (en) Inter-vehicle distance detector