JP2008305162A - Vehicle traveling support device and program - Google Patents

Vehicle traveling support device and program Download PDF

Info

Publication number
JP2008305162A
JP2008305162A JP2007151664A JP2007151664A JP2008305162A JP 2008305162 A JP2008305162 A JP 2008305162A JP 2007151664 A JP2007151664 A JP 2007151664A JP 2007151664 A JP2007151664 A JP 2007151664A JP 2008305162 A JP2008305162 A JP 2008305162A
Authority
JP
Japan
Prior art keywords
camera
lane
vehicle
image
control means
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2007151664A
Other languages
Japanese (ja)
Inventor
Takuya Nishiura
拓哉 西浦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aisin AW Co Ltd
Original Assignee
Aisin AW Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aisin AW Co Ltd filed Critical Aisin AW Co Ltd
Priority to JP2007151664A priority Critical patent/JP2008305162A/en
Publication of JP2008305162A publication Critical patent/JP2008305162A/en
Pending legal-status Critical Current

Links

Images

Abstract

<P>PROBLEM TO BE SOLVED: To decide whether a vehicle is running on a proper lane or not. <P>SOLUTION: This vehicle traveling support device has: a camera 1 photographing a scene in front of a vehicle; a camera control means 2a for taking a picture with the camera when the distance to a crossing becomes a predetermined value; an image processing means 2b recognizing a crossing traffic signal within a prescribed range above an acquisition image when a rut can be extracted from the acquisition image by the camera; display means 2c, 4 displaying the lane along the extracted rut on a windshield; and a control means 2d performing guidance according to a recognition processing result of the image processing means. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

本発明は雪道等において車線判定を行い、判定結果に応じて走行案内を行う車両走行支援装置及びプログラムに関する。   The present invention relates to a vehicle travel support apparatus and a program that perform lane determination on a snowy road or the like and perform travel guidance according to the determination result.

従来、フロントカメラの前方画像、もしくは道路地図データベースより取得した自車両の走行レーンの形状及び位置を示す車線情報をガイド線としてフロントウインドに表示するものが提案されている(特許文献1)。
特開2006−350617
2. Description of the Related Art Conventionally, there has been proposed an apparatus that displays a front image of a front camera or lane information indicating the shape and position of a traveling lane of a host vehicle acquired from a road map database as a guide line on a front window (Patent Document 1).
JP 2006-350617 A

しかし上記提案のものでは、雪道においてレーンマーカが隠れてしまった場合、道路地図データベースから取得した車線情報に基づいてガイド線を表示しているため、自分が走行しているラインが本来の車線上か否か正確に知ることができなかった。   However, in the above proposal, when the lane marker is hidden on the snowy road, the guide line is displayed based on the lane information acquired from the road map database. I could not know exactly whether or not.

本発明は上記課題を解決しようとするもので、路面の車線マーカが認識できない場合でも走行ラインが本来の車線上か否かを判定できるようにすることを目的とする。
本発明は、車両の前方を撮影するカメラと、交差点まで所定距離に接近したとき、カメラ撮影を実行させるカメラ制御手段と、前記カメラによる取得画像から轍が抽出できたとき、取得画像の上部所定範囲内において交差点信号機の認識処理を行う画像処理手段と、抽出した轍に沿った車線をフロントウインドに表示する表示手段と、前記画像処理手段の認識処理結果に応じた案内を行う制御手段とを備えたこと特徴とする。
また、本発明は、交差点まで所定距離に接近したとき、車両前方のカメラ撮影を実行するステップ、カメラによる取得画像から轍を抽出するステップ、取得画像の上部所定範囲内において交差点信号機の認識処理を行うステップ、抽出した轍に沿った車線をフロントウインドに表示するステップ、交差点信号機の認識処理結果に応じた案内を行うステップをコンピュータに実行させるプログラムを特徴とする。
An object of the present invention is to solve the above-described problems, and it is an object of the present invention to determine whether or not a travel line is on an original lane even when a lane marker on a road surface cannot be recognized.
The present invention relates to a camera for photographing the front of a vehicle, camera control means for executing camera photographing when approaching a predetermined distance to an intersection, and when a wrinkle can be extracted from an image obtained by the camera, Image processing means for recognizing the intersection traffic signal within the range, display means for displaying the lane along the extracted saddle on the front window, and control means for performing guidance according to the recognition processing result of the image processing means It is characterized by having.
The present invention also includes a step of performing camera photographing in front of the vehicle when approaching a predetermined distance to the intersection, a step of extracting wrinkles from the acquired image by the camera, and a recognition process for the intersection traffic signal within the upper predetermined range of the acquired image. And a program for causing a computer to execute a step of performing, a step of displaying a lane along the extracted saddle on a front window, and a step of performing guidance according to a recognition processing result of an intersection traffic light.

本発明は、雪道のように車線を示すマーカが隠れてしまった道路においても、轍が検出できれば走行しているラインが本来の車線上か否かを判定することが可能となる。   According to the present invention, it is possible to determine whether or not a running line is on an original lane if a hail can be detected even on a road where a lane marker is hidden such as a snowy road.

以下、本発明の実施の形態について説明する。
図1は本実施形態に係る車両走行支援装置の例を示す図、図2は車両が交差点に所定距離に接近したときの状態を上方から見た図、図3はフロントカメラで取得した車両の前方画像を示す図である。
図1において、フロントカメラ1は車のバンパー、ルームミラー等に取り付けられて、車両前方の路面の状態、交差点の信号機、案内板等の前方画像を撮影するためのもので、車両走行支援装置の装置本体2のカメラ制御手段2aによって制御され、交差点まで一定の距離に近づいたとき、前方を撮影する。すなわち、図2に示すように、車両12が交差点10に所定の距離に近づいたことを、ナビゲーション装置3(図1)のもつ位置検出システムから取得したとき、フロントカメラ1が作動して前方を撮影する。もちろん、位置検出システムを装置本体2がもつようにしてもよい。
Embodiments of the present invention will be described below.
FIG. 1 is a diagram illustrating an example of a vehicle travel support apparatus according to the present embodiment, FIG. 2 is a diagram of a state when a vehicle approaches a predetermined distance from an intersection, and FIG. 3 is a diagram of a vehicle acquired by a front camera. It is a figure which shows a front image.
In FIG. 1, a front camera 1 is attached to a car bumper, a rearview mirror, etc., and is used to photograph a front image of a road surface in front of the vehicle, a traffic light at an intersection, a guide plate, and the like. Controlled by the camera control means 2a of the apparatus main body 2, the front is photographed when approaching a certain distance to the intersection. That is, as shown in FIG. 2, when it is acquired from the position detection system of the navigation device 3 (FIG. 1) that the vehicle 12 has approached the intersection 10 by a predetermined distance, the front camera 1 operates and moves forward. Take a picture. Of course, the apparatus main body 2 may have a position detection system.

図3に示すように、カメラにより撮影した画像20には、轍13、信号機11等が含まれるが、雪道の場合は車線は撮影できない。こうして取得した前方画像を画像処理手段2bで画像処理し、まず、画像の濃淡から車両の走行跡(轍)13を抽出し、次いで、ほぼ轍13の延長方向で、画像の上部一定範囲21内に撮影されるはずの信号機11の認識処理を行う。範囲21は交差点までの距離が決まれば容易に設定できる範囲であるが、信号機11の種別や設置位置等をナビゲーション装置3のもつ信号機データから取得することで範囲21を設定してもよい。一定範囲21内に信号機11が認識できた場合、轍13は本来の車線上にあることになるので、表示処理手段2cにより、フロントウインドのディスプレイ4に轍13に沿った車線14を表示する。ディスプレイ4は、例えば、フロントウインドに貼り付けた透過型表示素子であり、また、ヘッドアップなどでもよい。なお、図3はカメラで撮影した画像であるとともに、フロントウインドに表示した画像の説明図でもある。次いで、制御手段2dにより、ドライバに対して轍13を走行車線として走行することを案内する。例えば、「表示された車線に沿って走行して下さい。」のように案内する。音声案内する場合はナビゲーション装置3のスピーカを使用してもよいし、装置本体2にスピーカを設けてもよい。   As shown in FIG. 3, the image 20 photographed by the camera includes a kite 13, a traffic light 11, and the like, but a lane cannot be photographed on a snowy road. The front image thus obtained is subjected to image processing by the image processing means 2b. First, the vehicle running trace (轍) 13 is extracted from the density of the image, and then within the upper fixed range 21 of the image in the extending direction of the kite 13. The traffic light 11 that should be photographed is recognized. The range 21 is a range that can be easily set if the distance to the intersection is determined. However, the range 21 may be set by acquiring the type, installation position, and the like of the traffic signal 11 from the traffic signal data of the navigation device 3. When the traffic light 11 can be recognized within the certain range 21, the ridge 13 is on the original lane, so the lane 14 along the ridge 13 is displayed on the display 4 of the front window by the display processing means 2c. The display 4 is, for example, a transmissive display element attached to the front window, and may be a head-up. FIG. 3 is an image taken with a camera and an explanatory diagram of an image displayed on the front window. Next, the control means 2d guides the driver to travel with the eaves 13 in the travel lane. For example, the guidance is “Please drive along the displayed lane.” When performing voice guidance, the speaker of the navigation apparatus 3 may be used, or the apparatus main body 2 may be provided with a speaker.

なお、一定範囲21内に信号機11が認識できなかった場合、抽出した轍13が本来の車線からずれている可能性がある。そこで、表示処理手段2cにより、フロントウインドのディスプレイ4に轍13に沿った車線14は表示するが、制御手段2dにより、ドライバに対して、表示された車線は本来の車線上にないことを案内する。例えば、「表示された車線は本来の車線上にありません。運転に注意して下さい。」のように案内する。このようなケースとしては、例えば、片側一車線の道路で、除雪により路側に雪が積み上げられて道路が狭くなり、実際の車線上を走行していない場合に、信号機11を画像上部の一定範囲21内に認識できないことが起こり得る。   In addition, when the traffic light 11 cannot be recognized within the certain range 21, the extracted basket 13 may be deviated from the original lane. Therefore, the display processing means 2c displays the lane 14 along the ridge 13 on the display 4 of the front window, but the control means 2d informs the driver that the displayed lane is not on the original lane. To do. For example, the guidance is as follows: “The displayed lane is not in the original lane. Be careful when driving.” As such a case, for example, when the road is narrow on one side of one lane and snow is piled up due to snow removal and the road becomes narrow, and the traffic light 11 is not traveling on the actual lane, the traffic light 11 is set within a certain range 21 at the top of the image. It can happen that it cannot be recognized within.

図4は本実施形態の走行支援処理フローを示す図である。
車両が交差点まで一定距離に近づいたか否か判断し、近づいたとき、フロントカメラの前方画像を撮影する(ステップS1、S2)。次いで、撮影した前方画像から轍が抽出できたか否か判断し(ステップS3)、他の車両がまだ通行していない雪道のような轍を抽出できない場合は本処理は終了する。撮影した画像から轍を抽出できたとき、フロントカメラの前方画像の上部一定範囲内の信号機の認識処理を行い(ステップS4)、フロントウインドのディスプレイに轍に沿った車線を表示する(ステップS5)。次いで、フロントカメラで撮影した前方画像から、信号機を認識できたか否か判断し(ステップS6)、認識できた場合は表示した車線の走行を案内し(ステップS7)、認識できなかった場合はドライバに注意を促し、表示された車線は本来の車線上にないことを案内する(ステップS8)。
FIG. 4 is a diagram showing a driving support processing flow of the present embodiment.
It is determined whether or not the vehicle has approached a certain distance to the intersection. When approaching, a front image of the front camera is taken (steps S1 and S2). Next, it is determined whether or not a kite has been extracted from the photographed front image (step S3). If a kite cannot be extracted such as a snowy road on which other vehicles have not yet passed, this processing ends. When the hail can be extracted from the captured image, the traffic signal recognition processing within the upper fixed range of the front image of the front camera is performed (step S4), and the lane along the hail is displayed on the front window display (step S5). . Next, it is determined whether or not the traffic light can be recognized from the front image photographed by the front camera (step S6). If the traffic signal can be recognized, the travel of the displayed lane is guided (step S7). Attention is given to guide that the displayed lane is not on the original lane (step S8).

本実施形態の車両走行支援装置の構成を示すブロック図である。It is a block diagram which shows the structure of the vehicle travel assistance apparatus of this embodiment. 車両が交差点に所定距離に接近したときの状態を上方から見た図である。It is the figure which looked at the state when a vehicle approached the intersection at the predetermined distance from the upper part. カメラで取得した前方画像を示す図である。It is a figure which shows the front image acquired with the camera. 本実施形態の走行支援処理フローを示す図である。It is a figure which shows the driving assistance process flow of this embodiment.

符号の説明Explanation of symbols

1…カメラ、2…装置本体、2a…カメラ制御手段、2b…画像処理手段、2c…表示処理手段、2d…制御手段、3…ナビゲーション装置、4…ディスプレイ。 DESCRIPTION OF SYMBOLS 1 ... Camera, 2 ... Apparatus main body, 2a ... Camera control means, 2b ... Image processing means, 2c ... Display processing means, 2d ... Control means, 3 ... Navigation apparatus, 4 ... Display.

Claims (4)

車両の前方を撮影するカメラと、
交差点まで所定距離に接近したとき、カメラ撮影を実行させるカメラ制御手段と、
前記カメラによる取得画像から轍が抽出できたとき、取得画像の上部所定範囲内において交差点信号機の認識処理を行う画像処理手段と、
抽出した轍に沿った車線をフロントウインドに表示する表示手段と、
前記画像処理手段の認識処理結果に応じた案内を行う制御手段と、
を備えた車両走行支援装置。
A camera that captures the front of the vehicle,
Camera control means for executing camera shooting when approaching a predetermined distance to the intersection;
When a wrinkle can be extracted from an acquired image by the camera, an image processing means for performing recognition processing of an intersection traffic signal within an upper predetermined range of the acquired image;
Display means for displaying the lane along the extracted fence on the front window;
Control means for performing guidance according to the recognition processing result of the image processing means;
A vehicle travel support device comprising:
前記制御手段は、前記認識処理において交差点信号機が認識できたとき、表示した車線に沿った走行を案内する請求項1記載の車両走行支援装置。 The vehicle travel support apparatus according to claim 1, wherein the control means guides traveling along the displayed lane when an intersection traffic signal can be recognized in the recognition processing. 前記制御手段は、前記認識処理において交差点信号機が認識できなかったとき、表示した車線が本来の車線上にないことを案内する請求項1記載の車両走行支援装置。 The vehicle travel support apparatus according to claim 1, wherein the control means guides that the displayed lane is not on the original lane when an intersection traffic signal cannot be recognized in the recognition process. 交差点まで所定距離に接近したとき、車両前方のカメラ撮影を実行するステップ、
カメラによる取得画像から轍を抽出するステップ、
取得画像の上部所定範囲内において交差点信号機の認識処理を行うステップ、
抽出した轍に沿った車線をフロントウインドに表示するステップ、
交差点信号機の認識処理結果に応じた案内を行うステップ、
をコンピュータに実行させることを特徴とするプログラム。
Performing camera photography in front of the vehicle when approaching a predetermined distance to the intersection;
Extracting cocoons from images acquired by the camera;
Performing an intersection traffic signal recognition process within an upper predetermined range of the acquired image;
Displaying the lane along the extracted fence on the front window;
Performing guidance according to the recognition processing result of the intersection traffic light,
A program that causes a computer to execute.
JP2007151664A 2007-06-07 2007-06-07 Vehicle traveling support device and program Pending JP2008305162A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2007151664A JP2008305162A (en) 2007-06-07 2007-06-07 Vehicle traveling support device and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2007151664A JP2008305162A (en) 2007-06-07 2007-06-07 Vehicle traveling support device and program

Publications (1)

Publication Number Publication Date
JP2008305162A true JP2008305162A (en) 2008-12-18

Family

ID=40233839

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2007151664A Pending JP2008305162A (en) 2007-06-07 2007-06-07 Vehicle traveling support device and program

Country Status (1)

Country Link
JP (1) JP2008305162A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016062308A (en) * 2014-09-18 2016-04-25 富士重工業株式会社 Vehicle outside environment recognition device
CN109427199A (en) * 2017-08-24 2019-03-05 北京三星通信技术研究有限公司 For assisting the method and device of the augmented reality driven

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016062308A (en) * 2014-09-18 2016-04-25 富士重工業株式会社 Vehicle outside environment recognition device
CN109427199A (en) * 2017-08-24 2019-03-05 北京三星通信技术研究有限公司 For assisting the method and device of the augmented reality driven

Similar Documents

Publication Publication Date Title
JP6566145B2 (en) Driving support device and computer program
JP5569365B2 (en) Guide device, guide method, and guide program
US8624717B2 (en) Image processor, storage medium storing an image processing program and vehicle-mounted terminal
JP6649738B2 (en) Parking lot recognition device, parking lot recognition method
KR102004062B1 (en) Method for operating a driver assistance system of a motor vehicle, driver assistance system and motor vehicle
JP2019095213A (en) Superimposed image display device and computer program
US20120277990A1 (en) Method and apparatus for determining a plausible lane for guiding a vehicle and an automobile
JP4755227B2 (en) Method for recognizing objects
KR20130109097A (en) Method for combining a road sign recognition system and lane detection system of a motor vehicle
CN105599610A (en) Road sign information display system and method
JP2009009209A (en) Image recognition device and image recognition processing method
KR102541560B1 (en) Method and apparatus for recognizing object
JP6129268B2 (en) Vehicle driving support system and driving support method
JP2009211624A (en) Driving support device, driving support method, and computer program
WO2020145302A1 (en) Driving assistance device
JP2019164611A (en) Traveling support device and computer program
JP4888285B2 (en) Driving support device, driving support method, and computer program
US11189048B2 (en) Information processing system, storing medium storing program, and information processing device controlling method for performing image processing on target region
JP6136238B2 (en) Driving support system, driving support method, and computer program
JP4968369B2 (en) In-vehicle device and vehicle recognition method
JP2006236094A (en) Obstacle recognition system
JP4687381B2 (en) Vehicle recognition method and in-vehicle device
JP2017062706A (en) Travel support system, travel support method, and computer program
JP2022006844A (en) Object detection method and object detection device
JP2008305162A (en) Vehicle traveling support device and program