EP3030459A1 - Système de visualisation, véhicule et méthode d'exploitation d'un système de visualisation - Google Patents

Système de visualisation, véhicule et méthode d'exploitation d'un système de visualisation

Info

Publication number
EP3030459A1
EP3030459A1 EP13794963.2A EP13794963A EP3030459A1 EP 3030459 A1 EP3030459 A1 EP 3030459A1 EP 13794963 A EP13794963 A EP 13794963A EP 3030459 A1 EP3030459 A1 EP 3030459A1
Authority
EP
European Patent Office
Prior art keywords
vehicle
visualization system
vision device
display
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP13794963.2A
Other languages
German (de)
English (en)
Inventor
Felix Schroeder
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Audi AG
Original Assignee
Audi AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi AG filed Critical Audi AG
Publication of EP3030459A1 publication Critical patent/EP3030459A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • B60R2001/1215—Mirror assemblies combined with other articles, e.g. clocks with information displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/202—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used displaying a blind spot scene on the vehicle part responsible for the blind spot
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/804—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for lane monitoring

Definitions

  • the invention relates to a visualization system for a vehicle, which comprises at least one vision device.
  • the vision device is configured to show at least a section of the vehicle's surroundings.
  • a sensor of the visualization system is configured to detect at least one object in the section of the vehicle's surroundings.
  • the visualization system also comprises means for visualizing the at least one object in the at least one vision device.
  • the invention further relates to a vehicle with such a visualization system and to a method for operating a visualization system for a vehicle.
  • Document US 2013/0063598 A1 describes a rear-view mirror for a vehicle, in which an image capture unit is integrated. Images captured by the image capture unit can be displayed on an image display apparatus which is arranged on a mirror surface of the rear-view mirror.
  • the image display apparatus can be a liquid crystal display or a light emitting diode screen.
  • US 2010/0271190 A1 describes a mirror which is installed at a road.
  • the mirror includes a camera and an indicating module.
  • signs or messages can be displayed by the indicating module such as a request to slow down.
  • WO 2007/018145 A1 describes a pavement marking recognition system which is configured to determine whether a pavement marking is worn or in good condition.
  • This object is solved by a visualization system having the features of claim 1 , a vehicle having the features of claim 9 and a method having the features of claim 10.
  • the visualization system comprises a positioning device which is configured to determine a position at least of a part of a driver's head within the vehicle relative to the at least one vision device.
  • a control unit of the visualization system is configured to operate the visualizing means in order to visualize the at least one object in an orientation which takes into account this position.
  • the control unit thus assures that the object detected in the vehicle's surroundings by the sensor is shown in the vision device at the correct position. This is based on the finding that by doing so the object can be visualized in the vision device in a way which helps the driver in correctly localizing the object in the vehicle's surroundings.
  • the visualization system is thus configured to visualize the object in a first orientation if the driver's head is in a first position relative to the vision device and in a second orientation if the driver's head is in a second position relative to the vision device.
  • differences in drivers' sizes or postures can be taken into account when visualizing the object in the vision device. It is for example taken into account if the driver's head is further away or closer to a steering wheel or a headrest of the driver's seat. Therefore if the driver's head moves within the vehicle, the means for visualizing change the orientation of the object shown in the vision device accordingly. As this helps the driver in realizing objects in the vehicle's surroundings, road safety is increased by the visualization system.
  • the positioning device comprises a unit which is configured to determine a position of at least one eye of the driver. This further enhances accuracy when showing the object in the correct orientation.
  • a unit for example an eye tracking device such as a camera, is readily available, reliable and can be easily implemented in the visualization system.
  • the positioning device comprises a unit configured to determine an inclination about a horizontal axis and/or about a vertical axis of the at least one vision device.
  • varying the inclination of the vision device causes the control unit to operate the means for visualizing in a way which takes into account the change in the inclination of the vision device. This renders the visualization system particularly flexible and precise.
  • the means for visualizing the at least one object can be configured to highlight the at least one object with respect to other elements shown in the at least one vision device. Then the driver can in a particularly easy way distinguish the object from the other elements and thus consider the object while driving.
  • the highlighting can be achieved by enhancing a luminosity of the object or of a contour line of the object displayed in the vision device. Alternatively or additionally the object or its contours can be broadened, or a striking colour can be utilized to visualize the object or the object's contours. Such highlighting measures to an improved visual perception of the object by the driver looking at the vision device.
  • the means for visualizing are configured to highlight road surface markings such as lane markings in the at least one vision device. Especially on roads with multiple lanes it is difficult to distinguish on which lanes surrounding cars drive. This is in particular true when driving by night or when the sight is limited by fog or the like. Thus visualizing highlighted lane markings enhances road safety when driving on roads with multiple lanes.
  • the at least one vision device can be designed as a vehicle mirror with a reflective element.
  • the means for visualizing the object is designed as a display arranged within the vehicle mirror. Especially when the driver looks at the vehicle mirror the position of the driver's head has an influence on the orientation in which the object should be visualized in order to show it at the exact position.
  • the visualization system is provided, if it comprises the vehicle mirror.
  • the at least one vehicle mirror is designed as a rear-view mirror and/or as a side-view mirror.
  • the visualization of objects in the correct orientation within the rear-view mirror or the side-view mirror is particularly helpful. For example it can then be easily distinguished by the driver whether another vehicle in the surroundings is about to overtake or just following the vehicle having the visualization system. This helps the driver in keeping a clear overview of the traffic situation.
  • the display can be designed as a liquid crystal display (LCD) and/or as a thin-film transistor (TFT) display covered by the reflective element, wherein the reflective element is transmissive for an optical signal generated by the display.
  • LCD liquid crystal display
  • TFT thin-film transistor
  • the at least one vision device is designed as a display configured to display an image captured by a camera and showing at least the section of the vehicle's surroundings.
  • the display is further configured to overlay the image with at least one element representing the at least one object.
  • Such a display is convenient in showing the vehicles surroundings and the object in the correct orientation in a particularly easy way. Further, if the display is utilized instead of a vehicle mirror located outside a passenger cabin of the vehicle the aerodynamic properties of the vehicle can be improved.
  • the vehicle according to the invention has a visualization system according to the invention. With such a vehicle improved road safety is achieved.
  • At least one vision device shows at least a section of the vehicle's surroundings. At least one object in the section of the vehicle's surroundings is detected by a sensor. The at least one object is visualized in the at least one vision device. The position at least of a part of a driver's head within the vehicle relative to the at least one vision device is determined by a positioning device. The at least one object is visualized in the vision device in an orientation taking into account this position.
  • Fig. 1 components of a visualization system for a vehicle, wherein the visualization system is configured to show lane markings in a vehicle mirror in an orientation which takes into account the position of the driver's eyes relative to the vehicle mirror;
  • Fig. 2 a side-view mirror on a passenger's side of the vehicle with lane markings shown in the side-view mirror;
  • Fig. 3 a side-view mirror on a driver's side of the vehicle with lane markings shown in the side-view mirror.
  • Fig. 1 shows components of a visualization system 10 for a vehicle.
  • the visualization system 10 includes an optical sensor such as a camera 12 which captures an image of a road portion.
  • the camera 12 includes an object recognition unit which is configured to detect objects, in particular lane markings 14 in the captured image.
  • the visualization system 10 also comprises a positioning device 16 with a first unit 18 which is configured to determine a position 20 of the eyes of a driver within the vehicle.
  • This first unit 18 may be an eye tracker which provides the position 20 of the driver's eyes.
  • the positioning device 16 further comprises a second unit 22 which is configured to determine a position 24 and an inclination of a vehicle mirror such as a side-view mirror 26 (see Fig. 2).
  • the information regarding the lane markings 14, the position 20 of the driver's eyes and the position 24 of the mirror are processed in a control unit 28 of the visualization system 10.
  • the control unit 28 controls a display 30 which is configured to visualize the lane markings 14 in the side-view mirror 26.
  • the control unit 28 takes into consideration the position 24 and the inclination of the side-view mirror 26 about a horizontal axis, i.e. about a lateral direction of the vehicle and the inclination about a vertical axis of the side-view mirror 26.
  • the control unit 28 also takes into consideration the position 20 of the driver's eyes within the vehicle. Thus the position 20 of the driver's eyes relative to the side-view mirror 26 is determined. With this information and the information on the lane markings 14 themselves the control unit 28 is able to operate the display 30 in such a way that the lane markings 14 are shown in an orientation on the side-view mirror 26 which take into account this relative position.
  • Fig. 2 shows the side-view mirror 26 on the passenger's side of the vehicle.
  • the side-view mirror 26 comprises a casing 32 and a reflective layer 34.
  • the reflective layer 34 is transmissive, i.e. semi-permeable for optical signals generated by the display 30.
  • the display 30 is arranged behind the reflective layer 34, and it may be configured as a LCD-screen and/or a TFT-screen.
  • the size of the display 30 preferably is substantially equal to the size of the reflective layer 34. Especially when driving on a road with multiple lanes it is important for the driver to know on which lane the surrounding cars drive.
  • the driver can assess whether a car 36 in the surroundings of the vehicle (see Fig. 2) is overtaking or just following. As this is particularly difficult when driving by night or with limited sight, displaying the lane markings 14 on the side-view mirror 26 helps the driver to distinguish on which lanes the surrounding cars 36 seen in the side-view mirror 26 actually drive.
  • the lane markings 14 are highlighted in the side-view mirror 26 this provides better orientation to the driver.
  • the lane markings 14 are displayed in the side-view mirror 26 in the correct orientation and at the right position as the control unit 28 takes into account the position 20 of the driver's eyes and the position 24 and inclination of the side-view mirror 26.
  • Fig. 3 shows another side-view mirror 38 which is located on the driver's side of the vehicle.
  • This side-view mirror 38 also comprises the casing 32 and the reflective layer 34 which is transmissive for the optical signals generated by the display 30.
  • the display 30 accordingly shows the lane markings 14 detected by the camera 12 in an orientation which takes into account the position 20 of the driver's eyes relative to the side-view mirror 38 on the driver's side of the vehicle.
  • the lane markings 14 or such additional overlaid information displayed in the side-view mirror 26, 38 are highlighted with respect to other elements visible on the reflective layer 34 of the side-view mirror 26, 38. Thus even in conditions with limited sight the lane markings 14 are clearly visible for the driver looking at each one of the side-view mirrors 26, 38.
  • the display 30 can be activated automatically for example depending on the visibility conditions in the surroundings of the vehicle. Also the display 30 showing the lane markings 14 at the correct position and in the correct orientation on the side-view mirror 26, 38 can be activated on demand. For example the driver can issue a corresponding command which makes the control unit 28 operate the display 30 accordingly.
  • Showing the lane markings 14 in the correct orientation by operating the display 30 can also be done in a rear-view mirror (not shown) of the vehicle. Accordingly in such a vehicle mirror the orientation of the lane markings 14 displayed by the display 30 change if the position 20 of the driver's eyes relative to the rear-view mirror or such a vehicle mirror changes.
  • the reflective layer 34 of the vehicle mirror such as the side-view mirrors 26, 38 by a screen which shows the image captured by the camera 12.
  • the lane markings 14 can be displayed at the right position and in the correct orientation as the control unit 28 takes into account the position 20 of the driver's eyes relative to the vehicle mirror.
  • the information comprising the position 20 of the driver's eyes, the position 24 and the inclination of the vehicle mirror and the position of the lane markings 14 in the image captured by the camera 12 itself is processed by the control unit 28. It is also possible that the object recognition unit which detects objects in the images captured by the camera 12 is integrated in the control unit 28. The control unit 28 then operates the display 30 based on this information, and the lane markings 14 are shown in vehicle mirrors such us the side-view mirrors 26, 38 in the exact position and orientation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

L'invention concerne un système de visualisation pour un véhicule comprenant au moins un dispositif de vision (38) qui est configuré pour présenter au moins une section des alentours du véhicule. Un capteur est configuré pour détecter au moins un objet (14) dans la section des alentours du véhicule. Le système de visualisation comprend de plus un dispositif de positionnement configuré pour déterminer une position d'au moins une partie de la tête du conducteur dans le véhicule par rapport audit dispositif de vision (38). Une unité de commande du système de visualisation est configurée pour faire fonctionner un moyen de visualisation afin de visualiser ledit objet (14) dans une orientation prenant en compte cette position. L'invention concerne de plus un véhicule avec un tel système de visualisation et une méthode d'exploitation d'un système de visualisation.
EP13794963.2A 2013-08-07 2013-08-07 Système de visualisation, véhicule et méthode d'exploitation d'un système de visualisation Withdrawn EP3030459A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2013/001855 WO2015019122A1 (fr) 2013-08-07 2013-08-07 Système de visualisation, véhicule et méthode d'exploitation d'un système de visualisation

Publications (1)

Publication Number Publication Date
EP3030459A1 true EP3030459A1 (fr) 2016-06-15

Family

ID=49626984

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13794963.2A Withdrawn EP3030459A1 (fr) 2013-08-07 2013-08-07 Système de visualisation, véhicule et méthode d'exploitation d'un système de visualisation

Country Status (3)

Country Link
EP (1) EP3030459A1 (fr)
CN (1) CN105658479B (fr)
WO (1) WO2015019122A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2019224114A1 (en) 2018-02-23 2020-09-10 Finch Therapeutics Holdings Llc Microbiome related immunotherapies
CN108437899B (zh) * 2018-03-22 2020-07-31 京东方科技集团股份有限公司 一种交通工具后视镜及其控制方法和系统
US10748303B2 (en) * 2018-10-03 2020-08-18 Gentex Corporation Rear facing lane detection overlay

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2660262A1 (fr) * 1990-04-02 1991-10-04 Renault Systeme d'eclairage et de visualisation pour vehicules.
JP3773433B2 (ja) * 2000-10-11 2006-05-10 シャープ株式会社 移動体の周囲監視装置
DE10340496A1 (de) * 2003-09-03 2005-03-31 Daimlerchrysler Ag Visualisierung des toten Winkels hinter einer A-Säule eines Fahrzeugs
JP2005191962A (ja) * 2003-12-25 2005-07-14 Sharp Corp 移動体周囲監視装置および移動体
JP4820712B2 (ja) 2005-08-05 2011-11-24 アイシン・エィ・ダブリュ株式会社 路面標示認識システム
JP4497133B2 (ja) * 2006-07-12 2010-07-07 アイシン・エィ・ダブリュ株式会社 運転支援方法及び運転支援装置
US8058977B2 (en) 2006-10-24 2011-11-15 Donnelly Corporation Exterior mirror having a display that can be viewed by a host driver or drivers of other vehicles
JP4412365B2 (ja) * 2007-03-26 2010-02-10 アイシン・エィ・ダブリュ株式会社 運転支援方法及び運転支援装置
EP2168815B1 (fr) * 2008-09-24 2014-06-04 Robert Bosch GmbH Procédé et dispositif pour détecter les objets éventuellement collidant dans une zone d'angle mort
CN101872547B (zh) 2009-04-24 2014-01-15 鸿富锦精密工业（深圳）有限公司 道路指示反射镜
US20110310001A1 (en) * 2010-06-16 2011-12-22 Visteon Global Technologies, Inc Display reconfiguration based on face/eye tracking
CN102887114B (zh) * 2011-07-18 2015-02-04 宏腾光电股份有限公司 车用显示镜及其制作方法
TWM424268U (en) 2011-09-13 2012-03-11 Sysgration Ltd Rear view mirror
DE102011113640A1 (de) 2011-09-16 2013-03-21 Daimler Ag Kraftfahrzeug und Verfahren zur Anzeige von Navigationsanweisungen in einem Kraftfahrzeug
CN202986966U (zh) * 2013-01-09 2013-06-12 无锡安睿驰科技有限公司 适合多种车辆的实景环视行车辅助系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2015019122A1 *

Also Published As

Publication number Publication date
CN105658479B (zh) 2018-08-31
WO2015019122A1 (fr) 2015-02-12
CN105658479A (zh) 2016-06-08

Similar Documents

Publication Publication Date Title
CN107791949B (zh) 车载摄像头的hud集成集群系统
US8810381B2 (en) Vehicular heads up display with integrated bi-modal high brightness collision warning system
US9443429B2 (en) Optimum gaze location on full windscreen display
KR101478135B1 (ko) 프로젝션 유닛을 이용한 증강현실 차선변경 보조 시스템
CN106143306B (zh) 一种车辆环境显示系统
JP5114550B2 (ja) 車道経過を表示する方法
US20130093579A1 (en) Driver assistance system
US20170043720A1 (en) Camera system for displaying an area exterior to a vehicle
CN108791062B (zh) 动态信息系统及操作方法
US9836656B2 (en) Device for the expanded representation of a surrounding region of a vehicle
CN113165510B (zh) 显示控制装置、方法和计算机程序
CN113448096B (zh) 车辆用显示装置
WO2015019122A1 (fr) Système de visualisation, véhicule et méthode d'exploitation d'un système de visualisation
US10051242B2 (en) Visual positioning with direction orientation navigation system
CN110871770A (zh) 具有可视化功能的挡风玻璃刮水器设备、操作方法和车辆
CN110626267A (zh) 用于后视镜显示器的叠加界面
EP3888966B1 (fr) Afficheur de véhicule
JP2017040773A (ja) 頭部装着型表示装置
CN110300992B (zh) 夜间道路导航辅助装置
CN111332317A (zh) 一种基于增强现实技术的行车提醒方法、系统和装置
TWM482526U (zh) 行車監控裝置
JP2017224067A (ja) わき見状態判定装置
JP2023142127A (ja) 表示装置、表示方法、およびプログラム
CN114609785A (zh) 一种增强现实车载抬头显示系统
WO2021018660A1 (fr) Procédé et système d'aide à la conduite pour fournir des informations visuelles concernant un premier véhicule dans un environnement d'un second véhicule, programme informatique et support lisible par ordinateur

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20160307

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20160928