EP2316003A1 - Appareil de navigation mobile et procédé associé - Google Patents

Appareil de navigation mobile et procédé associé

Info

Publication number
EP2316003A1
EP2316003A1 EP09780926A EP09780926A EP2316003A1 EP 2316003 A1 EP2316003 A1 EP 2316003A1 EP 09780926 A EP09780926 A EP 09780926A EP 09780926 A EP09780926 A EP 09780926A EP 2316003 A1 EP2316003 A1 EP 2316003A1
Authority
EP
European Patent Office
Prior art keywords
camera
navigation device
vehicle
mobile navigation
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP09780926A
Other languages
German (de)
English (en)
Inventor
Achim Rafalczik
Anes Hodzic
Rainer Garnitz
Wolfgang Niehsen
Mathias Garrelts
Jochen Wingbermuehle
Thomas Wiechers
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Publication of EP2316003A1 publication Critical patent/EP2316003A1/fr
Ceased legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/29Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area inside the vehicle, e.g. for viewing passengers or cargo
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/207Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using multi-purpose displays, e.g. camera image and navigation or video on same display

Definitions

  • the present invention relates to a mobile navigation device according to the preamble of claim 1 and to a related method according to the preamble of claim 6.
  • Mobile navigation devices have gained increasing acceptance in recent years because such devices also provide pedestrian navigation functionality based on conventional vehicle navigation based on G [lobal] positioning [ystem] data, gyro data and / or map data GPS signals directs the user to the desired destination.
  • the mobile navigation devices available today are characterized by a graphic or linguistic output function for map data, which can be loaded onto the navigation device by means of different storage media.
  • mobile navigation devices can be equipped with additional, non-navigation-relevant functionalities, for example with an MP3 player.
  • no purely mobile navigation device except P ersonal D [igital] A [ssitant] s or so-called SmartPhones) is equipped with an image recording unit or camera (unit).
  • modern vehicles contain a multitude of different assistance functions, for example relating to Adaptive Cruise Control (ACC) and / or Lane Departure Warning (LDW), which assist the driver when driving and in warn safety-critical situations.
  • ACC Adaptive Cruise Control
  • LW Lane Departure Warning
  • Such systems are capable of detecting a critical situation and sending a warning to the driver with the aid of the appropriate display systems, be it visually, acoustically and / or haptically.
  • a [pplication] S [pecific] l [inte- grated] C [ircuit] video processor has a camera module and a control unit.
  • the camera module is mounted in the center of the windscreen (below the rearview mirror) and the control unit can be placed on the dashboard or in a clamp mount.
  • the image processing module and the display unit are formed by a microcomputer, in particular by a mobile telephone or by a palmtop or by a personal digital assistant (PDA).
  • a microcomputer in particular by a mobile telephone or by a palmtop or by a personal digital assistant (PDA).
  • PDA personal digital assistant
  • the integration of the image processing module in the vehicle interior ensures that this image processing module is not exposed to strong temperature fluctuations or extreme temperatures. Because the image processing module and the image processing device display are formed by the processor module and the display of the microcomputer, the requirements for the e-mechanical stability and the longevity of this known system can be considerably reduced.
  • the present invention seeks to further develop a mobile navigation device of the type mentioned in the technical field and a method of the type mentioned in the technical field so that additional driver and / or pedestrian functionalities can be realized.
  • the object of the present invention is achieved by a mobile navigation device having the features specified in claim 1 and by a method having the features specified in claim 6.
  • Advantageous embodiments and expedient developments of the present invention are characterized in the respective subclaims.
  • the present invention is based on the equipment or equipment of a mobile navigation device with at least one image acquisition unit or with at least one camera (unit), that is, on the implementation of at least one image acquisition unit or at least one camera in a mobile navigation device.
  • the equipment or equipment of a mobile navigation device with at least one image acquisition unit or with at least one camera allows additional functionality.
  • Camera allows recording of pedestrian routes that are directly can be stored and / or can be passed as route guidance to acquaintances, and saves the cumbersome take away of additional recording devices, such as digital cameras.
  • the present invention uses in its various forms
  • the components already present in a mobile navigation device such as processor or computer, display or display unit and optionally image acquisition unit or camera, are used to provide additional customer-value, in particular driver assistance, functions in addition to today's customary applications realize.
  • a mobile navigation device such as processor or computer, display or display unit and optionally image acquisition unit or camera
  • the present invention relates to the use of at least one mobile navigation device according to the type set out above and / or a method according to the above-mentioned kind for video-based driver assistance functions and / or for video-based pedestrian assistance functions.
  • Fig. 1 is a schematic representation of an embodiment of a mobile navigation device according to the present invention, which operates according to the method according to the present invention.
  • At least one camera module 30 is connected to the mobile navigation device 10 illustrated by way of example in FIG. 1 via at least one image processing module 20, wherein the camera module 30 can be implemented or integrated in the mobile navigation device 10 or, as described in connection with FIG. 1
  • Fig. 1 illustrates, wired or wirelessly connected to the mobile navigation device 10 may be.
  • the image taken by at least one such camera 30 is transmitted to the (optional) image processing module 20, wherein the image processing module 20 may be integrated in the mobile navigation device 10 or, as illustrated with reference to FIG. 1, be implemented separately may or may be integrated in the camera module 30, whether in a realization as hardware and / or in a realization as software, for example in the form of an image processing software as a component of at least one software kernel or software kernel.
  • the image transmitted to the image processing module 20 is processed there and, after one or more such processing steps, either completely or partially, be it unchanged or modified, displayed by the mobile navigation device 10, be it on the display 12 of the mobile navigation device 10 itself or on an external display 12 connected to the mobile navigation device 10.
  • This display documents that the information gained in image processing can be used for driver assistance, for example in form
  • the image is not displayed, but merely a situation-dependent generated by an image processing warning and / or message from the mobile navigation device 10 further processed and / or stored and / or output.
  • the present invention thus offers the advantage that additional driver assistance functionalities can be realized with the camera 30.
  • the camera 30 When the camera 30 is not used by other applications, for example when the mobile navigation device 10 is connected to the vehicle infrastructure, the camera 30 may be used to monitor the traffic situation.
  • the recorded video sequences or digital photos are processed with the image processing software 20, for example, to measure the distance to preceding vehicles or to detect an exit from the selected lane.
  • the driver can be warned by different warning mechanisms against a dangerous situation in a timely manner, which contributes to accident prevention.
  • the image taken by the camera 30 can be any image taken by the camera 30. Furthermore, the image taken by the camera 30 can be any image taken by the camera 30.
  • a / ideosequenzen be used as a basis for further navigation applications (for example, so-called Videonavi) in which direction arrows of the route guidance can be projected directly into the image sequence.
  • the present invention thus offers the possibility of optimally utilizing the existing resources, for example camera 30 and computing power of mobile navigation device 10, and to realize additional driver assistance functionalities.
  • the mobile navigation device 10 has either an internal camera or wired or by radio transmission, ie wirelessly to at least one external Camera 30 is connected (see Fig. 1).
  • the camera 30 monitors this
  • the images of the inwardly directed to the driver camera 30 are analyzed with methods of digital image processing such that due to the eyelid activity, the line of sight and / or posture conclusions on the attention and / or fatigue of the driver can be. If the driver shows signs of fatigue or if the driver is inattentive in critical situations, a warning is issued from the mobile navigation device 10.
  • Camera 30 displayed in the display area or on the display 12 of the mobile navigation device 10.
  • a system similar to video telephony is used to facilitate communication between the driver and the passenger and the passengers in the rear. nation partners without the driver or front passenger having to turn backwards.
  • the faces of the passengers are detected by the camera 30.
  • the image display is carried out on the display 12 of the mobile device 10.
  • a return channel from the driver or the passenger to the passenger / passengers can be realized if the rear seats are equipped with display units or with displays.
  • Rear view camera 30 displayed on the display 12 of the mobile navigation device 10.
  • guides or other symbols or numbers may optionally be displayed to assist the driver in parking the vehicle and / or maneuvering the vehicle.
  • This auxiliary information can be obtained from the images of the camera 30 using methods of automatic and / or digital image processing 20.
  • guide lines or other symbols or numbers may optionally be displayed to assist the driver in driving through narrow gates or performing similar maneuvers.
  • This auxiliary information can be obtained from the images of the camera (s) 30 using methods of automatic and / or digital image processing 20.
  • the images of one or more cameras 30 become the laterally rearward or laterally rearward surroundings of the vehicle monitor, displayed on the display 12 of the mobile navigation device 10.
  • the images of one or more cameras 30 become the laterally rearward or laterally rearward surroundings of the vehicle monitor, displayed on the display 12 of the mobile navigation device 10.
  • lane departure warning in the vicinity of a vehicle, lane markings to the left of the vehicle and / or to the right of the vehicle are observed by one or more suitably positioned cameras 30. Inattentive driving over the lines, a warning via the mobile navigation device 10.
  • One possible character class to be recognized here are speed limits and their cancellation. If such characters are automatically detected, then this information compared to a stored map is much more current and can be used to warn the driver, for example, when exceeding the currently permitted maximum speed.
  • a display of the recognized character also has a memory function, that is, the driver can check whether he has passed during an inattentive phase at a corresponding sign over.
  • Another possible character class are the triangular danger signs, such as deer, rockfall and the like. If these characters are recognized, then a corresponding indication can be output via the mobile navigation device 10. Furthermore, it is also possible here to display the recognized and / or detected characters only in order to realize a reminder function.
  • the driver of the mobile navigation device 10 is warned against a collision against the direction of travel (so-called "ghost driver").
  • the navigation instructions can be used in more advanced
  • Systems can also be displayed partially transparent or overlapping in the live image. This can be done in particular taking into account the perspective of the image, so that, for example, the impression arises that a directional arrow is located directly on the roadway in front of the vehicle.
  • the directional arrows are statically adapted to a medium perspective. Allow later expansion stages - by methods of automatic and / or digital image processing
  • an image processed by means of image processing can be used in addition to the unmodified image of the camera 30.
  • a treatment can be used in particular at night in order to draw the attention of the driver to certain image areas and / or the visibility of objects in front of the vehicle. to improve. It is also possible here to switch from daytime image to nighttime image, which is analogous to switching between daytime display and nighttime display of the map.
  • a location of interest point of interest
  • a video recording to document the correct path from the perspective of the driver can be recorded and optionally provided to other (subsequent) drivers.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Mechanical Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Navigation (AREA)

Abstract

L'invention concerne un appareil de navigation (10) mobile et un procédé pour conférer au moins une fonctionnalité supplémentaire concernant la navigation et/ou au moins une fonction supplémentaire d'aide à la conduite à un appareil de navigation (10) mobile de ce type, de manière à pouvoir réaliser des fonctionnalités supplémentaires concernant le pilote et/ou les piétons. A cet effet, au moins une unité de prise de vue ou caméra (30) associée, en particulier intégrée, est proposée.
EP09780926A 2008-08-18 2009-07-22 Appareil de navigation mobile et procédé associé Ceased EP2316003A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102008041295A DE102008041295A1 (de) 2008-08-18 2008-08-18 Mobiles Navigationsgerät und diesbezügliches Verfahren
PCT/EP2009/059425 WO2010020512A1 (fr) 2008-08-18 2009-07-22 Appareil de navigation mobile et procédé associé

Publications (1)

Publication Number Publication Date
EP2316003A1 true EP2316003A1 (fr) 2011-05-04

Family

ID=41171039

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09780926A Ceased EP2316003A1 (fr) 2008-08-18 2009-07-22 Appareil de navigation mobile et procédé associé

Country Status (3)

Country Link
EP (1) EP2316003A1 (fr)
DE (1) DE102008041295A1 (fr)
WO (1) WO2010020512A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011078264B4 (de) * 2011-06-29 2021-09-16 Bayerische Motoren Werke Aktiengesellschaft Kommunikationssystem und Verfahren
FR2978097B1 (fr) * 2011-07-22 2014-11-28 Peugeot Citroen Automobiles Sa Systeme d'aide pour fournir des images de synthese a un conducteur de vehicule, a moyens de traitement et/ou moyens d'affichage deportes dans un terminal
DE102013203653A1 (de) * 2013-03-04 2014-09-04 Bayerische Motoren Werke Aktiengesellschaft Außenbildeinblendung für Center Display
DE102013011827A1 (de) 2013-07-15 2015-01-15 Audi Ag Verfahren zum Betrieb einer Navigationseinrichtung, Navigationseinrichtung und Kraftfahrzeug
DE102014119323B4 (de) * 2014-12-22 2022-06-09 Connaught Electronics Ltd. Verfahren zum Erzeugen einer personenspezifischen Information eines Fahrzeuginsassen, Einrichtung und Kraftfahrzeug
DE102016220947A1 (de) 2016-10-25 2018-06-28 Ford Global Technologies, Llc Fahrerassistenzsystem
DE102019128010A1 (de) * 2019-10-17 2021-04-22 Audi Ag Verfahren zur Ermittlung einer Position, Verfahren zur Steuerung einer Position und Computerprogrammprodukt
CN112097759A (zh) * 2020-08-18 2020-12-18 北京视域四维城市导向系统规划设计有限公司 智能导航系统
DE102022129115B3 (de) 2022-11-03 2023-11-02 Audi Aktiengesellschaft Verfahren und System zum Darstellen eines Fondbereichs

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19736774A1 (de) * 1997-08-23 1999-02-25 Bosch Gmbh Robert Verfahren zur Informationsanzeige in einem Kraftfahrzeug
DE19842176A1 (de) * 1998-09-15 2000-03-16 Bosch Gmbh Robert Verfahren und Vorrichtung zur Verkehrszeichenerkennung und Navigation
DE19937489A1 (de) * 1999-08-07 2001-02-08 Volkswagen Ag Verfahren zur Überwachung eines Fahrspurwechsels eines Kraftfahrzeuges
DE19938267A1 (de) * 1999-08-12 2001-02-15 Volkswagen Ag Verfahren und Einrichtung zur elektronischen Erkennung von Verkehrszeichen in Kraftfahrzeugen
US20010043717A1 (en) * 1998-10-23 2001-11-22 Facet Technology Corporation Method and apparatus for rapidly determining whether a digitized image frame contains an object of interest
DE10053315A1 (de) * 2000-10-27 2002-05-16 Audi Ag Verfahren zum Detektieren von Verkehrszeichen und Vorrichtung zu dessen Ausführung
DE102006007343A1 (de) * 2006-02-17 2007-08-30 Robert Bosch Gmbh Bilderfassungseinrichtung für ein Fahrerassistenzsystem
US20070233361A1 (en) * 2006-03-30 2007-10-04 Ford Global Technologies, Llc Centralized Image Processing For An Automobile With A Navigation System
DE102007001099A1 (de) * 2007-01-04 2008-07-10 Siemens Ag Fahrerassistenzsystem zur Verkehrszeichenerkennung

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6690268B2 (en) * 2000-03-02 2004-02-10 Donnelly Corporation Video mirror systems incorporating an accessory module
DE10307607A1 (de) 2003-02-22 2004-09-09 Daimlerchrysler Ag Verteiltes Bildverarbeitungssystem für Kraftfahrzeuge
JP2006119965A (ja) * 2004-10-22 2006-05-11 Mitsubishi Fuso Truck & Bus Corp 車載型警報システム
US7301464B2 (en) * 2005-05-24 2007-11-27 Electronic Data Systems Corporation Process and method for safer vehicle navigation through facial gesture recognition and operator condition monitoring
CA2609663A1 (fr) 2005-06-06 2006-12-14 Tomtom International B.V. Dispositif de navigation utilisant une camera
DE102006010478A1 (de) 2006-03-07 2007-09-13 Robert Bosch Gmbh Verfahren und Anordnung zur Anzeige von Navigationshinweisen
WO2008086656A1 (fr) * 2007-01-16 2008-07-24 Shenzhen Gospell Smarthome Electronic Co., Ltd Dispositif de rétrovision doté d'un gps et destiné à un véhicule

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19736774A1 (de) * 1997-08-23 1999-02-25 Bosch Gmbh Robert Verfahren zur Informationsanzeige in einem Kraftfahrzeug
DE19842176A1 (de) * 1998-09-15 2000-03-16 Bosch Gmbh Robert Verfahren und Vorrichtung zur Verkehrszeichenerkennung und Navigation
US20010043717A1 (en) * 1998-10-23 2001-11-22 Facet Technology Corporation Method and apparatus for rapidly determining whether a digitized image frame contains an object of interest
DE19937489A1 (de) * 1999-08-07 2001-02-08 Volkswagen Ag Verfahren zur Überwachung eines Fahrspurwechsels eines Kraftfahrzeuges
DE19938267A1 (de) * 1999-08-12 2001-02-15 Volkswagen Ag Verfahren und Einrichtung zur elektronischen Erkennung von Verkehrszeichen in Kraftfahrzeugen
DE10053315A1 (de) * 2000-10-27 2002-05-16 Audi Ag Verfahren zum Detektieren von Verkehrszeichen und Vorrichtung zu dessen Ausführung
DE102006007343A1 (de) * 2006-02-17 2007-08-30 Robert Bosch Gmbh Bilderfassungseinrichtung für ein Fahrerassistenzsystem
US20070233361A1 (en) * 2006-03-30 2007-10-04 Ford Global Technologies, Llc Centralized Image Processing For An Automobile With A Navigation System
DE102007001099A1 (de) * 2007-01-04 2008-07-10 Siemens Ag Fahrerassistenzsystem zur Verkehrszeichenerkennung

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2010020512A1 *

Also Published As

Publication number Publication date
WO2010020512A1 (fr) 2010-02-25
DE102008041295A1 (de) 2010-02-25

Similar Documents

Publication Publication Date Title
EP2316003A1 (fr) Appareil de navigation mobile et procédé associé
EP3401166B1 (fr) Système de remplacement de retroviseur en tant que système de surveillance par caméra d'un véhicule automobile, en particulier d'un véhicule utilitaire
EP1994366B1 (fr) Procédé et système pour afficher des indications de navigation
EP3024700B1 (fr) Procédé et dispositif permettant de reproduire une zone latérale et/ou arrière environnant un véhicule
CN102610125B (zh) 输出超车建议的机动车驾驶员辅助系统运行方法和机动车
DE102004008867B4 (de) Bildverarbeitungssystem für Kraftfahrzeuge
DE102008028303A1 (de) Anzeigesystem und Programm
WO2008061890A1 (fr) Procédé de communication hertzienne entre des véhicules
DE102017116073A1 (de) System und verfahren zur verbesserung der fahrzeugumgebungserfassung
DE112016002268T5 (de) Bildverarbeitungsvorrichtung, elektronisches spiegelsystem und bildverarbeitungsverfahren
DE102017122261A1 (de) Verfahren zum Überwachen eines Umgebungsbereiches eines Kraftfahrzeugs sowie Kamerasystem
DE112015001128T5 (de) Anzeigeobjektinformationsanzeigevorrichtung
DE102010060225A1 (de) Fahrzeuginformationsanbietevorrichtung
DE102008028374A1 (de) Verfahren zur kombinierten Ausgabe eines Bildes und einer Lokalinformation, sowie Kraftfahrzeug hierfür
DE102007024395A1 (de) Darstellungsverfahren zur Unterstützung eines Fahrzeugführers
DE102017212432A1 (de) Verfahren und Vorrichtung zum Betreiben eines Fahrerassistenzsystems eines Kraftfahrzeugs und Fahrerassistenzsysteme
DE102008006309A1 (de) Verfahren und Vorrichtung zur Fahrerunterstützung beim Rangieren eines Fahrzeuges oder Fahrzeuggespanns
DE102010054221A1 (de) Verfahren zur Assistenz eines Fahrers bei Spurwechseln und Spurwechselassistenzsystem
DE102017122543A1 (de) Verfahren zum Unterstützen eines Fahrers eines Kraftfahrzeugs beim Überholen eines Objektes sowie Fahrerassistenzsystem
DE102018108433A1 (de) Bildanzeigevorrichtung
DE102012200762A1 (de) Verfahren und Fahrerassistenzsystem zur Signalisierung einer Verkehrssituation in einem Umfeld eines Fahrzeuges
EP1832848B1 (fr) Procédé et dispositif destinés à l'affichage d'une section de carte numérique
DE102015213979B4 (de) Anzeigesystem für Verkehrsschildinformationen
DE102019116836A1 (de) Einblendschnittstellen für rückspiegelanzeigen
DE112022000986T5 (de) Anzeigesteuervorrichtung und anzeigesteuerprogramm

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110318

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: AL BA RS

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20150611

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20160918