JP5591108B2 - カメラ援用ナビゲーションシステム及びその動作方法 - Google Patents

カメラ援用ナビゲーションシステム及びその動作方法 Download PDF

Info

Publication number
JP5591108B2
JP5591108B2 JP2010513810A JP2010513810A JP5591108B2 JP 5591108 B2 JP5591108 B2 JP 5591108B2 JP 2010513810 A JP2010513810 A JP 2010513810A JP 2010513810 A JP2010513810 A JP 2010513810A JP 5591108 B2 JP5591108 B2 JP 5591108B2
Authority
JP
Japan
Prior art keywords
image
texture
vehicle
data
navigation system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2010513810A
Other languages
English (en)
Japanese (ja)
Other versions
JP2010532031A5 (enExample
JP2010532031A (ja
Inventor
フェンガー イェンス
キーナスト アンドレアス
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Publication of JP2010532031A publication Critical patent/JP2010532031A/ja
Publication of JP2010532031A5 publication Critical patent/JP2010532031A5/ja
Application granted granted Critical
Publication of JP5591108B2 publication Critical patent/JP5591108B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3647—Guidance involving output of stored or live camera images or video streams
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3635—Guidance using 3D or perspective road maps
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3635—Guidance using 3D or perspective road maps
    • G01C21/3638—Guidance using 3D or perspective road maps including 3D objects and buildings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/207—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using multi-purpose displays, e.g. camera image and navigation or video on same display
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/302—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Mechanical Engineering (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)
  • Instructional Devices (AREA)
JP2010513810A 2007-06-29 2008-05-09 カメラ援用ナビゲーションシステム及びその動作方法 Expired - Fee Related JP5591108B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102007030226.8 2007-06-29
DE102007030226A DE102007030226A1 (de) 2007-06-29 2007-06-29 Kameragestütztes Navigationssystem und Verfahren zu seinem Betrieb
PCT/EP2008/055769 WO2009003749A1 (de) 2007-06-29 2008-05-09 Kameragestütztes navigationssystem und verfahren zu seinem betrieb

Publications (3)

Publication Number Publication Date
JP2010532031A JP2010532031A (ja) 2010-09-30
JP2010532031A5 JP2010532031A5 (enExample) 2012-06-28
JP5591108B2 true JP5591108B2 (ja) 2014-09-17

Family

ID=39756015

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2010513810A Expired - Fee Related JP5591108B2 (ja) 2007-06-29 2008-05-09 カメラ援用ナビゲーションシステム及びその動作方法

Country Status (5)

Country Link
US (1) US8649974B2 (enExample)
EP (1) EP2162316B1 (enExample)
JP (1) JP5591108B2 (enExample)
DE (1) DE102007030226A1 (enExample)
WO (1) WO2009003749A1 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8108142B2 (en) * 2005-01-26 2012-01-31 Volkswagen Ag 3D navigation system for motor vehicles
DE102008012066A1 (de) * 2008-02-29 2009-09-10 Navigon Ag Verfahren zum Betrieb einer Navigationseinrichtung
WO2011063860A1 (en) * 2009-11-30 2011-06-03 Tomtom Belgium N.V. Navigation device and method
US9482296B2 (en) 2012-06-05 2016-11-01 Apple Inc. Rendering road signs during navigation
US9886794B2 (en) 2012-06-05 2018-02-06 Apple Inc. Problem reporting in maps
US9997069B2 (en) 2012-06-05 2018-06-12 Apple Inc. Context-aware voice guidance
US9269178B2 (en) 2012-06-05 2016-02-23 Apple Inc. Virtual camera for 3D maps
US9111380B2 (en) 2012-06-05 2015-08-18 Apple Inc. Rendering maps
US9418672B2 (en) 2012-06-05 2016-08-16 Apple Inc. Navigation application with adaptive instruction text
US9159153B2 (en) 2012-06-05 2015-10-13 Apple Inc. Method, system and apparatus for providing visual feedback of a map view change
US10176633B2 (en) 2012-06-05 2019-01-08 Apple Inc. Integrated mapping and navigation application
US9052197B2 (en) 2012-06-05 2015-06-09 Apple Inc. Providing navigation instructions while device is in locked mode
US8880336B2 (en) 2012-06-05 2014-11-04 Apple Inc. 3D navigation
US10156455B2 (en) 2012-06-05 2018-12-18 Apple Inc. Context-aware voice guidance
US9367959B2 (en) 2012-06-05 2016-06-14 Apple Inc. Mapping application with 3D presentation
US9147286B2 (en) * 2012-06-06 2015-09-29 Apple Inc. Non-static 3D map views
US9930252B2 (en) 2012-12-06 2018-03-27 Toyota Motor Engineering & Manufacturing North America, Inc. Methods, systems and robots for processing omni-directional image data
DE102013010010B4 (de) * 2013-06-14 2022-02-10 Audi Ag Verfahren zum Betrieb eines Fahrerassistenzsystems zum Rangieren und/oder Parken
DE102014205489B4 (de) * 2014-03-25 2021-10-28 Conti Temic Microelectronic Gmbh Verfahren und System zur Bereitstellung einer Rundumsicht unter Einbeziehung von nicht sichtbaren Objekten
CN110892462A (zh) * 2017-07-20 2020-03-17 丰田博图导航信息技术有限公司 新道路推定辅助装置、新道路推定辅助方法、计算机程序以及记录有计算机程序的记录介质
DE102017215811A1 (de) * 2017-09-07 2019-03-07 Bayerische Motoren Werke Aktiengesellschaft Verfahren zum Erstellen von Straßenbildern
US10757363B2 (en) * 2018-10-30 2020-08-25 GM Global Technology Operations LLC Method and system for reconstructing a vehicle scene at a cloud layer
US20240273837A1 (en) * 2021-07-13 2024-08-15 Lg Electronics Inc. Mr service platform for providing mixed reality automotive meta service, and control method therefor
CN113724521A (zh) * 2021-07-19 2021-11-30 阿里巴巴新加坡控股有限公司 图像数据处理方法、装置、设备及计算机程序产品

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL8901695A (nl) * 1989-07-04 1991-02-01 Koninkl Philips Electronics Nv Werkwijze voor het weergeven van navigatiegegevens voor een voertuig in een omgevingsbeeld van het voertuig, navigatiesysteem voor het uitvoeren van de werkwijze, alsmede voertuig voorzien van een navigatiesysteem.
EP1798705A2 (en) * 1997-10-27 2007-06-20 Matsushita Electric Industrial Co., Ltd. Three-dimensional map display device and device for creating data used therein
US6278479B1 (en) 1998-02-24 2001-08-21 Wilson, Hewitt & Associates, Inc. Dual reality system
US6456288B1 (en) * 1998-03-31 2002-09-24 Computer Associates Think, Inc. Method and apparatus for building a real time graphic scene database having increased resolution and improved rendering speed
US6285317B1 (en) * 1998-05-01 2001-09-04 Lucent Technologies Inc. Navigation system with three-dimensional display
US6182010B1 (en) * 1999-01-28 2001-01-30 International Business Machines Corporation Method and apparatus for displaying real-time visual information on an automobile pervasive computing client
DE19920709A1 (de) * 1999-05-05 2000-11-16 Siemens Ag Verfahren zum Gewinnen einer dreidimensionalen Kartendarstellung und Navigationssystem
JP3627914B2 (ja) * 2000-05-23 2005-03-09 シャープ株式会社 車両の周囲監視システム
US6744442B1 (en) * 2000-08-29 2004-06-01 Harris Corporation Texture mapping system used for creating three-dimensional urban models
JP2003006680A (ja) * 2001-06-20 2003-01-10 Zenrin Co Ltd ３次元電子地図データの生成方法
DE10137582B4 (de) * 2001-08-01 2004-07-29 Siemens Ag Bildverarbeitungsvorrichtung für ein Fahrzeug und Verfahren zum Betrieb einer Bildverarbeitungsvorrichtung
AU2003277240A1 (en) * 2002-10-15 2004-06-07 University Of Southern California Augmented virtual environments
US6885939B2 (en) * 2002-12-31 2005-04-26 Robert Bosch Gmbh System and method for advanced 3D visualization for mobile navigation units
US7619626B2 (en) * 2003-03-01 2009-11-17 The Boeing Company Mapping images from one or more sources into an image for display
DE102004048347A1 (de) 2004-10-01 2006-04-20 Daimlerchrysler Ag Fahrassistenzvorrichtung zur gegenüber dem Sichtfeld des Fahrers eines Kraftfahrzeugs positionsrichtigen Darstellung des weiteren Straßenverlaufs auf einem Fahrzeugdisplay
EP1681538A1 (en) * 2005-01-18 2006-07-19 Harman Becker Automotive Systems (Becker Division) GmbH Junction view with 3-dimensional landmarks for a navigation system for a vehicle
JP4761944B2 (ja) * 2005-11-18 2011-08-31 株式会社東芝 車載用ナビゲーション装置、標示認識方法、ナビゲーションシステム、サーバ
JP2007150681A (ja) * 2005-11-28 2007-06-14 Univ Waseda 位置特定システム及び位置特定方法
JP2007156777A (ja) 2005-12-05 2007-06-21 Alpine Electronics Inc ナビゲーションシステムにおける地図表示装置
US7603208B2 (en) * 2006-01-10 2009-10-13 Harris Corporation Geospatial image change detecting system with environmental enhancement and associated methods
JP4426535B2 (ja) * 2006-01-17 2010-03-03 本田技研工業株式会社 車両の周辺監視装置
JP5022609B2 (ja) * 2006-02-27 2012-09-12 日立オートモティブシステムズ株式会社 撮像環境認識装置
DE602006002748D1 (de) * 2006-07-18 2008-10-23 Harmann Becker Automotive Syst Verfahren zur Anzeige eines Objekts auf einer elektronischen Karte, entsprechende Speichereinheit und Navigationssystem
US20080033645A1 (en) * 2006-08-03 2008-02-07 Jesse Sol Levinson Pobabilistic methods for mapping and localization in arbitrary outdoor environments

Also Published As

Publication number Publication date
US20100235080A1 (en) 2010-09-16
EP2162316B1 (de) 2012-10-31
WO2009003749A1 (de) 2009-01-08
JP2010532031A (ja) 2010-09-30
US8649974B2 (en) 2014-02-11
DE102007030226A1 (de) 2009-01-08
EP2162316A1 (de) 2010-03-17

Similar Documents

Publication Publication Date Title
JP5591108B2 (ja) カメラ援用ナビゲーションシステム及びその動作方法
US11610342B2 (en) Integrated augmented reality system for sharing of augmented reality content between vehicle occupants
US10535180B2 (en) Method and system for efficient rendering of cloud weather effect graphics in three-dimensional maps
US8706316B1 (en) Method and system for enhanced scanner user interface
JP4642723B2 (ja) 画像生成装置および画像生成方法
CN110475107A (zh) 车辆全景可视摄像机投影的失真校正
CN101241233A (zh) 全息信息显示
US10740969B2 (en) Layered panoramas for virtual reality (VR)
IL202460A (en) Method and system for creating a 3D view of real arena for military planning and operations
CN112703527B (zh) 平视显示器（hud）内容控制系统和方法
JPH1165431A (ja) 景観ラベル付カーナビゲーション装置およびシステム
DE112010005944T5 (de) Stereoskopische Dreidimensionen-Anzeigevorichtung
CN109739352A (zh) 景观图像的展示方法及设备
CN102555905A (zh) 产生车辆周围环境中至少一个物体的影像的方法和设备
CN111447431A (zh) 一种应用于车载环视摄像的裸眼3d显示方法及系统
JP2024149597A (ja) ３次元仮想現実表示システム
WO2011123710A1 (en) Synthesizing panoramic three-dimensional images
CN117830492A (zh) 车模渲染方法、装置、电子设备和存储介质
CN109764888A (zh) 显示系统以及显示方法
JP2022532867A (ja) 車両周辺部の画像を生成するための方法ならびに車両周辺部の画像を生成するための装置
JP6602960B2 (ja) 車両の車両周辺環境を表示する方法及び装置
US10354547B1 (en) Apparatus and method for virtual test drive for virtual reality applications in head mounted displays
US11188767B2 (en) Image generation device and image generation method
CN115988247A (zh) 一种xr车载观影系统及方法
EP4454256A1 (en) System and method for displaying images to an augmented reality heads-up display rendering

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20101228

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20111111

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20120209

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20120216

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20120511

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120621

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20120919

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20120926

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121221

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20130222

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130620

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20130627

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20130726

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20131111

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20131114

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140604

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20140729

R150 Certificate of patent or registration of utility model

Ref document number: 5591108

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees