JP5591108B2 - カメラ援用ナビゲーションシステム及びその動作方法 - Google Patents

カメラ援用ナビゲーションシステム及びその動作方法 Download PDF

Info

Publication number
JP5591108B2
JP5591108B2 JP2010513810A JP2010513810A JP5591108B2 JP 5591108 B2 JP5591108 B2 JP 5591108B2 JP 2010513810 A JP2010513810 A JP 2010513810A JP 2010513810 A JP2010513810 A JP 2010513810A JP 5591108 B2 JP5591108 B2 JP 5591108B2
Authority
JP
Japan
Prior art keywords
image
texture
vehicle
data
navigation system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2010513810A
Other languages
English (en)
Japanese (ja)
Other versions
JP2010532031A5 (enExample
JP2010532031A (ja
Inventor
フェンガー イェンス
キーナスト アンドレアス
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Publication of JP2010532031A publication Critical patent/JP2010532031A/ja
Publication of JP2010532031A5 publication Critical patent/JP2010532031A5/ja
Application granted granted Critical
Publication of JP5591108B2 publication Critical patent/JP5591108B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3647—Guidance involving output of stored or live camera images or video streams
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3635—Guidance using 3D or perspective road maps
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3635—Guidance using 3D or perspective road maps
    • G01C21/3638—Guidance using 3D or perspective road maps including 3D objects and buildings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/207—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using multi-purpose displays, e.g. camera image and navigation or video on same display
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/302—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Mechanical Engineering (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)
  • Instructional Devices (AREA)
JP2010513810A 2007-06-29 2008-05-09 カメラ援用ナビゲーションシステム及びその動作方法 Expired - Fee Related JP5591108B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102007030226A DE102007030226A1 (de) 2007-06-29 2007-06-29 Kameragestütztes Navigationssystem und Verfahren zu seinem Betrieb
DE102007030226.8 2007-06-29
PCT/EP2008/055769 WO2009003749A1 (de) 2007-06-29 2008-05-09 Kameragestütztes navigationssystem und verfahren zu seinem betrieb

Publications (3)

Publication Number Publication Date
JP2010532031A JP2010532031A (ja) 2010-09-30
JP2010532031A5 JP2010532031A5 (enExample) 2012-06-28
JP5591108B2 true JP5591108B2 (ja) 2014-09-17

Family

ID=39756015

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2010513810A Expired - Fee Related JP5591108B2 (ja) 2007-06-29 2008-05-09 カメラ援用ナビゲーションシステム及びその動作方法

Country Status (5)

Country Link
US (1) US8649974B2 (enExample)
EP (1) EP2162316B1 (enExample)
JP (1) JP5591108B2 (enExample)
DE (1) DE102007030226A1 (enExample)
WO (1) WO2009003749A1 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8108142B2 (en) * 2005-01-26 2012-01-31 Volkswagen Ag 3D navigation system for motor vehicles
DE102008012066A1 (de) * 2008-02-29 2009-09-10 Navigon Ag Verfahren zum Betrieb einer Navigationseinrichtung
WO2011063860A1 (en) * 2009-11-30 2011-06-03 Tomtom Belgium N.V. Navigation device and method
US9367959B2 (en) 2012-06-05 2016-06-14 Apple Inc. Mapping application with 3D presentation
US9418672B2 (en) 2012-06-05 2016-08-16 Apple Inc. Navigation application with adaptive instruction text
US9052197B2 (en) 2012-06-05 2015-06-09 Apple Inc. Providing navigation instructions while device is in locked mode
US20130321400A1 (en) 2012-06-05 2013-12-05 Apple Inc. 3D Map Views for 3D Maps
US9269178B2 (en) 2012-06-05 2016-02-23 Apple Inc. Virtual camera for 3D maps
US9997069B2 (en) 2012-06-05 2018-06-12 Apple Inc. Context-aware voice guidance
US10176633B2 (en) 2012-06-05 2019-01-08 Apple Inc. Integrated mapping and navigation application
US8880336B2 (en) 2012-06-05 2014-11-04 Apple Inc. 3D navigation
US9482296B2 (en) 2012-06-05 2016-11-01 Apple Inc. Rendering road signs during navigation
US9886794B2 (en) 2012-06-05 2018-02-06 Apple Inc. Problem reporting in maps
US9159153B2 (en) 2012-06-05 2015-10-13 Apple Inc. Method, system and apparatus for providing visual feedback of a map view change
US9230556B2 (en) 2012-06-05 2016-01-05 Apple Inc. Voice instructions during navigation
US9147286B2 (en) * 2012-06-06 2015-09-29 Apple Inc. Non-static 3D map views
US9930252B2 (en) 2012-12-06 2018-03-27 Toyota Motor Engineering & Manufacturing North America, Inc. Methods, systems and robots for processing omni-directional image data
DE102013010010B4 (de) * 2013-06-14 2022-02-10 Audi Ag Verfahren zum Betrieb eines Fahrerassistenzsystems zum Rangieren und/oder Parken
DE102014205489B4 (de) * 2014-03-25 2021-10-28 Conti Temic Microelectronic Gmbh Verfahren und System zur Bereitstellung einer Rundumsicht unter Einbeziehung von nicht sichtbaren Objekten
WO2019016910A1 (ja) * 2017-07-20 2019-01-24 株式会社トヨタマップマスター 新規道路推定支援装置、新規道路推定支援方法、コンピュータプログラム及びコンピュータプログラムを記録した記録媒体
DE102017215811A1 (de) * 2017-09-07 2019-03-07 Bayerische Motoren Werke Aktiengesellschaft Verfahren zum Erstellen von Straßenbildern
US10757363B2 (en) * 2018-10-30 2020-08-25 GM Global Technology Operations LLC Method and system for reconstructing a vehicle scene at a cloud layer
KR20240024769A (ko) * 2021-07-13 2024-02-26 엘지전자 주식회사 혼합 현실 자동차 메타 서비스를 제공하는 mr 서비스플랫폼 및 그것의 제어방법
CN113724521A (zh) * 2021-07-19 2021-11-30 阿里巴巴新加坡控股有限公司 图像数据处理方法、装置、设备及计算机程序产品

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL8901695A (nl) * 1989-07-04 1991-02-01 Koninkl Philips Electronics Nv Werkwijze voor het weergeven van navigatiegegevens voor een voertuig in een omgevingsbeeld van het voertuig, navigatiesysteem voor het uitvoeren van de werkwijze, alsmede voertuig voorzien van een navigatiesysteem.
EP1798704A2 (en) * 1997-10-27 2007-06-20 Matsushita Electric Industrial Co., Ltd. Three-dimensional map display device and device for creating data used therein
US6278479B1 (en) 1998-02-24 2001-08-21 Wilson, Hewitt & Associates, Inc. Dual reality system
US6456288B1 (en) * 1998-03-31 2002-09-24 Computer Associates Think, Inc. Method and apparatus for building a real time graphic scene database having increased resolution and improved rendering speed
US6285317B1 (en) * 1998-05-01 2001-09-04 Lucent Technologies Inc. Navigation system with three-dimensional display
US6182010B1 (en) * 1999-01-28 2001-01-30 International Business Machines Corporation Method and apparatus for displaying real-time visual information on an automobile pervasive computing client
DE19920709A1 (de) * 1999-05-05 2000-11-16 Siemens Ag Verfahren zum Gewinnen einer dreidimensionalen Kartendarstellung und Navigationssystem
JP3627914B2 (ja) * 2000-05-23 2005-03-09 シャープ株式会社 車両の周囲監視システム
US6744442B1 (en) * 2000-08-29 2004-06-01 Harris Corporation Texture mapping system used for creating three-dimensional urban models
JP2003006680A (ja) * 2001-06-20 2003-01-10 Zenrin Co Ltd ３次元電子地図データの生成方法
DE10137582B4 (de) 2001-08-01 2004-07-29 Siemens Ag Bildverarbeitungsvorrichtung für ein Fahrzeug und Verfahren zum Betrieb einer Bildverarbeitungsvorrichtung
US7583275B2 (en) * 2002-10-15 2009-09-01 University Of Southern California Modeling and video projection for augmented virtual environments
US6885939B2 (en) * 2002-12-31 2005-04-26 Robert Bosch Gmbh System and method for advanced 3D visualization for mobile navigation units
US7619626B2 (en) * 2003-03-01 2009-11-17 The Boeing Company Mapping images from one or more sources into an image for display
DE102004048347A1 (de) * 2004-10-01 2006-04-20 Daimlerchrysler Ag Fahrassistenzvorrichtung zur gegenüber dem Sichtfeld des Fahrers eines Kraftfahrzeugs positionsrichtigen Darstellung des weiteren Straßenverlaufs auf einem Fahrzeugdisplay
EP1681538A1 (en) * 2005-01-18 2006-07-19 Harman Becker Automotive Systems (Becker Division) GmbH Junction view with 3-dimensional landmarks for a navigation system for a vehicle
JP4761944B2 (ja) 2005-11-18 2011-08-31 株式会社東芝 車載用ナビゲーション装置、標示認識方法、ナビゲーションシステム、サーバ
JP2007150681A (ja) 2005-11-28 2007-06-14 Univ Waseda 位置特定システム及び位置特定方法
JP2007156777A (ja) 2005-12-05 2007-06-21 Alpine Electronics Inc ナビゲーションシステムにおける地図表示装置
US7603208B2 (en) * 2006-01-10 2009-10-13 Harris Corporation Geospatial image change detecting system with environmental enhancement and associated methods
JP4426535B2 (ja) * 2006-01-17 2010-03-03 本田技研工業株式会社 車両の周辺監視装置
JP5022609B2 (ja) * 2006-02-27 2012-09-12 日立オートモティブシステムズ株式会社 撮像環境認識装置
EP1881294B1 (en) * 2006-07-18 2008-09-10 Harman Becker Automotive Systems GmbH Method for displaying an object on an electronic map and corresponding storage unit and navigation system
US20080033645A1 (en) * 2006-08-03 2008-02-07 Jesse Sol Levinson Pobabilistic methods for mapping and localization in arbitrary outdoor environments

Also Published As

Publication number Publication date
EP2162316B1 (de) 2012-10-31
US8649974B2 (en) 2014-02-11
DE102007030226A1 (de) 2009-01-08
WO2009003749A1 (de) 2009-01-08
US20100235080A1 (en) 2010-09-16
JP2010532031A (ja) 2010-09-30
EP2162316A1 (de) 2010-03-17

Similar Documents

Publication Publication Date Title
JP5591108B2 (ja) カメラ援用ナビゲーションシステム及びその動作方法
US11610342B2 (en) Integrated augmented reality system for sharing of augmented reality content between vehicle occupants
US10535180B2 (en) Method and system for efficient rendering of cloud weather effect graphics in three-dimensional maps
US8706316B1 (en) Method and system for enhanced scanner user interface
JP4642723B2 (ja) 画像生成装置および画像生成方法
CN110475107A (zh) 车辆全景可视摄像机投影的失真校正
CN101241233A (zh) 全息信息显示
CN111815780A (zh) 展示方法、显示装置、设备及计算机可读存储介质
US10740969B2 (en) Layered panoramas for virtual reality (VR)
JP6776440B2 (ja) 動力車両を運転する際に動力車両のドライバーを支援する方法、ドライバー支援システム及び動力車両
CN112703527B (zh) 平视显示器（hud）内容控制系统和方法
DE112010005944T5 (de) Stereoskopische Dreidimensionen-Anzeigevorichtung
US10311636B1 (en) Layered panoramas for virtual reality (VR)
CN109739352A (zh) 景观图像的展示方法及设备
CN111447431A (zh) 一种应用于车载环视摄像的裸眼3d显示方法及系统
JP2024149597A (ja) ３次元仮想現実表示システム
CN102555905A (zh) 产生车辆周围环境中至少一个物体的影像的方法和设备
JP2019175458A (ja) 天候エフェクト用の３ｄパーティクルシステムを効率的にレンダリングするための方法及びシステム
WO2011123710A1 (en) Synthesizing panoramic three-dimensional images
CN109764888A (zh) 显示系统以及显示方法
JP2022532867A (ja) 車両周辺部の画像を生成するための方法ならびに車両周辺部の画像を生成するための装置
US10354547B1 (en) Apparatus and method for virtual test drive for virtual reality applications in head mounted displays
CN115988247B (zh) 一种xr车载观影系统及方法
US11188767B2 (en) Image generation device and image generation method
EP4454256A1 (en) System and method for displaying images to an augmented reality heads-up display rendering

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20101228

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20111111

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20120209

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20120216

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20120511

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120621

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20120919

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20120926

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121221

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20130222

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130620

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20130627

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20130726

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20131111

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20131114

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140604

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20140729

R150 Certificate of patent or registration of utility model

Ref document number: 5591108

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees