JP7424866B2 - 環境内のオブジェクトのレーン割り当てを決定するための障害物及びレーン検出の活用 - Google Patents

環境内のオブジェクトのレーン割り当てを決定するための障害物及びレーン検出の活用 Download PDF

Info

Publication number
JP7424866B2
JP7424866B2 JP2020036424A JP2020036424A JP7424866B2 JP 7424866 B2 JP7424866 B2 JP 7424866B2 JP 2020036424 A JP2020036424 A JP 2020036424A JP 2020036424 A JP2020036424 A JP 2020036424A JP 7424866 B2 JP7424866 B2 JP 7424866B2
Authority
JP
Japan
Prior art keywords
lane
data
vehicle
fence
lanes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020036424A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021026752A (ja
Inventor
アボット ジョシュ
サインツ セラ ミゲル
イー チャオティン
ニスター デビッド
Original Assignee
エヌビディア コーポレーション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by エヌビディア コーポレーション filed Critical エヌビディア コーポレーション
Publication of JP2021026752A publication Critical patent/JP2021026752A/ja
Application granted granted Critical
Publication of JP7424866B2 publication Critical patent/JP7424866B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0125Traffic data processing
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0968Systems involving transmission of navigation instructions to the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20112Image segmentation details
    • G06T2207/20132Image cropping
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • G06T2207/30256Lane; Road marking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261Obstacle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/12Bounding box

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
JP2020036424A 2019-08-08 2020-03-04 環境内のオブジェクトのレーン割り当てを決定するための障害物及びレーン検出の活用 Active JP7424866B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/535,440 2019-08-08
US16/535,440 US10997435B2 (en) 2019-08-08 2019-08-08 Leveraging obstacle and lane detections to determine lane assignments for objects in an environment

Publications (2)

Publication Number Publication Date
JP2021026752A JP2021026752A (ja) 2021-02-22
JP7424866B2 true JP7424866B2 (ja) 2024-01-30

Family

ID=74188380

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020036424A Active JP7424866B2 (ja) 2019-08-08 2020-03-04 環境内のオブジェクトのレーン割り当てを決定するための障害物及びレーン検出の活用

Country Status (4)

Country Link
US (3) US10997435B2 (zh)
JP (1) JP7424866B2 (zh)
CN (1) CN112347829A (zh)
DE (1) DE102020117792A1 (zh)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110494863B (zh) 2018-03-15 2024-02-09 辉达公司 确定自主车辆的可驾驶自由空间
JP7199545B2 (ja) 2018-07-20 2023-01-05 メイ モビリティー,インコーポレイテッド 自律エージェントによる行動方針選択のための多視点システムおよび方法
US10969470B2 (en) 2019-02-15 2021-04-06 May Mobility, Inc. Systems and methods for intelligently calibrating infrastructure devices using onboard sensors of an autonomous agent
US11648945B2 (en) 2019-03-11 2023-05-16 Nvidia Corporation Intersection detection and classification in autonomous machine applications
KR20210145734A (ko) * 2019-03-27 2021-12-02 소니그룹주식회사 정보 처리 장치, 정보 처리 방법, 및 프로그램
US11375275B2 (en) * 2019-11-19 2022-06-28 Charter Communications Operating, Llc Method and system for using lip sequences to control operations of a device
US20220092735A1 (en) * 2019-11-21 2022-03-24 Samsung Electronics Co., Ltd. Electronic apparatus and controlling method thereof
KR20210062477A (ko) * 2019-11-21 2021-05-31 삼성전자주식회사 전자 장치 및 그 제어 방법
KR20210132496A (ko) * 2020-04-27 2021-11-04 한국전자기술연구원 영상 기반 차선 검출 및 주행 차로 인식 방법 및 장치
US11644830B1 (en) 2020-06-02 2023-05-09 Aurora Operations, Inc. Autonomous vehicle remote teleoperations system with scenario selection
US11595619B1 (en) * 2020-06-02 2023-02-28 Aurora Operations, Inc. Autonomous vehicle teleoperations system
US11560154B1 (en) 2020-06-02 2023-01-24 Aurora Operations, Inc. Autonomous vehicle remote teleoperations system
WO2022006418A1 (en) 2020-07-01 2022-01-06 May Mobility, Inc. Method and system for dynamically curating autonomous vehicle policies
USD992597S1 (en) * 2020-08-27 2023-07-18 Mobileye Vision Technologies Ltd. Display screen with animated graphical user interface
EP4260009A1 (en) 2020-12-14 2023-10-18 May Mobility, Inc. Autonomous vehicle safety platform system and method
EP4264181A1 (en) 2020-12-17 2023-10-25 May Mobility, Inc. Method and system for dynamically updating an environmental representation of an autonomous agent
JP7484783B2 (ja) * 2021-03-24 2024-05-16 トヨタ自動車株式会社 車線境界検出装置、車線境界検出方法及び車線境界検出用コンピュータプログラム
US11472436B1 (en) * 2021-04-02 2022-10-18 May Mobility, Inc Method and system for operating an autonomous agent with incomplete environmental information
CN113033030B (zh) * 2021-05-25 2021-08-03 四川见山科技有限责任公司 一种基于真实道路场景的拥堵模拟方法及系统
WO2022256249A1 (en) 2021-06-02 2022-12-08 May Mobility, Inc. Method and system for remote assistance of an autonomous agent
US20240331195A1 (en) * 2021-06-25 2024-10-03 Intel Corporation Methods and apparatus for scale recovery from monocular video
CN113255619B (zh) * 2021-07-09 2021-11-23 禾多科技(北京)有限公司 车道线识别及定位方法、电子设备和计算机可读介质
CN113467464A (zh) * 2021-07-17 2021-10-01 普达迪泰(天津)智能装备科技有限公司 一种用于无人车轨迹模拟测试的卫星定位运动轨迹方法
CN113848501B (zh) * 2021-09-18 2024-08-06 舟山中远海运重工有限公司 一种基于无人机的船舶航行信号灯检验方法
US20230094975A1 (en) * 2021-09-29 2023-03-30 Waymo Llc Lane search for self-driving vehicles
US12026955B2 (en) * 2021-09-29 2024-07-02 Nvidia Corporation Assigning obstacles to lanes using neural networks for autonomous machine applications
DE102021127748A1 (de) 2021-10-26 2023-04-27 Valeo Schalter Und Sensoren Gmbh Verfahren, computerprogrammprodukt, parkassistenzsystem und fahrzeug
US12012123B2 (en) 2021-12-01 2024-06-18 May Mobility, Inc. Method and system for impact-based operation of an autonomous agent
WO2023154568A1 (en) 2022-02-14 2023-08-17 May Mobility, Inc. Method and system for conditional operation of an autonomous agent
US12027053B1 (en) 2022-12-13 2024-07-02 May Mobility, Inc. Method and system for assessing and mitigating risks encounterable by an autonomous vehicle

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018523877A (ja) 2015-08-18 2018-08-23 クゥアルコム・インコーポレイテッドQualcomm Incorporated オブジェクト追跡のためのシステムおよび方法
WO2018216177A1 (ja) 2017-05-25 2018-11-29 本田技研工業株式会社 車両制御装置

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3747599B2 (ja) * 1997-11-20 2006-02-22 日産自動車株式会社 車両用障害物検出装置
US9098751B2 (en) * 2011-07-27 2015-08-04 Gentex Corporation System and method for periodic lane marker identification and tracking
US9721471B2 (en) * 2014-12-16 2017-08-01 Here Global B.V. Learning lanes from radar data
US10262213B2 (en) * 2014-12-16 2019-04-16 Here Global B.V. Learning lanes from vehicle probes
US10313638B1 (en) * 2015-06-12 2019-06-04 Amazon Technologies, Inc. Image creation using geo-fence data
CN107563256A (zh) * 2016-06-30 2018-01-09 北京旷视科技有限公司 辅助驾驶信息产生方法及装置、辅助驾驶系统
US10769660B2 (en) * 2016-09-09 2020-09-08 International Business Machines Corporation Determining advertisement content based on cluster density within dynamic visibility fence
US10332320B2 (en) * 2017-04-17 2019-06-25 Intel Corporation Autonomous vehicle advanced sensing and response
EP3437022A1 (en) * 2017-06-22 2019-02-06 Baidu.com Times Technology (Beijing) Co., Ltd. Traffic prediction based on map images for autonomous driving
US20190016331A1 (en) * 2017-07-14 2019-01-17 Nio Usa, Inc. Programming complex parking maneuvers for driverless vehicles
US11644834B2 (en) * 2017-11-10 2023-05-09 Nvidia Corporation Systems and methods for safe and reliable autonomous vehicles
US20190147296A1 (en) * 2017-11-15 2019-05-16 Nvidia Corporation Creating an image utilizing a map representing different classes of pixels
US10699135B2 (en) * 2017-11-20 2020-06-30 Here Global B.V. Automatic localization geometry generator for stripe-shaped objects
US10586456B2 (en) * 2018-04-27 2020-03-10 TuSimple System and method for determining car to lane distance
US10761535B2 (en) * 2018-08-21 2020-09-01 GM Global Technology Operations LLC Intelligent vehicle navigation systems, methods, and control logic for multi-lane separation and trajectory extraction of roadway segments
US10832439B1 (en) * 2019-04-19 2020-11-10 Zoox, Inc. Locating entities in a mapped environment
US11677931B2 (en) * 2021-07-23 2023-06-13 Embark Trucks Inc. Automated real-time calibration

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018523877A (ja) 2015-08-18 2018-08-23 クゥアルコム・インコーポレイテッドQualcomm Incorporated オブジェクト追跡のためのシステムおよび方法
WO2018216177A1 (ja) 2017-05-25 2018-11-29 本田技研工業株式会社 車両制御装置

Also Published As

Publication number Publication date
DE102020117792A1 (de) 2021-02-11
US20210241004A1 (en) 2021-08-05
US20210241005A1 (en) 2021-08-05
JP2021026752A (ja) 2021-02-22
CN112347829A (zh) 2021-02-09
US20210042535A1 (en) 2021-02-11
US10997435B2 (en) 2021-05-04

Similar Documents

Publication Publication Date Title
JP7424866B2 (ja) 環境内のオブジェクトのレーン割り当てを決定するための障害物及びレーン検出の活用
CN113811886B (zh) 自主机器应用中的路口检测和分类
JP7399164B2 (ja) 駐車スペース検出に適したスキューされたポリゴンを使用した物体検出
JP7472170B2 (ja) 自律マシン・アプリケーションにおける交差点姿勢検出
US11675359B2 (en) Path detection for autonomous machines using deep neural networks
US11885907B2 (en) Deep neural network for detecting obstacle instances using radar sensors in autonomous machine applications
US20200218979A1 (en) Distance estimation to objects and free-space boundaries in autonomous machine applications
US11531088B2 (en) Deep neural network for detecting obstacle instances using radar sensors in autonomous machine applications
EP3832341A1 (en) Deep neural network for detecting obstacle instances using radar sensors in autonomous machine applications
US20230152805A1 (en) Using neural networks to perform fault detection in autonomous driving applications
JP2022538813A (ja) 自律マシン・アプリケーションのための交差点領域検出及び分類
CN112989914B (zh) 具有自适应加权输入的注视确定机器学习系统
JP2023507695A (ja) 自律運転アプリケーションのための3次元交差点構造予測
JP2023531330A (ja) マシン学習を使用した自律マシン・アプリケーションのためのセンサ融合
JP2023503729A (ja) 自律運転アプリケーションのための曲線適合を使用するランドマーク検出
JP2023509831A (ja) 自律マシン・アプリケーションにおける車線変更プランニング及び制御
JP2022531092A (ja) 自律マシン・アプリケーションのための変換された現実世界センサ・データから現実的試験データをシミュレーションすること
JP2022526825A (ja) 自律マシン・アプリケーションのためのマップ情報で拡張されたグラウンド・トゥルース・データを使用するニューラル・ネットワーク・トレーニング
JP2023548721A (ja) 自律システム及びアプリケーションにおけるビヘイビア予測のためのモデルベースの強化学習
JP2023031237A (ja) 自律マシン・アプリケーションのためのLiDARデータを使用する物体追跡
US12050285B2 (en) Deep neural network for detecting obstacle instances using radar sensors in autonomous machine applications
US11840238B2 (en) Multi-view geometry-based hazard detection for autonomous systems and applications
US20230406315A1 (en) Encoding junction information in map data
CN115218888A (zh) 用于更新高清地图的系统和方法
JP2023071168A (ja) 自律マシン・アプリケーションのための粒子ベース危険検出

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221213

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20231012

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231013

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240111

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240117

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240118

R150 Certificate of patent or registration of utility model

Ref document number: 7424866

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150