JP6298128B2 - ３ｄセンサにより検出されたオブジェクトの分類 - Google Patents

３ｄセンサにより検出されたオブジェクトの分類 Download PDF

Info

Publication number
JP6298128B2
JP6298128B2 JP2016177291A JP2016177291A JP6298128B2 JP 6298128 B2 JP6298128 B2 JP 6298128B2 JP 2016177291 A JP2016177291 A JP 2016177291A JP 2016177291 A JP2016177291 A JP 2016177291A JP 6298128 B2 JP6298128 B2 JP 6298128B2
Authority
JP
Japan
Prior art keywords
trajectory
cluster
identified
based classifier
automatic driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016177291A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017056935A5 (enExample
JP2017056935A (ja
Inventor
ジェイ．デルプ マイケル
ジェイ．デルプ マイケル
Original Assignee
トヨタ モーター エンジニアリング アンド マニュファクチャリング ノース アメリカ，インコーポレイティド
トヨタ モーター エンジニアリング アンド マニュファクチャリング ノース アメリカ，インコーポレイティド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by トヨタ モーター エンジニアリング アンド マニュファクチャリング ノース アメリカ，インコーポレイティド, トヨタ モーター エンジニアリング アンド マニュファクチャリング ノース アメリカ，インコーポレイティド filed Critical トヨタ モーター エンジニアリング アンド マニュファクチャリング ノース アメリカ，インコーポレイティド
Publication of JP2017056935A publication Critical patent/JP2017056935A/ja
Publication of JP2017056935A5 publication Critical patent/JP2017056935A5/ja
Application granted granted Critical
Publication of JP6298128B2 publication Critical patent/JP6298128B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0242—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using non-visible light signals, e.g. IR or UV signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0238—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors
    • G05D1/024—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors in combination with a laser
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0251—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Electromagnetism (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Image Analysis (AREA)
JP2016177291A 2015-09-14 2016-09-12 ３ｄセンサにより検出されたオブジェクトの分類 Active JP6298128B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/852,806 US9576185B1 (en) 2015-09-14 2015-09-14 Classifying objects detected by 3D sensors for autonomous vehicle operation
US14/852,806 2015-09-14

Publications (3)

Publication Number Publication Date
JP2017056935A JP2017056935A (ja) 2017-03-23
JP2017056935A5 JP2017056935A5 (enExample) 2018-02-01
JP6298128B2 true JP6298128B2 (ja) 2018-03-20

Family

ID=58017693

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016177291A Active JP6298128B2 (ja) 2015-09-14 2016-09-12 ３ｄセンサにより検出されたオブジェクトの分類

Country Status (3)

Country Link
US (1) US9576185B1 (enExample)
JP (1) JP6298128B2 (enExample)
DE (1) DE102016116029B4 (enExample)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10121082B2 (en) * 2015-10-07 2018-11-06 Honda Motor Co., Ltd. System and method for providing laser camera fusion for identifying and tracking a traffic participant
EP3381016A4 (en) * 2015-11-26 2019-06-12 Sportlogiq Inc. SYSTEMS AND METHODS FOR OBJECT TRACKING AND VORTICATION IN VIDEOS WITH ADAPTIVE IMAGE DISPLAY
US9961261B2 (en) 2016-06-20 2018-05-01 Gopro, Inc. Image alignment using a virtual gyroscope model
US10740658B2 (en) * 2016-09-08 2020-08-11 Mentor Graphics Corporation Object recognition and classification using multiple sensor modalities
CN110461787B (zh) * 2017-03-30 2022-09-09 旭硝子欧洲玻璃公司 用于自主汽车的玻璃
US10710579B2 (en) * 2017-06-01 2020-07-14 Waymo Llc Collision prediction system
US11573573B2 (en) 2017-06-06 2023-02-07 Plusai, Inc. Method and system for distributed learning and adaptation in autonomous driving vehicles
US11392133B2 (en) 2017-06-06 2022-07-19 Plusai, Inc. Method and system for object centric stereo in autonomous driving vehicles
US11042155B2 (en) * 2017-06-06 2021-06-22 Plusai Limited Method and system for closed loop perception in autonomous driving vehicles
JP7193464B2 (ja) 2017-08-18 2022-12-20 株式会社小糸製作所 認識センサ、自動車、車両用灯具
US10401862B2 (en) 2017-10-31 2019-09-03 Waymo Llc Semantic object clustering for autonomous vehicle decision making
US10713940B2 (en) 2017-10-31 2020-07-14 Waymo Llc Detecting and responding to traffic redirection for autonomous vehicles
CN108230379B (zh) * 2017-12-29 2020-12-04 百度在线网络技术（北京）有限公司 用于融合点云数据的方法和装置
CN108460791A (zh) 2017-12-29 2018-08-28 百度在线网络技术（北京）有限公司 用于处理点云数据的方法和装置
WO2019176877A1 (ja) 2018-03-15 2019-09-19 株式会社小糸製作所 オブジェクト識別システム、自動車、車両用灯具、オブジェクトの種類の識別方法
JP7268001B2 (ja) * 2018-04-05 2023-05-02 株式会社小糸製作所 演算処理装置、オブジェクト識別システム、学習方法、自動車、車両用灯具
EP3779871A4 (en) 2018-04-05 2021-05-19 Koito Manufacturing Co., Ltd. ARITHMETIC PROCESSING DEVICE, OBJECT IDENTIFICATION SYSTEM, OBJECT IDENTIFICATION METHOD, AUTOMOTIVE AND VEHICLE LIGHTING UNITS
CN110555449B (zh) * 2018-05-30 2023-03-24 百度在线网络技术（北京）有限公司 用于输出信息的方法和装置
US10845818B2 (en) * 2018-07-30 2020-11-24 Toyota Research Institute, Inc. System and method for 3D scene reconstruction of agent operation sequences using low-level/high-level reasoning and parametric models
US10754338B2 (en) 2018-08-14 2020-08-25 GM Global Technology Operations LLC Controlling an autonomous vehicle based upon labels assigned to objects represented in sensor data
US10878282B2 (en) * 2018-10-15 2020-12-29 Tusimple, Inc. Segmentation processing of image data for LiDAR-based vehicle tracking system and method
US10984540B2 (en) * 2018-10-15 2021-04-20 Tusimple, Inc. Tracking and modeling processing of image data for LiDAR-based vehicle tracking system and method
US10878580B2 (en) 2018-10-15 2020-12-29 Tusimple, Inc. Point cluster refinement processing of image data for LiDAR-based vehicle tracking system and method
US10983530B2 (en) * 2018-10-31 2021-04-20 Wipro Limited Method and system for determining an accurate position of an autonomous vehicle
WO2020110801A1 (ja) 2018-11-30 2020-06-04 株式会社小糸製作所 測距センサおよび車両用灯具、測距方法
WO2020110802A1 (ja) 2018-11-30 2020-06-04 株式会社小糸製作所 車載用物体識別システム、自動車、車両用灯具、分類器の学習方法、演算処理装置
US10891518B1 (en) 2018-12-14 2021-01-12 Waymo Llc Auto labeler
CN109726692A (zh) * 2018-12-29 2019-05-07 重庆集诚汽车电子有限责任公司 基于深度学习的高清摄像头3d目标检测系统
WO2020168464A1 (en) * 2019-02-19 2020-08-27 SZ DJI Technology Co., Ltd. Local sensing based autonomous navigation, and associated systems and methods
US11630209B2 (en) 2019-07-09 2023-04-18 Waymo Llc Laser waveform embedding
EP3795940A1 (de) * 2019-09-19 2021-03-24 sentronics metrology GmbH Vorrichtung und verfahren zur inspektion von flachen objekten und zum erfassen von grenzschichten dieser objekte
US11597406B2 (en) * 2020-02-19 2023-03-07 Uatc, Llc Systems and methods for detecting actors with respect to an autonomous vehicle
CN113870347B (zh) * 2020-06-30 2025-06-06 北京市商汤科技开发有限公司 目标车辆的控制方法、装置、电子设备及存储介质
JP7001795B1 (ja) * 2020-11-13 2022-01-20 株式会社ネクスティエレクトロニクス シミュレーション用のデータ生成装置、方法及びコンピュータプログラム
CN114120271B (zh) * 2021-11-11 2025-11-14 深圳市虹鹏能源科技有限责任公司 一种用于隧道内的轨道识别方法、系统及边缘计算设备
CN114387305B (zh) * 2021-12-30 2025-02-14 驭势科技（北京）有限公司 拖车队列跟踪方法、装置、计算机设备及存储介质
US12461241B1 (en) * 2022-04-28 2025-11-04 Zoox, Inc. Object detection soft consistency checker
KR20240094519A (ko) * 2022-12-16 2024-06-25 현대자동차주식회사 센서 정보 융합 방법 및 장치
DE102024206034A1 (de) 2024-06-28 2025-12-31 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren und Vorrichtung zum Steuern eines Assistenzsystems für ein Fahrzeug und Assistenzsystems für ein Fahrzeug

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3516856B2 (ja) * 1998-01-30 2004-04-05 富士重工業株式会社 車外監視装置
JP4239689B2 (ja) 2003-05-30 2009-03-18 スズキ株式会社 車両用警報システム及び車両用警報発生方法
US7522066B2 (en) 2006-02-23 2009-04-21 Rockwell Automation Technologies, Inc. Systems and methods that evaluate distance to potential hazards utilizing overlapping sensing zones
US7720260B2 (en) * 2006-09-13 2010-05-18 Ford Motor Company Object detection system and method
EP2107503A1 (en) * 2008-03-31 2009-10-07 Harman Becker Automotive Systems GmbH Method and device for generating a real time environment model for vehicles
KR100946723B1 (ko) 2008-04-12 2010-03-12 재단법인서울대학교산학협력재단 차량의 조향 방법 및 그 장치
US8744122B2 (en) * 2008-10-22 2014-06-03 Sri International System and method for object detection from a moving platform
FR2953313B1 (fr) * 2009-11-27 2012-09-21 Thales Sa Systeme optronique et procede d'elaboration d'images en trois dimensions dedies a l'identification
WO2012117528A1 (ja) * 2011-03-01 2012-09-07 トヨタ自動車株式会社 状態推定装置
CN102685382B (zh) * 2011-03-18 2016-01-20 安尼株式会社 图像处理装置和方法、及移动体防碰撞装置
US8605998B2 (en) * 2011-05-06 2013-12-10 Toyota Motor Engineering & Manufacturing North America, Inc. Real-time 3D point cloud obstacle discriminator apparatus and associated methodology for training a classifier via bootstrapping
DE102011101246A1 (de) 2011-05-11 2012-11-15 Conti Temic Microelectronic Gmbh Redudante objektdetektion für fahrerassistenzsysteme
FR2981772B1 (fr) * 2011-10-21 2017-12-22 Thales Sa Procede de reconstruction 3d d'un objet d'une scene
DE102012014300A1 (de) 2012-07-19 2013-01-17 Daimler Ag Verfahren zur Objekterkennung in einer Umgebung eines Kraftwagens sowie Fahrerassistenzsystem zur Objekterkennung in einer Umgebung eines Kraftwagens
US9383753B1 (en) * 2012-09-26 2016-07-05 Google Inc. Wide-view LIDAR with areas of special attention
US8473144B1 (en) * 2012-10-30 2013-06-25 Google Inc. Controlling vehicle lateral lane positioning
US9110163B2 (en) * 2013-06-14 2015-08-18 Microsoft Technology Licensing, Llc Lidar-based classification of object movement
US8989944B1 (en) * 2013-11-26 2015-03-24 Google Inc. Methods and devices for determining movements of an object in an environment
US9091558B2 (en) * 2013-12-23 2015-07-28 Automotive Research & Testing Center Autonomous driver assistance system and autonomous driving method thereof
US9664779B2 (en) * 2014-07-03 2017-05-30 GM Global Technology Operations LLC Object classification for vehicle radar systems

Also Published As

Publication number Publication date
US20170075356A1 (en) 2017-03-16
JP2017056935A (ja) 2017-03-23
US9576185B1 (en) 2017-02-21
DE102016116029A1 (de) 2017-03-23
DE102016116029B4 (de) 2019-05-16

Similar Documents

Publication Publication Date Title
JP6298128B2 (ja) ３ｄセンサにより検出されたオブジェクトの分類
US11885910B2 (en) Hybrid-view LIDAR-based object detection
US12333389B2 (en) Autonomous vehicle system for intelligent on-board selection of data for training a remote machine learning model
US12277752B2 (en) Systems and methods for intelligent selection of data for building a machine learning model
EP3881226B1 (en) Object classification using extra-regional context
US11657591B2 (en) Autonomous vehicle system for intelligent on-board selection of data for building a remote machine learning model
US11841927B2 (en) Systems and methods for determining an object type and an attribute for an observation based on fused sensor data
US10152059B2 (en) Systems and methods for landing a drone on a moving base
US11842430B2 (en) Methods and systems for ground segmentation using graph-cuts
CN116249643A (zh) 由自主车辆预测对象的动作以确定通过冲突区域的可行路径的方法和系统
CN112660128B (zh) 用于确定自动驾驶车辆的车道变更路径的设备及其方法
CN111736142A (zh) 用于雷达交叉交通跟踪和操纵风险评估的系统和方法
CN118115557A (zh) 关联lidar数据和图像数据
EP3867721B1 (en) Method and system for operating a robot
EP4145398A1 (en) Systems and methods for vehicle camera obstruction detection
US20220212694A1 (en) Methods and systems for generating a longitudinal plan for an autonomous vehicle based on behavior of uncertain road users
KR20240047408A (ko) 비전 기반 시스템을 위한 검출된 오브젝트 경로 예측
US11731662B2 (en) Autonomous vehicle system for detecting pedestrian presence
US20230386326A1 (en) Systems and methods for detecting pedestrians with crosswalking or jaywalking intent
US12097860B2 (en) Traveling lane planning device, medium storing computer program for traveling lane planning, and traveling lane planning method

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20171215

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20171215

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20171215

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20180116

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180123

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180222

R150 Certificate of patent or registration of utility model

Ref document number: 6298128

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350