DE102016116029B4 - Klassifikation von durch 3D-Sensoren erfassten Objekten - Google Patents

Klassifikation von durch 3D-Sensoren erfassten Objekten Download PDF

Info

Publication number
DE102016116029B4
DE102016116029B4 DE102016116029.6A DE102016116029A DE102016116029B4 DE 102016116029 B4 DE102016116029 B4 DE 102016116029B4 DE 102016116029 A DE102016116029 A DE 102016116029A DE 102016116029 B4 DE102016116029 B4 DE 102016116029B4
Authority
DE
Germany
Prior art keywords
track
cluster
vehicle
clusters
identified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
DE102016116029.6A
Other languages
German (de)
English (en)
Other versions
DE102016116029A1 (de
Inventor
Michael J. Delp
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Original Assignee
Toyota Motor Engineering and Manufacturing North America Inc
Toyota Engineering and Manufacturing North America Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Engineering and Manufacturing North America Inc, Toyota Engineering and Manufacturing North America Inc filed Critical Toyota Motor Engineering and Manufacturing North America Inc
Publication of DE102016116029A1 publication Critical patent/DE102016116029A1/de
Application granted granted Critical
Publication of DE102016116029B4 publication Critical patent/DE102016116029B4/de
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0242—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using non-visible light signals, e.g. IR or UV signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0238—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors
    • G05D1/024—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors in combination with a laser
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0251—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Electromagnetism (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Image Analysis (AREA)
DE102016116029.6A 2015-09-14 2016-08-29 Klassifikation von durch 3D-Sensoren erfassten Objekten Expired - Fee Related DE102016116029B4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/852,806 2015-09-14
US14/852,806 US9576185B1 (en) 2015-09-14 2015-09-14 Classifying objects detected by 3D sensors for autonomous vehicle operation

Publications (2)

Publication Number Publication Date
DE102016116029A1 DE102016116029A1 (de) 2017-03-23
DE102016116029B4 true DE102016116029B4 (de) 2019-05-16

Family

ID=58017693

Family Applications (1)

Application Number Title Priority Date Filing Date
DE102016116029.6A Expired - Fee Related DE102016116029B4 (de) 2015-09-14 2016-08-29 Klassifikation von durch 3D-Sensoren erfassten Objekten

Country Status (3)

Country Link
US (1) US9576185B1 (cg-RX-API-DMAC7.html)
JP (1) JP6298128B2 (cg-RX-API-DMAC7.html)
DE (1) DE102016116029B4 (cg-RX-API-DMAC7.html)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10121082B2 (en) * 2015-10-07 2018-11-06 Honda Motor Co., Ltd. System and method for providing laser camera fusion for identifying and tracking a traffic participant
EP3381016A4 (en) * 2015-11-26 2019-06-12 Sportlogiq Inc. SYSTEMS AND METHODS FOR OBJECT TRACKING AND VORTICATION IN VIDEOS WITH ADAPTIVE IMAGE DISPLAY
US9961261B2 (en) * 2016-06-20 2018-05-01 Gopro, Inc. Image alignment using a virtual gyroscope model
US10740658B2 (en) * 2016-09-08 2020-08-11 Mentor Graphics Corporation Object recognition and classification using multiple sensor modalities
US11390557B2 (en) * 2017-03-30 2022-07-19 Agc Glass Europe Glass for autonomous car
US10710579B2 (en) * 2017-06-01 2020-07-14 Waymo Llc Collision prediction system
US11573573B2 (en) 2017-06-06 2023-02-07 Plusai, Inc. Method and system for distributed learning and adaptation in autonomous driving vehicles
US11392133B2 (en) 2017-06-06 2022-07-19 Plusai, Inc. Method and system for object centric stereo in autonomous driving vehicles
US11042155B2 (en) * 2017-06-06 2021-06-22 Plusai Limited Method and system for closed loop perception in autonomous driving vehicles
EP3671279B1 (en) 2017-08-18 2024-08-14 Koito Manufacturing Co., Ltd. Recognition sensor, control method therefor, automobile, vehicle light fixture, object identification system, and object identification method
US10713940B2 (en) 2017-10-31 2020-07-14 Waymo Llc Detecting and responding to traffic redirection for autonomous vehicles
US10401862B2 (en) 2017-10-31 2019-09-03 Waymo Llc Semantic object clustering for autonomous vehicle decision making
CN108460791A (zh) 2017-12-29 2018-08-28 百度在线网络技术（北京）有限公司 用于处理点云数据的方法和装置
CN108230379B (zh) * 2017-12-29 2020-12-04 百度在线网络技术（北京）有限公司 用于融合点云数据的方法和装置
EP3767338B1 (en) 2018-03-15 2026-01-28 Koito Manufacturing Co., Ltd. Object identification system, automobile, vehicular lamp fitting, and method for identifying type of object
WO2019194255A1 (ja) 2018-04-05 2019-10-10 株式会社小糸製作所 演算処理装置、オブジェクト識別システム、オブジェクト識別方法、自動車、車両用灯具
CN112005245A (zh) * 2018-04-05 2020-11-27 株式会社小糸制作所 运算处理装置、对象识别系统、学习方法、汽车、车辆用灯具
CN110555449B (zh) * 2018-05-30 2023-03-24 百度在线网络技术（北京）有限公司 用于输出信息的方法和装置
US10845818B2 (en) * 2018-07-30 2020-11-24 Toyota Research Institute, Inc. System and method for 3D scene reconstruction of agent operation sequences using low-level/high-level reasoning and parametric models
US10754338B2 (en) 2018-08-14 2020-08-25 GM Global Technology Operations LLC Controlling an autonomous vehicle based upon labels assigned to objects represented in sensor data
US10984540B2 (en) * 2018-10-15 2021-04-20 Tusimple, Inc. Tracking and modeling processing of image data for LiDAR-based vehicle tracking system and method
US10878580B2 (en) 2018-10-15 2020-12-29 Tusimple, Inc. Point cluster refinement processing of image data for LiDAR-based vehicle tracking system and method
US10878282B2 (en) * 2018-10-15 2020-12-29 Tusimple, Inc. Segmentation processing of image data for LiDAR-based vehicle tracking system and method
US10983530B2 (en) * 2018-10-31 2021-04-20 Wipro Limited Method and system for determining an accurate position of an autonomous vehicle
JP7339277B2 (ja) 2018-11-30 2023-09-05 株式会社小糸製作所 測距センサおよび車両用灯具、測距方法
JP7288460B2 (ja) 2018-11-30 2023-06-07 株式会社小糸製作所 車載用物体識別システム、自動車、車両用灯具、分類器の学習方法、演算処理装置
US10891518B1 (en) 2018-12-14 2021-01-12 Waymo Llc Auto labeler
CN109726692A (zh) * 2018-12-29 2019-05-07 重庆集诚汽车电子有限责任公司 基于深度学习的高清摄像头3d目标检测系统
CN111837136B (zh) * 2019-02-19 2025-02-14 深圳市卓驭科技有限公司 基于本地感测的自主导航以及相关联的系统和方法
US11630209B2 (en) 2019-07-09 2023-04-18 Waymo Llc Laser waveform embedding
EP3795940A1 (de) * 2019-09-19 2021-03-24 sentronics metrology GmbH Vorrichtung und verfahren zur inspektion von flachen objekten und zum erfassen von grenzschichten dieser objekte
US11597406B2 (en) * 2020-02-19 2023-03-07 Uatc, Llc Systems and methods for detecting actors with respect to an autonomous vehicle
CN113870347B (zh) * 2020-06-30 2025-06-06 北京市商汤科技开发有限公司 目标车辆的控制方法、装置、电子设备及存储介质
JP7001795B1 (ja) * 2020-11-13 2022-01-20 株式会社ネクスティエレクトロニクス シミュレーション用のデータ生成装置、方法及びコンピュータプログラム
IL282873A (en) 2021-05-03 2022-12-01 Israel Aerospace Ind Ltd Systems and method for tracking and classifying moving objects
CN114120271B (zh) * 2021-11-11 2025-11-14 深圳市虹鹏能源科技有限责任公司 一种用于隧道内的轨道识别方法、系统及边缘计算设备
CN114387305B (zh) * 2021-12-30 2025-02-14 驭势科技（北京）有限公司 拖车队列跟踪方法、装置、计算机设备及存储介质
US12461241B1 (en) * 2022-04-28 2025-11-04 Zoox, Inc. Object detection soft consistency checker
CN115755021B (zh) * 2022-10-31 2026-08-04 东风商用车有限公司 一种毫米波雷达目标跟踪方法、装置、设备及存储介质
KR20240094519A (ko) * 2022-12-16 2024-06-25 현대자동차주식회사 센서 정보 융합 방법 및 장치
DE102024206034A1 (de) 2024-06-28 2025-12-31 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren und Vorrichtung zum Steuern eines Assistenzsystems für ein Fahrzeug und Assistenzsystems für ein Fahrzeug

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011101246A1 (de) 2011-05-11 2012-11-15 Conti Temic Microelectronic Gmbh Redudante objektdetektion für fahrerassistenzsysteme
DE102012014300A1 (de) 2012-07-19 2013-01-17 Daimler Ag Verfahren zur Objekterkennung in einer Umgebung eines Kraftwagens sowie Fahrerassistenzsystem zur Objekterkennung in einer Umgebung eines Kraftwagens

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3516856B2 (ja) * 1998-01-30 2004-04-05 富士重工業株式会社 車外監視装置
JP4239689B2 (ja) 2003-05-30 2009-03-18 スズキ株式会社 車両用警報システム及び車両用警報発生方法
US7522066B2 (en) 2006-02-23 2009-04-21 Rockwell Automation Technologies, Inc. Systems and methods that evaluate distance to potential hazards utilizing overlapping sensing zones
US7720260B2 (en) * 2006-09-13 2010-05-18 Ford Motor Company Object detection system and method
EP2107503A1 (en) * 2008-03-31 2009-10-07 Harman Becker Automotive Systems GmbH Method and device for generating a real time environment model for vehicles
KR100946723B1 (ko) 2008-04-12 2010-03-12 재단법인서울대학교산학협력재단 차량의 조향 방법 및 그 장치
US8744122B2 (en) * 2008-10-22 2014-06-03 Sri International System and method for object detection from a moving platform
FR2953313B1 (fr) * 2009-11-27 2012-09-21 Thales Sa Systeme optronique et procede d'elaboration d'images en trois dimensions dedies a l'identification
US20130332112A1 (en) * 2011-03-01 2013-12-12 Toyota Jidosha Kabushiki Kaisha State estimation device
CN102685382B (zh) * 2011-03-18 2016-01-20 安尼株式会社 图像处理装置和方法、及移动体防碰撞装置
US8605998B2 (en) * 2011-05-06 2013-12-10 Toyota Motor Engineering & Manufacturing North America, Inc. Real-time 3D point cloud obstacle discriminator apparatus and associated methodology for training a classifier via bootstrapping
FR2981772B1 (fr) * 2011-10-21 2017-12-22 Thales Sa Procede de reconstruction 3d d'un objet d'une scene
US9383753B1 (en) * 2012-09-26 2016-07-05 Google Inc. Wide-view LIDAR with areas of special attention
US8473144B1 (en) * 2012-10-30 2013-06-25 Google Inc. Controlling vehicle lateral lane positioning
US9110163B2 (en) * 2013-06-14 2015-08-18 Microsoft Technology Licensing, Llc Lidar-based classification of object movement
US8989944B1 (en) * 2013-11-26 2015-03-24 Google Inc. Methods and devices for determining movements of an object in an environment
US9091558B2 (en) * 2013-12-23 2015-07-28 Automotive Research & Testing Center Autonomous driver assistance system and autonomous driving method thereof
US9664779B2 (en) * 2014-07-03 2017-05-30 GM Global Technology Operations LLC Object classification for vehicle radar systems

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011101246A1 (de) 2011-05-11 2012-11-15 Conti Temic Microelectronic Gmbh Redudante objektdetektion für fahrerassistenzsysteme
DE102012014300A1 (de) 2012-07-19 2013-01-17 Daimler Ag Verfahren zur Objekterkennung in einer Umgebung eines Kraftwagens sowie Fahrerassistenzsystem zur Objekterkennung in einer Umgebung eines Kraftwagens

Also Published As

Publication number Publication date
US9576185B1 (en) 2017-02-21
DE102016116029A1 (de) 2017-03-23
JP2017056935A (ja) 2017-03-23
JP6298128B2 (ja) 2018-03-20
US20170075356A1 (en) 2017-03-16

Similar Documents

Publication Publication Date Title
DE102016116029A1 (de) Klassifikation von durch 3D-Sensoren erfassten Objekten
DE112021006101T5 (de) Systeme und Verfahren zur Objektdetektion mit LiDAR-Dekorrelation
US10152649B2 (en) Detecting visual information corresponding to an animal
DE102021112349A1 (de) Fahrzeugbetrieb unter verwendung eines dynamischen belegungsrasters
DE102018129295A1 (de) Systeme und Verfahren zum Abbilden von Fahrbahnstörobjekten in autonomen Fahrzeugen
DE102020121865A1 (de) Potenzielle-kollision-warnsystem basierend auf verkehrsteilnehmerabsichtsvorhersage
DE112021005607T5 (de) Systeme und Verfahren für kamera-LiDAR-fusionierte Objektdetektion
DE102018121791A1 (de) Systeme und Verfahren zur Bestimmung des Vorhandenseins von Verkehrssteuerungspersonal und Verkehrsleitschildern
DE102010005290A1 (de) Vereinigungsmodul für mehrere Objekte für ein Kollisionsvorbereitungssystem
DE112021000482T5 (de) Erkennung von fremdkörpern in einem fahrzeugweg
DE102018108361A1 (de) Laubwerkerfassungstrainingssysteme und -verfahren
DE102018133441A1 (de) Verfahren und System zum Bestimmen von Landmarken in einer Umgebung eines Fahrzeugs
DE102013113619A1 (de) Probabilistische Zielauswahl und Gefahrbewertungsverfahren und Anwendung auf ein Kreuzungs-Kollisonswarnsystem
EP3961479B1 (de) Verfahren und vorrichtung zur klassifizierung von targets
DE102022130540A1 (de) Systeme und verfahren zur vermeidung von fehldetektionen von verfolgten objekten in der umgebenden umgebung eines fahrzeugs
DE112021006760T5 (de) Verfahren und Systeme zur Erstellung eines Longitudinalplans für ein autonomes Fahrzeug basierend auf dem Verhalten unsicherer Verkehrsteilnehmer
DE112022001403T5 (de) Lichtinterferenzdetektion während der fahrzeugnavigation
DE102022130559A1 (de) Systeme und verfahren für verbesserte dreidimensionale datenzuordnung unter verwendung von informationen aus zweidimensionalen bildern
DE112020003845T5 (de) Vorrichtung, messungsvorrichtung, entfernungsmessungssystem und verfahren
DE112016003241T5 (de) Verfahren, Steuereinheit und System zum Erkennen und Verfolgen verletzlicher Verkehrsteilnehmer
DE112019006281T5 (de) Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und programm
DE102021128041A1 (de) Verbesserung eines neuronalen fahrzeugnetzwerks
US20220406077A1 (en) Method and system for estimating road lane geometry
DE102024113845A1 (de) Maschinelles lernen zum betreiben einer beweglichen vorrichtung
DE102017200644B4 (de) Verfahren und Vorrichtung zum Erkennen eines Fahrzeuginsassen in einem Fahrzeug unter Verwendung zumindest eines im Fahrzeug befindlichen RFID-Transponders

Legal Events

Date Code Title Description
R012 Request for examination validly filed
R081 Change of applicant/patentee

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, TOYOTA-SHI, JP

Free format text: FORMER OWNER: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA INC., ERLANGER, KY., US

Owner name: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH, US

Free format text: FORMER OWNER: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA INC., ERLANGER, KY., US

R082 Change of representative

Representative=s name: KUHNEN & WACKER PATENT- UND RECHTSANWALTSBUERO, DE

R016 Response to examination communication
R018 Grant decision by examination section/examining division
R081 Change of applicant/patentee

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, TOYOTA-SHI, JP

Free format text: FORMER OWNER: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC., PLANO, TEX., US

R082 Change of representative

Representative=s name: KUHNEN & WACKER PATENT- UND RECHTSANWALTSBUERO, DE

R081 Change of applicant/patentee

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, TOYOTA-SHI, JP

Free format text: FORMER OWNER: TOYOTA JIDOSHA KABUSHIKI KAISHA, TOYOTA-SHI, AICHI-KEN, JP

R082 Change of representative

Representative=s name: KUHNEN & WACKER PATENT- UND RECHTSANWALTSBUERO, DE

R020 Patent grant now final
R119 Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal fee