CN117295647A - 具有统一的多传感器视图的传感器模拟 - Google Patents

具有统一的多传感器视图的传感器模拟 Download PDF

Info

Publication number
CN117295647A
CN117295647A CN202280034685.4A CN202280034685A CN117295647A CN 117295647 A CN117295647 A CN 117295647A CN 202280034685 A CN202280034685 A CN 202280034685A CN 117295647 A CN117295647 A CN 117295647A
Authority
CN
China
Prior art keywords
sensor
view
data
dimensional view
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202280034685.4A
Other languages
English (en)
Chinese (zh)
Inventor
A·拉斯里
J·G·多兰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zoox Inc
Original Assignee
Zoox Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zoox Inc filed Critical Zoox Inc
Publication of CN117295647A publication Critical patent/CN117295647A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/803—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of input or preprocessed data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0808—Diagnosing performance data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
CN202280034685.4A 2021-05-14 2022-05-12 具有统一的多传感器视图的传感器模拟 Pending CN117295647A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/321,205 US11741661B2 (en) 2021-05-14 2021-05-14 Sensor simulation with unified multi-sensor views
US17/321,205 2021-05-14
PCT/US2022/029044 WO2022241149A1 (en) 2021-05-14 2022-05-12 Sensor simulation with unified multi-sensor views

Publications (1)

Publication Number Publication Date
CN117295647A true CN117295647A (zh) 2023-12-26

Family

ID=83998708

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202280034685.4A Pending CN117295647A (zh) 2021-05-14 2022-05-12 具有统一的多传感器视图的传感器模拟

Country Status (5)

Country Link
US (1) US11741661B2 (https=)
EP (1) EP4337506A4 (https=)
JP (1) JP2024518570A (https=)
CN (1) CN117295647A (https=)
WO (1) WO2022241149A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11336887B2 (en) * 2019-09-03 2022-05-17 Facebook Technologies, Llc Adaptive shading and reprojection
EP3800518A1 (en) * 2019-10-02 2021-04-07 Siemens Industry Software and Services B.V. System, device and method for testing autonomous vehicles
US11715257B2 (en) 2021-05-14 2023-08-01 Zoox, Inc. Simulation view generation based on simulated sensor operations
US20230278589A1 (en) * 2022-03-07 2023-09-07 Woven By Toyota, Inc. Autonomous driving sensor simulation
US12559129B2 (en) * 2022-03-31 2026-02-24 Zoox, Inc. Capturing and simulating radar data for autonomous driving systems
US12578990B2 (en) * 2022-05-25 2026-03-17 GM Global Technology Operations LLC Simulation system and method
US12340459B2 (en) * 2022-09-21 2025-06-24 Qualcomm Incorporated Systems and methods of image reprojection
KR20250110260A (ko) * 2022-11-11 2025-07-18 와비 이노베이션 인코포레이티드 뉴럴 해시 그리드 기반 다중 센서 시뮬레이션
US20240345250A1 (en) * 2023-04-13 2024-10-17 Aeva, Inc. Techniques for point cloud data sharing between lidar systems

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7952583B2 (en) 2000-06-19 2011-05-31 Mental Images Gmbh Quasi-monte carlo light transport simulation by efficient ray tracing
GB201305402D0 (en) 2013-03-25 2013-05-08 Sony Comp Entertainment Europe Head mountable display
US9996976B2 (en) * 2014-05-05 2018-06-12 Avigilon Fortress Corporation System and method for real-time overlay of map features onto a video feed
US20160210775A1 (en) 2015-01-21 2016-07-21 Ford Global Technologies, Llc Virtual sensor testbed
JP6643775B2 (ja) 2015-01-29 2020-02-12 株式会社バンダイナムコエンターテインメント ゲーム機、ゲームシステム及びプログラム
US10086955B2 (en) 2015-10-23 2018-10-02 The Boeing Company Pattern-based camera pose estimation system
WO2018000038A1 (en) 2016-06-29 2018-01-04 Seeing Machines Limited System and method for identifying a camera pose of a forward facing camera in a vehicle
KR102802307B1 (ko) * 2017-06-14 2025-05-07 모빌아이 비젼 테크놀로지스 엘티디. 자율 주행을 위한 항법 정보의 융합 프레임워크 및 배치 정렬
US10555132B2 (en) 2017-06-23 2020-02-04 Here Global B.V. Metric for evaluating indoor positioning systems
US10762396B2 (en) * 2017-12-05 2020-09-01 Utac, Llc Multiple stage image based object detection and recognition
US20190278698A1 (en) * 2018-03-07 2019-09-12 RightHook, Inc. Autonomous Vehicle Simulation And Testing
CN108470323B (zh) 2018-03-13 2020-07-31 京东方科技集团股份有限公司 一种图像拼接方法、计算机设备及显示装置
CN109271893B (zh) 2018-08-30 2021-01-01 百度在线网络技术（北京）有限公司 一种仿真点云数据的生成方法、装置、设备及存储介质
US20200074233A1 (en) * 2018-09-04 2020-03-05 Luminar Technologies, Inc. Automatically generating training data for a lidar using simulated vehicles in virtual space
WO2020097912A1 (en) 2018-11-16 2020-05-22 Beijing Didi Infinity Technology And Development Co., Ltd. Systems and methods for positioning vehicles under poor lighting conditions
US11170299B2 (en) 2018-12-28 2021-11-09 Nvidia Corporation Distance estimation to objects and free-space boundaries in autonomous machine applications
US11544167B2 (en) 2019-03-23 2023-01-03 Uatc, Llc Systems and methods for generating synthetic sensor data via machine learning
JP6697115B2 (ja) 2019-06-14 2020-05-20 株式会社カンデラジャパン 移動体用画像生成記録表示装置及びプログラム
US11249479B2 (en) 2019-07-18 2022-02-15 Nissan North America, Inc. System to recommend sensor view for quick situational awareness
US11126891B2 (en) * 2019-09-11 2021-09-21 Toyota Research Institute, Inc. Systems and methods for simulating sensor data using a generative model
US11663377B2 (en) * 2019-09-27 2023-05-30 Woven Planet North America, Inc. Sensor arrangement validation using simulated environments
US11308682B2 (en) 2019-10-28 2022-04-19 Apical Limited Dynamic stereoscopic rendering method and processor
US11494995B2 (en) * 2019-10-29 2022-11-08 Magic Leap, Inc. Systems and methods for virtual and augmented reality
US11409927B2 (en) * 2020-09-22 2022-08-09 Beijing Voyager Technology Co., Ltd. Architecture for configurable distributed system simulation timing

Also Published As

Publication number Publication date
US20220366636A1 (en) 2022-11-17
US11741661B2 (en) 2023-08-29
EP4337506A1 (en) 2024-03-20
EP4337506A4 (en) 2025-03-26
JP2024518570A (ja) 2024-05-01
WO2022241149A1 (en) 2022-11-17

Similar Documents

Publication Publication Date Title
US11977386B2 (en) Adversarial scenarios for safety testing of autonomous vehicles
US11544896B2 (en) Spatial and temporal upsampling techniques for simulated sensor data
US11741661B2 (en) Sensor simulation with unified multi-sensor views
US11390301B2 (en) Tensor-based driving scenario characterization
CN113496290B (zh) 使用采用模拟对象增强的图像训练机器学习模型
JP7644094B2 (ja) 自律運転アプリケーションのためのマップ作成及びローカリゼーション
US11926346B2 (en) Behavior planning for autonomous vehicles in yield scenarios
US12346119B2 (en) Obstacle to path assignment and performance of control operations based on assignment for autonomous systems and applications
CN110352153B (zh) 自主车辆中用于障碍物躲避的安全程序分析
US11715257B2 (en) Simulation view generation based on simulated sensor operations
US20220138568A1 (en) Model-based reinforcement learning for behavior prediction
US11275673B1 (en) Simulated LiDAR data
CN116795091A (zh) 自主系统和应用程序的环境重建和路径规划
WO2021262603A1 (en) Sensor fusion for autonomous machine applications using machine learning
WO2021138010A1 (en) Three-dimensional intersection structure prediction for autonomous driving applications
CN115909237A (zh) 在自主机器应用程序中使用深度学习的能见度距离估计
US11928399B1 (en) Simulating object occlusions
US20230311932A1 (en) Merging object and background radar data for autonomous driving simulations
US20240312123A1 (en) Data augmentation for model training in autonomous systems and applications
CN118113036A (zh) 使用超声传感器用于自主系统及应用的传感器融合
US20240410705A1 (en) Path detection using machine learning models for autonomous systems and applications
US20250225721A1 (en) Performing a three-dimensional computer vision task using a neural radiance field grid representation of a scene produced from two-dimensional images of at least a portion of the scene
JP2023066377A (ja) 自律システム及びアプリケーションのための人工知能を使用した点群高密度化を有する３ｄ表面再構成
US11430177B1 (en) Mapping simulated sensors to simulated environment views
US20250341403A1 (en) Track selection in environment reconstruction systems and applications

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination