JP2024518570A - 統合されたマルチセンサビューによるセンサシミュレーション - Google Patents

統合されたマルチセンサビューによるセンサシミュレーション Download PDF

Info

Publication number
JP2024518570A
JP2024518570A JP2023570224A JP2023570224A JP2024518570A JP 2024518570 A JP2024518570 A JP 2024518570A JP 2023570224 A JP2023570224 A JP 2023570224A JP 2023570224 A JP2023570224 A JP 2023570224A JP 2024518570 A JP2024518570 A JP 2024518570A
Authority
JP
Japan
Prior art keywords
sensor
simulated
view
data
generating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2023570224A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022241149A5 (https=
JP2024518570A5 (https=
Inventor
ラスラム アナス
グラハム ドラン ジェームス
Original Assignee
ズークス インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ズークス インコーポレイテッド filed Critical ズークス インコーポレイテッド
Publication of JP2024518570A publication Critical patent/JP2024518570A/ja
Publication of JPWO2022241149A5 publication Critical patent/JPWO2022241149A5/ja
Publication of JP2024518570A5 publication Critical patent/JP2024518570A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/803—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of input or preprocessed data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0808—Diagnosing performance data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
JP2023570224A 2021-05-14 2022-05-12 統合されたマルチセンサビューによるセンサシミュレーション Pending JP2024518570A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/321,205 US11741661B2 (en) 2021-05-14 2021-05-14 Sensor simulation with unified multi-sensor views
US17/321,205 2021-05-14
PCT/US2022/029044 WO2022241149A1 (en) 2021-05-14 2022-05-12 Sensor simulation with unified multi-sensor views

Publications (3)

Publication Number Publication Date
JP2024518570A true JP2024518570A (ja) 2024-05-01
JPWO2022241149A5 JPWO2022241149A5 (https=) 2025-04-28
JP2024518570A5 JP2024518570A5 (https=) 2025-04-28

Family

ID=83998708

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023570224A Pending JP2024518570A (ja) 2021-05-14 2022-05-12 統合されたマルチセンサビューによるセンサシミュレーション

Country Status (5)

Country Link
US (1) US11741661B2 (https=)
EP (1) EP4337506A4 (https=)
JP (1) JP2024518570A (https=)
CN (1) CN117295647A (https=)
WO (1) WO2022241149A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11336887B2 (en) * 2019-09-03 2022-05-17 Facebook Technologies, Llc Adaptive shading and reprojection
EP3800518A1 (en) * 2019-10-02 2021-04-07 Siemens Industry Software and Services B.V. System, device and method for testing autonomous vehicles
US11715257B2 (en) 2021-05-14 2023-08-01 Zoox, Inc. Simulation view generation based on simulated sensor operations
US20230278589A1 (en) * 2022-03-07 2023-09-07 Woven By Toyota, Inc. Autonomous driving sensor simulation
US12559129B2 (en) * 2022-03-31 2026-02-24 Zoox, Inc. Capturing and simulating radar data for autonomous driving systems
US12578990B2 (en) * 2022-05-25 2026-03-17 GM Global Technology Operations LLC Simulation system and method
US12340459B2 (en) * 2022-09-21 2025-06-24 Qualcomm Incorporated Systems and methods of image reprojection
KR20250110260A (ko) * 2022-11-11 2025-07-18 와비 이노베이션 인코포레이티드 뉴럴 해시 그리드 기반 다중 센서 시뮬레이션
US20240345250A1 (en) * 2023-04-13 2024-10-17 Aeva, Inc. Techniques for point cloud data sharing between lidar systems

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200074230A1 (en) * 2018-09-04 2020-03-05 Luminar Technologies, Inc. Automatically generating training data for a lidar using simulated vehicles in virtual space
JP2021506000A (ja) * 2017-12-05 2021-02-18 ユーエーティーシー， エルエルシー 多段画像ベースの物体検出および認識
JP2021036431A (ja) * 2017-06-14 2021-03-04 モービルアイ ビジョン テクノロジーズ リミテッド 自律走行に関する走行情報のフレームワークとバッチ調整との結合

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7952583B2 (en) 2000-06-19 2011-05-31 Mental Images Gmbh Quasi-monte carlo light transport simulation by efficient ray tracing
GB201305402D0 (en) 2013-03-25 2013-05-08 Sony Comp Entertainment Europe Head mountable display
US9996976B2 (en) * 2014-05-05 2018-06-12 Avigilon Fortress Corporation System and method for real-time overlay of map features onto a video feed
US20160210775A1 (en) 2015-01-21 2016-07-21 Ford Global Technologies, Llc Virtual sensor testbed
JP6643775B2 (ja) 2015-01-29 2020-02-12 株式会社バンダイナムコエンターテインメント ゲーム機、ゲームシステム及びプログラム
US10086955B2 (en) 2015-10-23 2018-10-02 The Boeing Company Pattern-based camera pose estimation system
WO2018000038A1 (en) 2016-06-29 2018-01-04 Seeing Machines Limited System and method for identifying a camera pose of a forward facing camera in a vehicle
US10555132B2 (en) 2017-06-23 2020-02-04 Here Global B.V. Metric for evaluating indoor positioning systems
US20190278698A1 (en) * 2018-03-07 2019-09-12 RightHook, Inc. Autonomous Vehicle Simulation And Testing
CN108470323B (zh) 2018-03-13 2020-07-31 京东方科技集团股份有限公司 一种图像拼接方法、计算机设备及显示装置
CN109271893B (zh) 2018-08-30 2021-01-01 百度在线网络技术（北京）有限公司 一种仿真点云数据的生成方法、装置、设备及存储介质
WO2020097912A1 (en) 2018-11-16 2020-05-22 Beijing Didi Infinity Technology And Development Co., Ltd. Systems and methods for positioning vehicles under poor lighting conditions
US11170299B2 (en) 2018-12-28 2021-11-09 Nvidia Corporation Distance estimation to objects and free-space boundaries in autonomous machine applications
US11544167B2 (en) 2019-03-23 2023-01-03 Uatc, Llc Systems and methods for generating synthetic sensor data via machine learning
JP6697115B2 (ja) 2019-06-14 2020-05-20 株式会社カンデラジャパン 移動体用画像生成記録表示装置及びプログラム
US11249479B2 (en) 2019-07-18 2022-02-15 Nissan North America, Inc. System to recommend sensor view for quick situational awareness
US11126891B2 (en) * 2019-09-11 2021-09-21 Toyota Research Institute, Inc. Systems and methods for simulating sensor data using a generative model
US11663377B2 (en) * 2019-09-27 2023-05-30 Woven Planet North America, Inc. Sensor arrangement validation using simulated environments
US11308682B2 (en) 2019-10-28 2022-04-19 Apical Limited Dynamic stereoscopic rendering method and processor
US11494995B2 (en) * 2019-10-29 2022-11-08 Magic Leap, Inc. Systems and methods for virtual and augmented reality
US11409927B2 (en) * 2020-09-22 2022-08-09 Beijing Voyager Technology Co., Ltd. Architecture for configurable distributed system simulation timing

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021036431A (ja) * 2017-06-14 2021-03-04 モービルアイ ビジョン テクノロジーズ リミテッド 自律走行に関する走行情報のフレームワークとバッチ調整との結合
JP2021506000A (ja) * 2017-12-05 2021-02-18 ユーエーティーシー， エルエルシー 多段画像ベースの物体検出および認識
US20200074230A1 (en) * 2018-09-04 2020-03-05 Luminar Technologies, Inc. Automatically generating training data for a lidar using simulated vehicles in virtual space

Also Published As

Publication number Publication date
US20220366636A1 (en) 2022-11-17
CN117295647A (zh) 2023-12-26
US11741661B2 (en) 2023-08-29
EP4337506A1 (en) 2024-03-20
EP4337506A4 (en) 2025-03-26
WO2022241149A1 (en) 2022-11-17

Similar Documents

Publication Publication Date Title
US11544896B2 (en) Spatial and temporal upsampling techniques for simulated sensor data
US11741661B2 (en) Sensor simulation with unified multi-sensor views
US11977386B2 (en) Adversarial scenarios for safety testing of autonomous vehicles
JP7756000B2 (ja) 自律運転アプリケーションのための３次元交差点構造予測
US11390301B2 (en) Tensor-based driving scenario characterization
CN113496290B (zh) 使用采用模拟对象增强的图像训练机器学习模型
JP7586689B2 (ja) ＬｉＤＡＲ知覚のためのマルチビュー・ディープ・ニューラル・ネットワーク
CN113139642B (zh) 在自主驾驶应用中使用神经网络执行故障检测
US11715257B2 (en) Simulation view generation based on simulated sensor operations
CN110352153B (zh) 自主车辆中用于障碍物躲避的安全程序分析
US11275673B1 (en) Simulated LiDAR data
US12339658B2 (en) Generating a scenario using a variable autoencoder conditioned with a diffusion model
JP2023548721A (ja) 自律システム及びアプリケーションにおけるビヘイビア予測のためのモデルベースの強化学習
JP2023507390A (ja) オブジェクトの動きに基づくトップダウンシーンの予測
CN114631117A (zh) 使用机器学习的用于自主机器应用的传感器融合
CN116795091A (zh) 自主系统和应用程序的环境重建和路径规划
US20240212360A1 (en) Generating object data using a diffusion model
CN115909237A (zh) 在自主机器应用程序中使用深度学习的能见度距离估计
US12555043B2 (en) Training a variable autoencoder using a diffusion model
US12353979B2 (en) Generating object representations using a variable autoencoder
US11928399B1 (en) Simulating object occlusions
US12559129B2 (en) Capturing and simulating radar data for autonomous driving systems
US20230311932A1 (en) Merging object and background radar data for autonomous driving simulations
CN118113036A (zh) 使用超声传感器用于自主系统及应用的传感器融合
US11430177B1 (en) Mapping simulated sensors to simulated environment views

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250418

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20250418

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20260122

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260224