JP7372970B2 - 情報処理システム、センサシステム、情報処理方法及びプログラム - Google Patents

情報処理システム、センサシステム、情報処理方法及びプログラム Download PDF

Info

Publication number
JP7372970B2
JP7372970B2 JP2021530357A JP2021530357A JP7372970B2 JP 7372970 B2 JP7372970 B2 JP 7372970B2 JP 2021530357 A JP2021530357 A JP 2021530357A JP 2021530357 A JP2021530357 A JP 2021530357A JP 7372970 B2 JP7372970 B2 JP 7372970B2
Authority
JP
Japan
Prior art keywords
information
processing system
pixel
information processing
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021530357A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2021005659A5 (https=
JPWO2021005659A1 (https=
Inventor
哲郎 奥山
良直 河合
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nuvoton Technology Corp Japan
Original Assignee
Nuvoton Technology Corp Japan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nuvoton Technology Corp Japan filed Critical Nuvoton Technology Corp Japan
Publication of JPWO2021005659A1 publication Critical patent/JPWO2021005659A1/ja
Publication of JPWO2021005659A5 publication Critical patent/JPWO2021005659A5/ja
Application granted granted Critical
Publication of JP7372970B2 publication Critical patent/JP7372970B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/894—Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G01S17/32—Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
    • G01S17/36—Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated with phase comparison between the received signal and the contemporaneously transmitted signal
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4802—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4808—Evaluating distance, position or velocity data
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491—Details of non-pulse systems
    • G01S7/4912—Receivers
    • G01S7/4913—Circuits for detection, sampling, integration or read-out
    • G01S7/4914—Circuits for detection, sampling, integration or read-out of detector arrays, e.g. charge-transfer gates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491—Details of non-pulse systems
    • G01S7/493—Extracting wanted echo signals
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/497—Means for monitoring or calibrating
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range
    • H04N25/58—Control of the dynamic range involving two or more exposures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
    • H04N25/705—Pixels for depth measurement, e.g. RGBZ

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Measurement Of Optical Distance (AREA)
JP2021530357A 2019-07-05 2019-07-05 情報処理システム、センサシステム、情報処理方法及びプログラム Active JP7372970B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/026866 WO2021005659A1 (ja) 2019-07-05 2019-07-05 情報処理システム、センサシステム、情報処理方法及びプログラム

Publications (3)

Publication Number Publication Date
JPWO2021005659A1 JPWO2021005659A1 (https=) 2021-01-14
JPWO2021005659A5 JPWO2021005659A5 (https=) 2022-03-25
JP7372970B2 true JP7372970B2 (ja) 2023-11-01

Family

ID=74113979

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021530357A Active JP7372970B2 (ja) 2019-07-05 2019-07-05 情報処理システム、センサシステム、情報処理方法及びプログラム

Country Status (5)

Country Link
US (1) US20220120910A1 (https=)
EP (1) EP3995858A4 (https=)
JP (1) JP7372970B2 (https=)
CN (1) CN114072699A (https=)
WO (1) WO2021005659A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4315826A1 (en) * 2021-03-23 2024-02-07 Ricoh Company, Ltd. Information processing apparatus and information processing method
JP7138265B1 (ja) * 2021-06-17 2022-09-15 ヌヴォトンテクノロジージャパン株式会社 物体検知装置、物体検知方法およびプログラム
JP7220835B1 (ja) * 2021-07-16 2023-02-10 ヌヴォトンテクノロジージャパン株式会社 物体検知装置および物体検知方法
US20250159329A1 (en) * 2022-02-08 2025-05-15 Sony Semiconductor Solutions Corporation Information processing apparatus
JP7825826B2 (ja) * 2022-07-14 2026-03-09 三菱重工機械システム株式会社 データ処理アルゴリズム評価装置
JP2024157896A (ja) * 2023-04-26 2024-11-08 株式会社小松製作所 検出システム、検出方法、及び作業車両
CN116908877B (zh) * 2023-06-08 2024-09-17 信扬科技(佛山)有限公司 飞行时间相机和深度图像获取方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011128024A (ja) 2009-12-17 2011-06-30 Sharp Corp ３次元撮像装置
WO2013035612A1 (ja) 2011-09-09 2013-03-14 日本電気株式会社 障害物検知装置、障害物検知方法及び障害物検知プログラム
JP2013207415A (ja) 2012-03-27 2013-10-07 Osaka City Univ 撮像システム及び撮像方法
US20140098192A1 (en) 2012-10-10 2014-04-10 Samsung Electronics Co., Ltd. Imaging optical system and 3d image acquisition apparatus including the imaging optical system
JP2015087267A (ja) 2013-10-31 2015-05-07 日産自動車株式会社 物体検出装置
JP2016156913A (ja) 2015-02-24 2016-09-01 日本信号株式会社 光走査装置
JP2018036102A (ja) 2016-08-30 2018-03-08 ソニーセミコンダクタソリューションズ株式会社 測距装置、および、測距装置の制御方法
WO2018101049A1 (ja) 2016-11-29 2018-06-07 パナソニックＩｐマネジメント株式会社 固体撮像装置及び測距撮像装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4038726B2 (ja) 2003-09-03 2008-01-30 株式会社日立プラントテクノロジー 画像対応付け方法
US8139142B2 (en) * 2006-06-01 2012-03-20 Microsoft Corporation Video manipulation of red, green, blue, distance (RGB-Z) data including segmentation, up-sampling, and background substitution techniques
WO2010141631A1 (en) * 2009-06-02 2010-12-09 Velodyne Acoustics, Inc. Color lidar scanner
US8542348B2 (en) * 2010-11-03 2013-09-24 Rockwell Automation Technologies, Inc. Color sensor insensitive to distance variations
JP2016065718A (ja) * 2013-02-08 2016-04-28 三洋電機株式会社 情報取得装置および物体検出装置
JP2016065717A (ja) * 2013-02-08 2016-04-28 三洋電機株式会社 情報取得装置および物体検出装置
US9608027B2 (en) * 2015-02-17 2017-03-28 Omnivision Technologies, Inc. Stacked embedded SPAD image sensor for attached 3D information
US10520904B2 (en) * 2016-09-08 2019-12-31 Mentor Graphics Corporation Event classification and object tracking
EP3438777B1 (en) * 2017-08-04 2022-05-11 Bayerische Motoren Werke Aktiengesellschaft Method, apparatus and computer program for a vehicle
EP3438776B1 (en) * 2017-08-04 2022-09-07 Bayerische Motoren Werke Aktiengesellschaft Method, apparatus and computer program for a vehicle
US10438371B2 (en) * 2017-09-22 2019-10-08 Zoox, Inc. Three-dimensional bounding box from two-dimensional image and point cloud data
US11280907B2 (en) * 2018-12-28 2022-03-22 Texas Instruments Incorporated Depth imaging system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011128024A (ja) 2009-12-17 2011-06-30 Sharp Corp ３次元撮像装置
WO2013035612A1 (ja) 2011-09-09 2013-03-14 日本電気株式会社 障害物検知装置、障害物検知方法及び障害物検知プログラム
JP2013207415A (ja) 2012-03-27 2013-10-07 Osaka City Univ 撮像システム及び撮像方法
US20140098192A1 (en) 2012-10-10 2014-04-10 Samsung Electronics Co., Ltd. Imaging optical system and 3d image acquisition apparatus including the imaging optical system
JP2015087267A (ja) 2013-10-31 2015-05-07 日産自動車株式会社 物体検出装置
JP2016156913A (ja) 2015-02-24 2016-09-01 日本信号株式会社 光走査装置
JP2018036102A (ja) 2016-08-30 2018-03-08 ソニーセミコンダクタソリューションズ株式会社 測距装置、および、測距装置の制御方法
WO2018101049A1 (ja) 2016-11-29 2018-06-07 パナソニックＩｐマネジメント株式会社 固体撮像装置及び測距撮像装置

Also Published As

Publication number Publication date
WO2021005659A1 (ja) 2021-01-14
EP3995858A1 (en) 2022-05-11
EP3995858A4 (en) 2023-01-11
CN114072699A (zh) 2022-02-18
US20220120910A1 (en) 2022-04-21
JPWO2021005659A1 (https=) 2021-01-14

Similar Documents

Publication Publication Date Title
JP7372970B2 (ja) 情報処理システム、センサシステム、情報処理方法及びプログラム
JP4970516B2 (ja) 周囲確認支援装置
US11004233B1 (en) Intelligent vision-based detection and ranging system and method
KR102811949B1 (ko) 대상체 시퀀스를 사용한 대상체 이동성 파라미터들의 결정
US10708557B1 (en) Multispectrum, multi-polarization (MSMP) filtering for improved perception of difficult to perceive colors
JP5714940B2 (ja) 移動体位置測定装置
WO2005088971A1 (ja) 画像生成装置、画像生成方法、および画像生成プログラム
WO2020123259A1 (en) Multichannel, multi-polarization imaging for improved perception
KR102167835B1 (ko) 영상 처리 방법 및 장치
CN116935281A (zh) 基于雷达和视频的机动车道异常行为在线监测方法及设备
AU2024288921A1 (en) System with image capturing means
WO2022215371A1 (ja) 情報処理装置及び情報処理方法
JP7138265B1 (ja) 物体検知装置、物体検知方法およびプログラム
US20240129604A1 (en) Plenoptic sensor devices, systems, and methods
KR20130065281A (ko) 위치 정보 제공 장치 및 방법
Leberl et al. Aerial computer vision for a 3d virtual habitat
WO2022264894A1 (ja) 物体検知装置、物体検知方法およびプログラム
JP7688863B1 (ja) 情報処理方法、プログラム、情報処理装置
US20240319375A1 (en) Precision prediction of time-of-flight sensor measurements
KR102887298B1 (ko) 다중 이미지의 분할 배열 방식 기반 데이터 구축 및 학습 시스템, 방법
US20240062349A1 (en) Enhanced high dynamic range pipeline for three-dimensional image signal processing
CN120219253A (zh) 图像处理方法、车辆、电子设备及存储介质
KR20250092206A (ko) 주석을 위한 컬러 맵 레이어
CN119104082A (zh) 一种车辆虚像显示数据的生成方法、装置及系统

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211228

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220530

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230214

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230417

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230704

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230904

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230926

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20231020

R150 Certificate of patent or registration of utility model

Ref document number: 7372970

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150