JP7632470B2 - データ処理装置、データ処理方法、及びプログラム - Google Patents

データ処理装置、データ処理方法、及びプログラム Download PDF

Info

Publication number
JP7632470B2
JP7632470B2 JP2022544985A JP2022544985A JP7632470B2 JP 7632470 B2 JP7632470 B2 JP 7632470B2 JP 2022544985 A JP2022544985 A JP 2022544985A JP 2022544985 A JP2022544985 A JP 2022544985A JP 7632470 B2 JP7632470 B2 JP 7632470B2
Authority
JP
Japan
Prior art keywords
camera
image
radar
depth distance
coordinate system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022544985A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022044187A1 (https=
JPWO2022044187A5 (https=
Inventor
一峰 小倉
ナグマ サムリーン カーン
達哉 住谷
慎吾 山之内
正行 有吉
俊之 野村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Publication of JPWO2022044187A1 publication Critical patent/JPWO2022044187A1/ja
Publication of JPWO2022044187A5 publication Critical patent/JPWO2022044187A5/ja
Application granted granted Critical
Publication of JP7632470B2 publication Critical patent/JP7632470B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/806—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of extracted features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Radar Systems Or Details Thereof (AREA)
JP2022544985A 2020-08-27 2020-08-27 データ処理装置、データ処理方法、及びプログラム Active JP7632470B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/032314 WO2022044187A1 (ja) 2020-08-27 2020-08-27 データ処理装置、データ処理方法、及びプログラム

Publications (3)

Publication Number Publication Date
JPWO2022044187A1 JPWO2022044187A1 (https=) 2022-03-03
JPWO2022044187A5 JPWO2022044187A5 (https=) 2023-04-28
JP7632470B2 true JP7632470B2 (ja) 2025-02-19

Family

ID=80352867

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022544985A Active JP7632470B2 (ja) 2020-08-27 2020-08-27 データ処理装置、データ処理方法、及びプログラム

Country Status (4)

Country Link
US (1) US20230342879A1 (https=)
JP (1) JP7632470B2 (https=)
PH (1) PH12021551132A1 (https=)
WO (1) WO2022044187A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115496086A (zh) * 2022-09-30 2022-12-20 深圳市四度魔豆科技有限公司 一种用于移动物体的视觉引导方法及装置
JP2024097571A (ja) * 2023-01-06 2024-07-19 株式会社日立製作所 環境認識装置並びに環境認識方法
AU2024249353A1 (en) * 2023-03-24 2025-10-02 i-PRO Co., Ltd. Monitoring device and monitoring system
CN118555498A (zh) * 2024-05-20 2024-08-27 北京眸视科技有限公司 一种设备图像采集方法、机器人、计算机设备及存储介质

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007532907A (ja) 2004-04-14 2007-11-15 セイフビュー・インコーポレーテッド 強化された監視被写体撮像
US8587637B1 (en) 2010-05-07 2013-11-19 Lockheed Martin Corporation Three dimensional ladar imaging and methods using voxels
WO2017085755A1 (en) 2015-11-19 2017-05-26 Nec Corporation An advanced security system, an advanced security method and an advanced security program
EP3525000A1 (en) 2018-02-09 2019-08-14 Bayerische Motoren Werke Aktiengesellschaft Methods and apparatuses for object detection in a scene based on lidar data and radar data of the scene
US10451712B1 (en) 2019-03-11 2019-10-22 Plato Systems, Inc. Radar data collection and labeling for machine learning
WO2019234852A1 (ja) 2018-06-06 2019-12-12 日本電気株式会社 レーダ信号画像化装置、レーダ信号画像化方法およびレーダ信号画像化プログラム
US20200174112A1 (en) 2018-12-03 2020-06-04 CMMB Vision USA Inc. Method and apparatus for enhanced camera and radar sensor fusion
JP2020126607A (ja) 2019-01-31 2020-08-20 株式会社ストラドビジョンＳｔｒａｄｖｉｓｉｏｎ，Ｉｎｃ． カメラから取得されたイメージと、それに対応するレーダまたはライダを通じて取得されたポイントクラウドマップをニューラルネットワークのそれぞれのコンボリューションステージごとに統合する学習方法及び学習装置、そしてそれを利用したテスト方法及びテスト装置
JP7211510B2 (ja) 2019-06-18 2023-01-24 日本電気株式会社 レーダシステムおよびイメージング方法
JP7298708B2 (ja) 2019-11-19 2023-06-27 日本電気株式会社 対象物検出装置、対象物検出方法、及びプログラム
JP2023109699A (ja) 2022-01-27 2023-08-08 日本電気株式会社 ピークラベル物体検出システム、ピークラベル物体検出方法およびプログラム
JP7351345B2 (ja) 2019-10-25 2023-09-27 日本電気株式会社 画像生成装置、画像生成方法、及びプログラム
JP7435824B2 (ja) 2020-11-27 2024-02-21 日本電気株式会社 レーダ装置、イメージング方法、およびプログラム

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007532907A (ja) 2004-04-14 2007-11-15 セイフビュー・インコーポレーテッド 強化された監視被写体撮像
US8587637B1 (en) 2010-05-07 2013-11-19 Lockheed Martin Corporation Three dimensional ladar imaging and methods using voxels
WO2017085755A1 (en) 2015-11-19 2017-05-26 Nec Corporation An advanced security system, an advanced security method and an advanced security program
EP3525000A1 (en) 2018-02-09 2019-08-14 Bayerische Motoren Werke Aktiengesellschaft Methods and apparatuses for object detection in a scene based on lidar data and radar data of the scene
WO2019234852A1 (ja) 2018-06-06 2019-12-12 日本電気株式会社 レーダ信号画像化装置、レーダ信号画像化方法およびレーダ信号画像化プログラム
US20200174112A1 (en) 2018-12-03 2020-06-04 CMMB Vision USA Inc. Method and apparatus for enhanced camera and radar sensor fusion
JP2020126607A (ja) 2019-01-31 2020-08-20 株式会社ストラドビジョンＳｔｒａｄｖｉｓｉｏｎ，Ｉｎｃ． カメラから取得されたイメージと、それに対応するレーダまたはライダを通じて取得されたポイントクラウドマップをニューラルネットワークのそれぞれのコンボリューションステージごとに統合する学習方法及び学習装置、そしてそれを利用したテスト方法及びテスト装置
US10451712B1 (en) 2019-03-11 2019-10-22 Plato Systems, Inc. Radar data collection and labeling for machine learning
JP7211510B2 (ja) 2019-06-18 2023-01-24 日本電気株式会社 レーダシステムおよびイメージング方法
JP7351345B2 (ja) 2019-10-25 2023-09-27 日本電気株式会社 画像生成装置、画像生成方法、及びプログラム
JP7298708B2 (ja) 2019-11-19 2023-06-27 日本電気株式会社 対象物検出装置、対象物検出方法、及びプログラム
JP7435824B2 (ja) 2020-11-27 2024-02-21 日本電気株式会社 レーダ装置、イメージング方法、およびプログラム
JP2023109699A (ja) 2022-01-27 2023-08-08 日本電気株式会社 ピークラベル物体検出システム、ピークラベル物体検出方法およびプログラム

Non-Patent Citations (10)

* Cited by examiner, † Cited by third party
Title
CARRER, Leonardo; YAROVOY, Alexander G.，"Concealed Weapon Detection Using UWB 3-D Radar Imaging and Automatic Target Recognition"，The 8th European Conference on Antennas and Propagation (EuCAP 2014)，2014年04月06日，pp. 2786-2790，DOI: 10.1109/EuCAP.2014.6902403
KHAN, Nagma S.; OGURA, Kazumine; COSATTO, Eric; ARIYOSHI, Masayuki，"Real-time Concealed Weapon Detection on 3D Radar Images for Walk-through Screening System"，2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)，2023年01月02日，pp. 673-681，DOI: 10.1109/WACV56688.2023.00074
KHAN, Nagma S; OGURA, Kazumine; SUMIYA, Tatsuya; ARIYOSHI, Masayuki，"Whole Body Object Detection on Radar Images Captured by Coupled-Panel"，電子情報通信学会２０２１年総合大会講演論文集 通信１，2021年02月23日，p. 477
KHAN, Nagma Samreen; OGURA, Kazumine; ARIYOSHI, Masayuki，"Compressed Representation of 3D Complex Radar Image for Real-Time Object Detection"，電子情報通信学会２０２０年総合大会講演論文集 通信１，2020年03月03日，p. 514
SHEEN, David M.; MCMAKIN, Douglas L.; HALL, Thomas E.，"Three-Dimensional Millimeter-Wave Imaging for Concealed Weapon Detection"，IEEE Transactions on Microwave Theory and Techniques，2001年09月，Vol. 49, No.9，pp. 1581-1592，DOI: 10.1109/22.942570
SUMIYA, Tatsuya; OGURA, Kazumine; YAMANOUCHI, Shingo; KHAN, Nagma; ARIYOSHI, Masayuki; NOMURA, Toshiyuki，"Motion Blur Suppression Accommodating to Fast Radar Imaging for Walk-Through Concealed Weapon Detection"，2020 IEEE Radar Conference (RadarConf20)，2020年09月21日，DOI: 10.1109/RadarConf2043947.2020.9266439
住谷達哉；小倉一峰；山之内慎吾；野村俊之；有吉正行，"対向パネルレーダ連携による人体の全周イメージング"，電子情報通信学会２０２１年総合大会講演論文集 通信１，2021年02月23日，p. 476
小倉一峰；住谷達哉；カーンナグマ；山之内慎吾；有吉正行，"マイクロ波レーダを用いたウォークスルー危険物検知システム"，電子情報通信学会２０２０年総合大会講演論文集 通信１，2020年03月03日，p. 513
小倉一峰；住谷達哉；カーンナグマ；山之内慎吾；野村俊之；有吉正行，"マイクロ波対向パネルレーダによるウォークスルー危険物検知システム"，電子情報通信学会２０２１年総合大会講演論文集 通信１，2021年02月23日，p. 475
有吉正行；小倉一峰；野村俊之；森本伸一；本條翔，"インビジブルセンシング技術によるウォークスルーセキュリティ検査"，ＮＥＣ技報，日本電気株式会社，2021年08月01日，Vol. 74, No. 1，pp. 98-103

Also Published As

Publication number Publication date
US20230342879A1 (en) 2023-10-26
WO2022044187A1 (ja) 2022-03-03
JPWO2022044187A1 (https=) 2022-03-03
PH12021551132A1 (en) 2022-02-21

Similar Documents

Publication Publication Date Title
JP7632470B2 (ja) データ処理装置、データ処理方法、及びプログラム
US11244197B2 (en) Fast and robust multimodal remote sensing image matching method and system
JP2021530821A (ja) 三次元無線モデル構築を実行するための方法、装置およびコンピュータプログラム
CN108139475A (zh) 信号处理设备、信号处理方法和程序
CN110706278A (zh) 一种基于激光雷达和摄像头的物体识别方法和装置
WO2012120856A1 (ja) 物体検出装置及び物体検出方法
CN103890606A (zh) 用于使用雷达-光学成像融合来创建地图的方法和系统
CN106052646A (zh) 信息处理装置及信息处理方法
JP6172432B2 (ja) 被写体識別装置、被写体識別方法および被写体識別プログラム
US20220373683A1 (en) Image processing device, monitoring system, and image processing method
CN114519845A (zh) 多传感数据融合方法、装置、计算机设备和存储介质
WO2017038659A1 (ja) 運動検出装置及びそれを用いた三次元形状測定装置
WO2015049853A1 (ja) 寸法計測装置、寸法計測方法、寸法計測システム、プログラム
KR102274824B1 (ko) 홀로그램 기반 홈퍼니싱 시뮬레이션 시스템 및 방법
JPWO2022044187A5 (https=)
US20220148205A1 (en) Foreign matter detection device, foreign matter detection method, and program
JP2011053197A (ja) 物体の自動認識方法及び物体の自動認識装置
JP7156374B2 (ja) レーダ信号画像化装置、レーダ信号画像化方法およびレーダ信号画像化プログラム
US12586231B2 (en) Posture estimation apparatus, posture estimation method, and computer-readable recording medium
EP2911392B1 (en) Parallax calculation system, information processing apparatus, information processing method, and program
EP4443383A1 (en) Three-dimensional model generation method and three-dimensional model generation device
CN111339840A (zh) 人脸检测方法和监控系统
US20240114119A1 (en) Image processing device, image processing method, and program
JP7268732B2 (ja) レーダシステム、イメージング方法およびイメージングプログラム
Zhao et al. Robust multiple object tracking in RGB-D camera networks

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230215

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230215

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240326

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240527

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240806

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241007

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250107

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250120

R150 Certificate of patent or registration of utility model

Ref document number: 7632470

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150