JP7279721B2 - 物体認識装置、物体認識方法および物体認識プログラム - Google Patents

物体認識装置、物体認識方法および物体認識プログラム Download PDF

Info

Publication number
JP7279721B2
JP7279721B2 JP2020554806A JP2020554806A JP7279721B2 JP 7279721 B2 JP7279721 B2 JP 7279721B2 JP 2020554806 A JP2020554806 A JP 2020554806A JP 2020554806 A JP2020554806 A JP 2020554806A JP 7279721 B2 JP7279721 B2 JP 7279721B2
Authority
JP
Japan
Prior art keywords
object recognition
learning model
scene
unit
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020554806A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2020090251A1 (ja
Inventor
康則 二木
吉弘 三島
篤司 福里
淳 中山田
健治 傍田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Publication of JPWO2020090251A1 publication Critical patent/JPWO2020090251A1/ja
Application granted granted Critical
Publication of JP7279721B2 publication Critical patent/JP7279721B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/865—Combination of radar systems with lidar systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/867—Combination of radar systems with cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/41—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • G01S7/417—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section involving the use of neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06F18/2148—Generating training patterns; Bootstrap methods, e.g. bagging or boosting characterised by the process organisation or structure, e.g. boosting cascade
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G06F18/2193—Validation; Performance evaluation; Active pattern learning techniques based on specific statistical tests
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/285—Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06V10/7747—Organisation of the process, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/778—Active pattern-learning, e.g. online learning of image or video features
    • G06V10/7796—Active pattern-learning, e.g. online learning of image or video features based on specific statistical tests
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/87—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using selection of the recognition techniques, e.g. of a classifier in a multiple classifier system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/20—Ensemble learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08—Detecting or categorising vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
JP2020554806A 2018-10-30 2019-09-13 物体認識装置、物体認識方法および物体認識プログラム Active JP7279721B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2018203943 2018-10-30
JP2018203943 2018-10-30
PCT/JP2019/036152 WO2020090251A1 (fr) 2018-10-30 2019-09-13 Dispositif, procédé et programme de reconnaissance d'objets

Publications (2)

Publication Number Publication Date
JPWO2020090251A1 JPWO2020090251A1 (ja) 2021-09-30
JP7279721B2 true JP7279721B2 (ja) 2023-05-23

Family

ID=70463037

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020554806A Active JP7279721B2 (ja) 2018-10-30 2019-09-13 物体認識装置、物体認識方法および物体認識プログラム

Country Status (3)

Country Link
US (1) US11586856B2 (fr)
JP (1) JP7279721B2 (fr)
WO (1) WO2020090251A1 (fr)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE112020002630T5 (de) * 2019-05-29 2022-03-10 Denso Corporation Kartensystem, kartenerzeugendes programm, speichermedium, fahrzeuginterne vorrichtung und server
JP7025372B2 (ja) * 2019-06-11 2022-02-24 Kddi株式会社 物体識別装置、方法およびシステム
US20230009479A1 (en) * 2019-12-05 2023-01-12 Sony Group Corporation Information processing apparatus, information processing system, information processing method, and program
US11620522B2 (en) * 2019-12-31 2023-04-04 Magna Electronics Inc. Vehicular system for testing performance of headlamp detection systems
JP7402121B2 (ja) * 2020-06-02 2023-12-20 株式会社日立製作所 物体検出システムおよび物体検出方法
CA3180994A1 (fr) 2020-06-05 2021-12-09 Gautam Narang Procede et systeme pour la prise de decision guidee par les donnees et modulaire et la generation de trajectoire d'un agent autonome
EP4162337A4 (fr) * 2020-06-05 2024-07-03 Gatik Ai Inc Procédé et système de prise de décision sensible au contexte d'un agent autonome
JP7414995B2 (ja) * 2020-06-26 2024-01-16 三菱電機株式会社 Ａｉ統合システム、ａｉ統合装置及びａｉ統合プログラム
JP2022150703A (ja) * 2021-03-26 2022-10-07 株式会社Ｊｖｃケンウッド 推定装置およびプログラム
CA3240477A1 (fr) 2021-12-16 2023-06-22 Apeksha Kumavat Procede et systeme pour etendre le domaine de conception operationnelle d'un agent autonome
CA3240409A1 (fr) 2021-12-16 2023-06-22 Apeksha Kumavat Procede et systeme de traitement de defaillance dans agent autonome
WO2023127124A1 (fr) * 2021-12-28 2023-07-06 日本電気株式会社 Système d'imagerie, dispositif d'imagerie, procédé d'imagerie et support d'enregistrement
JP7371712B2 (ja) * 2021-12-28 2023-10-31 日本電気株式会社 撮像システム、撮像方法、及びコンピュータプログラム
JP2023124259A (ja) * 2022-02-25 2023-09-06 古野電気株式会社 物標監視装置、操船システム、物標監視方法、及びプログラム
JP2023156899A (ja) * 2022-04-13 2023-10-25 株式会社Ridge-i 情報処理装置、撮像画像解析方法及び撮像画像解析プログラム
KR102574540B1 (ko) * 2022-11-22 2023-09-07 (주)와토시스 영상 내 개인정보 영역 검출 방법 및 시스템

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001153969A (ja) 1999-11-25 2001-06-08 Nippon Seiki Co Ltd 雨滴検出装置
JP2010204095A (ja) 2009-02-06 2010-09-16 Yokohama Rubber Co Ltd:The 耐摩耗性能評価装置及び耐摩耗性能評価方法、並びに耐摩耗性能評価用コンピュータプログラム
JP2013186668A (ja) 2012-03-07 2013-09-19 Clarion Co Ltd 車両周囲監視装置
JP2017116506A (ja) 2015-12-25 2017-06-29 株式会社リコー 路面検知装置、及び車両自動運転制御システム

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2571368C1 (ru) * 2012-07-27 2015-12-20 Ниссан Мотор Ко., Лтд. Устройство обнаружения трехмерных объектов, способ обнаружения трехмерных объектов
JP2017068351A (ja) 2015-09-28 2017-04-06 株式会社Ｊｖｃケンウッド 道路標識認識装置および道路標識認識方法
JP2017138694A (ja) * 2016-02-02 2017-08-10 ソニー株式会社 映像処理装置及び映像処理方法
JP6468568B2 (ja) 2016-09-06 2019-02-13 本田技研工業株式会社 物体認識装置、モデル情報生成装置、物体認識方法、および物体認識プログラム
JP6825299B2 (ja) 2016-10-24 2021-02-03 株式会社リコー 情報処理装置、情報処理方法およびプログラム
JP2018073275A (ja) 2016-11-02 2018-05-10 三菱自動車工業株式会社 画像認識装置
JP2018081404A (ja) 2016-11-15 2018-05-24 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 識別方法、識別装置、識別器生成方法及び識別器生成装置
JP6720402B2 (ja) * 2017-03-21 2020-07-08 株式会社Ｐｒｅｆｅｒｒｅｄ Ｎｅｔｗｏｒｋｓ サーバ装置、学習済モデル提供プログラム、学習済モデル提供方法及び学習済モデル提供システム
US10755428B2 (en) * 2017-04-17 2020-08-25 The United States Of America, As Represented By The Secretary Of The Navy Apparatuses and methods for machine vision system including creation of a point cloud model and/or three dimensional model
JP7190842B2 (ja) * 2017-11-02 2022-12-16 キヤノン株式会社 情報処理装置、情報処理装置の制御方法及びプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001153969A (ja) 1999-11-25 2001-06-08 Nippon Seiki Co Ltd 雨滴検出装置
JP2010204095A (ja) 2009-02-06 2010-09-16 Yokohama Rubber Co Ltd:The 耐摩耗性能評価装置及び耐摩耗性能評価方法、並びに耐摩耗性能評価用コンピュータプログラム
JP2013186668A (ja) 2012-03-07 2013-09-19 Clarion Co Ltd 車両周囲監視装置
JP2017116506A (ja) 2015-12-25 2017-06-29 株式会社リコー 路面検知装置、及び車両自動運転制御システム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
木戸 嘉一（外２名），「適応環境データを用いた深層学習アルゴリズムによる走行環境認識」，第３２回 画像符号化シンポジウム, 第２２回 映像メディア処理シンポジウム（PCSJ/IMPS2017)（講演論文集），日本，電子情報通信学会 画像工学研究専門委員会，2017年11月20日，第１９６～１９７頁

Also Published As

Publication number Publication date
US11586856B2 (en) 2023-02-21
WO2020090251A1 (fr) 2020-05-07
JPWO2020090251A1 (ja) 2021-09-30
US20210390353A1 (en) 2021-12-16

Similar Documents

Publication Publication Date Title
JP7279721B2 (ja) 物体認識装置、物体認識方法および物体認識プログラム
JP7052663B2 (ja) 物体検出装置、物体検出方法及び物体検出用コンピュータプログラム
US20220004196A1 (en) System and method for detecting occluded objects based on image processing
US9836657B2 (en) System and method for periodic lane marker identification and tracking
US8994823B2 (en) Object detection apparatus and storage medium storing object detection program
JP6649738B2 (ja) 駐車区画認識装置、駐車区画認識方法
JP5480917B2 (ja) 車両周辺監視装置
US20100121561A1 (en) Car navigation system
US20130083971A1 (en) Front vehicle detecting method and front vehicle detecting apparatus
CN113496201B (zh) 物体状态识别装置、方法、计算机可读取的记录介质及控制装置
US11783596B2 (en) Detecting traffic signaling states with neural networks
JP5884635B2 (ja) 走行環境検出装置、走行環境検出プログラム、およびライト制御装置
US12033397B2 (en) Controller, method, and computer program for controlling vehicle
JP4937844B2 (ja) 歩行者検出装置
CN111145569A (zh) 一种道路监测、车辆行驶控制方法、装置及车路协同系统
JP5353531B2 (ja) 車両灯火認識装置及びプログラム
WO2022244356A1 (fr) Détection d'interférence lumineuse pendant la conduite d'un véhicule
JP2021163432A (ja) 信号灯状態識別装置、信号灯状態識別方法及び信号灯状態識別用コンピュータプログラムならびに制御装置
JP2019158662A (ja) 物標認識装置及び車両走行制御システム
JP2021018465A (ja) 物体認識装置
CN111976585A (zh) 基于人工神经网络的投射信息识别装置及其方法
CN116434156A (zh) 目标检测方法、存储介质、路侧设备及自动驾驶系统
JP2020534600A (ja) 車線認識方法および装置、運転支援システムならびに車両
CN115481724A (zh) 用于训练用于语义图像分割的神经网络的方法
JP2013028239A (ja) ライト検出装置、ライト検出プログラム、およびライト制御装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210420

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210420

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220510

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220706

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221108

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221221

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230411

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230424

R151 Written notification of patent or utility model registration

Ref document number: 7279721

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151