JP6144656B2 - 歩行者の視覚的認識が困難であり得ることを運転者に警告するシステム及び方法 - Google Patents

歩行者の視覚的認識が困難であり得ることを運転者に警告するシステム及び方法 Download PDF

Info

Publication number
JP6144656B2
JP6144656B2 JP2014192637A JP2014192637A JP6144656B2 JP 6144656 B2 JP6144656 B2 JP 6144656B2 JP 2014192637 A JP2014192637 A JP 2014192637A JP 2014192637 A JP2014192637 A JP 2014192637A JP 6144656 B2 JP6144656 B2 JP 6144656B2
Authority
JP
Japan
Prior art keywords
pedestrian
score
clutter
window
mask
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2014192637A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015062121A (ja
JP2015062121A5 (enExample
Inventor
ワイ．ドゥ エリザ
ワイ．ドゥ エリザ
カイ ヤン
カイ ヤン
ピンゲ ジアーン
ピンゲ ジアーン
シェロニー リニ
シェロニー リニ
高橋　浩幸
浩幸 高橋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Original Assignee
Toyota Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Corp filed Critical Toyota Motor Corp
Publication of JP2015062121A publication Critical patent/JP2015062121A/ja
Publication of JP2015062121A5 publication Critical patent/JP2015062121A5/ja
Application granted granted Critical
Publication of JP6144656B2 publication Critical patent/JP6144656B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/755—Deformable models or variational models, e.g. snakes or active contours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30236—Traffic on road, railway or crossing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Image Analysis (AREA)
JP2014192637A 2013-09-23 2014-09-22 歩行者の視覚的認識が困難であり得ることを運転者に警告するシステム及び方法 Active JP6144656B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/034,103 2013-09-23
US14/034,103 US9070023B2 (en) 2013-09-23 2013-09-23 System and method of alerting a driver that visual perception of pedestrian may be difficult

Publications (3)

Publication Number Publication Date
JP2015062121A JP2015062121A (ja) 2015-04-02
JP2015062121A5 JP2015062121A5 (enExample) 2015-08-13
JP6144656B2 true JP6144656B2 (ja) 2017-06-07

Family

ID=51726293

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014192637A Active JP6144656B2 (ja) 2013-09-23 2014-09-22 歩行者の視覚的認識が困難であり得ることを運転者に警告するシステム及び方法

Country Status (3)

Country Link
US (1) US9070023B2 (enExample)
EP (1) EP2851841A3 (enExample)
JP (1) JP6144656B2 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2926317B1 (en) * 2012-12-03 2020-02-12 Harman International Industries, Incorporated System and method for detecting pedestrians using a single normal camera
JP5886809B2 (ja) * 2013-09-27 2016-03-16 富士重工業株式会社 車外環境認識装置
US9299004B2 (en) 2013-10-24 2016-03-29 Adobe Systems Incorporated Image foreground detection
US10019823B2 (en) 2013-10-24 2018-07-10 Adobe Systems Incorporated Combined composition and change-based models for image cropping
US9330334B2 (en) * 2013-10-24 2016-05-03 Adobe Systems Incorporated Iterative saliency map estimation
KR101498114B1 (ko) * 2013-11-28 2015-03-05 현대모비스 주식회사 보행자를 검출하는 영상 처리 장치 및 그 방법
CN104717457B (zh) * 2013-12-13 2018-05-18 华为技术有限公司 一种视频浓缩方法及装置
US10095935B2 (en) * 2013-12-20 2018-10-09 Magna Electronics Inc. Vehicle vision system with enhanced pedestrian detection
JP6483360B2 (ja) * 2014-06-30 2019-03-13 本田技研工業株式会社 対象物認識装置
US9747812B2 (en) * 2014-10-22 2017-08-29 Honda Motor Co., Ltd. Saliency based awareness modeling
US9789822B2 (en) * 2015-10-22 2017-10-17 Feniex Industries, Inc. Mirror controller unit for emergency vehicle warning devices
US20170206426A1 (en) * 2016-01-15 2017-07-20 Ford Global Technologies, Llc Pedestrian Detection With Saliency Maps
JP6786264B2 (ja) * 2016-05-27 2020-11-18 株式会社東芝 情報処理装置、情報処理方法、および車両
US9858817B1 (en) * 2016-10-04 2018-01-02 International Busines Machines Corporation Method and system to allow drivers or driverless vehicles to see what is on the other side of an obstruction that they are driving near, using direct vehicle-to-vehicle sharing of environment data
US10429926B2 (en) * 2017-03-15 2019-10-01 International Business Machines Corporation Physical object addition and removal based on affordance and view
JP7028099B2 (ja) * 2018-08-02 2022-03-02 日本電信電話株式会社 候補領域推定装置、候補領域推定方法、及びプログラム
US11030465B1 (en) * 2019-12-01 2021-06-08 Automotive Research & Testing Center Method for analyzing number of people and system thereof
US11565653B2 (en) 2020-01-03 2023-01-31 Aptiv Technologies Limited Vehicle occupancy-monitoring system
EP3845431B1 (en) 2020-01-06 2024-08-07 Aptiv Technologies AG Driver-monitoring system
CN113034908A (zh) * 2021-03-12 2021-06-25 深圳市雷铭科技发展有限公司 基于智慧路灯的交通状况提示方法、电子设备及存储介质
US11718314B1 (en) * 2022-03-11 2023-08-08 Aptiv Technologies Limited Pedestrian alert system
WO2024164928A1 (zh) * 2023-02-08 2024-08-15 深圳市冠标科技发展有限公司 预警方法、装置、电子设备及存储介质
CN118038222B (zh) * 2024-01-19 2024-10-25 南京邮电大学 基于二次图像分解与注意力机制的图像融合模型及方法
US20250348260A1 (en) * 2024-05-10 2025-11-13 Faurecia Irystec, Inc. Driver or other vehicle operator attention retargeting

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4181917A (en) 1977-07-01 1980-01-01 Quadricolor Technology L.P. Color television receiving system utilizing inferred high frequency signal components to reduce color infidelities in regions of color transitions
US5053864A (en) 1989-06-01 1991-10-01 Thompson Electronics Ltd. Video capture, compression and display system, including averaging of chrominance information
US5602760A (en) 1994-02-02 1997-02-11 Hughes Electronics Image-based detection and tracking system and processing method employing clutter measurements and signal-to-clutter ratios
US6081753A (en) 1996-03-12 2000-06-27 The United States Of America As Represented By The Secretary Of The Army Method of determining probability of target detection in a visually cluttered scene
JP4752158B2 (ja) * 2001-08-28 2011-08-17 株式会社豊田中央研究所 環境複雑度演算装置、環境認識度合推定装置及び障害物警報装置
US7885453B1 (en) 2007-06-07 2011-02-08 Cognex Technology And Investment Corporation Image preprocessing for probe mark inspection
US7409092B2 (en) * 2002-06-20 2008-08-05 Hrl Laboratories, Llc Method and apparatus for the surveillance of objects in images
US7657059B2 (en) 2003-08-08 2010-02-02 Lockheed Martin Corporation Method and apparatus for tracking an object
WO2005060640A2 (en) * 2003-12-15 2005-07-07 Sarnoff Corporation Method and apparatus for object tracking prior to imminent collision detection
EP1544792A1 (en) 2003-12-18 2005-06-22 Thomson Licensing S.A. Device and method for creating a saliency map of an image
JP4638143B2 (ja) * 2003-12-26 2011-02-23 富士重工業株式会社 車両用運転支援装置
JP2007531121A (ja) * 2004-03-24 2007-11-01 セルニウム コーポレイション エリアごとの分割ゲインの使用によるビデオ分析の改良
US7454058B2 (en) * 2005-02-07 2008-11-18 Mitsubishi Electric Research Lab, Inc. Method of extracting and searching integral histograms of data samples
DE602005017376D1 (de) 2005-06-27 2009-12-10 Honda Res Inst Europe Gmbh Räumliche Annäherung und Objekterkennung für humanoiden Roboter
US7804980B2 (en) * 2005-08-24 2010-09-28 Denso Corporation Environment recognition device
US7460951B2 (en) * 2005-09-26 2008-12-02 Gm Global Technology Operations, Inc. System and method of target tracking using sensor fusion
US7881554B2 (en) 2006-06-05 2011-02-01 Stmicroelectronics S.R.L. Method for correcting a digital image
JP4670805B2 (ja) * 2006-12-13 2011-04-13 株式会社豊田中央研究所 運転支援装置、及びプログラム
US7796056B2 (en) * 2007-03-28 2010-09-14 Fein Gene S Digital windshield information system employing a recommendation engine keyed to a map database system
WO2008139530A1 (ja) * 2007-04-27 2008-11-20 Honda Motor Co., Ltd. 車両周辺監視装置、車両周辺監視用プログラム、車両周辺監視方法
EP2250624B1 (en) 2008-03-14 2011-12-21 Panasonic Corporation Image processing method and image processing apparatus
US8396282B1 (en) 2008-10-31 2013-03-12 Hrl Labortories, Llc Method and system for computing fused saliency maps from multi-modal sensory inputs
US8611590B2 (en) * 2008-12-23 2013-12-17 Canon Kabushiki Kaisha Video object fragmentation detection and management
US8395529B2 (en) * 2009-04-02 2013-03-12 GM Global Technology Operations LLC Traffic infrastructure indicator on head-up display
US8384532B2 (en) * 2009-04-02 2013-02-26 GM Global Technology Operations LLC Lane of travel on windshield head-up display
US8350724B2 (en) * 2009-04-02 2013-01-08 GM Global Technology Operations LLC Rear parking assist on full rear-window head-up display
JP5136504B2 (ja) * 2009-04-02 2013-02-06 トヨタ自動車株式会社 物体識別装置
US8704653B2 (en) * 2009-04-02 2014-04-22 GM Global Technology Operations LLC Enhanced road vision on full windshield head-up display
US8447139B2 (en) 2010-04-13 2013-05-21 International Business Machines Corporation Object recognition using Haar features and histograms of oriented gradients
US8345100B2 (en) * 2010-07-06 2013-01-01 GM Global Technology Operations LLC Shadow removal in an image captured by a vehicle-based camera using an optimized oriented linear axis
US8294794B2 (en) * 2010-07-06 2012-10-23 GM Global Technology Operations LLC Shadow removal in an image captured by a vehicle-based camera for clear path detection
JP5386538B2 (ja) * 2011-05-12 2014-01-15 富士重工業株式会社 環境認識装置
US8731291B2 (en) * 2012-09-24 2014-05-20 Eastman Kodak Company Estimating the clutter of digital images
US8897560B2 (en) * 2012-09-24 2014-11-25 Eastman Kodak Company Determining the estimated clutter of digital images

Also Published As

Publication number Publication date
JP2015062121A (ja) 2015-04-02
EP2851841A3 (en) 2015-05-20
US20150086077A1 (en) 2015-03-26
EP2851841A8 (en) 2015-07-29
EP2851841A2 (en) 2015-03-25
US9070023B2 (en) 2015-06-30

Similar Documents

Publication Publication Date Title
JP6144656B2 (ja) 歩行者の視覚的認識が困難であり得ることを運転者に警告するシステム及び方法
US9754160B2 (en) Method and device for detecting gathering of objects based on stereo vision as well as non-transitory computer-readable medium
RU2484531C2 (ru) Устройство обработки видеоинформации системы охранной сигнализации
Zhao et al. Car detection in low resolution aerial images
Negru et al. Image based fog detection and visibility estimation for driving assistance systems
Munoz et al. Depth-aware indoor staircase detection and recognition for the visually impaired
JP2015062121A5 (enExample)
JP2013537661A (ja) ステレオビジョン技術を使用することによる移動物体の自動検出
JP2015514278A (ja) マルチキュー・オブジェクトの検出および分析のための方法、システム、製品、およびコンピュータ・プログラム（マルチキュー・オブジェクトの検出および分析）
Chong et al. Integrated real-time vision-based preceding vehicle detection in urban roads
KR20180047149A (ko) 충돌 위험 경고 장치 및 방법
WO2020217812A1 (ja) 被写体の状態を認識する画像処理装置及びその方法
JP2012221162A (ja) 対象物検出装置及びプログラム
JP4173902B2 (ja) 車両周辺監視装置
Kühnl et al. Visual ego-vehicle lane assignment using spatial ray features
CN106415662A (zh) 车辆周围监视装置
KR20200087296A (ko) 라이다 센서 데이터 기반 장애물 검출 3차원 뷰어 시스템
Czyzewski et al. Moving object detection and tracking for the purpose of multimodal surveillance system in urban areas
Sebanja et al. Automatic detection and recognition of traffic road signs for intelligent autonomous unmanned vehicles for urban surveillance and rescue
Zheng et al. Shadow removal for pedestrian detection and tracking in indoor environments
Bruno et al. A comparison of traffic signs detection methods in 2d and 3d images for the benefit of the navigation of autonomous vehicles
Parsola et al. Automated system for road extraction and traffic volume estimation for traffic jam detection
JP2006010652A (ja) 物体検出装置
Weiss et al. A robust, real-time ground change detector for a “smart” walker
WO2018110377A1 (ja) 映像監視装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150626

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150626

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160512

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160705

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161004

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170411

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170511

R150 Certificate of patent or registration of utility model

Ref document number: 6144656

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313117

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250