JP6395656B2 - 環境における物体を追跡する方法及びシステム - Google Patents

環境における物体を追跡する方法及びシステム Download PDF

Info

Publication number
JP6395656B2
JP6395656B2 JP2015084185A JP2015084185A JP6395656B2 JP 6395656 B2 JP6395656 B2 JP 6395656B2 JP 2015084185 A JP2015084185 A JP 2015084185A JP 2015084185 A JP2015084185 A JP 2015084185A JP 6395656 B2 JP6395656 B2 JP 6395656B2
Authority
JP
Japan
Prior art keywords
track
image
bounding box
frame rate
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015084185A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015216635A5 (https=
JP2015216635A (ja
Inventor
ティム・マークス
マイケル・ジェイ・ジョーンズ
スレン・クマール
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of JP2015216635A publication Critical patent/JP2015216635A/ja
Publication of JP2015216635A5 publication Critical patent/JP2015216635A5/ja
Application granted granted Critical
Publication of JP6395656B2 publication Critical patent/JP6395656B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
    • G01J5/0025—Living bodies
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143—Sensing or illuminating at different wavelengths
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H04N23/23—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only from thermal infrared radiation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Image Analysis (AREA)
  • Air Conditioning Control Device (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)
JP2015084185A 2014-05-09 2015-04-16 環境における物体を追跡する方法及びシステム Active JP6395656B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/274,073 2014-05-09
US14/274,073 US9245196B2 (en) 2014-05-09 2014-05-09 Method and system for tracking people in indoor environments using a visible light camera and a low-frame-rate infrared sensor

Publications (3)

Publication Number Publication Date
JP2015216635A JP2015216635A (ja) 2015-12-03
JP2015216635A5 JP2015216635A5 (https=) 2018-02-22
JP6395656B2 true JP6395656B2 (ja) 2018-09-26

Family

ID=54368105

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015084185A Active JP6395656B2 (ja) 2014-05-09 2015-04-16 環境における物体を追跡する方法及びシステム

Country Status (2)

Country Link
US (1) US9245196B2 (https=)
JP (1) JP6395656B2 (https=)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9922271B2 (en) * 2015-03-20 2018-03-20 Netra, Inc. Object detection and classification
FR3039461B1 (fr) * 2015-07-30 2018-12-07 Valeo Systemes Thermiques Systeme de commande pour installation de conditionnement d'air d'un vehicule automobile
US20170068863A1 (en) * 2015-09-04 2017-03-09 Qualcomm Incorporated Occupancy detection using computer vision
KR102153607B1 (ko) 2016-01-22 2020-09-08 삼성전자주식회사 영상에서의 전경 검출 장치 및 방법
US11134848B2 (en) 2016-04-25 2021-10-05 Samsung Electronics Co., Ltd. Mobile hyperspectral camera system and human skin monitoring using a mobile hyperspectral camera system
US11328152B2 (en) 2019-06-17 2022-05-10 Pixart Imaging Inc. Recognition system employing thermal sensor
US9961261B2 (en) 2016-06-20 2018-05-01 Gopro, Inc. Image alignment using a virtual gyroscope model
US10574909B2 (en) 2016-08-08 2020-02-25 Microsoft Technology Licensing, Llc Hybrid imaging sensor for structured light object capture
GB201615776D0 (en) * 2016-09-16 2016-11-02 Rolls Royce Plc Spatiotemporal registation of image streams
US10701244B2 (en) 2016-09-30 2020-06-30 Microsoft Technology Licensing, Llc Recolorization of infrared image streams
TWI584227B (zh) * 2016-09-30 2017-05-21 晶睿通訊股份有限公司 影像處理方法、影像處理裝置及影像處理系統
US11049260B2 (en) 2016-10-19 2021-06-29 Nec Corporation Image processing device, stationary object tracking system, image processing method, and recording medium
US10768682B2 (en) * 2017-01-20 2020-09-08 Flir Systems, Inc. Detection-based wakeup of detection devices
JP6341396B1 (ja) * 2017-02-28 2018-06-13 パナソニックＩｐマネジメント株式会社 動体監視装置、サーバ装置、および動体監視システム
CN106911914A (zh) * 2017-02-28 2017-06-30 中国科学院城市环境研究所 红外热成像动物活动追踪系统
CN115937776A (zh) 2017-09-15 2023-04-07 杭州海康威视数字技术股份有限公司 监控方法、装置、系统、电子设备及计算机可读存储介质
CN108224684A (zh) * 2018-01-17 2018-06-29 苏州亮磊知识产权运营有限公司 一种基于公共场所的智能空调方法及其系统
RU2679218C1 (ru) 2018-02-06 2019-02-06 Акционерное общество Научно-производственный центр "Электронные вычислительно-информационные системы" (АО НПЦ "ЭЛВИС") Система и способ контроля перемещения людей
JP2019158614A (ja) * 2018-03-13 2019-09-19 三菱電機株式会社 照度推定装置、プログラム
US10449895B2 (en) * 2018-03-20 2019-10-22 Rockwell Collins, Inc. Object tracking illumination system
WO2019202713A1 (ja) * 2018-04-19 2019-10-24 三菱電機株式会社 制御管理装置、機器制御装置、機器制御システム及び機器制御方法
JP6583839B2 (ja) * 2018-04-27 2019-10-02 パナソニックＩｐマネジメント株式会社 動体監視装置、サーバ装置、および動体監視システム
WO2019231861A1 (en) * 2018-05-28 2019-12-05 Greenwave Systems PTE Ltd. Area monitoring and communication
CN110631706B (zh) * 2018-06-22 2021-04-27 杭州海康微影传感科技有限公司 红外图像的校正方法、装置及存储介质
CN110858892B (zh) * 2018-08-24 2021-07-16 中国电子科技集团公司第二十七研究所 岸岛观测系统
CN112313472B (zh) * 2018-10-29 2023-12-26 松下知识产权经营株式会社 信息提示方法、信息提示装置、以及信息提示系统
CN113228104B (zh) * 2018-11-06 2024-06-14 泰立戴恩菲力尔商业系统公司 热图像和可见图像对的自动共配准
CN113498530B (zh) * 2018-12-20 2024-12-17 派克赛斯有限责任公司 基于局部视觉信息的对象尺寸标注系统和方法
KR102756470B1 (ko) * 2019-01-02 2025-01-20 엘지이노텍 주식회사 사육장 환경 관리 장치
JP6892134B2 (ja) * 2019-01-25 2021-06-18 学校法人福岡工業大学 計測システム、計測方法および計測プログラム
CN109828596A (zh) * 2019-02-28 2019-05-31 深圳市道通智能航空技术有限公司 一种目标跟踪方法、装置和无人机
US11532093B2 (en) 2019-10-10 2022-12-20 Intermap Technologies, Inc. First floor height estimation from optical images
CN111089390B (zh) * 2019-12-16 2022-06-14 宁波奥克斯电气股份有限公司 一种可变色空调器
US12050133B2 (en) 2020-03-06 2024-07-30 Butlr Technologies, Inc. Pose detection using thermal data
US11022495B1 (en) * 2020-03-06 2021-06-01 Butlr Technologies, Inc. Monitoring human location, trajectory and behavior using thermal data
US12201403B2 (en) * 2020-05-29 2025-01-21 Nec Corporation Free flow fever screening
US20210400210A1 (en) * 2020-06-23 2021-12-23 Immervision, Inc. Infrared wide-angle camera
DE102020208089A1 (de) 2020-06-30 2021-12-30 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren und Bildverarbeitungsvorrichtung zum Detektieren von zumindest einem Objekt in einem optischen Bild einer Kamera
CN112560617B (zh) * 2020-12-05 2023-08-01 江苏爱科赛尔云数据科技有限公司 基于阵列相机的大场景行人轨迹跟踪方法
US11551366B2 (en) * 2021-03-05 2023-01-10 Intermap Technologies, Inc. System and methods for correcting terrain elevations under forest canopy
US12279857B2 (en) 2021-04-01 2025-04-22 Hill-Rom Services, Inc. Video used to estimate vital signs
US12056888B2 (en) 2021-09-07 2024-08-06 Intermap Technologies, Inc. Methods and apparatuses for calculating building heights from mono imagery
CN114219885B (zh) * 2021-12-13 2024-10-29 在线途游（北京）科技有限公司 一种用于移动终端的实时阴影渲染方法和装置
US11775132B1 (en) 2022-05-18 2023-10-03 Environments by LE, Inc. System and method for the management and use of building systems, facilities, and amenities using internet of things devices and a metaverse representation
WO2023223704A1 (ja) * 2022-05-20 2023-11-23 ソニーグループ株式会社 情報処理装置、情報処理方法、およびプログラム
US12355658B2 (en) 2023-08-08 2025-07-08 Butlr Technologies, Inc. Energy efficient wireless network of sensors
CN120510480B (zh) * 2025-07-18 2025-10-14 厦门理工学院 基于时序建模和提示微调的多模态目标跟踪方法及系统

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4636774A (en) 1983-11-08 1987-01-13 American District Telegraph Company Variable sensitivity motion detector
CN1056225C (zh) 1992-03-07 2000-09-06 三星电子株式会社 空调系统
US5555512A (en) 1993-08-19 1996-09-10 Matsushita Electric Industrial Co., Ltd. Picture processing apparatus for processing infrared pictures obtained with an infrared ray sensor and applied apparatus utilizing the picture processing apparatus
JP3453870B2 (ja) * 1994-09-21 2003-10-06 松下電器産業株式会社 画像処理装置と画像処理装置を用いた応用機器
US7961952B2 (en) * 2007-09-27 2011-06-14 Mitsubishi Electric Research Laboratories, Inc. Method and system for detecting and tracking objects in images
JP5478075B2 (ja) * 2009-01-06 2014-04-23 三菱電機株式会社 空気調和装置
US9077915B2 (en) * 2010-04-07 2015-07-07 Projectiondesign As Interweaving of IR and visible images
US8780161B2 (en) * 2011-03-01 2014-07-15 Hewlett-Packard Development Company, L.P. System and method for modifying images
TWI428508B (zh) 2011-04-12 2014-03-01 Hon Hai Prec Ind Co Ltd 風扇控制系統、方法及具有該系統的風扇

Also Published As

Publication number Publication date
US20150324656A1 (en) 2015-11-12
JP2015216635A (ja) 2015-12-03
US9245196B2 (en) 2016-01-26

Similar Documents

Publication Publication Date Title
JP6395656B2 (ja) 環境における物体を追跡する方法及びシステム
Brenner et al. RGB-D and thermal sensor fusion: A systematic literature review
Kumar et al. Improving person tracking using an inexpensive thermal infrared sensor
Kellnhofer et al. Gaze360: Physically unconstrained gaze estimation in the wild
US8929592B2 (en) Camera-based 3D climate control
Shin et al. Sparse depth enhanced direct thermal-infrared SLAM beyond the visible spectrum
Chrysos et al. A comprehensive performance evaluation of deformable face tracking “in-the-wild”
JP2015216635A5 (https=)
US20230079693A1 (en) Elevated temperature screening systems and methods
Dai et al. Towards privacy-preserving recognition of human activities
Krotosky et al. Mutual information based registration of multimodal stereo videos for person tracking
WO2014155979A1 (ja) 追尾処理装置及びこれを備えた追尾処理システム並びに追尾処理方法
Ellmauthaler et al. A visible-light and infrared video database for performance evaluation of video/image fusion methods
CN105590309A (zh) 前景图像分割方法和装置
KR102144394B1 (ko) 영상 정합 장치 및 이를 이용한 영상 정합 방법
JP2013242728A (ja) 画像監視装置
US20150339520A1 (en) Object recognition method and object recognition apparatus using the same
WO2008132741A2 (en) Apparatus and method for tracking human objects and determining attention metrics
CN106406684B (zh) 投影处理方法、装置及投影仪
Zhang et al. TADAR: Thermal Array-based Detection and Ranging for Privacy-Preserving Human Sensing
Chen et al. Image segmentation in thermal images
Yalcin et al. Background estimation under rapid gain change in thermal imagery
CN103155002B (zh) 用于在图像中识别虚拟视觉信息的方法和装置
KR20200145379A (ko) 해상도가 다른 영상을 정합하는 장치 및 방법
Cardone et al. Warping-based co-registration of thermal infrared images: Study of factors influencing its applicability

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180115

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20180115

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20180115

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20180412

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180417

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180516

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180731

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180828

R150 Certificate of patent or registration of utility model

Ref document number: 6395656

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250