US11699240B2 - Target tracking method and apparatus, and storage medium - Google Patents

Target tracking method and apparatus, and storage medium Download PDF

Info

Publication number
US11699240B2
US11699240B2 US16/819,487 US202016819487A US11699240B2 US 11699240 B2 US11699240 B2 US 11699240B2 US 202016819487 A US202016819487 A US 202016819487A US 11699240 B2 US11699240 B2 US 11699240B2
Authority
US
United States
Prior art keywords
reference frame
image frame
frame
feature data
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US16/819,487
Other languages
English (en)
Other versions
US20200258242A1 (en
Inventor
Shaohui Liu
Hongwei QIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sensetime Technology Development Co Ltd
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201810184967.8A external-priority patent/CN108416799A/zh
Priority claimed from CN201810182797.XA external-priority patent/CN108460787B/zh
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Assigned to BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD. reassignment BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LIU, SHAOHUI, QIN, Hongwei
Publication of US20200258242A1 publication Critical patent/US20200258242A1/en
Application granted granted Critical
Publication of US11699240B2 publication Critical patent/US11699240B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30232—Surveillance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)
US16/819,487 2018-03-06 2020-03-16 Target tracking method and apparatus, and storage medium Active US11699240B2 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
CN201810184967.8A CN108416799A (zh) 2018-03-06 2018-03-06 目标跟踪方法和装置、电子设备、程序、存储介质
CN201810182797.XA CN108460787B (zh) 2018-03-06 2018-03-06 目标跟踪方法和装置、电子设备、程序、存储介质
CN201810182797.X 2018-03-06
CN201810184967.8 2018-03-06
PCT/CN2019/076355 WO2019170024A1 (fr) 2018-03-06 2019-02-27 Procédé et appareil de suivi de cible, dispositif électronique et support d'informations

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/076355 Continuation WO2019170024A1 (fr) 2018-03-06 2019-02-27 Procédé et appareil de suivi de cible, dispositif électronique et support d'informations

Publications (2)

Publication Number Publication Date
US20200258242A1 US20200258242A1 (en) 2020-08-13
US11699240B2 true US11699240B2 (en) 2023-07-11

Family

ID=67845813

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/819,487 Active US11699240B2 (en) 2018-03-06 2020-03-16 Target tracking method and apparatus, and storage medium

Country Status (4)

Country Link
US (1) US11699240B2 (fr)
JP (1) JP7163372B2 (fr)
SG (1) SG11202002621SA (fr)
WO (1) WO2019170024A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110929630B (zh) * 2019-11-19 2023-11-24 中国科学院上海微系统与信息技术研究所 一种铁路轨道信息提取方法、系统、电子设备及存储介质
CN112651996A (zh) * 2020-12-22 2021-04-13 南京市城市与交通规划设计研究院股份有限公司 目标检测跟踪方法、装置、电子设备和存储介质
CN113723209A (zh) * 2021-08-05 2021-11-30 浙江大华技术股份有限公司 目标识别方法、装置、电子设备和计算机可读存储介质

Citations (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000113158A (ja) 1998-10-01 2000-04-21 Toshiba Corp 物体追跡装置及びその方法
CN101169827A (zh) 2007-12-03 2008-04-30 北京中星微电子有限公司 一种对图像中的特征点进行跟踪的方法及装置
JP2010145965A (ja) 2008-12-22 2010-07-01 Fujinon Corp オートフォーカスシステム
JP2011060167A (ja) 2009-09-14 2011-03-24 Secom Co Ltd 移動物体追跡装置
JP2011118782A (ja) 2009-12-04 2011-06-16 Sony Corp 画像処理装置および画像処理方法、並びにプログラム
US20110286631A1 (en) 2010-05-21 2011-11-24 Qualcomm Incorporated Real time tracking/detection of multiple targets
US20120093364A1 (en) 2010-02-19 2012-04-19 Panasonic Corporation Object tracking device, object tracking method, and object tracking program
US20120120237A1 (en) * 2010-11-12 2012-05-17 Sony Corporation Video processing
JP2012159958A (ja) 2011-01-31 2012-08-23 Secom Co Ltd 移動物体追跡装置
WO2013001940A1 (fr) 2011-06-29 2013-01-03 オリンパスイメージング株式会社 Dispositif de suivi et procédé de suivi
JP2013021726A (ja) 2012-10-18 2013-01-31 Canon Inc 被写体追跡装置及びその制御方法
JP2014241505A (ja) 2013-06-11 2014-12-25 ソニー株式会社 撮影装置および撮影方法、テンプレート生成装置およびテンプレート生成方法、並びにプログラム
US20150131851A1 (en) 2013-11-13 2015-05-14 Xerox Corporation System and method for using apparent size and orientation of an object to improve video-based tracking in regularized environments
US20150221136A1 (en) 2014-02-05 2015-08-06 Elena Shaburova Method for real-time video processing involving retouching of an object in the video
US20150369918A1 (en) 2014-06-20 2015-12-24 Syntronics, Llc Laser alignment and tracking system
JP2016085487A (ja) 2014-10-22 2016-05-19 キヤノン株式会社 情報処理装置、情報処理方法及びコンピュータプログラム
US20160180197A1 (en) 2014-12-19 2016-06-23 The Boeing Company System and method to improve object tracking using multiple tracking systems
CN106326837A (zh) 2016-08-09 2017-01-11 北京旷视科技有限公司 对象追踪方法和装置
CN106529587A (zh) 2016-08-26 2017-03-22 北京航空航天大学 基于目标点识别的视觉航向识别方法
US20170084045A1 (en) * 2015-09-23 2017-03-23 Vatics Inc. Monitoring Camera Device and Related Region-based Motion Detection Method
WO2017080399A1 (fr) 2015-11-12 2017-05-18 阿里巴巴集团控股有限公司 Procédé et dispositif pour le suivi de localisation de visage humain, et équipement électronique
CN106909909A (zh) 2017-03-08 2017-06-30 王华锋 一种基于共享卷积特征的人脸检测与对齐方法
JP2017156886A (ja) 2016-02-29 2017-09-07 Kddi株式会社 画像間類似度を考慮して物体を追跡する装置、プログラム及び方法
CN107169939A (zh) 2017-05-31 2017-09-15 广东欧珀移动通信有限公司 图像处理方法及相关产品
CN107562805A (zh) 2017-08-08 2018-01-09 浙江大华技术股份有限公司 一种以图搜图的方法及装置
JP2018026108A (ja) 2016-08-08 2018-02-15 パナソニックＩｐマネジメント株式会社 物体追跡方法、物体追跡装置およびプログラム
CN108416799A (zh) 2018-03-06 2018-08-17 北京市商汤科技开发有限公司 目标跟踪方法和装置、电子设备、程序、存储介质
CN108460787A (zh) 2018-03-06 2018-08-28 北京市商汤科技开发有限公司 目标跟踪方法和装置、电子设备、程序、存储介质
US20190096069A1 (en) * 2016-02-26 2019-03-28 SZ DJI Technology Co., Ltd. Systems and methods for visual target tracking
US20190197703A1 (en) 2017-12-21 2019-06-27 Baidu Online Network Technology (Beijing) Co., Ltd. Method and apparatus for tracking target profile in video
US20190205694A1 (en) * 2017-12-28 2019-07-04 Qualcomm Incorporated Multi-resolution feature description for object recognition

Patent Citations (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000113158A (ja) 1998-10-01 2000-04-21 Toshiba Corp 物体追跡装置及びその方法
CN101169827A (zh) 2007-12-03 2008-04-30 北京中星微电子有限公司 一种对图像中的特征点进行跟踪的方法及装置
JP2010145965A (ja) 2008-12-22 2010-07-01 Fujinon Corp オートフォーカスシステム
JP2011060167A (ja) 2009-09-14 2011-03-24 Secom Co Ltd 移動物体追跡装置
JP2011118782A (ja) 2009-12-04 2011-06-16 Sony Corp 画像処理装置および画像処理方法、並びにプログラム
US20120093364A1 (en) 2010-02-19 2012-04-19 Panasonic Corporation Object tracking device, object tracking method, and object tracking program
US20110286631A1 (en) 2010-05-21 2011-11-24 Qualcomm Incorporated Real time tracking/detection of multiple targets
US20120120237A1 (en) * 2010-11-12 2012-05-17 Sony Corporation Video processing
JP2012159958A (ja) 2011-01-31 2012-08-23 Secom Co Ltd 移動物体追跡装置
WO2013001940A1 (fr) 2011-06-29 2013-01-03 オリンパスイメージング株式会社 Dispositif de suivi et procédé de suivi
US20130113941A1 (en) 2011-06-29 2013-05-09 Olympus Imaging Corp. Tracking apparatus and tracking method
JP2013021726A (ja) 2012-10-18 2013-01-31 Canon Inc 被写体追跡装置及びその制御方法
JP2014241505A (ja) 2013-06-11 2014-12-25 ソニー株式会社 撮影装置および撮影方法、テンプレート生成装置およびテンプレート生成方法、並びにプログラム
US20150131851A1 (en) 2013-11-13 2015-05-14 Xerox Corporation System and method for using apparent size and orientation of an object to improve video-based tracking in regularized environments
US20150221136A1 (en) 2014-02-05 2015-08-06 Elena Shaburova Method for real-time video processing involving retouching of an object in the video
US20150369918A1 (en) 2014-06-20 2015-12-24 Syntronics, Llc Laser alignment and tracking system
JP2016085487A (ja) 2014-10-22 2016-05-19 キヤノン株式会社 情報処理装置、情報処理方法及びコンピュータプログラム
US20160180197A1 (en) 2014-12-19 2016-06-23 The Boeing Company System and method to improve object tracking using multiple tracking systems
US20170084045A1 (en) * 2015-09-23 2017-03-23 Vatics Inc. Monitoring Camera Device and Related Region-based Motion Detection Method
WO2017080399A1 (fr) 2015-11-12 2017-05-18 阿里巴巴集团控股有限公司 Procédé et dispositif pour le suivi de localisation de visage humain, et équipement électronique
US20190096069A1 (en) * 2016-02-26 2019-03-28 SZ DJI Technology Co., Ltd. Systems and methods for visual target tracking
JP2017156886A (ja) 2016-02-29 2017-09-07 Kddi株式会社 画像間類似度を考慮して物体を追跡する装置、プログラム及び方法
JP2018026108A (ja) 2016-08-08 2018-02-15 パナソニックＩｐマネジメント株式会社 物体追跡方法、物体追跡装置およびプログラム
CN106326837A (zh) 2016-08-09 2017-01-11 北京旷视科技有限公司 对象追踪方法和装置
CN106529587A (zh) 2016-08-26 2017-03-22 北京航空航天大学 基于目标点识别的视觉航向识别方法
CN106909909A (zh) 2017-03-08 2017-06-30 王华锋 一种基于共享卷积特征的人脸检测与对齐方法
CN107169939A (zh) 2017-05-31 2017-09-15 广东欧珀移动通信有限公司 图像处理方法及相关产品
CN107562805A (zh) 2017-08-08 2018-01-09 浙江大华技术股份有限公司 一种以图搜图的方法及装置
US20200160099A1 (en) * 2017-08-08 2020-05-21 Zhejiang Dahua Technology Co., Ltd. Systems and methods for searching images
US20190197703A1 (en) 2017-12-21 2019-06-27 Baidu Online Network Technology (Beijing) Co., Ltd. Method and apparatus for tracking target profile in video
US20190205694A1 (en) * 2017-12-28 2019-07-04 Qualcomm Incorporated Multi-resolution feature description for object recognition
CN108416799A (zh) 2018-03-06 2018-08-17 北京市商汤科技开发有限公司 目标跟踪方法和装置、电子设备、程序、存储介质
CN108460787A (zh) 2018-03-06 2018-08-28 北京市商汤科技开发有限公司 目标跟踪方法和装置、电子设备、程序、存储介质

Non-Patent Citations (21)

* Cited by examiner, † Cited by third party
Title
"FlowNet: Learning Optical Flow with Convolutional Networks", Dec. 2015, Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick Van De Smagt, Daniel Cremers and Thomas Brox, IEEE International Conference on Computer Vision, US, IEEE, pp. 2758-2766.
"High-Speed Tracking with Kernelized Correlation Filters"; Nov. 2014; Joao F. Henriques, Rui Caseiro, Pedro Martins and Jorge Batista; IEEE Transactions on Pattern Analysis and Machine Intelligence, 14 pgs.
"Learning to Track at 100 FPS with Deep Regression Networks"; Aug. 2016; David Held, Sebastian Thrun and Silvio Savarese, In European Conference on Computer Vision, Springer, 26 pgs.
"Object Tracking Benchmark"; Sep. 2015; Yi Wu, Jongwoo Lim and Ming-Hsuan Yang; IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, No. 9, 15 pgs.
English translation of the Written Opinion of the International Search Authority in the international application No. PCT/CN2019/076354, dated May 28, 2019, 4 pgs.
English translation of the Written Opinion of the International Search Authority in the international application No. PCT/CN2019/076355, dated May 28, 2019, 5 pgs.
Final Office Action of the U.S. Appl. No. 16/822,177, dated Sep. 9, 2021, 20 pgs.
First Office Action of the Chinese application No. 201810182797.X, dated Nov. 29, 2019, 12 pgs.
First Office Action of the Chinese application No. 201810184967.8, dated Jul. 1, 2019, 14 pgs.
First Office Action of the Japanese application No. 2020-516424, dated May 20, 2021, 6 pgs.
First Office Action of the Japanese application No. 2020-516429, dated May 18, 2021, 13 pgs.
First Office Action of the U.S. Appl. No. 16/822,177, dated Mar. 26, 2021, 20 pgs.
International Search Report in the international application No. PCT/CN2019/076354, dated May 28, 2019, 2 pgs.
International Search Report in the international application No. PCT/CN2019/076355, dated May 28, 2019, 2 pgs.
Mask R-CNN; Oct. 2017; Kaiming He, Georgia Gkioxari, Piour Dollar and Ross Girshick, In The IEEE International Conference on Computer Vision (ICCV), 9 pgs.
Notice of Allowance of the U.S. Appl. No. 16/822,177, dated Nov. 17, 2021, 18 pgs.
Second Office Action of the Chinese application No. 201810182797.X, dated May 28, 2020, 18 pgs.
Second Office Action of the Chinese application No. 201810184967.8, dated Apr. 14, 2020, 16 pgs.
Second Office Action of the Japanese application No. 2020-516424, dated Sep. 3, 2021, 6 pgs.
Written Opinion of the Singaporean application No. 11202002621S, dated Jul. 1, 2022, 9 pgs.
Written Opinion of the Singaporean application No. 11202002622Q, dated Jun. 29, 2022, 9 pgs.

Also Published As

Publication number Publication date
US20200258242A1 (en) 2020-08-13
SG11202002621SA (en) 2020-04-29
JP2020534609A (ja) 2020-11-26
JP7163372B2 (ja) 2022-10-31
WO2019170024A1 (fr) 2019-09-12

Similar Documents

Publication Publication Date Title
US11216955B2 (en) Target tracking methods and apparatuses, electronic devices, and storage media
US11455782B2 (en) Target detection method and apparatus, training method, electronic device and medium
US11783491B2 (en) Object tracking method and apparatus, storage medium, and electronic device
US11699240B2 (en) Target tracking method and apparatus, and storage medium
US10984266B2 (en) Vehicle lamp detection methods and apparatuses, methods and apparatuses for implementing intelligent driving, media and devices
US11270158B2 (en) Instance segmentation methods and apparatuses, electronic devices, programs, and media
CN111488791A (zh) 将指尖运动模式实时地设备上分类为手势
US11967132B2 (en) Lane marking detecting method, apparatus, electronic device, storage medium, and vehicle
CN113971751A (zh) 训练特征提取模型、检测相似图像的方法和装置
CN111783621A (zh) 人脸表情识别及模型训练的方法、装置、设备及存储介质
CN111783626A (zh) 图像识别方法、装置、电子设备及存储介质
CN111611903A (zh) 动作识别模型的训练方法、使用方法、装置、设备和介质
CN113378712A (zh) 物体检测模型的训练方法、图像检测方法及其装置
CN113469025A (zh) 应用于车路协同的目标检测方法、装置、路侧设备和车辆
CN114429631B (zh) 三维对象检测方法、装置、设备以及存储介质
CN114220163B (zh) 人体姿态估计方法、装置、电子设备及存储介质
CN113361519B (zh) 目标处理方法、目标处理模型的训练方法及其装置
CN114119990A (zh) 用于图像特征点匹配的方法、装置及计算机程序产品
CN113033377A (zh) 字符位置修正方法、装置、电子设备和存储介质
CN114092874B (zh) 目标检测模型的训练方法、目标检测方法及其相关设备
CN111860209B (zh) 手部识别方法、装置、电子设备及存储介质
Song et al. Real-time low-cost human skeleton detection
CN115641355A (zh) 用于检测骨架的方法、装置、设备、介质和产品
CN116524383A (zh) 手柄定位方法、装置、穿戴设备、存储介质及程序产品
CN116301361A (zh) 基于智能眼镜的目标选择方法、装置和电子设备

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STCF Information on status: patent grant

Free format text: PATENTED CASE