KR102165128B1 - 이미지 프레임들의 시퀀스 내의 관절 객체의 자동화된 추적 및 유지 - Google Patents

이미지 프레임들의 시퀀스 내의 관절 객체의 자동화된 추적 및 유지 Download PDF

Info

Publication number
KR102165128B1
KR102165128B1 KR1020190022264A KR20190022264A KR102165128B1 KR 102165128 B1 KR102165128 B1 KR 102165128B1 KR 1020190022264 A KR1020190022264 A KR 1020190022264A KR 20190022264 A KR20190022264 A KR 20190022264A KR 102165128 B1 KR102165128 B1 KR 102165128B1
Authority
KR
South Korea
Prior art keywords
image
superpixels
image frame
connectivity graph
superpixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020190022264A
Other languages
English (en)
Korean (ko)
Other versions
KR20190106704A (ko
Inventor
다니엘 유지코프
Original Assignee
소니 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 소니 주식회사 filed Critical 소니 주식회사
Publication of KR20190106704A publication Critical patent/KR20190106704A/ko
Application granted granted Critical
Publication of KR102165128B1 publication Critical patent/KR102165128B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G06V20/42—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items of sport video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G06T5/001—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/174—Segmentation; Edge detection involving the use of two or more images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/254—Analysis of motion involving subtraction of images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/262—Analysis of motion using transform domain methods, e.g. Fourier domain methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/457—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by analysing connectivity, e.g. edge linking, connected component analysis or slices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20036—Morphological image processing
    • G06T2207/20044—Skeletonization; Medial axis transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)
KR1020190022264A 2018-03-06 2019-02-26 이미지 프레임들의 시퀀스 내의 관절 객체의 자동화된 추적 및 유지 Active KR102165128B1 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/913,308 US10460156B2 (en) 2018-03-06 2018-03-06 Automated tracking and retaining of an articulated object in a sequence of image frames
US15/913,308 2018-03-06

Publications (2)

Publication Number Publication Date
KR20190106704A KR20190106704A (ko) 2019-09-18
KR102165128B1 true KR102165128B1 (ko) 2020-10-13

Family

ID=65443796

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020190022264A Active KR102165128B1 (ko) 2018-03-06 2019-02-26 이미지 프레임들의 시퀀스 내의 관절 객체의 자동화된 추적 및 유지

Country Status (5)

Country Link
US (1) US10460156B2 (https=)
EP (1) EP3537377B1 (https=)
JP (1) JP6882723B2 (https=)
KR (1) KR102165128B1 (https=)
CN (1) CN110232303B (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022139200A1 (ko) * 2020-12-22 2022-06-30 주식회사 네오펙트 연속되는 이미지 프레임에 대한 스켈레톤 분석에 기초한 동일객체 식별장치 및 식별방법

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109241844B (zh) * 2018-08-03 2020-11-17 百度在线网络技术（北京）有限公司 三维物体的姿态估计方法、装置、设备及存储介质
CN111611895B (zh) * 2020-05-15 2023-12-19 北京联合大学 一种基于OpenPose的多视角人体骨架自动标注方法
CN115439334B (zh) * 2021-06-02 2025-09-09 中国科学院分子植物科学卓越创新中心 整穗图像处理方法和装置
GB202111600D0 (en) * 2021-08-12 2021-09-29 Milestone Systems As Privacy preserving anomaly detection using semantic segmentation

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014099178A (ja) * 2012-11-15 2014-05-29 Thomson Licensing スーパーピクセルライフサイクル管理のための方法

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8150155B2 (en) 2006-02-07 2012-04-03 Qualcomm Incorporated Multi-mode region-of-interest video object segmentation
JP2009015558A (ja) * 2007-07-04 2009-01-22 Nippon Telegr & Teleph Corp <Ntt> 姿勢推定装置および姿勢推定方法
US20160065959A1 (en) * 2014-08-26 2016-03-03 Lyrical Labs Video Compression Technology, LLC Learning-based partitioning for video encoding
US20170337711A1 (en) * 2011-03-29 2017-11-23 Lyrical Labs Video Compression Technology, LLC Video processing and encoding
US9916662B2 (en) * 2015-03-17 2018-03-13 Lyrical Labs Video Compression Technology, LLC Foreground detection using fractal dimensional measures
US8630454B1 (en) 2011-05-31 2014-01-14 Google Inc. Method and system for motion detection in an image
US9373040B2 (en) * 2011-11-01 2016-06-21 Google Inc. Image matching using motion manifolds
JP5965764B2 (ja) * 2012-07-25 2016-08-10 日本放送協会 映像領域分割装置及び映像領域分割プログラム
US8811670B2 (en) 2012-09-28 2014-08-19 The Boeing Company Method and system for using fingerprints to track moving objects in video
AU2013245477A1 (en) * 2013-10-16 2015-04-30 Canon Kabushiki Kaisha Method, system and apparatus for determining a contour segment for an object in an image captured by a camera
JP6272071B2 (ja) * 2014-02-18 2018-01-31 日本放送協会 画像処理装置、画像処理方法及びプログラム
US9123133B1 (en) 2014-03-26 2015-09-01 National Taipei University Of Technology Method and apparatus for moving object detection based on cerebellar model articulation controller network
US9280831B1 (en) * 2014-10-23 2016-03-08 International Business Machines Corporation Image segmentation
US9747717B2 (en) * 2015-05-13 2017-08-29 Intel Corporation Iterative closest point technique based on a solution of inverse kinematics problem
US9547908B1 (en) * 2015-09-28 2017-01-17 Google Inc. Feature mask determination for images
US10019637B2 (en) * 2015-11-13 2018-07-10 Honda Motor Co., Ltd. Method and system for moving object detection with single camera

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014099178A (ja) * 2012-11-15 2014-05-29 Thomson Licensing スーパーピクセルライフサイクル管理のための方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"superpixel-based tracking-by-segmentation using markov chains"*

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022139200A1 (ko) * 2020-12-22 2022-06-30 주식회사 네오펙트 연속되는 이미지 프레임에 대한 스켈레톤 분석에 기초한 동일객체 식별장치 및 식별방법

Also Published As

Publication number Publication date
CN110232303B (zh) 2023-06-16
JP6882723B2 (ja) 2021-06-02
KR20190106704A (ko) 2019-09-18
US20190278980A1 (en) 2019-09-12
EP3537377A1 (en) 2019-09-11
US10460156B2 (en) 2019-10-29
CN110232303A (zh) 2019-09-13
EP3537377B1 (en) 2022-05-11
JP2019160299A (ja) 2019-09-19

Similar Documents

Publication Publication Date Title
KR102165128B1 (ko) 이미지 프레임들의 시퀀스 내의 관절 객체의 자동화된 추적 및 유지
US10380756B2 (en) Video processing system and method for object detection in a sequence of image frames
KR102169431B1 (ko) 이미지들의 시퀀스 중의 이미지에서의 객체 경계 안정화를 위한 이미지 처리 장치 및 방법
CN108122208B (zh) 用于对对象分割的前景掩模校正的图像处理设备和方法
US10916019B2 (en) Moving object detection in image frames based on optical flow maps
US11182903B2 (en) Image mask generation using a deep neural network
US9560271B2 (en) Removing unwanted objects from photographed image
US20170061229A1 (en) Method and system for object tracking
KR102598459B1 (ko) 지평면 검출에 기초한 이미지 시퀀스로부터의 사람 객체의 손실 발 복구
US11200678B2 (en) Image-based mask frame interpolation
KR20210069686A (ko) 사용자 지정 초기화 포인트에 기반한 개체 추적
JP2019160299A5 (https=)
US20250131572A1 (en) Method and device for performing video enhancement
US10089721B2 (en) Image processing system and method for object boundary smoothening for image segmentation
US12361752B2 (en) Face detection based on facial key-points
KR102203884B1 (ko) 촬상 장치 및 제어 방법

Legal Events

Date Code Title Description
A201 Request for examination
PA0109 Patent application

St.27 status event code: A-0-1-A10-A12-nap-PA0109

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E601 Decision to refuse application
PE0601 Decision on rejection of patent

St.27 status event code: N-2-6-B10-B15-exm-PE0601

X091 Application refused [patent]
T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

T13-X000 Administrative time limit extension granted

St.27 status event code: U-3-3-T10-T13-oth-X000

AMND Amendment
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PX0901 Re-examination

St.27 status event code: A-2-3-E10-E12-rex-PX0901

PX0701 Decision of registration after re-examination

St.27 status event code: A-3-4-F10-F13-rex-PX0701

X701 Decision to grant (after re-examination)
GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U11-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PN2301 Change of applicant

St.27 status event code: A-5-5-R10-R13-asn-PN2301

St.27 status event code: A-5-5-R10-R11-asn-PN2301

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000