KR20220024494A - 사람의 단안 깊이 추정을 위한 방법 및 시스템 - Google Patents

사람의 단안 깊이 추정을 위한 방법 및 시스템 Download PDF

Info

Publication number
KR20220024494A
KR20220024494A KR1020227000964A KR20227000964A KR20220024494A KR 20220024494 A KR20220024494 A KR 20220024494A KR 1020227000964 A KR1020227000964 A KR 1020227000964A KR 20227000964 A KR20227000964 A KR 20227000964A KR 20220024494 A KR20220024494 A KR 20220024494A
Authority
KR
South Korea
Prior art keywords
joint
depth
heatmap
layer
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020227000964A
Other languages
English (en)
Korean (ko)
Inventor
콜린 브라운
루이스 하버
Original Assignee
힌지 헬스 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 힌지 헬스 인크. filed Critical 힌지 헬스 인크.
Publication of KR20220024494A publication Critical patent/KR20220024494A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06N3/0454—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G06N3/0481—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)
KR1020227000964A 2019-06-14 2020-03-27 사람의 단안 깊이 추정을 위한 방법 및 시스템 Pending KR20220024494A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CA3046612A CA3046612C (en) 2019-06-14 2019-06-14 Method and system for monocular depth estimation of persons
CA3,046,612 2019-06-14
PCT/IB2020/052936 WO2020250046A1 (en) 2019-06-14 2020-03-27 Method and system for monocular depth estimation of persons

Publications (1)

Publication Number Publication Date
KR20220024494A true KR20220024494A (ko) 2022-03-03

Family

ID=73781888

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020227000964A Pending KR20220024494A (ko) 2019-06-14 2020-03-27 사람의 단안 깊이 추정을 위한 방법 및 시스템

Country Status (6)

Country Link
US (4) US11354817B2 (cg-RX-API-DMAC7.html)
EP (1) EP3983997A4 (cg-RX-API-DMAC7.html)
JP (1) JP7499280B2 (cg-RX-API-DMAC7.html)
KR (1) KR20220024494A (cg-RX-API-DMAC7.html)
CA (2) CA3280234A1 (cg-RX-API-DMAC7.html)
WO (1) WO2020250046A1 (cg-RX-API-DMAC7.html)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA3280234A1 (en) 2019-06-14 2025-10-30 Hinge Health, Inc. Method and system for monocular depth estimation of persons
WO2021186222A1 (en) * 2020-03-20 2021-09-23 Wrnch Inc. Markerless motion capture of hands with multiple pose estimation engines
EP4009277A1 (en) * 2020-12-03 2022-06-08 Tata Consultancy Services Limited Methods and systems for generating end-to-end model to estimate 3-dimensional(3-d) pose of object
CN114036969B (zh) * 2021-03-16 2023-07-25 上海大学 一种多视角情况下的3d人体动作识别算法
US12100156B2 (en) 2021-04-12 2024-09-24 Snap Inc. Garment segmentation
WO2023022709A1 (en) * 2021-08-17 2023-02-23 Innopeak Technology, Inc. Real-time hand-held markerless human motion recording and avatar rendering in a mobile platform
KR102636549B1 (ko) * 2021-08-31 2024-02-14 광주과학기술원 노이즈 개선 네트워크 기반 보행 인식 장치 및 방법
US11670059B2 (en) 2021-09-01 2023-06-06 Snap Inc. Controlling interactive fashion based on body gestures
US11983826B2 (en) 2021-09-30 2024-05-14 Snap Inc. 3D upper garment tracking
US11636662B2 (en) 2021-09-30 2023-04-25 Snap Inc. Body normal network light and rendering control
US11651572B2 (en) 2021-10-11 2023-05-16 Snap Inc. Light and rendering of garments
CN114742698B (zh) * 2022-04-24 2025-05-30 天津大学 基于深度生成模型的威亚线擦除方法、设备及存储介质
US12394082B2 (en) * 2022-08-16 2025-08-19 Verizon Patent And Licensing Inc. Methods and systems for resolving 3D positions of multiple objects present within a 3D space
CN116205984A (zh) * 2022-08-26 2023-06-02 安徽工布智造工业科技有限公司 基于单目视觉的立方体视差校正设备的视差校正算法
CN116188555B (zh) * 2022-12-09 2025-12-12 合肥工业大学 一种基于深度网络与运动信息的单目室内深度估计算法
WO2024128124A1 (ja) * 2022-12-15 2024-06-20 日本電気株式会社 学習装置、推定装置、学習方法、推定方法ならびに記録媒体
US20240296582A1 (en) * 2023-03-01 2024-09-05 Purdue Research Foundation Pose relation transformer and refining occlusions for human pose estimation
CN117237311B (zh) * 2023-09-26 2026-04-03 国网浙江省电力有限公司杭州市富阳区供电公司 一种检测电表箱视窗破损的方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105787439B (zh) * 2016-02-04 2019-04-05 广州新节奏智能科技股份有限公司 一种基于卷积神经网络的深度图像人体关节定位方法
JP6708260B2 (ja) * 2016-11-14 2020-06-10 富士通株式会社 情報処理装置、情報処理方法、およびプログラム
US10679046B1 (en) * 2016-11-29 2020-06-09 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Machine learning systems and methods of estimating body shape from images
EP3462373A1 (en) * 2017-10-02 2019-04-03 Promaton Holding B.V. Automated classification and taxonomy of 3d teeth data using deep learning methods
CN111565638B (zh) * 2018-01-08 2023-08-15 柯惠有限合伙公司 用于基于视频的非接触式潮气容积监测的系统和方法
US10929654B2 (en) * 2018-03-12 2021-02-23 Nvidia Corporation Three-dimensional (3D) pose estimation from a monocular camera
CN108549876A (zh) * 2018-04-20 2018-09-18 重庆邮电大学 基于目标检测和人体姿态估计的坐姿检测方法
US10922573B2 (en) * 2018-10-22 2021-02-16 Future Health Works Ltd. Computer based object detection within a video or image
US10937173B2 (en) * 2018-11-15 2021-03-02 Qualcomm Incorporated Predicting subject body poses and subject movement intent using probabilistic generative models
US10839543B2 (en) * 2019-02-26 2020-11-17 Baidu Usa Llc Systems and methods for depth estimation using convolutional spatial propagation networks
US11004230B2 (en) * 2019-03-22 2021-05-11 Microsoft Technology Licensing, Llc Predicting three-dimensional articulated and target object pose
CA3280234A1 (en) 2019-06-14 2025-10-30 Hinge Health, Inc. Method and system for monocular depth estimation of persons

Also Published As

Publication number Publication date
US20220292714A1 (en) 2022-09-15
WO2020250046A1 (en) 2020-12-17
US20220108470A1 (en) 2022-04-07
CA3046612A1 (en) 2020-12-14
CA3280234A1 (en) 2025-10-30
EP3983997A1 (en) 2022-04-20
US11875529B2 (en) 2024-01-16
CA3046612C (en) 2025-12-09
US12373983B2 (en) 2025-07-29
US11354817B2 (en) 2022-06-07
JP7499280B2 (ja) 2024-06-13
JP2022536790A (ja) 2022-08-18
US20240087161A1 (en) 2024-03-14
EP3983997A4 (en) 2023-06-28
US20250336087A1 (en) 2025-10-30

Similar Documents

Publication Publication Date Title
US12373983B2 (en) Method and system for monocular depth estimation of persons
US11836853B2 (en) Generation and presentation of predicted personalized three-dimensional body models
US10701332B2 (en) Image processing apparatus, image processing method, image processing system, and storage medium
CN108875633B (zh) 表情检测与表情驱动方法、装置和系统及存储介质
CN111417983B (zh) 基于事件相机的可变形对象跟踪
US11663463B2 (en) Center-biased machine learning techniques to determine saliency in digital images
JP5837508B2 (ja) 姿勢状態推定装置および姿勢状態推定方法
JP4597391B2 (ja) 顔領域検出装置およびその方法並びにコンピュータ読み取り可能な記録媒体
KR20210028185A (ko) 사람 자세 분석 시스템 및 방법
US11159717B2 (en) Systems and methods for real time screen display coordinate and shape detection
WO2019035155A1 (ja) 画像処理システム、画像処理方法、及びプログラム
US11954905B2 (en) Landmark temporal smoothing
KR20150039252A (ko) 행동 인식 기반의 응용 서비스 제공 장치 및 그 방법
US11854146B1 (en) Three-dimensional body composition from two-dimensional images of a portion of a body
US11887252B1 (en) Body model composition update from two-dimensional face images
CN114581986A (zh) 图像处理方法、装置、电子设备及存储介质
CN116645697A (zh) 一种多视角步态识别方法、装置、电子设备及存储介质
US20250182368A1 (en) Method and application for animating computer generated images
CN117529758A (zh) 用于使用神经网络识别图像和视频中的人类协同活动的方法、系统和介质
KR102808311B1 (ko) 영상 처리 방법 및 장치
CN113989925B (zh) 刷脸互动方法和装置
Ciou et al. Indoor positioning using convolution neural network to regress camera pose
KR20240043594A (ko) 객체 영역과 배경 영역을 분류하기 위한 전자 장치 및 전자 장치의 동작 방법
CN112511764A (zh) 移动图像整合方法及移动图像整合系统

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

D21 Rejection of application intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D21-EXM-PE0902 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E13 Pre-grant limitation requested

Free format text: ST27 STATUS EVENT CODE: A-2-3-E10-E13-LIM-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D22-EXM-PE0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701