CN116830166A - 骨骼识别方法、骨骼识别程序以及体操评分辅助系统 - Google Patents

骨骼识别方法、骨骼识别程序以及体操评分辅助系统 Download PDF

Info

Publication number
CN116830166A
CN116830166A CN202180093006.6A CN202180093006A CN116830166A CN 116830166 A CN116830166 A CN 116830166A CN 202180093006 A CN202180093006 A CN 202180093006A CN 116830166 A CN116830166 A CN 116830166A
Authority
CN
China
Prior art keywords
feature
features
joint
information
abnormal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180093006.6A
Other languages
English (en)
Chinese (zh)
Inventor
铃木达也
石川优
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Publication of CN116830166A publication Critical patent/CN116830166A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/285—Analysis of motion using a sequence of stereo image pairs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/292—Multi-camera tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/34—Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/62—Extraction of image or video features relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20036—Morphological image processing
    • G06T2207/20044—Skeletonization; Medial axis transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
CN202180093006.6A 2021-03-09 2021-03-09 骨骼识别方法、骨骼识别程序以及体操评分辅助系统 Pending CN116830166A (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/009267 WO2022190206A1 (ja) 2021-03-09 2021-03-09 骨格認識方法、骨格認識プログラムおよび体操採点支援システム

Publications (1)

Publication Number Publication Date
CN116830166A true CN116830166A (zh) 2023-09-29

Family

ID=83226426

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180093006.6A Pending CN116830166A (zh) 2021-03-09 2021-03-09 骨骼识别方法、骨骼识别程序以及体操评分辅助系统

Country Status (5)

Country Link
US (1) US12620118B2 (cg-RX-API-DMAC7.html)
EP (1) EP4307213A4 (cg-RX-API-DMAC7.html)
JP (1) JP7533765B2 (cg-RX-API-DMAC7.html)
CN (1) CN116830166A (cg-RX-API-DMAC7.html)
WO (1) WO2022190206A1 (cg-RX-API-DMAC7.html)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117542083A (zh) * 2023-12-01 2024-02-09 中南大学湘雅医院 基于超声波的骨骼图像识别方法及系统

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024073698A1 (en) 2022-09-30 2024-04-04 Hinge Health, Inc. Two-dimensional pose estimation based on bipartite matching of joint type heatmaps and joint person heatmaps
US12602797B2 (en) * 2023-10-31 2026-04-14 Rapsodo Pte. Ltd. Reconstruction of body motion using a camera system camera system for reconstruction of body motion based on 3D joint heat map

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103155003A (zh) * 2010-10-08 2013-06-12 松下电器产业株式会社 姿势估计装置及姿势估计方法
US20130195330A1 (en) * 2012-01-31 2013-08-01 Electronics And Telecommunications Research Institute Apparatus and method for estimating joint structure of human body
CN108229332A (zh) * 2017-12-08 2018-06-29 华为技术有限公司 骨骼姿态确定方法、装置及计算机可读存储介质

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3860287B2 (ja) 1997-04-25 2006-12-20 富士通株式会社 動き抽出処理方法,動き抽出処理装置およびプログラム記憶媒体
JP2000251078A (ja) 1998-12-22 2000-09-14 Atr Media Integration & Communications Res Lab 人物の3次元姿勢推定方法および装置ならびに人物の肘の位置推定方法および装置
JP5786463B2 (ja) * 2011-06-01 2015-09-30 ソニー株式会社 画像処理装置、画像処理方法、およびプログラム
WO2019069369A1 (ja) * 2017-10-03 2019-04-11 富士通株式会社 姿勢認識システム、画像補正プログラムおよび画像補正方法
JP7209333B2 (ja) * 2018-09-10 2023-01-20 国立大学法人 東京大学 関節位置の取得方法及び装置、動作の取得方法及び装置
JP7014304B2 (ja) 2018-10-22 2022-02-01 富士通株式会社 認識方法、認識プログラム、認識装置および学習方法
TWI715903B (zh) * 2018-12-24 2021-01-11 財團法人工業技術研究院 動作追蹤系統及方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103155003A (zh) * 2010-10-08 2013-06-12 松下电器产业株式会社 姿势估计装置及姿势估计方法
US20130195330A1 (en) * 2012-01-31 2013-08-01 Electronics And Telecommunications Research Institute Apparatus and method for estimating joint structure of human body
CN108229332A (zh) * 2017-12-08 2018-06-29 华为技术有限公司 骨骼姿态确定方法、装置及计算机可读存储介质
US20190251341A1 (en) * 2017-12-08 2019-08-15 Huawei Technologies Co., Ltd. Skeleton Posture Determining Method and Apparatus, and Computer Readable Storage Medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LONG CHEN: ""Cross-View Tracking for Multi-Human 3D Pose Estimation at Ove 100 FPS"", 《2020IEE/CVPR》, 5 August 2020 (2020-08-05), pages 3276 - 3285 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117542083A (zh) * 2023-12-01 2024-02-09 中南大学湘雅医院 基于超声波的骨骼图像识别方法及系统

Also Published As

Publication number Publication date
EP4307213A1 (en) 2024-01-17
US20230368415A1 (en) 2023-11-16
WO2022190206A1 (ja) 2022-09-15
JP7533765B2 (ja) 2024-08-14
JPWO2022190206A1 (cg-RX-API-DMAC7.html) 2022-09-15
EP4307213A4 (en) 2024-03-06
US12620118B2 (en) 2026-05-05

Similar Documents

Publication Publication Date Title
EP4002198B1 (en) Posture acquisition method and device, and key point coordinate positioning model training method and device
Yan et al. Cimi4d: A large multimodal climbing motion dataset under human-scene interactions
JP6204659B2 (ja) 映像処理装置及び映像処理方法
US20130100140A1 (en) Human body and facial animation systems with 3d camera and method thereof
CN104035557B (zh) 一种基于关节活跃度的Kinect动作识别方法
US20220319236A1 (en) Scoring metric for physical activity performance and tracking
US12620118B2 (en) Skeleton recognition method, non-transitory computer-readable recording medium, and gymnastics scoring assist system
JP7586344B2 (ja) 入力画像の処理方法、入力画像の処理装置及びプログラム
CN109448105A (zh) 基于多深度图像传感器的三维人体骨架生成方法及系统
JP7571796B2 (ja) 骨格認識装置、学習方法および学習プログラム
CN109961092B (zh) 一种基于视差锚点的双目视觉立体匹配方法及系统
JP7757851B2 (ja) 骨格認識プログラム、骨格認識方法および骨格認識装置
CN114722913A (zh) 姿态检测方法、装置、电子设备及计算机可读存储介质
Vo et al. Spatiotemporal bundle adjustment for dynamic 3d human reconstruction in the wild
Guo et al. Monocular 3D multi-person pose estimation via predicting factorized correction factors
Baumgartner et al. Extracting spatial knowledge from track and field broadcasts for monocular 3D human pose estimation
Nicodemou et al. Learning to infer the depth map of a hand from its color image
Munn et al. FixTag: An algorithm for identifying and tagging fixations to simplify the analysis of data collected by portable eye trackers
JP7727273B2 (ja) 姿勢評価装置、姿勢評価システム、姿勢評価方法、及びプログラム
JP6839116B2 (ja) 学習装置、推定装置、学習方法、推定方法及びコンピュータプログラム
CN116919391A (zh) 运动障碍评估方法和设备
US20220375266A1 (en) Computer-readable recording medium storing control program, control method, and information processing apparatus
Ooke et al. Transfer learning of deep neural network human pose estimator by domain-specific data for video motion capturing
JP6641313B2 (ja) 領域抽出装置及びプログラム
JP7726390B2 (ja) 映像処理装置、映像処理方法、およびプログラム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination