JP7533765B2 - 骨格認識方法、骨格認識プログラムおよび体操採点支援システム - Google Patents

骨格認識方法、骨格認識プログラムおよび体操採点支援システム Download PDF

Info

Publication number
JP7533765B2
JP7533765B2 JP2023504918A JP2023504918A JP7533765B2 JP 7533765 B2 JP7533765 B2 JP 7533765B2 JP 2023504918 A JP2023504918 A JP 2023504918A JP 2023504918 A JP2023504918 A JP 2023504918A JP 7533765 B2 JP7533765 B2 JP 7533765B2
Authority
JP
Japan
Prior art keywords
feature
features
joint
abnormal
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2023504918A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022190206A1 (https=
JPWO2022190206A5 (https=
Inventor
達也 鈴木
優 石川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Publication of JPWO2022190206A1 publication Critical patent/JPWO2022190206A1/ja
Publication of JPWO2022190206A5 publication Critical patent/JPWO2022190206A5/ja
Application granted granted Critical
Publication of JP7533765B2 publication Critical patent/JP7533765B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/285—Analysis of motion using a sequence of stereo image pairs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/292—Multi-camera tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/34—Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/62—Extraction of image or video features relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20036—Morphological image processing
    • G06T2207/20044—Skeletonization; Medial axis transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
JP2023504918A 2021-03-09 2021-03-09 骨格認識方法、骨格認識プログラムおよび体操採点支援システム Active JP7533765B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/009267 WO2022190206A1 (ja) 2021-03-09 2021-03-09 骨格認識方法、骨格認識プログラムおよび体操採点支援システム

Publications (3)

Publication Number Publication Date
JPWO2022190206A1 JPWO2022190206A1 (https=) 2022-09-15
JPWO2022190206A5 JPWO2022190206A5 (https=) 2023-10-05
JP7533765B2 true JP7533765B2 (ja) 2024-08-14

Family

ID=83226426

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023504918A Active JP7533765B2 (ja) 2021-03-09 2021-03-09 骨格認識方法、骨格認識プログラムおよび体操採点支援システム

Country Status (4)

Country Link
EP (1) EP4307213A4 (https=)
JP (1) JP7533765B2 (https=)
CN (1) CN116830166A (https=)
WO (1) WO2022190206A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117542083B (zh) * 2023-12-01 2024-11-05 中南大学湘雅医院 基于超声波的骨骼图像识别方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190251341A1 (en) 2017-12-08 2019-08-15 Huawei Technologies Co., Ltd. Skeleton Posture Determining Method and Apparatus, and Computer Readable Storage Medium
WO2020054442A1 (ja) 2018-09-10 2020-03-19 国立大学法人東京大学 関節位置の取得方法及び装置、動作の取得方法及び装置
WO2020084667A1 (ja) 2018-10-22 2020-04-30 富士通株式会社 認識方法、認識プログラム、認識装置、学習方法、学習プログラムおよび学習装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3860287B2 (ja) 1997-04-25 2006-12-20 富士通株式会社 動き抽出処理方法，動き抽出処理装置およびプログラム記憶媒体
JP2000251078A (ja) 1998-12-22 2000-09-14 Atr Media Integration & Communications Res Lab 人物の３次元姿勢推定方法および装置ならびに人物の肘の位置推定方法および装置
WO2012046392A1 (ja) * 2010-10-08 2012-04-12 パナソニック株式会社 姿勢推定装置及び姿勢推定方法
KR101849373B1 (ko) * 2012-01-31 2018-04-17 한국전자통신연구원 인체의 관절구조를 추정하기 위한 장치 및 방법

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190251341A1 (en) 2017-12-08 2019-08-15 Huawei Technologies Co., Ltd. Skeleton Posture Determining Method and Apparatus, and Computer Readable Storage Medium
WO2020054442A1 (ja) 2018-09-10 2020-03-19 国立大学法人東京大学 関節位置の取得方法及び装置、動作の取得方法及び装置
WO2020084667A1 (ja) 2018-10-22 2020-04-30 富士通株式会社 認識方法、認識プログラム、認識装置、学習方法、学習プログラムおよび学習装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CHEN, Long et al.，Cross-View Tracking for Multi-Human 3D Pose Estimation at Over 100 FPS，2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) [online]，IEEE，2020年06月，pp. 3276-3285，[検索日 2024.03.07]，インターネット，ＵＲＬ：https://ieeexplore.ieee.org/document/9156586

Also Published As

Publication number Publication date
US20230368415A1 (en) 2023-11-16
JPWO2022190206A1 (https=) 2022-09-15
WO2022190206A1 (ja) 2022-09-15
EP4307213A4 (en) 2024-03-06
EP4307213A1 (en) 2024-01-17
CN116830166A (zh) 2023-09-29

Similar Documents

Publication Publication Date Title
KR101616926B1 (ko) 영상 처리 장치 및 방법
JP7367764B2 (ja) 骨格認識方法、骨格認識プログラムおよび情報処理装置
JP6204659B2 (ja) 映像処理装置及び映像処理方法
CN104035557B (zh) 一种基于关节活跃度的Kinect动作识别方法
JP7164045B2 (ja) 骨格認識方法、骨格認識プログラムおよび骨格認識システム
KR20220149717A (ko) 단안 카메라로부터 전체 골격 3d 포즈 복구
CN110598590A (zh) 基于多视角相机的紧密交互人体姿态估计方法及装置
JP7501543B2 (ja) 情報処理装置、情報処理方法及び情報処理プログラム
JPWO2018207365A1 (ja) 距離画像処理装置、距離画像処理システム、距離画像処理方法および距離画像処理プログラム
JP7318814B2 (ja) データ生成方法、データ生成プログラムおよび情報処理装置
US12243258B1 (en) Gaze target detection method and system
JP7586344B2 (ja) 入力画像の処理方法、入力画像の処理装置及びプログラム
TWI668670B (zh) 深度圖產生裝置
CN114722913A (zh) 姿态检测方法、装置、电子设备及计算机可读存储介质
CN117197890B (zh) 人体行为识别方法、电子设备及介质
JP7533765B2 (ja) 骨格認識方法、骨格認識プログラムおよび体操採点支援システム
JP7439832B2 (ja) ３次元姿勢推定方法、プログラム、記録媒体および３次元姿勢推定装置
KR101362462B1 (ko) 스테레오 카메라를 이용한 장애물 검출 장치 및 방법
US20240281984A1 (en) Motion data generation device, motion data generation method, and recording medium
US12620118B2 (en) Skeleton recognition method, non-transitory computer-readable recording medium, and gymnastics scoring assist system
CN116648190B (zh) 骨架估计装置、骨架估计方法及体操评分辅助系统
JP7726390B2 (ja) 映像処理装置、映像処理方法、およびプログラム
JP7700870B2 (ja) 推定プログラム、推定方法および情報処理装置
CN119941821B (zh) 基于双目流深度估计的人体姿态关键角度计算方法
JP6641313B2 (ja) 領域抽出装置及びプログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230713

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230713

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240312

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240507

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240702

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240715

R150 Certificate of patent or registration of utility model

Ref document number: 7533765

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150