JP7422456B2 - 画像処理装置、画像処理方法及びプログラム - Google Patents

画像処理装置、画像処理方法及びプログラム Download PDF

Info

Publication number
JP7422456B2
JP7422456B2 JP2019213738A JP2019213738A JP7422456B2 JP 7422456 B2 JP7422456 B2 JP 7422456B2 JP 2019213738 A JP2019213738 A JP 2019213738A JP 2019213738 A JP2019213738 A JP 2019213738A JP 7422456 B2 JP7422456 B2 JP 7422456B2
Authority
JP
Japan
Prior art keywords
joint
score
joints
image
information processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019213738A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021086322A5 (https=
JP2021086322A (ja
Inventor
修平 小川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP2019213738A priority Critical patent/JP7422456B2/ja
Priority to US17/095,413 priority patent/US11836944B2/en
Publication of JP2021086322A publication Critical patent/JP2021086322A/ja
Publication of JP2021086322A5 publication Critical patent/JP2021086322A5/ja
Application granted granted Critical
Publication of JP7422456B2 publication Critical patent/JP7422456B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/7715—Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Image Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
JP2019213738A 2019-11-26 2019-11-26 画像処理装置、画像処理方法及びプログラム Active JP7422456B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2019213738A JP7422456B2 (ja) 2019-11-26 2019-11-26 画像処理装置、画像処理方法及びプログラム
US17/095,413 US11836944B2 (en) 2019-11-26 2020-11-11 Information processing apparatus, information processing method, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2019213738A JP7422456B2 (ja) 2019-11-26 2019-11-26 画像処理装置、画像処理方法及びプログラム

Publications (3)

Publication Number Publication Date
JP2021086322A JP2021086322A (ja) 2021-06-03
JP2021086322A5 JP2021086322A5 (https=) 2022-10-27
JP7422456B2 true JP7422456B2 (ja) 2024-01-26

Family

ID=75974180

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019213738A Active JP7422456B2 (ja) 2019-11-26 2019-11-26 画像処理装置、画像処理方法及びプログラム

Country Status (2)

Country Link
US (1) US11836944B2 (https=)
JP (1) JP7422456B2 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7490359B2 (ja) * 2019-12-24 2024-05-27 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7459949B2 (ja) * 2020-08-27 2024-04-02 日本電気株式会社 学習装置、学習方法、追跡装置及びプログラム
US20230015056A1 (en) * 2021-07-15 2023-01-19 Hill-Rom Services, Inc. Discharge risk and management
JP2023149600A (ja) * 2022-03-31 2023-10-13 株式会社アイシン 物体特徴点検出装置
JP7455889B2 (ja) * 2022-04-08 2024-03-26 楽天グループ株式会社 画像評価装置、画像処理システム、ユーザ端末、画像評価方法、および画像評価プログラム
JP2023160153A (ja) * 2022-04-21 2023-11-02 キヤノン株式会社 撮像装置、撮像装置の制御方法、及びプログラム
JP2023167058A (ja) * 2022-05-11 2023-11-24 日本電気株式会社 姿勢検出装置、姿勢検出システム、姿勢検出方法及びプログラム
JP7772259B2 (ja) * 2022-05-25 2025-11-18 日本電気株式会社 キーポイント関連付け装置、キーポイント関連付け方法、及びプログラム
CN117314993B (zh) * 2022-06-21 2025-12-19 鸿海精密工业股份有限公司 深度估计模型训练方法、深度估计方法及电子设备
US20240293931A1 (en) * 2023-12-27 2024-09-05 Intel Corporation Human-collaborative robot ergonomic interaction system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018013999A (ja) 2016-07-21 2018-01-25 日本電信電話株式会社 姿勢推定装置、方法、及びプログラム
JP2019185420A (ja) 2018-04-11 2019-10-24 株式会社アジラ 行動推定装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018013999A (ja) 2016-07-21 2018-01-25 日本電信電話株式会社 姿勢推定装置、方法、及びプログラム
JP2019185420A (ja) 2018-04-11 2019-10-24 株式会社アジラ 行動推定装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
NEWELL, Alejandro、他２名，Associative Embedding: End-to-End Learning for Joint Detection and Grouping，Computer Vision and Pattern Recognition，ARXIV.ORG，2017年06月09日，p.1-11，インターネット:<URL:https://arxiv.org/pdf/1611.05424.pdf>

Also Published As

Publication number Publication date
US20210158566A1 (en) 2021-05-27
US11836944B2 (en) 2023-12-05
JP2021086322A (ja) 2021-06-03

Similar Documents

Publication Publication Date Title
JP7422456B2 (ja) 画像処理装置、画像処理方法及びプログラム
US12169975B2 (en) Scene reconstruction in three-dimensions from two-dimensional images
US10242266B2 (en) Method and system for detecting actions in videos
US8639020B1 (en) Method and system for modeling subjects from a depth map
JP4318465B2 (ja) 人物検出装置および人物検出方法
KR100886557B1 (ko) 적응형 학습에 기반한 얼굴 인식 시스템 및 방법
CN114220176A (zh) 一种基于深度学习的人体行为的识别方法
Liu et al. Video analytic system for detecting cow structure
US20200074165A1 (en) Image analysis using neural networks for pose and action identification
CN114067358A (zh) 一种基于关键点检测技术的人体姿态识别方法及系统
CN112989889B (zh) 一种基于姿态指导的步态识别方法
Del Rincón et al. Tracking human position and lower body parts using Kalman and particle filters constrained by human biomechanics
Li et al. Robust multiperson detection and tracking for mobile service and social robots
CN109492588A (zh) 一种基于人工智能的快速车辆检测与分类方法
CN117218709A (zh) 基于时间可变形注意力机制的居家老人实时状态监测方法
JP7488674B2 (ja) 物体認識装置、物体認識方法及び物体認識プログラム
JP2005351814A (ja) 検出装置および検出方法
Kappan et al. A survey on deep learning for 2D and 3D human pose estimation
Jessika et al. A study on part affinity fields implementation for human pose estimation with deep neural network
CN119992664A (zh) 基于姿态估计的视频处理方法、装置、设备、介质和程序
JP7537700B2 (ja) 学習装置、学習データの作成方法、学習方法、及び学習プログラム
JP5688514B2 (ja) 視線計測システム、方法およびプログラム
Attamimi Object extraction using probabilistic maps of color, depth, and near-infrared information
Min et al. Extraction and temporal segmentation of multiple motion trajectories in human motion
De Beugher et al. Semi-automatic hand annotation making human-human interaction analysis fast and accurate

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221018

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221018

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230810

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230822

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231018

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20231212

RD01 Notification of change of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7421

Effective date: 20231213

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240110

R151 Written notification of patent or utility model registration

Ref document number: 7422456

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151