JP6927937B2 - 三次元骨格表現を生成するためのシステム及び方法 - Google Patents

三次元骨格表現を生成するためのシステム及び方法 Download PDF

Info

Publication number
JP6927937B2
JP6927937B2 JP2018180654A JP2018180654A JP6927937B2 JP 6927937 B2 JP6927937 B2 JP 6927937B2 JP 2018180654 A JP2018180654 A JP 2018180654A JP 2018180654 A JP2018180654 A JP 2018180654A JP 6927937 B2 JP6927937 B2 JP 6927937B2
Authority
JP
Japan
Prior art keywords
person
dimensional
links
representation
depth
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018180654A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019061679A (ja
JP2019061679A5 (enExample
Inventor
ノースカット ブランドン
ノースカット ブランドン
ストーン ケビン
ストーン ケビン
ムシュガン コンスタンティン
ムシュガン コンスタンティン
ブーマ カタリーナ
ブーマ カタリーナ
ムラセ カズト
ムラセ カズト
オチアイ アキヨシ
オチアイ アキヨシ
Original Assignee
トヨタ リサーチ インスティテュート，インコーポレイティド
トヨタ リサーチ インスティテュート，インコーポレイティド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by トヨタ リサーチ インスティテュート，インコーポレイティド, トヨタ リサーチ インスティテュート，インコーポレイティド filed Critical トヨタ リサーチ インスティテュート，インコーポレイティド
Publication of JP2019061679A publication Critical patent/JP2019061679A/ja
Publication of JP2019061679A5 publication Critical patent/JP2019061679A5/ja
Application granted granted Critical
Publication of JP6927937B2 publication Critical patent/JP6927937B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G06V40/25—Recognition of walking or running movements, e.g. gait recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)
  • Collating Specific Patterns (AREA)
JP2018180654A 2017-09-26 2018-09-26 三次元骨格表現を生成するためのシステム及び方法 Active JP6927937B2 (ja)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201762563427P 2017-09-26 2017-09-26
US62/563,427 2017-09-26
US15/868,374 2018-01-11
US15/868,374 US10607079B2 (en) 2017-09-26 2018-01-11 Systems and methods for generating three dimensional skeleton representations

Publications (3)

Publication Number Publication Date
JP2019061679A JP2019061679A (ja) 2019-04-18
JP2019061679A5 JP2019061679A5 (enExample) 2020-08-06
JP6927937B2 true JP6927937B2 (ja) 2021-09-01

Family

ID=65807643

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018180654A Active JP6927937B2 (ja) 2017-09-26 2018-09-26 三次元骨格表現を生成するためのシステム及び方法

Country Status (2)

Country Link
US (1) US10607079B2 (enExample)
JP (1) JP6927937B2 (enExample)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491820B (zh) * 2018-04-02 2022-04-12 京东方科技集团股份有限公司 图像中肢体表示信息的识别方法、装置及设备、存储介质
US11580724B2 (en) * 2019-07-23 2023-02-14 Toyota Research Institute, Inc. Virtual teach and repeat mobile manipulation system
JP7502881B2 (ja) * 2020-03-30 2024-06-19 株式会社バンダイナムコエンターテインメント プログラム及び仮想モデル生成制御装置
CN113510707A (zh) * 2021-07-23 2021-10-19 上海擎朗智能科技有限公司 一种机器人的控制方法、装置、电子设备及存储介质
WO2023022709A1 (en) * 2021-08-17 2023-02-23 Innopeak Technology, Inc. Real-time hand-held markerless human motion recording and avatar rendering in a mobile platform
US11553043B1 (en) 2022-06-16 2023-01-10 Embark Trucks Inc. Low bandwidth protocol for streaming sensor data

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10037491A1 (de) * 2000-08-01 2002-02-14 Stryker Leibinger Gmbh & Co Kg Verfahren zum dreidimensionalen Visualisieren von Strukturen im Körperinneren
KR101323966B1 (ko) * 2004-07-30 2013-10-31 익스트림 리얼리티 엘티디. 이미지 프로세싱을 기반으로 한 3ｄ 공간 차원용 시스템 및 방법
US8976160B2 (en) * 2005-03-01 2015-03-10 Eyesmatch Ltd User interface and authentication for a virtual mirror
US9165199B2 (en) 2007-12-21 2015-10-20 Honda Motor Co., Ltd. Controlled human pose estimation from depth image streams
US8542252B2 (en) * 2009-05-29 2013-09-24 Microsoft Corporation Target digitization, extraction, and tracking
US20110025689A1 (en) * 2009-07-29 2011-02-03 Microsoft Corporation Auto-Generating A Visual Representation
US8582867B2 (en) 2010-09-16 2013-11-12 Primesense Ltd Learning-based pose estimation from depth maps
US8922547B2 (en) 2010-12-22 2014-12-30 Electronics And Telecommunications Research Institute 3D model shape transformation method and apparatus
US9047507B2 (en) 2012-05-02 2015-06-02 Apple Inc. Upper-body skeleton extraction from depth maps
EP2674913B1 (en) * 2012-06-14 2014-07-23 Softkinetic Software Three-dimensional object modelling fitting & tracking.
US9275277B2 (en) 2013-02-22 2016-03-01 Kaiser Foundation Hospitals Using a combination of 2D and 3D image data to determine hand features information
US9340155B2 (en) * 2013-09-17 2016-05-17 Toyota Motor Sales, U.S.A., Inc. Interactive vehicle window display system with user identification
US9911219B2 (en) * 2015-05-13 2018-03-06 Intel Corporation Detection, tracking, and pose estimation of an articulated body
EP3425591B1 (en) * 2017-07-07 2021-01-13 Tata Consultancy Services Limited System and method for tracking body joints

Also Published As

Publication number Publication date
JP2019061679A (ja) 2019-04-18
US10607079B2 (en) 2020-03-31
US20190095711A1 (en) 2019-03-28

Similar Documents

Publication Publication Date Title
JP6927937B2 (ja) 三次元骨格表現を生成するためのシステム及び方法
JP6927938B2 (ja) クラウドサービスシステムを組み込んだロボットシステム
Alatise et al. A review on challenges of autonomous mobile robot and sensor fusion methods
KR102697721B1 (ko) 로봇 자율 모션 계획 및 내비게이션을 위한 시스템 및 방법들
Zhang et al. An indoor wayfinding system based on geometric features aided graph SLAM for the visually impaired
Kandalan et al. Techniques for constructing indoor navigation systems for the visually impaired: A review
Roda-Sanchez et al. Comparison of RGB-D and IMU-based gesture recognition for human-robot interaction in remanufacturing
Ye et al. 6-DOF pose estimation of a robotic navigation aid by tracking visual and geometric features
US11847741B2 (en) System and method of scanning an environment and generating two dimensional images of the environment
EP3205127B1 (en) A method of setting up a tracking system
JP7428436B2 (ja) 随意のデュアルレンジ運動学を用いたプロキシコントローラスーツ
CN106708037A (zh) 自主移动式设备定位的方法、装置及自主移动式设备
Beyl et al. Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgical operating room
CN105184268A (zh) 手势识别设备、手势识别方法及虚拟现实系统
Chikhalikar et al. An object-oriented navigation strategy for service robots leveraging semantic information
JP7454677B2 (ja) 質量中心位置決定方法、装置、足式ロボット及びコンピュータプログラム
Matthies et al. Loomorescue: An affordable rescue robot for evacuation situations
Shafii et al. Autonomous interactive object manipulation and navigation capabilities for an intelligent wheelchair
Li et al. Development and demonstration of indoor three-dimensional localization using ir cmos sensors for mobile manipulators
Fabian et al. One-point visual odometry using a RGB-depth camera pair
Gulde et al. Vision-based slam navigation for vibro-tactile human-centered indoor guidance
Almer Casino et al. Autonomous medical robot
JP7196894B2 (ja) 情報処理装置、情報処理システム及びプログラム
Li A new efficient pose estimation and tracking method for personal devices: application to interaction in smart spaces
WO2024182277A1 (en) Image-based delocalization recovery

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200625

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200625

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210706

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210805

R150 Certificate of patent or registration of utility model

Ref document number: 6927937

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350