CN112753007A - 虚拟角色的姿势空间变形的姿势空间维度减小 - Google Patents

虚拟角色的姿势空间变形的姿势空间维度减小 Download PDF

Info

Publication number
CN112753007A
CN112753007A CN201980062589.9A CN201980062589A CN112753007A CN 112753007 A CN112753007 A CN 112753007A CN 201980062589 A CN201980062589 A CN 201980062589A CN 112753007 A CN112753007 A CN 112753007A
Authority
CN
China
Prior art keywords
user
cluster
pose
space
input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980062589.9A
Other languages
English (en)
Chinese (zh)
Inventor
S·M·科默
G·韦迪希
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CN112753007A publication Critical patent/CN112753007A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
    • G06V10/763—Non-hierarchical techniques, e.g. based on statistics of modelling distributions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/7715—Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
CN201980062589.9A 2018-07-27 2019-07-25 虚拟角色的姿势空间变形的姿势空间维度减小 Pending CN112753007A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862711326P 2018-07-27 2018-07-27
US62/711,326 2018-07-27
PCT/US2019/043506 WO2020023788A1 (en) 2018-07-27 2019-07-25 Pose space dimensionality reduction for pose space deformation of a virtual character

Publications (1)

Publication Number Publication Date
CN112753007A true CN112753007A (zh) 2021-05-04

Family

ID=69177449

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980062589.9A Pending CN112753007A (zh) 2018-07-27 2019-07-25 虚拟角色的姿势空间变形的姿势空间维度减小

Country Status (5)

Country Link
US (3) US10950024B2 (https=)
EP (1) EP3830673A4 (https=)
JP (2) JP7459050B2 (https=)
CN (1) CN112753007A (https=)
WO (1) WO2020023788A1 (https=)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113470113A (zh) * 2021-08-13 2021-10-01 西南科技大学 一种融合brief特征匹配与icp点云配准的零部件姿态估计方法
CN113554736A (zh) * 2021-09-22 2021-10-26 成都市谛视科技有限公司 骨骼动画顶点矫正方法及模型的学习方法、装置和设备
CN113766418A (zh) * 2021-08-31 2021-12-07 中国矿业大学 一种基于uwb技术的姿态自校正井下运输设备及其控制方法
CN115223240A (zh) * 2022-07-05 2022-10-21 北京甲板智慧科技有限公司 基于动态时间规整算法的运动实时计数方法和系统
CN117037275A (zh) * 2023-08-14 2023-11-10 清华大学 一种语义保持的数字人手部动作重定向方法、装置和设备

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109584295B (zh) 2017-09-29 2022-08-26 阿里巴巴集团控股有限公司 对图像内目标物体进行自动标注的方法、装置及系统
EP3830673A4 (en) 2018-07-27 2022-05-04 Magic Leap, Inc. REDUCTION OF LAY SPACE DIMENSIONALITY INTENDED FOR LAY SPACE DEFORMATION OF A VIRTUAL CHARACTER
WO2021202803A1 (en) * 2020-03-31 2021-10-07 Sony Group Corporation Volumetric capture and mesh-tracking based machine learning
CN115769174A (zh) * 2020-04-03 2023-03-07 奇跃公司 用于最佳注视辨别的化身定制
JP7600693B2 (ja) * 2021-01-13 2024-12-17 株式会社リコー 光学装置、視線検出装置、網膜投影表示装置、頭部装着型表示装置、検眼装置、立体物の傾き検出方法及び視線検出方法
US11830121B1 (en) 2021-01-26 2023-11-28 Electronic Arts Inc. Neural animation layering for synthesizing martial arts movements
WO2023063570A1 (ko) 2021-10-14 2023-04-20 삼성전자 주식회사 손 동작에 관한 이미지 데이터를 획득하는 전자 장치 및 그 동작 방법
CN116205956B (zh) * 2021-11-30 2026-04-21 合肥美亚光电技术股份有限公司 点云配准方法、装置以及医疗影像设备
US12374014B2 (en) 2021-12-07 2025-07-29 Electronic Arts Inc. Predicting facial expressions using character motion states
US20250157078A1 (en) * 2022-02-14 2025-05-15 Nec Corporation Image processing apparatus, image processing method, and non-transitory storage medium
US11887233B2 (en) * 2022-02-18 2024-01-30 Digital Domain Virtual Human (Us), Inc. Machine learning acceleration of complex deformations such as muscle, skin and clothing simulation
US12205214B2 (en) * 2022-02-23 2025-01-21 Electronic Arts Inc. Joint twist generation for animation
WO2023170795A1 (ja) * 2022-03-08 2023-09-14 ソフトバンク株式会社 情報処理装置、情報処理方法、およびプログラム
US12403400B2 (en) 2022-03-31 2025-09-02 Electronic Arts Inc. Learning character motion alignment with periodic autoencoders
CN115293239B (zh) * 2022-07-06 2026-01-06 武汉大学 一种基于大数据信息挖掘的定位定姿在线学习方法及系统
US20240085987A1 (en) * 2022-09-12 2024-03-14 Apple Inc. Environmentally Aware Gestures
JP7721088B2 (ja) * 2022-09-20 2025-08-12 本田技研工業株式会社 情報処理装置、情報処理方法、及びプログラム
WO2025186722A1 (en) * 2024-03-06 2025-09-12 Green Ai Solutions Pte.Ltd. System and method for personalizing the operation of avatar movements

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5459636A (en) * 1994-01-14 1995-10-17 Hughes Aircraft Company Position and orientation estimation neural network system and method
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
JP3976200B2 (ja) 2003-12-05 2007-09-12 株式会社コナミデジタルエンタテインメント データ処理方法、データ処理装置
JP4509860B2 (ja) 2005-05-25 2010-07-21 株式会社東芝 データ分割装置、データ分割方法およびプログラム
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
JP4536095B2 (ja) 2007-09-04 2010-09-01 株式会社コナミデジタルエンタテインメント 画像処理プログラム、画像処理装置及び画像処理制御方法
US8249343B2 (en) * 2008-10-15 2012-08-21 Xerox Corporation Representing documents with runlength histograms
JP2010176380A (ja) 2009-01-29 2010-08-12 Sony Corp 情報処理装置および方法、プログラム、並びに記録媒体
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
AU2011348122A1 (en) 2010-12-24 2013-07-11 Magic Leap Inc. An ergonomic head mounted display device and optical system
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
JP6316186B2 (ja) 2011-05-06 2018-04-25 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 広範囲同時遠隔ディジタル提示世界
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
US9215293B2 (en) 2011-10-28 2015-12-15 Magic Leap, Inc. System and method for augmented and virtual reality
WO2013152205A1 (en) 2012-04-05 2013-10-10 Augmented Vision Inc. Wide-field of view (fov) imaging devices with active foveation capability
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US9123175B1 (en) * 2012-06-29 2015-09-01 Lucasfilm Entertainment Company Ltd. Pose space simplicial interpolation
KR20150054967A (ko) 2012-09-11 2015-05-20 매직 립, 인코포레이티드 인체공학적 헤드 마운티드 디스플레이 디바이스 및 광학 시스템
KR102141992B1 (ko) 2013-01-15 2020-08-06 매직 립, 인코포레이티드 초고해상도 스캐닝 섬유 디스플레이
IL308285B2 (en) 2013-03-11 2024-11-01 Magic Leap Inc System and method for augmentation and virtual reality
US9417452B2 (en) 2013-03-15 2016-08-16 Magic Leap, Inc. Display system and method
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
JP2015026186A (ja) * 2013-07-25 2015-02-05 学校法人常翔学園 ３次元コンピュータグラフィックスモデル及びその画像の作成方法、同システム、並びにバーチャル試着方法
JP6479785B2 (ja) 2013-10-16 2019-03-06 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 調節可能な瞳孔間距離を有する仮想または拡張現実ヘッドセット
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
CN107272199B (zh) 2013-11-27 2023-04-07 奇跃公司 虚拟和增强现实系统与方法
US9524582B2 (en) 2014-01-28 2016-12-20 Siemens Healthcare Gmbh Method and system for constructing personalized avatars using a parameterized deformable mesh
KR102177133B1 (ko) 2014-01-31 2020-11-10 매직 립, 인코포레이티드 멀티-포컬 디스플레이 시스템 및 방법
CN106233189B (zh) 2014-01-31 2020-06-26 奇跃公司 多焦点显示系统和方法
JP2015163947A (ja) 2014-02-03 2015-09-10 キヤノン株式会社 光源光学系およびこれを用いた光源装置、画像表示装置
US10255492B2 (en) 2014-03-05 2019-04-09 Konica Minolta, Inc. Image processing method providing information for identifying a function of an object, the function being identified based on a pose of a person with respect to the object
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP3140780B1 (en) 2014-05-09 2020-11-04 Google LLC Systems and methods for discerning eye signals and continuous biometric identification
NZ727350A (en) 2014-05-30 2020-08-28 Magic Leap Inc Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
US9987749B2 (en) 2014-08-15 2018-06-05 University Of Central Florida Research Foundation, Inc. Control interface for robotic humanoid avatar system and related methods
US9519988B2 (en) 2014-09-30 2016-12-13 Pixar Subspace clothing simulation using adaptive bases
EP3341919A4 (en) * 2015-09-07 2019-04-03 Sony Interactive Entertainment America LLC PICTURE REGULATORY AND RETARGETING SYSTEM
CN108140105A (zh) * 2015-09-29 2018-06-08 比纳里虚拟现实技术有限公司 具有脸部表情检测能力的头戴式显示器
EP3830673A4 (en) 2018-07-27 2022-05-04 Magic Leap, Inc. REDUCTION OF LAY SPACE DIMENSIONALITY INTENDED FOR LAY SPACE DEFORMATION OF A VIRTUAL CHARACTER

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113470113A (zh) * 2021-08-13 2021-10-01 西南科技大学 一种融合brief特征匹配与icp点云配准的零部件姿态估计方法
CN113470113B (zh) * 2021-08-13 2023-07-21 西南科技大学 一种融合brief特征匹配与icp点云配准的零部件姿态估计方法
CN113766418A (zh) * 2021-08-31 2021-12-07 中国矿业大学 一种基于uwb技术的姿态自校正井下运输设备及其控制方法
CN113554736A (zh) * 2021-09-22 2021-10-26 成都市谛视科技有限公司 骨骼动画顶点矫正方法及模型的学习方法、装置和设备
CN113554736B (zh) * 2021-09-22 2021-12-21 成都市谛视科技有限公司 骨骼动画顶点矫正方法及模型的学习方法、装置和设备
CN115223240A (zh) * 2022-07-05 2022-10-21 北京甲板智慧科技有限公司 基于动态时间规整算法的运动实时计数方法和系统
CN117037275A (zh) * 2023-08-14 2023-11-10 清华大学 一种语义保持的数字人手部动作重定向方法、装置和设备

Also Published As

Publication number Publication date
JP7459050B2 (ja) 2024-04-01
US20200035009A1 (en) 2020-01-30
US10950024B2 (en) 2021-03-16
EP3830673A1 (en) 2021-06-09
JP2021530815A (ja) 2021-11-11
US20220327756A1 (en) 2022-10-13
US11670032B2 (en) 2023-06-06
US20210304477A1 (en) 2021-09-30
EP3830673A4 (en) 2022-05-04
JP2024069598A (ja) 2024-05-21
WO2020023788A1 (en) 2020-01-30
US11328467B2 (en) 2022-05-10

Similar Documents

Publication Publication Date Title
US11670032B2 (en) Pose space dimensionality reduction for pose space deformation of a virtual character
US12033263B2 (en) Using three-dimensional scans of a physical subject to determine positions and/or orientations of skeletal joints in the rigging for a virtual character
US11868515B2 (en) Generating textured polygon strip hair from strand-based hair for a virtual character
US11557076B2 (en) Computer generated hair groom transfer tool
US10885692B2 (en) Skeletal systems for animating virtual avatars
JP7437327B2 (ja) 異種入力の補間のための方法およびシステム
US11074748B2 (en) Matching meshes for virtual avatars
US12229861B2 (en) Systems and methods for cross-application authoring, transfer, and evaluation of rigging control systems for virtual characters
US20250037309A1 (en) Methods and systems for interpolation of disparate inputs

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination