CA3192467A1 - Systemes et procedes pour construire une transformation muscle-peau en animation par ordinateur - Google Patents

Systemes et procedes pour construire une transformation muscle-peau en animation par ordinateur

Info

Publication number
CA3192467A1
CA3192467A1 CA3192467A CA3192467A CA3192467A1 CA 3192467 A1 CA3192467 A1 CA 3192467A1 CA 3192467 A CA3192467 A CA 3192467A CA 3192467 A CA3192467 A CA 3192467A CA 3192467 A1 CA3192467 A1 CA 3192467A1
Authority
CA
Canada
Prior art keywords
facial
skin surface
vector
data
learning model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3192467A
Other languages
English (en)
Inventor
Byung Kuk Choi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Unity Technologies SF
Original Assignee
Unity Technologies SF
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/082,890 external-priority patent/US11875504B2/en
Priority claimed from US17/082,895 external-priority patent/US20220076409A1/en
Priority claimed from US17/082,859 external-priority patent/US11341702B2/en
Application filed by Unity Technologies SF filed Critical Unity Technologies SF
Publication of CA3192467A1 publication Critical patent/CA3192467A1/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un système d'animation dans lequel un modèle d'apprentissage machine est adopté pour apprendre une relation de transformation entre des mouvements de muscles faciaux et des mouvements de surface de peau. Par exemple, pour la surface de la peau représentant l'action « sourire », le modèle de transformation dérive des vecteurs de mouvement associés aux muscles faciaux qui sont activés, aux tensions sur les muscles, au mouvement d'articulation, et/ou similaire. De tels vecteurs de mouvement dérivés peuvent être utilisés pour simuler la surface de la peau pour l'action « sourire ».
CA3192467A 2020-09-10 2020-11-11 Systemes et procedes pour construire une transformation muscle-peau en animation par ordinateur Pending CA3192467A1 (fr)

Applications Claiming Priority (11)

Application Number Priority Date Filing Date Title
US202063076858P 2020-09-10 2020-09-10
US202063076856P 2020-09-10 2020-09-10
US63/076,856 2020-09-10
US63/076,858 2020-09-10
US17/082,859 2020-10-28
US17/082,890 US11875504B2 (en) 2020-09-10 2020-10-28 Systems and methods for building a muscle-to-skin transformation in computer animation
US17/082,895 US20220076409A1 (en) 2020-09-10 2020-10-28 Systems and Methods for Building a Skin-to-Muscle Transformation in Computer Animation
US17/082,859 US11341702B2 (en) 2020-09-10 2020-10-28 Systems and methods for data bundles in computer animation
US17/082,895 2020-10-28
US17/082,890 2020-10-28
PCT/NZ2020/050148 WO2022055365A1 (fr) 2020-09-10 2020-11-11 Systèmes et procédés pour construire une transformation muscle-peau en animation par ordinateur

Publications (1)

Publication Number Publication Date
CA3192467A1 true CA3192467A1 (fr) 2022-03-17

Family

ID=80630036

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3192467A Pending CA3192467A1 (fr) 2020-09-10 2020-11-11 Systemes et procedes pour construire une transformation muscle-peau en animation par ordinateur

Country Status (4)

Country Link
EP (1) EP4211659A1 (fr)
CN (1) CN116438575A (fr)
CA (1) CA3192467A1 (fr)
WO (3) WO2022055365A1 (fr)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101473352A (zh) * 2006-04-24 2009-07-01 索尼株式会社 表演驱动的脸部动画
US7733346B2 (en) * 2006-07-28 2010-06-08 Sony Corporation FACS solving in motion capture
US10497163B1 (en) * 2017-05-16 2019-12-03 Electronic Arts Inc. Computer architecture for animation of a character in a simulation based on muscle activation data

Also Published As

Publication number Publication date
WO2022055364A1 (fr) 2022-03-17
EP4211659A1 (fr) 2023-07-19
WO2022055365A1 (fr) 2022-03-17
WO2022055366A1 (fr) 2022-03-17
CN116438575A (zh) 2023-07-14

Similar Documents

Publication Publication Date Title
US11393150B2 (en) Generating an animation rig for use in animating a computer-generated character based on facial scans of an actor and a muscle model
US11354774B2 (en) Facial model mapping with a neural network trained on varying levels of detail of facial scans
US11158104B1 (en) Systems and methods for building a pseudo-muscle topology of a live actor in computer animation
US20220076409A1 (en) Systems and Methods for Building a Skin-to-Muscle Transformation in Computer Animation
US11341702B2 (en) Systems and methods for data bundles in computer animation
US11875504B2 (en) Systems and methods for building a muscle-to-skin transformation in computer animation
EP3980975B1 (fr) Procédé de déduction de microdétails sur une animation de la peau
US11587278B1 (en) Systems and methods for computer animation of an artificial character using facial poses from a live actor
CA3192467A1 (fr) Systemes et procedes pour construire une transformation muscle-peau en animation par ordinateur
US20230154094A1 (en) Systems and Methods for Computer Animation of an Artificial Character Using Facial Poses From a Live Actor
US11715247B1 (en) Generating a facial rig for use in animating a computer-generated character based on facial scans and muscle models of multiple live actors
US20240169635A1 (en) Systems and Methods for Anatomically-Driven 3D Facial Animation
WO2023022607A1 (fr) Systèmes et procédés pour l'animation informatique d'un personnage artificiel à l'aide de poses faciales d'un acteur réel
US20220028144A1 (en) Methods and systems for generating an animation control rig
US20220028152A1 (en) Methods and systems for generating an animation control rig including posing of non-rigid areas