JP7555337B2 - デジタルキャラクタブレンディング及び生成のシステム及び方法 - Google Patents

デジタルキャラクタブレンディング及び生成のシステム及び方法 Download PDF

Info

Publication number
JP7555337B2
JP7555337B2 JP2021522403A JP2021522403A JP7555337B2 JP 7555337 B2 JP7555337 B2 JP 7555337B2 JP 2021522403 A JP2021522403 A JP 2021522403A JP 2021522403 A JP2021522403 A JP 2021522403A JP 7555337 B2 JP7555337 B2 JP 7555337B2
Authority
JP
Japan
Prior art keywords
texture
model
texture maps
blending
layers
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021522403A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022505746A (ja
JPWO2020085922A5 (https=
JP2022505746A5 (https=
Inventor
マーク セイガー，アンドリュー
ス－シェン ウ，ティム
オレワゲン，ワーナー
タン，シアニ
Original Assignee
ソウル マシーンズ リミティド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソウル マシーンズ リミティド filed Critical ソウル マシーンズ リミティド
Publication of JP2022505746A publication Critical patent/JP2022505746A/ja
Publication of JPWO2020085922A5 publication Critical patent/JPWO2020085922A5/ja
Publication of JP2022505746A5 publication Critical patent/JP2022505746A5/ja
Application granted granted Critical
Publication of JP7555337B2 publication Critical patent/JP7555337B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/503—Blending, e.g. for anti-aliasing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/149—Segmentation; Edge detection involving deformable models, e.g. active contour models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Architecture (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
JP2021522403A 2018-10-26 2019-10-25 デジタルキャラクタブレンディング及び生成のシステム及び方法 Active JP7555337B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
NZ74762618 2018-10-26
NZ747626 2018-10-26
PCT/NZ2019/050142 WO2020085922A1 (en) 2018-10-26 2019-10-25 Digital character blending and generation system and method

Publications (4)

Publication Number Publication Date
JP2022505746A JP2022505746A (ja) 2022-01-14
JPWO2020085922A5 JPWO2020085922A5 (https=) 2022-11-01
JP2022505746A5 JP2022505746A5 (https=) 2022-11-01
JP7555337B2 true JP7555337B2 (ja) 2024-09-24

Family

ID=70330525

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021522403A Active JP7555337B2 (ja) 2018-10-26 2019-10-25 デジタルキャラクタブレンディング及び生成のシステム及び方法

Country Status (9)

Country Link
US (1) US11354844B2 (https=)
EP (1) EP3871194B1 (https=)
JP (1) JP7555337B2 (https=)
KR (1) KR20210069093A (https=)
CN (1) CN112970046A (https=)
AU (1) AU2019364148A1 (https=)
CA (1) CA3111498A1 (https=)
SG (1) SG11202102961YA (https=)
WO (1) WO2020085922A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11983834B1 (en) * 2019-11-14 2024-05-14 Radical Convergence Inc. Rapid generation of three-dimensional characters
CA3213416A1 (en) * 2021-03-18 2022-09-22 Digital Domain Virtual Human (Us), Inc. Methods and systems for markerless facial motion capture
US12367649B2 (en) * 2022-01-27 2025-07-22 Disney Enterprises, Inc. Generating a facial-hair-free mesh of a subject
WO2023148826A1 (ja) * 2022-02-01 2023-08-10 株式会社ソニー・インタラクティブエンタテインメント 画像処理装置、画像処理方法、及びプログラム
US20240119671A1 (en) * 2022-09-22 2024-04-11 University Of Southern California Systems and methods for face asset creation and models from one or more images
US12524965B2 (en) * 2023-09-25 2026-01-13 Sony Group Corporation Generation of three-dimensional (3D) blend-shapes from 3D scans using neural network
CN121616758B (zh) * 2026-01-30 2026-04-21 重庆大学 基于语义分离与pbr材质先验的人头三维重建方法及系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007265396A (ja) 2006-03-29 2007-10-11 Mitsubishi Electric Research Laboratories Inc 顔モデルを生成する方法およびシステム
US20090153552A1 (en) 2007-11-20 2009-06-18 Big Stage Entertainment, Inc. Systems and methods for generating individualized 3d head models
JP2016532953A (ja) 2013-08-02 2016-10-20 オークランド ユニサービシーズ リミティド 神経行動学的アニメーションのためのシステム
US20160328874A1 (en) 2014-07-25 2016-11-10 Intel Corporation Avatar facial expression animations with head rotation
JP2017501514A (ja) 2013-11-04 2017-01-12 フェイスブック，インク． 顔表現のためのシステムおよび方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1039417B1 (en) 1999-03-19 2006-12-20 Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. Method and device for the processing of images based on morphable models
US7039222B2 (en) * 2003-02-28 2006-05-02 Eastman Kodak Company Method and system for enhancing portrait images that are processed in a batch mode
US20050026685A1 (en) 2003-05-13 2005-02-03 Electronic Arts Inc. Customizing players in a video game using morphing from morph targets and other elements
KR20050009504A (ko) * 2003-07-16 2005-01-25 정보통신연구진흥원 사용자 애니메이션 캐릭터 제작 방법 및 사용자애니메이션 캐릭터 제공 서비스 시스템
JP4682373B2 (ja) 2005-11-01 2011-05-11 株式会社国際電気通信基礎技術研究所 顔画像合成装置、顔画像合成方法および顔画像合成プログラム
WO2008151421A1 (en) 2007-06-11 2008-12-18 Darwin Dimensions Inc. User defined characteristics for inheritance based avatar generation
GB2450757A (en) 2007-07-06 2009-01-07 Sony Comp Entertainment Europe Avatar customisation, transmission and reception
CN103765479A (zh) 2011-08-09 2014-04-30 英特尔公司 基于图像的多视点3d脸部生成
US9607441B2 (en) 2012-10-02 2017-03-28 Autodesk, Inc. Morphological attractor for creating custom ancestors in inheritance-based character generation
CN106204698A (zh) 2015-05-06 2016-12-07 北京蓝犀时空科技有限公司 为自由组合创作的虚拟形象生成及使用表情的方法和系统
KR101968437B1 (ko) 2015-07-09 2019-04-11 미즈호 죠호 소켄 가부시키가이샤 가령화 예측 시스템, 가령화 예측 방법 및 가령화 예측 프로그램
CN105488472B (zh) 2015-11-30 2019-04-09 华南理工大学 一种基于样本模板的数字化妆方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007265396A (ja) 2006-03-29 2007-10-11 Mitsubishi Electric Research Laboratories Inc 顔モデルを生成する方法およびシステム
US20090153552A1 (en) 2007-11-20 2009-06-18 Big Stage Entertainment, Inc. Systems and methods for generating individualized 3d head models
JP2016532953A (ja) 2013-08-02 2016-10-20 オークランド ユニサービシーズ リミティド 神経行動学的アニメーションのためのシステム
JP2017501514A (ja) 2013-11-04 2017-01-12 フェイスブック，インク． 顔表現のためのシステムおよび方法
US20160328874A1 (en) 2014-07-25 2016-11-10 Intel Corporation Avatar facial expression animations with head rotation

Also Published As

Publication number Publication date
WO2020085922A1 (en) 2020-04-30
JP2022505746A (ja) 2022-01-14
EP3871194B1 (en) 2026-03-11
KR20210069093A (ko) 2021-06-10
EP3871194A4 (en) 2022-08-24
SG11202102961YA (en) 2021-04-29
CA3111498A1 (en) 2020-04-30
US20210390751A1 (en) 2021-12-16
CN112970046A (zh) 2021-06-15
EP3871194A1 (en) 2021-09-01
AU2019364148A1 (en) 2021-06-03
EP3871194C0 (en) 2026-03-11
US11354844B2 (en) 2022-06-07

Similar Documents

Publication Publication Date Title
JP7555337B2 (ja) デジタルキャラクタブレンディング及び生成のシステム及び方法
JP7198332B2 (ja) 画像正則化及びリターゲティングシステム
US10535163B2 (en) Avatar digitization from a single image for real-time rendering
Sharma et al. 3d face reconstruction in deep learning era: A survey
JP7632917B2 (ja) ３ｄ頭部変形モデルを生成するための方法、システム及びコンピュータプログラム
KR102241153B1 (ko) 2차원 이미지로부터 3차원 아바타를 생성하는 방법, 장치 및 시스템
KR102887595B1 (ko) 개인화된 3d 머리 및 얼굴 모델들을 형성하기 위한 방법들 및 시스템들
KR102927332B1 (ko) 얼굴 이미지에서 색상을 추출하기 위한 방법 및 시스템
Li et al. Learning a model of facial shape and expression from 4D scans.
US7804997B2 (en) Method and system for a three dimensional facial recognition system
JP7696438B2 (ja) 反転ｇａｎを用いた試着
WO2019050808A1 (en) SCANNING AVATAR FROM A SINGLE IMAGE FOR REAL TIME REALIZATION
CN113628327B (zh) 一种头部三维重建方法及设备
JP7690500B2 (ja) 空間認識条件付きｇａｎによる高解像度で制御可能な顔のエージング
KR20220098218A (ko) 지도 학습을 위한 짝없는 데이터를 사용한 이미지-대-이미지 변환
CN118262035A (zh) 从单个图像重建三维人类头部模型的系统和方法
KR20250125406A (ko) 메이크업 가상 시착 방법들 및 장치들
CN114742951B (zh) 素材生成、图像处理方法、装置、电子设备及存储介质
CN117830527A (zh) 一种数字人可定制的人像实现方法、系统及存储介质
US10878610B1 (en) Generating an animation feature from line deformations
HK40054269A (en) Digital character blending and generation system and method
CN116030181A (zh) 3d虚拟形象生成方法与装置
Gecer Synthesization and reconstruction of 3D faces by deep neural networks
CN117994395A (zh) 数字人面部资产生成方法、装置、电子设备及存储介质
CN121794761A (zh) 针对临床环境的个性化图像修改

Legal Events

Date Code Title Description
A529 Written submission of copy of amendment under article 34 pct

Free format text: JAPANESE INTERMEDIATE CODE: A529

Effective date: 20210423

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221024

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221024

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240109

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20240307

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240708

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240820

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240910

R150 Certificate of patent or registration of utility model

Ref document number: 7555337

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150