JP2023089947A - 容貌トラッキングシステムおよび方法 - Google Patents

容貌トラッキングシステムおよび方法 Download PDF

Info

Publication number
JP2023089947A
JP2023089947A JP2022193462A JP2022193462A JP2023089947A JP 2023089947 A JP2023089947 A JP 2023089947A JP 2022193462 A JP2022193462 A JP 2022193462A JP 2022193462 A JP2022193462 A JP 2022193462A JP 2023089947 A JP2023089947 A JP 2023089947A
Authority
JP
Japan
Prior art keywords
points
flow
point
feature
input image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022193462A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023089947A5 (enExample
Inventor
ウィネシュ ラゴーバーダヤル シャーウィン
Winesh Raghoebardajal Sharwin
ルビオ ホセ
Rubio Jose
タッターソール スティーブン
Tattersall Steven
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Europe Ltd
Original Assignee
Sony Interactive Entertainment Europe Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Europe Ltd filed Critical Sony Interactive Entertainment Europe Ltd
Publication of JP2023089947A publication Critical patent/JP2023089947A/ja
Publication of JP2023089947A5 publication Critical patent/JP2023089947A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/269—Analysis of motion using gradient-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/755—Deformable models or variational models, e.g. snakes or active contours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
JP2022193462A 2021-12-16 2022-12-02 容貌トラッキングシステムおよび方法 Pending JP2023089947A (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB2118271.2A GB2613840B (en) 2021-12-16 2021-12-16 Feature tracking system and method
GB2118271.2 2021-12-16

Publications (2)

Publication Number Publication Date
JP2023089947A true JP2023089947A (ja) 2023-06-28
JP2023089947A5 JP2023089947A5 (enExample) 2025-12-03

Family

ID=79269920

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022193462A Pending JP2023089947A (ja) 2021-12-16 2022-12-02 容貌トラッキングシステムおよび方法

Country Status (5)

Country Link
US (1) US20230196593A1 (enExample)
EP (1) EP4198896A1 (enExample)
JP (1) JP2023089947A (enExample)
CN (1) CN116433718A (enExample)
GB (1) GB2613840B (enExample)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12430863B2 (en) * 2022-08-21 2025-09-30 Adobe Inc. Deformable neural radiance field for editing facial pose and facial expression in neural 3D scenes
CN116862954B (zh) * 2023-07-31 2025-12-19 咪咕新空文化科技(厦门)有限公司 图像跟踪方法及系统、位姿融合方法及系统、设备和介质
CN117975543B (zh) * 2024-04-01 2024-07-19 武汉烽火信息集成技术有限公司 一种基于光流表情的区块链零知识身份认证凭证交互方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6807290B2 (en) * 2000-03-09 2004-10-19 Microsoft Corporation Rapid computer modeling of faces for animation
US9317954B2 (en) * 2013-09-23 2016-04-19 Lucasfilm Entertainment Company Ltd. Real-time performance capture with on-the-fly correctives
US9691165B2 (en) * 2015-07-24 2017-06-27 Disney Enterprises, Inc. Detailed spatio-temporal reconstruction of eyelids
US9865032B2 (en) * 2015-09-04 2018-01-09 Adobe Systems Incorporated Focal length warping
US10540817B2 (en) * 2017-03-03 2020-01-21 Augray Pvt. Ltd. System and method for creating a full head 3D morphable model
CN109145681B (zh) * 2017-06-16 2021-02-26 北京京东尚科信息技术有限公司 用于判断目标旋转方向的方法及装置
CN119206817A (zh) * 2018-06-14 2024-12-27 英特尔公司 使用图像和时间跟踪神经网络进行的3d面部捕获和修改
US12002292B2 (en) * 2018-11-28 2024-06-04 Sony Group Corporation Online calibration of 3D scan data from multiple viewpoints
CN109961507B (zh) * 2019-03-22 2020-12-18 腾讯科技（深圳）有限公司 一种人脸图像生成方法、装置、设备及存储介质
CN114026606B (zh) * 2019-06-28 2025-06-17 奇跃公司 用于动态遮挡的快速手部网格划分
US11514665B2 (en) * 2020-04-01 2022-11-29 Scandit Ag Mapping optical-code images to an overview image
US12062130B2 (en) * 2021-01-26 2024-08-13 Qualcomm Incorporated Object reconstruction using media data
KR20230072851A (ko) * 2021-11-18 2023-05-25 조선대학교산학협력단 표정 분류를 위한 랜드마크 기반의 앙상블 네트워크 생성 방법 및 생성된 앙상블 네트워크를 이용한 표정 분류 방법.

Also Published As

Publication number Publication date
GB2613840B (en) 2025-03-12
CN116433718A (zh) 2023-07-14
GB2613840A (en) 2023-06-21
EP4198896A1 (en) 2023-06-21
US20230196593A1 (en) 2023-06-22

Similar Documents

Publication Publication Date Title
JP7476428B2 (ja) 画像の視線補正方法、装置、電子機器、コンピュータ可読記憶媒体及びコンピュータプログラム
KR102866211B1 (ko) 포토리얼리스틱 실시간 인물 애니메이션을 위한 시스템 및 방법
US10860838B1 (en) Universal facial expression translation and character rendering system
CN111598818B (zh) 人脸融合模型训练方法、装置及电子设备
US10147219B2 (en) Determining control values of an animation model using performance capture
JP2023089947A (ja) 容貌トラッキングシステムおよび方法
US9245176B2 (en) Content retargeting using facial layers
US10055874B2 (en) Lip synchronization between rigs
Bhat et al. High fidelity facial animation capture and retargeting with contours
CN112437950A (zh) 用于对虚拟头像制作动画的骨架系统
US20120306874A1 (en) Method and system for single view image 3 d face synthesis
WO2017223530A1 (en) Systems and methods for generating computer ready animation models of a human head from captured data images
US10109083B2 (en) Local optimization for curvy brush stroke synthesis
Moser et al. Semi-supervised video-driven facial animation transfer for production
WO2021232690A1 (zh) 一种视频生成方法、装置、电子设备及存储介质
US20200357157A1 (en) A method of generating training data
CN111652123A (zh) 图像处理和图像合成方法、装置和存储介质
TW202244852A (zh) 用於擷取臉部表情且產生網格資料之人工智慧
Rhee et al. Real-time facial animation from live video tracking
CN107862387B (zh) 训练有监督机器学习的模型的方法和装置
US11893681B2 (en) Method for processing two-dimensional image and device for executing method
US20250078377A1 (en) Body tracking from monocular video
CN118212311A (zh) 图像的针对性的生成视觉编辑
Ergüzen et al. Personality Transfer in Human Animation: Handcrafted versus Data-Driven Approaches
Woodward et al. A low cost framework for real-time marker based 3-D human expression modeling

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20251125

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20251125