CN116433718A - 特征追踪系统和方法 - Google Patents

特征追踪系统和方法 Download PDF

Info

Publication number
CN116433718A
CN116433718A CN202211588190.4A CN202211588190A CN116433718A CN 116433718 A CN116433718 A CN 116433718A CN 202211588190 A CN202211588190 A CN 202211588190A CN 116433718 A CN116433718 A CN 116433718A
Authority
CN
China
Prior art keywords
point
feature
flow
points
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211588190.4A
Other languages
English (en)
Chinese (zh)
Inventor
S.W.拉霍巴达雅尔
J.鲁比奥
S.塔特萨尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Europe Ltd
Original Assignee
Sony Interactive Entertainment Europe Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Europe Ltd filed Critical Sony Interactive Entertainment Europe Ltd
Publication of CN116433718A publication Critical patent/CN116433718A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/269—Analysis of motion using gradient-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/755—Deformable models or variational models, e.g. snakes or active contours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
CN202211588190.4A 2021-12-16 2022-12-08 特征追踪系统和方法 Pending CN116433718A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB2118271.2A GB2613840B (en) 2021-12-16 2021-12-16 Feature tracking system and method
GB2118271.2 2021-12-16

Publications (1)

Publication Number Publication Date
CN116433718A true CN116433718A (zh) 2023-07-14

Family

ID=79269920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211588190.4A Pending CN116433718A (zh) 2021-12-16 2022-12-08 特征追踪系统和方法

Country Status (5)

Country Link
US (1) US20230196593A1 (enExample)
EP (1) EP4198896A1 (enExample)
JP (1) JP2023089947A (enExample)
CN (1) CN116433718A (enExample)
GB (1) GB2613840B (enExample)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12430863B2 (en) * 2022-08-21 2025-09-30 Adobe Inc. Deformable neural radiance field for editing facial pose and facial expression in neural 3D scenes
CN116862954B (zh) * 2023-07-31 2025-12-19 咪咕新空文化科技(厦门)有限公司 图像跟踪方法及系统、位姿融合方法及系统、设备和介质
CN117975543B (zh) * 2024-04-01 2024-07-19 武汉烽火信息集成技术有限公司 一种基于光流表情的区块链零知识身份认证凭证交互方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6807290B2 (en) * 2000-03-09 2004-10-19 Microsoft Corporation Rapid computer modeling of faces for animation
US9317954B2 (en) * 2013-09-23 2016-04-19 Lucasfilm Entertainment Company Ltd. Real-time performance capture with on-the-fly correctives
US9691165B2 (en) * 2015-07-24 2017-06-27 Disney Enterprises, Inc. Detailed spatio-temporal reconstruction of eyelids
US9865032B2 (en) * 2015-09-04 2018-01-09 Adobe Systems Incorporated Focal length warping
US10540817B2 (en) * 2017-03-03 2020-01-21 Augray Pvt. Ltd. System and method for creating a full head 3D morphable model
CN109145681B (zh) * 2017-06-16 2021-02-26 北京京东尚科信息技术有限公司 用于判断目标旋转方向的方法及装置
CN119206817A (zh) * 2018-06-14 2024-12-27 英特尔公司 使用图像和时间跟踪神经网络进行的3d面部捕获和修改
US12002292B2 (en) * 2018-11-28 2024-06-04 Sony Group Corporation Online calibration of 3D scan data from multiple viewpoints
CN109961507B (zh) * 2019-03-22 2020-12-18 腾讯科技（深圳）有限公司 一种人脸图像生成方法、装置、设备及存储介质
CN114026606B (zh) * 2019-06-28 2025-06-17 奇跃公司 用于动态遮挡的快速手部网格划分
US11514665B2 (en) * 2020-04-01 2022-11-29 Scandit Ag Mapping optical-code images to an overview image
US12062130B2 (en) * 2021-01-26 2024-08-13 Qualcomm Incorporated Object reconstruction using media data
KR20230072851A (ko) * 2021-11-18 2023-05-25 조선대학교산학협력단 표정 분류를 위한 랜드마크 기반의 앙상블 네트워크 생성 방법 및 생성된 앙상블 네트워크를 이용한 표정 분류 방법.

Also Published As

Publication number Publication date
GB2613840B (en) 2025-03-12
JP2023089947A (ja) 2023-06-28
GB2613840A (en) 2023-06-21
EP4198896A1 (en) 2023-06-21
US20230196593A1 (en) 2023-06-22

Similar Documents

Publication Publication Date Title
US12377936B2 (en) Matching meshes for virtual avatars
JP7476428B2 (ja) 画像の視線補正方法、装置、電子機器、コンピュータ可読記憶媒体及びコンピュータプログラム
Stoll et al. Fast articulated motion tracking using a sums of gaussians body model
US9348950B2 (en) Perceptually guided capture and stylization of 3D human figures
CN116433718A (zh) 特征追踪系统和方法
CN102222431B (zh) 用于翻译手语的计算机实现的方法
US10147219B2 (en) Determining control values of an animation model using performance capture
US20210012549A1 (en) Animating virtual avatar facial movements
CN112437950A (zh) 用于对虚拟头像制作动画的骨架系统
Bhat et al. High fidelity facial animation capture and retargeting with contours
CN112602090A (zh) 用于插值不同输入的方法和系统
WO2017223530A1 (en) Systems and methods for generating computer ready animation models of a human head from captured data images
US20090066700A1 (en) Facial animation using motion capture data
US11443473B2 (en) Systems and methods for generating a skull surface for computer animation
CN111652123A (zh) 图像处理和图像合成方法、装置和存储介质
Rhee et al. Real-time facial animation from live video tracking
US20220005266A1 (en) Method for processing two-dimensional image and device for executing method
KR20170016901A (ko) 표정 제어점을 이용한 아바타 제어 장치 및 방법
US12333681B1 (en) Targeted generative visual editing of images
CN120318382A (zh) 一种基于3d gaussian splatting生成的可实时驱动的3D人类化身方法及系统
CN119810268A (zh) 姿态过渡动画生成方法、装置、电子设备和存储介质
Zhou et al. A Method of Facial Animation Retargeting Based on Motion Capture
CN117241064A (zh) 一种直播实时人脸替换的方法、设备及存储介质
CN118247397A (zh) 人脸表情动画生成方法及装置、电子设备、可读存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination