CN116433718A - 特征追踪系统和方法 - Google Patents

特征追踪系统和方法 Download PDF

Info

Publication number
CN116433718A
CN116433718A CN202211588190.4A CN202211588190A CN116433718A CN 116433718 A CN116433718 A CN 116433718A CN 202211588190 A CN202211588190 A CN 202211588190A CN 116433718 A CN116433718 A CN 116433718A
Authority
CN
China
Prior art keywords
point
feature
flow
points
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211588190.4A
Other languages
English (en)
Chinese (zh)
Inventor
S.W.拉霍巴达雅尔
J.鲁比奥
S.塔特萨尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Europe Ltd
Original Assignee
Sony Interactive Entertainment Europe Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Europe Ltd filed Critical Sony Interactive Entertainment Europe Ltd
Publication of CN116433718A publication Critical patent/CN116433718A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/269—Analysis of motion using gradient-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/755—Deformable models or variational models, e.g. snakes or active contours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
CN202211588190.4A 2021-12-16 2022-12-08 特征追踪系统和方法 Pending CN116433718A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB2118271.2 2021-12-16
GB2118271.2A GB2613840B (en) 2021-12-16 2021-12-16 Feature tracking system and method

Publications (1)

Publication Number Publication Date
CN116433718A true CN116433718A (zh) 2023-07-14

Family

ID=79269920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211588190.4A Pending CN116433718A (zh) 2021-12-16 2022-12-08 特征追踪系统和方法

Country Status (5)

Country Link
US (1) US20230196593A1 (cg-RX-API-DMAC7.html)
EP (1) EP4198896A1 (cg-RX-API-DMAC7.html)
JP (1) JP2023089947A (cg-RX-API-DMAC7.html)
CN (1) CN116433718A (cg-RX-API-DMAC7.html)
GB (1) GB2613840B (cg-RX-API-DMAC7.html)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12430863B2 (en) * 2022-08-21 2025-09-30 Adobe Inc. Deformable neural radiance field for editing facial pose and facial expression in neural 3D scenes
CN116862954B (zh) * 2023-07-31 2025-12-19 咪咕新空文化科技(厦门)有限公司 图像跟踪方法及系统、位姿融合方法及系统、设备和介质
CN117975543B (zh) * 2024-04-01 2024-07-19 武汉烽火信息集成技术有限公司 一种基于光流表情的区块链零知识身份认证凭证交互方法

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6807290B2 (en) * 2000-03-09 2004-10-19 Microsoft Corporation Rapid computer modeling of faces for animation
US9317954B2 (en) * 2013-09-23 2016-04-19 Lucasfilm Entertainment Company Ltd. Real-time performance capture with on-the-fly correctives
US9691165B2 (en) * 2015-07-24 2017-06-27 Disney Enterprises, Inc. Detailed spatio-temporal reconstruction of eyelids
US9865032B2 (en) * 2015-09-04 2018-01-09 Adobe Systems Incorporated Focal length warping
US9639737B2 (en) * 2015-09-29 2017-05-02 Eth Zürich (Eidgenöessische Technische Hochschule Zürich) Methods and systems of performing performance capture using an anatomically-constrained local model
US10540817B2 (en) * 2017-03-03 2020-01-21 Augray Pvt. Ltd. System and method for creating a full head 3D morphable model
CN109145681B (zh) * 2017-06-16 2021-02-26 北京京东尚科信息技术有限公司 用于判断目标旋转方向的方法及装置
WO2019237299A1 (en) * 2018-06-14 2019-12-19 Intel Corporation 3d facial capture and modification using image and temporal tracking neural networks
US12002292B2 (en) * 2018-11-28 2024-06-04 Sony Group Corporation Online calibration of 3D scan data from multiple viewpoints
CN109961507B (zh) * 2019-03-22 2020-12-18 腾讯科技(深圳)有限公司 一种人脸图像生成方法、装置、设备及存储介质
WO2020264149A1 (en) * 2019-06-28 2020-12-30 Magic Leap, Inc. Fast hand meshing for dynamic occlusion
US11514665B2 (en) * 2020-04-01 2022-11-29 Scandit Ag Mapping optical-code images to an overview image
US12062130B2 (en) * 2021-01-26 2024-08-13 Qualcomm Incorporated Object reconstruction using media data
KR20230072851A (ko) * 2021-11-18 2023-05-25 조선대학교산학협력단 표정 분류를 위한 랜드마크 기반의 앙상블 네트워크 생성 방법 및 생성된 앙상블 네트워크를 이용한 표정 분류 방법.

Also Published As

Publication number Publication date
US20230196593A1 (en) 2023-06-22
EP4198896A1 (en) 2023-06-21
GB2613840B (en) 2025-03-12
JP2023089947A (ja) 2023-06-28
GB2613840A (en) 2023-06-21

Similar Documents

Publication Publication Date Title
JP7476428B2 (ja) 画像の視線補正方法、装置、電子機器、コンピュータ可読記憶媒体及びコンピュータプログラム
US12377936B2 (en) Matching meshes for virtual avatars
US20220366627A1 (en) Animating virtual avatar facial movements
CN111325846B (zh) 表情基确定方法、虚拟形象驱动方法、装置及介质
US8737767B2 (en) Perceptually guided capture and stylization of 3D human figures
Stoll et al. Fast articulated motion tracking using a sums of gaussians body model
US9697635B2 (en) Generating an avatar from real time image data
CN102222431B (zh) 用于翻译手语的计算机实现的方法
US9600742B2 (en) Determining control values of an animation model using performance capture
CN112437950A (zh) 用于对虚拟头像制作动画的骨架系统
EP4198896A1 (en) Feature tracking system and method
CN112602090A (zh) 用于插值不同输入的方法和系统
WO2017223530A1 (en) Systems and methods for generating computer ready animation models of a human head from captured data images
US20090066700A1 (en) Facial animation using motion capture data
JP7164045B2 (ja) 骨格認識方法、骨格認識プログラムおよび骨格認識システム
US11443473B2 (en) Systems and methods for generating a skull surface for computer animation
CN111652123A (zh) 图像处理和图像合成方法、装置和存储介质
CN110443884B (zh) 手部运动重建方法和装置
US20220005266A1 (en) Method for processing two-dimensional image and device for executing method
CN118212311A (zh) 图像的针对性的生成视觉编辑
KR101815995B1 (ko) 표정 제어점을 이용한 아바타 제어 장치 및 방법
CN120318382A (zh) 一种基于3d gaussian splatting生成的可实时驱动的3D人类化身方法及系统
Zhou et al. A Method of Facial Animation Retargeting Based on Motion Capture
Liu et al. A Low-cost Efficient Approach to Synchronize Real-world and Virtual-world Objects in VR via In-built Cameras

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination