WO2004083773A2 - System and method for capturing facial and body motion - Google Patents

System and method for capturing facial and body motion Download PDF

Info

Publication number
WO2004083773A2
WO2004083773A2 PCT/US2004/003606 US2004003606W WO2004083773A2 WO 2004083773 A2 WO2004083773 A2 WO 2004083773A2 US 2004003606 W US2004003606 W US 2004003606W WO 2004083773 A2 WO2004083773 A2 WO 2004083773A2
Authority
WO
WIPO (PCT)
Prior art keywords
motion
cameras
facial
capture volume
capturing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2004/003606
Other languages
English (en)
French (fr)
Other versions
WO2004083773A3 (en
Inventor
Demian Gordon
Jerome Chen
Albert Robert Hastings
Jody Echegaray
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Pictures Entertainment Inc
Original Assignee
Sony Pictures Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Pictures Entertainment Inc filed Critical Sony Pictures Entertainment Inc
Priority to EP04708669.9A priority Critical patent/EP1602074B1/en
Priority to JP2006508692A priority patent/JP4384659B2/ja
Publication of WO2004083773A2 publication Critical patent/WO2004083773A2/en
Publication of WO2004083773A3 publication Critical patent/WO2004083773A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker

Definitions

  • a motion capture processor is coupled to the plurality of facial motion cameras and the plurality of body motion cameras to produce a digital model reflecting combined body and facial motion of the actor.
  • At least one microphone may be oriented to pick up audio from the motion capture volume.
  • the motion capture volume further comprises a rectangular area subdivided into a plurality of quadrants.
  • the quadrants each further comprise plural edges coincident with the periphery of the motion capture volume.
  • the plurality of facial motion cameras further include first subgroups of cameras oriented toward respective ones of the edges.
  • the plurality of facial motion cameras may further include second subgroups of cameras oriented toward respective ones of the edges and spatially separated from the first subgroups of cameras.
  • Fig. 3 is a side view of the motion capture volume with a plurality of motion capture cameras arranged around the periphery of the motion capture volume;
  • Fig. 4 is a top view of the motion capture volume illustrating an exemplary arrangement of facial motion cameras with respect to a quadrant of the motion capture volume;
  • Figs. 2 and 3 illustrate an exemplary motion capture volume 30 surrounded by a plurality of motion capture cameras.
  • the motion capture volume 30 includes a peripheral edge 32.
  • the motion capture volume 30 is illustrated as a rectangular- shaped region subdivided by grid lines. It should be appreciated that the motion capture volume 30 actually comprises a three-dimensional space with the grid defining a floor for the motion capture volume. Motion would be captured within the three- dimensional space above the floor.
  • the motion capture volume 30 comprises a floor area of approximately 10 feet by 10 feet, with a height of approximately 6 feet above the floor.
  • Other size and shape motion capture volumes could also be advantageously utilized to suit the particular needs of a production, such as oval, round, rectangular, polygonal, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
PCT/US2004/003606 2003-03-13 2004-02-05 System and method for capturing facial and body motion Ceased WO2004083773A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP04708669.9A EP1602074B1 (en) 2003-03-13 2004-02-05 System and method for capturing facial and body motion
JP2006508692A JP4384659B2 (ja) 2003-03-13 2004-02-05 モーションキャプチャシステム及び方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US45487203P 2003-03-13 2003-03-13
US60/454,872 2003-03-13
US10/427,114 US7218320B2 (en) 2003-03-13 2003-05-01 System and method for capturing facial and body motion
US10/427,114 2003-05-01

Publications (2)

Publication Number Publication Date
WO2004083773A2 true WO2004083773A2 (en) 2004-09-30
WO2004083773A3 WO2004083773A3 (en) 2005-05-12

Family

ID=32965391

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2004/003606 Ceased WO2004083773A2 (en) 2003-03-13 2004-02-05 System and method for capturing facial and body motion

Country Status (5)

Country Link
US (1) US7218320B2 (cg-RX-API-DMAC10.html)
EP (1) EP1602074B1 (cg-RX-API-DMAC10.html)
JP (1) JP4384659B2 (cg-RX-API-DMAC10.html)
KR (1) KR100688398B1 (cg-RX-API-DMAC10.html)
WO (1) WO2004083773A2 (cg-RX-API-DMAC10.html)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008522324A (ja) * 2004-12-03 2008-06-26 ソニー株式会社 顔動作および身体動作を取り込むシステムおよび方法
JP2008529189A (ja) * 2005-02-02 2008-07-31 インターグラフ ソフトウェアー テクノロジーズ カンパニー 偏光データを用いるリアルタイム画像検出
CN101310308A (zh) * 2005-08-26 2008-11-19 索尼株式会社 在运动捕捉中使用的重构渲染集群
JP2009544079A (ja) * 2006-07-11 2009-12-10 ソニー株式会社 モーションピクチャ又はビデオゲームにおける量子ナノドットの使用
JP2013061987A (ja) * 2005-07-01 2013-04-04 Sony Pictures Entertainment Inc モバイルモーションキャプチャカメラ

Families Citing this family (110)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4849761B2 (ja) * 2002-09-02 2012-01-11 株式会社 資生堂 質感に基づく化粧方法及び質感イメージマップ
KR100507780B1 (ko) * 2002-12-20 2005-08-17 한국전자통신연구원 고속 마커프리 모션 캡쳐 장치 및 방법
US10425134B2 (en) 2004-04-02 2019-09-24 Rearden, Llc System and methods for planned evolution and obsolescence of multiuser spectrum
US10277290B2 (en) 2004-04-02 2019-04-30 Rearden, Llc Systems and methods to exploit areas of coherence in wireless systems
US9826537B2 (en) 2004-04-02 2017-11-21 Rearden, Llc System and method for managing inter-cluster handoff of clients which traverse multiple DIDO clusters
US8654815B1 (en) 2004-04-02 2014-02-18 Rearden, Llc System and method for distributed antenna wireless communications
US9819403B2 (en) 2004-04-02 2017-11-14 Rearden, Llc System and method for managing handoff of a client between different distributed-input-distributed-output (DIDO) networks based on detected velocity of the client
US8194093B2 (en) * 2004-09-15 2012-06-05 Onlive, Inc. Apparatus and method for capturing the expression of a performer
US20060055706A1 (en) * 2004-09-15 2006-03-16 Perlman Stephen G Apparatus and method for capturing the motion of a performer
TW200620049A (en) * 2004-12-14 2006-06-16 Bextech Inc System and method for processing stream video process
US7633521B2 (en) * 2005-02-25 2009-12-15 Onlive, Inc. Apparatus and method improving marker identification within a motion capture system
US7605861B2 (en) * 2005-03-10 2009-10-20 Onlive, Inc. Apparatus and method for performing motion capture using shutter synchronization
GB2438783B8 (en) 2005-03-16 2011-12-28 Lucasfilm Entertainment Co Ltd Three-dimensional motion capture
US7352370B2 (en) * 2005-06-02 2008-04-01 Accuray Incorporated Four-dimensional volume of interest
US7720259B2 (en) * 2005-08-26 2010-05-18 Sony Corporation Motion capture using primary and secondary markers
US8659668B2 (en) 2005-10-07 2014-02-25 Rearden, Llc Apparatus and method for performing motion capture using a random pattern on capture surfaces
US7667767B2 (en) * 2006-06-07 2010-02-23 Onlive, Inc. System and method for three dimensional capture of stop-motion animated characters
US7567293B2 (en) * 2006-06-07 2009-07-28 Onlive, Inc. System and method for performing motion capture by strobing a fluorescent lamp
US7548272B2 (en) * 2006-06-07 2009-06-16 Onlive, Inc. System and method for performing motion capture using phosphor application techniques
WO2008005946A2 (en) * 2006-06-30 2008-01-10 Imagemovers Digital Llc Capturing and rendering dynamic surface deformations in human motion
MX2009000206A (es) * 2006-07-12 2009-06-08 Medical Cyberworlds Inc Sistema de entrenamiento medico computarizado.
US20100231692A1 (en) * 2006-07-31 2010-09-16 Onlive, Inc. System and method for performing motion capture and image reconstruction with transparent makeup
US8330823B2 (en) * 2006-11-01 2012-12-11 Sony Corporation Capturing surface in motion picture
US20080170750A1 (en) * 2006-11-01 2008-07-17 Demian Gordon Segment tracking in motion picture
US8199152B2 (en) 2007-01-16 2012-06-12 Lucasfilm Entertainment Company Ltd. Combining multiple session content for animation libraries
US8130225B2 (en) 2007-01-16 2012-03-06 Lucasfilm Entertainment Company Ltd. Using animation libraries for object identification
US8542236B2 (en) * 2007-01-16 2013-09-24 Lucasfilm Entertainment Company Ltd. Generating animation libraries
GB2452041B (en) * 2007-08-20 2012-09-26 Snell Ltd Video framing control
WO2009032944A2 (en) * 2007-09-04 2009-03-12 Sony Corporation Integrated motion capture
US8144153B1 (en) 2007-11-20 2012-03-27 Lucasfilm Entertainment Company Ltd. Model production for animation libraries
KR100896065B1 (ko) * 2007-12-17 2009-05-07 한국전자통신연구원 3차원 얼굴 표정 애니메이션 생성 방법
US8761938B2 (en) 2008-04-18 2014-06-24 David Jenkinson Robotic device tester
US20090270193A1 (en) * 2008-04-24 2009-10-29 United States Bowling Congress Analyzing a motion of a bowler
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
EP4336447B1 (en) 2008-05-20 2025-05-07 Adeia Imaging LLC Capturing and processing of images using monolithic camera array with heterogeneous imagers
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US8289443B2 (en) * 2008-09-29 2012-10-16 Two Pic Mc Llc Mounting and bracket for an actor-mounted motion capture camera system
US9390516B2 (en) * 2008-09-29 2016-07-12 Two Pic Mc Llc Asynchronous streaming of data for validation
US9325972B2 (en) * 2008-09-29 2016-04-26 Two Pic Mc Llc Actor-mounted motion capture camera
GB2464486A (en) * 2008-10-16 2010-04-21 Shafir Production Systems Ltd Control of a robotic arm by the recognition and analysis of facial gestures.
US9142024B2 (en) 2008-12-31 2015-09-22 Lucasfilm Entertainment Company Ltd. Visual and physical motion sensing for three-dimensional motion capture
US20120154593A1 (en) * 2009-08-31 2012-06-21 Trace Optics Pty Ltd method and apparatus for relative control of multiple cameras
WO2011063347A2 (en) 2009-11-20 2011-05-26 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
US8864581B2 (en) 2010-01-29 2014-10-21 Microsoft Corporation Visual based identitiy tracking
CN101833791B (zh) * 2010-05-11 2012-04-18 成都索贝数码科技股份有限公司 一种单摄像机下的场景建模方法及系统
US20120012748A1 (en) 2010-05-12 2012-01-19 Pelican Imaging Corporation Architectures for imager arrays and array cameras
US9132352B1 (en) 2010-06-24 2015-09-15 Gregory S. Rabin Interactive system and method for rendering an object
WO2012002734A2 (en) * 2010-06-29 2012-01-05 Golfzon Co., Ltd. Sensing device and sensing processing method for moving object and virtual golf simulation device using the same
KR101019824B1 (ko) * 2010-06-29 2011-03-04 (주) 골프존 오브젝트 운동 센싱장치 및 센싱방법과, 이를 이용한 가상 골프 시뮬레이션 장치
KR101019801B1 (ko) * 2010-06-29 2011-03-04 (주) 골프존 오브젝트 운동 센싱장치 및 센싱방법과, 이를 이용한 가상 골프 시뮬레이션 장치
US8878950B2 (en) 2010-12-14 2014-11-04 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using super-resolution processes
EP2708019B1 (en) 2011-05-11 2019-10-16 FotoNation Limited Systems and methods for transmitting and receiving array camera image data
US8948447B2 (en) 2011-07-12 2015-02-03 Lucasfilm Entertainment Companyy, Ltd. Scale independent tracking pattern
WO2013043751A1 (en) 2011-09-19 2013-03-28 Pelican Imaging Corporation Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
JP6140709B2 (ja) 2011-09-28 2017-05-31 ペリカン イメージング コーポレイション 明視野画像ファイルを符号化および復号するためのシステムおよび方法
WO2013074926A1 (en) 2011-11-18 2013-05-23 Lucasfilm Entertainment Company Ltd. Path and speed based character control
WO2013126578A1 (en) 2012-02-21 2013-08-29 Pelican Imaging Corporation Systems and methods for the manipulation of captured light field image data
EP2873028A4 (en) 2012-06-28 2016-05-25 Pelican Imaging Corp SYSTEMS AND METHOD FOR DETECTING DEFECTIVE CAMERA ARRAYS, OPTICAL ARRAYS AND SENSORS
US20140002674A1 (en) 2012-06-30 2014-01-02 Pelican Imaging Corporation Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors
EP3869797B1 (en) 2012-08-21 2023-07-19 Adeia Imaging LLC Method for depth detection in images captured using array cameras
US20140055632A1 (en) 2012-08-23 2014-02-27 Pelican Imaging Corporation Feature based high resolution motion estimation from low resolution images captured using an array source
US20140092281A1 (en) 2012-09-28 2014-04-03 Pelican Imaging Corporation Generating Images from Light Fields Utilizing Virtual Viewpoints
US11189917B2 (en) 2014-04-16 2021-11-30 Rearden, Llc Systems and methods for distributing radioheads
WO2014130849A1 (en) 2013-02-21 2014-08-28 Pelican Imaging Corporation Generating compressed light field representation data
WO2014133974A1 (en) 2013-02-24 2014-09-04 Pelican Imaging Corporation Thin form computational and modular array cameras
WO2014138695A1 (en) 2013-03-08 2014-09-12 Pelican Imaging Corporation Systems and methods for measuring scene information while capturing images using array cameras
US8866912B2 (en) 2013-03-10 2014-10-21 Pelican Imaging Corporation System and methods for calibration of an array camera using a single captured image
US9923657B2 (en) 2013-03-12 2018-03-20 Rearden, Llc Systems and methods for exploiting inter-cell multiplexing gain in wireless cellular systems via distributed input distributed output technology
US9973246B2 (en) 2013-03-12 2018-05-15 Rearden, Llc Systems and methods for exploiting inter-cell multiplexing gain in wireless cellular systems via distributed input distributed output technology
US10488535B2 (en) 2013-03-12 2019-11-26 Rearden, Llc Apparatus and method for capturing still images and video using diffraction coded imaging techniques
WO2014164909A1 (en) 2013-03-13 2014-10-09 Pelican Imaging Corporation Array camera architecture implementing quantum film sensors
WO2014164550A2 (en) 2013-03-13 2014-10-09 Pelican Imaging Corporation System and methods for calibration of an array camera
WO2014165244A1 (en) 2013-03-13 2014-10-09 Pelican Imaging Corporation Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
WO2014153098A1 (en) 2013-03-14 2014-09-25 Pelican Imaging Corporation Photmetric normalization in array cameras
WO2014159779A1 (en) 2013-03-14 2014-10-02 Pelican Imaging Corporation Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10547358B2 (en) 2013-03-15 2020-01-28 Rearden, Llc Systems and methods for radio frequency calibration exploiting channel reciprocity in distributed input distributed output wireless communications
US9445003B1 (en) 2013-03-15 2016-09-13 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
EP4604059A3 (en) 2013-03-15 2025-09-17 Adeia Imaging LLC Systems and methods for stereo imaging with camera arrays
US9497429B2 (en) 2013-03-15 2016-11-15 Pelican Imaging Corporation Extended color processing on pelican array cameras
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US9185276B2 (en) 2013-11-07 2015-11-10 Pelican Imaging Corporation Methods of manufacturing array camera modules incorporating independently aligned lens stacks
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
EP3075140B1 (en) 2013-11-26 2018-06-13 FotoNation Cayman Limited Array camera configurations incorporating multiple constituent array cameras
WO2015134996A1 (en) 2014-03-07 2015-09-11 Pelican Imaging Corporation System and methods for depth regularization and semiautomatic interactive matting using rgb-d images
JP2017531976A (ja) 2014-09-29 2017-10-26 フォトネイション ケイマン リミテッド アレイカメラを動的に較正するためのシステム及び方法
US9942474B2 (en) 2015-04-17 2018-04-10 Fotonation Cayman Limited Systems and methods for performing high speed video capture and depth estimation using array cameras
KR102777120B1 (ko) 2015-04-19 2025-03-05 포토내이션 리미티드 Vr/ar 응용에서 심도 증강을 위한 다중-기선 카메라 어레이 시스템 아키텍처
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
US10701253B2 (en) 2017-10-20 2020-06-30 Lucasfilm Entertainment Company Ltd. Camera systems for motion capture
KR102227260B1 (ko) * 2018-09-07 2021-03-12 (주)위지윅스튜디오 리그 결합형 가상 카메라를 활용한 실시간 cg 영상 제작 시스템
US11283985B2 (en) 2018-12-05 2022-03-22 Gentex Corporation Imaging system for iris authentication and driver monitoring
CN110379259B (zh) * 2019-08-07 2024-01-26 泉州师范学院 基于动作捕捉的演员培训方法
CA3109406C (en) 2019-09-17 2023-01-10 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
EP4042366A4 (en) 2019-10-07 2023-11-15 Boston Polarimetrics, Inc. SYSTEMS AND METHODS FOR AUGMENTING SENSOR SYSTEMS AND IMAGING SYSTEMS WITH POLARIZATION
KR102558903B1 (ko) 2019-11-30 2023-07-24 보스턴 폴라리메트릭스, 인크. 편광 신호를 이용한 투명 물체 분할을 위한 시스템 및 방법
CN115552486A (zh) 2020-01-29 2022-12-30 因思创新有限责任公司 用于表征物体姿态检测和测量系统的系统和方法
CN115428028B (zh) 2020-01-30 2026-05-19 因思创新有限责任公司 合成用于在不同成像模态下训练模型的数据的系统和方法
WO2021243088A1 (en) 2020-05-27 2021-12-02 Boston Polarimetrics, Inc. Multi-aperture polarization optical systems using beam splitters
US12069227B2 (en) 2021-03-10 2024-08-20 Intrinsic Innovation Llc Multi-modal and multi-spectral stereo camera arrays
US12020455B2 (en) 2021-03-10 2024-06-25 Intrinsic Innovation Llc Systems and methods for high dynamic range image reconstruction
CN116529766B (zh) * 2021-04-01 2025-12-02 索尼集团公司 使用集成的照片-视频体积捕获系统和网格跟踪的用于动态数字人体模型创建的人类面部表情和全身姿势的自动混合
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US12067746B2 (en) 2021-05-07 2024-08-20 Intrinsic Innovation Llc Systems and methods for using computer vision to pick up small objects
US12175741B2 (en) 2021-06-22 2024-12-24 Intrinsic Innovation Llc Systems and methods for a vision guided end effector
US12340538B2 (en) 2021-06-25 2025-06-24 Intrinsic Innovation Llc Systems and methods for generating and using visual datasets for training computer vision models
US12172310B2 (en) 2021-06-29 2024-12-24 Intrinsic Innovation Llc Systems and methods for picking objects using 3-D geometry and segmentation
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US12293535B2 (en) 2021-08-03 2025-05-06 Intrinsic Innovation Llc Systems and methods for training pose estimators in computer vision

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6163322A (en) 1998-01-19 2000-12-19 Taarna Studios Inc. Method and apparatus for providing real-time animation utilizing a database of postures

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6054999A (en) * 1988-03-22 2000-04-25 Strandberg; Oerjan Method and apparatus for computer supported animation
US6020892A (en) * 1995-04-17 2000-02-01 Dillon; Kelly Process for producing and controlling animated facial representations
US5802220A (en) * 1995-12-15 1998-09-01 Xerox Corporation Apparatus and method for tracking facial motion through a sequence of images
US5774591A (en) * 1995-12-15 1998-06-30 Xerox Corporation Apparatus and method for recognizing facial expressions and facial gestures in a sequence of images
US6121953A (en) * 1997-02-06 2000-09-19 Modern Cartoons, Ltd. Virtual reality system for sensing facial movements
US6324296B1 (en) * 1997-12-04 2001-11-27 Phasespace, Inc. Distributed-processing motion tracking system for tracking individually modulated light points
US6272231B1 (en) * 1998-11-06 2001-08-07 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US6215498B1 (en) * 1998-09-10 2001-04-10 Lionhearth Technologies, Inc. Virtual command post
JP2001084375A (ja) * 1999-09-13 2001-03-30 Atr Media Integration & Communications Res Lab 動作検証システムおよび非接触マニピュレーションシステム
US6707444B1 (en) * 2000-08-18 2004-03-16 International Business Machines Corporation Projector and camera arrangement with shared optics and optical marker for use with whiteboard systems
US6950104B1 (en) * 2000-08-30 2005-09-27 Microsoft Corporation Methods and systems for animating facial features, and methods and systems for expression transformation
US6774869B2 (en) * 2000-12-22 2004-08-10 Board Of Trustees Operating Michigan State University Teleportal face-to-face system
NZ535747A (en) * 2002-03-12 2005-05-27 Menache Llc Motion tracking system and method
US7106358B2 (en) * 2002-12-30 2006-09-12 Motorola, Inc. Method, system and apparatus for telepresence communications
US7068277B2 (en) * 2003-03-13 2006-06-27 Sony Corporation System and method for animating a digital facial model

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6163322A (en) 1998-01-19 2000-12-19 Taarna Studios Inc. Method and apparatus for providing real-time animation utilizing a database of postures

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008522324A (ja) * 2004-12-03 2008-06-26 ソニー株式会社 顔動作および身体動作を取り込むシステムおよび方法
JP2008529189A (ja) * 2005-02-02 2008-07-31 インターグラフ ソフトウェアー テクノロジーズ カンパニー 偏光データを用いるリアルタイム画像検出
JP2013061987A (ja) * 2005-07-01 2013-04-04 Sony Pictures Entertainment Inc モバイルモーションキャプチャカメラ
CN101310308A (zh) * 2005-08-26 2008-11-19 索尼株式会社 在运动捕捉中使用的重构渲染集群
JP2009506440A (ja) * 2005-08-26 2009-02-12 ソニー株式会社 モーションキャプチャに使用される再構成レンダリングファーム
JP2009544079A (ja) * 2006-07-11 2009-12-10 ソニー株式会社 モーションピクチャ又はビデオゲームにおける量子ナノドットの使用

Also Published As

Publication number Publication date
KR20050109552A (ko) 2005-11-21
JP4384659B2 (ja) 2009-12-16
EP1602074B1 (en) 2020-04-08
WO2004083773A3 (en) 2005-05-12
JP2006520476A (ja) 2006-09-07
KR100688398B1 (ko) 2007-03-02
EP1602074A2 (en) 2005-12-07
US7218320B2 (en) 2007-05-15
US20040179008A1 (en) 2004-09-16
EP1602074A4 (en) 2014-11-26

Similar Documents

Publication Publication Date Title
US7218320B2 (en) System and method for capturing facial and body motion
US7358972B2 (en) System and method for capturing facial and body motion
EP1825438B1 (en) System and method for capturing facial and body motion
US7812842B2 (en) Mobile motion capture cameras
US8106911B2 (en) Mobile motion capture cameras
JP2006520476A5 (cg-RX-API-DMAC10.html)
AU2006282765B2 (en) Motion capture using primary and secondary markers
CN101310289A (zh) 捕捉和处理面部运动数据
KR101299840B1 (ko) 모바일 모션 캡쳐 카메라
US20070146543A1 (en) Volume configurations in motion capture
Wang MEASURING TRACKING PERFORMANCE OF VIDEO-BASED AUGMENTED REALITY SYSTEMS FOR DESIGN AND CONSTRUCTION

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2004708669

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1020057016985

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2006508692

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 1020057016985

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2004708669

Country of ref document: EP