WO2002009038A3 - Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image - Google Patents

Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image Download PDF

Info

Publication number
WO2002009038A3
WO2002009038A3 PCT/US2001/023337 US0123337W WO0209038A3 WO 2002009038 A3 WO2002009038 A3 WO 2002009038A3 US 0123337 W US0123337 W US 0123337W WO 0209038 A3 WO0209038 A3 WO 0209038A3
Authority
WO
WIPO (PCT)
Prior art keywords
face image
facial feature
feature tracking
neutral face
customizing
Prior art date
Application number
PCT/US2001/023337
Other languages
French (fr)
Other versions
WO2002009038A2 (en
Inventor
Ulrich F Buddenmeier
Hartmut Neven
Original Assignee
Eyematic Interfaces Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyematic Interfaces Inc filed Critical Eyematic Interfaces Inc
Priority to AU2001277148A priority Critical patent/AU2001277148B2/en
Priority to AU7714801A priority patent/AU7714801A/en
Priority to KR1020037001107A priority patent/KR100827939B1/en
Priority to EP01954934A priority patent/EP1303842A2/en
Priority to JP2002514665A priority patent/JP2004505353A/en
Publication of WO2002009038A2 publication Critical patent/WO2002009038A2/en
Publication of WO2002009038A3 publication Critical patent/WO2002009038A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G06V10/422—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation for representing the structure of the pattern or shape of an object therefor
    • G06V10/426—Graphical representations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20064—Wavelet transform [DWT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Abstract

The present invention is embodied in a method and system for customizing a visual sensor for facial feature tracking using a neutral face image of an actor. The method may include generating a corrector graph to improve the sensor's performance in tracking an actor's facial features.
PCT/US2001/023337 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image WO2002009038A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
AU2001277148A AU2001277148B2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
AU7714801A AU7714801A (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmarkfinding on a neutral face image
KR1020037001107A KR100827939B1 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
EP01954934A EP1303842A2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
JP2002514665A JP2004505353A (en) 2000-07-24 2001-07-24 Facial feature special method and device by accurate landmark detection on expressionless facial image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US22028800P 2000-07-24 2000-07-24
US60/220,288 2000-07-24

Publications (2)

Publication Number Publication Date
WO2002009038A2 WO2002009038A2 (en) 2002-01-31
WO2002009038A3 true WO2002009038A3 (en) 2002-06-27

Family

ID=22822939

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/023337 WO2002009038A2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image

Country Status (5)

Country Link
EP (1) EP1303842A2 (en)
JP (1) JP2004505353A (en)
KR (1) KR100827939B1 (en)
AU (2) AU7714801A (en)
WO (1) WO2002009038A2 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101823611B1 (en) 2015-10-05 2018-01-31 주식회사 감성과학연구센터 Method for extracting Emotional Expression information based on Action Unit
KR101783453B1 (en) 2015-10-05 2017-09-29 (주)감성과학연구센터 Method and Apparatus for extracting information of facial movement based on Action Unit

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999053443A1 (en) * 1998-04-13 1999-10-21 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US6031539A (en) * 1997-03-10 2000-02-29 Digital Equipment Corporation Facial image method and apparatus for semi-automatically mapping a face on to a wireframe topology

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031539A (en) * 1997-03-10 2000-02-29 Digital Equipment Corporation Facial image method and apparatus for semi-automatically mapping a face on to a wireframe topology
WO1999053443A1 (en) * 1998-04-13 1999-10-21 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation

Also Published As

Publication number Publication date
KR100827939B1 (en) 2008-05-13
JP2004505353A (en) 2004-02-19
EP1303842A2 (en) 2003-04-23
KR20030041131A (en) 2003-05-23
WO2002009038A2 (en) 2002-01-31
AU2001277148B2 (en) 2007-09-20
AU7714801A (en) 2002-02-05

Similar Documents

Publication Publication Date Title
EP1967941A3 (en) Video-based image control system
AU4492897A (en) A method and apparatus for enhancing the broadcast of a live event
EP1221673A3 (en) Method and device for generating a person's portrait and communications terminal using the same
EP0902396A3 (en) Moving-target tracking apparatus
GB9917591D0 (en) Head tracker system
WO2003009643A1 (en) Sound image localizer
EP1028389A3 (en) Arithmetic unit for image transformation
BR9909611B1 (en) Method and apparatus for detecting facial features in a sequence of image frames comprising an image of a face.
EP2360642A3 (en) Video object tracking
AU2414597A (en) Method and system for manipulation of objects in a television picture
WO2001022872A3 (en) A system and method for estimating the orientation of an object
WO1998043105A3 (en) Object tracking system using statistical modeling and geometric relationship
NZ333362A (en) Computer vision system, graphical user interface superimposed on picture from camera
WO2001069535A3 (en) Method and apparatus for performing geo-spatial registration of imagery
AU2002210309A1 (en) Image tracking system and method
WO2003039350A3 (en) Direct, real-time imaging guidance of cardiac catheterization
AU2002327698A1 (en) Self-activating system and method for alerting when an object or a person is left unattended
GB2352580A (en) Method of and apparatus for creating panoramic or surround images using a motion sensor equipped camera
AU2124297A (en) Method and system for the creation of and navigation through a multidimensional space using encoded digital video
WO2001031570A3 (en) Tracking motion of a writing instrument
EP0913810A3 (en) Feature extraction and pattern recognition
WO2002065898A3 (en) Device and method for determining the viewing direction in terms of a fixed reference co-ordinates system
WO2001073916A3 (en) Synchronous frame regulation to extract a positive sequence component of a line voltage
WO2002009038A3 (en) Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
EP0827327A3 (en) Electronic camera having a printer for providing improved hard copy images

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWE Wipo information: entry into national phase

Ref document number: 2001277148

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 1020037001107

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2001954934

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2001954934

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020037001107

Country of ref document: KR

WWW Wipo information: withdrawn in national office

Ref document number: 2001954934

Country of ref document: EP