IL265520B1 - Face model capture by a wearable device - Google Patents

Face model capture by a wearable device

Info

Publication number
IL265520B1
IL265520B1 IL265520A IL26552019A IL265520B1 IL 265520 B1 IL265520 B1 IL 265520B1 IL 265520 A IL265520 A IL 265520A IL 26552019 A IL26552019 A IL 26552019A IL 265520 B1 IL265520 B1 IL 265520B1
Authority
IL
Israel
Prior art keywords
wearable device
face model
model capture
capture
face
Prior art date
Application number
IL265520A
Other languages
Hebrew (he)
Other versions
IL265520B2 (en
IL265520A (en
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of IL265520A publication Critical patent/IL265520A/en
Publication of IL265520B1 publication Critical patent/IL265520B1/en
Publication of IL265520B2 publication Critical patent/IL265520B2/en

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/169—Holistic features and representations, i.e. based on the facial image taken as a whole
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
    • G02B2027/0105—Holograms with particular structures
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G02B2027/0174—Head mounted characterised by optical features holographic
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/12—Acquisition of 3D measurements of objects

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ophthalmology & Optometry (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
  • Toys (AREA)
  • Instructional Devices (AREA)
IL265520A 2016-09-28 2017-09-27 Face model capture by a wearable device IL265520B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662400907P 2016-09-28 2016-09-28
PCT/US2017/053729 WO2018064169A1 (en) 2016-09-28 2017-09-27 Face model capture by a wearable device

Publications (3)

Publication Number Publication Date
IL265520A IL265520A (en) 2019-05-30
IL265520B1 true IL265520B1 (en) 2023-05-01
IL265520B2 IL265520B2 (en) 2023-09-01

Family

ID=61687208

Family Applications (1)

Application Number Title Priority Date Filing Date
IL265520A IL265520B2 (en) 2016-09-28 2017-09-27 Face model capture by a wearable device

Country Status (9)

Country Link
US (4) US10976549B2 (en)
EP (2) EP4220280A1 (en)
JP (2) JP6964132B2 (en)
KR (1) KR102491438B1 (en)
CN (2) CN114356098A (en)
AU (2) AU2017335736B2 (en)
CA (1) CA3037047A1 (en)
IL (1) IL265520B2 (en)
WO (1) WO2018064169A1 (en)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015192117A1 (en) * 2014-06-14 2015-12-17 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US10359806B2 (en) * 2016-03-28 2019-07-23 Sony Interactive Entertainment Inc. Pressure sensing to identify fitness and comfort of virtual reality headset
CN114356098A (en) 2016-09-28 2022-04-15 奇跃公司 Face model capture by wearable device
US11944481B1 (en) * 2018-02-23 2024-04-02 Robert Edwin Douglas Method and apparatus for predicting an image analysis tool based on user behavior
JP2021081757A (en) * 2018-03-12 2021-05-27 ソニーグループ株式会社 Information processing equipment, information processing methods, and program
US10728518B2 (en) * 2018-03-22 2020-07-28 Microsoft Technology Licensing, Llc Movement detection in low light environments
US10475196B2 (en) * 2018-03-22 2019-11-12 Microsoft Technology Licensing, Llc Hybrid depth detection and movement detection
US10565720B2 (en) 2018-03-27 2020-02-18 Microsoft Technology Licensing, Llc External IR illuminator enabling improved head tracking and surface reconstruction for virtual reality
WO2019246044A1 (en) 2018-06-18 2019-12-26 Magic Leap, Inc. Head-mounted display systems with power saving functionality
US10549186B2 (en) * 2018-06-26 2020-02-04 Sony Interactive Entertainment Inc. Multipoint SLAM capture
US11796833B2 (en) * 2018-12-12 2023-10-24 Solos Technology Limited Modularized eyewear systems, apparatuses, and methods
US11835798B2 (en) 2018-12-12 2023-12-05 Solos Technology Limited Eyewear systems, apparatuses, and methods for providing assistance to a user
US11871174B1 (en) 2018-12-12 2024-01-09 Solos Technology Limited Personalized directional audio for head-worn audio projection systems, apparatuses, and methods
JP7293814B2 (en) * 2019-04-01 2023-06-20 株式会社リコー Biological information measuring device, biological information measuring method and program
CN110287764B (en) * 2019-05-06 2022-01-11 深圳大学 Gesture prediction method, gesture prediction device, computer equipment and storage medium
US11039651B1 (en) * 2019-06-19 2021-06-22 Facebook Technologies, Llc Artificial reality hat
WO2020264101A1 (en) * 2019-06-25 2020-12-30 The Regents Of The University Of California Systems and methods for characterizing joint attention during real world interaction
CN110310373B (en) * 2019-06-28 2023-12-12 京东方科技集团股份有限公司 Image processing method of augmented reality equipment and augmented reality equipment
EP3997867A4 (en) * 2019-07-12 2022-09-07 Magic Leap, Inc. Eyeball camera system and methods for display system calibration
US11687778B2 (en) 2020-01-06 2023-06-27 The Research Foundation For The State University Of New York Fakecatcher: detection of synthetic portrait videos using biological signals
US20210327121A1 (en) * 2020-04-15 2021-10-21 Sirisilp Kongsilp Display based mixed-reality device
CN111523480B (en) * 2020-04-24 2021-06-18 北京嘀嘀无限科技发展有限公司 Method and device for detecting face obstruction, electronic equipment and storage medium
CN111709302B (en) * 2020-05-21 2023-08-25 青岛小鸟看看科技有限公司 Facial expression detection method and device, head-mounted display equipment and storage medium
CN112911356B (en) * 2020-05-29 2022-04-05 腾讯科技（深圳）有限公司 Virtual reality VR video playing method and related equipment
US11803237B2 (en) 2020-11-14 2023-10-31 Facense Ltd. Controlling an eye tracking camera according to eye movement velocity
US11740322B2 (en) * 2021-09-10 2023-08-29 Htc Corporation Head mounted display device and position device thereof
AU2021480445A1 (en) * 2021-12-23 2024-03-07 Softbank Corp. Avatar display device, avatar generation device, and program
CN116433432B (en) * 2023-04-18 2023-11-21 北京漂洋过海科技有限责任公司 Big data intelligent campus management system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015192117A1 (en) * 2014-06-14 2015-12-17 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality

Family Cites Families (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
EP1039417B1 (en) 1999-03-19 2006-12-20 Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. Method and device for the processing of images based on morphable models
US7255437B2 (en) 2003-10-09 2007-08-14 Howell Thomas A Eyeglasses with activity monitoring
USD514570S1 (en) 2004-06-24 2006-02-07 Microsoft Corporation Region of a fingerprint scanning device with an illuminated ring
KR20070064319A (en) 2004-08-06 2007-06-20 유니버시티 오브 워싱톤 Variable fixation viewing distance scanned light displays
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
JP5434569B2 (en) * 2009-12-22 2014-03-05 ソニー株式会社 Information processing apparatus and method, and program
US20130278631A1 (en) * 2010-02-28 2013-10-24 Osterhout Group, Inc. 3d positioning of augmented reality information
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
KR20120064557A (en) 2010-12-09 2012-06-19 한국전자통신연구원 Mixed reality display platform for presenting augmented 3d stereo image and operation method thereof
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
EP2656135B1 (en) 2010-12-24 2022-05-04 Magic Leap, Inc. Freeform waveguide prism
WO2012154620A2 (en) 2011-05-06 2012-11-15 Magic Leap, Inc. Massive simultaneous remote digital presence world
WO2012172719A1 (en) 2011-06-16 2012-12-20 パナソニック株式会社 Head-mounted display and misalignment correction method thereof
US8184067B1 (en) * 2011-07-20 2012-05-22 Google Inc. Nose bridge sensor
JP6144681B2 (en) 2011-08-30 2017-06-07 マイクロソフト テクノロジー ライセンシング，エルエルシー Head mounted display with iris scan profiling function
WO2013049861A1 (en) 2011-09-29 2013-04-04 Magic Leap, Inc. Tactile glove for human-computer interaction
US20130083003A1 (en) 2011-09-30 2013-04-04 Kathryn Stone Perez Personal audio/visual system
EP3258671B1 (en) 2011-10-28 2018-09-05 Magic Leap, Inc. System and method for augmented and virtual reality
BR112014012615A2 (en) 2011-11-23 2017-06-13 Magic Leap Inc three-dimensional augmented reality and virtual reality display system
WO2013077076A1 (en) * 2011-11-24 2013-05-30 株式会社エヌ・ティ・ティ・ドコモ Expression output device and expression output method
NZ700887A (en) 2012-04-05 2016-11-25 Magic Leap Inc Wide-field of view (fov) imaging devices with active foveation capability
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
CN104737061B (en) 2012-06-11 2018-01-16 奇跃公司 Use more depth plane three dimensional displays of the waveguided reflector arrays projector
US20130339433A1 (en) 2012-06-15 2013-12-19 Duke University Method and apparatus for content rating using reaction sensing
KR102099262B1 (en) 2012-07-11 2020-04-09 가부시키가이샤 한도오따이 에네루기 켄큐쇼 Liquid crystal display device and method for driving the same
US20140071163A1 (en) * 2012-09-11 2014-03-13 Peter Tobias Kinnebrew Augmented reality information detail
US9740006B2 (en) 2012-09-11 2017-08-22 Magic Leap, Inc. Ergonomic head mounted display device and optical system
JP2014064248A (en) * 2012-09-24 2014-04-10 Ntt Docomo Inc Image projection device and image projection method
US8860634B2 (en) * 2012-10-11 2014-10-14 Sony Computer Entertainment Europe Limited Head mountable display
US9996150B2 (en) * 2012-12-19 2018-06-12 Qualcomm Incorporated Enabling augmented reality using eye gaze tracking
IL301489B1 (en) 2013-01-15 2024-04-01 Magic Leap Inc System for scanning electromagnetic imaging radiation
US10163049B2 (en) * 2013-03-08 2018-12-25 Microsoft Technology Licensing, Llc Inconspicuous tag for generating augmented reality experiences
EP2967322A4 (en) 2013-03-11 2017-02-08 Magic Leap, Inc. System and method for augmented and virtual reality
KR20230113418A (en) 2013-03-15 2023-07-28 매직 립, 인코포레이티드 Display system and method
US9264803B1 (en) 2013-06-05 2016-02-16 Google Inc. Using sounds for determining a worn state of a wearable computing device
US10019057B2 (en) 2013-06-07 2018-07-10 Sony Interactive Entertainment Inc. Switching mode of operation in a head mounted display
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9256987B2 (en) 2013-06-24 2016-02-09 Microsoft Technology Licensing, Llc Tracking head movement when wearing mobile device
US20140375542A1 (en) 2013-06-25 2014-12-25 Steve Robbins Adjusting a near-eye display device
KR102270674B1 (en) * 2013-09-30 2021-07-01 삼성전자주식회사 Biometric camera
CN105829953B (en) 2013-10-16 2019-05-28 奇跃公司 Virtual or augmented reality helmet with adjustable interpupillary distance
JP2015092646A (en) * 2013-11-08 2015-05-14 ソニー株式会社 Information processing device, control method, and program
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
CN110542938B (en) 2013-11-27 2023-04-18 奇跃公司 Virtual and augmented reality systems and methods
US10175478B2 (en) 2014-05-30 2019-01-08 Magic Leap, Inc. Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
EP2887639A1 (en) * 2013-12-18 2015-06-24 Microsoft Technology Licensing, LLC Augmented reality information detail
WO2015117043A1 (en) 2014-01-31 2015-08-06 Magic Leap, Inc. Multi-focal display system and method
NZ722903A (en) 2014-01-31 2020-05-29 Magic Leap Inc Multi-focal display system and method
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US10430985B2 (en) 2014-03-14 2019-10-01 Magic Leap, Inc. Augmented reality systems and methods utilizing reflections
US9672416B2 (en) * 2014-04-29 2017-06-06 Microsoft Technology Licensing, Llc Facial expression tracking
CN106537290B (en) 2014-05-09 2019-08-27 谷歌有限责任公司 The system and method for the eyeball signal based on biomethanics interacted with true and virtual objects
USD759657S1 (en) 2014-05-19 2016-06-21 Microsoft Corporation Connector with illumination region
USD752529S1 (en) 2014-06-09 2016-03-29 Comcast Cable Communications, Llc Electronic housing with illuminated region
US20160025971A1 (en) * 2014-07-25 2016-01-28 William M. Crow Eyelid movement as user input
US9719871B2 (en) 2014-08-09 2017-08-01 Google Inc. Detecting a state of a wearable device
US9922236B2 (en) 2014-09-17 2018-03-20 Toyota Motor Engineering & Manufacturing North America, Inc. Wearable eyeglasses for providing social and environmental awareness
US9808185B2 (en) 2014-09-23 2017-11-07 Fitbit, Inc. Movement measure generation in a wearable electronic device
US9728010B2 (en) 2014-12-30 2017-08-08 Microsoft Technology Licensing, Llc Virtual representations of real-world objects
GB2534580B (en) * 2015-01-28 2020-06-17 Sony Interactive Entertainment Europe Ltd Image processing
JP2016149660A (en) 2015-02-13 2016-08-18 ソニー株式会社 Information processing device, information processing method and program
USD758367S1 (en) 2015-05-14 2016-06-07 Magic Leap, Inc. Virtual reality headset
US9652896B1 (en) 2015-10-30 2017-05-16 Snap Inc. Image based tracking in augmented reality systems
JP6952713B2 (en) * 2016-01-19 2021-10-20 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． Augmented reality systems and methods that utilize reflection
US10359806B2 (en) * 2016-03-28 2019-07-23 Sony Interactive Entertainment Inc. Pressure sensing to identify fitness and comfort of virtual reality headset
CN114356098A (en) 2016-09-28 2022-04-15 奇跃公司 Face model capture by wearable device
JP6212667B1 (en) 2016-12-26 2017-10-11 株式会社コロプラ Method executed by computer to communicate via virtual space, program causing computer to execute the method, and information processing apparatus

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015192117A1 (en) * 2014-06-14 2015-12-17 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality

Also Published As

Publication number Publication date
EP4220280A1 (en) 2023-08-02
US11740474B2 (en) 2023-08-29
US20220357582A1 (en) 2022-11-10
US11428941B2 (en) 2022-08-30
JP2022009208A (en) 2022-01-14
JP7186844B2 (en) 2022-12-09
US20230359044A1 (en) 2023-11-09
US20210223552A1 (en) 2021-07-22
WO2018064169A1 (en) 2018-04-05
US10976549B2 (en) 2021-04-13
KR20190054119A (en) 2019-05-21
CA3037047A1 (en) 2018-04-05
IL265520B2 (en) 2023-09-01
CN110023814A (en) 2019-07-16
KR102491438B1 (en) 2023-01-25
IL265520A (en) 2019-05-30
AU2022268332A1 (en) 2022-12-15
EP3519878B1 (en) 2023-04-19
CN110023814B (en) 2022-01-11
AU2017335736A1 (en) 2019-04-11
EP3519878A1 (en) 2019-08-07
JP6964132B2 (en) 2021-11-10
US20180088340A1 (en) 2018-03-29
JP2019531014A (en) 2019-10-24
EP3519878A4 (en) 2020-06-10
AU2017335736B2 (en) 2022-08-11
CN114356098A (en) 2022-04-15

Similar Documents

Publication Publication Date Title
IL265520A (en) Face model capture by a wearable device
GB201709227D0 (en) A wearable device
GB201602911D0 (en) A Device
GB201609557D0 (en) A device
GB2536911B (en) A jewellery device
SG10202013219WA (en) Improvements relating to a respiratory device
GB201701162D0 (en) A device
GB201511785D0 (en) A headwear device
GB201718248D0 (en) Behaviour Capture Device
GB2555568B (en) A device
GB201614671D0 (en) A device
GB201612206D0 (en) A device
GB2551368B (en) A man-over-board recovery device
HK1224506A2 (en) A wearable device
HK1223239A2 (en) A wearable device
GB201715191D0 (en) A foorwear device
GB201617916D0 (en) A tracing device
GB201621208D0 (en) A device
GB201619850D0 (en) A device
GB201618250D0 (en) A device
GB201615884D0 (en) A device
GB201611904D0 (en) A jewellery device
GB201613092D0 (en) A device
GB201612463D0 (en) A device
GB201611842D0 (en) A device