JP6913164B2 - 完全な顔画像の眼球周囲およびオーディオ合成 - Google Patents

完全な顔画像の眼球周囲およびオーディオ合成 Download PDF

Info

Publication number
JP6913164B2
JP6913164B2 JP2019521695A JP2019521695A JP6913164B2 JP 6913164 B2 JP6913164 B2 JP 6913164B2 JP 2019521695 A JP2019521695 A JP 2019521695A JP 2019521695 A JP2019521695 A JP 2019521695A JP 6913164 B2 JP6913164 B2 JP 6913164B2
Authority
JP
Japan
Prior art keywords
user
eye
face
image
peri
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019521695A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020507141A5 (https=
JP2020507141A (ja
Inventor
エイドリアン ケーラー，
エイドリアン ケーラー，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2020507141A publication Critical patent/JP2020507141A/ja
Publication of JP2020507141A5 publication Critical patent/JP2020507141A5/ja
Priority to JP2021072365A priority Critical patent/JP7307119B2/ja
Application granted granted Critical
Publication of JP6913164B2 publication Critical patent/JP6913164B2/ja
Priority to JP2022129597A priority patent/JP7378553B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/169—Holistic features and representations, i.e. based on the facial image taken as a whole
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
    • G10L2015/025—Phonemes, fenemes or fenones being the recognition units
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • G10L2021/105—Synthesis of the lips movements from speech, e.g. for talking heads

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Acoustics & Sound (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Geometry (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Inorganic Compounds Of Heavy Metals (AREA)
  • Silicon Compounds (AREA)
JP2019521695A 2016-11-11 2017-11-09 完全な顔画像の眼球周囲およびオーディオ合成 Active JP6913164B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021072365A JP7307119B2 (ja) 2016-11-11 2021-04-22 完全な顔画像の眼球周囲およびオーディオ合成
JP2022129597A JP7378553B2 (ja) 2016-11-11 2022-08-16 完全な顔画像の眼球周囲およびオーディオ合成

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662421033P 2016-11-11 2016-11-11
US62/421,033 2016-11-11
PCT/US2017/060942 WO2018089691A1 (en) 2016-11-11 2017-11-09 Periocular and audio synthesis of a full face image

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2021072365A Division JP7307119B2 (ja) 2016-11-11 2021-04-22 完全な顔画像の眼球周囲およびオーディオ合成

Publications (3)

Publication Number Publication Date
JP2020507141A JP2020507141A (ja) 2020-03-05
JP2020507141A5 JP2020507141A5 (https=) 2020-12-17
JP6913164B2 true JP6913164B2 (ja) 2021-08-04

Family

ID=62108639

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2019521695A Active JP6913164B2 (ja) 2016-11-11 2017-11-09 完全な顔画像の眼球周囲およびオーディオ合成
JP2021072365A Active JP7307119B2 (ja) 2016-11-11 2021-04-22 完全な顔画像の眼球周囲およびオーディオ合成
JP2022129597A Active JP7378553B2 (ja) 2016-11-11 2022-08-16 完全な顔画像の眼球周囲およびオーディオ合成

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2021072365A Active JP7307119B2 (ja) 2016-11-11 2021-04-22 完全な顔画像の眼球周囲およびオーディオ合成
JP2022129597A Active JP7378553B2 (ja) 2016-11-11 2022-08-16 完全な顔画像の眼球周囲およびオーディオ合成

Country Status (6)

Country Link
US (3) US10565790B2 (https=)
EP (2) EP3538946B1 (https=)
JP (3) JP6913164B2 (https=)
KR (1) KR102217797B1 (https=)
IL (3) IL296031A (https=)
WO (1) WO2018089691A1 (https=)

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10708545B2 (en) 2018-01-17 2020-07-07 Duelight Llc System, method, and computer program for transmitting face models based on face data points
US12401911B2 (en) 2014-11-07 2025-08-26 Duelight Llc Systems and methods for generating a high-dynamic range (HDR) pixel stream
US12401912B2 (en) 2014-11-17 2025-08-26 Duelight Llc System and method for generating a digital image
US12445736B2 (en) 2015-05-01 2025-10-14 Duelight Llc Systems and methods for generating a digital image
EP3404358B1 (en) * 2016-03-07 2020-04-22 Mitsubishi Electric Corporation Map making device and map making method
WO2018080702A1 (en) * 2016-10-31 2018-05-03 Google Llc Face reconstruction from a learned embedding
JP6913164B2 (ja) 2016-11-11 2021-08-04 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 完全な顔画像の眼球周囲およびオーディオ合成
KR102781167B1 (ko) * 2017-04-14 2025-03-12 매직 립, 인코포레이티드 다중 모드 눈 추적
US10636193B1 (en) 2017-06-29 2020-04-28 Facebook Technologies, Llc Generating graphical representation of a user's face and body using a monitoring system included on a head mounted display
US10636192B1 (en) * 2017-06-30 2020-04-28 Facebook Technologies, Llc Generating a graphical representation of a face of a user wearing a head mounted display
US10398855B2 (en) * 2017-11-14 2019-09-03 William T. MCCLELLAN Augmented reality based injection therapy
KR102661019B1 (ko) 2018-02-23 2024-04-26 삼성전자주식회사 얼굴에 대응하는 3차원 아바타를 이용하여 얼굴의 움직임이 반영된 3차원 아바타를 포함하는 이미지를 생성하는 전자 장치 및 그 동작 방법
EP3766004A4 (en) 2018-03-16 2021-12-15 Magic Leap, Inc. FACIAL EXPRESSIONS OBTAINED FROM EYE-TRACKING CAMERAS
CN111353943B (zh) * 2018-12-20 2023-12-26 杭州海康威视数字技术股份有限公司 一种人脸图像恢复方法、装置及可读存储介质
CN111475206B (zh) * 2019-01-04 2023-04-11 优奈柯恩(北京)科技有限公司 用于唤醒可穿戴设备的方法及装置
CN110097586B (zh) * 2019-04-30 2023-05-30 青岛海信网络科技股份有限公司 一种人脸检测追踪方法及装置
US11749018B1 (en) 2019-05-28 2023-09-05 Apple Inc. Eye enrollment for head-mounted enclosure
WO2021034408A2 (en) 2019-06-27 2021-02-25 Hsu, Yu-Pin System for sensing arterial pulse waveform
US11113859B1 (en) * 2019-07-10 2021-09-07 Facebook Technologies, Llc System and method for rendering three dimensional face model based on audio stream and image data
CN110503942A (zh) * 2019-08-29 2019-11-26 腾讯科技（深圳）有限公司 一种基于人工智能的语音驱动动画方法和装置
US11557208B2 (en) 2019-10-02 2023-01-17 Samsara Networks Inc. Facial recognition technology for improving motor carrier regulatory compliance
US12505500B2 (en) 2019-11-07 2025-12-23 Hyperconnect LLC Method and apparatus for generating landmark
US12315293B2 (en) * 2019-11-07 2025-05-27 Hyperconnect LLC Method and apparatus for generating reenacted image
WO2021112365A1 (ko) * 2019-12-02 2021-06-10 삼성전자 주식회사 음성 신호에서 헤드 모델 애니메이션을 생성하는 방법 및 이를 구현하는 전자 장치
US11687778B2 (en) 2020-01-06 2023-06-27 The Research Foundation For The State University Of New York Fakecatcher: detection of synthetic portrait videos using biological signals
CN111274910B (zh) * 2020-01-16 2024-01-30 腾讯科技（深圳）有限公司 场景互动方法、装置及电子设备
CN111589114B (zh) 2020-05-12 2023-03-10 腾讯科技（深圳）有限公司 虚拟对象的选择方法、装置、终端及存储介质
EP3945498B1 (en) * 2020-07-30 2024-11-27 Tata Consultancy Services Limited Audio-speech driven animated talking face generation using a cascaded generative adversarial network
EP3996047A1 (en) * 2020-11-04 2022-05-11 Tata Consultancy Services Limited Method and system for generating face animations from speech signal input
US11803237B2 (en) 2020-11-14 2023-10-31 Facense Ltd. Controlling an eye tracking camera according to eye movement velocity
US11218666B1 (en) * 2020-12-11 2022-01-04 Amazon Technologies, Inc. Enhanced audio and video capture and presentation
US11157723B1 (en) * 2021-02-12 2021-10-26 Samsara Networks lac. Facial recognition for drivers
GB2606173B (en) * 2021-04-28 2024-08-28 Sony Interactive Entertainment Europe Ltd Computer-implemented method for controlling a virtual avatar
US20230030442A1 (en) * 2021-07-31 2023-02-02 Sony Interactive Entertainment Inc. Telepresence robot
US12216749B2 (en) * 2021-08-04 2025-02-04 Q (Cue) Ltd. Using facial skin micromovements to identify a user
US11908478B2 (en) 2021-08-04 2024-02-20 Q (Cue) Ltd. Determining speech from facial skin movements using a housing supported by ear or associated with an earphone
US11740322B2 (en) * 2021-09-10 2023-08-29 Htc Corporation Head mounted display device and position device thereof
WO2023037812A1 (ja) * 2021-09-10 2023-03-16 株式会社Ｎｔｔドコモ オンライン対話支援システム
EP4155810A1 (en) * 2021-09-28 2023-03-29 Nokia Technologies Oy Optical apparatus, modules and devices
US12333640B2 (en) 2022-01-04 2025-06-17 Universal City Studios Llc Facial activity detection for virtual reality systems and methods
JP2023127042A (ja) * 2022-03-01 2023-09-13 株式会社国際電気通信基礎技術研究所 人型エージェントの口唇動作生成方法及びコンピュータプログラム
US20240029333A1 (en) * 2022-07-20 2024-01-25 Google Llc Hybrid representation for photorealistic synthesis, animation and relighting of human eyes
KR20250137111A (ko) 2022-07-20 2025-09-17 큐(큐) 리미티드 얼굴 미세 움직임의 검출 및 이용
CN115607416B (zh) * 2022-10-09 2025-10-17 波克医疗科技(上海)有限公司 从任意应用至红蓝弱双眼视练应用的转变方法、装置、终端及介质
US20250005851A1 (en) * 2023-06-30 2025-01-02 Qualcomm Incorporated Generating face models based on image and audio data

Family Cites Families (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
US7020305B2 (en) 2000-12-06 2006-03-28 Microsoft Corporation System and method providing improved head motion estimations for animation
US7257538B2 (en) * 2002-10-07 2007-08-14 Intel Corporation Generating animation from visual and audio input
US7255437B2 (en) 2003-10-09 2007-08-14 Howell Thomas A Eyeglasses with activity monitoring
USD514570S1 (en) 2004-06-24 2006-02-07 Microsoft Corporation Region of a fingerprint scanning device with an illuminated ring
US7133048B2 (en) 2004-06-30 2006-11-07 Mitsubishi Electric Research Laboratories, Inc. Variable multilinear models for facial synthesis
US20060009978A1 (en) * 2004-07-02 2006-01-12 The Regents Of The University Of Colorado Methods and systems for synthesis of accurate visible speech via transformation of motion capture data
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
CN1991982A (zh) * 2005-12-29 2007-07-04 摩托罗拉公司 一种使用语音数据激励图像的方法
JP2010250419A (ja) 2009-04-13 2010-11-04 Seiko Epson Corp 目の様態を検出する画像処理装置
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
NZ706893A (en) 2010-12-24 2017-02-24 Magic Leap Inc An ergonomic head mounted display device and optical system
CA3035118C (en) 2011-05-06 2022-01-04 Magic Leap, Inc. Massive simultaneous remote digital presence world
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
RU2017115669A (ru) 2011-10-28 2019-01-28 Мэджик Лип, Инк. Система и способ для дополненной и виртуальной реальности
CN104067316B (zh) 2011-11-23 2017-10-27 奇跃公司 三维虚拟和增强现实显示系统
CN103339926A (zh) * 2011-11-24 2013-10-02 株式会社Ntt都科摩 表情输出装置和表情输出方法
US9128522B2 (en) 2012-04-02 2015-09-08 Google Inc. Wink gesture input for a head-mountable device
BR112014024941A2 (pt) 2012-04-05 2017-09-19 Magic Leap Inc dispositivo de imagem de campo de visão amplo com capacidade de focalização ativa
US9146397B2 (en) 2012-05-30 2015-09-29 Microsoft Technology Licensing, Llc Customized see-through, electronic display device
AU2013274359B2 (en) 2012-06-11 2017-05-25 Magic Leap, Inc. Multiple depth plane three-dimensional display using a wave guide reflector array projector
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
KR101911133B1 (ko) 2012-06-21 2018-10-23 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 깊이 카메라를 이용한 아바타 구성
JP2015534108A (ja) 2012-09-11 2015-11-26 マジック リープ， インコーポレイテッド 人間工学的な頭部搭載型ディスプレイデバイスおよび光学システム
IL301489B2 (en) 2013-01-15 2024-08-01 Magic Leap Inc A system for scanning electromagnetic imaging radiation
KR20230044041A (ko) 2013-03-11 2023-03-31 매직 립, 인코포레이티드 증강 및 가상 현실을 위한 시스템 및 방법
US9094576B1 (en) * 2013-03-12 2015-07-28 Amazon Technologies, Inc. Rendered audiovisual communication
US20140278403A1 (en) 2013-03-14 2014-09-18 Toytalk, Inc. Systems and methods for interactive synthetic character dialogue
CN105229719B (zh) 2013-03-15 2018-04-27 奇跃公司 显示系统和方法
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
EP3058418B1 (en) 2013-10-16 2023-10-04 Magic Leap, Inc. Virtual or augmented reality headsets having adjustable interpupillary distance
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
KR102651578B1 (ko) * 2013-11-27 2024-03-25 매직 립, 인코포레이티드 가상 및 증강 현실 시스템들 및 방법들
KR102177133B1 (ko) 2014-01-31 2020-11-10 매직 립, 인코포레이티드 멀티-포컬 디스플레이 시스템 및 방법
NZ722903A (en) 2014-01-31 2020-05-29 Magic Leap Inc Multi-focal display system and method
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP3140779A4 (en) 2014-05-09 2017-11-29 Google LLC Systems and methods for using eye signals with secure mobile communications
USD759657S1 (en) 2014-05-19 2016-06-21 Microsoft Corporation Connector with illumination region
NZ764905A (en) 2014-05-30 2022-05-27 Magic Leap Inc Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
USD752529S1 (en) 2014-06-09 2016-03-29 Comcast Cable Communications, Llc Electronic housing with illuminated region
JP6547244B2 (ja) * 2014-06-30 2019-07-24 カシオ計算機株式会社 動作処理装置、動作処理方法及びプログラム
CA3297330A1 (en) 2014-08-10 2026-03-02 Autonomix Medical, Inc. Ans assessment systems, kits, and methods
US10227536B2 (en) 2014-12-01 2019-03-12 Uop Llc Methods for alternating production of distillate fuels and lube basestocks from heavy hydrocarbon feed
GB2534580B (en) * 2015-01-28 2020-06-17 Sony Interactive Entertainment Europe Ltd Image processing
WO2016165052A1 (en) 2015-04-13 2016-10-20 Empire Technology Development Llc Detecting facial expressions
USD758367S1 (en) 2015-05-14 2016-06-07 Magic Leap, Inc. Virtual reality headset
US9910275B2 (en) 2015-05-18 2018-03-06 Samsung Electronics Co., Ltd. Image processing for head mounted display devices
CN108140105A (zh) * 2015-09-29 2018-06-08 比纳里虚拟现实技术有限公司 具有脸部表情检测能力的头戴式显示器
EP3362946B1 (en) 2015-10-16 2020-08-26 Magic Leap, Inc. Eye pose identification using eye features
EP3185176A1 (en) 2015-12-21 2017-06-28 THOMSON Licensing Method and device for synthesizing an image of a face partially occluded
CN108604291A (zh) 2016-01-13 2018-09-28 Fove股份有限公司 表情辨识系统、表情辨识方法及表情辨识程序
JP6913164B2 (ja) 2016-11-11 2021-08-04 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 完全な顔画像の眼球周囲およびオーディオ合成
US11010595B2 (en) 2017-03-23 2021-05-18 Samsung Electronics Co., Ltd. Facial verification method and apparatus
EP3766004A4 (en) 2018-03-16 2021-12-15 Magic Leap, Inc. FACIAL EXPRESSIONS OBTAINED FROM EYE-TRACKING CAMERAS

Also Published As

Publication number Publication date
IL266420A (en) 2019-06-30
US20180137678A1 (en) 2018-05-17
KR20190084260A (ko) 2019-07-16
WO2018089691A1 (en) 2018-05-17
US20220130113A1 (en) 2022-04-28
IL285010B (en) 2022-10-01
JP2020507141A (ja) 2020-03-05
IL285010B2 (en) 2023-02-01
EP4202840A1 (en) 2023-06-28
US20200226830A1 (en) 2020-07-16
US11636652B2 (en) 2023-04-25
JP7378553B2 (ja) 2023-11-13
US10565790B2 (en) 2020-02-18
IL285010A (en) 2021-08-31
EP3538946B1 (en) 2023-02-15
IL296031A (en) 2022-10-01
JP2021114324A (ja) 2021-08-05
JP7307119B2 (ja) 2023-07-11
JP2022159436A (ja) 2022-10-17
EP3538946A4 (en) 2020-05-20
IL266420B (en) 2021-08-31
KR102217797B1 (ko) 2021-02-18
US11200736B2 (en) 2021-12-14
EP3538946A1 (en) 2019-09-18

Similar Documents

Publication Publication Date Title
JP6913164B2 (ja) 完全な顔画像の眼球周囲およびオーディオ合成
JP7186844B2 (ja) ウェアラブルデバイスによる顔モデル捕捉
US20240312100A1 (en) Using three-dimensional scans of a physical subject to determine positions and/or orientations of skeletal joints in the rigging for a virtual character
JP7459050B2 (ja) 仮想キャラクタの姿勢空間変形のための姿勢空間次元低減
JP7437327B2 (ja) 異種入力の補間のための方法およびシステム
JP7342008B2 (ja) 仮想アバタのためのメッシュの合致
JP7090601B2 (ja) 複合現実較正のための眼球周囲試験
JP7502292B2 (ja) アバタ移動のためのマルチモードの手の場所および配向
JP7389032B2 (ja) 仮想アバタのコンテキストベースのレンダリング
JP7355748B2 (ja) 眼球位置合わせを使用した頭部走査整合
JP2022173312A (ja) 眼追跡較正技術
JP2021517689A (ja) 眼追跡カメラからの顔の表情
JP2020537202A (ja) 眼追跡のための個人化されたニューラルネットワーク
JP7712279B2 (ja) 仮想および拡張現実ディスプレイシステムのための仮想オブジェクト移動速度曲線

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201106

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201106

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20201106

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20210119

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210122

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210422

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210616

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210709

R150 Certificate of patent or registration of utility model

Ref document number: 6913164

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250