RU2016141911A - Отслеживание выражения лица - Google Patents
Отслеживание выражения лица Download PDFInfo
- Publication number
- RU2016141911A RU2016141911A RU2016141911A RU2016141911A RU2016141911A RU 2016141911 A RU2016141911 A RU 2016141911A RU 2016141911 A RU2016141911 A RU 2016141911A RU 2016141911 A RU2016141911 A RU 2016141911A RU 2016141911 A RU2016141911 A RU 2016141911A
- Authority
- RU
- Russia
- Prior art keywords
- user
- smart device
- wearable smart
- images
- mouth
- Prior art date
Links
- 230000008921 facial expression Effects 0.000 title 1
- 239000004984 smart glass Substances 0.000 claims 2
- 238000006243 chemical reaction Methods 0.000 claims 1
- 238000003384 imaging method Methods 0.000 claims 1
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/55—Controlling game characters or game objects based on the game progress
- A63F13/56—Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/176—Dynamic expression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/32—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using local area network [LAN] connections
- A63F13/327—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using local area network [LAN] connections using wireless networks, e.g. Wi-Fi® or piconet
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Optics & Photonics (AREA)
- General Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Life Sciences & Earth Sciences (AREA)
- Heart & Thoracic Surgery (AREA)
- Cardiology (AREA)
- Biophysics (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
- Image Analysis (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
- Eyeglasses (AREA)
- Length Measuring Devices By Optical Means (AREA)
Claims (13)
1. Носимое интеллектуальное устройство, содержащее:
структуру ориентации, сконфигурированную, чтобы позиционировать носимое устройство относительно лица пользователя;
камеру, закрепленную посредством структуры ориентации, чтобы захватывать изображения рта пользователя в направлении параллельном или под углом менее чем приблизительно +/- 45° относительно базовой плоскости, которая проходит через или включает в себя переднюю часть глаз пользователя и рта пользователя;
процессор, сконфигурированный, чтобы принимать изображения и преобразовывать изображения рта пользователя в параметры анимации, включающие в себя движения рта, ассоциированные с моделью аватара, преобразование было выполнено во время стадии обучения, чтобы связывать конкретные действия пользователя с конкретными параметрами анимации на основе действий пользователя, захватываемых одновременно посредством носимого интеллектуального устройства и посредством другого устройства формирования изображений.
2. Носимое интеллектуальное устройство по п. 1, представляющее собой интеллектуальные очки, и при этом структура ориентации содержит оправу.
3. Носимое интеллектуальное устройство по п. 2, дополнительно содержащее пару линз, поддерживаемых посредством оправы, при этом интеллектуальные очки сконфигурированы, чтобы представлять изображение на одной или обеих линзах из пары линз.
4. Носимое интеллектуальное устройство по п. 3, при этом пара линз является корректирующими линзами.
5. Носимое интеллектуальное устройство по п. 1, представляющее собой интеллектуальный головной убор, и при этом структура ориентации содержит козырек интеллектуального головного убора.
6. Носимое интеллектуальное устройство по п. 1, при этом структура ориентации содержит головную повязку.
7. Носимое интеллектуальное устройство по п. 1, при этом структура ориентации содержит оправу и дополнительно содержит зажимы для прикрепления оправы к одежде пользователя.
8. Носимое интеллектуальное устройство по п. 2, дополнительно содержащее, по меньшей мере, один другой датчик, ориентированный на оправе по направлению к глазу пользователя и сконфигурированный, чтобы захватывать другие изображения глаза пользователя одновременно с захватом камерой изображений рта пользователя, и при этом процессор сконфигурирован, чтобы получать параметры лица как из изображений, так и из других изображений.
9. Носимое интеллектуальное устройство по п. 1, при этом камера включает в себя линзу "рыбий глаз", которая может захватывать рот пользователя и, по меньшей мере, один из глаз пользователя в отдельном изображении.
10. Носимое интеллектуальное устройство по п. 2, при этом оправа включает в себя пару дужек, и при этом камера ориентируется, в целом, перпендикулярно длинной оси отдельной дужки из пары дужек.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/265,201 | 2014-04-29 | ||
| US14/265,201 US9672416B2 (en) | 2014-04-29 | 2014-04-29 | Facial expression tracking |
| PCT/US2015/027188 WO2015167909A1 (en) | 2014-04-29 | 2015-04-23 | Facial expression tracking |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| RU2016141911A true RU2016141911A (ru) | 2018-04-26 |
| RU2016141911A3 RU2016141911A3 (ru) | 2018-12-10 |
| RU2679986C2 RU2679986C2 (ru) | 2019-02-14 |
Family
ID=53059473
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| RU2016141911A RU2679986C2 (ru) | 2014-04-29 | 2015-04-23 | Отслеживание выражения лица |
Country Status (10)
| Country | Link |
|---|---|
| US (1) | US9672416B2 (ru) |
| EP (1) | EP3137938B1 (ru) |
| JP (1) | JP6722590B2 (ru) |
| KR (1) | KR102390781B1 (ru) |
| CN (1) | CN106255978B (ru) |
| AU (1) | AU2015253557B2 (ru) |
| CA (1) | CA2943424C (ru) |
| MX (1) | MX360923B (ru) |
| RU (1) | RU2679986C2 (ru) |
| WO (1) | WO2015167909A1 (ru) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11195302B2 (en) | 2018-11-30 | 2021-12-07 | Dwango Co., Ltd. | Video synthesis device, video synthesis method and recording medium |
| US11367260B2 (en) | 2018-11-30 | 2022-06-21 | Dwango Co., Ltd. | Video synthesis device, video synthesis method and recording medium |
Families Citing this family (121)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107257403A (zh) | 2012-04-09 | 2017-10-17 | 英特尔公司 | 使用交互化身的通信 |
| WO2016011654A1 (en) * | 2014-07-25 | 2016-01-28 | Intel Corporation | Avatar facial expression animations with head rotation |
| CA2956508C (en) * | 2014-08-04 | 2020-04-21 | Facebook, Inc. | Method and system for reconstructing obstructed face portions for virtual reality environment |
| US20160062987A1 (en) * | 2014-08-26 | 2016-03-03 | Ncr Corporation | Language independent customer communications |
| US20170278302A1 (en) * | 2014-08-29 | 2017-09-28 | Thomson Licensing | Method and device for registering an image to a model |
| US9830728B2 (en) | 2014-12-23 | 2017-11-28 | Intel Corporation | Augmented facial animation |
| WO2016165052A1 (en) * | 2015-04-13 | 2016-10-20 | Empire Technology Development Llc | Detecting facial expressions |
| US9910275B2 (en) * | 2015-05-18 | 2018-03-06 | Samsung Electronics Co., Ltd. | Image processing for head mounted display devices |
| US10216981B2 (en) | 2015-06-14 | 2019-02-26 | Facense Ltd. | Eyeglasses that measure facial skin color changes |
| US10076250B2 (en) | 2015-06-14 | 2018-09-18 | Facense Ltd. | Detecting physiological responses based on multispectral data from head-mounted cameras |
| US10524696B2 (en) | 2015-06-14 | 2020-01-07 | Facense Ltd. | Virtual coaching based on respiration signals |
| US10045726B2 (en) | 2015-06-14 | 2018-08-14 | Facense Ltd. | Selecting a stressor based on thermal measurements of the face |
| US10113913B2 (en) | 2015-10-03 | 2018-10-30 | Facense Ltd. | Systems for collecting thermal measurements of the face |
| US10130308B2 (en) | 2015-06-14 | 2018-11-20 | Facense Ltd. | Calculating respiratory parameters from thermal measurements |
| US10064559B2 (en) | 2015-06-14 | 2018-09-04 | Facense Ltd. | Identification of the dominant nostril using thermal measurements |
| US10159411B2 (en) | 2015-06-14 | 2018-12-25 | Facense Ltd. | Detecting irregular physiological responses during exposure to sensitive data |
| US10165949B2 (en) * | 2015-06-14 | 2019-01-01 | Facense Ltd. | Estimating posture using head-mounted cameras |
| US10045737B2 (en) | 2015-06-14 | 2018-08-14 | Facense Ltd. | Clip-on device with inward-facing cameras |
| US10085685B2 (en) | 2015-06-14 | 2018-10-02 | Facense Ltd. | Selecting triggers of an allergic reaction based on nasal temperatures |
| US10151636B2 (en) | 2015-06-14 | 2018-12-11 | Facense Ltd. | Eyeglasses having inward-facing and outward-facing thermal cameras |
| US10076270B2 (en) | 2015-06-14 | 2018-09-18 | Facense Ltd. | Detecting physiological responses while accounting for touching the face |
| US10299717B2 (en) | 2015-06-14 | 2019-05-28 | Facense Ltd. | Detecting stress based on thermal measurements of the face |
| US10523852B2 (en) | 2015-06-14 | 2019-12-31 | Facense Ltd. | Wearable inward-facing camera utilizing the Scheimpflug principle |
| US10092232B2 (en) | 2015-06-14 | 2018-10-09 | Facense Ltd. | User state selection based on the shape of the exhale stream |
| US10080861B2 (en) | 2015-06-14 | 2018-09-25 | Facense Ltd. | Breathing biofeedback eyeglasses |
| US10130299B2 (en) | 2015-06-14 | 2018-11-20 | Facense Ltd. | Neurofeedback eyeglasses |
| US10045699B2 (en) | 2015-06-14 | 2018-08-14 | Facense Ltd. | Determining a state of a user based on thermal measurements of the forehead |
| US10136856B2 (en) | 2016-06-27 | 2018-11-27 | Facense Ltd. | Wearable respiration measurements system |
| US10136852B2 (en) | 2015-06-14 | 2018-11-27 | Facense Ltd. | Detecting an allergic reaction from nasal temperatures |
| US10130261B2 (en) | 2015-06-14 | 2018-11-20 | Facense Ltd. | Detecting physiological responses while taking into account consumption of confounding substances |
| US10154810B2 (en) | 2015-06-14 | 2018-12-18 | Facense Ltd. | Security system that detects atypical behavior |
| US9968264B2 (en) | 2015-06-14 | 2018-05-15 | Facense Ltd. | Detecting physiological responses based on thermal asymmetry of the face |
| US10524667B2 (en) | 2015-06-14 | 2020-01-07 | Facense Ltd. | Respiration-based estimation of an aerobic activity parameter |
| US10089522B2 (en) * | 2015-09-29 | 2018-10-02 | BinaryVR, Inc. | Head-mounted display with facial expression detecting capability |
| WO2017101094A1 (en) * | 2015-12-18 | 2017-06-22 | Intel Corporation | Avatar animation system |
| US10217261B2 (en) * | 2016-02-18 | 2019-02-26 | Pinscreen, Inc. | Deep learning-based facial animation for head-mounted display |
| GB2548154A (en) | 2016-03-11 | 2017-09-13 | Sony Computer Entertainment Europe Ltd | Virtual reality |
| CN105867617B (zh) * | 2016-03-25 | 2018-12-25 | 京东方科技集团股份有限公司 | 增强现实设备、系统、图像处理方法及装置 |
| CN107305621A (zh) * | 2016-04-17 | 2017-10-31 | 张翔宇 | 一种虚拟现实眼镜的图像捕获设备及图像合成系统 |
| EP3469803B1 (en) * | 2016-06-13 | 2024-09-11 | Sony Interactive Entertainment LLC | Method and system for directing user attention to a location based game play companion application |
| US10083347B2 (en) * | 2016-07-29 | 2018-09-25 | NTech lab LLC | Face identification using artificial neural network |
| US20180082482A1 (en) * | 2016-09-22 | 2018-03-22 | Apple Inc. | Display system having world and user sensors |
| AU2017335736B2 (en) | 2016-09-28 | 2022-08-11 | Magic Leap, Inc. | Face model capture by a wearable device |
| US10607070B2 (en) * | 2016-09-30 | 2020-03-31 | Intel Corporation | Human search and identification in complex scenarios |
| KR102402467B1 (ko) | 2016-10-05 | 2022-05-25 | 매직 립, 인코포레이티드 | 혼합 현실 교정을 위한 안구주위 테스트 |
| US20180101989A1 (en) * | 2016-10-06 | 2018-04-12 | Google Inc. | Headset removal in virtual, augmented, and mixed reality using an eye gaze database |
| GB2569936B (en) * | 2016-10-14 | 2021-12-01 | Facense Ltd | Calculating respiratory parameters from thermal measurements |
| CN206387961U (zh) | 2016-12-30 | 2017-08-08 | 孙淑芬 | 头戴显示设备 |
| CN106686308B (zh) * | 2016-12-28 | 2018-02-16 | 平安科技（深圳）有限公司 | 图像焦距检测方法和装置 |
| WO2018128996A1 (en) * | 2017-01-03 | 2018-07-12 | Clipo, Inc. | System and method for facilitating dynamic avatar based on real-time facial expression detection |
| CA2953752A1 (en) * | 2017-01-06 | 2018-07-06 | Libra At Home Ltd | Virtual reality apparatus and methods therefor |
| WO2018142228A2 (en) * | 2017-01-19 | 2018-08-09 | Mindmaze Holding Sa | Systems, methods, apparatuses and devices for detecting facial expression and for tracking movement and location including for at least one of a virtual and augmented reality system |
| US10515474B2 (en) | 2017-01-19 | 2019-12-24 | Mindmaze Holding Sa | System, method and apparatus for detecting facial expression in a virtual reality system |
| US10943100B2 (en) | 2017-01-19 | 2021-03-09 | Mindmaze Holding Sa | Systems, methods, devices and apparatuses for detecting facial expression |
| WO2018146558A2 (en) | 2017-02-07 | 2018-08-16 | Mindmaze Holding Sa | Systems, methods and apparatuses for stereo vision and tracking |
| US10325396B2 (en) * | 2017-02-14 | 2019-06-18 | Linden Research, Inc. | Virtual reality presentation of eye movement and eye contact |
| US20180247443A1 (en) * | 2017-02-28 | 2018-08-30 | International Business Machines Corporation | Emotional analysis and depiction in virtual reality |
| US10438394B2 (en) * | 2017-03-02 | 2019-10-08 | Colopl, Inc. | Information processing method, virtual space delivering system and apparatus therefor |
| US11042729B2 (en) | 2017-05-01 | 2021-06-22 | Google Llc | Classifying facial expressions using eye-tracking cameras |
| US10686996B2 (en) | 2017-06-26 | 2020-06-16 | Facebook Technologies, Llc | Digital pixel with extended dynamic range |
| US10636193B1 (en) * | 2017-06-29 | 2020-04-28 | Facebook Technologies, Llc | Generating graphical representation of a user's face and body using a monitoring system included on a head mounted display |
| US10636192B1 (en) | 2017-06-30 | 2020-04-28 | Facebook Technologies, Llc | Generating a graphical representation of a face of a user wearing a head mounted display |
| CN107392213B (zh) * | 2017-07-21 | 2020-04-07 | 西安电子科技大学 | 基于深度图模型特征学习的人脸画像合成方法 |
| US11568609B1 (en) | 2017-07-25 | 2023-01-31 | Meta Platforms Technologies, Llc | Image sensor having on-chip compute circuit |
| US10726627B2 (en) * | 2017-07-25 | 2020-07-28 | Facebook Technologies, Llc | Sensor system based on stacked sensor layers |
| US10598546B2 (en) | 2017-08-17 | 2020-03-24 | Facebook Technologies, Llc | Detecting high intensity light in photo sensor |
| TWI647631B (zh) * | 2017-11-28 | 2019-01-11 | 承潔投資有限公司 | 工地管理系統及其穿戴裝置 |
| PL3492406T3 (pl) * | 2017-12-01 | 2021-12-06 | Grifols Worldwide Operations Limited | Kontener z pokrywą i urządzenie do otwierania i zamykania pokryw kontenerów |
| KR102564854B1 (ko) | 2017-12-29 | 2023-08-08 | 삼성전자주식회사 | 정규화된 표현력에 기초한 표정 인식 방법, 표정 인식 장치 및 표정 인식을 위한 학습 방법 |
| KR102564855B1 (ko) | 2018-01-08 | 2023-08-08 | 삼성전자주식회사 | 표정 변화에 강인한 객체 및 표정 인식 장치 및 방법, 객체 및 표정 트레이닝 장치 및 방법 |
| US11328533B1 (en) | 2018-01-09 | 2022-05-10 | Mindmaze Holding Sa | System, method and apparatus for detecting facial expression for motion capture |
| US11057581B2 (en) | 2018-01-24 | 2021-07-06 | Facebook Technologies, Llc | Digital pixel array with multi-stage readouts |
| US11442539B2 (en) | 2018-01-24 | 2022-09-13 | Apple Inc. | Event camera-based gaze tracking using neural networks |
| US11194161B2 (en) | 2018-02-09 | 2021-12-07 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters |
| US11393251B2 (en) | 2018-02-09 | 2022-07-19 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters |
| WO2019154511A1 (en) | 2018-02-09 | 2019-08-15 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters using a neural network |
| US12034015B2 (en) | 2018-05-25 | 2024-07-09 | Meta Platforms Technologies, Llc | Programmable pixel array |
| CN110634174B (zh) * | 2018-06-05 | 2023-10-10 | 深圳市优必选科技有限公司 | 一种表情动画过渡方法、系统及智能终端 |
| US11906353B2 (en) | 2018-06-11 | 2024-02-20 | Meta Platforms Technologies, Llc | Digital pixel with extended dynamic range |
| US11463636B2 (en) | 2018-06-27 | 2022-10-04 | Facebook Technologies, Llc | Pixel sensor having multiple photodiodes |
| US10897586B2 (en) | 2018-06-28 | 2021-01-19 | Facebook Technologies, Llc | Global shutter image sensor |
| EP3827426A4 (en) | 2018-07-24 | 2022-07-27 | Magic Leap, Inc. | AD SYSTEMS AND PROCEDURES FOR DETERMINING A REGISTRATION BETWEEN AN AD AND A USER'S EYES |
| US10931884B2 (en) | 2018-08-20 | 2021-02-23 | Facebook Technologies, Llc | Pixel sensor having adaptive exposure time |
| CN109145987B (zh) * | 2018-08-21 | 2020-10-20 | 厦门美图之家科技有限公司 | 模型生成方法及装置 |
| US11956413B2 (en) | 2018-08-27 | 2024-04-09 | Meta Platforms Technologies, Llc | Pixel sensor having multiple photodiodes and shared comparator |
| US11595602B2 (en) | 2018-11-05 | 2023-02-28 | Meta Platforms Technologies, Llc | Image sensor post processing |
| CN109474805A (zh) * | 2018-11-08 | 2019-03-15 | 国网北京市电力公司 | 一种电子眼镜 |
| US11888002B2 (en) | 2018-12-17 | 2024-01-30 | Meta Platforms Technologies, Llc | Dynamically programmable image sensor |
| US11962928B2 (en) | 2018-12-17 | 2024-04-16 | Meta Platforms Technologies, Llc | Programmable pixel array |
| US11816795B2 (en) * | 2018-12-20 | 2023-11-14 | Sony Group Corporation | Photo-video based spatial-temporal volumetric capture system for dynamic 4D human face and body digitization |
| JP7160669B2 (ja) * | 2018-12-27 | 2022-10-25 | 株式会社コロプラ | プログラム、情報処理装置、および方法 |
| US10936178B2 (en) * | 2019-01-07 | 2021-03-02 | MemoryWeb, LLC | Systems and methods for analyzing and organizing digital photos and videos |
| WO2020147948A1 (en) | 2019-01-16 | 2020-07-23 | Pupil Labs Gmbh | Methods for generating calibration data for head-wearable devices and eye tracking system |
| US11218660B1 (en) | 2019-03-26 | 2022-01-04 | Facebook Technologies, Llc | Pixel sensor having shared readout structure |
| US20220124140A1 (en) * | 2019-04-01 | 2022-04-21 | Sumitomo Electric Industries, Ltd. | Communication assistance system, communication assistance method, and image control program |
| US11676422B2 (en) | 2019-06-05 | 2023-06-13 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters |
| US11943561B2 (en) | 2019-06-13 | 2024-03-26 | Meta Platforms Technologies, Llc | Non-linear quantization at pixel sensor |
| US12108141B2 (en) | 2019-08-05 | 2024-10-01 | Meta Platforms Technologies, Llc | Dynamically programmable image sensor |
| US11936998B1 (en) | 2019-10-17 | 2024-03-19 | Meta Platforms Technologies, Llc | Digital pixel sensor having extended dynamic range |
| US11935291B2 (en) | 2019-10-30 | 2024-03-19 | Meta Platforms Technologies, Llc | Distributed sensor system |
| US11948089B2 (en) | 2019-11-07 | 2024-04-02 | Meta Platforms Technologies, Llc | Sparse image sensing and processing |
| RU2764144C1 (ru) * | 2020-07-27 | 2022-01-13 | Самсунг Электроникс Ко., Лтд. | Быстрый двухслойный нейросетевой синтез реалистичных изображений нейронного аватара по одному снимку |
| US11902685B1 (en) | 2020-04-28 | 2024-02-13 | Meta Platforms Technologies, Llc | Pixel sensor having hierarchical memory |
| EP4150520A4 (en) * | 2020-05-15 | 2024-05-22 | Cornell University | WEARABLE DEVICES FOR FACIAL EXPRESSION RECOGNITION |
| US11825228B2 (en) | 2020-05-20 | 2023-11-21 | Meta Platforms Technologies, Llc | Programmable pixel array having multiple power domains |
| US11910114B2 (en) | 2020-07-17 | 2024-02-20 | Meta Platforms Technologies, Llc | Multi-mode image sensor |
| US20220067433A1 (en) * | 2020-08-26 | 2022-03-03 | International Business Machines Corporation | Domain adaptation |
| US12075175B1 (en) | 2020-09-08 | 2024-08-27 | Meta Platforms Technologies, Llc | Programmable smart sensor with adaptive readout |
| US11956560B2 (en) | 2020-10-09 | 2024-04-09 | Meta Platforms Technologies, Llc | Digital pixel sensor having reduced quantization operation |
| US11908233B2 (en) | 2020-11-02 | 2024-02-20 | Pinscreen, Inc. | Normalization of facial images using deep neural networks |
| US11935575B1 (en) | 2020-12-23 | 2024-03-19 | Meta Platforms Technologies, Llc | Heterogeneous memory system |
| US12022218B2 (en) | 2020-12-29 | 2024-06-25 | Meta Platforms Technologies, Llc | Digital image sensor using a single-input comparator based quantizer |
| CN112929619B (zh) * | 2021-02-03 | 2022-04-19 | 广州工程技术职业学院 | 一种动画角色中面部特征点的跟踪显示结构 |
| GB2607151B (en) * | 2021-03-12 | 2024-06-05 | Canon Kk | Wearable image pickup apparatus, portable device and calibrator that communicate with image pickup apparatus, control methods therefor, and storage media |
| EP4080331A1 (fr) * | 2021-04-19 | 2022-10-26 | Dynamixyz | Casque |
| US11614345B2 (en) | 2021-06-16 | 2023-03-28 | Microsoft Technology Licensing, Llc | Surface sensing via resonant sensor |
| GB2611154A (en) * | 2021-07-29 | 2023-03-29 | Canon Kk | Image pickup apparatus used as action camera, control method therefor, and storage medium storing control program therefor |
| GB2611156B (en) | 2021-07-30 | 2024-06-05 | Canon Kk | Image capture apparatus, control method, and program |
| KR20230019016A (ko) | 2021-07-30 | 2023-02-07 | 캐논 가부시끼가이샤 | 액션 카메라로서 사용되는 촬상장치 |
| GB2611157A (en) | 2021-07-30 | 2023-03-29 | Canon Kk | Image pickup apparatus used as action camera, calibration system, control method for image pickup apparatus, and storage medium storing control program for... |
| KR102575097B1 (ko) | 2022-11-09 | 2023-09-06 | 주식회사 플루언트 | 음성 기반 아바타 얼굴 표정 구현 방법 및 장치 |
Family Cites Families (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS5124145U (ru) * | 1974-08-07 | 1976-02-21 | ||
| US5886735A (en) | 1997-01-14 | 1999-03-23 | Bullister; Edward T | Video telephone headset |
| US6774869B2 (en) | 2000-12-22 | 2004-08-10 | Board Of Trustees Operating Michigan State University | Teleportal face-to-face system |
| US6493136B2 (en) * | 2001-03-07 | 2002-12-10 | General Scientific Corp. | Clip-on optical mounting structure |
| NO315679B1 (no) * | 2001-10-19 | 2003-10-06 | Dmates As | Rik kommunikasjon over internett |
| US20050208457A1 (en) * | 2004-01-05 | 2005-09-22 | Wolfgang Fink | Digital object recognition audio-assistant for the visually impaired |
| US7606392B2 (en) | 2005-08-26 | 2009-10-20 | Sony Corporation | Capturing and processing facial motion data |
| US11428937B2 (en) | 2005-10-07 | 2022-08-30 | Percept Technologies | Enhanced optical and perceptual digital eyewear |
| US7991230B2 (en) * | 2005-10-14 | 2011-08-02 | Microsoft Corporation | Modeling micro-structure for feature extraction |
| EP2016562A4 (en) | 2006-05-07 | 2010-01-06 | Sony Computer Entertainment Inc | METHOD FOR IMPLEMENTING AFFECTIVE PROPERTIES IN A COMPUTER GENERATED AVATAR DURING A COMPUTER GAME |
| CN101601043B (zh) * | 2007-02-02 | 2013-02-27 | 皇家飞利浦电子股份有限公司 | 医疗视频通信系统和方法 |
| US8068169B2 (en) * | 2007-02-26 | 2011-11-29 | General Scientific Corporation | Clip-on video camera system for medical, surgical and dental applications |
| WO2011042989A1 (ja) * | 2009-10-09 | 2011-04-14 | Kikuchi Kouichi | 視認情景に対する視認者情感判定装置 |
| US8717447B2 (en) | 2010-08-20 | 2014-05-06 | Gary Stephen Shuster | Remote telepresence gaze direction |
| KR20120018479A (ko) * | 2010-08-23 | 2012-03-05 | 에스케이플래닛 주식회사 | 얼굴 표정 및 동작 인식을 이용한 아바타 제공 서버 및 그 방법 |
| KR101133225B1 (ko) * | 2010-11-12 | 2012-04-05 | 홍익대학교 산학협력단 | 자세 추정을 이용한 얼굴 인식 시스템 및 방법 |
| US8573866B2 (en) | 2011-02-03 | 2013-11-05 | Jason R. Bond | Head-mounted face image capturing devices and systems |
| US9165404B2 (en) | 2011-07-14 | 2015-10-20 | Samsung Electronics Co., Ltd. | Method, apparatus, and system for processing virtual world |
| CA3207408A1 (en) | 2011-10-28 | 2013-06-13 | Magic Leap, Inc. | System and method for augmented and virtual reality |
| US8929589B2 (en) | 2011-11-07 | 2015-01-06 | Eyefluence, Inc. | Systems and methods for high-resolution gaze tracking |
| EP2800351A4 (en) * | 2011-11-24 | 2016-06-01 | Ntt Docomo Inc | EXPRESSION OUTPUT DEVICE AND EXPRESSION PUBLISHING METHOD |
| JP2013175929A (ja) * | 2012-02-24 | 2013-09-05 | Nikon Corp | 情報出力装置、及び情報出力方法 |
| US9357174B2 (en) | 2012-04-09 | 2016-05-31 | Intel Corporation | System and method for avatar management and selection |
| CN107257403A (zh) * | 2012-04-09 | 2017-10-17 | 英特尔公司 | 使用交互化身的通信 |
| US9235968B2 (en) * | 2013-03-14 | 2016-01-12 | Otoy, Inc. | Tactile elements for a wearable eye piece |
| US10019825B2 (en) * | 2013-06-05 | 2018-07-10 | Intel Corporation | Karaoke avatar animation based on facial motion data |
-
2014
- 2014-04-29 US US14/265,201 patent/US9672416B2/en active Active
-
2015
- 2015-04-23 JP JP2016565351A patent/JP6722590B2/ja active Active
- 2015-04-23 AU AU2015253557A patent/AU2015253557B2/en active Active
- 2015-04-23 MX MX2016014091A patent/MX360923B/es active IP Right Grant
- 2015-04-23 RU RU2016141911A patent/RU2679986C2/ru active
- 2015-04-23 CN CN201580023604.0A patent/CN106255978B/zh active Active
- 2015-04-23 EP EP15721449.5A patent/EP3137938B1/en active Active
- 2015-04-23 CA CA2943424A patent/CA2943424C/en active Active
- 2015-04-23 WO PCT/US2015/027188 patent/WO2015167909A1/en active Application Filing
- 2015-04-23 KR KR1020167032126A patent/KR102390781B1/ko active IP Right Grant
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11195302B2 (en) | 2018-11-30 | 2021-12-07 | Dwango Co., Ltd. | Video synthesis device, video synthesis method and recording medium |
| US11367260B2 (en) | 2018-11-30 | 2022-06-21 | Dwango Co., Ltd. | Video synthesis device, video synthesis method and recording medium |
| US11625858B2 (en) | 2018-11-30 | 2023-04-11 | Dwango Co., Ltd. | Video synthesis device, video synthesis method and recording medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2015167909A1 (en) | 2015-11-05 |
| RU2679986C2 (ru) | 2019-02-14 |
| EP3137938B1 (en) | 2018-01-31 |
| US9672416B2 (en) | 2017-06-06 |
| EP3137938A1 (en) | 2017-03-08 |
| AU2015253557A1 (en) | 2017-03-09 |
| JP6722590B2 (ja) | 2020-07-15 |
| KR20160146861A (ko) | 2016-12-21 |
| RU2016141911A3 (ru) | 2018-12-10 |
| AU2015253557B2 (en) | 2019-07-25 |
| CN106255978B (zh) | 2019-09-03 |
| CN106255978A (zh) | 2016-12-21 |
| CA2943424C (en) | 2021-11-16 |
| CA2943424A1 (en) | 2015-11-05 |
| KR102390781B1 (ko) | 2022-04-25 |
| MX2016014091A (es) | 2017-02-09 |
| MX360923B (es) | 2018-11-22 |
| JP2017516140A (ja) | 2017-06-15 |
| US20150310263A1 (en) | 2015-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2016141911A (ru) | Отслеживание выражения лица | |
| JP2017516140A5 (ru) | ||
| JP2016510517A5 (ru) | ||
| CN205038406U (zh) | 可调焦距的头戴式显示设备 | |
| US11941167B2 (en) | Head-mounted VR all-in-one machine | |
| US20190102956A1 (en) | Information processing apparatus, information processing method, and program | |
| CN109002164B (zh) | 头戴显示设备的显示方法、装置及头戴显示设备 | |
| CN104483753A (zh) | 自配准透射式头戴显示设备 | |
| WO2014197109A3 (en) | Infrared video display eyewear | |
| JP2015503934A5 (ru) | ||
| JP2018514882A5 (ru) | ||
| JP2014219621A (ja) | 表示装置、表示制御プログラム | |
| CN105554384A (zh) | 可穿戴设备及拍摄方法 | |
| JP2015013031A5 (ru) | ||
| RU2013147677A (ru) | Система отображения виртуальной реальности | |
| RU2014105687A (ru) | Способ и система для лечения нарушения зрения | |
| EA201201649A1 (ru) | Фотокамерное устройство покадровой фотосъемки для получения трехмерного изображения с изменяемой глубиной восприятия | |
| JP2014191386A5 (ru) | ||
| US20180205932A1 (en) | Stereoscopic video see-through augmented reality device with vergence control and gaze stabilization, head-mounted display and method for near-field augmented reality application | |
| WO2013142031A3 (en) | Compact iris imaging system | |
| TW201814356A (zh) | 頭戴顯示裝置與其鏡片位置調整方法 | |
| JP2017158083A5 (ru) | ||
| JP2011090702A5 (ru) | ||
| WO2020029658A1 (zh) | 一种基于单摄像头的双眼追踪系统 | |
| WO2016016445A3 (fr) | Dispositif et procédé de projection tête haute pour casque de moto |