JPWO2020023399A5 - - Google Patents
Download PDFInfo
- Publication number
- JPWO2020023399A5 JPWO2020023399A5 JP2021500724A JP2021500724A JPWO2020023399A5 JP WO2020023399 A5 JPWO2020023399 A5 JP WO2020023399A5 JP 2021500724 A JP2021500724 A JP 2021500724A JP 2021500724 A JP2021500724 A JP 2021500724A JP WO2020023399 A5 JPWO2020023399 A5 JP WO2020023399A5
- Authority
- JP
- Japan
- Prior art keywords
- head pose
- wearable system
- head
- neural network
- predicted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims description 20
- 238000013528 artificial neural network Methods 0.000 claims description 17
- 230000000306 recurrent effect Effects 0.000 claims description 15
- 238000009877 rendering Methods 0.000 claims description 10
- 230000001133 acceleration Effects 0.000 claims description 8
- 230000006403 short-term memory Effects 0.000 claims description 6
- 238000005259 measurement Methods 0.000 claims description 5
- 230000015654 memory Effects 0.000 claims description 4
- 238000003062 neural network model Methods 0.000 claims description 4
- 230000001052 transient effect Effects 0.000 claims description 2
- 210000003128 head Anatomy 0.000 claims 32
- 241000288105 Grus Species 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2024014693A JP2024036471A (ja) | 2018-07-23 | 2024-02-02 | 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201862702309P | 2018-07-23 | 2018-07-23 | |
| US62/702,309 | 2018-07-23 | ||
| PCT/US2019/042846 WO2020023399A1 (en) | 2018-07-23 | 2019-07-22 | Deep predictor recurrent neural network for head pose prediction |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2024014693A Division JP2024036471A (ja) | 2018-07-23 | 2024-02-02 | 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク |
Publications (4)
| Publication Number | Publication Date |
|---|---|
| JP2021530790A JP2021530790A (ja) | 2021-11-11 |
| JPWO2020023399A5 true JPWO2020023399A5 (https=) | 2022-07-29 |
| JP2021530790A5 JP2021530790A5 (https=) | 2022-07-29 |
| JP7562504B2 JP7562504B2 (ja) | 2024-10-07 |
Family
ID=69181908
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2021500724A Active JP7562504B2 (ja) | 2018-07-23 | 2019-07-22 | 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク |
| JP2024014693A Withdrawn JP2024036471A (ja) | 2018-07-23 | 2024-02-02 | 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2024014693A Withdrawn JP2024036471A (ja) | 2018-07-23 | 2024-02-02 | 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク |
Country Status (5)
| Country | Link |
|---|---|
| US (2) | US11320899B2 (https=) |
| EP (1) | EP3827417A4 (https=) |
| JP (2) | JP7562504B2 (https=) |
| CN (1) | CN112513944A (https=) |
| WO (1) | WO2020023399A1 (https=) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3500908B1 (en) * | 2016-11-11 | 2020-04-22 | Telefonaktiebolaget LM Ericsson (publ) | Supporting an augmented-reality software application |
| CN112513944A (zh) | 2018-07-23 | 2021-03-16 | 奇跃公司 | 用于头部姿势预测的深度预测器循环神经网络 |
| US12122420B2 (en) * | 2018-08-29 | 2024-10-22 | Intel Corporation | Computer vision system |
| US10901502B2 (en) * | 2019-06-27 | 2021-01-26 | Facebook, Inc. | Reducing head mounted display power consumption and heat generation through predictive rendering of content |
| TW202125343A (zh) * | 2019-12-30 | 2021-07-01 | 瑞昱半導體股份有限公司 | 時間序列預測方法及相關的時間序列預測電路 |
| US20210240257A1 (en) * | 2020-01-31 | 2021-08-05 | Ati Technologies Ulc | Hiding latency in wireless virtual and augmented reality systems |
| IL274382A (en) | 2020-05-01 | 2021-12-01 | Pulsenmore Ltd | A system and method for assisting an unskilled patient in performing ultrasound scans himself |
| US11144117B1 (en) * | 2020-05-18 | 2021-10-12 | Qualcomm Incorporated | Deep learning based head motion prediction for extended reality |
| DE102020121408A1 (de) | 2020-08-14 | 2022-02-17 | Bayerische Motoren Werke Aktiengesellschaft | Computerimplementiertes Verfahren und System zur Vorhersage einer Orientierung und räumlichen Position einer am Kopf eines Nutzers montierbaren Anzeigevorrichtung |
| KR102672387B1 (ko) * | 2020-12-09 | 2024-06-10 | 서울과학기술대학교 산학협력단 | Lstm 기반의 개인화 시점 추정 방법 및 장치 |
| KR20220083346A (ko) | 2020-12-11 | 2022-06-20 | 삼성전자주식회사 | 영상 표시 장치의 위치를 추정하는 방법 및 장치 |
| US11914762B2 (en) * | 2020-12-28 | 2024-02-27 | Meta Platforms Technologies, Llc | Controller position tracking using inertial measurement units and machine learning |
| JP7617417B2 (ja) * | 2021-04-27 | 2025-01-20 | パナソニックIpマネジメント株式会社 | 照明装置、照明制御方法及びプログラム |
| US11886245B2 (en) * | 2021-05-06 | 2024-01-30 | Microsoft Technology Licensing, Llc | Estimating runtime-frame velocity of wearable device |
| JP7474726B2 (ja) | 2021-05-14 | 2024-04-25 | Kddi株式会社 | 計算機合成ホログラム生成装置及びプログラム |
| CN113420720B (zh) * | 2021-07-21 | 2024-01-09 | 中通服咨询设计研究院有限公司 | 一种高精度低延时大型室内场馆人群分布计算方法 |
| CN114004342B (zh) * | 2021-11-29 | 2023-05-30 | 中国科学院光电技术研究所 | 一种基于lstm网络的激光通信系统畸变波前预测方法 |
| CN114154583B (zh) * | 2021-12-08 | 2024-05-24 | 深圳博沃智慧科技有限公司 | 一种小波分析耦合lstm神经网络的水质预测方法 |
| US11847259B1 (en) | 2022-11-23 | 2023-12-19 | Google Llc | Map-aided inertial odometry with neural network for augmented reality devices |
| US12602803B2 (en) * | 2024-03-28 | 2026-04-14 | Htc Corporation | Head-mounted display and method for depth prediction |
| CN119178437B (zh) * | 2024-10-15 | 2025-03-14 | 北京大学 | 一种室内航向估计方法、装置、设备及介质 |
| CN119027624B (zh) * | 2024-10-28 | 2024-12-20 | 云南邦彦科技有限公司 | 3d展览馆效果可视化体验平台 |
Family Cites Families (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6222525B1 (en) | 1992-03-05 | 2001-04-24 | Brad A. Armstrong | Image controllers with sheet connected sensors |
| US5670988A (en) | 1995-09-05 | 1997-09-23 | Interlink Electronics, Inc. | Trigger operated electronic device |
| US11428937B2 (en) | 2005-10-07 | 2022-08-30 | Percept Technologies | Enhanced optical and perceptual digital eyewear |
| US20070081123A1 (en) | 2005-10-07 | 2007-04-12 | Lewis Scott W | Digital eyewear |
| US8696113B2 (en) | 2005-10-07 | 2014-04-15 | Percept Technologies Inc. | Enhanced optical and perceptual digital eyewear |
| US9304319B2 (en) | 2010-11-18 | 2016-04-05 | Microsoft Technology Licensing, Llc | Automatic focus improvement for augmented reality displays |
| US10156722B2 (en) | 2010-12-24 | 2018-12-18 | Magic Leap, Inc. | Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality |
| AU2011348122A1 (en) | 2010-12-24 | 2013-07-11 | Magic Leap Inc. | An ergonomic head mounted display device and optical system |
| JP6316186B2 (ja) | 2011-05-06 | 2018-04-25 | マジック リープ, インコーポレイテッドMagic Leap,Inc. | 広範囲同時遠隔ディジタル提示世界 |
| EP2760363A4 (en) | 2011-09-29 | 2015-06-24 | Magic Leap Inc | TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION |
| US9215293B2 (en) | 2011-10-28 | 2015-12-15 | Magic Leap, Inc. | System and method for augmented and virtual reality |
| WO2013152205A1 (en) | 2012-04-05 | 2013-10-10 | Augmented Vision Inc. | Wide-field of view (fov) imaging devices with active foveation capability |
| US9671566B2 (en) | 2012-06-11 | 2017-06-06 | Magic Leap, Inc. | Planar waveguide apparatus with diffraction element(s) and system employing same |
| KR20150054967A (ko) | 2012-09-11 | 2015-05-20 | 매직 립, 인코포레이티드 | 인체공학적 헤드 마운티드 디스플레이 디바이스 및 광학 시스템 |
| US9417452B2 (en) | 2013-03-15 | 2016-08-16 | Magic Leap, Inc. | Display system and method |
| US9874749B2 (en) | 2013-11-27 | 2018-01-23 | Magic Leap, Inc. | Virtual and augmented reality systems and methods |
| JP6479785B2 (ja) | 2013-10-16 | 2019-03-06 | マジック リープ, インコーポレイテッドMagic Leap,Inc. | 調節可能な瞳孔間距離を有する仮想または拡張現実ヘッドセット |
| US9857591B2 (en) | 2014-05-30 | 2018-01-02 | Magic Leap, Inc. | Methods and system for creating focal planes in virtual and augmented reality |
| CN107272199B (zh) | 2013-11-27 | 2023-04-07 | 奇跃公司 | 虚拟和增强现实系统与方法 |
| US10203762B2 (en) | 2014-03-11 | 2019-02-12 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
| EP3140780B1 (en) | 2014-05-09 | 2020-11-04 | Google LLC | Systems and methods for discerning eye signals and continuous biometric identification |
| US10310595B2 (en) | 2014-06-30 | 2019-06-04 | Sony Corporation | Information processing apparatus, information processing method, computer program, and image processing system |
| US9442564B1 (en) * | 2015-02-12 | 2016-09-13 | Amazon Technologies, Inc. | Motion sensor-based head location estimation and updating |
| US10977774B2 (en) * | 2015-09-16 | 2021-04-13 | Sony Corporation | Information processing apparatus, information processing method, and program for estimating prediction accuracy |
| WO2017213780A1 (en) * | 2016-05-06 | 2017-12-14 | The Board Of Trustees Of The Leland Stanford Junior University | Mobile and wearable video capture and feedback plat-forms for therapy of mental disorders |
| KR102648770B1 (ko) | 2016-07-14 | 2024-03-15 | 매직 립, 인코포레이티드 | 홍채 식별을 위한 딥 뉴럴 네트워크 |
| US11120353B2 (en) | 2016-08-16 | 2021-09-14 | Toyota Jidosha Kabushiki Kaisha | Efficient driver action prediction system based on temporal fusion of sensor data using deep (bidirectional) recurrent neural network |
| CN114253400A (zh) | 2016-08-22 | 2022-03-29 | 奇跃公司 | 具有深度学习传感器的增强现实显示装置 |
| RU2016138608A (ru) | 2016-09-29 | 2018-03-30 | Мэджик Лип, Инк. | Нейронная сеть для сегментации изображения глаза и оценки качества изображения |
| KR102610030B1 (ko) | 2016-11-15 | 2023-12-04 | 매직 립, 인코포레이티드 | 큐보이드 검출을 위한 딥 러닝 시스템 |
| AU2018236433B2 (en) | 2017-03-17 | 2022-03-03 | Magic Leap, Inc. | Room layout estimation methods and techniques |
| US10096125B1 (en) * | 2017-04-07 | 2018-10-09 | Adobe Systems Incorporated | Forecasting multiple poses based on a graphical image |
| US10996742B2 (en) * | 2017-10-17 | 2021-05-04 | Logitech Europe S.A. | Input device for AR/VR applications |
| US10942564B2 (en) * | 2018-05-17 | 2021-03-09 | Sony Interactive Entertainment Inc. | Dynamic graphics rendering based on predicted saccade landing point |
| CN112513944A (zh) | 2018-07-23 | 2021-03-16 | 奇跃公司 | 用于头部姿势预测的深度预测器循环神经网络 |
-
2019
- 2019-07-22 CN CN201980049016.2A patent/CN112513944A/zh active Pending
- 2019-07-22 WO PCT/US2019/042846 patent/WO2020023399A1/en not_active Ceased
- 2019-07-22 JP JP2021500724A patent/JP7562504B2/ja active Active
- 2019-07-22 US US17/253,888 patent/US11320899B2/en active Active
- 2019-07-22 EP EP19842146.3A patent/EP3827417A4/en active Pending
-
2022
- 2022-04-29 US US17/733,857 patent/US11662806B2/en active Active
-
2024
- 2024-02-02 JP JP2024014693A patent/JP2024036471A/ja not_active Withdrawn
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2021530790A5 (https=) | ||
| JPWO2020023399A5 (https=) | ||
| JP7562504B2 (ja) | 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク | |
| EP3899696B1 (en) | Voice command execution from auxiliary input | |
| Oh et al. | Layerweaver: Maximizing resource utilization of neural processing units via layer-wise scheduling | |
| CN113534948B (zh) | 增强现实ar装置和预测其中的姿势的方法 | |
| CN115293227B (zh) | 一种模型训练方法及相关设备 | |
| JP2021503122A (ja) | ニューラルネットワークに関するマルチタスク学習のためのメタ学習 | |
| EP3942529A1 (en) | Predicting three-dimensional articulated and target object pose | |
| WO2019192172A1 (zh) | 一种姿态预测方法、装置和电子设备 | |
| WO2018048598A1 (en) | Deep machine learning to perform touch motion prediction | |
| CN111552383A (zh) | 虚拟增强现实交互设备的手指识别方法、系统及交互设备 | |
| CN109910754A (zh) | 一种盲区画面获取的方法以及终端设备 | |
| CN117746400A (zh) | 疲劳驾驶检测方法、装置、电子设备及存储介质 | |
| CN106709471A (zh) | 跌倒检测方法及装置 | |
| WO2018009844A1 (en) | Methods and apparatus to determine objects to present in virtual reality environments | |
| CN111158476B (zh) | 一种虚拟键盘的按键识别方法、系统、设备及存储介质 | |
| JP6117438B2 (ja) | 掴み検出の較正 | |
| CN116203946A (zh) | 可移动设备脱困方法、装置、计算机设备和存储介质 | |
| CN111279364A (zh) | 卷积计算的装置、方法、处理器和可移动设备 | |
| US20190343465A1 (en) | Condition detection in a virtual reality system or an augmented reality system | |
| US20220343608A1 (en) | Prediction of contact points between 3d models | |
| CN116026493A (zh) | 核心体温检测方法及电子设备 | |
| EP4335598A1 (en) | Action abstraction controller for fully actuated robotic manipulators | |
| CN120541511A (zh) | 模型训练方法、装置、电子设备及存储介质 |