BR112020012291A8 - Dispositivo head-mounted display e método do mesmo - Google Patents

Dispositivo head-mounted display e método do mesmo

Info

Publication number
BR112020012291A8
BR112020012291A8 BR112020012291A BR112020012291A BR112020012291A8 BR 112020012291 A8 BR112020012291 A8 BR 112020012291A8 BR 112020012291 A BR112020012291 A BR 112020012291A BR 112020012291 A BR112020012291 A BR 112020012291A BR 112020012291 A8 BR112020012291 A8 BR 112020012291A8
Authority
BR
Brazil
Prior art keywords
real
world
display
head
mounted display
Prior art date
Application number
BR112020012291A
Other languages
English (en)
Other versions
BR112020012291A2 (pt
Inventor
ARAÚJO José
Tayamon Soma
Original Assignee
Ericsson Telefon Ab L M
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ericsson Telefon Ab L M filed Critical Ericsson Telefon Ab L M
Publication of BR112020012291A2 publication Critical patent/BR112020012291A2/pt
Publication of BR112020012291A8 publication Critical patent/BR112020012291A8/pt

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85Stereo camera calibration
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0025Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)

Abstract

É fornecido um dispositivo head-mounted display (HMD) (100) configurado para ser vestido por um usuário (121). O HMD compreende um display pelo menos parcialmente transparente (101), uma câmera frontal (102) operativa para capturar uma primeira imagem de uma cena do mundo real e meios de processamento (104) que são operativos para selecionar um objeto de calibração dentre um ou mais objetos do mundo real, ou partes dos mesmos, (130?135) que são visíveis na primeira imagem e para derivar uma transformação de calibração para calcular uma posição de display com base em uma posição do mundo real, de modo que um objeto virtual que é exibido no display na posição de display esteja alinhado com um objeto do mundo real correspondente localizado na posição do mundo real, conforme visto pelo usuário.
BR112020012291A 2017-12-19 2017-12-19 Dispositivo head-mounted display e método do mesmo BR112020012291A8 (pt)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2017/083600 WO2019120488A1 (en) 2017-12-19 2017-12-19 Head-mounted display device and method thereof

Publications (2)

Publication Number Publication Date
BR112020012291A2 BR112020012291A2 (pt) 2020-11-24
BR112020012291A8 true BR112020012291A8 (pt) 2023-04-04

Family

ID=60957276

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112020012291A BR112020012291A8 (pt) 2017-12-19 2017-12-19 Dispositivo head-mounted display e método do mesmo

Country Status (15)

Country Link
US (3) US11380018B2 (pt)
EP (2) EP3729378B1 (pt)
JP (1) JP7012163B2 (pt)
KR (1) KR102465654B1 (pt)
CN (1) CN111492405B (pt)
BR (1) BR112020012291A8 (pt)
CA (1) CA3084686C (pt)
DK (1) DK3729378T3 (pt)
ES (1) ES2890428T3 (pt)
IL (1) IL275047B2 (pt)
MA (1) MA54342B1 (pt)
MX (1) MX2020006407A (pt)
PL (1) PL3729378T3 (pt)
RU (1) RU2749643C1 (pt)
WO (1) WO2019120488A1 (pt)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6410987B2 (ja) * 2016-02-25 2018-10-24 富士フイルム株式会社 運転支援装置、運転支援方法、及び、運転支援プログラム
JP2022539603A (ja) * 2019-07-12 2022-09-12 マジック リープ, インコーポレイテッド ディスプレイシステム較正のための眼球カメラシステムおよび方法
CN110766094B (zh) * 2019-10-31 2022-07-26 联想(北京)有限公司 用于评估增强现实设备标定准确性的方法和装置
CN113253840B (zh) * 2021-05-06 2023-03-10 青岛小鸟看看科技有限公司 多参与模式的人工现实系统
GB2609009B (en) * 2021-07-16 2024-01-03 Sony Interactive Entertainment Inc Head-mountable display systems and methods
CN113566847B (zh) * 2021-07-22 2022-10-11 北京百度网讯科技有限公司 导航校准方法和装置、电子设备、计算机可读介质
CN114366330A (zh) * 2022-01-13 2022-04-19 北京歌锐科技有限公司 一种混合现实系统及基于混合现实的标识物配准方法
US20230245345A1 (en) * 2022-02-02 2023-08-03 Varjo Technologies Oy Object-based camera calibration

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2130980A1 (en) 1994-08-26 1996-02-27 Carl Treftlin Control apparatus for a video display or virtual reality system
US6711293B1 (en) 1999-03-08 2004-03-23 The University Of British Columbia Method and apparatus for identifying scale invariant features in an image and use of same for locating an object in an image
DE10103922A1 (de) 2001-01-30 2002-08-01 Physoptics Opto Electronic Gmb Interaktives Datensicht- und Bediensystem
US20130278631A1 (en) 2010-02-28 2013-10-24 Osterhout Group, Inc. 3d positioning of augmented reality information
JP2012203823A (ja) * 2011-03-28 2012-10-22 Kddi Corp 画像認識装置
US20140176609A1 (en) * 2011-08-09 2014-06-26 Pioneer Corporation Mixed reality apparatus
US9311883B2 (en) 2011-11-11 2016-04-12 Microsoft Technology Licensing, Llc Recalibration of a flexible mixed reality device
WO2013179427A1 (ja) 2012-05-30 2013-12-05 パイオニア株式会社 表示装置、ヘッドマウントディスプレイ、校正方法及び校正プログラム、並びに記録媒体
US9239460B2 (en) 2013-05-10 2016-01-19 Microsoft Technology Licensing, Llc Calibration of eye location
TWI505260B (zh) 2013-07-30 2015-10-21 Univ Nat Chiao Tung 頭戴式人眼追蹤系統
US20150193980A1 (en) * 2014-01-06 2015-07-09 Qualcomm Incorporated Calibration of augmented reality (ar) optical see-through display using shape-based alignment
IL232853A (en) * 2014-05-28 2015-11-30 Elbit Systems Land & C4I Ltd Imaging Georegistration System and Method
WO2016013634A1 (ja) * 2014-07-24 2016-01-28 国立研究開発法人科学技術振興機構 画像位置合わせ装置、画像位置合わせ方法、および、画像位置合わせプログラム
EP3230825B1 (en) * 2014-12-10 2019-05-29 Telefonaktiebolaget LM Ericsson (publ) Device for and method of corneal imaging
US20170061700A1 (en) 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
US9746675B2 (en) 2015-05-28 2017-08-29 Microsoft Technology Licensing, Llc Alignment based view matrix tuning
US10630965B2 (en) * 2015-10-02 2020-04-21 Microsoft Technology Licensing, Llc Calibrating a near-eye display
AU2016359149B2 (en) 2015-11-25 2018-08-23 Google Llc Prism-based eye tracking
JP2017187667A (ja) * 2016-04-07 2017-10-12 セイコーエプソン株式会社 頭部装着型表示装置およびコンピュータープログラム
IL252582A0 (en) 2017-05-29 2017-08-31 Eyeway Vision Ltd A method and system for registration between the outside world and a virtual image
GB201709199D0 (en) 2017-06-09 2017-07-26 Delamont Dean Lindsay IR mixed reality and augmented reality gaming system
US11650426B2 (en) * 2019-05-09 2023-05-16 Meta Platforms Technologies, Llc Holographic optical elements for eye-tracking illumination
CN111147834A (zh) 2019-12-31 2020-05-12 深圳疆程技术有限公司 一种基于增强现实抬头显示的虚拟图像标定方法

Also Published As

Publication number Publication date
EP3729378B1 (en) 2021-07-21
KR102465654B1 (ko) 2022-11-09
EP3901915A2 (en) 2021-10-27
IL275047A (en) 2020-07-30
RU2749643C1 (ru) 2021-06-16
MA54342A (fr) 2020-10-28
MX2020006407A (es) 2020-09-07
WO2019120488A1 (en) 2019-06-27
CA3084686C (en) 2024-01-02
US20240185463A1 (en) 2024-06-06
US11380018B2 (en) 2022-07-05
BR112020012291A2 (pt) 2020-11-24
US20220301226A1 (en) 2022-09-22
ES2890428T3 (es) 2022-01-19
IL275047B1 (en) 2023-12-01
JP7012163B2 (ja) 2022-01-27
EP3729378A1 (en) 2020-10-28
IL275047B2 (en) 2024-04-01
US20200388054A1 (en) 2020-12-10
CA3084686A1 (en) 2019-06-27
KR20200094767A (ko) 2020-08-07
PL3729378T3 (pl) 2022-01-10
MA54342B1 (fr) 2021-09-30
CN111492405B (zh) 2023-09-05
CN111492405A (zh) 2020-08-04
US11935267B2 (en) 2024-03-19
EP3901915A3 (en) 2022-01-26
JP2021508109A (ja) 2021-02-25
DK3729378T3 (da) 2021-09-20

Similar Documents

Publication Publication Date Title
BR112020012291A8 (pt) Dispositivo head-mounted display e método do mesmo
EP4345831A3 (en) Imaging modification, display and visualization using augmented and virtual reality eyewear
WO2016053915A3 (en) Environmental control via wearable computing system
BR112017012719A2 (pt) melhoria da percepção visual da simbologia de cor exibida
WO2014209244A8 (en) Image display device in the form of a pair of eye glasses
MX2017003762A (es) Visibilidad de dispositivo de salida para la informacion visual con base en la convergencia ocular.
WO2015047599A3 (en) Visual search in real world using optical see-through head mounted display with augmented reality and user interaction tracking
NZ724519A (en) Wearable 3d augmented reality display with variable focus and/or object recognition
NZ754406A (en) Systems and methods for manipulating light from ambient light sources
EP3007038A3 (en) Interaction with three-dimensional video
JP2016505919A5 (pt)
GB2519418A8 (en) Head-mountable apparatus and systems
WO2014197231A3 (en) Switching mode of operation in a head mounted display
NZ746117A (en) Head mounted display system configured to exchange biometric information
MX359046B (es) Navegacion de menu en un casco de realidad virtual.
WO2014197338A3 (en) Head mounted display based on optical prescription of a user
JP2016509245A5 (pt)
WO2016154026A3 (en) Retroreflective light field display
BR112016006044A2 (pt) método e aparelho para controle de exibição, e, dispositivo eletrônico
JP2016024273A5 (pt)
WO2014108799A3 (en) Apparatus and methods of real time presenting 3d visual effects with stereopsis more realistically and substract reality with external display(s)
WO2012129282A3 (en) Augmented reality in a virtual tour through a financial portfolio
PH12019501822A1 (en) Virtual reality head-mounted apparatus
JP2019510991A5 (pt)
BR112017006638A2 (pt) aparelho, equipamento de usuário, método e programa de computador de interação para interfaces de usuário

Legal Events

Date Code Title Description
B350 Update of information on the portal [chapter 15.35 patent gazette]
B06W Patent application suspended after preliminary examination (for patents with searches from other patent authorities) chapter 6.23 patent gazette]
B15K Others concerning applications: alteration of classification

Free format text: AS CLASSIFICACOES ANTERIORES ERAM: G06T 7/80 , G06T 7/73

Ipc: G06T 7/73 (2017.01), G02B 27/00 (2006.01), G06T 7/