KR20190002416A - 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템 - Google Patents

가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템 Download PDF

Info

Publication number
KR20190002416A
KR20190002416A KR1020187018599A KR20187018599A KR20190002416A KR 20190002416 A KR20190002416 A KR 20190002416A KR 1020187018599 A KR1020187018599 A KR 1020187018599A KR 20187018599 A KR20187018599 A KR 20187018599A KR 20190002416 A KR20190002416 A KR 20190002416A
Authority
KR
South Korea
Prior art keywords
user
display
head
additional content
gaze
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
KR1020187018599A
Other languages
English (en)
Korean (ko)
Inventor
아지트 샨웨어
Original Assignee
로비 가이드스, 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/140,272 external-priority patent/US10025376B2/en
Priority claimed from US15/140,249 external-priority patent/US9851792B2/en
Application filed by 로비 가이드스, 인크. filed Critical 로비 가이드스, 인크.
Priority to KR1020237010112A priority Critical patent/KR102673480B1/ko
Publication of KR20190002416A publication Critical patent/KR20190002416A/ko
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Position Input By Displaying (AREA)
KR1020187018599A 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템 Ceased KR20190002416A (ko)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020237010112A KR102673480B1 (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US15/140,272 US10025376B2 (en) 2016-04-27 2016-04-27 Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment
US15/140,249 2016-04-27
US15/140,272 2016-04-27
US15/140,249 US9851792B2 (en) 2016-04-27 2016-04-27 Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment
PCT/US2017/029593 WO2017189699A1 (en) 2016-04-27 2017-04-26 Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020237010112A Division KR102673480B1 (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템

Publications (1)

Publication Number Publication Date
KR20190002416A true KR20190002416A (ko) 2019-01-08

Family

ID=58692608

Family Applications (4)

Application Number Title Priority Date Filing Date
KR1020187018599A Ceased KR20190002416A (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템
KR1020237010112A Active KR102673480B1 (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템
KR1020247018405A Active KR102762521B1 (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템
KR1020257003064A Pending KR20250020731A (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템

Family Applications After (3)

Application Number Title Priority Date Filing Date
KR1020237010112A Active KR102673480B1 (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템
KR1020247018405A Active KR102762521B1 (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템
KR1020257003064A Pending KR20250020731A (ko) 2016-04-27 2017-04-26 가상 현실 환경을 디스플레이하는 헤드업 디스플레이 상에 추가적인 콘텐트를 디스플레이하는 방법 및 시스템

Country Status (6)

Country Link
EP (3) EP3457251A1 (enExample)
JP (6) JP6968800B2 (enExample)
KR (4) KR20190002416A (enExample)
AU (1) AU2017255567A1 (enExample)
CA (1) CA2999057C (enExample)
WO (1) WO2017189699A1 (enExample)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20220033223A (ko) * 2020-09-09 2022-03-16 한양대학교 산학협력단 안구 기반 개인화 헤드 마운티드 디스플레이 장치 및 그 제어 방법
KR20220148893A (ko) * 2020-12-14 2022-11-07 구글 엘엘씨 가변 밝기 및 시야 디스플레이
WO2024136381A1 (ko) * 2022-12-20 2024-06-27 삼성전자주식회사 시각적 객체를 표시하기 위한 웨어러블 장치 및 그 방법
US12058392B2 (en) 2020-09-21 2024-08-06 Samsung Electronics Co., Ltd. Method and device for transmitting video content by using edge computing service
WO2025100571A1 (ko) * 2023-11-07 2025-05-15 고큐바테크놀로지 주식회사 시선 트레킹 적용된 혼합 현실 기반의 상지 재활 디지털 치료 장치

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102539579B1 (ko) * 2018-12-18 2023-06-05 삼성전자주식회사 정보의 표시 영역을 적응적으로 변경하기 위한 전자 장치 및 그의 동작 방법
TWI719483B (zh) 2019-05-17 2021-02-21 雅得近顯股份有限公司 便利備忘操作系統
US11391945B2 (en) * 2020-08-31 2022-07-19 Sony Interactive Entertainment LLC Automatic positioning of head-up display based on gaze tracking
CN117008731A (zh) * 2020-09-25 2023-11-07 苹果公司 用于导航用户界面的方法
CN114327214A (zh) * 2022-01-05 2022-04-12 北京有竹居网络技术有限公司 交互方法、装置、电子设备、存储介质及计算机程序产品

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6239794B1 (en) 1994-08-31 2001-05-29 E Guide, Inc. Method and system for simultaneously displaying a television program and information about the program
US6388714B1 (en) 1995-10-02 2002-05-14 Starsight Telecast Inc Interactive computer system for providing television schedule information
US6177931B1 (en) 1996-12-19 2001-01-23 Index Systems, Inc. Systems and methods for displaying and recording control interface with television programs, video, advertising information and program scheduling information
US6564378B1 (en) 1997-12-08 2003-05-13 United Video Properties, Inc. Program guide system with browsing display
EP1365582A1 (en) 1998-03-04 2003-11-26 United Video Properties, Inc. Program guide system with targeted advertising
CN1867068A (zh) 1998-07-14 2006-11-22 联合视频制品公司 交互式电视节目导视系统及其方法
AR020608A1 (es) 1998-07-17 2002-05-22 United Video Properties Inc Un metodo y una disposicion para suministrar a un usuario acceso remoto a una guia de programacion interactiva por un enlace de acceso remoto
TW420936B (en) 1998-07-17 2001-02-01 United Video Properties Inc Interactive television program guide system having multiple devices within a household
US7165098B1 (en) 1998-11-10 2007-01-16 United Video Properties, Inc. On-line schedule system with personalization features
MXPA03007512A (es) 2001-02-21 2003-12-04 United Video Properties Inc Sistemas y metodos para guias de programa interactivas con caracteristicas de grabacion personal.
US20030067476A1 (en) * 2001-10-04 2003-04-10 Eastman Kodak Company Method and system for displaying an image
JP4364047B2 (ja) * 2004-04-14 2009-11-11 オリンパス株式会社 表示装置、撮像装置
US20100153885A1 (en) 2005-12-29 2010-06-17 Rovi Technologies Corporation Systems and methods for interacting with advanced displays provided by an interactive media guidance application
JP5309448B2 (ja) * 2007-01-26 2013-10-09 ソニー株式会社 表示装置、表示方法
CN102246121B (zh) * 2008-12-25 2016-01-13 松下知识产权经营株式会社 信息显示装置和信息显示方法
JP5654284B2 (ja) * 2010-08-09 2015-01-14 東芝アルパイン・オートモティブテクノロジー株式会社 車両用ディスプレイ装置
JP5391224B2 (ja) * 2011-03-28 2014-01-15 日本電信電話株式会社 映像付加情報表示制御装置およびその動作方法
WO2012154620A2 (en) * 2011-05-06 2012-11-15 Magic Leap, Inc. Massive simultaneous remote digital presence world
WO2013049248A2 (en) * 2011-09-26 2013-04-04 Osterhout Group, Inc. Video display modification based on sensor input for a see-through near-to-eye display
US9389420B2 (en) * 2012-06-14 2016-07-12 Qualcomm Incorporated User interface interaction for transparent head-mounted displays
US9219901B2 (en) * 2012-06-19 2015-12-22 Qualcomm Incorporated Reactive user interface for head-mounted display
JP5665140B2 (ja) * 2012-08-17 2015-02-04 Ｎｅｃソリューションイノベータ株式会社 入力装置、入力方法、及びプログラム
JP6364735B2 (ja) * 2013-10-04 2018-08-01 セイコーエプソン株式会社 表示装置、頭部装着型表示装置、表示装置の制御方法、および、頭部装着型表示装置の制御方法
US9996150B2 (en) * 2012-12-19 2018-06-12 Qualcomm Incorporated Enabling augmented reality using eye gaze tracking
JP6089705B2 (ja) * 2013-01-07 2017-03-08 セイコーエプソン株式会社 表示装置、および、表示装置の制御方法
US9395543B2 (en) * 2013-01-12 2016-07-19 Microsoft Technology Licensing, Llc Wearable behavior-based vision system
JP6375591B2 (ja) * 2013-01-15 2018-08-22 セイコーエプソン株式会社 頭部装着型表示装置、頭部装着型表示装置の制御方法、および、画像表示システム
JP2014164537A (ja) * 2013-02-26 2014-09-08 Yasuaki Iwai 仮想現実サービス提供システム、仮想現実サービス提供方法
CN105229584A (zh) * 2013-05-29 2016-01-06 三菱电机株式会社 信息显示装置
US9908048B2 (en) * 2013-06-08 2018-03-06 Sony Interactive Entertainment Inc. Systems and methods for transitioning between transparent mode and non-transparent mode in a head mounted display
US9329682B2 (en) * 2013-06-18 2016-05-03 Microsoft Technology Licensing, Llc Multi-step virtual object selection
JP5983547B2 (ja) * 2013-07-02 2016-08-31 株式会社デンソー ヘッドアップディスプレイ及びプログラム
JP6209906B2 (ja) * 2013-09-05 2017-10-11 セイコーエプソン株式会社 頭部装着型表示装置、頭部装着型表示装置を制御する方法、画像表示システム
JP6039525B2 (ja) * 2013-09-27 2016-12-07 株式会社トヨタマップマスター ヘッドマウントディスプレイ及びその制御方法、並びにヘッドマウントディスプレイを制御するためのコンピュータプログラム及びコンピュータプログラムを記録した記録媒体
US9630105B2 (en) * 2013-09-30 2017-04-25 Sony Interactive Entertainment Inc. Camera based safety mechanisms for users of head mounted displays
JP6079614B2 (ja) * 2013-12-19 2017-02-15 ソニー株式会社 画像表示装置及び画像表示方法
EP3098689B1 (en) * 2014-01-23 2019-04-03 Sony Corporation Image display device and image display method
US9552060B2 (en) * 2014-01-28 2017-01-24 Microsoft Technology Licensing, Llc Radial selection by vestibulo-ocular reflex fixation
GB201404732D0 (en) * 2014-03-17 2014-04-30 Sony Comp Entertainment Europe Virtual Reality
CN106663410B (zh) * 2014-04-23 2020-05-12 诺基亚技术有限公司 头戴式显示器上的信息显示
JP6355978B2 (ja) * 2014-06-09 2018-07-11 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
US20160025971A1 (en) * 2014-07-25 2016-01-28 William M. Crow Eyelid movement as user input
JP6476643B2 (ja) * 2014-08-11 2019-03-06 セイコーエプソン株式会社 頭部装着型表示装置、情報システム、頭部装着型表示装置の制御方法、および、コンピュータープログラム
US9798143B2 (en) * 2014-08-11 2017-10-24 Seiko Epson Corporation Head mounted display, information system, control method for head mounted display, and computer program

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20220033223A (ko) * 2020-09-09 2022-03-16 한양대학교 산학협력단 안구 기반 개인화 헤드 마운티드 디스플레이 장치 및 그 제어 방법
US12058392B2 (en) 2020-09-21 2024-08-06 Samsung Electronics Co., Ltd. Method and device for transmitting video content by using edge computing service
KR20220148893A (ko) * 2020-12-14 2022-11-07 구글 엘엘씨 가변 밝기 및 시야 디스플레이
WO2024136381A1 (ko) * 2022-12-20 2024-06-27 삼성전자주식회사 시각적 객체를 표시하기 위한 웨어러블 장치 및 그 방법
WO2025100571A1 (ko) * 2023-11-07 2025-05-15 고큐바테크놀로지 주식회사 시선 트레킹 적용된 혼합 현실 기반의 상지 재활 디지털 치료 장치

Also Published As

Publication number Publication date
JP2020120411A (ja) 2020-08-06
WO2017189699A1 (en) 2017-11-02
KR102762521B1 (ko) 2025-02-03
KR20240096647A (ko) 2024-06-26
JP7286828B2 (ja) 2023-06-05
JP2023116433A (ja) 2023-08-22
JP2019515361A (ja) 2019-06-06
JP2022078113A (ja) 2022-05-24
CA2999057C (en) 2023-12-05
EP3650994A1 (en) 2020-05-13
JP7623418B2 (ja) 2025-01-28
JP2025061720A (ja) 2025-04-11
CA2999057A1 (en) 2017-11-02
JP2020120410A (ja) 2020-08-06
JP6968800B2 (ja) 2021-11-17
EP3457251A1 (en) 2019-03-20
JP7028909B2 (ja) 2022-03-02
JP7027478B2 (ja) 2022-03-01
AU2017255567A1 (en) 2018-07-12
KR102673480B1 (ko) 2024-06-07
KR20230044556A (ko) 2023-04-04
KR20250020731A (ko) 2025-02-11
EP3377962A1 (en) 2018-09-26

Similar Documents

Publication Publication Date Title
US12050724B2 (en) Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment
US9851792B2 (en) Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment
JP7286828B2 (ja) 仮想現実環境を表示するヘッドアップディスプレイ上に付加的コンテンツを表示するための方法およびシステム
US9229616B2 (en) Methods and systems for arranging media objects on a display screen to compensate for user disabilities
US12294765B2 (en) Augmented reality content recommendation
JP2020120411A5 (enExample)
JP2020120410A5 (enExample)

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20180629

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
AMND Amendment
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20200424

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20211214

Patent event code: PE09021S01D

AMND Amendment
E601 Decision to refuse application
PE0601 Decision on rejection of patent

Patent event date: 20220725

Comment text: Decision to Refuse Application

Patent event code: PE06012S01D

Patent event date: 20211214

Comment text: Notification of reason for refusal

Patent event code: PE06011S01I

X091 Application refused [patent]
AMND Amendment
PX0901 Re-examination

Patent event code: PX09011S01I

Patent event date: 20220725

Comment text: Decision to Refuse Application

Patent event code: PX09012R01I

Patent event date: 20220314

Comment text: Amendment to Specification, etc.

Patent event code: PX09012R01I

Patent event date: 20200424

Comment text: Amendment to Specification, etc.

PX0601 Decision of rejection after re-examination

Comment text: Decision to Refuse Application

Patent event code: PX06014S01D

Patent event date: 20221222

Comment text: Amendment to Specification, etc.

Patent event code: PX06012R01I

Patent event date: 20221125

Comment text: Decision to Refuse Application

Patent event code: PX06011S01I

Patent event date: 20220725

Comment text: Amendment to Specification, etc.

Patent event code: PX06012R01I

Patent event date: 20220314

Comment text: Notification of reason for refusal

Patent event code: PX06013S01I

Patent event date: 20211214

Comment text: Amendment to Specification, etc.

Patent event code: PX06012R01I

Patent event date: 20200424

X601 Decision of rejection after re-examination