JP5978592B2 - ヘッド・マウント・ディスプレイ及び表示制御方法 - Google Patents

ヘッド・マウント・ディスプレイ及び表示制御方法 Download PDF

Info

Publication number
JP5978592B2
JP5978592B2 JP2011235171A JP2011235171A JP5978592B2 JP 5978592 B2 JP5978592 B2 JP 5978592B2 JP 2011235171 A JP2011235171 A JP 2011235171A JP 2011235171 A JP2011235171 A JP 2011235171A JP 5978592 B2 JP5978592 B2 JP 5978592B2
Authority
JP
Japan
Prior art keywords
user
display
touch sensor
head
mounted display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2011235171A
Other languages
English (en)
Japanese (ja)
Other versions
JP2013093768A (ja
JP2013093768A5 (enExample
Inventor
山本　正晃
正晃 山本
楢原　立也
立也 楢原
将之 清水
将之 清水
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to JP2011235171A priority Critical patent/JP5978592B2/ja
Priority to EP12188864.8A priority patent/EP2587300B1/en
Priority to US13/655,824 priority patent/US9341847B2/en
Priority to CN201210401222.5A priority patent/CN103076678B/zh
Publication of JP2013093768A publication Critical patent/JP2013093768A/ja
Publication of JP2013093768A5 publication Critical patent/JP2013093768A5/ja
Priority to US15/071,407 priority patent/US9495029B2/en
Application granted granted Critical
Publication of JP5978592B2 publication Critical patent/JP5978592B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G06F3/04895—Guidance during keyboard input operation, e.g. prompting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G06F3/04897—Special input arrangements or commands for improving display capability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/398—Synchronisation thereof; Control thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2011235171A 2011-10-26 2011-10-26 ヘッド・マウント・ディスプレイ及び表示制御方法 Active JP5978592B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2011235171A JP5978592B2 (ja) 2011-10-26 2011-10-26 ヘッド・マウント・ディスプレイ及び表示制御方法
EP12188864.8A EP2587300B1 (en) 2011-10-26 2012-10-17 Head mount display and display control method
US13/655,824 US9341847B2 (en) 2011-10-26 2012-10-19 Head mount display and display control method
CN201210401222.5A CN103076678B (zh) 2011-10-26 2012-10-19 头戴式显示器和显示控制方法
US15/071,407 US9495029B2 (en) 2011-10-26 2016-03-16 Head mount display and display control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2011235171A JP5978592B2 (ja) 2011-10-26 2011-10-26 ヘッド・マウント・ディスプレイ及び表示制御方法

Publications (3)

Publication Number Publication Date
JP2013093768A JP2013093768A (ja) 2013-05-16
JP2013093768A5 JP2013093768A5 (enExample) 2014-11-13
JP5978592B2 true JP5978592B2 (ja) 2016-08-24

Family

ID=47080326

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2011235171A Active JP5978592B2 (ja) 2011-10-26 2011-10-26 ヘッド・マウント・ディスプレイ及び表示制御方法

Country Status (4)

Country Link
US (2) US9341847B2 (enExample)
EP (1) EP2587300B1 (enExample)
JP (1) JP5978592B2 (enExample)
CN (1) CN103076678B (enExample)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5958689B2 (ja) * 2012-03-22 2016-08-02 セイコーエプソン株式会社 頭部装着型表示装置
KR101509169B1 (ko) * 2013-05-07 2015-04-07 배영식 헤드 마운트 디스플레이
EP3001406A4 (en) * 2013-05-21 2017-01-25 Sony Corporation Display control device, display control method, and recording medium
US9563331B2 (en) * 2013-06-28 2017-02-07 Microsoft Technology Licensing, Llc Web-like hierarchical menu display configuration for a near-eye display
CN103336579A (zh) * 2013-07-05 2013-10-02 百度在线网络技术（北京）有限公司 穿戴式设备的输入方法和穿戴式设备
US9298298B2 (en) 2013-12-18 2016-03-29 Microsoft Technology Licensing, Llc Wearable display input system
DE102014006776A1 (de) * 2014-05-08 2015-11-12 Audi Ag Bedienvorrichtung für ein elektronisches Gerät
CN106686364B (zh) * 2014-07-09 2019-02-15 歌尔科技有限公司 一种头戴式可视设备和视频系统
JP6340301B2 (ja) 2014-10-22 2018-06-06 株式会社ソニー・インタラクティブエンタテインメント ヘッドマウントディスプレイ、携帯情報端末、画像処理装置、表示制御プログラム、表示制御方法、及び表示システム
CN104503584A (zh) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 一种触控式头戴显示器
CN104503585A (zh) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 触控式头戴显示器
CN106155383A (zh) * 2015-04-03 2016-11-23 上海乐相科技有限公司 一种头戴式智能眼镜屏幕控制方法及装置
EP3096212B1 (en) * 2015-05-18 2020-01-01 DreamWorks Animation LLC Method and system for calibrating a virtual reality system
KR20180084901A (ko) * 2015-12-30 2018-07-25 선전 로욜 테크놀로지스 컴퍼니 리미티드 헤드 장착형 디스플레이 디바이스 및 이의 제어 방법
EP3399388A4 (en) * 2015-12-30 2019-09-04 Shenzhen Royole Technologies Co. Ltd. HEAD-MOUNTED DISPLAY DEVICE, HEAD-MOUNTED DISPLAY SYSTEM AND INPUT METHOD
CN106970734B (zh) * 2016-01-13 2020-12-18 阿里巴巴集团控股有限公司 一种显示设备的任务启动方法和装置
CN106502323A (zh) * 2016-10-20 2017-03-15 精元电脑股份有限公司 能叠加虚拟键盘的显示装置
CN109144378B (zh) * 2017-06-19 2023-07-07 中兴通讯股份有限公司 数据交互方法、装置、头戴设备和控制设备
US10304207B2 (en) 2017-07-07 2019-05-28 Samsung Electronics Co., Ltd. System and method for optical tracking
CN107526479B (zh) * 2017-09-20 2020-08-04 浙江大华技术股份有限公司 一种传感器采集的环境量的显示方法、装置及系统
CN110491322B (zh) * 2018-05-15 2022-11-29 瑞昱半导体股份有限公司 荧幕显示驱动电路以及控制方法
CN110652190B (zh) * 2018-06-29 2022-12-06 浙江绍兴苏泊尔生活电器有限公司 烹饪菜单的显示方法和装置、烹饪器具
US11550446B2 (en) 2020-04-06 2023-01-10 Samsung Electronics Co., Ltd. Systems and methods for viewing webpages in extended reality environments
CN117561497A (zh) * 2021-05-19 2024-02-13 斯纳普公司 用于增强现实显示设备的触摸板输入
KR102766471B1 (ko) 2021-05-19 2025-02-12 스냅 인코포레이티드 증강 현실 디스플레이 디바이스를 위한 터치패드 입력
US11561612B1 (en) * 2021-08-10 2023-01-24 Synaptics Incorporated AR/VR navigation with authentication using an integrated scrollwheel and fingerprint sensor user input apparatus
CN114201104B (zh) * 2021-12-13 2025-01-03 杭州灵伴科技有限公司 虚拟应用界面更新方法、头戴式显示设备组件和介质

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5579026A (en) * 1993-05-14 1996-11-26 Olympus Optical Co., Ltd. Image display apparatus of head mounted type
US6046712A (en) * 1996-07-23 2000-04-04 Telxon Corporation Head mounted communication system for providing interactive visual communications with a remote system
JP2001133724A (ja) 1999-08-25 2001-05-18 Olympus Optical Co Ltd 頭部装着型映像表示装置
JP2002189441A (ja) 2000-10-11 2002-07-05 Olympus Optical Co Ltd 頭部装着型映像表示装置
JP3714606B2 (ja) 2001-07-25 2005-11-09 シャープ株式会社 ヘッドマウントディスプレイ装置
JP2003098471A (ja) 2001-09-25 2003-04-03 Olympus Optical Co Ltd 頭部装着型映像表示装置
TWI238348B (en) * 2002-05-13 2005-08-21 Kyocera Corp Portable information terminal, display control device, display control method, and recording media
JP2004213355A (ja) * 2002-12-27 2004-07-29 Canon Inc 情報処理方法
JP2004295159A (ja) * 2003-02-07 2004-10-21 Sony Corp アイコン表示システム、アイコン表示方法、電子機器装置およびコンピュータプログラム
JP4344568B2 (ja) 2003-09-05 2009-10-14 富士フイルム株式会社 ヘッドマウントディスプレイ及びそのコンテンツ再生方法
JP2007310599A (ja) * 2006-05-17 2007-11-29 Nikon Corp 映像表示装置
US8605008B1 (en) * 2007-05-04 2013-12-10 Apple Inc. Head-mounted display
US8933876B2 (en) * 2010-12-13 2015-01-13 Apple Inc. Three dimensional user interface session control
JP2009171505A (ja) * 2008-01-21 2009-07-30 Nikon Corp ヘッドマウントディスプレイ
US9030418B2 (en) * 2008-06-24 2015-05-12 Lg Electronics Inc. Mobile terminal capable of sensing proximity touch
JP4636164B2 (ja) * 2008-10-23 2011-02-23 ソニー株式会社 頭部装着型ディスプレイ
US20110221776A1 (en) * 2008-12-04 2011-09-15 Mitsuo Shimotani Display input device and navigation device
HU0900696D0 (en) * 2009-11-05 2009-12-28 Holakovszky Laszlo Binocular display device
WO2011097564A1 (en) * 2010-02-05 2011-08-11 Kopin Corporation Touch sensor for controlling eyewear
WO2011106797A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
US20110214082A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
JP2011180843A (ja) * 2010-03-01 2011-09-15 Sony Corp 情報処理装置、情報処理方法、およびプログラム
KR101685343B1 (ko) * 2010-06-01 2016-12-12 엘지전자 주식회사 영상표시장치 및 그 동작방법
JP2011235171A (ja) 2011-07-29 2011-11-24 Sammy Corp 遊技機、及びシミュレーションプログラム
US8941560B2 (en) * 2011-09-21 2015-01-27 Google Inc. Wearable computer with superimposed controls and instructions for external device

Also Published As

Publication number Publication date
CN103076678B (zh) 2017-10-20
US9341847B2 (en) 2016-05-17
US9495029B2 (en) 2016-11-15
EP2587300A1 (en) 2013-05-01
US20130285884A1 (en) 2013-10-31
JP2013093768A (ja) 2013-05-16
EP2587300B1 (en) 2021-05-19
US20160195952A1 (en) 2016-07-07
CN103076678A (zh) 2013-05-01

Similar Documents

Publication Publication Date Title
JP5978592B2 (ja) ヘッド・マウント・ディスプレイ及び表示制御方法
JP5953963B2 (ja) 頭部装着型映像表示装置
JP5923926B2 (ja) ヘッド・マウント・ディスプレイ及びヘッド・マウント・ディスプレイの制御方法
CN104423583B (zh) 头部佩戴型显示装置、图像显示系统及信息处理装置
US10692300B2 (en) Information processing apparatus, information processing method, and image display system
WO2016017062A1 (en) Information processing for motion sickness prevention in an image display system
US20140198192A1 (en) Display device and display control method
JP6492419B2 (ja) 頭部装着型表示装置、頭部装着型表示装置を制御する方法、コンピュータープログラム、画像表示システム、および、情報処理装置
JP2013050558A (ja) ヘッド・マウント・ディスプレイ及び表示制御方法
JP6229381B2 (ja) 頭部装着型表示装置、頭部装着型表示装置を制御する方法、画像表示システム、情報処理装置
JP5289538B2 (ja) 電子機器、表示制御方法及びプログラム
JP6740613B2 (ja) 表示装置、表示装置の制御方法、及び、プログラム
JP2011085705A (ja) 映像表示装置及び映像表示方法
JP2016167844A (ja) ヘッド・マウント・ディスプレイ及びヘッド・マウント・ディスプレイの制御方法、並びに表示システム及びその制御方法
KR20130070592A (ko) 데이터 전송 시스템
JP2013093664A (ja) 表示システム並びに中継装置
KR20120020784A (ko) 입체영상 디스플레이 장치

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140925

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20140925

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20150610

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20150714

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150716

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160105

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160129

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160628

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160711

R151 Written notification of patent or utility model registration

Ref document number: 5978592

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250