US9182599B2 - Head mounted display - Google Patents

Head mounted display Download PDF

Info

Publication number
US9182599B2
US9182599B2 US14/296,562 US201414296562A US9182599B2 US 9182599 B2 US9182599 B2 US 9182599B2 US 201414296562 A US201414296562 A US 201414296562A US 9182599 B2 US9182599 B2 US 9182599B2
Authority
US
United States
Prior art keywords
mounted display
head
processing circuit
screen
display according
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US14/296,562
Other languages
English (en)
Other versions
US20150268470A1 (en
Inventor
Wen-Chu Yang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Quanta Computer Inc
Original Assignee
Quanta Computer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Quanta Computer Inc filed Critical Quanta Computer Inc
Assigned to QUANTA COMPUTER INC. reassignment QUANTA COMPUTER INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YANG, WEN-CHU
Publication of US20150268470A1 publication Critical patent/US20150268470A1/en
Application granted granted Critical
Publication of US9182599B2 publication Critical patent/US9182599B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Definitions

  • the invention relates in general to an electronic apparatus and more particularly to a head mounted display (HMD).
  • HMD head mounted display
  • an optical see-through head mounted display is provided.
  • the head mounted display apparatus has a CRT or LCD disposed in front of each eye.
  • the head mounted display apparatus projects the images outputted by respective CRT or LCD onto the user's retinas through beam splitters and creates a 3D effect by using the parallax between the user's two eyes.
  • the invention is directed to a head mounted display (HMD).
  • HMD head mounted display
  • a head mounted display comprising a screen, a processing circuit and an eyeglass frame.
  • the screen displays a coded data associated with an exchange information.
  • the processing circuit outputs the coded data to the screen.
  • the eyeglass frame carries the screen and the processing circuit.
  • FIG. 1 is a configuration diagram of a head-mounted display according to a first embodiment.
  • FIG. 2 is an appearance diagram of a head-mounted display according to a first embodiment.
  • FIG. 3 is a flowchart of generating a sample data according to the coded data.
  • FIG. 4 is a flowchart of displaying an exchange information according to the facial image.
  • FIG. 5 is a configuration diagram of a head-mounted display according to a second embodiment.
  • FIG. 6 is a configuration diagram of a head-mounted display according to a third embodiment.
  • FIG. 7 is a configuration diagram of a head-mounted display according to a fourth embodiment.
  • FIG. 8 is an appearance diagram of a head-mounted display according to a fifth embodiment.
  • FIG. 9 is an appearance diagram of a head-mounted display according to a sixth embodiment.
  • FIG. 10 is an appearance diagram of a head-mounted display according to a seventh embodiment.
  • FIG. 1 is a configuration diagram of a head-mounted display according to a first embodiment.
  • FIG. 2 is an appearance diagram of a head-mounted display according to a first embodiment.
  • the HMD 1 a comprises a screen 11 a , a processing circuit 12 a , an eyeglass frame 13 , an image capturing device 14 , an image capturing device 15 , a projection unit 16 , an infra-red LED 17 and a database 18 .
  • the eyeglass frame 13 carries the screen 11 a , the processing circuit 12 a , the image capturing device 14 , the image capturing device 15 , the projection unit 16 , the infra-red LED 17 and the database 18 .
  • the eyeglass frame 13 comprises a frame 131 and handles 132 and 133 .
  • the frame 131 is located between the handles 132 and 133 , and the screen 11 a is disposed at the center of the frame 131 .
  • the screen 11 a displays a coded data CD 1 associated with the user's exchange information. Based on the different natures of social occasions, the user may decide which the exchange information to open.
  • the exchange information is such as the user's hobbies, blog website, Facebook account, e-mail address, occupation, sharing of gourmet and travel experiences, research topics and thesis.
  • the coded data CD 1 can be realized by a two-dimensional matrix barcode such as a QR code, a micro QR code, a data matrix or an Aztec code.
  • the processing circuit 12 a outputs the coded data CD 1 to the screen 11 a .
  • the image capturing device 14 captures a coded data CD 2 displayed on the screen of someone's HMD and the facial image FA 2 associated with the coded data CD 2 .
  • the coded data CD 2 can be realized by a two-dimensional matrix barcode such as a QR code, a micro QR code, a data matrix or an Aztec code.
  • the processing circuit 12 a can activate the infra-red LED 17 to provide an auxiliary light source to the image capturing device 14 .
  • the database 18 stores sample data TD 1 ⁇ TDN.
  • the processing circuit 12 a generates someone's exchange information SC 2 according to the coded data CD 2 and generates the sample data TD 2 according to the exchange information SC 2 .
  • the projection unit 16 projects someone's exchange information SC 2 to the user's eyes.
  • the processing circuit 12 a comprises an application specific integrated circuit (ASIC) 121 and an application processor 122 .
  • the ASIC 121 is connected to the application processor 122 and communicates with the application processor 122 through a universal serial bus (USB).
  • the ASIC 121 is connected to the infra-red LED 17 and communicates with the infra-red LED 17 through a general purpose input output (GPIO).
  • the ASIC 121 is connected to the image capturing device 14 and communicates with the image capturing device 14 through a mobile industry processor interface (MIPI) or a parallel I/F.
  • MIPI mobile industry processor interface
  • the ASIC 121 is connected to the screen 11 a and communicates with the screen 11 a through the display I/F.
  • the application processor 122 is connected to the image capturing device 15 and communicates with the image capturing device 15 through the mobile industry processor interface (MIPI).
  • the image capturing device 15 can be realized by such as a video camera.
  • the application processor 122 is connected to the projection unit 16 and communicates with the projection unit 16 through the display I/F.
  • the eyeglass frame 13 comprises a frame 131 and handles 132 and 133 .
  • the frame 131 is located between the handles 132 and 133 and the screen 11 a is disposed at the center of the frame 131 .
  • FIG. 3 is a flowchart of generating a sample data according to the coded data.
  • the method begins at step 301 , the image capturing device 14 captures a coded data CD 2 displayed on the screen of someone's HMD.
  • the coded data CD 2 is a QR code
  • the position detection pattern of the QR code will help the processing circuit 12 a to identify a facial image in subsequent processing.
  • the method proceeds to step 302 , the processing circuit 12 a generates someone's exchange information SC 2 according to the coded data CD 2 and the image capturing device 14 captures a facial image FA 2 associated with the coded data CD 2 .
  • the method proceeds to step 303 , the processing circuit 12 a generates someone's exchange information SC 2 according to the coded data CD 2 and extracts a facial feature FE 2 of the facial image FA 2 .
  • the facial image FA 2 corresponds to the exchange information SC 2 .
  • the method proceeds to step 304 , the projection unit 16 projects the exchange information SC 2 to the user's eyes and the processing circuit 12 a generates a sample data TD 2 and further stores the sample data TD 2 to the database 18 .
  • the sample data TD 1 and the sample data TD 3 ⁇ TDN can also be generated through the above procedures.
  • the sample data TD 1 ⁇ TDN can have different implementations.
  • the processing circuit 12 a generates the sample data TD 2 according to the exchange information SC 2 and the facial image FA 2 and the sample data TD 2 is such as a combination of the exchange information SC 2 and the facial image FA 2 .
  • the processing circuit 12 a generates the sample data TD 2 according to the exchange information SC 2 and the facial feature FE 2 and the sample data TD 2 is such as a combination of the exchange information SC 2 and the facial feature FE 2 .
  • the processing circuit 12 a generates the sample data TD 2 according to the exchange information SC 2 , the facial image FA 2 and the facial feature FE 2 and the sample data TD 2 is such as a combination of the exchange information SC 2 , the facial image FA 2 and the facial feature FE 2 .
  • FIG. 4 is a flowchart of displaying an exchange information according to the facial image.
  • the method begins at step 401 , the image capturing device 14 captures a facial image FA 3 .
  • the method proceeds to step 402 , the processing circuit 12 a extracts a facial feature FE 3 of the facial image FA 3 .
  • the method proceeds to step 403 , the processing circuit 12 a judges whether the facial image FA 3 matches one of the sample data TD 1 ⁇ TDN stored in the database 12 .
  • the processing circuit 12 a calculates an Euclidean distance according to the facial features of the sample data TD 1 ⁇ TDN and the facial feature FE 3 of the facial image FA 3 .
  • the Euclidean distance between the facial feature FE 2 and the facial feature FE 3 is the smallest and the Euclidean distance is smaller than a threshold, this implies that the facial image FA 3 matches the sample data TD 2 .
  • the method proceeds to step 404 , the processing circuit 12 a controls the projection unit 16 to project the exchange information SC 2 . Conversely, when the facial image FA 3 does not match the sample data TD 2 , the method proceeds to step 405 , the processing circuit 12 a adds a sample data TDM to the database 18 .
  • the sample data TDM can have different implementations. For example, the processing circuit 12 a generates the sample data TDM according to the facial feature FE 3 and the user's annotations and the user can edit the annotations according to the facial image FA 3 .
  • the sample data TDM is such as a combination of the facial image FA 3 and the facial feature FE 3 .
  • the processing circuit 12 a generates the sample data TDM according to the facial image FA 3 , the facial feature FE 3 and the user's annotations.
  • the sample data TDM is such as a combination of the facial image FA 3 , the facial feature FE 3 and the user's annotations.
  • FIG. 5 is a configuration diagram of a head-mounted display according to a second embodiment.
  • the HMD 1 b is different from the HMD 1 a mainly in that the screen 11 a of the HMD 1 b is connected to the application processor 122 rather than the ASIC 121 of the processing circuit 12 b.
  • FIG. 6 is a configuration diagram of a head-mounted display according to a third embodiment.
  • the HMD 1 c is different from the HMD 1 a mainly in that the infra-red LED 17 and the image capturing device 14 of the HMD 1 c are connected to the application processor 122 rather than the ASIC 121 of the processing circuit 12 c.
  • FIG. 7 is a configuration diagram of a head-mounted display according to a fourth embodiment.
  • the HMD 1 d is different from the HMD 1 a mainly in that the processing circuit 12 d of the HMD 1 d does not comprise an ASIC 121 .
  • the screen 11 a , the infra-red LED 17 and the image capturing device 14 of the HMD 1 d are connected to the application processor 122 .
  • FIG. 8 is an appearance diagram of a head-mounted display according to a fifth embodiment.
  • the HMD 1 e is different from the HMD 1 a mainly in that the screen 11 a of the HMD 1 e is disposed on the handle 132 rather than the frame 131 .
  • FIG. 9 is an appearance diagram of a head-mounted display according to a sixth embodiment.
  • the HMD 1 f is different from the HMD 1 e mainly in that the HMD 1 f further comprises a screen 11 b disposed on the handle 132 .
  • the screen 11 a and the screen 11 b can display the same or different coded data.
  • the coded data displayed on the screen 11 a and the screen 11 b are associated with the user's exchange information. That is, when the exchange information that the user wants to share cannot be compressed as one coded data, the exchange information can be compressed as two coded data: one is displayed on the screen 11 a and the other one is displayed on the screen 11 b.
  • FIG. 10 is an appearance diagram of a head-mounted display according to a seventh embodiment.
  • the HMD 1 g is different from the HMD 1 a mainly in that the HMD 1 g further comprises a screen 11 b and a screen 11 c .
  • the screen 11 b is disposed on the handle 132 and the screen 11 c is disposed on the handle 133 .
  • the screen 11 a , the screen 11 b and the screen 11 c can display the same or different coded data.
  • the coded data displayed on the screen 11 a , the screen 11 b and the screen 11 c are associated with the user's exchange information. That is, when the exchange information that the user wants to share cannot be compressed as one coded data, the exchange information can be compressed as three coded data: one is displayed on the screen 11 a , another one is displayed on the screen 11 b and the remaining one is displayed on the screen 11 c.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
US14/296,562 2014-03-21 2014-06-05 Head mounted display Expired - Fee Related US9182599B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
TW103110647 2014-03-21
TW103110647A TW201537219A (zh) 2014-03-21 2014-03-21 頭戴式顯示裝置
TW103110647A 2014-03-21

Publications (2)

Publication Number Publication Date
US20150268470A1 US20150268470A1 (en) 2015-09-24
US9182599B2 true US9182599B2 (en) 2015-11-10

Family

ID=54119338

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/296,562 Expired - Fee Related US9182599B2 (en) 2014-03-21 2014-06-05 Head mounted display

Country Status (3)

Country Link
US (1) US9182599B2 (zh)
CN (1) CN104932101A (zh)
TW (1) TW201537219A (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10714055B1 (en) * 2018-06-14 2020-07-14 Facebook Technologies, Llc Systems and methods for display synchronization in head-mounted display devices

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9746101B2 (en) * 2015-05-22 2017-08-29 Dresser, Inc. Valve positioner communication method utilizing two-dimensional graphical display
US10099122B2 (en) * 2016-03-30 2018-10-16 Sony Interactive Entertainment Inc. Head-mounted display tracking
US11250266B2 (en) 2019-08-09 2022-02-15 Clearview Ai, Inc. Methods for providing information about a person based on facial recognition

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020171605A1 (en) * 2001-05-18 2002-11-21 Samsung Electronics Co., Ltd. Head mounted display
US20090037477A1 (en) * 2007-07-31 2009-02-05 Hyun-Bo Choi Portable terminal and image information managing method therefor
US20120200595A1 (en) * 2007-04-02 2012-08-09 Esight Corporation Apparatus and method for augmenting sight
US20120321059A1 (en) * 2011-06-20 2012-12-20 Avaya Inc. Methods and systems for monitoring contact center operations
US20130222334A1 (en) * 2011-10-28 2013-08-29 Sony Mobile Communications Japan, Inc. Information processing apparatus
TW201346333A (zh) 2012-03-30 2013-11-16 Google Inc 具有輸入與輸出結構的可戴式裝置
US20140071539A1 (en) * 2012-09-11 2014-03-13 Magic Leap, Inc. Ergonomic head mounted display device and optical system
US20150088625A1 (en) * 2012-01-30 2015-03-26 Nokia Corporation Method, an apparatus and a computer program for promoting the apparatus

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020171605A1 (en) * 2001-05-18 2002-11-21 Samsung Electronics Co., Ltd. Head mounted display
US20120200595A1 (en) * 2007-04-02 2012-08-09 Esight Corporation Apparatus and method for augmenting sight
US20090037477A1 (en) * 2007-07-31 2009-02-05 Hyun-Bo Choi Portable terminal and image information managing method therefor
US20120321059A1 (en) * 2011-06-20 2012-12-20 Avaya Inc. Methods and systems for monitoring contact center operations
US20130222334A1 (en) * 2011-10-28 2013-08-29 Sony Mobile Communications Japan, Inc. Information processing apparatus
US20150088625A1 (en) * 2012-01-30 2015-03-26 Nokia Corporation Method, an apparatus and a computer program for promoting the apparatus
TW201346333A (zh) 2012-03-30 2013-11-16 Google Inc 具有輸入與輸出結構的可戴式裝置
US20140071539A1 (en) * 2012-09-11 2014-03-13 Magic Leap, Inc. Ergonomic head mounted display device and optical system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Taiwanese Office Action dated May 25, 2015.

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10714055B1 (en) * 2018-06-14 2020-07-14 Facebook Technologies, Llc Systems and methods for display synchronization in head-mounted display devices

Also Published As

Publication number Publication date
CN104932101A (zh) 2015-09-23
TW201537219A (zh) 2015-10-01
US20150268470A1 (en) 2015-09-24

Similar Documents

Publication Publication Date Title
US11353707B2 (en) Method and apparatus for processing screen using device
US9262780B2 (en) Method and apparatus for enabling real-time product and vendor identification
CN107111863B (zh) 角膜成像的设备和方法
JP2021500690A5 (zh)
WO2011132373A1 (en) Image processing device, image processing method and program
US8996974B2 (en) Enhancing video presentation systems
US11302086B1 (en) Providing features of an electronic product in an augmented reality environment
US9182599B2 (en) Head mounted display
WO2013169237A1 (en) Eye tracking based selective accentuation of portions of a display
US20160025983A1 (en) Computer display device mounted on eyeglasses
TWI608428B (zh) 利用影像辨識產生相對應資訊之影像處理系統及其相關方法
KR20160015972A (ko) 웨어러블 디바이스 및 그 제어 방법
CN103913842A (zh) 显示装置以及显示装置的控制方法
Le et al. MirrorTablet: exploring a low-cost mobile system for capturing unmediated hand gestures in remote collaboration
GB201200898D0 (en) Head-mounted system for image pick-up, analysis and display and display method
US9424555B2 (en) Virtual conferencing system
US20190005546A1 (en) Augmented reality advertisements on objects
US10783666B2 (en) Color analysis and control using an electronic mobile device transparent display screen integral with the use of augmented reality glasses
US10699374B2 (en) Lens contribution-based virtual reality display rendering
US11972505B2 (en) Augmented image overlay on external panel
CN107133028B (zh) 一种信息处理方法及电子设备
CN113673277B (zh) 线上绘本内容的获取方法、装置以及智能屏设备
TWM480729U (zh) 整合有電子設備並用於顯示2d擴增實境之擴增實境系統
JP2012181328A (ja) 広告配信システム、広告配信装置、広告配信方法、及びプログラム
US20210097754A1 (en) Virtual display monitors

Legal Events

Date Code Title Description
AS Assignment

Owner name: QUANTA COMPUTER INC., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YANG, WEN-CHU;REEL/FRAME:033034/0481

Effective date: 20140603

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20231110