WO2014085757A3 - Head-mounted display resource management - Google Patents

Head-mounted display resource management Download PDF

Info

Publication number
WO2014085757A3
WO2014085757A3 PCT/US2013/072476 US2013072476W WO2014085757A3 WO 2014085757 A3 WO2014085757 A3 WO 2014085757A3 US 2013072476 W US2013072476 W US 2013072476W WO 2014085757 A3 WO2014085757 A3 WO 2014085757A3
Authority
WO
WIPO (PCT)
Prior art keywords
head
resource management
mounted display
power mode
program
Prior art date
Application number
PCT/US2013/072476
Other languages
French (fr)
Other versions
WO2014085757A2 (en
Inventor
Stephen Latta
Jedd Anthony PERRY
Rod G. Fleck
Jack CLEVENGER
Frederik Schaffalitzky
Drew Steedly
Daniel MCCULLOCH
Ian Mcintyre
Alexandru Balan
Ben Sugden
Ryan Hastings
Brian Mount
Original Assignee
Microsoft Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US13/689,379 priority Critical
Priority to US13/689,379 priority patent/US9851787B2/en
Application filed by Microsoft Corporation filed Critical Microsoft Corporation
Publication of WO2014085757A2 publication Critical patent/WO2014085757A2/en
Publication of WO2014085757A3 publication Critical patent/WO2014085757A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 – G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3215Monitoring of peripheral devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 – G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 – G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3265Power saving in display device
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • G02B2027/0174Head mounted characterised by optical features holographic
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/0093Other optical systems; Other optical apparatus with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 – G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/3287Power saving characterised by the action undertaken by switching off individual functional units in the computer system
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing
    • Y02D10/10Reducing energy consumption at the single machine level, e.g. processors, personal computers, peripherals or power supply
    • Y02D10/15Reducing energy consumption at the single machine level, e.g. processors, personal computers, peripherals or power supply acting upon peripherals
    • Y02D10/153Reducing energy consumption at the single machine level, e.g. processors, personal computers, peripherals or power supply acting upon peripherals the peripheral being a display
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing
    • Y02D10/10Reducing energy consumption at the single machine level, e.g. processors, personal computers, peripherals or power supply
    • Y02D10/17Power management
    • Y02D10/171Selective power distribution

Abstract

A system and related methods for a resource management in a head-mounted display device are provided. In one example, the head-mounted display device includes a plurality of sensors and a display system for presenting holographic objects. A resource management program is configured to operate a selected sensor in a default power mode to achieve a selected fidelity. The program receives user-related information from one or more of the sensors, and determines whether target information is detected. Where target information is detected, the program adjusts the selected sensor to operate in a reduced power mode that uses less power than the default power mode.
PCT/US2013/072476 2012-11-29 2013-11-29 Head-mounted display resource management WO2014085757A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/689,379 2012-11-29
US13/689,379 US9851787B2 (en) 2012-11-29 2012-11-29 Display resource management

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR1020157017410A KR20150092226A (en) 2012-11-29 2013-11-29 Head-mounted display resource management
EP13812270.0A EP2926212A2 (en) 2012-11-29 2013-11-29 Head-mounted display resource management
JP2015545482A JP6246829B2 (en) 2012-11-29 2013-11-29 Head-mounted display Resource Management
CN201380062662.5A CN105144022B (en) 2012-11-29 2013-11-29 Head-mounted displays Resource Management

Publications (2)

Publication Number Publication Date
WO2014085757A2 WO2014085757A2 (en) 2014-06-05
WO2014085757A3 true WO2014085757A3 (en) 2014-11-06

Family

ID=49880975

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/072476 WO2014085757A2 (en) 2012-11-29 2013-11-29 Head-mounted display resource management

Country Status (6)

Country Link
US (1) US9851787B2 (en)
EP (1) EP2926212A2 (en)
JP (1) JP6246829B2 (en)
KR (1) KR20150092226A (en)
CN (1) CN105144022B (en)
WO (1) WO2014085757A2 (en)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102906623A (en) 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 Local advertising content on an interactive head-mounted eyepiece
US10180572B2 (en) 2010-02-28 2019-01-15 Microsoft Technology Licensing, Llc AR glasses with event and user action control of external applications
US20140294366A1 (en) * 2013-04-01 2014-10-02 Michael-Ryan FLETCHALL Capture, Processing, And Assembly Of Immersive Experience
US9958681B2 (en) * 2013-10-28 2018-05-01 Lg Electronics Inc. Electronic device and control method thereof
WO2015139002A1 (en) 2014-03-14 2015-09-17 Sony Computer Entertainment Inc. Gaming device with volumetric sensing
CN106255916B (en) * 2014-03-14 2019-08-09 索尼互动娱乐股份有限公司 Track the method and system of head-mounted display (HMD) and the calibration for the adjustment of HMD headband
US20170075406A1 (en) * 2014-04-03 2017-03-16 Sony Corporation Electronic device and recording medium
US9946361B2 (en) 2014-08-14 2018-04-17 Qualcomm Incorporated Management for wearable display
US20160048022A1 (en) * 2014-08-14 2016-02-18 Qualcomm Incorporated Management for wearable display
KR20160026467A (en) * 2014-09-01 2016-03-09 삼성전자주식회사 Electronic device, controlling method thereof and recording medium
JP2016096513A (en) * 2014-11-17 2016-05-26 株式会社ゼンリンデータコム Information processing system, information processing method, and program
WO2016142423A1 (en) * 2015-03-12 2016-09-15 Essilor International (Compagnie Générale d'Optique) A method for customizing a mounted sensing device
WO2017003693A1 (en) * 2015-06-30 2017-01-05 Thomson Licensing Method and apparatus using augmented reality with physical objects to change user states
CN105395252A (en) * 2015-12-10 2016-03-16 哈尔滨工业大学 Wearable three-dimensional image navigation device for vascular intervention operation and realizing man-machine interaction
US20170220119A1 (en) * 2016-02-01 2017-08-03 Lori Ann Potts Object motion tracking with remote device
US20170221225A1 (en) * 2016-02-02 2017-08-03 Samsung Electronics Co., Ltd. Systems and methods for drift correction
AU2017225977A1 (en) * 2016-03-04 2018-09-13 Magic Leap, Inc. Current drain reduction in AR/VR display systems
CN106027802A (en) * 2016-07-06 2016-10-12 捷开通讯(深圳)有限公司 Mobile terminal and parameter setting method thereof
EP3299871A1 (en) * 2016-09-22 2018-03-28 Essilor International A wearing detection module for spectacle frame
US10302482B2 (en) 2016-10-07 2019-05-28 Microsoft Technology Licensing, Llc Dynamic sensor performance adjustment
CN109804220A (en) * 2016-12-06 2019-05-24 美国景书公司 System and method for tracking the fortune dynamic posture on head and eyes
US10302764B2 (en) * 2017-02-03 2019-05-28 Microsoft Technology Licensing, Llc Active illumination management through contextual information

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6124976A (en) * 1998-03-17 2000-09-26 Sony Corporation Voltage controlling method for head mounted display unit and head mounted display apparatus
US6279058B1 (en) * 1998-07-02 2001-08-21 Advanced Micro Devices, Inc. Master isochronous clock structure having a clock controller coupling to a CPU and two data buses
US20020040377A1 (en) * 1998-09-25 2002-04-04 Newman Edward G. Computer with audio interrupt system
US20040175020A1 (en) * 2003-03-05 2004-09-09 Bradski Gary R. Method and apparatus for monitoring human attention in dynamic power management
US20060053011A1 (en) * 2004-09-07 2006-03-09 Lg Electronics Inc. Baseband modem for speech recognition and mobile communication terminal using the same
US20060087502A1 (en) * 2004-10-21 2006-04-27 Karidis John P Apparatus and method for display power saving
US20080068559A1 (en) * 2006-09-20 2008-03-20 Howell Thomas A Eyeglasses with activity monitoring and acoustic dampening
EP2073098A2 (en) * 2007-12-20 2009-06-24 Intel Corporation (a Delaware Corporation) Device, system, and method of power saving using location sensing modules
US8184067B1 (en) * 2011-07-20 2012-05-22 Google Inc. Nose bridge sensor

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001100870A (en) 1999-09-28 2001-04-13 Toshiba Corp Information processor
US6690351B1 (en) * 2000-04-06 2004-02-10 Xybernaut Corporation Computer display optimizer
US6674493B2 (en) 2002-01-02 2004-01-06 Intel Corporation Head mounted display using single display including only one liquid crystal shutter
JP2004312401A (en) 2003-04-08 2004-11-04 Sony Corp Apparatus and method for reproducing
JP2005025563A (en) 2003-07-03 2005-01-27 Canon Inc Virtual reality generation method
US20050198257A1 (en) 2003-12-29 2005-09-08 Gupta Ajay G. Power conservation in wireless devices
JP4373286B2 (en) * 2004-05-06 2009-11-25 オリンパス株式会社 Head-mounted display device
US7565562B2 (en) 2004-09-03 2009-07-21 Intel Corporation Context based power management
US20060103591A1 (en) * 2004-11-15 2006-05-18 Canon Kabushiki Kaisha Information processing apparatus and method for providing observer with information
US20070113207A1 (en) * 2005-11-16 2007-05-17 Hillcrest Laboratories, Inc. Methods and systems for gesture classification in 3D pointing devices
EP2046026A4 (en) 2006-07-25 2010-05-05 Nikon Corp Outputting apparatus and image display apparatus
US8036690B1 (en) 2008-06-04 2011-10-11 Sprint Communciations Company L.P. Download prioritization for intelligent content distribution
US20110075257A1 (en) * 2009-09-14 2011-03-31 The Arizona Board Of Regents On Behalf Of The University Of Arizona 3-Dimensional electro-optical see-through displays
KR101688655B1 (en) * 2009-12-03 2016-12-21 엘지전자 주식회사 Controlling power of devices which is controllable with user's gesture by detecting presence of user
CN103890836B (en) 2010-09-20 2017-03-15 寇平公司 Bluetooth for head-mounted display having a power management or other wireless interface
US9081416B2 (en) 2011-03-24 2015-07-14 Seiko Epson Corporation Device, head mounted display, control method of device and control method of head mounted display
US9217867B2 (en) * 2011-03-24 2015-12-22 Seiko Epson Corporation Head-mounted display device and control method for the head-mounted display device
EP2551784A1 (en) * 2011-07-28 2013-01-30 Roche Diagnostics GmbH Method of controlling the display of a dataset
US8918665B2 (en) * 2011-09-23 2014-12-23 Wing Kong Low Operating input device in low power mode with auxiliary sensor calibrated to main sensor
US8976110B2 (en) * 2011-10-27 2015-03-10 Tobii Technology Ab Power management in an eye-tracking system
US8235529B1 (en) * 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6124976A (en) * 1998-03-17 2000-09-26 Sony Corporation Voltage controlling method for head mounted display unit and head mounted display apparatus
US6279058B1 (en) * 1998-07-02 2001-08-21 Advanced Micro Devices, Inc. Master isochronous clock structure having a clock controller coupling to a CPU and two data buses
US20020040377A1 (en) * 1998-09-25 2002-04-04 Newman Edward G. Computer with audio interrupt system
US20040175020A1 (en) * 2003-03-05 2004-09-09 Bradski Gary R. Method and apparatus for monitoring human attention in dynamic power management
US20060053011A1 (en) * 2004-09-07 2006-03-09 Lg Electronics Inc. Baseband modem for speech recognition and mobile communication terminal using the same
US20060087502A1 (en) * 2004-10-21 2006-04-27 Karidis John P Apparatus and method for display power saving
US20080068559A1 (en) * 2006-09-20 2008-03-20 Howell Thomas A Eyeglasses with activity monitoring and acoustic dampening
EP2073098A2 (en) * 2007-12-20 2009-06-24 Intel Corporation (a Delaware Corporation) Device, system, and method of power saving using location sensing modules
US8184067B1 (en) * 2011-07-20 2012-05-22 Google Inc. Nose bridge sensor

Also Published As

Publication number Publication date
JP6246829B2 (en) 2017-12-13
EP2926212A2 (en) 2015-10-07
WO2014085757A2 (en) 2014-06-05
US9851787B2 (en) 2017-12-26
CN105144022B (en) 2018-06-22
KR20150092226A (en) 2015-08-12
US20140145914A1 (en) 2014-05-29
JP2016502201A (en) 2016-01-21
CN105144022A (en) 2015-12-09

Similar Documents

Publication Publication Date Title
EP3005312A4 (en) Systems and methods for activity determination based on human frame
WO2013169842A3 (en) Device, method, and graphical user interface for selecting object within a group of objects
WO2015127056A3 (en) Smart wearable devices and methods with power consumption and network load optimization
EP2661382A4 (en) Information display system and method
EP2641145A4 (en) Systems and methods for using entered text to access and process contextual information
EP2683471A4 (en) Membrane separation devices, systems and methods employing same, and data management systems and methods
EP3259632A4 (en) See-through computer display systems
WO2012082410A3 (en) Technique for supporting multiple secure enclaves
EP3036675A4 (en) System and method for identity management
EP2622548A4 (en) Dynamic queueing and management system
EP3030879A4 (en) System and methods for monitoring an environment
EP2840968A4 (en) Vein imaging systems and methods
EP3089011A4 (en) Control device, control method, and computer program
EP3172613A4 (en) Compact heads-up display system
EP2583233A4 (en) Contextual based information aggregation system
IL235413D0 (en) Systems and methods for providing mobile security based on dynamic attestation
WO2013190380A3 (en) Device context determination
EP3195106A4 (en) Secure storage and access to sensitive data
EP3054836A4 (en) Fatigue monitoring and management system
IN2014DN08342A (en) Alert directives and focused alert directives in a behavioral recognition system
EP3118700A4 (en) Intelligent home control method and system based on alljoyn technology
GB2500581B (en) Method and system for controlling the output of information to a driver based on an estimated driver workload
IN2012DE00767A (en) "wireless communication device, wireless communication method, program, and wireless communication system"
IN2014DN09254A (en) Deformable display device and method for controlling thereof
EP3044684A4 (en) Malware and exploit campaign detection system and method

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201380062662.5

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13812270

Country of ref document: EP

Kind code of ref document: A2

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase in:

Ref document number: 2015545482

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2013812270

Country of ref document: EP

ENP Entry into the national phase in:

Ref document number: 20157017410

Country of ref document: KR

Kind code of ref document: A