IN2015KN00682A - - Google Patents

Download PDF

Info

Publication number
IN2015KN00682A
IN2015KN00682A IN682KON2015A IN2015KN00682A IN 2015KN00682 A IN2015KN00682 A IN 2015KN00682A IN 682KON2015 A IN682KON2015 A IN 682KON2015A IN 2015KN00682 A IN2015KN00682 A IN 2015KN00682A
Authority
IN
India
Prior art keywords
right eye
user
eye
head mounted
stream
Prior art date
Application number
Inventor
Walter Nistico
Jan Hoffmann
Eberhard Schmidt
Original Assignee
Sensomotoric Instr Ges Für Innovative Sensorik Mbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sensomotoric Instr Ges Für Innovative Sensorik Mbh filed Critical Sensomotoric Instr Ges Für Innovative Sensorik Mbh
Publication of IN2015KN00682A publication Critical patent/IN2015KN00682A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/62—Semi-transparency

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Biomedical Technology (AREA)
  • Dermatology (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Computing Systems (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computer Hardware Design (AREA)
  • Ophthalmology & Optometry (AREA)
  • Public Health (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

The invention relates to a head mounted system (10) comprising a binocular eye tracking system (14a, 14b) comprising at least a first camera (14a) arranged for acquiring a user's left eye (16a) and at least a second camera (14b) arranged for acquiring a user's right eye (16b), a head mounted display (10) comprising a first displaying means (18a) for presenting an image to a user's left eye (16a), a second displaying means (18b) for presenting an image to a user's right eye (16b), a processing unit (24, 24a, 24b) designed to process images from the eye tracking system (14a, 14b) and calculate at least a 3D position of the left (16a) and the right eye (16b) and an orientation vector of the left (16a) and the right eye (16b) and to compute and render a stream of digital images to be projected onto the user's left and right eye (16a, 16b) by means of the head mounted display, wherein the processing unit (24, 24a, 24b) is further designed to consider the 3D position of the left and the right eye (16a, 16b) and the orientation of the left and the right eye (16a, 16b) when computing and rendering the stream of digital images. The invention further relates to a method to compute and render a stream of digital images using a head mounted display.
IN682KON2015 2012-09-03 2013-09-02 IN2015KN00682A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP12182804 2012-09-03
PCT/EP2013/068113 WO2014033306A1 (en) 2012-09-03 2013-09-02 Head mounted system and method to compute and render a stream of digital images using a head mounted system

Publications (1)

Publication Number Publication Date
IN2015KN00682A true IN2015KN00682A (en) 2015-07-17

Family

ID=47008289

Family Applications (1)

Application Number Title Priority Date Filing Date
IN682KON2015 IN2015KN00682A (en) 2012-09-03 2013-09-02

Country Status (6)

Country Link
US (2) US9380287B2 (en)
EP (1) EP2893388B1 (en)
JP (1) JP5887026B2 (en)
CN (1) CN104603673B (en)
IN (1) IN2015KN00682A (en)
WO (1) WO2014033306A1 (en)

Families Citing this family (197)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8810598B2 (en) 2011-04-08 2014-08-19 Nant Holdings Ip, Llc Interference based augmented reality hosting platforms
US9699433B2 (en) * 2013-01-24 2017-07-04 Yuchen Zhou Method and apparatus to produce re-focusable vision with detecting re-focusing event from human eye
US9672627B1 (en) * 2013-05-09 2017-06-06 Amazon Technologies, Inc. Multiple camera based motion tracking
US20140362110A1 (en) * 2013-06-08 2014-12-11 Sony Computer Entertainment Inc. Systems and methods for customizing optical representation of views provided by a head mounted display based on optical prescription of a user
US20150124566A1 (en) 2013-10-04 2015-05-07 Thalmic Labs Inc. Systems, articles and methods for wearable electronic devices employing contact sensors
US11921471B2 (en) 2013-08-16 2024-03-05 Meta Platforms Technologies, Llc Systems, articles, and methods for wearable devices having secondary power sources in links of a band for providing secondary power in addition to a primary power source
US9630631B2 (en) 2013-10-03 2017-04-25 Honda Motor Co., Ltd. System and method for dynamic in-vehicle virtual reality
US9536353B2 (en) 2013-10-03 2017-01-03 Honda Motor Co., Ltd. System and method for dynamic in-vehicle virtual reality
US9547173B2 (en) 2013-10-03 2017-01-17 Honda Motor Co., Ltd. System and method for dynamic in-vehicle virtual reality
US9715764B2 (en) 2013-10-03 2017-07-25 Honda Motor Co., Ltd. System and method for dynamic in-vehicle virtual reality
US10318100B2 (en) * 2013-10-16 2019-06-11 Atheer, Inc. Method and apparatus for addressing obstruction in an interface
US9582516B2 (en) 2013-10-17 2017-02-28 Nant Holdings Ip, Llc Wide area augmented reality location-based services
WO2015081113A1 (en) 2013-11-27 2015-06-04 Cezar Morun Systems, articles, and methods for electromyography sensors
KR20150065336A (en) * 2013-12-05 2015-06-15 삼성전자주식회사 Method, apparatus and computer readable recording medium for recognizing gesture through an electronic device
US20150312558A1 (en) * 2014-04-29 2015-10-29 Quentin Simon Charles Miller Stereoscopic rendering to eye positions
AU2014202500A1 (en) * 2014-05-08 2015-11-26 Canon Kabushiki Kaisha Method, apparatus and system for rendering virtual content
KR102262086B1 (en) * 2014-05-28 2021-06-09 삼성전자 주식회사 Apparatus and method for processing image
WO2016027539A1 (en) * 2014-08-18 2016-02-25 ソニー株式会社 Image display device and display apparatus
US9773350B1 (en) 2014-09-16 2017-09-26 SilVR Thread, Inc. Systems and methods for greater than 360 degree capture for virtual reality
WO2016073986A1 (en) * 2014-11-07 2016-05-12 Eye Labs, LLC Visual stabilization system for head-mounted displays
JP6459421B2 (en) * 2014-11-17 2019-01-30 セイコーエプソン株式会社 Head-mounted display device, method for controlling head-mounted display device, computer program
US9881422B2 (en) * 2014-12-04 2018-01-30 Htc Corporation Virtual reality system and method for controlling operation modes of virtual reality system
KR20170081272A (en) 2014-12-18 2017-07-11 페이스북, 인크. Method, system and device for navigating in a virtual reality environment
US11263794B2 (en) 2015-01-21 2022-03-01 Chengdu Idealsee Technology Co., Ltd. Binocular see-through AR head-mounted display device and information displaying method thereof
EP3062142B1 (en) 2015-02-26 2018-10-03 Nokia Technologies OY Apparatus for a near-eye display
GB2536650A (en) 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
US20160300391A1 (en) * 2015-04-07 2016-10-13 Purdue Research Foundation System and method for reducing simulator sickness
CA2984138A1 (en) * 2015-05-28 2016-12-01 Thalmic Labs Inc. Systems, devices, and methods that integrate eye tracking and scanning laser projection in wearable heads-up displays
CN105242400B (en) * 2015-07-10 2017-12-29 上海鹰为智能科技有限公司 Virtual reality glasses
CN105068658A (en) * 2015-08-19 2015-11-18 天津先驱领域科技有限公司 Man-machine interaction device capable of performing virtual environment control
US9857871B2 (en) * 2015-09-04 2018-01-02 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
KR102501752B1 (en) * 2015-09-21 2023-02-20 삼성전자주식회사 The method and apparatus for comppensating motion of the head mounted display
US10217286B1 (en) * 2015-09-21 2019-02-26 Amazon Technologies, Inc. Realistic rendering for virtual reality applications
CN105208370B (en) * 2015-09-23 2017-02-01 暴风集团股份有限公司 Display and calibration method of virtual-reality device
US20170090196A1 (en) * 2015-09-28 2017-03-30 Deere & Company Virtual heads-up display application for a work machine
US10401953B2 (en) * 2015-10-26 2019-09-03 Pillantas Inc. Systems and methods for eye vergence control in real and augmented reality environments
US9983709B2 (en) 2015-11-02 2018-05-29 Oculus Vr, Llc Eye tracking using structured light
US9984507B2 (en) * 2015-11-19 2018-05-29 Oculus Vr, Llc Eye tracking for mitigating vergence and accommodation conflicts
US9880384B2 (en) 2015-11-27 2018-01-30 Fove, Inc. Gaze detection system, gaze point detection method, and gaze point detection program
US10444972B2 (en) 2015-11-28 2019-10-15 International Business Machines Corporation Assisting a user with efficient navigation between a selection of entries with elements of interest to the user within a stream of entries
US10204451B2 (en) 2015-11-30 2019-02-12 Microsoft Technology Licensing, Llc Multi-optical surface optical design
JP6532393B2 (en) * 2015-12-02 2019-06-19 株式会社ソニー・インタラクティブエンタテインメント Display control apparatus and display control method
US10445860B2 (en) 2015-12-08 2019-10-15 Facebook Technologies, Llc Autofocus virtual reality headset
US10241569B2 (en) 2015-12-08 2019-03-26 Facebook Technologies, Llc Focus adjustment method for a virtual reality headset
CN105507931B (en) * 2015-12-11 2018-10-23 北京天地玛珂电液控制系统有限公司 A kind of coal working face supporting robot
CN105607256A (en) * 2016-01-04 2016-05-25 深圳市华星光电技术有限公司 Intelligent wearable device
KR102524641B1 (en) * 2016-01-22 2023-04-21 삼성전자주식회사 Head mounted display device and method for controlling the same
WO2017131770A1 (en) * 2016-01-29 2017-08-03 Hewlett-Packard Development Company, L.P Viewing device adjustment based on eye accommodation in relation to a display
US11106276B2 (en) 2016-03-11 2021-08-31 Facebook Technologies, Llc Focus adjusting headset
CN105832503B (en) * 2016-03-17 2018-10-19 广东小天才科技有限公司 A kind of picture outputting method and device for orthpia
WO2017165231A1 (en) * 2016-03-22 2017-09-28 Magic Leap, Inc. Head mounted display system configured to exchange biometric information
KR20170111450A (en) * 2016-03-28 2017-10-12 삼성전자주식회사 Hearing aid apparatus, portable apparatus and controlling method thereof
US10452227B1 (en) 2016-03-31 2019-10-22 United Services Automobile Association (Usaa) System and method for data visualization and modification in an immersive three dimensional (3-D) environment
US10379356B2 (en) 2016-04-07 2019-08-13 Facebook Technologies, Llc Accommodation based optical correction
WO2017177128A1 (en) * 2016-04-08 2017-10-12 The Trustees Of Columbia University In The City Of New York Systems and methods for deep reinforcement learning using a brain-artificial intelligence interface
US20170336631A1 (en) * 2016-05-18 2017-11-23 Rockwell Collins, Inc. Dynamic Vergence for Binocular Display Device
US10429647B2 (en) 2016-06-10 2019-10-01 Facebook Technologies, Llc Focus adjusting virtual reality headset
CN107544661B (en) * 2016-06-24 2020-06-23 联想(北京)有限公司 Information processing method and electronic equipment
US9773438B1 (en) 2016-06-29 2017-09-26 Meta Company System and method for providing views of virtual content in an augmented reality environment
US11216069B2 (en) * 2018-05-08 2022-01-04 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
WO2020112986A1 (en) 2018-11-27 2020-06-04 Facebook Technologies, Inc. Methods and apparatus for autocalibration of a wearable electrode sensor system
EP3494695B1 (en) * 2016-08-04 2023-09-27 Dolby Laboratories Licensing Corporation Single depth tracked accommodation-vergence solutions
CN106226904A (en) * 2016-08-23 2016-12-14 刘永锋 VR glasses circuit
US10699472B2 (en) * 2016-08-26 2020-06-30 Magic Leap, Inc. Continuous time warp and binocular time warp for virtual and augmented reality display systems and methods
WO2018044073A1 (en) * 2016-09-01 2018-03-08 Samsung Electronics Co., Ltd. Image streaming method and electronic device for supporting the same
KR20180025797A (en) * 2016-09-01 2018-03-09 삼성전자주식회사 Method for Streaming Image and the Electronic Device supporting the same
KR20180028796A (en) * 2016-09-09 2018-03-19 삼성전자주식회사 Method, storage medium and electronic device for displaying images
CN106412563A (en) * 2016-09-30 2017-02-15 珠海市魅族科技有限公司 Image display method and apparatus
US20180095635A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Controls and Interfaces for User Interactions in Virtual Spaces
WO2018076202A1 (en) * 2016-10-26 2018-05-03 中国科学院深圳先进技术研究院 Head-mounted display device that can perform eye tracking, and eye tracking method
CN107991775B (en) * 2016-10-26 2020-06-05 中国科学院深圳先进技术研究院 Head-mounted visual equipment capable of tracking human eyes and human eye tracking method
CN106774821B (en) * 2016-11-08 2020-05-19 广州视源电子科技股份有限公司 Display method and system based on virtual reality technology
CN106405843A (en) * 2016-11-24 2017-02-15 天津临境科技有限公司 Projection VR glasses
WO2018100518A1 (en) * 2016-11-30 2018-06-07 Novasight Ltd. Methods and devices for displaying image with changed field of view
TWI632395B (en) * 2016-12-27 2018-08-11 廣達電腦股份有限公司 Virtual reality devices and method for generating display thereof
US10650552B2 (en) 2016-12-29 2020-05-12 Magic Leap, Inc. Systems and methods for augmented reality
CN106710002A (en) * 2016-12-29 2017-05-24 深圳迪乐普数码科技有限公司 AR implementation method and system based on positioning of visual angle of observer
US20180190282A1 (en) * 2016-12-30 2018-07-05 Qualcomm Incorporated In-vehicle voice command control
EP3343267B1 (en) 2016-12-30 2024-01-24 Magic Leap, Inc. Polychromatic light out-coupling apparatus, near-eye displays comprising the same, and method of out-coupling polychromatic light
US10310598B2 (en) 2017-01-17 2019-06-04 Facebook Technologies, Llc Varifocal head-mounted display including modular air spaced optical assembly
US10679366B1 (en) 2017-01-30 2020-06-09 Facebook Technologies, Llc High speed computational tracking sensor
US10485420B2 (en) 2017-02-17 2019-11-26 Analog Devices Global Unlimited Company Eye gaze tracking
EP3602583A4 (en) * 2017-03-22 2020-07-29 Magic Leap, Inc. Dynamic field of view variable focus display system
CN106880475A (en) * 2017-03-23 2017-06-23 郑州诚优成电子科技有限公司 Wear-type virtual reality vision training apparatus
US9754397B1 (en) * 2017-04-07 2017-09-05 Mirage Worlds, Inc. Systems and methods for contextual augmented reality sharing and performance
CN107247511B (en) * 2017-05-05 2019-07-16 浙江大学 A kind of across object exchange method and device captured based on eye movement in virtual reality
US10845955B2 (en) 2017-05-15 2020-11-24 Apple Inc. Displaying a scrollable list of affordances associated with physical activities
US11202051B2 (en) 2017-05-18 2021-12-14 Pcms Holdings, Inc. System and method for distributing and rendering content as spherical video and 3D asset combination
CN107315470B (en) * 2017-05-25 2018-08-17 腾讯科技（深圳）有限公司 Graphic processing method, processor and virtual reality system
US11116415B2 (en) * 2017-06-07 2021-09-14 Bragi GmbH Use of body-worn radar for biometric measurements, contextual awareness and identification
US10810773B2 (en) * 2017-06-14 2020-10-20 Dell Products, L.P. Headset display control based upon a user's pupil state
CN107193127A (en) * 2017-06-27 2017-09-22 北京数科技有限公司 A kind of imaging method and Wearable
CN107229340B (en) * 2017-06-29 2020-04-24 联想(北京)有限公司 Information processing method and electronic equipment
CN107463251B (en) * 2017-07-13 2020-12-22 咪咕音乐有限公司 Information processing method, device, system and storage medium
US10578870B2 (en) 2017-07-26 2020-03-03 Magic Leap, Inc. Exit pupil expander
EP3660636A4 (en) * 2017-07-27 2020-07-08 Sony Corporation Information processing device, information processing method, and program
US10489648B2 (en) 2017-08-04 2019-11-26 Facebook Technologies, Llc Eye tracking using time multiplexing
US10448762B2 (en) 2017-09-15 2019-10-22 Kohler Co. Mirror
US11093554B2 (en) 2017-09-15 2021-08-17 Kohler Co. Feedback for water consuming appliance
US10887125B2 (en) 2017-09-15 2021-01-05 Kohler Co. Bathroom speaker
US11099540B2 (en) 2017-09-15 2021-08-24 Kohler Co. User identity in household appliances
US11314215B2 (en) 2017-09-15 2022-04-26 Kohler Co. Apparatus controlling bathroom appliance lighting based on user identity
CN114924651A (en) 2017-09-29 2022-08-19 苹果公司 Gaze-based user interaction
CN107682690A (en) 2017-10-19 2018-02-09 京东方科技集团股份有限公司 Self-adapting parallax adjusting method and Virtual Reality display system
EP3697297A4 (en) 2017-10-19 2020-12-16 Facebook Technologies, Inc. Systems and methods for identifying biological structures associated with neuromuscular source signals
US11256667B2 (en) 2017-10-26 2022-02-22 Druva Inc. Deduplicated merged indexed object storage file system
CN109725418B (en) * 2017-10-30 2020-10-16 华为技术有限公司 Display device, method and device for adjusting image presentation of display device
US11138301B1 (en) * 2017-11-20 2021-10-05 Snap Inc. Eye scanner for user identification and security in an eyewear device
US10729389B2 (en) * 2017-11-28 2020-08-04 Hillel Sarel MARESKY 3D assessment of conjugant eye deviation for the identificaiton of acute ischemic stroke
EP3721320B1 (en) * 2017-12-07 2022-02-23 Eyefree Assisting Communication Ltd. Communication methods and systems
CN116990888A (en) 2017-12-10 2023-11-03 奇跃公司 Antireflective coating on optical waveguides
WO2019126175A1 (en) 2017-12-20 2019-06-27 Vuzix Corporation Augmented reality display system
AU2018392482A1 (en) 2017-12-20 2020-07-02 Magic Leap, Inc. Insert for augmented reality viewing device
US10989921B2 (en) * 2017-12-29 2021-04-27 Letinar Co., Ltd. Augmented reality optics system with pinpoint mirror
US11481030B2 (en) 2019-03-29 2022-10-25 Meta Platforms Technologies, Llc Methods and apparatus for gesture detection and classification
US11907423B2 (en) 2019-11-25 2024-02-20 Meta Platforms Technologies, Llc Systems and methods for contextualized interactions with an environment
US11961494B1 (en) 2019-03-29 2024-04-16 Meta Platforms Technologies, Llc Electromagnetic interference reduction in extended reality environments
US11493993B2 (en) 2019-09-04 2022-11-08 Meta Platforms Technologies, Llc Systems, methods, and interfaces for performing inputs based on neuromuscular control
US11150730B1 (en) 2019-04-30 2021-10-19 Facebook Technologies, Llc Devices, systems, and methods for controlling computing devices via neuromuscular signals of users
WO2019154510A1 (en) * 2018-02-09 2019-08-15 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
EP3750028B1 (en) 2018-02-09 2022-10-19 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
US11556741B2 (en) 2018-02-09 2023-01-17 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters using a neural network
US10564716B2 (en) 2018-02-12 2020-02-18 Hong Kong Applied Science and Technology Research Institute Company Limited 3D gazing point detection by binocular homography mapping
US10521013B2 (en) * 2018-03-01 2019-12-31 Samsung Electronics Co., Ltd. High-speed staggered binocular eye tracking systems
DK201870599A1 (en) 2018-03-12 2019-10-16 Apple Inc. User interfaces for health monitoring
DE102018105917A1 (en) * 2018-03-14 2019-09-19 tooz technologies GmbH A method for user-specific calibration of a superimposed on the head of a user display device for an augmented presentation
CN112136152A (en) * 2018-03-15 2020-12-25 奇跃公司 Image correction caused by deformation of components of a viewing device
US10504288B2 (en) 2018-04-17 2019-12-10 Patrick Piemonte & Ryan Staake Systems and methods for shared creation of augmented reality
US11029521B2 (en) * 2018-04-24 2021-06-08 Apple Inc. Head-mounted device with an adjustable opacity system
KR20210005555A (en) * 2018-04-28 2021-01-14 알마렌스, 인코포레이티드 Mixed reality optical system with digitally corrected aberration
CN108592865A (en) * 2018-04-28 2018-09-28 京东方科技集团股份有限公司 Geometric measurement method and its device, AR equipment based on AR equipment
EP3787543A4 (en) 2018-05-02 2022-01-19 Augmedics Ltd. Registration of a fiducial marker for an augmented reality system
US11317833B2 (en) 2018-05-07 2022-05-03 Apple Inc. Displaying user interfaces associated with physical activities
DK179992B1 (en) 2018-05-07 2020-01-14 Apple Inc. Visning af brugergrænseflader associeret med fysiske aktiviteter
CN110488489B (en) * 2018-05-15 2022-10-11 苹果公司 Eye registration for a head-mounted housing
WO2019231850A1 (en) 2018-05-31 2019-12-05 Magic Leap, Inc. Radar head pose localization
WO2019236495A1 (en) 2018-06-05 2019-12-12 Magic Leap, Inc. Homography transformation matrices based temperature calibration of a viewing system
WO2020009877A1 (en) * 2018-07-02 2020-01-09 Stowers Institute For Medical Research Facial image recognition using pseudo-images
US11579441B2 (en) 2018-07-02 2023-02-14 Magic Leap, Inc. Pixel intensity modulation using modifying gain values
US11856479B2 (en) 2018-07-03 2023-12-26 Magic Leap, Inc. Systems and methods for virtual and augmented reality along a route with markers
US11510027B2 (en) 2018-07-03 2022-11-22 Magic Leap, Inc. Systems and methods for virtual and augmented reality
TWI697348B (en) * 2018-07-05 2020-07-01 宏碁股份有限公司 Stereoscopic display system and stereoscopic display method
US11598651B2 (en) 2018-07-24 2023-03-07 Magic Leap, Inc. Temperature dependent calibration of movement detection devices
US11624929B2 (en) 2018-07-24 2023-04-11 Magic Leap, Inc. Viewing device with dust seal integration
EP3831058A4 (en) 2018-08-02 2022-04-20 Magic Leap, Inc. A viewing system with interpupillary distance compensation based on head motion
JP7438188B2 (en) 2018-08-03 2024-02-26 マジック リープ， インコーポレイテッド Unfused pose-based drift correction of fused poses of totems in user interaction systems
EP3853698A4 (en) 2018-09-20 2021-11-17 Facebook Technologies, LLC Neuromuscular text entry, writing and drawing in augmented reality systems
CN109522789A (en) * 2018-09-30 2019-03-26 北京七鑫易维信息技术有限公司 Eyeball tracking method, apparatus and system applied to terminal device
US10855979B2 (en) 2018-10-23 2020-12-01 Microsoft Technology Licensing, Llc Interpreting eye gaze direction as user input to near-eye-display (NED) devices for enabling hands free positioning of virtual items
US10718942B2 (en) 2018-10-23 2020-07-21 Microsoft Technology Licensing, Llc Eye tracking systems and methods for near-eye-display (NED) devices
US10996746B2 (en) 2018-10-23 2021-05-04 Microsoft Technology Licensing, Llc Real-time computational solutions to a three-dimensional eye tracking framework
US10838490B2 (en) 2018-10-23 2020-11-17 Microsoft Technology Licensing, Llc Translating combinations of user gaze direction and predetermined facial gestures into user input instructions for near-eye-display (NED) devices
US10852823B2 (en) 2018-10-23 2020-12-01 Microsoft Technology Licensing, Llc User-specific eye tracking calibration for near-eye-display (NED) devices
WO2020102412A1 (en) 2018-11-16 2020-05-22 Magic Leap, Inc. Image size triggered clarification to maintain image sharpness
US11766296B2 (en) 2018-11-26 2023-09-26 Augmedics Ltd. Tracking system for image-guided surgery
TWI688254B (en) * 2018-12-11 2020-03-11 宏碁股份有限公司 Stereoscopic display device and parameter calibration method thereof
WO2020147948A1 (en) 2019-01-16 2020-07-23 Pupil Labs Gmbh Methods for generating calibration data for head-wearable devices and eye tracking system
CN113518961A (en) 2019-02-06 2021-10-19 奇跃公司 Targeted intent based clock speed determination and adjustment to limit total heat generated by multiple processors
US11070778B2 (en) * 2019-02-14 2021-07-20 Facebook Technologies, Llc Multi-projector display architecture
SE543332C2 (en) 2019-02-19 2020-12-01 Tobii Ab Method, computer program and head mountable arrangement for assisting a subject to acquire spatial information about an environment
CN109907741B (en) * 2019-03-06 2022-04-01 智美康民(珠海)健康科技有限公司 Three-dimensional pulse wave display method and device, computer equipment and storage medium
CN109938705B (en) * 2019-03-06 2022-03-29 智美康民(珠海)健康科技有限公司 Three-dimensional pulse wave display method and device, computer equipment and storage medium
CN113544766A (en) 2019-03-12 2021-10-22 奇跃公司 Registering local content between first and second augmented reality viewers
WO2020185219A1 (en) 2019-03-13 2020-09-17 Hewlett-Packard Development Company, L.P. Detecting eye tracking calibration errors
JP6943913B2 (en) * 2019-03-18 2021-10-06 Ｎｅｃプラットフォームズ株式会社 Information display system and wearable device
CN111757089A (en) * 2019-03-29 2020-10-09 托比股份公司 Method and system for rendering images with pupil enhancement adjustment of the eye
KR20200120466A (en) * 2019-04-11 2020-10-21 삼성전자주식회사 Head mounted display apparatus and operating method for the same
EP3911992A4 (en) 2019-04-11 2022-03-23 Samsung Electronics Co., Ltd. Head-mounted display device and operating method of the same
WO2020223636A1 (en) 2019-05-01 2020-11-05 Magic Leap, Inc. Content provisioning system and method
US11749018B1 (en) 2019-05-28 2023-09-05 Apple Inc. Eye enrollment for head-mounted enclosure
US11234077B2 (en) 2019-06-01 2022-01-25 Apple Inc. User interfaces for managing audio exposure
US11228835B2 (en) 2019-06-01 2022-01-18 Apple Inc. User interfaces for managing audio exposure
US11209957B2 (en) 2019-06-01 2021-12-28 Apple Inc. User interfaces for cycle tracking
DK201970534A1 (en) 2019-06-01 2021-02-16 Apple Inc User interfaces for monitoring noise exposure levels
US11152100B2 (en) 2019-06-01 2021-10-19 Apple Inc. Health application user interfaces
WO2020243829A1 (en) * 2019-06-03 2020-12-10 Vuereal Inc. Nonintrusive head-mounted device
EP3979896A1 (en) 2019-06-05 2022-04-13 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
WO2020253949A1 (en) * 2019-06-18 2020-12-24 Pupil Labs Gmbh Systems and methods for determining one or more parameters of a user's eye
EP3760157A1 (en) * 2019-07-04 2021-01-06 Scopis GmbH Technique for calibrating a registration of an augmented reality device
JP2022542363A (en) 2019-07-26 2022-10-03 マジック リープ， インコーポレイテッド Systems and methods for augmented reality
US11980506B2 (en) 2019-07-29 2024-05-14 Augmedics Ltd. Fiducial marker
EP4004702A1 (en) 2019-09-09 2022-06-01 Apple Inc. Research study user interfaces
CN114667538A (en) 2019-11-15 2022-06-24 奇跃公司 Viewing system for use in a surgical environment
US11709546B1 (en) * 2019-11-25 2023-07-25 Robert Edwin Douglas Visualization of images via an enhanced eye tracking system
US11382712B2 (en) 2019-12-22 2022-07-12 Augmedics Ltd. Mirroring in image guided surgery
CN110989166A (en) 2019-12-25 2020-04-10 歌尔股份有限公司 Eyeball tracking system of near-to-eye display equipment and near-to-eye display equipment
CN111401921B (en) * 2020-03-05 2023-04-18 成都威爱新经济技术研究院有限公司 Virtual human-based remote customer service method
DK181037B1 (en) 2020-06-02 2022-10-10 Apple Inc User interfaces for health applications
US11698710B2 (en) 2020-08-31 2023-07-11 Apple Inc. User interfaces for logging user activities
US11630556B2 (en) * 2020-09-16 2023-04-18 Kyndryl, Inc. Finger control of wearable devices
US20220104959A1 (en) * 2020-10-07 2022-04-07 Jay Curtis Beavers Systems, methods, and techniques for eye gaze control of seat and bed positioning
US20230412792A1 (en) * 2020-10-19 2023-12-21 Hewlett-Packard Development Company, L.P. Rendering format selection based on virtual distance
DE102020215285A1 (en) 2020-12-03 2022-06-09 Robert Bosch Gesellschaft mit beschränkter Haftung Method for parallax control and binocular data glasses with a computing unit for carrying out the method
KR20220136561A (en) * 2021-03-31 2022-10-11 삼성디스플레이 주식회사 Display device, and control method of display device
US11868531B1 (en) 2021-04-08 2024-01-09 Meta Platforms Technologies, Llc Wearable device providing for thumb-to-finger-based input gestures detected based on neuromuscular signals, and systems and methods of use thereof
US11896445B2 (en) 2021-07-07 2024-02-13 Augmedics Ltd. Iliac pin and adapter
SE545378C2 (en) * 2021-12-30 2023-07-25 Tobii Ab Method and system for determining a current gaze direction

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0968670A (en) * 1995-08-31 1997-03-11 Olympus Optical Co Ltd Head-mounted type video display device
JP3771964B2 (en) * 1996-03-12 2006-05-10 オリンパス株式会社 3D image display device
JP2000013818A (en) * 1998-06-23 2000-01-14 Nec Corp Stereoscopic display device and stereoscopic display method
US20020044152A1 (en) * 2000-10-16 2002-04-18 Abbott Kenneth H. Dynamic integration of computer generated and real world images
EP1739642B1 (en) * 2004-03-26 2017-05-24 Atsushi Takahashi 3d entity digital magnifying glass system having 3d visual instruction function
JP4270347B2 (en) * 2005-12-26 2009-05-27 オリンパス株式会社 Distance calculator
EP1862969A1 (en) * 2006-06-02 2007-12-05 Eidgenössische Technische Hochschule Zürich Method and system for generating a representation of a dynamically changing 3D scene
CN101489467B (en) * 2006-07-14 2011-05-04 松下电器产业株式会社 Visual axis direction detection device and visual line direction detection method
US8295546B2 (en) * 2009-01-30 2012-10-23 Microsoft Corporation Pose tracking pipeline
US20110117530A1 (en) * 2009-05-07 2011-05-19 Technion Research & Development Foundation Ltd. Method and system of simulating physical object incisions, deformations and interactions therewith
US20110075257A1 (en) 2009-09-14 2011-03-31 The Arizona Board Of Regents On Behalf Of The University Of Arizona 3-Dimensional electro-optical see-through displays
US20120188279A1 (en) * 2009-09-29 2012-07-26 Kent Demaine Multi-Sensor Proximity-Based Immersion System and Method
US8994611B2 (en) * 2010-03-24 2015-03-31 Olympus Corporation Head-mounted type display device
JP6001526B2 (en) * 2010-04-01 2016-10-05 シーリアル テクノロジーズ ソシエテ アノニムＳｅｅｒｅａｌ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｓ．Ａ． Method and apparatus for encoding a three-dimensional scene containing transmissive objects in a hologram system
KR101729023B1 (en) * 2010-10-05 2017-04-21 엘지전자 주식회사 Mobile terminal and operation control method thereof
US8576276B2 (en) * 2010-11-18 2013-11-05 Microsoft Corporation Head-mounted display device which provides surround video
CA2750287C (en) * 2011-08-29 2012-07-03 Microsoft Corporation Gaze detection in a see-through, near-eye, mixed reality display
US20130088413A1 (en) * 2011-10-05 2013-04-11 Google Inc. Method to Autofocus on Near-Eye Display
TW201320717A (en) * 2011-11-08 2013-05-16 Unique Instr Co Ltd Method of displaying 3D image
US20130137076A1 (en) * 2011-11-30 2013-05-30 Kathryn Stone Perez Head-mounted display based education and instruction
US8824779B1 (en) * 2011-12-20 2014-09-02 Christopher Charles Smyth Apparatus and method for determining eye gaze from stereo-optic views
US20130342572A1 (en) * 2012-06-26 2013-12-26 Adam G. Poulos Control of displayed content in virtual environments

Also Published As

Publication number Publication date
EP2893388B1 (en) 2016-08-03
US20150288944A1 (en) 2015-10-08
WO2014033306A1 (en) 2014-03-06
US9380287B2 (en) 2016-06-28
JP2016502120A (en) 2016-01-21
EP2893388A1 (en) 2015-07-15
CN104603673A (en) 2015-05-06
US20160267708A1 (en) 2016-09-15
JP5887026B2 (en) 2016-03-16
CN104603673B (en) 2017-03-15

Similar Documents

Publication Publication Date Title
IN2015KN00682A (en)
MX2018004231A (en) Display assistance device and display assistance method.
EP2693760A3 (en) Stereoscopic image display device, image processing device, and stereoscopic image processing method
EP2673957A4 (en) Three-dimensional display with motion parallax
WO2013086249A3 (en) Vehicle vision system with customized display
WO2016154123A3 (en) Virtual 3d methods, systems and software
EP3007038A3 (en) Interaction with three-dimensional video
MX2016009512A (en) Food processor and method for operating a food processor.
JP2013101528A5 (en)
NZ751602A (en) Display system and method
EP4235367A3 (en) Image-generating device and method
GB2533520A (en) Gaze-controlled interface method and system
EP2677497A3 (en) Method and system of spacial visualisation of objects and a platform control system included in the system, in particular for a virtual fitting room
EP2706395A3 (en) Sport glasses and use method thereof
RU2015138973A (en) HEAD-STRENGTHED DISPLAY AND METHOD OF MANAGEMENT FOR STRENGTHENED-HEAD DISPLAY
EP2394715A3 (en) Image display program, system and method
EP2693759A3 (en) Stereoscopic image display device, image processing device, and stereoscopic image processing method
JP2016024273A5 (en)
GB201200910D0 (en) Head-mounted somatosensory control and display system and method using same
JP2012205267A5 (en)
GB201110661D0 (en) Apparatus and method for displaying images
JP2013167481A5 (en)
WO2013070406A3 (en) Systems and methods for mask adjustment in 3d display technology
WO2009114772A3 (en) System and method for displaying stereo images
MX2020006407A (en) Head-mounted display device and method thereof.