IL271129B - שיטה ומערכת לראיה אופטית דרך תצוגה מורכבת–ראש של עצמים וירטואליים המיושרים במדויק עם עצמים כלפי חוץ - Google Patents

שיטה ומערכת לראיה אופטית דרך תצוגה מורכבת–ראש של עצמים וירטואליים המיושרים במדויק עם עצמים כלפי חוץ

Info

Publication number
IL271129B
IL271129B IL271129A IL27112919A IL271129B IL 271129 B IL271129 B IL 271129B IL 271129 A IL271129 A IL 271129A IL 27112919 A IL27112919 A IL 27112919A IL 271129 B IL271129 B IL 271129B
Authority
IL
Israel
Prior art keywords
head
mounted display
precisely aligned
objects
optical vision
Prior art date
Application number
IL271129A
Other languages
English (en)
Other versions
IL271129A (he
Inventor
Ben-Yishai Rani
Benesh Gil
Original Assignee
Elbit Systems Ltd
Rani Ben Yishai
Benesh Gil
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Elbit Systems Ltd, Rani Ben Yishai, Benesh Gil filed Critical Elbit Systems Ltd
Priority to IL271129A priority Critical patent/IL271129B/he
Publication of IL271129A publication Critical patent/IL271129A/he
Publication of IL271129B publication Critical patent/IL271129B/he

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/00017—Electrical control of surgical instruments
    • A61B2017/00216—Electrical control of surgical instruments with eye tracking or head position tracking control
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101—Computer-aided simulation of surgical operations
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A61B2034/2057—Details of tracking cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50—Supports for surgical instruments, e.g. articulated arms
    • A61B2090/502—Headgear, e.g. helmet, spectacles
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/011—Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/44—Morphing

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Robotics (AREA)
  • Optics & Photonics (AREA)
  • General Engineering & Computer Science (AREA)
  • Gynecology & Obstetrics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Human Computer Interaction (AREA)
IL271129A 2019-12-02 2019-12-02 שיטה ומערכת לראיה אופטית דרך תצוגה מורכבת–ראש של עצמים וירטואליים המיושרים במדויק עם עצמים כלפי חוץ IL271129B (he)

Priority Applications (1)

Application Number Priority Date Filing Date Title
IL271129A IL271129B (he) 2019-12-02 2019-12-02 שיטה ומערכת לראיה אופטית דרך תצוגה מורכבת–ראש של עצמים וירטואליים המיושרים במדויק עם עצמים כלפי חוץ

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
IL271129A IL271129B (he) 2019-12-02 2019-12-02 שיטה ומערכת לראיה אופטית דרך תצוגה מורכבת–ראש של עצמים וירטואליים המיושרים במדויק עם עצמים כלפי חוץ

Publications (2)

Publication Number Publication Date
IL271129A IL271129A (he) 2021-06-30
IL271129B true IL271129B (he) 2021-12-01

Family

ID=76820085

Family Applications (1)

Application Number Title Priority Date Filing Date
IL271129A IL271129B (he) 2019-12-02 2019-12-02 שיטה ומערכת לראיה אופטית דרך תצוגה מורכבת–ראש של עצמים וירטואליים המיושרים במדויק עם עצמים כלפי חוץ

Country Status (1)

Country Link
IL (1) IL271129B (he)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11508127B2 (en) * 2018-11-13 2022-11-22 Disney Enterprises, Inc. Capturing augmented reality on a head mounted display
EP4329662A4 (en) 2021-04-27 2024-08-21 Elbit Systems Ltd. OPTICAL THROUGH-OUT (OT) HEAD-MOUNTED DISPLAY (HMD) SYSTEM AND METHOD FOR PRECISE ALIGNMENT OF VIRTUAL OBJECTS WITH OUTWARD VIEWED OBJECTS

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180053284A1 (en) * 2016-08-22 2018-02-22 Magic Leap, Inc. Virtual, augmented, and mixed reality systems and methods
US20180114298A1 (en) * 2016-10-26 2018-04-26 Valve Corporation Using pupil location to correct optical lens distortion
WO2018220631A1 (en) * 2017-05-29 2018-12-06 Eyeway Vision Ltd. A method and system for registering between an external scene and a virtual image
US20190108645A1 (en) * 2016-04-21 2019-04-11 Elbit Systems Ltd. Method and system for registration verification
WO2019152617A1 (en) * 2018-02-03 2019-08-08 The Johns Hopkins University Calibration system and method to align a 3d virtual scene and 3d real world for a stereoscopic head-mounted display
WO2019152619A1 (en) * 2018-02-03 2019-08-08 The Johns Hopkins University Blink-based calibration of an optical see-through head-mounted display
US10466484B1 (en) * 2017-12-14 2019-11-05 Facebook Technologies, Llc Compact head-mounted display for artificial reality

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190108645A1 (en) * 2016-04-21 2019-04-11 Elbit Systems Ltd. Method and system for registration verification
US20180053284A1 (en) * 2016-08-22 2018-02-22 Magic Leap, Inc. Virtual, augmented, and mixed reality systems and methods
US20180114298A1 (en) * 2016-10-26 2018-04-26 Valve Corporation Using pupil location to correct optical lens distortion
WO2018220631A1 (en) * 2017-05-29 2018-12-06 Eyeway Vision Ltd. A method and system for registering between an external scene and a virtual image
US10466484B1 (en) * 2017-12-14 2019-11-05 Facebook Technologies, Llc Compact head-mounted display for artificial reality
WO2019152617A1 (en) * 2018-02-03 2019-08-08 The Johns Hopkins University Calibration system and method to align a 3d virtual scene and 3d real world for a stereoscopic head-mounted display
WO2019152619A1 (en) * 2018-02-03 2019-08-08 The Johns Hopkins University Blink-based calibration of an optical see-through head-mounted display

Also Published As

Publication number Publication date
IL271129A (he) 2021-06-30

Similar Documents

Publication Publication Date Title
EP4097574A4 (en) EYE-TRACKING SYSTEM FOR HEAD-MOUNTED DISPLAY DEVICES
EP4028827A4 (en) PUPIL ADJUSTED OCCLUSIVE OPTICAL TRANSPARENT HEAD MOUNTED DISPLAY
EP3443407A4 (en) OPTICAL WEARABLE DISPLAY SYSTEM WITH BINOCULAR LARGE FOCUS (WFOV)
WO2017040875A3 (en) Optical system
EP4066044A4 (en) ENHANCED EYE TRACKING FOR AUGMENTED OR VIRTUAL REALITY DISPLAY SYSTEMS
EP3167321A4 (en) Optical ferrule for multi-fiber cable and hardened multi-fiber optic connector therefore
EP4055435A4 (en) Optical system for head-mounted display device
GB201712640D0 (en) Method of laser modification of an optical fibre
EP3676659A4 (en) OPTICAL LENS FOR VISION CORRECTION
EP4325272A4 (en) HEAD-UP DISPLAY SYSTEM
EP3757652A4 (en) OCULAR AND HEADSET OPTICAL SYSTEM
EP3385764A4 (en) FERRULE WITH OPTICAL FIBER AND METHOD FOR PRODUCING A FERRULE WITH OPTICAL FIBER
EP3290973A4 (en) Ultralow-attenuation bend-insensitive single-mode optical fibre
EP4212945C0 (en) OPTICAL SYSTEM AND HEAD-MOUNTED DISPLAY DEVICE
EP3824262A4 (en) FIBER OPTIC FERRULE INSPECTION TOOL
IL284992A (he) מערכת עדשת מציאות רבודה אופטית ומתקנת
EP3990971A4 (en) OPTICAL CLEAR (OST) NEAR EYE DISPLAY (NED) WITH INTEGRATED OPHTHALMIC CORRECTION
IL311759A (he) מערכת אופטית לתצוגות לעין קרובה
IL271129B (he) שיטה ומערכת לראיה אופטית דרך תצוגה מורכבת–ראש של עצמים וירטואליים המיושרים במדויק עם עצמים כלפי חוץ
EP4276411B8 (en) Fiber optic gyroscope with optical gating for spike suppression
EP4067969A4 (en) AUGMENTED REALITY DISPLAY AND GLASSES
EP3392682A4 (en) METHOD FOR PRODUCING AN OPTICAL ANTI-REFLECTION BODY, DISPLAY PANEL AND OPTICAL FILM
EP4208751A4 (en) HEADS-UP DISPLAY SYSTEMS
IL263055B (he) שיטה ומערכת להרמוניזציה דואלית של מערכת תצוגה לבישה בראש להתאמת תצוגת מידע ניווט כלי טיס לעולם החיצוני האמתי
EP4014483A4 (en) Optical design and optimization techniques for 3d light field displays