CN113876422B - 不可见光可视化自动配准型增强现实眼镜 - Google Patents

不可见光可视化自动配准型增强现实眼镜 Download PDF

Info

Publication number
CN113876422B
CN113876422B CN202110724590.2A CN202110724590A CN113876422B CN 113876422 B CN113876422 B CN 113876422B CN 202110724590 A CN202110724590 A CN 202110724590A CN 113876422 B CN113876422 B CN 113876422B
Authority
CN
China
Prior art keywords
invisible light
output
waveguide
augmented reality
coupler
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110724590.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN113876422A (zh
Inventor
安礼灿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pukyong National University
Original Assignee
Pukyong National University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pukyong National University filed Critical Pukyong National University
Publication of CN113876422A publication Critical patent/CN113876422A/zh
Application granted granted Critical
Publication of CN113876422B publication Critical patent/CN113876422B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/7445—Display arrangements, e.g. multiple display units
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0189—Sight systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus
    • G02B27/022—Viewing apparatus
    • G02B27/023—Viewing apparatus for viewing X-ray images using image converters, e.g. radioscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/00017—Electrical control of surgical instruments
    • A61B2017/00216—Electrical control of surgical instruments with eye tracking or head position tracking control
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/372—Details of monitor hardware
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/373—Surgical systems with images on a monitor during operation using light, e.g. by using optical scanners
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50—Supports for surgical instruments, e.g. articulated arms
    • A61B2090/502—Headgear, e.g. helmet, spectacles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
    • A61B2505/05—Surgical care
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/745—Details of notification to user or communication with user or patient; User input means using visual displays using a holographic display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Robotics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
CN202110724590.2A 2020-07-01 2021-06-29 不可见光可视化自动配准型增强现实眼镜 Active CN113876422B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2020-0080871 2020-07-01
KR1020200080871A KR102223621B1 (ko) 2020-07-01 2020-07-01 비가시광선 가시화 자동정합형 증강현실 글래스

Publications (2)

Publication Number Publication Date
CN113876422A CN113876422A (zh) 2022-01-04
CN113876422B true CN113876422B (zh) 2024-04-19

Family

ID=75164001

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110724590.2A Active CN113876422B (zh) 2020-07-01 2021-06-29 不可见光可视化自动配准型增强现实眼镜

Country Status (5)

Country Link
US (1) US11609425B2 (enExample)
EP (1) EP3932361A1 (enExample)
JP (2) JP7324802B2 (enExample)
KR (1) KR102223621B1 (enExample)
CN (1) CN113876422B (enExample)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2536650A (en) 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
JP7310952B2 (ja) * 2017-04-27 2023-07-19 株式会社三洋物産 遊技機
JP7260012B2 (ja) * 2017-04-27 2023-04-18 株式会社三洋物産 遊技機
JP7310945B2 (ja) * 2017-04-27 2023-07-19 株式会社三洋物産 遊技機
JP7260021B2 (ja) * 2017-04-27 2023-04-18 株式会社三洋物産 遊技機
JP7260009B2 (ja) * 2017-04-27 2023-04-18 株式会社三洋物産 遊技機
JP7272480B2 (ja) * 2017-04-27 2023-05-12 株式会社三洋物産 遊技機
JP7260013B2 (ja) * 2017-04-27 2023-04-18 株式会社三洋物産 遊技機
US12458411B2 (en) 2017-12-07 2025-11-04 Augmedics Ltd. Spinous process clamp
WO2019211741A1 (en) 2018-05-02 2019-11-07 Augmedics Ltd. Registration of a fiducial marker for an augmented reality system
US11766296B2 (en) 2018-11-26 2023-09-26 Augmedics Ltd. Tracking system for image-guided surgery
US12178666B2 (en) 2019-07-29 2024-12-31 Augmedics Ltd. Fiducial marker
US11980506B2 (en) 2019-07-29 2024-05-14 Augmedics Ltd. Fiducial marker
US11382712B2 (en) 2019-12-22 2022-07-12 Augmedics Ltd. Mirroring in image guided surgery
US11389252B2 (en) 2020-06-15 2022-07-19 Augmedics Ltd. Rotating marker for image guided surgery
US12239385B2 (en) 2020-09-09 2025-03-04 Augmedics Ltd. Universal tool adapter
US11896445B2 (en) 2021-07-07 2024-02-13 Augmedics Ltd. Iliac pin and adapter
US12150821B2 (en) 2021-07-29 2024-11-26 Augmedics Ltd. Rotating marker and adapter for image-guided surgery
EP4388734A4 (en) 2021-08-18 2025-05-07 Augmedics Ltd. Stereoscopic display and digital magnifier for close-up augmented reality viewing
KR102627825B1 (ko) * 2021-08-30 2024-01-23 주식회사 레티널 회절 소자를 이용한 컴팩트형 증강 현실용 광학 장치
KR102660339B1 (ko) * 2021-10-22 2024-04-26 인하대학교 산학협력단 핀미러 홀로그래픽 광학 소자 배열을 이용해 확장된 아이박스를 갖는 도파관 형태의 투과형 맥스웰리안 근안 디스플레이
WO2023203521A1 (en) 2022-04-21 2023-10-26 Augmedics Ltd. Systems and methods for medical image visualization
KR102823347B1 (ko) * 2022-08-23 2025-06-20 주식회사 피앤씨솔루션 허상 거리가 조절되는 증강현실 글래스 장치
IL319523A (en) 2022-09-13 2025-05-01 Augmedics Ltd Augmented reality glasses for image-guided medical intervention
JP2024101879A (ja) * 2023-01-18 2024-07-30 トヨタ自動車株式会社 情報処理装置
KR102839536B1 (ko) * 2023-02-09 2025-07-28 주식회사 레티널 확장된 시야각 및 아이박스를 갖는 증강 현실용 광학 장치
KR20250045338A (ko) * 2023-09-25 2025-04-01 삼성전자주식회사 사용자의 시선을 추적하기 위한 전자 장치

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB384514A (en) * 1932-03-23 1932-12-08 Arthur Edward Barnwell Improvements relating to the focussing fronts of cameras
JPH11347016A (ja) * 1997-10-01 1999-12-21 Oki Electric Ind Co Ltd 撮像装置
JP2016521480A (ja) * 2013-03-22 2016-07-21 セイコーエプソン株式会社 赤外線ビデオ表示アイウェア
KR101807824B1 (ko) * 2016-11-16 2017-12-11 부경대학교 산학협력단 적외선 흡수 특성을 갖는 텍스트 문서를 이용하는 증강현실 시스템 및 그의 구현 방법
CN108474867A (zh) * 2015-12-18 2018-08-31 釜庆大学校产学协力团 高分辨率降水量资料复原系统及其方法
EP3640949A1 (en) * 2018-10-17 2020-04-22 Incremed AG Augmented reality with medical imaging

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9491425B2 (en) * 2012-07-10 2016-11-08 Empire Technology Development Llc Device and method for projecting a scrambled image
US9459451B2 (en) * 2013-12-26 2016-10-04 Microsoft Technology Licensing, Llc Eye tracking apparatus, method and system
US11103122B2 (en) * 2014-07-15 2021-08-31 Mentor Acquisition One, Llc Content presentation in head worn computing
US9377623B2 (en) * 2014-08-11 2016-06-28 Microsoft Technology Licensing, Llc Waveguide eye tracking employing volume Bragg grating
JP6576639B2 (ja) * 2015-01-16 2019-09-18 ミラマサービスインク 電子眼鏡および電子眼鏡の制御方法
CA2930738C (en) * 2015-08-24 2017-05-02 Synaptive Medical (Barbados) Inc. A medical imaging system for illuminating tissue samples using three-dimensional structured illumination microscopy
US10110883B2 (en) 2015-09-30 2018-10-23 Daqri, Llc Bidirectional holographic lens
KR101678009B1 (ko) 2016-03-07 2016-11-21 윤석진 웨어러블 디바이스를 활용한 현장 가시화와 요원관리를 위한 종합 시스템 및 그 서비스 방법
JP2018060011A (ja) * 2016-10-04 2018-04-12 株式会社島津製作所 表示装置
EP3568783A4 (en) * 2017-01-11 2020-11-11 Magic Leap, Inc. MEDICAL ASSISTANT
CN106782417B (zh) * 2017-03-03 2019-04-16 京东方科技集团股份有限公司 显示面板、显示系统、显示装置及其驱动方法
KR102438618B1 (ko) 2017-03-22 2022-08-30 매직 립, 인코포레이티드 동적 시야 가변 초점 디스플레이 시스템
JP7125423B2 (ja) * 2017-04-17 2022-08-24 アコニア ホログラフィックス、エルエルシー スキューミラー補助画像化
US11083537B2 (en) * 2017-04-24 2021-08-10 Alcon Inc. Stereoscopic camera with fluorescence visualization
WO2018213010A1 (en) * 2017-05-17 2018-11-22 Apple Inc. Head-mounted display device with vision correction
CN120161619A (zh) * 2017-09-21 2025-06-17 奇跃公司 具有被配置为捕获眼睛和/或环境的图像的波导的增强现实显示器
US10747309B2 (en) 2018-05-10 2020-08-18 Microsoft Technology Licensing, Llc Reconfigurable optics for switching between near-to-eye display modes
US20200018962A1 (en) * 2018-07-11 2020-01-16 Facebook Technologies, Llc Adaptive lenses for near-eye displays
CN111077670B (zh) 2018-10-18 2022-02-18 中强光电股份有限公司 光传递模块以及头戴式显示装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB384514A (en) * 1932-03-23 1932-12-08 Arthur Edward Barnwell Improvements relating to the focussing fronts of cameras
JPH11347016A (ja) * 1997-10-01 1999-12-21 Oki Electric Ind Co Ltd 撮像装置
JP2016521480A (ja) * 2013-03-22 2016-07-21 セイコーエプソン株式会社 赤外線ビデオ表示アイウェア
CN108474867A (zh) * 2015-12-18 2018-08-31 釜庆大学校产学协力团 高分辨率降水量资料复原系统及其方法
KR101807824B1 (ko) * 2016-11-16 2017-12-11 부경대학교 산학협력단 적외선 흡수 특성을 갖는 텍스트 문서를 이용하는 증강현실 시스템 및 그의 구현 방법
EP3640949A1 (en) * 2018-10-17 2020-04-22 Incremed AG Augmented reality with medical imaging

Also Published As

Publication number Publication date
CN113876422A (zh) 2022-01-04
KR102223621B1 (ko) 2021-03-05
EP3932361A1 (en) 2022-01-05
US11609425B2 (en) 2023-03-21
JP2022013882A (ja) 2022-01-18
JP2023159123A (ja) 2023-10-31
JP7324802B2 (ja) 2023-08-10
US20220003992A1 (en) 2022-01-06

Similar Documents

Publication Publication Date Title
CN113876422B (zh) 不可见光可视化自动配准型增强现实眼镜
CN109381158B (zh) 适配器、包含适配器的眼底照相系统及其使用方法
US8391567B2 (en) Multimodal ocular biometric system
US9295388B2 (en) Methods and apparatus for retinal imaging
JP2023159123A5 (enExample)
JP7075178B2 (ja) 広視野の網膜イメージャおよびその動作方法
CN110199517B (zh) 在单个对准处具有自动剪辑的宽视野眼底相机
TW201831953A (zh) 基於經由光導光學元件之視網膜成像的眼動追蹤器
US10452911B2 (en) Gaze-tracking system using curved photo-sensitive chip
CN108697321B (zh) 用于在限定操作范围内进行视线跟踪的装置
KR101999224B1 (ko) 내부 반사를 효과적으로 억제하기 위한 편광 빔 스플리터와 선형 편광필터를 사용한 안저카메라
WO2014127134A1 (en) Methods and apparatus for retinal imaging
JP2018060011A (ja) 表示装置
CN112946885A (zh) 近眼显示与取像头戴装置
US11058298B2 (en) Polarization fundus camera for effectively suppressing internal reflection
KR102055254B1 (ko) 수술 지원 영상을 제공하는 헤드 마운트 시스템
KR101651271B1 (ko) 광역학 진단 기기
JPH11347016A (ja) 撮像装置
CN213097817U (zh) 一种可更换镜头的手持式数字诊断系统
US20160242643A1 (en) Transparent Camera for Imaging the Eye
KR102852280B1 (ko) 촬영영상의 품질을 향상시킨 안운동 이상 질환 측정 ar 광학계 및 그를 포함하는 ar 장치
TWI727511B (zh) 近眼顯示與取像頭戴裝置
US20250082197A1 (en) Ar optical system for measurement of ocular dyskinesia with quality of photographed images and ar apparatus including the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant