CA3083350A1 - Method for calibrating an augmented reality device - Google Patents

Method for calibrating an augmented reality device Download PDF

Info

Publication number
CA3083350A1
CA3083350A1 CA3083350A CA3083350A CA3083350A1 CA 3083350 A1 CA3083350 A1 CA 3083350A1 CA 3083350 A CA3083350 A CA 3083350A CA 3083350 A CA3083350 A CA 3083350A CA 3083350 A1 CA3083350 A1 CA 3083350A1
Authority
CA
Canada
Prior art keywords
calibration
sensor
parameter
calibrated
rotation parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3083350A
Other languages
English (en)
French (fr)
Inventor
Yu-Tseh CHI
Jean-Yves Bouguet
Divya SHARMA
Lei Huang
Dennis William STRELOW
Etienne Gregoire GROSSMAN
Evan Gregory LEVINE
Adam HARMAT
Ashwin Swaminathan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CA3083350A1 publication Critical patent/CA3083350A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85—Stereo camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0693—Calibration of display systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Testing Or Calibration Of Command Recording Devices (AREA)
  • Indication And Recording Devices For Special Purposes And Tariff Metering Devices (AREA)
CA3083350A 2017-12-21 2018-12-21 Method for calibrating an augmented reality device Pending CA3083350A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762609242P 2017-12-21 2017-12-21
US62/609,242 2017-12-21
PCT/US2018/067214 WO2019126714A1 (en) 2017-12-21 2018-12-21 Method for calibrating an augmented reality device

Publications (1)

Publication Number Publication Date
CA3083350A1 true CA3083350A1 (en) 2019-06-27

Family

ID=66951379

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3083350A Pending CA3083350A1 (en) 2017-12-21 2018-12-21 Method for calibrating an augmented reality device

Country Status (9)

Country Link
US (2) US10854165B2 (he)
EP (1) EP3729693B1 (he)
JP (1) JP7046189B2 (he)
KR (1) KR102627352B1 (he)
CN (1) CN111512574B (he)
AU (1) AU2018389234B2 (he)
CA (1) CA3083350A1 (he)
IL (1) IL275383B2 (he)
WO (1) WO2019126714A1 (he)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11244649B2 (en) 2017-12-21 2022-02-08 Magic Leap, Inc. Calibration of augmented reality device

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2992065T3 (es) 2016-08-16 2024-12-09 Insight Medical Systems Inc Sistemas de aumento sensorial en procedimientos médicos
US10552497B2 (en) 2016-08-16 2020-02-04 International Business Machines Corporation Unbiasing search results
US20190057180A1 (en) * 2017-08-18 2019-02-21 International Business Machines Corporation System and method for design optimization using augmented reality
WO2020014700A1 (en) 2018-07-13 2020-01-16 Magic Leap, Inc. Systems and methods for display binocular deformation compensation
US11212509B2 (en) 2018-12-20 2021-12-28 Snap Inc. Flexible eyewear device with dual cameras for generating stereoscopic images
US10827116B1 (en) * 2019-08-26 2020-11-03 Juan Ramon Terven Self calibration system for moving cameras
EP4070538B1 (en) 2019-12-06 2025-11-12 Magic Leap, Inc. Encoding stereo splash screen in static image
US11846782B1 (en) * 2020-04-13 2023-12-19 Apple Inc. Electronic devices with deformation sensors
EP3901913A1 (en) * 2020-04-22 2021-10-27 Continental Automotive GmbH Single camera calibration
US11391596B2 (en) * 2020-04-28 2022-07-19 Vgis Inc. System and method for converging mediated reality positioning data and geographic positioning data
US12482134B2 (en) 2020-09-23 2025-11-25 Magic Leap, Inc. Joint camera and inertial measurement unit calibration
US12519921B2 (en) 2020-12-04 2026-01-06 Magic Leap, Inc. Miscalibration detection for virtual reality and augmented reality systems
CN114765667B (zh) * 2021-01-13 2025-09-09 安霸国际有限合伙企业 用于多视图拼接的固定图案校准
US20250052593A1 (en) * 2021-03-03 2025-02-13 Qwake Technologies, Inc. Map Refinement for Inside-Out Location Tracking and Mapping System
GB2605442B (en) * 2021-04-01 2023-03-22 Xyz Reality Ltd Configuration method for the display of a building information model
KR102603467B1 (ko) * 2021-07-12 2023-11-17 클레이웍스 주식회사 디지털 트윈 연동 증강현실 카메라를 통한 공간 형성 및 측위 오차 보정 시스템 및 그 방법
WO2023150614A1 (en) * 2022-02-02 2023-08-10 Google Llc Case for smartglasses with calibration capabilities
US11887513B2 (en) 2022-02-02 2024-01-30 Google Llc Case for smartglasses with calibration capabilities
US12225291B2 (en) 2022-02-02 2025-02-11 Ford Global Technologies, Llc System, method, and computer program product for online sensor motion compensation
US12323574B2 (en) * 2022-05-09 2025-06-03 Zoox, Inc. Sensor calibration validation
US12333762B2 (en) 2022-09-15 2025-06-17 Apple Inc. Methods for camera calibration via bundle adjustment
US12456225B2 (en) 2022-09-15 2025-10-28 Apple Inc. Methods for infield camera calibrations
US12435996B2 (en) 2023-09-28 2025-10-07 Snap Inc. Field calibration of an augmented reality device
US20250334459A1 (en) * 2024-04-24 2025-10-30 Htc Corporation Electronic device, parameter calibration method, and non-transitory computer readable storage medium

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000182026A (ja) 1998-12-14 2000-06-30 Ricoh Co Ltd 画像処理装置、画像処理方法およびその方法をコンピュータに実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体
JP4807194B2 (ja) 2006-09-06 2011-11-02 カシオ計算機株式会社 画像処理装置及びプログラム
EP2154650A1 (en) * 2008-08-12 2010-02-17 IEE INTERNATIONAL ELECTRONICS & ENGINEERING S.A. 3D time-of-flight camera system and position/orientation calibration method therefor
US10198865B2 (en) * 2014-07-10 2019-02-05 Seiko Epson Corporation HMD calibration with direct geometric modeling
US9693040B2 (en) 2014-09-10 2017-06-27 Faro Technologies, Inc. Method for optically measuring three-dimensional coordinates and calibration of a three-dimensional measuring device
US10084960B2 (en) * 2014-10-10 2018-09-25 Iec Infrared Systems, Llc Panoramic view imaging system with drone integration
US10152119B2 (en) * 2014-12-11 2018-12-11 Htc Corporation Head-mounted display apparatus and calibration method thereof
US9852546B2 (en) * 2015-01-28 2017-12-26 CCP hf. Method and system for receiving gesture input via virtual control objects
US10187629B2 (en) * 2016-04-06 2019-01-22 Facebook, Inc. Camera calibration system
US10762651B2 (en) 2016-09-30 2020-09-01 Magic Leap, Inc. Real time calibration for time-of-flight depth measurement
IL275383B2 (he) 2017-12-21 2024-08-01 Magic Leap Inc שיטה לכיול מכשיר מציאות רבודה

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11244649B2 (en) 2017-12-21 2022-02-08 Magic Leap, Inc. Calibration of augmented reality device

Also Published As

Publication number Publication date
US11244649B2 (en) 2022-02-08
KR102627352B1 (ko) 2024-01-18
JP7046189B2 (ja) 2022-04-01
EP3729693A4 (en) 2021-01-20
WO2019126714A1 (en) 2019-06-27
AU2018389234B2 (en) 2023-06-01
EP3729693A1 (en) 2020-10-28
US10854165B2 (en) 2020-12-01
US20210118401A1 (en) 2021-04-22
IL275383B1 (he) 2024-04-01
EP3729693B1 (en) 2023-09-06
CN111512574B (zh) 2023-04-11
KR20200100102A (ko) 2020-08-25
JP2021507393A (ja) 2021-02-22
CN111512574A (zh) 2020-08-07
AU2018389234A1 (en) 2020-06-04
IL275383B2 (he) 2024-08-01
US20190197982A1 (en) 2019-06-27
IL275383A (he) 2020-07-30

Similar Documents

Publication Publication Date Title
AU2018389234B2 (en) Method for calibrating an augmented reality device
US11928838B2 (en) Calibration system and method to align a 3D virtual scene and a 3D real world for a stereoscopic head-mounted display
JP7068562B2 (ja) 拡張現実データを記録するための手法
US10269139B2 (en) Computer program, head-mounted display device, and calibration method
US10896497B2 (en) Inconsistency detecting system, mixed-reality system, program, and inconsistency detecting method
CN116309854B (zh) 标定增强现实设备的方法、装置、设备、系统及存储介质
US9759918B2 (en) 3D mapping with flexible camera rig
JP6008397B2 (ja) 光学式シースルー型ｈｍｄを用いたａｒシステム
WO2019074503A1 (en) HEAD-ON DISPLAY MONITORING SYSTEM
WO2016095057A1 (en) Peripheral tracking for an augmented reality head mounted device
KR20060106773A (ko) 캘리브레이션 방법 및 장치
US20240061251A1 (en) Low motion to photon latency rapid target acquisition
KR20200003719A (ko) 화상 처리장치, 화상 처리방법, 및 기억매체
WO2014174109A1 (en) Computer graphics presentation system and method
US11704834B2 (en) Convolution-based camera and display calibration
US10992928B1 (en) Calibration system for concurrent calibration of device sensors
KR101419044B1 (ko) 3d 가상 객체의 그림자를 표시하기 위한 방법, 시스템 및 컴퓨터 판독 가능한 기록 매체
JP6975001B2 (ja) 傾き測定装置及び傾き測定方法
JP6061334B2 (ja) 光学式シースルー型ｈｍｄを用いたａｒシステム
US20240242327A1 (en) Frame Selection for Image Matching in Rapid Target Acquisition
JP2024034143A (ja) 情報処理装置および情報処理方法
CN121685809A (zh) 三维人体模型参数拟合方法、装置和电子设备
JP2016145733A (ja) 情報処理装置およびその方法