JP2023525508A - 畳み込みベースのカメラおよびディスプレイ較正 - Google Patents

畳み込みベースのカメラおよびディスプレイ較正 Download PDF

Info

Publication number
JP2023525508A
JP2023525508A JP2022567088A JP2022567088A JP2023525508A JP 2023525508 A JP2023525508 A JP 2023525508A JP 2022567088 A JP2022567088 A JP 2022567088A JP 2022567088 A JP2022567088 A JP 2022567088A JP 2023525508 A JP2023525508 A JP 2023525508A
Authority
JP
Japan
Prior art keywords
image
matrices
target
unique patterns
tiles
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022567088A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023525508A5 (OSRAM
Inventor
マイケル アレクサンダー サワーズ，
ジヘン ジア，
ハンス ブランドン ワック，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023525508A publication Critical patent/JP2023525508A/ja
Publication of JP2023525508A5 publication Critical patent/JP2023525508A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G06T2207/30208—Marker matrix
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0693—Calibration of display systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/145—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light originating from the display screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
    • G09G5/32—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory with means for controlling the display position

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
JP2022567088A 2020-05-06 2021-05-05 畳み込みベースのカメラおよびディスプレイ較正 Pending JP2023525508A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063020787P 2020-05-06 2020-05-06
US63/020,787 2020-05-06
PCT/US2021/030962 WO2021226282A1 (en) 2020-05-06 2021-05-05 Convolution-based camera and display calibration

Publications (2)

Publication Number Publication Date
JP2023525508A true JP2023525508A (ja) 2023-06-16
JP2023525508A5 JP2023525508A5 (OSRAM) 2024-05-01

Family

ID=78412937

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022567088A Pending JP2023525508A (ja) 2020-05-06 2021-05-05 畳み込みベースのカメラおよびディスプレイ較正

Country Status (5)

Country Link
US (1) US11704834B2 (OSRAM)
EP (1) EP4147206A4 (OSRAM)
JP (1) JP2023525508A (OSRAM)
CN (1) CN115516513A (OSRAM)
WO (1) WO2021226282A1 (OSRAM)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD951961S1 (en) * 2020-01-30 2022-05-17 Magic Leap, Inc. Head strap
EP4195665A1 (en) * 2021-12-08 2023-06-14 Harman Becker Automotive Systems GmbH Calibration arrangement and calibration method
CN115272459A (zh) * 2022-07-06 2022-11-01 同济大学 一种四角二维码定向平面靶标装置及其标定方法
CN115423804B (zh) * 2022-11-02 2023-03-21 依未科技(北京)有限公司 影像标定方法及装置、影像处理方法
CN116125669A (zh) * 2023-01-31 2023-05-16 富泰华工业（深圳）有限公司 显示装置及拍摄视野的调制方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005110252A (ja) * 2003-09-26 2005-04-21 Mitsubishi Electric Research Laboratories Inc リアプロジェクションテレビにおいて収束誤差を補正する装置および方法
US8401294B1 (en) * 2008-12-30 2013-03-19 Lucasfilm Entertainment Company Ltd. Pattern matching using convolution of mask image and search image
US20170374360A1 (en) * 2016-06-28 2017-12-28 Magic Leap, Inc. Camera calibration system, target, and process
US20190104295A1 (en) * 2017-09-29 2019-04-04 Waymo Llc Target, Method, and System for Camera Calibration
JP2019161278A (ja) * 2018-03-07 2019-09-19 株式会社リコー 校正基準点取得システム、及び校正基準点取得方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8106949B2 (en) * 2009-03-26 2012-01-31 Seiko Epson Corporation Small memory footprint light transport matrix capture
US9172913B1 (en) * 2010-09-24 2015-10-27 Jetprotect Corporation Automatic counter-surveillance detection camera and software
EP2742484B1 (en) * 2011-07-25 2016-08-31 Universidade de Coimbra Method and apparatus for automatic camera calibration using one or more images of a checkerboard pattern
CN106611148B (zh) * 2015-10-21 2020-04-24 北京百度网讯科技有限公司 基于图像的离线公式识别方法和装置
US10958843B2 (en) * 2018-05-04 2021-03-23 Raytheon Technologies Corporation Multi-camera system for simultaneous registration and zoomed imagery
CN118840433A (zh) * 2018-05-25 2024-10-25 派克赛斯有限责任公司 用于多相机放置的系统和方法
US11361474B2 (en) 2018-08-03 2022-06-14 Magic Leap, Inc. Method and system for subgrid calibration of a display device
CN109086753B (zh) * 2018-10-08 2022-05-10 新疆大学 基于双通道卷积神经网络的交通标志识别方法、装置
CA3131071C (en) * 2019-04-04 2025-06-10 Centerline Biomedical, Inc. SPATIAL REGISTRATION OF A TRACKING SYSTEM WITH AN IMAGE USING TWO-DIMENSIONAL IMAGE PROJECTIONS
WO2021077078A1 (en) * 2019-10-18 2021-04-22 Looking Glass Factory, Inc. System and method for lightfield capture
US20210256729A1 (en) * 2020-02-13 2021-08-19 Proprio, Inc. Methods and systems for determining calibration quality metrics for a multicamera imaging system
US11206294B2 (en) * 2020-03-31 2021-12-21 Konica Minolta Business Solutions U.S.A., Inc. Method for separating local and remote content in a camera-projector based collaborative system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005110252A (ja) * 2003-09-26 2005-04-21 Mitsubishi Electric Research Laboratories Inc リアプロジェクションテレビにおいて収束誤差を補正する装置および方法
US8401294B1 (en) * 2008-12-30 2013-03-19 Lucasfilm Entertainment Company Ltd. Pattern matching using convolution of mask image and search image
US20170374360A1 (en) * 2016-06-28 2017-12-28 Magic Leap, Inc. Camera calibration system, target, and process
US20190104295A1 (en) * 2017-09-29 2019-04-04 Waymo Llc Target, Method, and System for Camera Calibration
JP2019161278A (ja) * 2018-03-07 2019-09-19 株式会社リコー 校正基準点取得システム、及び校正基準点取得方法

Also Published As

Publication number Publication date
WO2021226282A1 (en) 2021-11-11
EP4147206A1 (en) 2023-03-15
CN115516513A (zh) 2022-12-23
US11704834B2 (en) 2023-07-18
EP4147206A4 (en) 2023-11-08
US20210350574A1 (en) 2021-11-11

Similar Documents

Publication Publication Date Title
US12169276B2 (en) Head-mounted display for virtual and mixed reality with inside-out positional, user body and environment tracking
US11704834B2 (en) Convolution-based camera and display calibration
US11386572B2 (en) Calibration system and method to align a 3D virtual scene and a 3D real world for a stereoscopic head-mounted display
US10192361B2 (en) Head-mounted display device and computer program
US10269139B2 (en) Computer program, head-mounted display device, and calibration method
KR102777120B1 (ko) Vr/ar 응용에서 심도 증강을 위한 다중-기선 카메라 어레이 시스템 아키텍처
US20200027201A1 (en) Augmented reality system and color compensation method thereof
US10482663B2 (en) Virtual cues for augmented-reality pose alignment
US20160033770A1 (en) Head-mounted display device, control method of head-mounted display device, and display system
US10896494B1 (en) Dirty lens image correction
EP3752898A1 (en) External ir illuminator enabling improved head tracking and surface reconstruction for virtual reality
US20190197994A1 (en) Display system, electronic device, and display method
EP4158447A1 (en) Systems and methods for providing mixed-reality experiences under low light conditions
KR20250002838A (ko) 분리가능한 왜곡 불일치 결정
US20210097749A1 (en) Stylized image painting
WO2021066970A1 (en) Multi-dimensional rendering
EP4198873A1 (en) Sparse rgb filter hardware accelerator
JP7501044B2 (ja) 表示システム、情報処理装置及び表示システムの表示制御方法
EP2706508B1 (en) Reducing latency in an augmented-reality display
JP2026023767A (ja) 画像処理装置、画像処理方法、およびプログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240419

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240419

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20240419

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240529

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20240613

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20240627

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240827

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20241224

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250321

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20250617