CN115516513A - 基于卷积的相机和显示器校准 - Google Patents

基于卷积的相机和显示器校准 Download PDF

Info

Publication number
CN115516513A
CN115516513A CN202180033037.2A CN202180033037A CN115516513A CN 115516513 A CN115516513 A CN 115516513A CN 202180033037 A CN202180033037 A CN 202180033037A CN 115516513 A CN115516513 A CN 115516513A
Authority
CN
China
Prior art keywords
image
target
matrices
unique
pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180033037.2A
Other languages
English (en)
Chinese (zh)
Inventor
M·A·苏里斯
贾志恒
H·B·瓦赫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CN115516513A publication Critical patent/CN115516513A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G06T2207/30208—Marker matrix
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0693—Calibration of display systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/145—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light originating from the display screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
    • G09G5/32—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory with means for controlling the display position

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
CN202180033037.2A 2020-05-06 2021-05-05 基于卷积的相机和显示器校准 Pending CN115516513A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063020787P 2020-05-06 2020-05-06
US63/020,787 2020-05-06
PCT/US2021/030962 WO2021226282A1 (en) 2020-05-06 2021-05-05 Convolution-based camera and display calibration

Publications (1)

Publication Number Publication Date
CN115516513A true CN115516513A (zh) 2022-12-23

Family

ID=78412937

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180033037.2A Pending CN115516513A (zh) 2020-05-06 2021-05-05 基于卷积的相机和显示器校准

Country Status (5)

Country Link
US (1) US11704834B2 (OSRAM)
EP (1) EP4147206A4 (OSRAM)
JP (1) JP2023525508A (OSRAM)
CN (1) CN115516513A (OSRAM)
WO (1) WO2021226282A1 (OSRAM)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD951961S1 (en) * 2020-01-30 2022-05-17 Magic Leap, Inc. Head strap
EP4195665A1 (en) * 2021-12-08 2023-06-14 Harman Becker Automotive Systems GmbH Calibration arrangement and calibration method
CN115272459A (zh) * 2022-07-06 2022-11-01 同济大学 一种四角二维码定向平面靶标装置及其标定方法
CN115423804B (zh) * 2022-11-02 2023-03-21 依未科技(北京)有限公司 影像标定方法及装置、影像处理方法
CN116125669A (zh) * 2023-01-31 2023-05-16 富泰华工业（深圳）有限公司 显示装置及拍摄视野的调制方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8401294B1 (en) * 2008-12-30 2013-03-19 Lucasfilm Entertainment Company Ltd. Pattern matching using convolution of mask image and search image
CN103827917A (zh) * 2011-07-25 2014-05-28 科英布拉大学 用于使用棋盘图案的一幅或多幅图像的自动相机校准的方法和装置
CN106611148A (zh) * 2015-10-21 2017-05-03 北京百度网讯科技有限公司 基于图像的离线公式识别方法和装置
US20170374360A1 (en) * 2016-06-28 2017-12-28 Magic Leap, Inc. Camera calibration system, target, and process
CN109086753A (zh) * 2018-10-08 2018-12-25 新疆大学 基于双通道卷积神经网络的交通标志识别方法、装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7227592B2 (en) * 2003-09-26 2007-06-05 Mitsubishi Electric Research Laboratories, Inc. Self-correcting rear projection television
US8106949B2 (en) * 2009-03-26 2012-01-31 Seiko Epson Corporation Small memory footprint light transport matrix capture
US9172913B1 (en) * 2010-09-24 2015-10-27 Jetprotect Corporation Automatic counter-surveillance detection camera and software
US10432912B2 (en) * 2017-09-29 2019-10-01 Waymo Llc Target, method, and system for camera calibration
JP2019161278A (ja) * 2018-03-07 2019-09-19 株式会社リコー 校正基準点取得システム、及び校正基準点取得方法
US10958843B2 (en) * 2018-05-04 2021-03-23 Raytheon Technologies Corporation Multi-camera system for simultaneous registration and zoomed imagery
CN118840433A (zh) * 2018-05-25 2024-10-25 派克赛斯有限责任公司 用于多相机放置的系统和方法
US11361474B2 (en) 2018-08-03 2022-06-14 Magic Leap, Inc. Method and system for subgrid calibration of a display device
CA3131071C (en) * 2019-04-04 2025-06-10 Centerline Biomedical, Inc. SPATIAL REGISTRATION OF A TRACKING SYSTEM WITH AN IMAGE USING TWO-DIMENSIONAL IMAGE PROJECTIONS
WO2021077078A1 (en) * 2019-10-18 2021-04-22 Looking Glass Factory, Inc. System and method for lightfield capture
US20210256729A1 (en) * 2020-02-13 2021-08-19 Proprio, Inc. Methods and systems for determining calibration quality metrics for a multicamera imaging system
US11206294B2 (en) * 2020-03-31 2021-12-21 Konica Minolta Business Solutions U.S.A., Inc. Method for separating local and remote content in a camera-projector based collaborative system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8401294B1 (en) * 2008-12-30 2013-03-19 Lucasfilm Entertainment Company Ltd. Pattern matching using convolution of mask image and search image
CN103827917A (zh) * 2011-07-25 2014-05-28 科英布拉大学 用于使用棋盘图案的一幅或多幅图像的自动相机校准的方法和装置
CN106611148A (zh) * 2015-10-21 2017-05-03 北京百度网讯科技有限公司 基于图像的离线公式识别方法和装置
US20170374360A1 (en) * 2016-06-28 2017-12-28 Magic Leap, Inc. Camera calibration system, target, and process
CN109086753A (zh) * 2018-10-08 2018-12-25 新疆大学 基于双通道卷积神经网络的交通标志识别方法、装置

Also Published As

Publication number Publication date
JP2023525508A (ja) 2023-06-16
WO2021226282A1 (en) 2021-11-11
EP4147206A1 (en) 2023-03-15
US11704834B2 (en) 2023-07-18
EP4147206A4 (en) 2023-11-08
US20210350574A1 (en) 2021-11-11

Similar Documents

Publication Publication Date Title
US11704834B2 (en) Convolution-based camera and display calibration
US10192361B2 (en) Head-mounted display device and computer program
US20230324684A1 (en) Head-mounted display for virtual and mixed reality with inside-out positional, user body and environment tracking
US9880384B2 (en) Gaze detection system, gaze point detection method, and gaze point detection program
CN106643699B (zh) 一种虚拟现实系统中的空间定位装置和定位方法
US10424117B2 (en) Controlling a display of a head-mounted display device
US12075020B2 (en) Active stereo matching for depth applications
US10469836B2 (en) Head-mounted display device and computer program
EP3752898B1 (en) External ir illuminator enabling improved head tracking and surface reconstruction for virtual reality
US20140307100A1 (en) Orthographic image capture system
WO2015012280A1 (ja) 視線検出装置
US20230326119A1 (en) Stylized image painting
US10896494B1 (en) Dirty lens image correction
JP2018160735A (ja) 透過型表示装置、表示制御方法、およびコンピュータープログラム
KR20230079138A (ko) 스트레인 게이지 추정 기능을 갖는 아이웨어
US11589024B2 (en) Multi-dimensional rendering
KR20250002838A (ko) 분리가능한 왜곡 불일치 결정
JP2017102696A (ja) 頭部装着型表示装置およびコンピュータープログラム
US20190086677A1 (en) Head mounted display device and control method for head mounted display device
EP2706508B1 (en) Reducing latency in an augmented-reality display
RU229691U1 (ru) Устройство для вычисления собственного положения и ориентации в пространстве
US20240394921A1 (en) Object localization and information encoding system
JP2017102269A (ja) 頭部装着型表示装置およびコンピュータープログラム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination