WO2015142412A3 - Auto-alignment of image sensors in a multi-camera system - Google Patents

Auto-alignment of image sensors in a multi-camera system Download PDF

Info

Publication number
WO2015142412A3
WO2015142412A3 PCT/US2015/011490 US2015011490W WO2015142412A3 WO 2015142412 A3 WO2015142412 A3 WO 2015142412A3 US 2015011490 W US2015011490 W US 2015011490W WO 2015142412 A3 WO2015142412 A3 WO 2015142412A3
Authority
WO
WIPO (PCT)
Prior art keywords
cameras
pair
pixel shift
image sensors
auto
Prior art date
Application number
PCT/US2015/011490
Other languages
French (fr)
Other versions
WO2015142412A2 (en
Inventor
Timothy Macmillan
Scott Patrick CAMPBELL
David A. Newman
Yajie Sun
Original Assignee
Gopro, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/221,256 external-priority patent/US9197885B2/en
Priority claimed from US14/221,254 external-priority patent/US8988509B1/en
Application filed by Gopro, Inc. filed Critical Gopro, Inc.
Priority to CN201580021229.6A priority Critical patent/CN106233722B/en
Priority to EP15765335.3A priority patent/EP3120542A4/en
Publication of WO2015142412A2 publication Critical patent/WO2015142412A2/en
Publication of WO2015142412A3 publication Critical patent/WO2015142412A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/53—Control of the integration time
    • H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Studio Devices (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
PCT/US2015/011490 2014-03-20 2015-01-15 Auto-alignment of image sensors in a multi-camera system WO2015142412A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201580021229.6A CN106233722B (en) 2014-03-20 2015-01-15 The automatic alignment of imaging sensor in multicamera system
EP15765335.3A EP3120542A4 (en) 2014-03-20 2015-01-15 Auto-alignment of image sensors in a multi-camera system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US14/221,254 2014-03-20
US14/221,256 2014-03-20
US14/221,256 US9197885B2 (en) 2014-03-20 2014-03-20 Target-less auto-alignment of image sensors in a multi-camera system
US14/221,254 US8988509B1 (en) 2014-03-20 2014-03-20 Auto-alignment of image sensors in a multi-camera system

Publications (2)

Publication Number Publication Date
WO2015142412A2 WO2015142412A2 (en) 2015-09-24
WO2015142412A3 true WO2015142412A3 (en) 2015-11-12

Family

ID=54145462

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/011490 WO2015142412A2 (en) 2014-03-20 2015-01-15 Auto-alignment of image sensors in a multi-camera system

Country Status (3)

Country Link
EP (1) EP3120542A4 (en)
CN (1) CN106233722B (en)
WO (1) WO2015142412A2 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107333130B (en) * 2017-08-24 2019-04-23 歌尔股份有限公司 Assemble multi-cam module testing method and system
KR20190051146A (en) * 2017-11-06 2019-05-15 에스케이하이닉스 주식회사 Image synchronizing device and image data generating device
CN109839378B (en) * 2017-11-24 2020-07-28 苏州精濑光电有限公司 Rapid optical correction method
JP7027844B2 (en) * 2017-11-29 2022-03-02 株式会社デンソー The camera module
CN110770669A (en) * 2018-08-28 2020-02-07 深圳市大疆创新科技有限公司 Target position marking method of holder, holder and shooting device
US11601575B2 (en) 2018-09-14 2023-03-07 Gopro, Inc. Electrical connectivity between detachable components
CN112261262B (en) * 2020-10-21 2022-06-17 维沃移动通信有限公司 Image calibration method and device, electronic equipment and readable storage medium
CN113177440A (en) * 2021-04-09 2021-07-27 深圳市商汤科技有限公司 Image synchronization method and device, electronic equipment and computer storage medium
CN115412719B (en) * 2021-05-26 2024-03-01 致伸科技股份有限公司 Method for aligning camera lens and light source
WO2023067867A1 (en) * 2021-10-21 2023-04-27 日立Astemo株式会社 Vehicle-mounted control device, and three-dimensional information acquisition method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110222757A1 (en) * 2010-03-10 2011-09-15 Gbo 3D Technology Pte. Ltd. Systems and methods for 2D image and spatial data capture for 3D stereo imaging
US20120081519A1 (en) * 2010-04-05 2012-04-05 Qualcomm Incorporated Combining data from multiple image sensors
US20130229497A1 (en) * 2010-11-05 2013-09-05 Transvideo Method and device for monitoring phase shifting between stereoscopic cameras

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3958638B2 (en) * 2002-06-25 2007-08-15 富士重工業株式会社 Stereo image processing apparatus and stereo image processing method
US8300086B2 (en) * 2007-12-20 2012-10-30 Nokia Corporation Image processing for supporting a stereoscopic presentation
JP5683025B2 (en) * 2010-04-19 2015-03-11 パナソニックＩｐマネジメント株式会社 Stereoscopic image capturing apparatus and stereoscopic image capturing method
JP2012198075A (en) * 2011-03-18 2012-10-18 Ricoh Co Ltd Stereoscopic camera device and image adjusting method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110222757A1 (en) * 2010-03-10 2011-09-15 Gbo 3D Technology Pte. Ltd. Systems and methods for 2D image and spatial data capture for 3D stereo imaging
US20120081519A1 (en) * 2010-04-05 2012-04-05 Qualcomm Incorporated Combining data from multiple image sensors
US20130229497A1 (en) * 2010-11-05 2013-09-05 Transvideo Method and device for monitoring phase shifting between stereoscopic cameras

Also Published As

Publication number Publication date
CN106233722B (en) 2018-05-15
EP3120542A2 (en) 2017-01-25
CN106233722A (en) 2016-12-14
WO2015142412A2 (en) 2015-09-24
EP3120542A4 (en) 2017-03-01

Similar Documents

Publication Publication Date Title
WO2015142412A3 (en) Auto-alignment of image sensors in a multi-camera system
WO2016077057A3 (en) Imaging systems and methods
WO2018106671A3 (en) Distance sensor including adjustable focus imaging sensor
WO2016203078A3 (en) Ir or thermal image enhancement method based on background information for video analysis
EP3866052A4 (en) Face anti-spoof detection method, device and multi-view camera
EP2268048A3 (en) Distance measuring apparatus having dual stereo camera
EP3439040A4 (en) Solid-state image pickup element, sensor device, and electronic apparatus
WO2015015383A3 (en) Thin multi-aperture imaging system with auto-focus and methods for using same
WO2014111814A3 (en) Stereo assist with rolling shutters
EP3119078A3 (en) Image capturing device and auto-focus method thereof
WO2015162605A3 (en) System and method for controlling a camera based on processing an image captured by other camera
MX2017006717A (en) Method of controlling a traffic surveillance system.
WO2018025115A3 (en) Method and system for calibrating components of an inertial measurement unit (imu) using scene-captured data
WO2008016566A3 (en) Focus system calibration for image capture systems
GB2577353B (en) A pixel unit, image sensor and camera
EP3591963A4 (en) Image sensor, camera module, and electronic device
WO2017220600A3 (en) Method for calibrating an image-capturing sensor consisting of at least one sensor camera, using a time-coded patterned target
WO2014170670A3 (en) Imaging apparatus and method
EP3751840A4 (en) Solid-state image sensor and imaging device
EP3606028A4 (en) Image sensor, camera module, and electronic device
EP3606027A4 (en) Image sensor, camera module, and electronic device
EP3618425A4 (en) Dual-core focusing image sensor, focusing control method thereof, and imaging device
WO2011054971A3 (en) Method and system for detecting the movement of objects
WO2008155961A1 (en) Distance measuring device
GB201817739D0 (en) Cmos pixel, image sensor and camera, and method for reading a cmos pixel

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15765335

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2015765335

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015765335

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15765335

Country of ref document: EP

Kind code of ref document: A2