KR102272254B1 - 위상 검출 픽셀을 이용하여 깊이 맵을 생성하기 위한 영상 생성 장치 - Google Patents

위상 검출 픽셀을 이용하여 깊이 맵을 생성하기 위한 영상 생성 장치 Download PDF

Info

Publication number
KR102272254B1
KR102272254B1 KR1020150022298A KR20150022298A KR102272254B1 KR 102272254 B1 KR102272254 B1 KR 102272254B1 KR 1020150022298 A KR1020150022298 A KR 1020150022298A KR 20150022298 A KR20150022298 A KR 20150022298A KR 102272254 B1 KR102272254 B1 KR 102272254B1
Authority
KR
South Korea
Prior art keywords
phase
depth map
lens
image
image sensor
Prior art date
Application number
KR1020150022298A
Other languages
English (en)
Korean (ko)
Other versions
KR20160099948A (ko
Inventor
왕태식
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority to KR1020150022298A priority Critical patent/KR102272254B1/ko
Priority to US14/963,753 priority patent/US10337861B2/en
Priority to DE102016100031.0A priority patent/DE102016100031A1/de
Priority to JP2016017442A priority patent/JP6731738B2/ja
Priority to CN201610074226.5A priority patent/CN105898281B/zh
Publication of KR20160099948A publication Critical patent/KR20160099948A/ko
Application granted granted Critical
Publication of KR102272254B1 publication Critical patent/KR102272254B1/ko

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C3/00—Measuring distances in line of sight; Optical rangefinders
    • G01C3/32—Measuring distances in line of sight; Optical rangefinders by focusing the object, e.g. on a ground glass screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/229—Image signal generators using stereoscopic image cameras using a single 2D image sensor using lenticular lenses, e.g. arrangements of cylindrical lenses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10148—Varying focus

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Studio Devices (AREA)
  • Automatic Focus Adjustment (AREA)
  • Measurement Of Optical Distance (AREA)
  • Focusing (AREA)
KR1020150022298A 2015-02-13 2015-02-13 위상 검출 픽셀을 이용하여 깊이 맵을 생성하기 위한 영상 생성 장치 KR102272254B1 (ko)

Priority Applications (5)

Application Number Priority Date Filing Date Title
KR1020150022298A KR102272254B1 (ko) 2015-02-13 2015-02-13 위상 검출 픽셀을 이용하여 깊이 맵을 생성하기 위한 영상 생성 장치
US14/963,753 US10337861B2 (en) 2015-02-13 2015-12-09 Image generating device for generating depth map with phase detection pixel
DE102016100031.0A DE102016100031A1 (de) 2015-02-13 2016-01-04 Bilderzeugungsvorrichtung zum Erzeugen einer Tiefenkarte mit Phasenerfassungspixel
JP2016017442A JP6731738B2 (ja) 2015-02-13 2016-02-01 位相検出ピクセルを利用して深さマップを生成するための映像生成装置
CN201610074226.5A CN105898281B (zh) 2015-02-13 2016-02-02 用于使用相位检测像素生成深度图的图像生成装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150022298A KR102272254B1 (ko) 2015-02-13 2015-02-13 위상 검출 픽셀을 이용하여 깊이 맵을 생성하기 위한 영상 생성 장치

Publications (2)

Publication Number Publication Date
KR20160099948A KR20160099948A (ko) 2016-08-23
KR102272254B1 true KR102272254B1 (ko) 2021-07-06

Family

ID=56551790

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150022298A KR102272254B1 (ko) 2015-02-13 2015-02-13 위상 검출 픽셀을 이용하여 깊이 맵을 생성하기 위한 영상 생성 장치

Country Status (5)

Country Link
US (1) US10337861B2 (ja)
JP (1) JP6731738B2 (ja)
KR (1) KR102272254B1 (ja)
CN (1) CN105898281B (ja)
DE (1) DE102016100031A1 (ja)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10148864B2 (en) * 2015-07-02 2018-12-04 Pixart Imaging Inc. Imaging device having phase detection pixels and regular pixels, and operating method thereof
WO2017015580A1 (en) 2015-07-23 2017-01-26 Artilux Corporation High efficiency wide spectrum sensor
US10707260B2 (en) 2015-08-04 2020-07-07 Artilux, Inc. Circuit for operating a multi-gate VIS/IR photodiode
US10861888B2 (en) 2015-08-04 2020-12-08 Artilux, Inc. Silicon germanium imager with photodiode in trench
US10761599B2 (en) 2015-08-04 2020-09-01 Artilux, Inc. Eye gesture tracking
TW202335281A (zh) 2015-08-04 2023-09-01 光程研創股份有限公司 光感測系統
EP3783656B1 (en) 2015-08-27 2023-08-23 Artilux Inc. Wide spectrum optical sensor
GB2598525B (en) 2015-09-16 2022-06-01 Canon Kk Image sensor and image capturing apparatus
GB2596029B (en) * 2015-09-16 2022-07-27 Canon Kk Image sensor and image capturing apparatus
JP6664177B2 (ja) * 2015-09-28 2020-03-13 キヤノン株式会社 焦点検出装置、予測方法、プログラム及び記憶媒体
US10254389B2 (en) 2015-11-06 2019-04-09 Artilux Corporation High-speed light sensing apparatus
US10418407B2 (en) 2015-11-06 2019-09-17 Artilux, Inc. High-speed light sensing apparatus III
US10741598B2 (en) 2015-11-06 2020-08-11 Atrilux, Inc. High-speed light sensing apparatus II
US10739443B2 (en) 2015-11-06 2020-08-11 Artilux, Inc. High-speed light sensing apparatus II
US10886309B2 (en) 2015-11-06 2021-01-05 Artilux, Inc. High-speed light sensing apparatus II
JP6786253B2 (ja) * 2016-04-15 2020-11-18 キヤノン株式会社 撮像システム、情報処理装置、撮像システムの制御方法、情報処理装置の制御方法、及びプログラム
KR101859040B1 (ko) * 2016-09-22 2018-05-17 엘지전자 주식회사 차량용 카메라 장치 및 방법
JP6759347B2 (ja) * 2016-09-23 2020-09-23 日本電信電話株式会社 画像生成装置、画像生成方法、およびプログラム
KR102392751B1 (ko) * 2017-03-07 2022-04-29 삼성전자 주식회사 카메라 모듈을 구비한 전자 장치 및 전자 장치 제어 방법
CN106996938A (zh) * 2017-03-07 2017-08-01 天津大学 超宽带微波目标检测的fpga成像系统
US10419664B2 (en) * 2017-12-28 2019-09-17 Semiconductor Components Industries, Llc Image sensors with phase detection pixels and a variable aperture
US10410374B2 (en) * 2017-12-28 2019-09-10 Semiconductor Components Industries, Llc Image sensors with calibrated phase detection pixels
US11105928B2 (en) 2018-02-23 2021-08-31 Artilux, Inc. Light-sensing apparatus and light-sensing method thereof
JP6975341B2 (ja) 2018-02-23 2021-12-01 アーティラックス・インコーポレイテッド 光検出装置およびその光検出方法
US10595007B2 (en) * 2018-03-21 2020-03-17 Himax Imaging Limited Structured-light method and system of dynamically generating a depth map
WO2019199691A1 (en) 2018-04-08 2019-10-17 Artilux, Inc. Photo-detecting apparatus
KR102185320B1 (ko) * 2018-04-20 2020-12-01 알바이오텍 주식회사 사용자의 운동 자세 분석을 위한 이미지 생성 장치
CN108648222B (zh) * 2018-04-27 2021-08-17 华中科技大学 结构光深度数据空间分辨率的提升方法及装置
US10854770B2 (en) 2018-05-07 2020-12-01 Artilux, Inc. Avalanche photo-transistor
US10969877B2 (en) 2018-05-08 2021-04-06 Artilux, Inc. Display apparatus
US10410368B1 (en) * 2018-09-27 2019-09-10 Qualcomm Incorporated Hybrid depth processing
KR102561533B1 (ko) * 2018-09-28 2023-07-31 엘지이노텍 주식회사 카메라 장치
WO2020105092A1 (ja) * 2018-11-19 2020-05-28 日本電気株式会社 画像処理方法および画像処理装置
US11367390B2 (en) 2018-12-24 2022-06-21 Novatek Microelectronics Corp. Display apparatus and method for noise reduction
US11544873B2 (en) * 2019-03-05 2023-01-03 Artilux, Inc. High resolution 3D image processing apparatus and method thereof
KR102648089B1 (ko) * 2019-03-26 2024-03-19 삼성전자주식회사 이미징 장치 및 이미지 센서
CN112862880A (zh) * 2019-11-12 2021-05-28 Oppo广东移动通信有限公司 深度信息获取方法、装置、电子设备和存储介质
KR20210108082A (ko) 2020-02-25 2021-09-02 삼성전자주식회사 위상 차를 이용하는 라이브니스 검출 방법 및 장치
US11694480B2 (en) * 2020-07-27 2023-07-04 Samsung Electronics Co., Ltd. Method and apparatus with liveness detection

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110274420A1 (en) * 2010-05-10 2011-11-10 Canon Kabushiki Kaisha Imaging apparatus and method for controlling same
US20140036134A1 (en) * 2012-07-31 2014-02-06 Sony Corporation Focus adjustment device and focus adjustment method

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090080876A1 (en) 2007-09-25 2009-03-26 Mikhail Brusnitsyn Method For Distance Estimation Using AutoFocus Image Sensors And An Image Capture Device Employing The Same
JP5019117B2 (ja) * 2007-11-14 2012-09-05 スタンレー電気株式会社 距離画像生成装置
JP5146295B2 (ja) 2008-12-15 2013-02-20 ソニー株式会社 撮像装置および合焦制御方法
JP5178553B2 (ja) 2009-01-27 2013-04-10 オリンパス株式会社 撮像装置
JP5424679B2 (ja) 2009-03-18 2014-02-26 キヤノン株式会社 撮像装置及び信号処理装置
JP5361598B2 (ja) 2009-07-30 2013-12-04 キヤノン株式会社 焦点調節装置及び方法、及び撮像装置
JP2012058665A (ja) * 2010-09-13 2012-03-22 Sony Corp 顕微鏡制御装置及び処理範囲決定方法
JP5493010B2 (ja) * 2010-11-30 2014-05-14 富士フイルム株式会社 撮像装置及びその合焦位置検出方法
JP2012124555A (ja) * 2010-12-06 2012-06-28 Canon Inc 撮像装置
JP2012124553A (ja) 2010-12-06 2012-06-28 Canon Inc 撮影システムおよびレンズ装置
JP5803095B2 (ja) * 2010-12-10 2015-11-04 ソニー株式会社 撮像素子および撮像装置
JP2012173531A (ja) 2011-02-22 2012-09-10 Sony Corp 撮像装置、およびフォーカス制御方法、並びにプログラム
JP5615756B2 (ja) 2011-03-31 2014-10-29 富士フイルム株式会社 撮像装置及び撮像プログラム
JP2012230258A (ja) 2011-04-26 2012-11-22 Canon Inc 撮像装置及びその制御方法
JP6029309B2 (ja) * 2011-06-22 2016-11-24 キヤノン株式会社 焦点検出装置
CN103181156B (zh) * 2011-07-12 2017-09-01 三星电子株式会社 模糊处理装置及方法
WO2013009099A2 (ko) * 2011-07-12 2013-01-17 삼성전자 주식회사 블러 처리 장치 및 방법
GB2492848A (en) * 2011-07-15 2013-01-16 Softkinetic Sensors Nv Optical distance measurement
JP5800187B2 (ja) 2011-08-16 2015-10-28 リコーイメージング株式会社 撮像装置および距離情報取得方法
US20140036861A1 (en) * 2012-08-03 2014-02-06 Institute For Information Industry High-power base station and low-power base station for use in hererogeneous network and transmission methods thereof
JP2014179939A (ja) * 2013-03-15 2014-09-25 Sony Corp 信号処理装置および信号処理方法
JP6239862B2 (ja) 2013-05-20 2017-11-29 キヤノン株式会社 焦点調節装置、焦点調節方法およびプログラム、並びに撮像装置
US20140362190A1 (en) * 2013-06-07 2014-12-11 Canon Kabushiki Kaisha Depth measurement apparatus, imaging apparatus, and method of controlling depth measurement apparatus
KR102082703B1 (ko) * 2013-06-13 2020-02-28 엘지전자 주식회사 깊이 영상 획득 장치 및 방법
US10230934B2 (en) * 2013-06-14 2019-03-12 Microsoft Tehcnology Licensing, Llc Depth map correction using lookup tables
JP2015033103A (ja) 2013-08-07 2015-02-16 ソニー株式会社 画像処理装置、画像処理方法、およびプログラム
KR20150022298A (ko) 2013-08-22 2015-03-04 주식회사 온세텔레콤 자동 콜 다이얼링을 이용한 결제 확인 시스템 및 방법
ITTO20130784A1 (it) * 2013-09-30 2015-03-31 Sisvel Technology Srl Method and device for edge shape enforcement for visual enhancement of depth image based rendering
US9823352B2 (en) * 2014-10-31 2017-11-21 Rockwell Automation Safety Ag Absolute distance measurement for time-of-flight sensors

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110274420A1 (en) * 2010-05-10 2011-11-10 Canon Kabushiki Kaisha Imaging apparatus and method for controlling same
US20140036134A1 (en) * 2012-07-31 2014-02-06 Sony Corporation Focus adjustment device and focus adjustment method

Also Published As

Publication number Publication date
KR20160099948A (ko) 2016-08-23
CN105898281B (zh) 2019-10-15
JP2016149765A (ja) 2016-08-18
JP6731738B2 (ja) 2020-07-29
US10337861B2 (en) 2019-07-02
US20160239974A1 (en) 2016-08-18
DE102016100031A1 (de) 2016-08-18
CN105898281A (zh) 2016-08-24

Similar Documents

Publication Publication Date Title
KR102272254B1 (ko) 위상 검출 픽셀을 이용하여 깊이 맵을 생성하기 위한 영상 생성 장치
CN109151301B (zh) 包括相机模块的电子装置
CN108702437B (zh) 计算深度图的方法、系统、设备和存储介质
CN109792478B (zh) 基于焦点目标信息调整焦点的装置和方法
US10326981B2 (en) Generating 3D images using multi-resolution camera set
JP5980294B2 (ja) データ処理装置、撮像装置、およびデータ処理方法
US9092875B2 (en) Motion estimation apparatus, depth estimation apparatus, and motion estimation method
CN106067953B (zh) 确定用于具有各种视场的多相机设备的镜头阴影校正的方法和装置
US9900584B2 (en) Depth map generation based on cluster hierarchy and multiple multiresolution camera clusters
US11682107B2 (en) Depth of field adjustment in images based on time of flight depth maps
US9729857B2 (en) High resolution depth map computation using multiresolution camera clusters for 3D image generation
CN112930677B (zh) 用于在第一镜头和第二镜头之间切换的方法和电子设备
WO2021084530A1 (en) Method and system for generating a depth map
US9832390B2 (en) Image capturing device
TW201337838A (zh) 利用散焦方形影像執行景深估測的系統與方法
US10116865B2 (en) Image processing apparatus and image processing method for calculating motion vector between images with different in-focus positions
CN107211095B (zh) 处理图像的方法和设备
CN112584015B (zh) 物体探测方法、装置、存储介质和电子设备
US20180150968A1 (en) Camera assembly, method for tracking target portion based on the same, and electronic device
JP5927265B2 (ja) 画像処理装置及びプログラム
US20220279127A1 (en) Image signal processor for performing auto zoom and auto focus, image processing method thereof, and image processing system including the image signal processor
US9621780B2 (en) Method and system of curve fitting for common focus measures
JP6637242B2 (ja) 画像処理装置、撮像装置、プログラム、および画像処理方法
US12010408B2 (en) Automatic focus distance extension
WO2022226823A1 (en) Lens positioning for secondary camera in multi-camera system

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant