CN109829875B - 用于估计视差的方法和装置 - Google Patents

用于估计视差的方法和装置 Download PDF

Info

Publication number
CN109829875B
CN109829875B CN201810527546.0A CN201810527546A CN109829875B CN 109829875 B CN109829875 B CN 109829875B CN 201810527546 A CN201810527546 A CN 201810527546A CN 109829875 B CN109829875 B CN 109829875B
Authority
CN
China
Prior art keywords
image
disparity
residual
initial
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810527546.0A
Other languages
English (en)
Chinese (zh)
Other versions
CN109829875A (zh
Inventor
李元熙
郑景夫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of CN109829875A publication Critical patent/CN109829875A/zh
Application granted granted Critical
Publication of CN109829875B publication Critical patent/CN109829875B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Measurement Of Optical Distance (AREA)
CN201810527546.0A 2017-11-23 2018-05-28 用于估计视差的方法和装置 Active CN109829875B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2017-0157352 2017-11-23
KR1020170157352A KR102459853B1 (ko) 2017-11-23 2017-11-23 디스패리티 추정 장치 및 방법

Publications (2)

Publication Number Publication Date
CN109829875A CN109829875A (zh) 2019-05-31
CN109829875B true CN109829875B (zh) 2023-10-27

Family

ID=63293949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810527546.0A Active CN109829875B (zh) 2017-11-23 2018-05-28 用于估计视差的方法和装置

Country Status (5)

Country Link
US (1) US10929998B2 (ja)
EP (1) EP3489898B1 (ja)
JP (1) JP7134012B2 (ja)
KR (1) KR102459853B1 (ja)
CN (1) CN109829875B (ja)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7393809B2 (ja) * 2019-06-21 2023-12-07 スリーアイ インク 全方位画像情報に基づく自動位相マッピング処理方法及びそのシステムとコンピュータープログラム
CN110427968B (zh) * 2019-06-28 2021-11-02 武汉大学 一种基于细节增强的双目立体匹配方法
WO2021049281A1 (ja) * 2019-09-12 2021-03-18 株式会社ソニー・インタラクティブエンタテインメント 画像処理装置、ヘッドマウントディスプレイ、および空間情報取得方法
CN112991254A (zh) 2019-12-13 2021-06-18 上海肇观电子科技有限公司 视差估计系统、方法、电子设备及计算机可读存储介质
US11127115B2 (en) 2019-12-13 2021-09-21 NextVPU (Shanghai) Co., Ltd. Determination of disparity
CN112991404A (zh) * 2019-12-13 2021-06-18 上海肇观电子科技有限公司 视差确定方法、电子设备及计算机可读存储介质
US11694341B2 (en) * 2019-12-23 2023-07-04 Texas Instmments Incorporated Cascaded architecture for disparity and motion prediction with block matching and convolutional neural network (CNN)
US12069302B2 (en) 2020-04-13 2024-08-20 Intel Corporation Texture based immersive video coding
US11941084B2 (en) * 2020-11-13 2024-03-26 Google Llc Self-supervised learning for anomaly detection and localization
EP4256788A1 (en) * 2020-12-04 2023-10-11 Beijing Dajia Internet Information Technology Co., Ltd. Network based image filtering for video coding
DE102021107904A1 (de) * 2021-03-29 2022-09-29 Conti Temic Microelectronic Gmbh Verfahren und System zur Bestimmung der Bodenebene mit einem künstlichen neuronalen Netz
US11966454B2 (en) * 2021-10-28 2024-04-23 Shanghai United Imaging Intelligence Co., Ltd. Self-contrastive learning for image processing
CN115546515A (zh) * 2022-08-31 2022-12-30 北京鉴智科技有限公司 一种深度信息获取方法和装置
CN117611648B (zh) * 2023-12-04 2024-07-02 北京斯年智驾科技有限公司 一种图像深度估计方法、系统和存储介质
CN117576180B (zh) * 2024-01-15 2024-03-26 常熟理工学院 基于自适应多尺度窗口的多视图深度估计方法及应用

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012109788A (ja) * 2010-11-17 2012-06-07 Konica Minolta Holdings Inc 画像処理装置および視差情報生成装置
CN104662896A (zh) * 2012-09-06 2015-05-27 诺基亚技术有限公司 用于图像处理的装置、方法和计算机程序
CN106887018A (zh) * 2015-12-15 2017-06-23 株式会社理光 立体匹配方法、控制器和系统

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7061489B2 (en) 2003-08-15 2006-06-13 Microsoft Corporation Precomputed radiance transfer for rendering objects
JP4532171B2 (ja) 2004-06-01 2010-08-25 富士重工業株式会社 立体物認識装置
JP2008309529A (ja) 2007-06-12 2008-12-25 Panasonic Corp ナビゲーション装置、ナビゲーション方法、及びナビゲーション用プログラム
CA2729106A1 (en) 2008-06-24 2009-12-30 Thomson Licensing System and method for depth extraction of images with motion compensation
JP2012257198A (ja) * 2011-05-17 2012-12-27 Canon Inc 立体画像符号化装置、その方法、および立体画像符号化装置を有する撮像装置
JP5127973B1 (ja) 2011-10-21 2013-01-23 株式会社東芝 映像処理装置、映像処理方法および映像表示装置
EP3869797B1 (en) 2012-08-21 2023-07-19 Adeia Imaging LLC Method for depth detection in images captured using array cameras
WO2014049919A1 (ja) 2012-09-27 2014-04-03 パナソニック株式会社 ステレオ画像処理装置およびステレオ画像処理方法
JP2014096062A (ja) 2012-11-09 2014-05-22 Yamaguchi Univ 画像処理方法及び画像処理装置
EP2757524B1 (en) 2013-01-16 2018-12-19 Honda Research Institute Europe GmbH Depth sensing method and system for autonomous vehicles
US20140241612A1 (en) 2013-02-23 2014-08-28 Microsoft Corporation Real time stereo matching
US9183583B2 (en) 2013-05-13 2015-11-10 A9.Com, Inc. Augmented reality recommendations
US9224060B1 (en) 2013-09-17 2015-12-29 Amazon Technologies, Inc. Object tracking using depth information
CN103702098B (zh) 2013-12-09 2015-12-30 上海交通大学 一种时空域联合约束的三视点立体视频深度提取方法
US9600887B2 (en) * 2013-12-09 2017-03-21 Intel Corporation Techniques for disparity estimation using camera arrays for high dynamic range imaging
JP2016038886A (ja) * 2014-08-11 2016-03-22 ソニー株式会社 情報処理装置および情報処理方法
WO2016056754A1 (ko) * 2014-10-08 2016-04-14 엘지전자 주식회사 3d 비디오 부호화/복호화 방법 및 장치
KR102360424B1 (ko) * 2014-12-24 2022-02-09 삼성전자주식회사 얼굴 검출 방법, 영상 처리 방법, 얼굴 검출 장치 및 이를 포함하는 전자 시스템
JP6687886B2 (ja) * 2015-03-11 2020-04-28 株式会社リコー 画像処理システム、移動体制御システム、移動体装置、物体検出方法、物体検出プログラム
JP6523925B2 (ja) * 2015-11-10 2019-06-05 株式会社日立製作所 生体情報を用いた認証装置及び認証方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012109788A (ja) * 2010-11-17 2012-06-07 Konica Minolta Holdings Inc 画像処理装置および視差情報生成装置
CN104662896A (zh) * 2012-09-06 2015-05-27 诺基亚技术有限公司 用于图像处理的装置、方法和计算机程序
CN106887018A (zh) * 2015-12-15 2017-06-23 株式会社理光 立体匹配方法、控制器和系统

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Akihito Seki et al.《Patch Based Confidence Prediction for Dense Disparity Map》.《BMVC2016》.2016,摘要、第2节. *
Jiahao Pang et al.《Cascade Residual Learning：A Two-stage Convolutional Neural Network for Stereo Matching》.《ICCV2017》.2017,第2-3节. *
基于卷积神经网络的立体匹配及视差图获取算法;徐豪;2017 4th International Conference on Power and Energy Systems;全文 *

Also Published As

Publication number Publication date
JP2019096294A (ja) 2019-06-20
EP3489898A1 (en) 2019-05-29
EP3489898B1 (en) 2024-09-25
US10929998B2 (en) 2021-02-23
JP7134012B2 (ja) 2022-09-09
KR20190059594A (ko) 2019-05-31
US20190156502A1 (en) 2019-05-23
KR102459853B1 (ko) 2022-10-27
CN109829875A (zh) 2019-05-31

Similar Documents

Publication Publication Date Title
CN109829875B (zh) 用于估计视差的方法和装置
US11900628B2 (en) Stereo matching method and apparatus, image processing apparatus, and training method therefor
US12031842B2 (en) Method and apparatus for binocular ranging
US8755630B2 (en) Object pose recognition apparatus and object pose recognition method using the same
KR102214934B1 (ko) 단항 신뢰도 및 쌍별 신뢰도 학습을 통한 스테레오 매칭 장치 및 방법
KR102483641B1 (ko) 양안 시차 영상의 처리 방법 및 장치
CN104346811B (zh) 基于视频图像的目标实时追踪方法及其装置
JP6245330B2 (ja) 対象分割方法、対象分割装置及び対象分割プログラム
US10582179B2 (en) Method and apparatus for processing binocular disparity image
CN103313081A (zh) 图像处理设备和方法
EP3945497A1 (en) Method and apparatus with image depth estimation
CN104637043B (zh) 支持像素选择方法、装置、视差值确定方法
KR102240570B1 (ko) 신장 트리 생성 방법 및 장치，스테레오 매칭 방법 및 장치，업 샘플링 방법 및 장치，및 기준 픽셀 생성 방법 및 장치
CN116051448A (zh) 平坦表面检测装置和方法
CN108090401B (zh) 线检测方法和线检测设备
US10713808B2 (en) Stereo matching method and system using rectangular window
CN106157289B (zh) 线检测方法和设备
US20180108142A1 (en) Image processing apparatus and method
KR20160010900A (ko) 스테레오 영상에 대한 변위 지도 생성 방법 및 장치

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant