CN100514367C - 基于彩色分割的立体3d重构系统和方法 - Google Patents

基于彩色分割的立体3d重构系统和方法 Download PDF

Info

Publication number
CN100514367C
CN100514367C CNB2005100820957A CN200510082095A CN100514367C CN 100514367 C CN100514367 C CN 100514367C CN B2005100820957 A CNB2005100820957 A CN B2005100820957A CN 200510082095 A CN200510082095 A CN 200510082095A CN 100514367 C CN100514367 C CN 100514367C
Authority
CN
China
Prior art keywords
disparity
image
pixel
pixels
segment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2005100820957A
Other languages
English (en)
Chinese (zh)
Other versions
CN1716316A (zh
Inventor
C·孜特尼克三世
M·尤特坦戴乐
R·斯泽利司基
S·维恩德
S·B·康
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of CN1716316A publication Critical patent/CN1716316A/zh
Application granted granted Critical
Publication of CN100514367C publication Critical patent/CN100514367C/zh
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/12—Acquisition of 3D measurements of objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
CNB2005100820957A 2004-06-28 2005-06-28 基于彩色分割的立体3d重构系统和方法 Expired - Fee Related CN100514367C (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/879,327 2004-06-28
US10/879,327 US7324687B2 (en) 2004-06-28 2004-06-28 Color segmentation-based stereo 3D reconstruction system and process

Publications (2)

Publication Number Publication Date
CN1716316A CN1716316A (zh) 2006-01-04
CN100514367C true CN100514367C (zh) 2009-07-15

Family

ID=34940185

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005100820957A Expired - Fee Related CN100514367C (zh) 2004-06-28 2005-06-28 基于彩色分割的立体3d重构系统和方法

Country Status (7)

Country Link
US (2) US7324687B2 (enExample)
EP (1) EP1612733B1 (enExample)
JP (1) JP4740657B2 (enExample)
KR (1) KR101143218B1 (enExample)
CN (1) CN100514367C (enExample)
AT (1) ATE438160T1 (enExample)
DE (1) DE602005015649D1 (enExample)

Families Citing this family (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4350706B2 (ja) * 2003-03-28 2009-10-21 オリンパス株式会社 画像処理装置及び画像処理プログラム
DE102005017313A1 (de) * 2005-04-14 2006-10-19 Volkswagen Ag Verfahren zur Darstellung von Informationen in einem Verkehrsmittel und Kombiinstrument für ein Kraftfahrzeug
US7676103B2 (en) * 2005-06-20 2010-03-09 Intel Corporation Enhancing video sharpness and contrast by luminance and chrominance transient improvement
JP2009515404A (ja) * 2005-11-04 2009-04-09 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ マルチビューディスプレイのための画像データの再生
US7889932B2 (en) * 2006-03-02 2011-02-15 Sharp Laboratories Of America, Inc. Methods and systems for detecting regions in digital images
US8630498B2 (en) 2006-03-02 2014-01-14 Sharp Laboratories Of America, Inc. Methods and systems for detecting pictorial regions in digital images
US7916934B2 (en) * 2006-04-04 2011-03-29 Mitsubishi Electric Research Laboratories, Inc. Method and system for acquiring, encoding, decoding and displaying 3D light fields
US20090167843A1 (en) * 2006-06-08 2009-07-02 Izzat Hekmat Izzat Two pass approach to three dimensional Reconstruction
US8437054B2 (en) * 2006-06-15 2013-05-07 Sharp Laboratories Of America, Inc. Methods and systems for identifying regions of substantially uniform color in a digital image
US7864365B2 (en) 2006-06-15 2011-01-04 Sharp Laboratories Of America, Inc. Methods and systems for segmenting a digital image into regions
JP5053373B2 (ja) * 2006-06-29 2012-10-17 トムソン ライセンシング 適応ピクセルベースのフィルタリング
US7876959B2 (en) 2006-09-06 2011-01-25 Sharp Laboratories Of America, Inc. Methods and systems for identifying text in digital images
WO2008062351A1 (en) * 2006-11-21 2008-05-29 Koninklijke Philips Electronics N.V. Generation of depth map for an image
CN101001391B (zh) * 2007-01-09 2010-05-19 四川大学 一种立体图像编码方法
US7970226B2 (en) * 2007-04-23 2011-06-28 Microsoft Corporation Local image descriptors
US8126275B2 (en) 2007-04-24 2012-02-28 Microsoft Corporation Interest point detection
CN101690220B (zh) * 2007-04-25 2013-09-25 Lg电子株式会社 用于解码/编码视频信号的方法和装置
CN101785025B (zh) * 2007-07-12 2013-10-30 汤姆森特许公司 用于从二维图像进行三维对象重构的系统和方法
US8280149B2 (en) * 2007-09-11 2012-10-02 Motorola Solutions, Inc. Method and apparatus to facilitate processing a stereoscopic image using first and second images to facilitate computing a depth/disparity image
CA2704479C (en) 2007-11-09 2016-01-05 Thomson Licensing System and method for depth map extraction using region-based filtering
US9094675B2 (en) * 2008-02-29 2015-07-28 Disney Enterprises Inc. Processing image data from multiple cameras for motion pictures
US8781250B2 (en) * 2008-06-26 2014-07-15 Microsoft Corporation Image deconvolution using color priors
KR100942925B1 (ko) * 2008-08-11 2010-02-22 한국전자통신연구원 스테레오 비전 시스템 및 그 제어방법
US8164617B2 (en) 2009-03-25 2012-04-24 Cisco Technology, Inc. Combining views of a plurality of cameras for a video conferencing endpoint with a display wall
JP5249114B2 (ja) * 2009-04-03 2013-07-31 Ｋｄｄｉ株式会社 画像生成装置、方法及びプログラム
KR20100135032A (ko) * 2009-06-16 2010-12-24 삼성전자주식회사 2차원 영상의 3차원 영상 변환 장치 및 방법
JP4934701B2 (ja) * 2009-06-30 2012-05-16 株式会社日立製作所 ステレオ画像処理装置およびステレオ画像処理方法
RU2423018C2 (ru) * 2009-08-04 2011-06-27 Корпорация "САМСУНГ ЭЛЕКТРОНИКС Ко., Лтд." Способ и система для преобразования стереоконтента
TWI398158B (zh) * 2009-12-01 2013-06-01 Ind Tech Res Inst 產生立體影像之影像深度的方法
CN101719286B (zh) * 2009-12-09 2012-05-23 北京大学 融合单视点场景分析的多视点三维场景重建方法及其系统
US8290248B2 (en) * 2009-12-31 2012-10-16 Mitsubishi Electric Research Laboratories, Inc. Determining disparity search range in stereo videos
US20110169818A1 (en) * 2010-01-13 2011-07-14 Sharp Laboratories Of America, Inc. Reducing viewing discomfort
CN102822873B (zh) * 2010-01-26 2016-07-13 萨博股份公司 自动三维绘图方法
RU2453922C2 (ru) * 2010-02-12 2012-06-20 Георгий Русланович Вяхирев Способ представления исходной трехмерной сцены по результатам съемки изображений в двумерной проекции (варианты)
US8669979B2 (en) * 2010-04-01 2014-03-11 Intel Corporation Multi-core processor supporting real-time 3D image rendering on an autostereoscopic display
US8488870B2 (en) * 2010-06-25 2013-07-16 Qualcomm Incorporated Multi-resolution, multi-window disparity estimation in 3D video processing
CN101945299B (zh) * 2010-07-09 2013-10-09 清华大学 一种基于拍摄设备阵列的动态场景深度恢复方法
US8655093B2 (en) * 2010-09-02 2014-02-18 Edge 3 Technologies, Inc. Method and apparatus for performing segmentation of an image
US9177381B2 (en) * 2010-12-22 2015-11-03 Nani Holdings IP, LLC Depth estimate determination, systems and methods
US8884949B1 (en) 2011-06-06 2014-11-11 Thibault Lambert Method and system for real time rendering of objects from a low resolution depth camera
US8941644B2 (en) 2011-06-14 2015-01-27 Microsoft Corporation Computing three-dimensional image models in parallel
CN102263954B (zh) * 2011-07-06 2014-01-29 北京航空航天大学 一种基于对象的快速分形视频压缩与解压缩方法
CN102291579B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的多目立体视频分形压缩与解压缩方法
CN102263952B (zh) * 2011-07-06 2013-12-11 北京航空航天大学 一种基于对象的快速双目立体视频分形压缩与解压缩方法
CN102263953B (zh) * 2011-07-06 2013-12-11 北京航空航天大学 一种基于对象的快速多目立体视频分形压缩与解压缩方法
CN102263951B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的分形视频压缩与解压缩方法
CN103647969B (zh) * 2011-07-06 2016-09-14 北京航空航天大学 一种基于对象的快速分形视频压缩与解压缩方法
CN102316323B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的双目立体视频分形压缩与解压缩方法
US8553998B1 (en) * 2011-08-16 2013-10-08 Google Inc. Depthmap compression using a primitive
US8553997B1 (en) * 2011-08-16 2013-10-08 Google Inc. Depthmap compression
US8749548B2 (en) * 2011-09-01 2014-06-10 Samsung Electronics Co., Ltd. Display system with image conversion mechanism and method of operation thereof
US9129378B2 (en) * 2011-09-07 2015-09-08 Thomson Licensing Method and apparatus for recovering a component of a distortion field and for determining a disparity field
JP2013073598A (ja) * 2011-09-29 2013-04-22 Sony Corp 画像処理装置、画像処理方法、及びプログラム
US8995755B2 (en) 2011-09-30 2015-03-31 Cyberlink Corp. Two-dimensional to stereoscopic conversion systems and methods
US8854724B2 (en) 2012-03-27 2014-10-07 Ostendo Technologies, Inc. Spatio-temporal directional light modulator
US8928969B2 (en) 2011-12-06 2015-01-06 Ostendo Technologies, Inc. Spatio-optical directional light modulator
JP5755571B2 (ja) * 2012-01-11 2015-07-29 シャープ株式会社 仮想視点画像生成装置、仮想視点画像生成方法、制御プログラム、記録媒体、および立体表示装置
US9924196B2 (en) 2012-05-18 2018-03-20 The Regents Of The University Of California Independent thread video disparity estimation method and codec
EP2669845A3 (en) * 2012-06-01 2014-11-19 Ricoh Company, Ltd. Target recognition system, target recognition method executed by the target recognition system, target recognition program executed on the target recognition system, and recording medium storing the target recognition program
DE102012209316A1 (de) * 2012-06-01 2013-12-05 Robert Bosch Gmbh Verfahren und Vorrichtung zum Verarbeiten von Sensordaten eines Stereosensorsystems
US9179126B2 (en) 2012-06-01 2015-11-03 Ostendo Technologies, Inc. Spatio-temporal light field cameras
CN102831637B (zh) * 2012-06-28 2015-08-26 北京理工大学 基于移动设备的三维重建方法
US9641821B2 (en) 2012-09-24 2017-05-02 Panasonic Intellectual Property Management Co., Ltd. Image signal processing device and image signal processing method
JP2014078095A (ja) 2012-10-10 2014-05-01 Sony Corp 画像処理装置、画像処理方法、及びプログラム
KR101885088B1 (ko) 2012-11-22 2018-08-06 삼성전자주식회사 깊이 영상을 이용한 컬러 영상 처리 장치 및 방법
US8964254B2 (en) 2013-04-03 2015-02-24 Hewlett-Packard Development Company, L.P. To generate a histogram matched image
EP2787319A1 (de) * 2013-04-05 2014-10-08 Leica Geosystems AG Steuerung einer Bildauslösung zur Luftbilderfassung in Nadir-Ausrichtung für ein unbemanntes Fluggerät
CN104123715B (zh) * 2013-04-27 2017-12-05 株式会社理光 配置视差值的方法和系统
US10341611B2 (en) 2013-04-30 2019-07-02 Inuitive Ltd. System and method for video conferencing
CN103310450B (zh) * 2013-06-17 2016-12-28 北京工业大学 一种融合直连通约束的图像分割方法
CN105659604B (zh) 2013-10-18 2018-12-21 Lg电子株式会社 在多视图视频编译中预测视图合成的方法和用于通过使用其构建合并候选列表的方法
US8760500B1 (en) * 2013-10-23 2014-06-24 Google Inc. Depth map generation
CN104021774B (zh) * 2014-05-29 2016-06-15 京东方科技集团股份有限公司 一种图像处理的方法及装置
KR102265315B1 (ko) 2015-04-17 2021-06-15 삼성전자주식회사 영상 광류를 추정하는 방법 및 이를 위한 장치
US10489970B2 (en) * 2015-11-06 2019-11-26 Microsoft Technology Licensing, Llc 2D image processing for extrusion into 3D objects
US10372968B2 (en) * 2016-01-22 2019-08-06 Qualcomm Incorporated Object-focused active three-dimensional reconstruction
US10582179B2 (en) 2016-02-01 2020-03-03 Samsung Electronics Co., Ltd. Method and apparatus for processing binocular disparity image
EP3427008B1 (en) 2016-03-11 2022-09-07 Kaarta, Inc. Laser scanner with real-time, online ego-motion estimation
US11573325B2 (en) 2016-03-11 2023-02-07 Kaarta, Inc. Systems and methods for improvements in scanning and mapping
US10989542B2 (en) 2016-03-11 2021-04-27 Kaarta, Inc. Aligning measured signal data with slam localization data and uses thereof
US11567201B2 (en) 2016-03-11 2023-01-31 Kaarta, Inc. Laser scanner with real-time, online ego-motion estimation
JP6991700B2 (ja) 2016-04-28 2022-01-12 キヤノン株式会社 情報処理装置、情報処理方法、プログラム
EP3252713A1 (en) * 2016-06-01 2017-12-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for performing 3d estimation based on locally determined 3d information hypotheses
EP3343506A1 (en) * 2016-12-28 2018-07-04 Thomson Licensing Method and device for joint segmentation and 3d reconstruction of a scene
US10885714B2 (en) * 2017-07-07 2021-01-05 Niantic, Inc. Cloud enabled augmented reality
WO2019099605A1 (en) 2017-11-17 2019-05-23 Kaarta, Inc. Methods and systems for geo-referencing mapping systems
WO2019165194A1 (en) * 2018-02-23 2019-08-29 Kaarta, Inc. Methods and systems for processing and colorizing point clouds and meshes
WO2019195270A1 (en) 2018-04-03 2019-10-10 Kaarta, Inc. Methods and systems for real or near real-time point cloud map data confidence evaluation
WO2020009826A1 (en) 2018-07-05 2020-01-09 Kaarta, Inc. Methods and systems for auto-leveling of point clouds and 3d models
US11023722B2 (en) * 2018-07-11 2021-06-01 International Business Machines Corporation Data classification bandwidth reduction
CN110889851B (zh) * 2018-09-11 2023-08-01 苹果公司 针对深度和视差估计的语义分割的稳健用途
CN110838148B (zh) * 2019-11-11 2023-05-05 杭州凌像科技有限公司 一种双目相机自标定方法
US11069071B1 (en) * 2020-01-21 2021-07-20 Compound Eye, Inc. System and method for egomotion estimation
KR102455833B1 (ko) * 2020-02-12 2022-10-19 한국전자통신연구원 변이 지도 개선 방법 및 장치
CN113256815B (zh) * 2021-02-24 2024-03-22 北京华清易通科技有限公司 虚拟现实场景融合及播放方法和虚拟现实设备
US12003697B2 (en) 2021-05-06 2024-06-04 Samsung Electronics Co., Ltd. Wearable electronic device and method of outputting three-dimensional image
KR20220151420A (ko) * 2021-05-06 2022-11-15 삼성전자주식회사 웨어러블 전자 장치 및 3d 이미지 출력 방법

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5179441A (en) * 1991-12-18 1993-01-12 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Near real-time stereo vision system
JPH09218954A (ja) * 1996-02-14 1997-08-19 Nippon Telegr & Teleph Corp <Ntt> 画像生成方法
JPH1023331A (ja) 1996-06-28 1998-01-23 Olympus Optical Co Ltd 画像処理装置
JPH1079029A (ja) * 1996-09-02 1998-03-24 Canon Inc 立体情報検出方法及びその装置
JP3017122B2 (ja) * 1997-04-03 2000-03-06 株式会社エイ・ティ・アール知能映像通信研究所 奥行き情報抽出装置および奥行き情報抽出方法
JP3728160B2 (ja) * 1999-12-06 2005-12-21 キヤノン株式会社 奥行き画像計測装置及び方法、並びに複合現実感提示システム
US6788809B1 (en) * 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
US7227526B2 (en) 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US7031512B2 (en) 2002-04-18 2006-04-18 Stmicroelectronics, Inc. Method and system for 3D smoothing within the bound of error regions of matching curves
US6847728B2 (en) 2002-12-09 2005-01-25 Sarnoff Corporation Dynamic depth recovery from multiple synchronized video streams

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
A global matching framework for stereo computation. Hai Tao,Harpreet S. Sawhney,Rakesh Kumar.Proceedings of the eight IEEE international conference on computer vision,Vol.1 No.8. 2001 *
High-quality video interpolation using a layered representation. C. Lawrence Zitnick,Sing Bing Kang,MatthewUyttendaele,Simon Winder,Richard Szeliski.ACM transactions on graphics,Vol.23 No.3. 2004 *

Also Published As

Publication number Publication date
US20050286758A1 (en) 2005-12-29
US7324687B2 (en) 2008-01-29
CN1716316A (zh) 2006-01-04
JP2006012166A (ja) 2006-01-12
KR101143218B1 (ko) 2012-05-18
DE602005015649D1 (de) 2009-09-10
EP1612733A3 (en) 2007-05-09
JP4740657B2 (ja) 2011-08-03
EP1612733B1 (en) 2009-07-29
US7379583B2 (en) 2008-05-27
EP1612733A2 (en) 2006-01-04
ATE438160T1 (de) 2009-08-15
KR20060048642A (ko) 2006-05-18
US20050286757A1 (en) 2005-12-29

Similar Documents

Publication Publication Date Title
CN100514367C (zh) 基于彩色分割的立体3d重构系统和方法
US12423849B2 (en) Systems and methods for hybrid depth regularization
JP6655737B2 (ja) マルチビューシーンのセグメンテーションおよび伝播
Bleyer et al. Graph-based surface reconstruction from stereo pairs using image segmentation
Pham et al. Domain transformation-based efficient cost aggregation for local stereo matching
JP4074062B2 (ja) ベクトル画像シーケンスにおける意味対象物の追跡
Zhou et al. Plane-based content preserving warps for video stabilization
EP3367334B1 (en) Depth estimation method and depth estimation apparatus of multi-view images
EP0952552A2 (en) Method for generating 2-D images from 3-D video data
US20020176625A1 (en) Method for segmenting multi-resolution video objects
US7974470B2 (en) Method and apparatus for processing an image
JP2010502945A (ja) 画像から奥行きマップを決定する方法、奥行きマップを決定する装置
WO2013178725A1 (en) Segmentation of a foreground object in a 3d scene
Goldlucke et al. Joint 3D-reconstruction and background separation in multiple views using graph cuts
TW202037169A (zh) 基於視訊的點雲壓縮的區塊分段的方法及裝置
Ben-Ari et al. Stereo matching with Mumford-Shah regularization and occlusion handling
Mukherjee et al. A hybrid algorithm for disparity calculation from sparse disparity estimates based on stereo vision
CN115426535A (zh) 基于背景分离的rgb-d视频合成视点空洞掩盖方法
Kim et al. Multi-view object extraction with fractional boundaries
Kumar et al. Human visual system and segment-based disparity estimation
JP7703796B2 (ja) 動的メッシュコーディングのためのパッチ生成
Jain et al. Video completion for indoor scenes
Pohl et al. Semi-Automatic 2D to 3D Video Conversion
Fickel Video view interpolation using temporally adaptive 3D meshes
CN111724390A (zh) 一种人脸五官分割方法和装置

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: MICROSOFT TECHNOLOGY LICENSING LLC

Free format text: FORMER OWNER: MICROSOFT CORP.

Effective date: 20150515

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20150515

Address after: Washington State

Patentee after: Micro soft technique license Co., Ltd

Address before: Washington State

Patentee before: Microsoft Corp.

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090715

Termination date: 20190628

CF01 Termination of patent right due to non-payment of annual fee