IN2013CN00086A - - Google Patents

Download PDF

Info

Publication number
IN2013CN00086A
IN2013CN00086A IN86CHN2013A IN2013CN00086A IN 2013CN00086 A IN2013CN00086 A IN 2013CN00086A IN 86CHN2013 A IN86CHN2013 A IN 86CHN2013A IN 2013CN00086 A IN2013CN00086 A IN 2013CN00086A
Authority
IN
India
Prior art keywords
analysis unit
video data
depth map
dibr
metric
Prior art date
Application number
Inventor
Bauza Judit Martinez
Mashhour M Solh
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of IN2013CN00086A publication Critical patent/IN2013CN00086A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

In general techniques are described for determining a vision based quality metric for three dimensional (3D) video. A device (12 14) comprising a 3D analysis unit (24 48) may implement these techniques to compute a 3D objective metric (36 60). The 3D analysis unit (24 48) estimates an ideal depth map (62 70) that would generate a distortion limited image view using DIBR based 3D video data (34) and then derives one or more distortion metrics (64 72) based on quantitative comparison of the ideal depth map (62 70) and a depth map (28 58) used in the generation of the DIBR based 3D video data (34). Based on the derived one or more distortion metrics (64 72) the 3D analysis unit (24 48) computes the objective metric (36 60) to quantify visual quality of DIBR based video data (34). The 3D objective metric (36 60) may be used to alter or otherwise adjust depth estimation and encoding/decoding parameters to correct for expected visual discomfort.
IN86CHN2013 2010-07-16 2011-07-15 IN2013CN00086A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US36494010P 2010-07-16 2010-07-16
US13/094,607 US9406132B2 (en) 2010-07-16 2011-04-26 Vision-based quality metric for three dimensional video
PCT/US2011/044277 WO2012009695A1 (en) 2010-07-16 2011-07-15 Vision-based quality metric for three dimensional video

Publications (1)

Publication Number Publication Date
IN2013CN00086A true IN2013CN00086A (en) 2015-07-03

Family

ID=45466983

Family Applications (1)

Application Number Title Priority Date Filing Date
IN86CHN2013 IN2013CN00086A (en) 2010-07-16 2011-07-15

Country Status (7)

Country Link
US (1) US9406132B2 (en)
EP (1) EP2594078A1 (en)
JP (1) JP5583850B2 (en)
KR (1) KR101533162B1 (en)
CN (1) CN103004214B (en)
IN (1) IN2013CN00086A (en)
WO (1) WO2012009695A1 (en)

Families Citing this family (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3328048B1 (en) 2008-05-20 2021-04-21 FotoNation Limited Capturing and processing of images using monolithic camera array with heterogeneous imagers
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
EP2502115A4 (en) 2009-11-20 2013-11-06 Pelican Imaging Corp Capturing and processing of images using monolithic camera array with heterogeneous imagers
SG10201503516VA (en) 2010-05-12 2015-06-29 Pelican Imaging Corp Architectures for imager arrays and array cameras
WO2012073336A1 (en) * 2010-11-30 2012-06-07 株式会社 東芝 Apparatus and method for displaying stereoscopic images
US8878950B2 (en) 2010-12-14 2014-11-04 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using super-resolution processes
US20120162394A1 (en) * 2010-12-23 2012-06-28 Tektronix, Inc. Displays for easy visualizing of 3d disparity data
KR101973822B1 (en) 2011-05-11 2019-04-29 포토네이션 케이맨 리미티드 Systems and methods for transmitting and receiving array camera image data
GB2490886B (en) 2011-05-13 2017-07-05 Snell Advanced Media Ltd Video processing method and apparatus for use with a sequence of stereoscopic images
WO2013043751A1 (en) 2011-09-19 2013-03-28 Pelican Imaging Corporation Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
IN2014CN02708A (en) 2011-09-28 2015-08-07 Pelican Imaging Corp
CN103108197A (en) 2011-11-14 2013-05-15 辉达公司 Priority level compression method and priority level compression system for three-dimensional (3D) video wireless display
US9661310B2 (en) * 2011-11-28 2017-05-23 ArcSoft Hanzhou Co., Ltd. Image depth recovering method and stereo image fetching device thereof
US9829715B2 (en) 2012-01-23 2017-11-28 Nvidia Corporation Eyewear device for transmitting signal and communication method thereof
WO2013126578A1 (en) 2012-02-21 2013-08-29 Pelican Imaging Corporation Systems and methods for the manipulation of captured light field image data
JP5851332B2 (en) * 2012-05-02 2016-02-03 日本電信電話株式会社 3D video quality evaluation apparatus, method and program
JP5851331B2 (en) * 2012-05-02 2016-02-03 日本電信電話株式会社 3D video quality evaluation apparatus, method and program
JP5851330B2 (en) * 2012-05-02 2016-02-03 日本電信電話株式会社 3D video quality evaluation apparatus, method and program
WO2014005123A1 (en) 2012-06-28 2014-01-03 Pelican Imaging Corporation Systems and methods for detecting defective camera arrays, optic arrays, and sensors
US20140002674A1 (en) 2012-06-30 2014-01-02 Pelican Imaging Corporation Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors
WO2014031795A1 (en) 2012-08-21 2014-02-27 Pelican Imaging Corporation Systems and methods for parallax detection and correction in images captured using array cameras
US20140055632A1 (en) 2012-08-23 2014-02-27 Pelican Imaging Corporation Feature based high resolution motion estimation from low resolution images captured using an array source
US9578224B2 (en) 2012-09-10 2017-02-21 Nvidia Corporation System and method for enhanced monoimaging
EP2901671A4 (en) 2012-09-28 2016-08-24 Pelican Imaging Corp Generating images from light fields utilizing virtual viewpoints
US9462164B2 (en) 2013-02-21 2016-10-04 Pelican Imaging Corporation Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
WO2014138697A1 (en) 2013-03-08 2014-09-12 Pelican Imaging Corporation Systems and methods for high dynamic range imaging using array cameras
US8866912B2 (en) 2013-03-10 2014-10-21 Pelican Imaging Corporation System and methods for calibration of an array camera using a single captured image
WO2014164550A2 (en) 2013-03-13 2014-10-09 Pelican Imaging Corporation System and methods for calibration of an array camera
US9888194B2 (en) 2013-03-13 2018-02-06 Fotonation Cayman Limited Array camera architecture implementing quantum film image sensors
WO2014159779A1 (en) 2013-03-14 2014-10-02 Pelican Imaging Corporation Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US9497429B2 (en) 2013-03-15 2016-11-15 Pelican Imaging Corporation Extended color processing on pelican array cameras
US9445003B1 (en) 2013-03-15 2016-09-13 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
EP2973476A4 (en) 2013-03-15 2017-01-18 Pelican Imaging Corporation Systems and methods for stereo imaging with camera arrays
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10127196B2 (en) 2013-04-02 2018-11-13 3M Innovative Properties Company Systems and methods for managing notes
KR101650833B1 (en) 2013-04-02 2016-08-24 쓰리엠 이노베이티브 프로퍼티즈 컴파니 Systems and methods for note recognition
TWI547142B (en) 2013-04-02 2016-08-21 杜比實驗室特許公司 Guided 3d display adaptation
EP2981931B1 (en) 2013-04-02 2021-03-03 3M Innovative Properties Company Systems and methods for managing notes
EP3020000B1 (en) * 2013-07-09 2022-04-27 3M Innovative Properties Company Systems and methods for note content extraction and management using segmented notes
US9292906B1 (en) * 2013-09-06 2016-03-22 Google Inc. Two-dimensional image processing based on third dimension data
JP6476658B2 (en) * 2013-09-11 2019-03-06 ソニー株式会社 Image processing apparatus and method
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
EP3058513B1 (en) 2013-10-16 2021-05-19 3M Innovative Properties Company Multi-color channel detection for note recognition and management
EP3058509A4 (en) 2013-10-16 2017-08-09 3M Innovative Properties Company Note recognition for overlapping physical notes
US10175845B2 (en) 2013-10-16 2019-01-08 3M Innovative Properties Company Organizing digital notes on a user interface
WO2015057785A2 (en) 2013-10-16 2015-04-23 3M Innovative Properties Company Adding, deleting digital notes from a group of digital notes
WO2015057778A1 (en) 2013-10-16 2015-04-23 3M Innovative Properties Company Note recognition and association based on grouping
US9274693B2 (en) 2013-10-16 2016-03-01 3M Innovative Properties Company Editing digital notes representing physical notes
US9185276B2 (en) 2013-11-07 2015-11-10 Pelican Imaging Corporation Methods of manufacturing array camera modules incorporating independently aligned lens stacks
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
WO2015081279A1 (en) 2013-11-26 2015-06-04 Pelican Imaging Corporation Array camera configurations incorporating multiple constituent array cameras
US10935788B2 (en) 2014-01-24 2021-03-02 Nvidia Corporation Hybrid virtual 3D rendering approach to stereovision
WO2015116803A1 (en) 2014-01-31 2015-08-06 3M Innovative Properties Company Note capture and recognition with manual assist
US9626766B2 (en) * 2014-02-28 2017-04-18 Microsoft Technology Licensing, Llc Depth sensing using an RGB camera
US10089740B2 (en) 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
JP2017531976A (en) 2014-09-29 2017-10-26 フォトネイション ケイマン リミテッド System and method for dynamically calibrating an array camera
CN104661013B (en) * 2015-01-27 2016-08-17 宁波大学 A kind of virtual viewpoint rendering method based on spatial weighting
US10334223B2 (en) * 2015-01-30 2019-06-25 Qualcomm Incorporated System and method for multi-view video in wireless devices
EP3422702B1 (en) * 2016-02-22 2022-12-28 Sony Group Corporation File generation device, file generation method, reproduction device, and reproduction method
US9906981B2 (en) 2016-02-25 2018-02-27 Nvidia Corporation Method and system for dynamic regulation and control of Wi-Fi scans
CN106170086B (en) * 2016-08-19 2019-03-15 深圳奥比中光科技有限公司 Method and device thereof, the system of drawing three-dimensional image
GB2553148A (en) * 2016-08-26 2018-02-28 Nctech Ltd Modelling system and method
CN110114803B (en) * 2016-12-28 2023-06-27 松下电器（美国）知识产权公司 Three-dimensional model distribution method, three-dimensional model reception method, three-dimensional model distribution device, and three-dimensional model reception device
CN106817578B (en) * 2017-01-11 2018-05-22 清华大学深圳研究生院 A kind of method for analyzing bore hole 3D display system three-dimensional depth influence factor
TWI636427B (en) * 2017-05-31 2018-09-21 鈺立微電子股份有限公司 Verification method of depth map quality corresponding to an image capture device and verification system thereof
US10282827B2 (en) * 2017-08-10 2019-05-07 Wipro Limited Method and system for removal of rain streak distortion from a video
US11310475B2 (en) 2019-08-05 2022-04-19 City University Of Hong Kong Video quality determination system and method
MX2022003020A (en) 2019-09-17 2022-06-14 Boston Polarimetrics Inc Systems and methods for surface modeling using polarization cues.
DE112020004813B4 (en) 2019-10-07 2023-02-09 Boston Polarimetrics, Inc. System for expanding sensor systems and imaging systems with polarization
CN114787648B (en) 2019-11-30 2023-11-10 波士顿偏振测定公司 Systems and methods for transparent object segmentation using polarization cues
US11195303B2 (en) 2020-01-29 2021-12-07 Boston Polarimetrics, Inc. Systems and methods for characterizing object pose detection and measurement systems
JP2023511747A (en) 2020-01-30 2023-03-22 イントリンジック イノベーション エルエルシー Systems and methods for synthesizing data for training statistical models with different imaging modalities, including polarization imaging
US11953700B2 (en) 2020-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6046763A (en) 1997-04-11 2000-04-04 Nec Research Institute, Inc. Maximum flow method for stereo correspondence
US20030206652A1 (en) 2000-06-28 2003-11-06 David Nister Depth map creation through hypothesis blending in a bayesian framework
JP4436080B2 (en) 2003-06-30 2010-03-24 日本放送協会 Stereoscopic image reproduction distortion output device, stereoscopic image reproduction distortion output method, and stereoscopic image reproduction distortion output program
US20080279285A1 (en) 2004-07-02 2008-11-13 Koninklijke Philips Electronics, N.V. Video Processing
KR100603601B1 (en) 2004-11-08 2006-07-24 한국전자통신연구원 Apparatus and Method for Production Multi-view Contents
US8351685B2 (en) 2007-11-16 2013-01-08 Gwangju Institute Of Science And Technology Device and method for estimating depth map, and method for generating intermediate image and method for encoding multi-view video using the same
US8787654B2 (en) * 2008-05-12 2014-07-22 Thomson Licensing System and method for measuring potential eyestrain of stereoscopic motion pictures
JP2012501506A (en) 2008-08-31 2012-01-19 ミツビシ エレクトリック ビジュアル ソリューションズ アメリカ， インコーポレイテッド Conversion of 3D video content that matches the viewer position
US20100182445A1 (en) 2009-01-22 2010-07-22 Upi Semiconductor Corporation Processing Device, Method, And Electronic System Utilizing The Same

Also Published As

Publication number Publication date
JP2013535898A (en) 2013-09-12
CN103004214B (en) 2015-11-25
EP2594078A1 (en) 2013-05-22
US9406132B2 (en) 2016-08-02
US20120014456A1 (en) 2012-01-19
JP5583850B2 (en) 2014-09-03
CN103004214A (en) 2013-03-27
KR20130038386A (en) 2013-04-17
KR101533162B1 (en) 2015-07-01
WO2012009695A1 (en) 2012-01-19

Similar Documents

Publication Publication Date Title
IN2013CN00086A (en)
EP1968329A3 (en) Three-dimensional image display apparatus and method for enhancing stereoscopic effect of image
GB2483213A (en) 3D image generation
EP2552097A3 (en) Image processing apparatus, system, and method
NZ742532A (en) Light field display metrology
WO2012143885A9 (en) Mpr slice selection for visualization of catheter in three-dimensional ultrasound
GB2489871A (en) Depth from defocus calibration
WO2011156143A3 (en) Distinguishing live faces from flat surfaces
WO2016140934A3 (en) Methods and apparatus for 3d image rendering
WO2011017485A3 (en) 3d autostereoscopic display with true depth perception
EP3267398A3 (en) Image processing apparatus and image processing method
MY163422A (en) Method and system for determining an amount of a liquid energy commodity in storage in an underground cavern
WO2009091382A8 (en) Use of a single x-ray image in a stereo imaging pair for quality assurance of tracking
EP2811424A3 (en) Method and apparatus for training an estimator for estimating a pose of an articulated object
EP2432229A3 (en) Object tracking and highlighting in stereoscopic images
IN2014CN02808A (en)
IN2014CN02088A (en)
GB201217215D0 (en) Method and apparatus for generating an enhanced image from medical imaging data
EP2394715A3 (en) Image display program, system and method
WO2009102984A3 (en) System and method for virtually augmented endoscopy
EP2408212A3 (en) Mobile terminal and 3D image controlling method therein
RU2010103049A (en) STEREOSCOPIC IMAGE GENERATION DEVICE, STEREOSCOPIC IMAGE GENERATION METHOD AND PROGRAM
GB201119950D0 (en) Methods and apparatus for comparing 3D and 2D image data
IN2012DE00763A (en)
IN2014CN02389A (en)