WO2011029209A3 - Method and apparatus for generating and processing depth-enhanced images - Google Patents

Method and apparatus for generating and processing depth-enhanced images Download PDF

Info

Publication number
WO2011029209A3
WO2011029209A3 PCT/CH2010/000218 CH2010000218W WO2011029209A3 WO 2011029209 A3 WO2011029209 A3 WO 2011029209A3 CH 2010000218 W CH2010000218 W CH 2010000218W WO 2011029209 A3 WO2011029209 A3 WO 2011029209A3
Authority
WO
WIPO (PCT)
Prior art keywords
scene
elements
generating
annotation
camera
Prior art date
Application number
PCT/CH2010/000218
Other languages
French (fr)
Other versions
WO2011029209A2 (en
Inventor
Christoph Niederberger
Stephan Würmlin Stadler
Richard Keiser
Remo Ziegler
Marco Feriencik
Marcel Germann
Marcel Müller
Original Assignee
Liberovision Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Liberovision Ag filed Critical Liberovision Ag
Publication of WO2011029209A2 publication Critical patent/WO2011029209A2/en
Publication of WO2011029209A3 publication Critical patent/WO2011029209A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation

Abstract

A method for generating and processing depth-enhanced images comprises the steps of - providing an image of a scene (10); - computing a depth-enhanced representation of the scene (10) comprising information on the relative position of scene elements in (real or virtual) 3D space, wherein each scene element (23) corresponds to a particular object (12) in the scene and to an image segment generated by observing the object with the physical camera; -inputting one or more annotation elements (24) and information on the relative position of the one or more annotation elements (24) with regard to the scene elements (23); - defining camera parameters of a viewing camera; - rendering, by means of a rendering processor (7), a rendered image as seen by the viewing camera, wherein the one or more annotation (24) elements are shown in a spatially consistent relation to the scene elements (23).
PCT/CH2010/000218 2009-09-10 2010-09-07 Method and apparatus for generating and processing depth-enhanced images WO2011029209A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US24105209P 2009-09-10 2009-09-10
US61/241,052 2009-09-10

Publications (2)

Publication Number Publication Date
WO2011029209A2 WO2011029209A2 (en) 2011-03-17
WO2011029209A3 true WO2011029209A3 (en) 2011-09-29

Family

ID=43732858

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CH2010/000218 WO2011029209A2 (en) 2009-09-10 2010-09-07 Method and apparatus for generating and processing depth-enhanced images

Country Status (1)

Country Link
WO (1) WO2011029209A2 (en)

Families Citing this family (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8897596B1 (en) 2001-05-04 2014-11-25 Legend3D, Inc. System and method for rapid image sequence depth enhancement with translucent elements
US8401336B2 (en) 2001-05-04 2013-03-19 Legend3D, Inc. System and method for rapid image sequence depth enhancement with augmented computer-generated elements
US9286941B2 (en) 2001-05-04 2016-03-15 Legend3D, Inc. Image sequence enhancement and motion picture project management system
US10298834B2 (en) 2006-12-01 2019-05-21 Google Llc Video refocusing
US9241147B2 (en) 2013-05-01 2016-01-19 Legend3D, Inc. External depth map transformation method for conversion of two-dimensional images to stereoscopic images
US9288476B2 (en) 2011-02-17 2016-03-15 Legend3D, Inc. System and method for real-time depth modification of stereo images of a virtual reality environment
US9282321B2 (en) 2011-02-17 2016-03-08 Legend3D, Inc. 3D model multi-reviewer system
US9407904B2 (en) 2013-05-01 2016-08-02 Legend3D, Inc. Method for creating 3D virtual reality from 2D images
WO2012139232A1 (en) * 2011-04-11 2012-10-18 Liberovision Ag Image processing
US9607424B2 (en) * 2012-06-26 2017-03-28 Lytro, Inc. Depth-assigned content for depth-enhanced pictures
US10129524B2 (en) 2012-06-26 2018-11-13 Google Llc Depth-assigned content for depth-enhanced virtual reality images
US9858649B2 (en) 2015-09-30 2018-01-02 Lytro, Inc. Depth-based image blurring
US9007365B2 (en) 2012-11-27 2015-04-14 Legend3D, Inc. Line depth augmentation system and method for conversion of 2D images to 3D images
US9547937B2 (en) * 2012-11-30 2017-01-17 Legend3D, Inc. Three-dimensional annotation system and method
US9007404B2 (en) 2013-03-15 2015-04-14 Legend3D, Inc. Tilt-based look around effect image enhancement method
US10334151B2 (en) 2013-04-22 2019-06-25 Google Llc Phase detection autofocus using subaperture images
US9438878B2 (en) 2013-05-01 2016-09-06 Legend3D, Inc. Method of converting 2D video to 3D video using 3D object models
RU2543549C2 (en) * 2013-07-09 2015-03-10 Сергей Александрович Соболев Television multiview method of acquiring, transmitting and receiving stereo information on monitored space with automatic measurement thereof "third eye" system
EP3121792B1 (en) 2014-03-17 2019-07-03 Panasonic Intellectual Property Management Co., Ltd. Processing device for label information for multi-viewpoint images and processing method for label information
US10469873B2 (en) 2015-04-15 2019-11-05 Google Llc Encoding and decoding virtual reality video
US10275898B1 (en) 2015-04-15 2019-04-30 Google Llc Wedge-based light-field video capture
US10341632B2 (en) 2015-04-15 2019-07-02 Google Llc. Spatial random access enabled video system with a three-dimensional viewing volume
US11328446B2 (en) 2015-04-15 2022-05-10 Google Llc Combining light-field data with active depth data for depth map generation
US10546424B2 (en) 2015-04-15 2020-01-28 Google Llc Layered content delivery for virtual and augmented reality experiences
US10567464B2 (en) 2015-04-15 2020-02-18 Google Llc Video compression with adaptive view-dependent lighting removal
US10419737B2 (en) 2015-04-15 2019-09-17 Google Llc Data structures and delivery methods for expediting virtual reality playback
US10412373B2 (en) 2015-04-15 2019-09-10 Google Llc Image capture for virtual reality displays
US10444931B2 (en) 2017-05-09 2019-10-15 Google Llc Vantage generation and interactive playback
US10440407B2 (en) 2017-05-09 2019-10-08 Google Llc Adaptive control for immersive experience delivery
US10565734B2 (en) 2015-04-15 2020-02-18 Google Llc Video capture, processing, calibration, computational fiber artifact removal, and light-field pipeline
US10540818B2 (en) 2015-04-15 2020-01-21 Google Llc Stereo image generation and interactive playback
US9979909B2 (en) 2015-07-24 2018-05-22 Lytro, Inc. Automatic lens flare detection and correction for light-field images
US9639945B2 (en) 2015-08-27 2017-05-02 Lytro, Inc. Depth-based application of image effects
US9609307B1 (en) 2015-09-17 2017-03-28 Legend3D, Inc. Method of converting 2D video to 3D video using machine learning
US10672180B2 (en) 2016-05-02 2020-06-02 Samsung Electronics Co., Ltd. Method, apparatus, and recording medium for processing image
US10275892B2 (en) 2016-06-09 2019-04-30 Google Llc Multi-view scene segmentation and propagation
US10679361B2 (en) 2016-12-05 2020-06-09 Google Llc Multi-view rotoscope contour propagation
US10594945B2 (en) 2017-04-03 2020-03-17 Google Llc Generating dolly zoom effect using light field image data
US10474227B2 (en) 2017-05-09 2019-11-12 Google Llc Generation of virtual reality with 6 degrees of freedom from limited viewer data
US10354399B2 (en) 2017-05-25 2019-07-16 Google Llc Multi-view back-projection to a light-field
US10545215B2 (en) 2017-09-13 2020-01-28 Google Llc 4D camera tracking and optical stabilization
US10965862B2 (en) 2018-01-18 2021-03-30 Google Llc Multi-camera navigation interface
GB2571306A (en) * 2018-02-23 2019-08-28 Sony Interactive Entertainment Europe Ltd Video recording and playback systems and methods
DK201870351A1 (en) 2018-05-07 2020-01-13 Apple Inc. Devices and Methods for Measuring Using Augmented Reality
US10785413B2 (en) 2018-09-29 2020-09-22 Apple Inc. Devices, methods, and graphical user interfaces for depth-based annotation
CN111275611B (en) * 2020-01-13 2024-02-06 深圳市华橙数字科技有限公司 Method, device, terminal and storage medium for determining object depth in three-dimensional scene
US11003308B1 (en) 2020-02-03 2021-05-11 Apple Inc. Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
US11727650B2 (en) 2020-03-17 2023-08-15 Apple Inc. Systems, methods, and graphical user interfaces for displaying and manipulating virtual objects in augmented reality environments
US11941764B2 (en) 2021-04-18 2024-03-26 Apple Inc. Systems, methods, and graphical user interfaces for adding effects in augmented reality environments

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999026198A2 (en) * 1997-11-14 1999-05-27 National University Of Singapore System and method for merging objects into an image sequence without prior knowledge of the scene in the image sequence
US6115028A (en) * 1996-08-22 2000-09-05 Silicon Graphics, Inc. Three dimensional input system using tilt

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6115028A (en) * 1996-08-22 2000-09-05 Silicon Graphics, Inc. Three dimensional input system using tilt
WO1999026198A2 (en) * 1997-11-14 1999-05-27 National University Of Singapore System and method for merging objects into an image sequence without prior knowledge of the scene in the image sequence

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"Interactive Video Object Annotation", 1 April 2007, article DAN B GOLDMAN, BRIAN CURLESS, DAVID SALESIN, STEVEN M. SEITZ: "Interactive Video Object Annotation", XP055003121 *
AZUMA R ET AL: "Recent advances in augmented reality", IEEE COMPUTER GRAPHICS AND APPLICATIONS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 21, no. 6, 1 November 2001 (2001-11-01), pages 34 - 47, XP011093930, ISSN: 0272-1716, DOI: DOI:10.1109/38.963459 *
IGOR G OLAIZOLA ET AL: "MHP Oriented Interactive Augmented Reality System for Sports Broadcasting Environments", JOURNAL OF VIRTUAL REALITY AND BROADCASTING, vol. 3, no. 12, 1 January 2006 (2006-01-01), pages 1 - 11, XP055003123 *
KIM H ET AL: "Hierarchical Depth Estimation for Image Synthesis in Mixed Reality", PROCEEDINGS OF SPIE, THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING SPIE, USA, vol. 5006, 21 January 2003 (2003-01-21), pages 544 - 553, XP002523433, ISSN: 0277-786X, [retrieved on 20031023], DOI: DOI:10.1117/12.473879 *

Also Published As

Publication number Publication date
WO2011029209A2 (en) 2011-03-17

Similar Documents

Publication Publication Date Title
WO2011029209A3 (en) Method and apparatus for generating and processing depth-enhanced images
KR102214827B1 (en) Method and apparatus for providing augmented reality
EP4231245A3 (en) Method and apparatus for generating a virtual image from a viewpoint selected by the user, from a camera array with transmission of foreground and background images at different frame rates
WO2016140934A3 (en) Methods and apparatus for 3d image rendering
WO2008061490A3 (en) Arrangement and method for capturing and displaying images of a scene and/or an object
EP2566150A3 (en) Image processing apparatus, image processing method, and program
EP2402906A3 (en) Apparatus and method for providing 3D augmented reality
WO2007057485A3 (en) Method of generating and using a virtual fitting room and corresponding system
US20190206115A1 (en) Image processing device and method
GB2507830A8 (en) System and Method of Image Augmentation
EP2533541A4 (en) Stereo camera
WO2009157708A3 (en) Method and apparatus for processing 3d video image
EP2738743A3 (en) Generating and reproducing augmented reality contents
EP2529810A3 (en) Information processing system, information processing device, information processing program, and moving image reproduction control method
EP3267398A3 (en) Image processing apparatus and image processing method
EP2153409A4 (en) Camera pose estimation apparatus and method for augmented reality imaging
GB0712690D0 (en) Imagee processing
JP2006115246A5 (en)
GB201120987D0 (en) A reconstruction system and method
EP2408212A3 (en) Mobile terminal and 3D image controlling method therein
WO2007107214A3 (en) Method and device for determining correspondence, preferably for the three-dimensional reconstruction of a scene
WO2019085022A1 (en) Generation method and device for optical field 3d display unit image
JP2014199532A5 (en) Image processing apparatus, image processing method, and program
JP2012208719A5 (en)
JP2019510991A (en) Arrangement for rendering virtual reality with an adaptive focal plane

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10757383

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10757383

Country of ref document: EP

Kind code of ref document: A2