WO2013119408A3 - Method and system for automatic 3-d image creation - Google Patents

Method and system for automatic 3-d image creation Download PDF

Info

Publication number
WO2013119408A3
WO2013119408A3 PCT/US2013/023489 US2013023489W WO2013119408A3 WO 2013119408 A3 WO2013119408 A3 WO 2013119408A3 US 2013023489 W US2013023489 W US 2013023489W WO 2013119408 A3 WO2013119408 A3 WO 2013119408A3
Authority
WO
WIPO (PCT)
Prior art keywords
image
initial
camera
initial position
candidate
Prior art date
Application number
PCT/US2013/023489
Other languages
French (fr)
Other versions
WO2013119408A2 (en
Inventor
Jonathan Huang
Samuel Kvaalen
Peter Bradshaw
Original Assignee
Google Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Inc. filed Critical Google Inc.
Priority to EP13702870.0A priority Critical patent/EP2812756B1/en
Priority to CN201380018661.0A priority patent/CN104205828B/en
Publication of WO2013119408A2 publication Critical patent/WO2013119408A2/en
Publication of WO2013119408A3 publication Critical patent/WO2013119408A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/221—Image signal generators using stereoscopic image cameras using a single 2D image sensor using the relative movement between cameras and objects
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00—Stereoscopic photography
    • G03B35/02—Stereoscopic photography by sequential recording
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/285—Analysis of motion using a sequence of stereo image pairs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/003—Aspects relating to the "2D+depth" image format

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

Disclosed herein are methods, devices, and non-transitory computer readable media that relate to stereoscopic image creation. A camera captures an initial image at an initial position. A target displacement from the initial position is determined for a desired stereoscopic effect, and an instruction is provided that specifies a direction in which to move the camera from the initial position. While the camera is in motion, an estimated displacement from the initial position is calculated. When the estimated displacement corresponds to the target displacement, the camera automatically captures a candidate image. An acceptability analysis is performed to determine whether the candidate image has acceptable image quality and acceptable similarity to the initial image. If the candidate image passes the acceptability analysis, a stereoscopic image is created based on the initial and candidate images.
PCT/US2013/023489 2012-02-06 2013-01-28 Method and system for automatic 3-d image creation WO2013119408A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13702870.0A EP2812756B1 (en) 2012-02-06 2013-01-28 Method and system for automatic 3-d image creation
CN201380018661.0A CN104205828B (en) 2012-02-06 2013-01-28 For the method and system that automatic 3D rendering is created

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US13/366,709 US8259161B1 (en) 2012-02-06 2012-02-06 Method and system for automatic 3-D image creation
US13/366,709 2012-02-06
US13/601,845 2012-08-31
US13/601,845 US8711209B2 (en) 2012-02-06 2012-08-31 Method and system for automatic 3-D image creation

Publications (2)

Publication Number Publication Date
WO2013119408A2 WO2013119408A2 (en) 2013-08-15
WO2013119408A3 true WO2013119408A3 (en) 2013-10-10

Family

ID=46726493

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/023489 WO2013119408A2 (en) 2012-02-06 2013-01-28 Method and system for automatic 3-d image creation

Country Status (4)

Country Link
US (5) US8259161B1 (en)
EP (1) EP2812756B1 (en)
CN (1) CN104205828B (en)
WO (1) WO2013119408A2 (en)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012002017A1 (en) * 2010-06-30 2012-01-05 富士フイルム株式会社 Image capture device, program, and image capture method
JP2013092616A (en) * 2011-10-25 2013-05-16 Toshiba Lighting & Technology Corp Illuminating device
US20130107008A1 (en) * 2011-10-31 2013-05-02 Nokia Corporation Method, apparatus and computer program product for capturing images
US8259161B1 (en) 2012-02-06 2012-09-04 Google Inc. Method and system for automatic 3-D image creation
US9064184B2 (en) 2012-06-18 2015-06-23 Ebay Inc. Normalized images for item listings
EP2731336B1 (en) * 2012-11-12 2017-10-18 Samsung Electronics Co., Ltd Method and apparatus for generating 3D images using plurality of mobile devices
KR20150091064A (en) * 2012-11-30 2015-08-07 톰슨 라이센싱 Method and system for capturing a 3d image using single camera
US9554049B2 (en) 2012-12-04 2017-01-24 Ebay Inc. Guided video capture for item listings
WO2014103731A1 (en) * 2012-12-26 2014-07-03 ソニー株式会社 Image processing device and method, and program
EP2750392A1 (en) * 2012-12-27 2014-07-02 ST-Ericsson SA Visually-assisted stereo acquisition from a single camera
US10192312B2 (en) 2013-04-08 2019-01-29 C3D Augmented Reality Solutions Ltd Distance estimation using multi-camera device
CN104113684B (en) * 2013-04-15 2017-09-22 宏达国际电子股份有限公司 Control method and electronic installation
US20140378810A1 (en) * 2013-04-18 2014-12-25 Digimarc Corporation Physiologic data acquisition and analysis
CN105190229B (en) * 2013-04-19 2018-07-31 凸版印刷株式会社 Three-dimensional shape measuring device, three-dimensional shape measuring method and three-dimensional shape measuring program
CN105143816B (en) * 2013-04-19 2018-10-26 凸版印刷株式会社 Three-dimensional shape measuring device, three-dimensional shape measuring method and three-dimensional shape measuring program
US9261966B2 (en) 2013-08-22 2016-02-16 Sony Corporation Close range natural user interface system and method of operation thereof
EP3703001A1 (en) 2013-08-31 2020-09-02 ML Netherlands C.V. User feedback for real-time checking and improving quality of scanned image
CN105705903A (en) * 2013-11-06 2016-06-22 凸版印刷株式会社 3D-shape measurement device, 3D-shape measurement method, and 3D-shape measurement program
US10142522B2 (en) 2013-12-03 2018-11-27 Ml Netherlands C.V. User feedback for real-time checking and improving quality of scanned image
CH709003B1 (en) * 2013-12-18 2017-06-15 Kaba Ag Distance determination from images with reference object.
WO2015104235A1 (en) 2014-01-07 2015-07-16 Dacuda Ag Dynamic updating of composite images
EP3748953B1 (en) 2014-01-07 2024-04-17 ML Netherlands C.V. Adaptive camera control for reducing motion blur during real-time image capture
US10484561B2 (en) 2014-05-12 2019-11-19 Ml Netherlands C.V. Method and apparatus for scanning and printing a 3D object
US10026010B2 (en) * 2014-05-14 2018-07-17 At&T Intellectual Property I, L.P. Image quality estimation using a reference image portion
EP3055734A4 (en) * 2014-10-28 2016-10-26 Sz Dji Technology Co Ltd Rgb-d imaging system and method using ultrasonic depth sensing
WO2019067134A1 (en) 2017-08-27 2019-04-04 Mine One Gmbh Visual communications methods, systems and software
US10853625B2 (en) 2015-03-21 2020-12-01 Mine One Gmbh Facial signature methods, systems and software
EP3274986A4 (en) 2015-03-21 2019-04-17 Mine One GmbH Virtual 3d methods, systems and software
EP3089449B1 (en) 2015-04-30 2020-03-04 InterDigital CE Patent Holdings Method for obtaining light-field data using a non-light-field imaging device, corresponding device, computer program product and non-transitory computer-readable carrier medium
CN105141942B (en) * 2015-09-02 2017-10-27 小米科技有限责任公司 3D rendering synthetic method and device
JP6630118B2 (en) * 2015-11-04 2020-01-15 キヤノン株式会社 Imaging device and control method therefor, program, storage medium
WO2017086516A1 (en) * 2015-11-20 2017-05-26 엘지전자 주식회사 Mobile terminal and operation method thereof
US10380993B1 (en) * 2016-01-22 2019-08-13 United Services Automobile Association (Usaa) Voice commands for the visually impaired to move a camera relative to a document
US9454154B1 (en) 2016-03-07 2016-09-27 Amazon Technologies, Inc. Incident light sensor on autonomous vehicle
KR102101916B1 (en) * 2016-06-09 2020-05-29 구글 엘엘씨 Taking photos through visual obstructions
US10643360B2 (en) * 2017-02-10 2020-05-05 Arizona Board Of Regents On Behalf Of Arizona State University Real-time medical image visualization systems and related methods
US10587796B1 (en) 2017-02-24 2020-03-10 State Farm Mutual Automobile Insurance Company Technology for automatically ensuring consistent digital image capture parameters
WO2019078310A1 (en) * 2017-10-20 2019-04-25 日本電気株式会社 Three-dimensional face shape derivation device, three-dimensional face shape deriving method, and non-transitory computer readable medium
CN109982062A (en) * 2017-12-28 2019-07-05 深圳市优必选科技有限公司 3D picture shooting method, system and robot based on robot
US10885657B2 (en) * 2018-10-31 2021-01-05 Disney Enterprises, Inc. Configuration for indicating image capture device position
US11100704B2 (en) * 2018-12-14 2021-08-24 Hover Inc. Generating and validating a virtual 3D representation of a real-world structure
IT202100008477A1 (en) * 2021-04-07 2022-10-07 Medilx S R L WEARABLE SYSTEM TO ASSIST THE ACTIVITIES OF PLANNING INTERVENTIONS IN THE BUILDING FIELD

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110157017A1 (en) * 2009-12-31 2011-06-30 Sony Computer Entertainment Europe Limited Portable data processing appartatus
US20110193941A1 (en) * 2010-02-05 2011-08-11 Sony Corporation Image processing apparatus, imaging apparatus, image processing method, and program
US20110255775A1 (en) * 2009-07-31 2011-10-20 3Dmedia Corporation Methods, systems, and computer-readable storage media for generating three-dimensional (3d) images of a scene
US20120002019A1 (en) * 2010-06-30 2012-01-05 Takashi Hashimoto Multiple viewpoint imaging control device, multiple viewpoint imaging control method and conputer readable medium

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3963568B2 (en) * 1997-05-28 2007-08-22 オリンパス株式会社 Camera autofocus device
US7764284B2 (en) * 2004-05-24 2010-07-27 Simactive Inc. Method and system for detecting and evaluating 3D changes from images and a 3D reference model
US8274530B2 (en) * 2007-03-12 2012-09-25 Conversion Works, Inc. Systems and methods for filling occluded information for 2-D to 3-D conversion
IL191615A (en) * 2007-10-23 2015-05-31 Israel Aerospace Ind Ltd Method and system for producing tie points for use in stereo-matching of stereoscopic images and method for detecting differences in a photographed scenery between two time points
EP2315446A4 (en) * 2008-08-08 2011-12-28 Sharp Kk Dynamic image encoding device and dynamic image decoding device
WO2010113929A1 (en) * 2009-03-31 2010-10-07 日本電気株式会社 Tracking judgment device, tracking judgment method, and tracking judgment program
WO2011014420A1 (en) * 2009-07-31 2011-02-03 3Dmedia Corporation Methods, systems, and computer-readable storage media for selecting image capture positions to generate three-dimensional (3d) images
US20110080466A1 (en) 2009-10-07 2011-04-07 Spatial View Inc. Automated processing of aligned and non-aligned images for creating two-view and multi-view stereoscopic 3d images
US10080006B2 (en) 2009-12-11 2018-09-18 Fotonation Limited Stereoscopic (3D) panorama creation on handheld device
US20110172526A1 (en) * 2010-01-12 2011-07-14 Martin Lachaine Feature Tracking Using Ultrasound
US8274552B2 (en) * 2010-12-27 2012-09-25 3Dmedia Corporation Primary and auxiliary image capture devices for image processing and related methods
US20130155049A1 (en) * 2011-12-15 2013-06-20 Luugi Marsan Multiple hardware cursors per controller
US8259161B1 (en) 2012-02-06 2012-09-04 Google Inc. Method and system for automatic 3-D image creation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110255775A1 (en) * 2009-07-31 2011-10-20 3Dmedia Corporation Methods, systems, and computer-readable storage media for generating three-dimensional (3d) images of a scene
US20110157017A1 (en) * 2009-12-31 2011-06-30 Sony Computer Entertainment Europe Limited Portable data processing appartatus
US20110193941A1 (en) * 2010-02-05 2011-08-11 Sony Corporation Image processing apparatus, imaging apparatus, image processing method, and program
US20120002019A1 (en) * 2010-06-30 2012-01-05 Takashi Hashimoto Multiple viewpoint imaging control device, multiple viewpoint imaging control method and conputer readable medium

Also Published As

Publication number Publication date
US10116922B2 (en) 2018-10-30
US8259161B1 (en) 2012-09-04
US9071827B1 (en) 2015-06-30
US20170026629A1 (en) 2017-01-26
US20150262366A1 (en) 2015-09-17
CN104205828B (en) 2017-06-13
EP2812756B1 (en) 2017-09-13
US9466114B2 (en) 2016-10-11
EP2812756A2 (en) 2014-12-17
US8711209B2 (en) 2014-04-29
US20130201301A1 (en) 2013-08-08
CN104205828A (en) 2014-12-10
WO2013119408A2 (en) 2013-08-15

Similar Documents

Publication Publication Date Title
WO2013119408A3 (en) Method and system for automatic 3-d image creation
EP3654286A3 (en) Image capturing apparatus, monitoring system, image processing apparatus, image capturing method, and non-transitory computer readable recording medium
EP3134850A4 (en) System and method for controlling a camera based on processing an image captured by other camera
GB201411690D0 (en) Method, device, and system for computinga spherical projection image based on two-dimensional images
WO2013035096A3 (en) System and method of tracking an object in an image captured by a moving device
WO2015054194A3 (en) System and method for camera based position and orientation measurement
EP3565237A3 (en) Method and apparatus for capturing images
WO2015186002A3 (en) Systems and methods for detecting an object
WO2014132090A3 (en) Optical navigation & positioning system
WO2013149916A3 (en) Method and device for optically determining a position and/or orientation of an object in space
SG10201710217TA (en) Information processing apparatus and information processing method
EP3024229A3 (en) Method and apparatus for calibrating multi-view images
WO2015041872A8 (en) Method and apparatus for selectively providing information on objects in a captured image
WO2013043021A3 (en) System and method for photographing moving subject by means of camera, and acquiring actual movement trajectory of subject based on photographed image
WO2014186420A3 (en) Augmented reality (ar) capture & play
EP2919159A3 (en) Image processing device and image processing method
WO2013096844A3 (en) Directional input for a video game
WO2014140932A3 (en) Apparatus and method for providing feedback to the user based on the visual context
EP2620896A3 (en) System And Method For Face Capture And Matching
GB201014411D0 (en) A method and apparatus for detecting disparity
GB201119501D0 (en) An apparatus, method and system
WO2013015549A3 (en) Plane-characteristic-based markerless augmented reality system and method for operating same
EP2669846A3 (en) Target recognition system and target recognition method executed by the target recognition system, target recognition program executed on the target recognition system, and recording medium storing the target recognition program
EP3038015A3 (en) Image recognition apparatus and commodity information processing apparatus
EP3317850A4 (en) Disparity image generation device, disparity image generation method, disparity image generation program, object recognition device, and equipment control system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13702870

Country of ref document: EP

Kind code of ref document: A2

REEP Request for entry into the european phase

Ref document number: 2013702870

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2013702870

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13702870

Country of ref document: EP

Kind code of ref document: A2