WO2011048497A3 - Computer vision based hybrid tracking for augmented reality in outdoor urban environments - Google Patents

Computer vision based hybrid tracking for augmented reality in outdoor urban environments Download PDF

Info

Publication number
WO2011048497A3
WO2011048497A3 PCT/IB2010/002885 IB2010002885W WO2011048497A3 WO 2011048497 A3 WO2011048497 A3 WO 2011048497A3 IB 2010002885 W IB2010002885 W IB 2010002885W WO 2011048497 A3 WO2011048497 A3 WO 2011048497A3
Authority
WO
WIPO (PCT)
Prior art keywords
computer vision
hybrid tracking
tracking system
reference frame
phase
Prior art date
Application number
PCT/IB2010/002885
Other languages
French (fr)
Other versions
WO2011048497A2 (en
Inventor
Wee Teck Fong
Soh Khim Ong
Andrew Yeh-Ching Nee
Original Assignee
National University Of Singapore
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National University Of Singapore filed Critical National University Of Singapore
Publication of WO2011048497A2 publication Critical patent/WO2011048497A2/en
Publication of WO2011048497A3 publication Critical patent/WO2011048497A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches

Abstract

A computer vision based hybrid tracking system integrates computer vision, global positioning services and inertial sensing to provide robust, accurate and jitter- free augmentation in outdoor environments. The hybrid tracking system operates in two phases: configuration phase followed by tracking phase. In configuration phase, the hybrid tracking system selects a reference frame from an input video sequence captured by a camera and detects feature signatures of each planar surface of objects in the reference frame. In tracking phase, the hybrid tracking system uses the selected reference frame and detected feature signatures from configuration phase to estimate 3D positions and orientations of objects in the video sequence relative to camera motion.
PCT/IB2010/002885 2009-10-19 2010-10-18 Computer vision based hybrid tracking for augmented reality in outdoor urban environments WO2011048497A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US25272609P 2009-10-19 2009-10-19
US61/252,726 2009-10-19

Publications (2)

Publication Number Publication Date
WO2011048497A2 WO2011048497A2 (en) 2011-04-28
WO2011048497A3 true WO2011048497A3 (en) 2011-07-14

Family

ID=43900742

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2010/002885 WO2011048497A2 (en) 2009-10-19 2010-10-18 Computer vision based hybrid tracking for augmented reality in outdoor urban environments

Country Status (1)

Country Link
WO (1) WO2011048497A2 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9342886B2 (en) 2011-04-29 2016-05-17 Qualcomm Incorporated Devices, methods, and apparatuses for homography evaluation involving a mobile device
WO2015062164A1 (en) * 2013-10-31 2015-05-07 The Chinese University Of Hong Kong Method for optimizing localization of augmented reality-based location system
US10102675B2 (en) 2014-06-27 2018-10-16 Nokia Technologies Oy Method and technical equipment for determining a pose of a device
US9317921B2 (en) * 2014-07-10 2016-04-19 Qualcomm Incorporated Speed-up template matching using peripheral information
GB2535190A (en) 2015-02-12 2016-08-17 Nokia Technologies Oy A method, a system, an apparatus and a computer program product for image-based retrieval
CN109509206A (en) * 2017-09-11 2019-03-22 苏宁云商集团股份有限公司 The localization method and system of superposition of data in a kind of augmented reality
CN108648235B (en) * 2018-04-27 2022-05-17 腾讯科技（深圳）有限公司 Repositioning method and device for camera attitude tracking process and storage medium
CN109509261B (en) * 2018-11-26 2023-07-25 端美科技(中山)有限公司 Augmented reality method, device and computer storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030012410A1 (en) * 2001-07-10 2003-01-16 Nassir Navab Tracking and pose estimation for augmented reality using real features
US6765569B2 (en) * 2001-03-07 2004-07-20 University Of Southern California Augmented-reality tool employing scene-feature autocalibration during camera motion
US20050238200A1 (en) * 2004-04-27 2005-10-27 Rakesh Gupta Simultaneous localization and mapping using multiple view feature descriptors
US7015831B2 (en) * 2002-12-17 2006-03-21 Evolution Robotics, Inc. Systems and methods for incrementally updating a pose of a mobile device calculated by visual simultaneous localization and mapping techniques
US20060233423A1 (en) * 2005-04-19 2006-10-19 Hesam Najafi Fast object detection for augmented reality systems
EP1850270A1 (en) * 2006-04-28 2007-10-31 Toyota Motor Europe NV Robust interest point detector and descriptor
WO2008143523A1 (en) * 2007-05-22 2008-11-27 Metaio Gmbh Camera pose estimation apparatus and method for augmented reality imaging

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6765569B2 (en) * 2001-03-07 2004-07-20 University Of Southern California Augmented-reality tool employing scene-feature autocalibration during camera motion
US20030012410A1 (en) * 2001-07-10 2003-01-16 Nassir Navab Tracking and pose estimation for augmented reality using real features
US7015831B2 (en) * 2002-12-17 2006-03-21 Evolution Robotics, Inc. Systems and methods for incrementally updating a pose of a mobile device calculated by visual simultaneous localization and mapping techniques
US20050238200A1 (en) * 2004-04-27 2005-10-27 Rakesh Gupta Simultaneous localization and mapping using multiple view feature descriptors
US20060233423A1 (en) * 2005-04-19 2006-10-19 Hesam Najafi Fast object detection for augmented reality systems
EP1850270A1 (en) * 2006-04-28 2007-10-31 Toyota Motor Europe NV Robust interest point detector and descriptor
WO2008143523A1 (en) * 2007-05-22 2008-11-27 Metaio Gmbh Camera pose estimation apparatus and method for augmented reality imaging

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. 244-250, (Washington, DC, USA), 27 June - 2 July 2004", article LEPETIT, V. ET AL.: "Point Matching as a Classification Problem for Fast and Robust Object Pose Estimation" *
"Proceedings of the International Conference on Computer Vision, vol. 2, IEEE Computer Society, Washington, DC, USA, September 1999", article LOWE, G.: "Object Recognition from Local State-Invariant Features", pages: 1 - 8 *

Also Published As

Publication number Publication date
WO2011048497A2 (en) 2011-04-28

Similar Documents

Publication Publication Date Title
WO2011048497A3 (en) Computer vision based hybrid tracking for augmented reality in outdoor urban environments
US9390344B2 (en) Sensor-based camera motion detection for unconstrained slam
WO2011128766A3 (en) Methods and systems for object tracking
WO2006105054A3 (en) Method and system for improving video metadata through the use of frame-to-frame correspondences
KR101295714B1 (en) Apparatus and Method for providing 3D Augmented Reality
EP2348280A3 (en) Systems and methods for monocular airborne object detection
UA103759C2 (en) Method and camera for the real-time acquisition of visual information from three-dimensional scenes
WO2011108827A3 (en) Pointing device of augmented reality
WO2012034092A8 (en) Online reference generation and tracking for multi-user augmented reality
EP2642447A3 (en) Device for the calibration of a stereo camera
WO2010128321A3 (en) Entertainment device, system, and method
WO2010022386A3 (en) Navigation in a three dimensional environment on a mobile device
WO2014054958A3 (en) Method for aligning and tracking point regions in images with radial distortion that outputs motion model parameters, distortion calibration, and variation in zoom
WO2009007917A3 (en) Object motion capturing system and method
WO2006083297A3 (en) Method and apparatus for aligning video to three-dimensional point clouds
WO2010126816A3 (en) Systems and methods for applying model tracking to motion capture
US20150022552A1 (en) Ar image processing apparatus and method technical field
WO2012106068A3 (en) Mobile camera localization using depth maps
WO2012039636A3 (en) "3d localisation microscopy and 4d localisation microscopy and tracking methods and systems"
EP2538305A3 (en) System and method for close-range movement tracking
WO2014032020A3 (en) Feature based high resolution motion estimation from low resolution images captured using an array source
EP2602740A3 (en) Changing parameters of sequential video frames to detect different types of objects
WO2010141120A3 (en) System and method for generating three dimensional images using lidar and video measurements
WO2007045994A3 (en) Drop location verification system
WO2012106370A2 (en) Correlating areas on the physical object to areas on the phone screen

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10824538

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10824538

Country of ref document: EP

Kind code of ref document: A2