CN104081434B - 经配置以基于运动传感器数据计算3d模型的移动装置 - Google Patents

经配置以基于运动传感器数据计算3d模型的移动装置 Download PDF

Info

Publication number
CN104081434B
CN104081434B CN201280066984.2A CN201280066984A CN104081434B CN 104081434 B CN104081434 B CN 104081434B CN 201280066984 A CN201280066984 A CN 201280066984A CN 104081434 B CN104081434 B CN 104081434B
Authority
CN
China
Prior art keywords
image
mobile device
camera
model
projection matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201280066984.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN104081434A (zh
Inventor
齐英勇
杨瑞多
塞拉姆·孙达雷桑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN104081434A publication Critical patent/CN104081434A/zh
Application granted granted Critical
Publication of CN104081434B publication Critical patent/CN104081434B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/564—Depth or shape recovery from multiple images from contours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/579—Depth or shape recovery from multiple images from motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
CN201280066984.2A 2012-01-26 2012-12-12 经配置以基于运动传感器数据计算3d模型的移动装置 Active CN104081434B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201261591196P 2012-01-26 2012-01-26
US61/591,196 2012-01-26
US13/673,681 US9639959B2 (en) 2012-01-26 2012-11-09 Mobile device configured to compute 3D models based on motion sensor data
US13/673,681 2012-11-09
PCT/US2012/069088 WO2013112237A1 (en) 2012-01-26 2012-12-12 Mobile device configured to compute 3d models based on motion sensor data

Publications (2)

Publication Number Publication Date
CN104081434A CN104081434A (zh) 2014-10-01
CN104081434B true CN104081434B (zh) 2018-01-05

Family

ID=48869873

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280066984.2A Active CN104081434B (zh) 2012-01-26 2012-12-12 经配置以基于运动传感器数据计算3d模型的移动装置

Country Status (6)

Country Link
US (1) US9639959B2 (enExample)
EP (1) EP2807629B1 (enExample)
JP (1) JP6199313B2 (enExample)
KR (1) KR101827046B1 (enExample)
CN (1) CN104081434B (enExample)
WO (1) WO2013112237A1 (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10261408B2 (en) * 2010-07-18 2019-04-16 Spatial Cam Llc Mobile and portable camera platform for tracking an object
US9131118B2 (en) * 2012-11-14 2015-09-08 Massachusetts Institute Of Technology Laser speckle photography for surface tampering detection
EP2926196A4 (en) * 2012-11-30 2016-08-24 Thomson Licensing METHOD AND SYSTEM FOR DETECTING A 3D IMAGE USING A SINGLE CAMERA
KR102153539B1 (ko) * 2013-09-05 2020-09-08 한국전자통신연구원 영상 처리 장치 및 방법
US9173066B1 (en) * 2014-06-13 2015-10-27 Xerox Corporation Methods and systems for controlling an electronic device
CN104282041A (zh) * 2014-09-30 2015-01-14 小米科技有限责任公司 三维建模方法及装置
JP2016070891A (ja) * 2014-10-01 2016-05-09 日本電信電話株式会社 映像データ処理装置及び映像データ処理プログラム
JP6306996B2 (ja) * 2014-10-01 2018-04-04 日本電信電話株式会社 映像データ処理方法、映像データ処理装置及び映像データ処理プログラム
KR102248404B1 (ko) 2014-11-17 2021-05-07 삼성전자주식회사 움직임 분석 방법 및 움직임 분석 장치
CN104517316B (zh) * 2014-12-31 2018-10-16 中科创达软件股份有限公司 一种三维物体建模方法及终端设备
CN108139876B (zh) * 2015-03-04 2022-02-25 杭州凌感科技有限公司 用于沉浸式和交互式多媒体生成的系统和方法
CN104794723A (zh) * 2015-05-04 2015-07-22 福建师范大学 一种基于概率的遥感影像建筑物位置检测方法
US10012509B2 (en) * 2015-11-12 2018-07-03 Blackberry Limited Utilizing camera to assist with indoor pedestrian navigation
US10341633B2 (en) 2015-11-20 2019-07-02 Qualcomm Incorporated Systems and methods for correcting erroneous depth information
KR20170076471A (ko) 2015-12-24 2017-07-04 삼성전자주식회사 변형 가능한 디스플레이 장치 및 이를 이용한 영상 표시 방법
US10841486B2 (en) * 2017-07-20 2020-11-17 Eclo, Inc. Augmented reality for three-dimensional model reconstruction
CN108235764B (zh) * 2017-12-29 2022-09-16 达闼机器人股份有限公司 信息处理方法、装置、云处理设备及计算机程序产品
WO2019198562A1 (ja) * 2018-04-11 2019-10-17 富士フイルム株式会社 構造物管理装置、構造物管理方法、及び構造物管理プログラム
CN113140030B (zh) * 2020-01-17 2024-12-31 北京小米移动软件有限公司 三维模型生成方法、装置及存储介质
US20210259779A1 (en) * 2020-02-20 2021-08-26 Verb Surgical Inc. Multi-camera user interface device calibration and tracking
US11694313B2 (en) * 2020-02-28 2023-07-04 Unity Technologies Sf Computer-generated image processing including volumetric scene reconstruction
FR3122763B1 (fr) * 2021-05-07 2024-07-26 Captana Gmbh Procédé automatisé de réglage d’un paramètre de visualisation d’un dispositif d’imagerie en magasin

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020029127A1 (en) * 2000-07-19 2002-03-07 Asahi Kogaku Kogyo Kabushiki Kaisha Method and apparatus for measuring 3-D information
CN101395613A (zh) * 2006-01-31 2009-03-25 南加利福尼亚大学 由2d图像实现3d人脸重建
CN102012625A (zh) * 2009-06-16 2011-04-13 英特尔公司 根据单个相机和运动传感器的3d信息推导
WO2011144408A1 (fr) * 2010-05-17 2011-11-24 Commissariat A L'energie Atomique Et Aux Energies Alternatives Procede et systeme pour fusionner des donnees issues de capteurs d'images et de capteurs de mouvement ou de position

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6094215A (en) 1998-01-06 2000-07-25 Intel Corporation Method of determining relative camera orientation position to create 3-D visual images
CA2637877A1 (en) * 1998-06-18 1999-12-23 Kline & Walker, Llc Automated devices to control equipment and machines with remote control and accountability worldwide
US7466843B2 (en) * 2000-07-07 2008-12-16 Pryor Timothy R Multi-functional control and entertainment systems
US6961055B2 (en) * 2001-05-09 2005-11-01 Free Radical Design Limited Methods and apparatus for constructing virtual environments
JP2003006680A (ja) 2001-06-20 2003-01-10 Zenrin Co Ltd ３次元電子地図データの生成方法
CN100340960C (zh) * 2003-05-20 2007-10-03 英特莱格公司 用于操纵三维对象的数字表示的方法和系统
US7596473B2 (en) * 2003-05-20 2009-09-29 Interlego Ag Method of constructing a virtual construction model
JP4132068B2 (ja) 2005-02-28 2008-08-13 学校法人早稲田大学 画像処理装置及び三次元計測装置並びに画像処理装置用プログラム
JP4910312B2 (ja) * 2005-06-03 2012-04-04 ソニー株式会社 撮像装置および撮像方法
US7856125B2 (en) 2006-01-31 2010-12-21 University Of Southern California 3D face reconstruction from 2D images
US20070248260A1 (en) 2006-04-20 2007-10-25 Nokia Corporation Supporting a 3D presentation
US8498497B2 (en) 2006-11-17 2013-07-30 Microsoft Corporation Swarm imaging
US7676146B2 (en) * 2007-03-09 2010-03-09 Eastman Kodak Company Camera using multiple lenses and image sensors to provide improved focusing capability
JP2009200713A (ja) 2008-02-20 2009-09-03 Sony Corp 画像処理装置、画像処理方法、プログラム
CA2718680C (en) * 2008-03-18 2016-12-06 Elliptic Laboratories As Object and movement detection
WO2011091552A1 (en) 2010-02-01 2011-08-04 Intel Corporation Extracting and mapping three dimensional features from geo-referenced images
US20110234750A1 (en) 2010-03-24 2011-09-29 Jimmy Kwok Lap Lai Capturing Two or More Images to Form a Panoramic Image
KR20110116525A (ko) 2010-04-19 2011-10-26 엘지전자 주식회사 3ｄ 오브젝트를 제공하는 영상표시장치, 그 시스템 및 그 동작 제어방법
US9400503B2 (en) 2010-05-20 2016-07-26 Irobot Corporation Mobile human interface robot
JP2015507860A (ja) * 2011-12-07 2015-03-12 インテル コーポレイション 画像キャプチャのガイド

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020029127A1 (en) * 2000-07-19 2002-03-07 Asahi Kogaku Kogyo Kabushiki Kaisha Method and apparatus for measuring 3-D information
CN101395613A (zh) * 2006-01-31 2009-03-25 南加利福尼亚大学 由2d图像实现3d人脸重建
CN102012625A (zh) * 2009-06-16 2011-04-13 英特尔公司 根据单个相机和运动传感器的3d信息推导
WO2011144408A1 (fr) * 2010-05-17 2011-11-24 Commissariat A L'energie Atomique Et Aux Energies Alternatives Procede et systeme pour fusionner des donnees issues de capteurs d'images et de capteurs de mouvement ou de position

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
3D environment capture from monocular video and inertial data;R. Robert Clark;《Three-Dimensional Image Capture and Applications VII》;20060223;第6056卷;全文 *
The Design and Implementation of a Generic Sparse Bundle Adjustment Software Package Based on the Levenberg-Marquardt Algorithm;Manolis LA. Lourakis;《FORTH-ICS/TR-340》;20040831;全文 *

Also Published As

Publication number Publication date
JP2015508197A (ja) 2015-03-16
EP2807629A1 (en) 2014-12-03
KR20140116867A (ko) 2014-10-06
KR101827046B1 (ko) 2018-02-07
WO2013112237A1 (en) 2013-08-01
JP6199313B2 (ja) 2017-09-20
EP2807629B1 (en) 2017-09-20
CN104081434A (zh) 2014-10-01
US20130194392A1 (en) 2013-08-01
US9639959B2 (en) 2017-05-02

Similar Documents

Publication Publication Date Title
CN104081434B (zh) 经配置以基于运动传感器数据计算3d模型的移动装置
JP2015508197A5 (enExample)
US12387431B2 (en) 3D model reconstruction and scale estimation
US11436779B2 (en) Image processing method, electronic device, and storage medium
CN107646126B (zh) 用于移动设备的相机姿态估计
CN103905761B (zh) 图像处理系统和图像处理方法
US8660362B2 (en) Combined depth filtering and super resolution
CN103561211B (zh) 拍摄终端的拍摄角度提示方法和系统
JP2021192250A (ja) 単眼カメラを用いたリアルタイム３ｄ捕捉およびライブフィードバックのための方法およびシステム
CN111161336B (zh) 三维重建方法、三维重建装置和计算机可读存储介质
EP3467787B1 (en) Three-dimensional model generation system, three-dimensional model generation method, and program
CN103914876B (zh) 用于在3d地图上显示视频的方法和设备
JP6677098B2 (ja) 全天球動画の撮影システム、及びプログラム
CN109906600B (zh) 模拟景深
JP2016522485A (ja) 再構成からの隠消現実感効果および媒介現実感効果
JP7666018B2 (ja) 画像処理方法、プログラム、画像処理装置および画像処理システム
US11423609B2 (en) Apparatus and method for generating point cloud
CN107077719A (zh) 数码照片中基于深度图的透视校正
CN110868581A (zh) 一种图像的显示方法、装置及系统
JP2016152586A (ja) プロジェクションマッピング装置、映像投影制御装置、映像投影制御方法および映像投影制御プログラム
TWI502271B (zh) 控制方法及電子裝置
CN110555815A (zh) 一种图像处理方法和电子设备
CN118509713A (zh) 视频处理方法、装置、计算机设备和存储介质
US10013736B1 (en) Image perspective transformation system
CN116051695A (zh) 图像处理方法及其装置

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant