CN108133495A - 用于移动设备环境的3d重建方法、相应的程序产品和设备 - Google Patents

用于移动设备环境的3d重建方法、相应的程序产品和设备 Download PDF

Info

Publication number
CN108133495A
CN108133495A CN201711247711.9A CN201711247711A CN108133495A CN 108133495 A CN108133495 A CN 108133495A CN 201711247711 A CN201711247711 A CN 201711247711A CN 108133495 A CN108133495 A CN 108133495A
Authority
CN
China
Prior art keywords
reconstruction
environment
camera
image
target part
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711247711.9A
Other languages
English (en)
Chinese (zh)
Inventor
罗涛
P.罗伯特
V.阿勒奥姆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital CE Patent Holdings SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CN108133495A publication Critical patent/CN108133495A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/586—Depth or shape recovery from multiple images from multiple light sources, e.g. photometric stereo
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00—Image generation
    • G06T2211/40—Computed tomography
    • G06T2211/416—Exact reconstruction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Electromagnetism (AREA)
  • Architecture (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
CN201711247711.9A 2016-12-01 2017-12-01 用于移动设备环境的3d重建方法、相应的程序产品和设备 Pending CN108133495A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16306599.8 2016-12-01
EP16306599.8A EP3330924A1 (en) 2016-12-01 2016-12-01 Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device

Publications (1)

Publication Number Publication Date
CN108133495A true CN108133495A (zh) 2018-06-08

Family

ID=57542932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711247711.9A Pending CN108133495A (zh) 2016-12-01 2017-12-01 用于移动设备环境的3d重建方法、相应的程序产品和设备

Country Status (10)

Country Link
US (1) US20180160102A1 (enExample)
EP (2) EP3330924A1 (enExample)
JP (1) JP2018124984A (enExample)
KR (1) KR20180062959A (enExample)
CN (1) CN108133495A (enExample)
BR (1) BR102017025905A2 (enExample)
CA (1) CA2987087A1 (enExample)
MX (1) MX373029B (enExample)
PL (1) PL3330925T3 (enExample)
RU (1) RU2017141588A (enExample)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110706280A (zh) * 2018-09-28 2020-01-17 成都家有为力机器人技术有限公司 基于2d-slam的轻量级语义驱动的稀疏重建方法
CN111459274A (zh) * 2020-03-30 2020-07-28 华南理工大学 一种基于5g+ ar的针对非结构化环境的遥操作方法
CN114430454A (zh) * 2020-10-28 2022-05-03 广东小天才科技有限公司 基于双摄像头的建模方法及可穿戴装置、设备和介质
US12266127B2 (en) 2019-03-25 2025-04-01 Sony Group Corporation Medical system, signal processing device, and signal processing method
CN120894518A (zh) * 2025-07-11 2025-11-04 齐鲁工业大学(山东省科学院) 一种基于场景环境选择的3dgs重建方法及系统

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10535156B2 (en) * 2017-02-03 2020-01-14 Microsoft Technology Licensing, Llc Scene reconstruction from bursts of image data
US11436791B2 (en) * 2018-04-30 2022-09-06 The Regents Of The University Of California Methods and systems for acquiring svBRDF measurements
WO2020076026A1 (ko) * 2018-10-08 2020-04-16 한국과학기술원 인공조명 사진을 이용한 3차원 객체 획득 방법 및 그 장치
KR102287472B1 (ko) 2018-10-08 2021-08-09 한국과학기술원 인공조명 사진을 이용한 3차원 객체 획득 방법 및 그 장치
CN109492607B (zh) * 2018-11-27 2021-07-09 Oppo广东移动通信有限公司 一种信息推送方法、信息推送装置及终端设备
US12243170B2 (en) 2019-01-22 2025-03-04 Fyusion, Inc. Live in-camera overlays
US11176704B2 (en) 2019-01-22 2021-11-16 Fyusion, Inc. Object pose estimation in visual data
US10887582B2 (en) 2019-01-22 2021-01-05 Fyusion, Inc. Object damage aggregation
US11783443B2 (en) 2019-01-22 2023-10-10 Fyusion, Inc. Extraction of standardized images from a single view or multi-view capture
US12203872B2 (en) 2019-01-22 2025-01-21 Fyusion, Inc. Damage detection from multi-view visual data
US12204869B2 (en) 2019-01-22 2025-01-21 Fyusion, Inc. Natural language understanding for visual tagging
US12244784B2 (en) 2019-07-29 2025-03-04 Fyusion, Inc. Multiview interactive digital media representation inventory verification
GB2586157B (en) * 2019-08-08 2022-01-12 Toshiba Kk System and method for performing 3D imaging of an object
CN111133477B (zh) 2019-12-20 2023-06-23 驭势科技（浙江）有限公司 三维重建方法、装置、系统和存储介质
US11776142B2 (en) 2020-01-16 2023-10-03 Fyusion, Inc. Structuring visual data
US11869135B2 (en) 2020-01-16 2024-01-09 Fyusion, Inc. Creating action shot video from multi-view capture data
US11252398B2 (en) 2020-01-16 2022-02-15 Fyusion, Inc. Creating cinematic video from multi-view capture data
US11562474B2 (en) 2020-01-16 2023-01-24 Fyusion, Inc. Mobile multi-camera multi-view capture
JP2021131652A (ja) * 2020-02-19 2021-09-09 株式会社トプコン データ構造、記録媒体、プログラム、及びシステム
JP7611648B2 (ja) 2020-03-05 2025-01-10 株式会社トプコン 情報処理装置、推論モデル構築方法、プログラム、及び記録媒体
CN111583263B (zh) * 2020-04-30 2022-09-23 北京工业大学 一种基于联合动态图卷积的点云分割方法
KR102819575B1 (ko) 2020-10-12 2025-06-12 삼성전자주식회사 전자 장치 및 제어 방법
US11605151B2 (en) 2021-03-02 2023-03-14 Fyusion, Inc. Vehicle undercarriage imaging
JP2023174401A (ja) * 2022-05-27 2023-12-07 シャープ株式会社 情報処理装置、サーバ、情報処理方法、およびプログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140369558A1 (en) * 2012-01-17 2014-12-18 David Holz Systems and methods for machine control
CN105190703A (zh) * 2012-12-28 2015-12-23 微软技术许可有限责任公司 使用光度立体来进行3d环境建模
CN105493155A (zh) * 2013-08-30 2016-04-13 高通股份有限公司 用于表示物理场景的方法和设备
US20160330431A1 (en) * 2015-05-06 2016-11-10 Lg Electronics Inc. Mobile terminal

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6750873B1 (en) * 2000-06-27 2004-06-15 International Business Machines Corporation High quality texture reconstruction from multiple scans
WO2004006181A2 (en) * 2002-07-10 2004-01-15 Harman Becker Automotive Systems Gmbh System for generating three-dimensional electronic models of objects
US8655052B2 (en) * 2007-01-26 2014-02-18 Intellectual Discovery Co., Ltd. Methodology for 3D scene reconstruction from 2D image sequences
JP2012141894A (ja) * 2011-01-05 2012-07-26 Sharp Corp 画像検索装置、画像検索方法およびプログラム
US9393686B1 (en) * 2013-03-15 2016-07-19 Industrial Perception, Inc. Moveable apparatuses having robotic manipulators and conveyors to facilitate object movement
JP6465682B2 (ja) * 2014-03-20 2019-02-06 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
GB2544725A (en) * 2015-11-03 2017-05-31 Fuel 3D Tech Ltd Systems and methods for forming models of a three-dimensional objects
US10055882B2 (en) * 2016-08-15 2018-08-21 Aquifi, Inc. System and method for three-dimensional scanning and for capturing a bidirectional reflectance distribution function

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140369558A1 (en) * 2012-01-17 2014-12-18 David Holz Systems and methods for machine control
CN105190703A (zh) * 2012-12-28 2015-12-23 微软技术许可有限责任公司 使用光度立体来进行3d环境建模
CN105493155A (zh) * 2013-08-30 2016-04-13 高通股份有限公司 用于表示物理场景的方法和设备
JP2016534461A (ja) * 2013-08-30 2016-11-04 クアルコム，インコーポレイテッド 物理的光景を表すための方法および装置
US20160330431A1 (en) * 2015-05-06 2016-11-10 Lg Electronics Inc. Mobile terminal

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110706280A (zh) * 2018-09-28 2020-01-17 成都家有为力机器人技术有限公司 基于2d-slam的轻量级语义驱动的稀疏重建方法
US12266127B2 (en) 2019-03-25 2025-04-01 Sony Group Corporation Medical system, signal processing device, and signal processing method
CN111459274A (zh) * 2020-03-30 2020-07-28 华南理工大学 一种基于5g+ ar的针对非结构化环境的遥操作方法
CN111459274B (zh) * 2020-03-30 2021-09-21 华南理工大学 一种基于5g+ ar的针对非结构化环境的遥操作方法
CN114430454A (zh) * 2020-10-28 2022-05-03 广东小天才科技有限公司 基于双摄像头的建模方法及可穿戴装置、设备和介质
CN120894518A (zh) * 2025-07-11 2025-11-04 齐鲁工业大学(山东省科学院) 一种基于场景环境选择的3dgs重建方法及系统

Also Published As

Publication number Publication date
US20180160102A1 (en) 2018-06-07
EP3330925A1 (en) 2018-06-06
KR20180062959A (ko) 2018-06-11
PL3330925T3 (pl) 2020-03-31
CA2987087A1 (en) 2018-06-01
EP3330924A1 (en) 2018-06-06
BR102017025905A2 (pt) 2018-12-18
JP2018124984A (ja) 2018-08-09
EP3330925B1 (en) 2019-10-02
MX2017015345A (es) 2018-11-09
MX373029B (es) 2020-05-27
RU2017141588A (ru) 2019-05-29

Similar Documents

Publication Publication Date Title
CN108133495A (zh) 用于移动设备环境的3d重建方法、相应的程序产品和设备
CN103959307B (zh) 从灰度图像中检测和描述特征的方法
JP7190842B2 (ja) 情報処理装置、情報処理装置の制御方法及びプログラム
CN101246603B (zh) 基于2d拍摄图像实现3d模型生成的方法
US11348267B2 (en) Method and apparatus for generating a three-dimensional model
US9525862B2 (en) Method for estimating a camera motion and for determining a three-dimensional model of a real environment
RU2642167C2 (ru) Устройство, способ и система для реконструкции 3d-модели объекта
WO2018119606A1 (en) Method and apparatus for representing a map element and method and apparatus for locating vehicle/robot
US20110227922A1 (en) Apparatus and method extracting light and texture, and rendering apparatus using light and texture
CN111373442B (zh) 三维点群数据生成方法、位置推断方法、三维点群数据生成装置以及位置推断装置
Kim et al. Multi-view inverse rendering under arbitrary illumination and albedo
CN105793730A (zh) 对象运动的基于激光雷达的分类
US10607350B2 (en) Method of detecting and describing features from an intensity image
CN115588187A (zh) 基于三维点云的行人检测方法、装置、设备以及存储介质
O'Byrne et al. A stereo‐matching technique for recovering 3D information from underwater inspection imagery
CN117576653A (zh) 目标追踪方法、装置、计算机设备和存储介质
CN110443228B (zh) 一种行人匹配方法、装置、电子设备及存储介质
Yan et al. Automatic extraction of moving objects from image and LIDAR sequences
He et al. Sparse depth map upsampling with rgb image and anisotropic diffusion tensor
Wong et al. 3D object model reconstruction from image sequence based on photometric consistency in volume space
US12125281B2 (en) Determining distance of objects
Serra et al. 3D Copy&Paste: A Photogrammetry Solution for 3D Scanning of Salient Objects
Geetha Kiran et al. Automatic 3D view generation from a single 2D image for both indoor and outdoor scenes
CN120047918A (zh) 移动物体的检测方法、装置、电子设备及存储介质
Bartie et al. A combined GIS and stereo vision approach to identify building pixels in images and determine appropriate color terms

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
TA01 Transfer of patent application right

Effective date of registration: 20190606

Address after: Paris France

Applicant after: Interactive digital CE patent holding Co.

Address before: I Si Eli Murli Nor, France

Applicant before: THOMSON LICENSING

TA01 Transfer of patent application right
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180608

WD01 Invention patent application deemed withdrawn after publication