JP2018124984A - モバイル装置の環境の３ｄ再構成のための方法および対応するコンピュータ・プログラム・プロダクトおよび装置 - Google Patents

モバイル装置の環境の３ｄ再構成のための方法および対応するコンピュータ・プログラム・プロダクトおよび装置 Download PDF

Info

Publication number
JP2018124984A
JP2018124984A JP2017228563A JP2017228563A JP2018124984A JP 2018124984 A JP2018124984 A JP 2018124984A JP 2017228563 A JP2017228563 A JP 2017228563A JP 2017228563 A JP2017228563 A JP 2017228563A JP 2018124984 A JP2018124984 A JP 2018124984A
Authority
JP
Japan
Prior art keywords
reconstruction
target portion
environment
camera
mobile device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2017228563A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018124984A5 (enExample
Inventor
ルオ，タオ
Tao Luo
ロベルト，フリツプ
Robert Philippe
アルーム，ヴインセント
Alleaume Vincent
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of JP2018124984A publication Critical patent/JP2018124984A/ja
Publication of JP2018124984A5 publication Critical patent/JP2018124984A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/586—Depth or shape recovery from multiple images from multiple light sources, e.g. photometric stereo
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00—Image generation
    • G06T2211/40—Computed tomography
    • G06T2211/416—Exact reconstruction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Electromagnetism (AREA)
  • Architecture (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
JP2017228563A 2016-12-01 2017-11-29 モバイル装置の環境の３ｄ再構成のための方法および対応するコンピュータ・プログラム・プロダクトおよび装置 Pending JP2018124984A (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16306599.8A EP3330924A1 (en) 2016-12-01 2016-12-01 Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device
EP16306599.8 2016-12-01

Publications (2)

Publication Number Publication Date
JP2018124984A true JP2018124984A (ja) 2018-08-09
JP2018124984A5 JP2018124984A5 (enExample) 2021-01-14

Family

ID=57542932

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017228563A Pending JP2018124984A (ja) 2016-12-01 2017-11-29 モバイル装置の環境の３ｄ再構成のための方法および対応するコンピュータ・プログラム・プロダクトおよび装置

Country Status (10)

Country Link
US (1) US20180160102A1 (enExample)
EP (2) EP3330924A1 (enExample)
JP (1) JP2018124984A (enExample)
KR (1) KR20180062959A (enExample)
CN (1) CN108133495A (enExample)
BR (1) BR102017025905A2 (enExample)
CA (1) CA2987087A1 (enExample)
MX (1) MX373029B (enExample)
PL (1) PL3330925T3 (enExample)
RU (1) RU2017141588A (enExample)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2020195877A1 (enExample) * 2019-03-25 2020-10-01
JP2021026759A (ja) * 2019-08-08 2021-02-22 株式会社東芝 オブジェクトの３ｄイメージングを実施するためのシステムおよび方法
US11393169B2 (en) 2020-03-05 2022-07-19 Topcon Corporation Photogrammetry of building using machine learning based inference

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10535156B2 (en) * 2017-02-03 2020-01-14 Microsoft Technology Licensing, Llc Scene reconstruction from bursts of image data
US11436791B2 (en) * 2018-04-30 2022-09-06 The Regents Of The University Of California Methods and systems for acquiring svBRDF measurements
CN110706280A (zh) * 2018-09-28 2020-01-17 成都家有为力机器人技术有限公司 基于2d-slam的轻量级语义驱动的稀疏重建方法
WO2020076026A1 (ko) * 2018-10-08 2020-04-16 한국과학기술원 인공조명 사진을 이용한 3차원 객체 획득 방법 및 그 장치
KR102287472B1 (ko) 2018-10-08 2021-08-09 한국과학기술원 인공조명 사진을 이용한 3차원 객체 획득 방법 및 그 장치
CN109492607B (zh) * 2018-11-27 2021-07-09 Oppo广东移动通信有限公司 一种信息推送方法、信息推送装置及终端设备
US12203872B2 (en) 2019-01-22 2025-01-21 Fyusion, Inc. Damage detection from multi-view visual data
US11176704B2 (en) 2019-01-22 2021-11-16 Fyusion, Inc. Object pose estimation in visual data
US12243170B2 (en) 2019-01-22 2025-03-04 Fyusion, Inc. Live in-camera overlays
US10887582B2 (en) 2019-01-22 2021-01-05 Fyusion, Inc. Object damage aggregation
US11783443B2 (en) 2019-01-22 2023-10-10 Fyusion, Inc. Extraction of standardized images from a single view or multi-view capture
US12204869B2 (en) 2019-01-22 2025-01-21 Fyusion, Inc. Natural language understanding for visual tagging
US12244784B2 (en) 2019-07-29 2025-03-04 Fyusion, Inc. Multiview interactive digital media representation inventory verification
JP7245574B2 (ja) 2019-12-20 2023-03-24 馭勢科技（浙江）有限公司 ３次元再構成方法、装置、システム及び記憶媒体
US11869135B2 (en) * 2020-01-16 2024-01-09 Fyusion, Inc. Creating action shot video from multi-view capture data
US11252398B2 (en) 2020-01-16 2022-02-15 Fyusion, Inc. Creating cinematic video from multi-view capture data
US11562474B2 (en) * 2020-01-16 2023-01-24 Fyusion, Inc. Mobile multi-camera multi-view capture
US11776142B2 (en) 2020-01-16 2023-10-03 Fyusion, Inc. Structuring visual data
JP2021131652A (ja) * 2020-02-19 2021-09-09 株式会社トプコン データ構造、記録媒体、プログラム、及びシステム
CN111459274B (zh) * 2020-03-30 2021-09-21 华南理工大学 一种基于5g+ ar的针对非结构化环境的遥操作方法
CN111583263B (zh) * 2020-04-30 2022-09-23 北京工业大学 一种基于联合动态图卷积的点云分割方法
KR102819575B1 (ko) 2020-10-12 2025-06-12 삼성전자주식회사 전자 장치 및 제어 방법
CN114430454A (zh) * 2020-10-28 2022-05-03 广东小天才科技有限公司 基于双摄像头的建模方法及可穿戴装置、设备和介质
US11605151B2 (en) 2021-03-02 2023-03-14 Fyusion, Inc. Vehicle undercarriage imaging

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012141894A (ja) * 2011-01-05 2012-07-26 Sharp Corp 画像検索装置、画像検索方法およびプログラム
JP2016534461A (ja) * 2013-08-30 2016-11-04 クアルコム，インコーポレイテッド 物理的光景を表すための方法および装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6750873B1 (en) * 2000-06-27 2004-06-15 International Business Machines Corporation High quality texture reconstruction from multiple scans
WO2004006181A2 (en) * 2002-07-10 2004-01-15 Harman Becker Automotive Systems Gmbh System for generating three-dimensional electronic models of objects
US8655052B2 (en) * 2007-01-26 2014-02-18 Intellectual Discovery Co., Ltd. Methodology for 3D scene reconstruction from 2D image sequences
US9679215B2 (en) * 2012-01-17 2017-06-13 Leap Motion, Inc. Systems and methods for machine control
US9857470B2 (en) * 2012-12-28 2018-01-02 Microsoft Technology Licensing, Llc Using photometric stereo for 3D environment modeling
US9333649B1 (en) * 2013-03-15 2016-05-10 Industrial Perception, Inc. Object pickup strategies for a robotic device
JP6465682B2 (ja) * 2014-03-20 2019-02-06 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
KR20160131278A (ko) * 2015-05-06 2016-11-16 엘지전자 주식회사 이동 단말기
GB2544725A (en) * 2015-11-03 2017-05-31 Fuel 3D Tech Ltd Systems and methods for forming models of a three-dimensional objects
US10055882B2 (en) * 2016-08-15 2018-08-21 Aquifi, Inc. System and method for three-dimensional scanning and for capturing a bidirectional reflectance distribution function

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012141894A (ja) * 2011-01-05 2012-07-26 Sharp Corp 画像検索装置、画像検索方法およびプログラム
JP2016534461A (ja) * 2013-08-30 2016-11-04 クアルコム，インコーポレイテッド 物理的光景を表すための方法および装置

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
KEN'ICHI MOROOKA ET AL.: ""A Method for Integrating Range Images with Different Resolutions for 3-D Model Construction"", PROCEEDINGS 2006 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, 2006. ICRA 2006., JPN6021047499, 15 May 2006 (2006-05-15), US, pages 3070 - 3075, ISSN: 0004648865 *
TOMOAKI HIGO ET AL.: ""A Hand-held Photometric Stereo Camera for 3-D Modeling"", 2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, JPN6021047496, 29 September 2009 (2009-09-29), US, pages 1234 - 1241, ISSN: 0004729857 *
奥脇 舞希、外２名: ""多視点画像から得られた３次元点群を用いた高精度なメッシュ復元"", 映像情報メディア学会技術報告, vol. 39, no. 47, JPN6021047498, 26 November 2015 (2015-11-26), JP, pages 77 - 80, ISSN: 0004648864 *
池内 克史、松下 康之: ""照度差ステレオの原理と実際"", 光学, vol. 41, no. 5, JPN6021047497, 10 May 2012 (2012-05-10), JP, pages 281 - 286, ISSN: 0004729858 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2020195877A1 (enExample) * 2019-03-25 2020-10-01
WO2020195877A1 (ja) * 2019-03-25 2020-10-01 ソニー株式会社 医療システム、信号処理装置、及び、信号処理方法
JP7517325B2 (ja) 2019-03-25 2024-07-17 ソニーグループ株式会社 医療システム、信号処理装置、及び、信号処理方法
US12266127B2 (en) 2019-03-25 2025-04-01 Sony Group Corporation Medical system, signal processing device, and signal processing method
JP2021026759A (ja) * 2019-08-08 2021-02-22 株式会社東芝 オブジェクトの３ｄイメージングを実施するためのシステムおよび方法
JP7119023B2 (ja) 2019-08-08 2022-08-16 株式会社東芝 オブジェクトの３ｄイメージングを実施するためのシステムおよび方法
US11393169B2 (en) 2020-03-05 2022-07-19 Topcon Corporation Photogrammetry of building using machine learning based inference
US11880943B2 (en) 2020-03-05 2024-01-23 Topcon Corporation Photogrammetry of building using machine learning based inference

Also Published As

Publication number Publication date
KR20180062959A (ko) 2018-06-11
MX2017015345A (es) 2018-11-09
EP3330925A1 (en) 2018-06-06
CA2987087A1 (en) 2018-06-01
PL3330925T3 (pl) 2020-03-31
BR102017025905A2 (pt) 2018-12-18
EP3330925B1 (en) 2019-10-02
EP3330924A1 (en) 2018-06-06
CN108133495A (zh) 2018-06-08
MX373029B (es) 2020-05-27
RU2017141588A (ru) 2019-05-29
US20180160102A1 (en) 2018-06-07

Similar Documents

Publication Publication Date Title
JP2018124984A (ja) モバイル装置の環境の３ｄ再構成のための方法および対応するコンピュータ・プログラム・プロダクトおよび装置
CN106993112B (zh) 基于景深的背景虚化方法及装置和电子装置
Boss et al. Samurai: Shape and material from unconstrained real-world arbitrary image collections
Huang et al. Indoor depth completion with boundary consistency and self-attention
CN108764091B (zh) 活体检测方法及装置、电子设备和存储介质
US11432619B2 (en) System, method, and apparatus for modelling feet and selecting footwear
RU2642167C2 (ru) Устройство, способ и система для реконструкции 3d-модели объекта
CN107851178B (zh) 基于多个表面模型的混合三维场景重构
US10373366B2 (en) Three-dimensional model generation
CN107481304B (zh) 在游戏场景中构建虚拟形象的方法及其装置
US10008024B2 (en) Material-aware three-dimensional scanning
CN108053469A (zh) 多视角相机下的复杂动态场景人体三维重建方法及装置
WO2018107910A1 (zh) 一种全景视频融合方法及装置
KR20170008638A (ko) 3차원 컨텐츠 생성 장치 및 그 3차원 컨텐츠 생성 방법
US11908096B2 (en) Stereoscopic image acquisition method, electronic device and storage medium
CN117593454B (zh) 三维重建与目标表面平面点云生成方法
CN107483845B (zh) 拍照方法及其装置
CN107481101B (zh) 穿衣推荐方法及其装置
JP2023505900A (ja) メモリおよびデバイスのトラッキングを使用する拡張現実アプリケーションにおけるオクルージョンハンドリングのための方法と関連装置
KR20120003232A (ko) 볼륨 예측 기반 폐색 영역 양방향 복원 장치 및 방법
CN110400338A (zh) 深度图处理方法、装置和电子设备
US11776204B2 (en) 3D dataset generation for neural network model training
CN107592449A (zh) 三维模型建立方法、装置和移动终端
CN107463659A (zh) 物体搜索方法及其装置
CN107481318A (zh) 用户头像的替换方法、装置和终端设备

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20180223

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20181220

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20181227

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20191111

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201120

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201120

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20211125

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20211130

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220224

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20220317