TWI795425B - 用於產生場景之表示的設備及方法 - Google Patents

用於產生場景之表示的設備及方法 Download PDF

Info

Publication number
TWI795425B
TWI795425B TW107127548A TW107127548A TWI795425B TW I795425 B TWI795425 B TW I795425B TW 107127548 A TW107127548 A TW 107127548A TW 107127548 A TW107127548 A TW 107127548A TW I795425 B TWI795425 B TW I795425B
Authority
TW
Taiwan
Prior art keywords
depth
image
placement
camera
sensing camera
Prior art date
Application number
TW107127548A
Other languages
English (en)
Chinese (zh)
Other versions
TW201920985A (zh
Inventor
克莉斯汀 維爾甘
巴特 庫倫
Original Assignee
荷蘭商皇家飛利浦有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荷蘭商皇家飛利浦有限公司 filed Critical 荷蘭商皇家飛利浦有限公司
Publication of TW201920985A publication Critical patent/TW201920985A/zh
Application granted granted Critical
Publication of TWI795425B publication Critical patent/TWI795425B/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87—Combinations of systems using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4808—Evaluating distance, position or velocity data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85—Stereo camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30168—Image quality inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Processing (AREA)
  • Electrophonic Musical Instruments (AREA)
TW107127548A 2017-08-08 2018-08-08 用於產生場景之表示的設備及方法 TWI795425B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
??17185271.8 2017-08-08
EP17185271.8A EP3441788A1 (en) 2017-08-08 2017-08-08 Apparatus and method for generating a representation of a scene
EP17185271.8 2017-08-08

Publications (2)

Publication Number Publication Date
TW201920985A TW201920985A (zh) 2019-06-01
TWI795425B true TWI795425B (zh) 2023-03-11

Family

ID=59569191

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107127548A TWI795425B (zh) 2017-08-08 2018-08-08 用於產生場景之表示的設備及方法

Country Status (9)

Country Link
US (1) US11218687B2 (enExample)
EP (2) EP3441788A1 (enExample)
JP (1) JP7059355B6 (enExample)
KR (1) KR102535945B1 (enExample)
CN (1) CN111194416B (enExample)
BR (1) BR112020002452B1 (enExample)
RU (1) RU2769303C2 (enExample)
TW (1) TWI795425B (enExample)
WO (1) WO2019030235A1 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108470323B (zh) * 2018-03-13 2020-07-31 京东方科技集团股份有限公司 一种图像拼接方法、计算机设备及显示装置
EP3703378A1 (en) * 2019-03-01 2020-09-02 Koninklijke Philips N.V. Apparatus and method of generating an image signal
EP3712843A1 (en) * 2019-03-19 2020-09-23 Koninklijke Philips N.V. Image signal representing a scene
GB2584122B (en) 2019-05-22 2024-01-10 Sony Interactive Entertainment Inc Data processing
US10510155B1 (en) * 2019-06-11 2019-12-17 Mujin, Inc. Method and processing system for updating a first image generated by a first camera based on a second image generated by a second camera
JP2021077238A (ja) * 2019-11-12 2021-05-20 キヤノン株式会社 出力装置、画像処理システム、画像処理方法、及び、プログラム
US12211228B2 (en) * 2019-12-26 2025-01-28 Nec Corporation Information processing device, control method, and storage medium
EP3848899B1 (en) * 2020-01-09 2023-01-25 Stryker European Operations Limited Technique of determining a pose of a surgical registration device
TWI784482B (zh) * 2020-04-16 2022-11-21 鈺立微電子股份有限公司 多深度資訊之處理方法與處理系統
US12192632B2 (en) 2020-05-21 2025-01-07 Nec Corporation Installation assistance apparatus, installation assistance method, and non-transitory computer-readable storage medium
US20230186575A1 (en) * 2020-05-22 2023-06-15 Google Llc Method and apparatus for combining an augmented reality object in a real-world image
CN114092632B (zh) * 2020-08-06 2025-07-11 财团法人工业技术研究院 标注方法、应用其的装置、系统、方法及计算机程序产品
US12002235B2 (en) * 2020-08-12 2024-06-04 Hong Kong Applied Science and Technology Research Institute Company Limited Apparatus and method for estimating camera orientation relative to ground surface
JP7508350B2 (ja) * 2020-12-04 2024-07-01 株式会社日立製作所 キャリブレーション装置およびキャリブレーション方法
DE102021119481A1 (de) 2021-07-27 2023-02-02 Karl Storz Se & Co. Kg Messverfahren und eine Messvorrichtung
JP7582554B2 (ja) * 2021-09-16 2024-11-13 コーニンクレッカ フィリップス エヌ ヴェ ６－ｄｏｆビデオの完全な奥行きデータの生成
US12364545B2 (en) 2021-09-29 2025-07-22 Cilag Gmbh International Surgical devices, systems, and methods using fiducial identification and tracking
US12239387B2 (en) * 2021-09-29 2025-03-04 Cilag Gmbh International Surgical methods using fiducial identification and tracking
KR102727329B1 (ko) * 2021-10-12 2024-11-07 (주)비바 안전사고 예방을 위한 관제 시스템 및 시스템의 동작 방법
CN116468206A (zh) * 2022-01-11 2023-07-21 大金工业株式会社 设备的维护方法、装置及系统
US20230419635A1 (en) * 2022-06-27 2023-12-28 Shopify Inc. Volumetric permissioning
EP4332902B1 (de) * 2022-09-02 2024-11-06 Sick Ag Lokalisierung eines optischen markers
US12488499B2 (en) 2022-12-28 2025-12-02 Industrial Technology Research Institute Positioning method, operating method and positioning device
TWI845192B (zh) * 2023-03-06 2024-06-11 國立臺灣大學 操作輔助系統

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090109280A1 (en) * 2007-10-31 2009-04-30 Technion Research And Development Foundation Ltd. Free viewpoint video
TW201205181A (en) * 2010-06-09 2012-02-01 Eastman Kodak Co Video camera providing videos with perceived depth
TW201616443A (zh) * 2014-10-20 2016-05-01 陳金仁 即時影像合成裝置、方法與電腦程式產品
TW201631963A (zh) * 2013-01-30 2016-09-01 高通公司 具有功率有效深度感測器運用之即時三維重建
CN106056664A (zh) * 2016-05-23 2016-10-26 武汉盈力科技有限公司 一种基于惯性和深度视觉的实时三维场景重构系统及方法
US20170094251A1 (en) * 2015-09-30 2017-03-30 Faro Technologies, Inc. Three-dimensional imager that includes a dichroic camera

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7319479B1 (en) * 2000-09-22 2008-01-15 Brickstream Corporation System and method for multi-camera linking and analysis
GB2372656A (en) * 2001-02-23 2002-08-28 Ind Control Systems Ltd Optical position determination
EP2405236B1 (de) * 2010-07-07 2012-10-31 Leica Geosystems AG Geodätisches Vermessungsgerät mit automatischer hochpräziser Zielpunkt-Anzielfunktionalität
US9686532B2 (en) * 2011-04-15 2017-06-20 Faro Technologies, Inc. System and method of acquiring three-dimensional coordinates using multiple coordinate measurement devices
WO2013045517A1 (de) * 2011-09-27 2013-04-04 Leica Geosystems Ag Vermessungssystem und verfahren zur absteckung eines in einem koordinatensystem bekannten zielpunkts
JP5804892B2 (ja) 2011-10-25 2015-11-04 セコム株式会社 カメラ姿勢算出装置
EP2587450B1 (en) * 2011-10-27 2016-08-31 Nordson Corporation Method and apparatus for generating a three-dimensional model of a region of interest using an imaging system
GB2496591B (en) * 2011-11-11 2017-12-27 Sony Corp Camera Movement Correction
GB2497119B (en) * 2011-12-01 2013-12-25 Sony Corp Image processing system and method
DE102012207931A1 (de) 2012-01-07 2013-07-11 Johnson Controls Gmbh Kameraanordnung zur Distanzmessung
EP2615580B1 (en) * 2012-01-13 2016-08-17 Softkinetic Software Automatic scene calibration
US8773562B1 (en) * 2013-01-31 2014-07-08 Apple Inc. Vertically stacked image sensor
US10122993B2 (en) * 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
JP6171671B2 (ja) * 2013-07-24 2017-08-02 富士通株式会社 情報処理装置、位置指定方法および位置指定プログラム
JP2015168936A (ja) * 2014-03-05 2015-09-28 キャタピラー エス エー アール エル 作業機械におけるキャブ保護構造
JP6299879B2 (ja) 2014-03-21 2018-04-11 オムロン株式会社 光学システムにおける光学性能劣化の検出および緩和のための方法および装置
JP2016017913A (ja) * 2014-07-10 2016-02-01 国立大学法人鳥取大学 姿勢情報作成システム、姿勢情報作成方法及び姿勢情報作成プログラム
US20160044301A1 (en) * 2014-08-06 2016-02-11 Dejan JOVANOVICH 3d modeling of imaged objects using camera position and pose to obtain accuracy with reduced processing requirements
WO2016029939A1 (en) * 2014-08-27 2016-03-03 Metaio Gmbh Method and system for determining at least one image feature in at least one image
KR102660109B1 (ko) * 2015-07-13 2024-04-24 코닌클리케 필립스 엔.브이. 이미지에 대한 깊이 맵을 결정하기 위한 방법 및 장치
KR101629610B1 (ko) 2015-07-27 2016-06-13 주식회사 앤비젼 고해상도 영상 추출을 위한 광경로 변환 유닛, 광경로 변환 모듈, 광경로 변환 방법 및 이 방법을 수행하기 위한 프로그램을 기록한 기록매체, 반도체 기판 패턴 검사 장치
GB2541884A (en) * 2015-08-28 2017-03-08 Imp College Of Science Tech And Medicine Mapping a space using a multi-directional camera
US11073373B2 (en) * 2018-08-22 2021-07-27 Government Of The United States Of America, As Represented By The Secretary Of Commerce Non-contact coordinate measuring machine using a noncontact metrology probe

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090109280A1 (en) * 2007-10-31 2009-04-30 Technion Research And Development Foundation Ltd. Free viewpoint video
TW201205181A (en) * 2010-06-09 2012-02-01 Eastman Kodak Co Video camera providing videos with perceived depth
TW201631963A (zh) * 2013-01-30 2016-09-01 高通公司 具有功率有效深度感測器運用之即時三維重建
TW201616443A (zh) * 2014-10-20 2016-05-01 陳金仁 即時影像合成裝置、方法與電腦程式產品
US20170094251A1 (en) * 2015-09-30 2017-03-30 Faro Technologies, Inc. Three-dimensional imager that includes a dichroic camera
CN106056664A (zh) * 2016-05-23 2016-10-26 武汉盈力科技有限公司 一种基于惯性和深度视觉的实时三维场景重构系统及方法

Also Published As

Publication number Publication date
KR20200035297A (ko) 2020-04-02
JP7059355B2 (ja) 2022-04-25
TW201920985A (zh) 2019-06-01
EP3665506B1 (en) 2022-03-09
RU2020109861A3 (enExample) 2022-01-28
US20210152802A1 (en) 2021-05-20
US11218687B2 (en) 2022-01-04
RU2769303C2 (ru) 2022-03-30
KR102535945B1 (ko) 2023-05-26
RU2020109861A (ru) 2021-09-10
EP3665506A1 (en) 2020-06-17
CN111194416B (zh) 2024-01-23
JP2020529685A (ja) 2020-10-08
JP7059355B6 (ja) 2022-06-03
BR112020002452A2 (pt) 2020-07-28
CN111194416A (zh) 2020-05-22
BR112020002452B1 (pt) 2024-03-05
EP3441788A1 (en) 2019-02-13
WO2019030235A1 (en) 2019-02-14

Similar Documents

Publication Publication Date Title
TWI795425B (zh) 用於產生場景之表示的設備及方法
KR101761751B1 (ko) 직접적인 기하학적 모델링이 행해지는 hmd 보정
KR100513055B1 (ko) 변이지도 및 깊이지도의 융합을 통한 3차원 장면 모델생성 장치 및 그 방법
EP2992507B1 (en) Methods for facilitating computer vision application initialization
US20150009295A1 (en) Three-dimensional image acquisition apparatus and image processing method using the same
EP3394832A1 (en) Depth perceptive trinocular camera system
EP3545675A1 (en) Light field capture and rendering for head-mounted displays
US20220148207A1 (en) Processing of depth maps for images
CN111009030A (zh) 一种多视高分辨率纹理图像与双目三维点云映射方法
GB2477333A (en) Stereoscopic camera system with image processor to transform one of stereoscopic pair to give effect of increased stereo base
US20180192032A1 (en) System, Method and Software for Producing Three-Dimensional Images that Appear to Project Forward of or Vertically Above a Display Medium Using a Virtual 3D Model Made from the Simultaneous Localization and Depth-Mapping of the Physical Features of Real Objects
TWI788739B (zh) 3d顯示設備、3d圖像顯示方法
WO2018032841A1 (zh) 绘制三维图像的方法及其设备、系统
US11710273B2 (en) Image processing
CN116577072A (zh) 设备的标定方法、装置、系统和存储介质
KR102298047B1 (ko) 디지털 콘텐츠를 녹화하여 3d 영상을 생성하는 방법 및 장치
CN112819970B (zh) 一种控制方法、装置及电子设备
RU229691U1 (ru) Устройство для вычисления собственного положения и ориентации в пространстве
WO2018187743A1 (en) Producing three-dimensional images using a virtual 3d model
JP2020004121A (ja) 情報処理装置、情報処理方法及びプログラム
Liu et al. Fusion of depth maps based on confidence
CN117710445A (zh) 一种应用于ar设备的目标定位方法、装置及电子设备
Goma et al. Introducing the Depth Transfer Curve for 3D capture system characterization