JP6812271B2 - 画像処理装置、画像処理方法およびプログラム - Google Patents

画像処理装置、画像処理方法およびプログラム Download PDF

Info

Publication number
JP6812271B2
JP6812271B2 JP2017034504A JP2017034504A JP6812271B2 JP 6812271 B2 JP6812271 B2 JP 6812271B2 JP 2017034504 A JP2017034504 A JP 2017034504A JP 2017034504 A JP2017034504 A JP 2017034504A JP 6812271 B2 JP6812271 B2 JP 6812271B2
Authority
JP
Japan
Prior art keywords
environment map
light source
map
image processing
real object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017034504A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018141653A (ja
JP2018141653A5 (enExample
Inventor
大賀 学
学 大賀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP2017034504A priority Critical patent/JP6812271B2/ja
Priority to US15/896,960 priority patent/US10593026B2/en
Publication of JP2018141653A publication Critical patent/JP2018141653A/ja
Publication of JP2018141653A5 publication Critical patent/JP2018141653A5/ja
Application granted granted Critical
Publication of JP6812271B2 publication Critical patent/JP6812271B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/55Specular reflectivity
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/80Geometric correction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/50Lighting effects
    • G06T15/506Illumination models
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/50Lighting effects
    • G06T15/60Shadow generation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map
    • G06T3/047Fisheye or wide-angle transformations
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/06Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • G06T3/067Reshaping or unfolding 3D tree structures onto 2D planes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00Indexing scheme for image rendering
    • G06T2215/12Shadow map, environment map

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Immunology (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
JP2017034504A 2017-02-27 2017-02-27 画像処理装置、画像処理方法およびプログラム Active JP6812271B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2017034504A JP6812271B2 (ja) 2017-02-27 2017-02-27 画像処理装置、画像処理方法およびプログラム
US15/896,960 US10593026B2 (en) 2017-02-27 2018-02-14 Image processing apparatus, image processing method, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017034504A JP6812271B2 (ja) 2017-02-27 2017-02-27 画像処理装置、画像処理方法およびプログラム

Publications (3)

Publication Number Publication Date
JP2018141653A JP2018141653A (ja) 2018-09-13
JP2018141653A5 JP2018141653A5 (enExample) 2020-02-13
JP6812271B2 true JP6812271B2 (ja) 2021-01-13

Family

ID=63246830

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017034504A Active JP6812271B2 (ja) 2017-02-27 2017-02-27 画像処理装置、画像処理方法およびプログラム

Country Status (2)

Country Link
US (1) US10593026B2 (enExample)
JP (1) JP6812271B2 (enExample)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3057067B1 (en) * 2015-02-16 2017-08-23 Thomson Licensing Device and method for estimating a glossy part of radiation
CZ2016752A3 (cs) * 2016-11-30 2018-03-28 ÄŚeskĂ© vysokĂ© uÄŤenĂ­ technickĂ© v Praze Přenosné zařízení pro měření geometrie objektu a prostorově proměnné funkce odrazivosti na povrchu vzorku s multiplikací prvků podílejících se na zobrazování a snímacích systémů na pohyblivých ramenech umožňující terénní měření
CN110998669B (zh) * 2017-08-08 2023-12-08 索尼公司 图像处理装置和方法
US10504251B1 (en) * 2017-12-13 2019-12-10 A9.Com, Inc. Determining a visual hull of an object
CN110044334B (zh) * 2018-01-16 2020-04-21 京东方科技集团股份有限公司 基于维诺图的室内空间定位
EP3599588B1 (en) * 2018-07-27 2021-09-08 Siemens Healthcare GmbH Rendering an object
JP6800938B2 (ja) * 2018-10-30 2020-12-16 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
US11620794B2 (en) * 2018-12-14 2023-04-04 Intel Corporation Determining visually reflective properties of physical surfaces in a mixed reality environment
US11004253B2 (en) * 2019-02-21 2021-05-11 Electronic Arts Inc. Systems and methods for texture-space ray tracing of transparent and translucent objects
WO2020242047A1 (en) * 2019-05-30 2020-12-03 Samsung Electronics Co., Ltd. Method and apparatus for acquiring virtual object data in augmented reality
JP7409014B2 (ja) * 2019-10-31 2024-01-09 富士フイルムビジネスイノベーション株式会社 表示装置
JP7551387B2 (ja) * 2020-08-03 2024-09-17 キヤノン株式会社 制御装置、制御方法及びプログラム
JP2024514066A (ja) * 2021-04-07 2024-03-28 インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ 光効果をサポートする容積ビデオ
JP2023025805A (ja) * 2021-08-11 2023-02-24 凸版印刷株式会社 画像処理システム、画像処理方法、及びプログラム
US12382190B2 (en) 2022-12-12 2025-08-05 Vasis Medical, LLC Camera system for capturing three-dimensional images
US11974051B1 (en) * 2022-12-12 2024-04-30 Vasis Medical, LLC Camera system for capturing three dimensional images
CN118447151A (zh) * 2023-02-03 2024-08-06 华为技术有限公司 重光照方法和装置
JP2024138852A (ja) * 2023-03-27 2024-10-09 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム
EP4443273A1 (en) * 2023-03-31 2024-10-09 Canon Kabushiki Kaisha Display control apparatus, display control method, and program
CN116955679A (zh) * 2023-08-19 2023-10-27 中信戴卡股份有限公司 一种车轮3d造型相似检索方法

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5710876A (en) * 1995-05-25 1998-01-20 Silicon Graphics, Inc. Computer graphics system for rendering images using full spectral illumination data
US5923334A (en) * 1996-08-05 1999-07-13 International Business Machines Corporation Polyhedral environment map utilizing a triangular data structure
JPH11175762A (ja) * 1997-12-08 1999-07-02 Katsushi Ikeuchi 光環境計測装置とそれを利用した仮想画像への陰影付与装置及び方法
EP1322919A2 (en) * 2000-09-27 2003-07-02 HRL Laboratories Distributed sensing apparatus and method of use therefor
JP3962588B2 (ja) 2002-01-07 2007-08-22 キヤノン株式会社 三次元画像処理方法、三次元画像処理装置、三次元画像処理システムおよび三次元画像処理プログラム
US6921898B1 (en) * 2002-06-20 2005-07-26 The United States Of America As Represented By The Secretary Of The Navy Bi-directional reflectance distribution function determination by large scale field measurement
JP4335589B2 (ja) * 2002-06-27 2009-09-30 ミツビシ・エレクトリック・リサーチ・ラボラトリーズ・インコーポレイテッド 3dオブジェクトをモデル化する方法
US7212206B2 (en) * 2003-08-20 2007-05-01 Sony Computer Entertainment Inc. Method and apparatus for self shadowing and self interreflection light capture
JP4357997B2 (ja) 2004-03-15 2009-11-04 独立行政法人科学技術振興機構 物体の双方向反射分布関数の高速推定方法
JP4594136B2 (ja) * 2005-03-09 2010-12-08 キヤノン株式会社 画像処理方法、画像処理装置
AU2006284577B2 (en) * 2005-09-02 2012-09-13 Neato Robotics, Inc. Multi-function robotic device
US8180486B2 (en) * 2006-10-02 2012-05-15 Honda Motor Co., Ltd. Mobile robot and controller for same
JP5133626B2 (ja) * 2007-07-13 2013-01-30 花王株式会社 表面反射特性測定装置
JP4788722B2 (ja) * 2008-02-26 2011-10-05 トヨタ自動車株式会社 自律移動ロボット、自己位置推定方法、環境地図の生成方法、環境地図の生成装置、及び環境地図のデータ構造
JP5506371B2 (ja) * 2009-12-24 2014-05-28 三星電子株式会社 画像処理装置、画像処理方法およびプログラム
JP2013127774A (ja) * 2011-11-16 2013-06-27 Canon Inc 画像処理装置、画像処理方法及びプログラム
US20130194254A1 (en) * 2012-01-23 2013-08-01 Canon Kabushiki Kaisha Image processing apparatus, image processing method and program
US9460553B2 (en) * 2012-06-18 2016-10-04 Dreamworks Animation Llc Point-based global illumination directional importance mapping
US9001226B1 (en) * 2012-12-04 2015-04-07 Lytro, Inc. Capturing and relighting images using multiple devices
JP6619598B2 (ja) * 2015-06-22 2019-12-11 株式会社スクウェア・エニックス プログラム、記録媒体、輝度演算装置及び輝度演算方法

Also Published As

Publication number Publication date
US10593026B2 (en) 2020-03-17
JP2018141653A (ja) 2018-09-13
US20180247393A1 (en) 2018-08-30

Similar Documents

Publication Publication Date Title
JP6812271B2 (ja) 画像処理装置、画像処理方法およびプログラム
US20230394740A1 (en) Method and system providing temporary texture application to enhance 3d modeling
CN110148204B (zh) 用于在真实环境的视图中表示虚拟对象的方法和系统
US10229483B2 (en) Image processing apparatus and image processing method for setting an illumination environment
EP3051793B1 (en) Imaging apparatus, systems and methods
US9478065B2 (en) System and method for remote generation of indirect illumination sources in three-dimensional graphics
JP6073858B2 (ja) 顔の位置検出
WO2017217296A1 (ja) 画像処理装置
US20140085295A1 (en) Direct environmental mapping method and system
US20200273199A1 (en) Determining the relative position between a thermal camera and a 3d camera using a hybrid phantom
KR20220151306A (ko) 3차원 콘텐츠 생성 방법 및 장치
US11145108B2 (en) Uniform density cube map rendering for spherical projections
JP5441752B2 (ja) 環境内の3d物体の3d姿勢を推定する方法及び装置
JP4764963B2 (ja) 画像処理装置
WO2019230320A1 (ja) 視覚センサシステム、制御方法およびプログラム
US20230090732A1 (en) System and method for real-time ray tracing in a 3d environment
CN111383262A (zh) 遮挡检测方法、系统、电子终端以及存储介质
JP5865092B2 (ja) 画像処理装置、画像処理方法及びプログラム
KR20080045392A (ko) 영상 합성을 위한 조명환경 재구성 방법 및 프로그램이기록된 기록매체
JP2018077168A (ja) シミュレーション装置、シミュレーション方法およびシミュレーションプログラム
JP5506371B2 (ja) 画像処理装置、画像処理方法およびプログラム
CN116266375A (zh) 处理光线数据的方法、装置、设备和存储介质
JP7465133B2 (ja) 情報処理装置、情報処理方法
JP2020169856A (ja) 画像処理装置、画像処理方法およびプログラム
JP2004151950A (ja) テクスチャ画像の生成・マッピングシステム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191220

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191220

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20201015

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20201117

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20201216

R151 Written notification of patent or utility model registration

Ref document number: 6812271

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: R3D03