CN110533707B - 照明估计 - Google Patents

照明估计 Download PDF

Info

Publication number
CN110533707B
CN110533707B CN201810510214.1A CN201810510214A CN110533707B CN 110533707 B CN110533707 B CN 110533707B CN 201810510214 A CN201810510214 A CN 201810510214A CN 110533707 B CN110533707 B CN 110533707B
Authority
CN
China
Prior art keywords
pixels
image
scene
pixel
input image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810510214.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN110533707A (zh
Inventor
董悦
陈国军
童欣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CN201810510214.1A priority Critical patent/CN110533707B/zh
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Priority to KR1020207036796A priority patent/KR102612808B1/ko
Priority to EP19726843.6A priority patent/EP3803803B1/en
Priority to JP2020564910A priority patent/JP7386812B2/ja
Priority to US17/044,270 priority patent/US11151780B2/en
Priority to EP25189178.4A priority patent/EP4607466A3/en
Priority to PCT/US2019/031907 priority patent/WO2019226366A1/en
Publication of CN110533707A publication Critical patent/CN110533707A/zh
Application granted granted Critical
Publication of CN110533707B publication Critical patent/CN110533707B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/506—Illumination models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/80—Shading
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/507—Depth or shape recovery from shading
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)
  • Image Generation (AREA)
  • Image Processing (AREA)
CN201810510214.1A 2018-05-24 2018-05-24 照明估计 Active CN110533707B (zh)

Priority Applications (7)

Application Number Priority Date Filing Date Title
CN201810510214.1A CN110533707B (zh) 2018-05-24 2018-05-24 照明估计
EP19726843.6A EP3803803B1 (en) 2018-05-24 2019-05-13 Lighting estimation
JP2020564910A JP7386812B2 (ja) 2018-05-24 2019-05-13 照明推定
US17/044,270 US11151780B2 (en) 2018-05-24 2019-05-13 Lighting estimation using an input image and depth map
KR1020207036796A KR102612808B1 (ko) 2018-05-24 2019-05-13 조명 추정
EP25189178.4A EP4607466A3 (en) 2018-05-24 2019-05-13 Lighting estimation
PCT/US2019/031907 WO2019226366A1 (en) 2018-05-24 2019-05-13 Lighting estimation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810510214.1A CN110533707B (zh) 2018-05-24 2018-05-24 照明估计

Publications (2)

Publication Number Publication Date
CN110533707A CN110533707A (zh) 2019-12-03
CN110533707B true CN110533707B (zh) 2023-04-14

Family

ID=66655477

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810510214.1A Active CN110533707B (zh) 2018-05-24 2018-05-24 照明估计

Country Status (6)

Country Link
US (1) US11151780B2 (https=)
EP (2) EP3803803B1 (https=)
JP (1) JP7386812B2 (https=)
KR (1) KR102612808B1 (https=)
CN (1) CN110533707B (https=)
WO (1) WO2019226366A1 (https=)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7003994B2 (ja) * 2017-08-08 2022-01-21 ソニーグループ株式会社 画像処理装置および方法
CN112183551A (zh) * 2019-07-02 2021-01-05 佳能株式会社 光照颜色预测方法、图像处理方法、装置及存储介质
JP7300517B2 (ja) * 2019-11-21 2023-06-29 株式会社ソニー・インタラクティブエンタテインメント 入射光情報取得方法、入射光情報取得システム、および情報処理装置
US20230063215A1 (en) * 2020-01-23 2023-03-02 Sony Group Corporation Information processing apparatus, information processing method, and program
CN114846521B (zh) * 2020-05-20 2025-09-09 谷歌有限责任公司 从各种肖像学习照明
US12469227B2 (en) 2020-06-22 2025-11-11 Google Llc Depth-based relighting in augmented reality
CN111932641B (zh) 2020-09-27 2021-05-14 北京达佳互联信息技术有限公司 一种图像处理方法、装置、电子设备及存储介质
KR20230011045A (ko) 2021-07-13 2023-01-20 삼성전자주식회사 빛 추정 방법 및 장치
KR102459771B1 (ko) * 2021-11-15 2022-10-28 한국전자기술연구원 이미지 딥러닝 기반 객체의 실시간 메쉬화 장치 및 방법
KR20230092514A (ko) * 2021-12-17 2023-06-26 삼성전자주식회사 렌더링 방법 및 장치
CN114399572B (zh) * 2021-12-23 2025-07-29 网易（杭州）网络有限公司 动态阴影生成方法、装置、电子设备及存储介质
KR102559691B1 (ko) * 2022-04-04 2023-07-26 주식회사 리빌더에이아이 뉴럴 렌더링 기반 형상 색상 통합 3d 메시 복원 방법 및 장치
KR20240054111A (ko) * 2022-10-18 2024-04-25 삼성전자주식회사 전자 디바이스, 전자 디바이스의 동작 방법 및 이미지 편집 시스템
US12400395B2 (en) * 2023-03-15 2025-08-26 Nvidia Corporation Rendering and composition of neural 3D objects with non-neural assets in content generation systems and applications
KR102848513B1 (ko) 2023-11-15 2025-08-22 한국과학기술연구원 3d 공간 조명 정보 유추를 포함하는 역렌더링을 이용한 2d 이미지와 미디어 합성 장치 및 방법
US20250209670A1 (en) * 2023-12-20 2025-06-26 L'oreal Deep learning systems, devices, and methods for predicting high-dynamic range environment panoramas
CN117496359B (zh) * 2023-12-29 2024-03-22 浙江大学山东(临沂)现代农业研究院 基于三维点云的植物种植布局监测方法及系统

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7262770B2 (en) * 2002-03-21 2007-08-28 Microsoft Corporation Graphics image rendering with radiance self-transfer for low-frequency lighting environments
US6791542B2 (en) 2002-06-17 2004-09-14 Mitsubishi Electric Research Laboratories, Inc. Modeling 3D objects with opacity hulls
JP5025496B2 (ja) * 2008-01-09 2012-09-12 キヤノン株式会社 画像処理装置及び画像処理方法
KR101885090B1 (ko) * 2010-12-09 2018-08-03 삼성전자주식회사 영상 처리 장치, 조명 처리 장치 및 그 방법
JP5842634B2 (ja) * 2012-01-26 2016-01-13 富士通株式会社 表示方法及び表示装置
US9857470B2 (en) 2012-12-28 2018-01-02 Microsoft Technology Licensing, Llc Using photometric stereo for 3D environment modeling
JP2014164497A (ja) * 2013-02-25 2014-09-08 Canon Inc 画像処理装置、画像処理方法及びプログラム
US9818224B1 (en) * 2013-06-20 2017-11-14 Amazon Technologies, Inc. Augmented reality images based on color and depth information
EP2829842B1 (en) * 2013-07-22 2022-12-21 Hexagon Technology Center GmbH Method, system and computer programme product for determination of an absolute volume of a stock pile using a structure from motion algorithm
US9412040B2 (en) * 2013-12-04 2016-08-09 Mitsubishi Electric Research Laboratories, Inc. Method for extracting planes from 3D point cloud sensor data
US20150262412A1 (en) * 2014-03-17 2015-09-17 Qualcomm Incorporated Augmented reality lighting with dynamic geometry
CN106133796B (zh) * 2014-03-25 2019-07-16 苹果公司 用于在真实环境的视图中表示虚拟对象的方法和系统
US20160140761A1 (en) * 2014-11-19 2016-05-19 Microsoft Technology Licensing, Llc. Using depth information for drawing in augmented reality scenes
US10008032B2 (en) * 2015-03-03 2018-06-26 Imagination Technologies Limited Graphics processing using directional representations of lighting at probe positions within a scene
US10354449B2 (en) 2015-06-12 2019-07-16 Hand Held Products, Inc. Augmented reality lighting effects
CN105825544B (zh) * 2015-11-25 2019-08-20 维沃移动通信有限公司 一种图像处理方法及移动终端
US20180308281A1 (en) 2016-04-01 2018-10-25 draw, Inc. 3-d graphic generation, artificial intelligence verification and learning system, program, and method
CN107341853B (zh) * 2017-07-13 2021-02-12 河北中科恒运软件科技股份有限公司 超大虚拟场景和动态摄屏的虚实融合方法及系统

Also Published As

Publication number Publication date
US20210027526A1 (en) 2021-01-28
WO2019226366A1 (en) 2019-11-28
JP7386812B2 (ja) 2023-11-27
EP3803803A1 (en) 2021-04-14
EP4607466A3 (en) 2025-10-29
US11151780B2 (en) 2021-10-19
KR20210013150A (ko) 2021-02-03
EP4607466A2 (en) 2025-08-27
EP3803803B1 (en) 2025-07-16
JP2021524628A (ja) 2021-09-13
CN110533707A (zh) 2019-12-03
KR102612808B1 (ko) 2023-12-11

Similar Documents

Publication Publication Date Title
CN110533707B (zh) 照明估计
US11631239B2 (en) Iterative spatio-temporal action detection in video
US11967024B2 (en) Extracting triangular 3-D models, materials, and lighting from images
US20240104842A1 (en) Encoder-based approach for inferring a three-dimensional representation from an image
CN110009705A (zh) 利用表示不同种类像素的映射创建图像
US12586293B2 (en) Scene reconstruction from monocular video
US11925860B2 (en) Projective hash maps
US11282258B1 (en) Adaptive sampling at a target sampling rate
CN120107454A (zh) 使用生成模型的四维对象和场景模型合成
US11954830B2 (en) High dynamic range support for legacy applications
US11475549B1 (en) High dynamic range image generation from tone mapped standard dynamic range images
US11610370B2 (en) Joint shape and appearance optimization through topology sampling
US20250252614A1 (en) Training-free consistent text-to-video generation
US12406422B2 (en) 3D digital avatar generation from a single or few portrait images
US20250200896A1 (en) Coherent three-dimensional portrait reconstruction via undistorting and fusing triplane representations
US20230206562A1 (en) Image processing method and apparatus
CN115053234A (zh) 深度光度学习（dpl）系统、装置和方法
CN115797543A (zh) 单个图像逆向渲染
CN111161398A (zh) 一种图像生成方法、装置、设备及存储介质
US12412250B2 (en) Rendering along a space-filling curve
US20250095275A1 (en) Characteristic-based acceleration for efficient scene rendering
US11430150B2 (en) Method and apparatus for processing sparse points
US20250259277A1 (en) General data prior based on langevin diffusion
US20240354912A1 (en) Rank-1 lattice sampling
CN116385643A (zh) 虚拟形象生成、模型的训练方法、装置及电子设备

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant