KR102612808B1 - 조명 추정 - Google Patents

조명 추정 Download PDF

Info

Publication number
KR102612808B1
KR102612808B1 KR1020207036796A KR20207036796A KR102612808B1 KR 102612808 B1 KR102612808 B1 KR 102612808B1 KR 1020207036796 A KR1020207036796 A KR 1020207036796A KR 20207036796 A KR20207036796 A KR 20207036796A KR 102612808 B1 KR102612808 B1 KR 102612808B1
Authority
KR
South Korea
Prior art keywords
scene
image
pixels
determining
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020207036796A
Other languages
English (en)
Korean (ko)
Other versions
KR20210013150A (ko
Inventor
위에 동
구오준 천
신 통
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20210013150A publication Critical patent/KR20210013150A/ko
Application granted granted Critical
Publication of KR102612808B1 publication Critical patent/KR102612808B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/506—Illumination models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/80—Shading
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/507—Depth or shape recovery from shading
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)
  • Image Generation (AREA)
  • Image Processing (AREA)
KR1020207036796A 2018-05-24 2019-05-13 조명 추정 Active KR102612808B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201810510214.1 2018-05-24
CN201810510214.1A CN110533707B (zh) 2018-05-24 2018-05-24 照明估计
PCT/US2019/031907 WO2019226366A1 (en) 2018-05-24 2019-05-13 Lighting estimation

Publications (2)

Publication Number Publication Date
KR20210013150A KR20210013150A (ko) 2021-02-03
KR102612808B1 true KR102612808B1 (ko) 2023-12-11

Family

ID=66655477

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020207036796A Active KR102612808B1 (ko) 2018-05-24 2019-05-13 조명 추정

Country Status (6)

Country Link
US (1) US11151780B2 (https=)
EP (2) EP3803803B1 (https=)
JP (1) JP7386812B2 (https=)
KR (1) KR102612808B1 (https=)
CN (1) CN110533707B (https=)
WO (1) WO2019226366A1 (https=)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7003994B2 (ja) * 2017-08-08 2022-01-21 ソニーグループ株式会社 画像処理装置および方法
CN112183551A (zh) * 2019-07-02 2021-01-05 佳能株式会社 光照颜色预测方法、图像处理方法、装置及存储介质
JP7300517B2 (ja) * 2019-11-21 2023-06-29 株式会社ソニー・インタラクティブエンタテインメント 入射光情報取得方法、入射光情報取得システム、および情報処理装置
US20230063215A1 (en) * 2020-01-23 2023-03-02 Sony Group Corporation Information processing apparatus, information processing method, and program
CN114846521B (zh) * 2020-05-20 2025-09-09 谷歌有限责任公司 从各种肖像学习照明
US12469227B2 (en) 2020-06-22 2025-11-11 Google Llc Depth-based relighting in augmented reality
CN111932641B (zh) 2020-09-27 2021-05-14 北京达佳互联信息技术有限公司 一种图像处理方法、装置、电子设备及存储介质
KR20230011045A (ko) 2021-07-13 2023-01-20 삼성전자주식회사 빛 추정 방법 및 장치
KR102459771B1 (ko) * 2021-11-15 2022-10-28 한국전자기술연구원 이미지 딥러닝 기반 객체의 실시간 메쉬화 장치 및 방법
KR20230092514A (ko) * 2021-12-17 2023-06-26 삼성전자주식회사 렌더링 방법 및 장치
CN114399572B (zh) * 2021-12-23 2025-07-29 网易（杭州）网络有限公司 动态阴影生成方法、装置、电子设备及存储介质
KR102559691B1 (ko) * 2022-04-04 2023-07-26 주식회사 리빌더에이아이 뉴럴 렌더링 기반 형상 색상 통합 3d 메시 복원 방법 및 장치
KR20240054111A (ko) * 2022-10-18 2024-04-25 삼성전자주식회사 전자 디바이스, 전자 디바이스의 동작 방법 및 이미지 편집 시스템
US12400395B2 (en) * 2023-03-15 2025-08-26 Nvidia Corporation Rendering and composition of neural 3D objects with non-neural assets in content generation systems and applications
KR102848513B1 (ko) 2023-11-15 2025-08-22 한국과학기술연구원 3d 공간 조명 정보 유추를 포함하는 역렌더링을 이용한 2d 이미지와 미디어 합성 장치 및 방법
US20250209670A1 (en) * 2023-12-20 2025-06-26 L'oreal Deep learning systems, devices, and methods for predicting high-dynamic range environment panoramas
CN117496359B (zh) * 2023-12-29 2024-03-22 浙江大学山东(临沂)现代农业研究院 基于三维点云的植物种植布局监测方法及系统

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7262770B2 (en) * 2002-03-21 2007-08-28 Microsoft Corporation Graphics image rendering with radiance self-transfer for low-frequency lighting environments
US6791542B2 (en) 2002-06-17 2004-09-14 Mitsubishi Electric Research Laboratories, Inc. Modeling 3D objects with opacity hulls
JP5025496B2 (ja) * 2008-01-09 2012-09-12 キヤノン株式会社 画像処理装置及び画像処理方法
KR101885090B1 (ko) * 2010-12-09 2018-08-03 삼성전자주식회사 영상 처리 장치, 조명 처리 장치 및 그 방법
JP5842634B2 (ja) * 2012-01-26 2016-01-13 富士通株式会社 表示方法及び表示装置
US9857470B2 (en) 2012-12-28 2018-01-02 Microsoft Technology Licensing, Llc Using photometric stereo for 3D environment modeling
JP2014164497A (ja) * 2013-02-25 2014-09-08 Canon Inc 画像処理装置、画像処理方法及びプログラム
US9818224B1 (en) * 2013-06-20 2017-11-14 Amazon Technologies, Inc. Augmented reality images based on color and depth information
EP2829842B1 (en) * 2013-07-22 2022-12-21 Hexagon Technology Center GmbH Method, system and computer programme product for determination of an absolute volume of a stock pile using a structure from motion algorithm
US9412040B2 (en) * 2013-12-04 2016-08-09 Mitsubishi Electric Research Laboratories, Inc. Method for extracting planes from 3D point cloud sensor data
US20150262412A1 (en) * 2014-03-17 2015-09-17 Qualcomm Incorporated Augmented reality lighting with dynamic geometry
CN106133796B (zh) * 2014-03-25 2019-07-16 苹果公司 用于在真实环境的视图中表示虚拟对象的方法和系统
US20160140761A1 (en) * 2014-11-19 2016-05-19 Microsoft Technology Licensing, Llc. Using depth information for drawing in augmented reality scenes
US10008032B2 (en) * 2015-03-03 2018-06-26 Imagination Technologies Limited Graphics processing using directional representations of lighting at probe positions within a scene
US10354449B2 (en) 2015-06-12 2019-07-16 Hand Held Products, Inc. Augmented reality lighting effects
CN105825544B (zh) * 2015-11-25 2019-08-20 维沃移动通信有限公司 一种图像处理方法及移动终端
US20180308281A1 (en) 2016-04-01 2018-10-25 draw, Inc. 3-d graphic generation, artificial intelligence verification and learning system, program, and method
CN107341853B (zh) * 2017-07-13 2021-02-12 河北中科恒运软件科技股份有限公司 超大虚拟场景和动态摄屏的虚实融合方法及系统

Also Published As

Publication number Publication date
US20210027526A1 (en) 2021-01-28
WO2019226366A1 (en) 2019-11-28
JP7386812B2 (ja) 2023-11-27
EP3803803A1 (en) 2021-04-14
EP4607466A3 (en) 2025-10-29
US11151780B2 (en) 2021-10-19
KR20210013150A (ko) 2021-02-03
EP4607466A2 (en) 2025-08-27
EP3803803B1 (en) 2025-07-16
JP2021524628A (ja) 2021-09-13
CN110533707B (zh) 2023-04-14
CN110533707A (zh) 2019-12-03

Similar Documents

Publication Publication Date Title
KR102612808B1 (ko) 조명 추정
US11967024B2 (en) Extracting triangular 3-D models, materials, and lighting from images
US20230290038A1 (en) Three-dimensional object reconstruction from a video
CN110378838B (zh) 变视角图像生成方法，装置，存储介质及电子设备
CN111583381B (zh) 游戏资源图的渲染方法、装置及电子设备
US20220165040A1 (en) Appearance-driven automatic three-dimensional modeling
US20240104842A1 (en) Encoder-based approach for inferring a three-dimensional representation from an image
CN120107454A (zh) 使用生成模型的四维对象和场景模型合成
CN117557714A (zh) 三维重建方法、电子设备及可读存储介质
US11954830B2 (en) High dynamic range support for legacy applications
US11475549B1 (en) High dynamic range image generation from tone mapped standard dynamic range images
CN114842127B (zh) 地形渲染方法及装置、电子设备、介质及产品
CN113139992A (zh) 多分辨率体素网格化
US20250252614A1 (en) Training-free consistent text-to-video generation
US12406422B2 (en) 3D digital avatar generation from a single or few portrait images
US20250086896A1 (en) Synthetic image generation for supplementing neural field representations and related applications
CN115409949A (zh) 模型训练方法、视角图像生成方法、装置、设备及介质
US12051168B2 (en) Avatar generation based on driving views
US20250200896A1 (en) Coherent three-dimensional portrait reconstruction via undistorting and fusing triplane representations
CN111161398B (zh) 一种图像生成方法、装置、设备及存储介质
CN117372607A (zh) 一种三维模型的生成方法、装置及电子设备
KR20250025432A (ko) 이미지에서 객체의 재배치, 교체, 및 생성
CN120091122B (zh) 一种基于神经网络的3d裸眼图像生成方法及系统
US20250095275A1 (en) Characteristic-based acceleration for efficient scene rendering
CN115222859A (zh) 图像动画化

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20201221

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20220415

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20230426

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20230926

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20231207

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20231207

End annual number: 3

Start annual number: 1

PG1601 Publication of registration