WO2021089422A1 - A system for performing ambient light image correction - Google Patents

A system for performing ambient light image correction Download PDF

Info

Publication number
WO2021089422A1
WO2021089422A1 PCT/EP2020/080501 EP2020080501W WO2021089422A1 WO 2021089422 A1 WO2021089422 A1 WO 2021089422A1 EP 2020080501 W EP2020080501 W EP 2020080501W WO 2021089422 A1 WO2021089422 A1 WO 2021089422A1
Authority
WO
WIPO (PCT)
Prior art keywords
images
composite image
captured images
illumination
bands
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2020/080501
Other languages
English (en)
French (fr)
Inventor
Jonathan Alambra PALERO
Yannyk Parulian Julian BOURQUIN
Rieko Verhagen
Kiran Kumar THUMMA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Priority to EP20796837.1A priority Critical patent/EP4055812B1/en
Priority to CN202080077126.2A priority patent/CN114641982B/zh
Priority to US17/771,513 priority patent/US11700462B2/en
Priority to JP2022525822A priority patent/JP2023500510A/ja
Publication of WO2021089422A1 publication Critical patent/WO2021089422A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • H04N25/53Control of the integration time
    • H04N25/531Control of the integration time by controlling rolling shutters in CMOS SSIS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/743Bracketing, i.e. taking a series of images with varying exposure conditions

Definitions

  • the present disclosure relates to systems and methods for optical imaging, in particular to non-contact skin imaging systems and methods for performing ambient light image correction.
  • a critical issue in such imaging measurement systems is that when they are used in an uncontrolled environment, e.g. at home, there are typically inconsistencies in measurement due to undefined and potentially varying ambient lighting.
  • ambient light removal techniques such as active illumination methods that involve controlled illumination to probe and infer scene properties maybe used.
  • some currently available techniques include controlled capture setups, e.g. a light stage, for capturing images of a person or a scene in all lighting directions (multiplexed illumination), and re-render photorealistic images under arbitrary illumination.
  • Some other techniques rely on projector-camera systems for projecting structured patterns for subsequent image analysis. While active technique can enable high-quality illumination analysis and editing, these systems are typically complex and expensive.
  • a method for performing ambient light image correction comprises: providing pulsed illumination to an object; capturing, while the object is illuminated by the pulsed illumination from the light source, a plurality of images of the object at an exposure time shorter than the wave period of the pulsed illumination, such that each of the plurality of captured images comprises a plurality of bright bands and dark bands, wherein a bright band corresponds to a high state of the pulsed illumination and a dark band corresponds to a low state of the pulsed illumination, and wherein the pulse frequency of the illumination provided by the light source is not a multiple integral of the frame rate at which the plurality of images are captured; generating a first composite image comprising a plurality of bright bands from the plurality of captured images, by combining sections from the plurality of captured images which correspond to bright bands; generating a second composite image comprising a plurality of dark bands from the plurality of captured images, by combining sections from the plurality of captured images which correspond to dark bands; and generating an ambient light corrected
  • a first composite image comprising a plurality of bright bands from the plurality of captured images is generated by combining sections from the plurality of captured images which correspond to bright bands.
  • the first composite image may be generated by the control unit 130 of the system 100.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
PCT/EP2020/080501 2019-11-06 2020-10-30 A system for performing ambient light image correction Ceased WO2021089422A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP20796837.1A EP4055812B1 (en) 2019-11-06 2020-10-30 A system for performing ambient light image correction
CN202080077126.2A CN114641982B (zh) 2019-11-06 2020-10-30 用于执行环境光图像校正的系统
US17/771,513 US11700462B2 (en) 2019-11-06 2020-10-30 System for performing ambient light image correction
JP2022525822A JP2023500510A (ja) 2019-11-06 2020-10-30 環境光画像補正を実施するためのシステム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP19207439.1A EP3820134A1 (en) 2019-11-06 2019-11-06 A system for performing ambient light image correction
EP19207439.1 2019-11-06

Publications (1)

Publication Number Publication Date
WO2021089422A1 true WO2021089422A1 (en) 2021-05-14

Family

ID=68470373

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2020/080501 Ceased WO2021089422A1 (en) 2019-11-06 2020-10-30 A system for performing ambient light image correction

Country Status (5)

Country Link
US (1) US11700462B2 (enExample)
EP (2) EP3820134A1 (enExample)
JP (1) JP2023500510A (enExample)
CN (1) CN114641982B (enExample)
WO (1) WO2021089422A1 (enExample)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021249857A1 (en) * 2020-06-10 2021-12-16 Koninklijke Philips N.V. Determining pixel information
EP4220074A1 (en) 2022-01-28 2023-08-02 Koninklijke Philips N.V. Determining a parameter map for a region of a subject's body
US11800134B2 (en) 2019-11-06 2023-10-24 Koninklijke Philips N.V. System for performing image motion compensation
US11871117B2 (en) 2019-12-20 2024-01-09 Koninklijke Philips N.V. System for performing ambient light image correction
EP4445830A1 (en) 2023-04-11 2024-10-16 Koninklijke Philips N.V. Optical sensing system for a body treatment device
US12376799B2 (en) 2020-06-10 2025-08-05 Koninklijke Philips N.V. Signal-to-noise ratio targeting

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD987425S1 (en) * 2021-02-24 2023-05-30 Hangzhou Lifesmart Technology Co., Ltd Ambient light
EP4057218A1 (en) 2021-03-11 2022-09-14 Koninklijke Philips N.V. A method and image capturing apparatus
EP4057217A1 (en) 2021-03-11 2022-09-14 Koninklijke Philips N.V. A method and image capturing apparatus for minimising error in ambient light corrected images
JP7748864B2 (ja) * 2021-12-07 2025-10-03 株式会社トヨタプロダクションエンジニアリング 画像処理装置及びピッキングシステム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050093997A1 (en) * 2003-10-30 2005-05-05 Dalton Dan L. System and method for dual white balance compensation of images
US20100026853A1 (en) * 2008-07-30 2010-02-04 Micron Technology, Inc. Method and system for synchronizing a flash to an imager
US20170286792A1 (en) * 2016-03-31 2017-10-05 Princeton Identity, Inc. Systems And Methods Of Biometric Analysis With Adaptive Trigger
WO2018145030A1 (en) * 2017-02-06 2018-08-09 Intuitive Surgical Operations, Inc. System and method for extracting multiple feeds from a rolling-shutter sensor

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7305108B2 (en) 2001-11-08 2007-12-04 Pelco Security identification system
US8004502B2 (en) * 2007-10-05 2011-08-23 Microsoft Corporation Correcting for ambient light in an optical touch-sensitive device
WO2009158662A2 (en) 2008-06-26 2009-12-30 Global Rainmakers, Inc. Method of reducing visibility of illimination while acquiring high quality imagery
US8289300B2 (en) * 2009-07-17 2012-10-16 Microsoft Corporation Ambient correction in rolling image capture system
US7962031B2 (en) * 2009-10-06 2011-06-14 Apple Inc. Pulsed control of camera flash
CN101931755B (zh) 2010-07-06 2012-05-23 上海洪剑智能科技有限公司 一种人脸识别用的调制光滤光装置和滤光方法
GB201110157D0 (en) 2011-06-16 2011-07-27 Light Blue Optics Ltd Touch sensitive display devices
TWI489325B (zh) * 2011-09-21 2015-06-21 Pixart Imaging Inc 光學手指滑鼠、電子裝置及生理特徵偵測裝置
TWI459800B (zh) * 2011-10-18 2014-11-01 Pixart Imaging Inc 影像系統及其干擾消除方法
US8752768B2 (en) 2011-11-17 2014-06-17 Datalogic ADC, Inc. Systems and methods for reading color optical codes
JP5988093B2 (ja) * 2012-07-30 2016-09-07 株式会社豊田中央研究所 画像処理装置、物体識別装置、及びプログラム
JP2014122847A (ja) * 2012-12-21 2014-07-03 Olympus Corp 画像補正装置、画像補正プログラム、画像補正方法
US10074165B2 (en) * 2014-09-10 2018-09-11 Morpho, Inc. Image composition device, image composition method, and recording medium
EP3430472B1 (en) * 2016-03-13 2023-06-07 B.G. Negev Technologies and Applications Ltd. at Ben-Gurion University Method of producing video images that are independent of the background lighting

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050093997A1 (en) * 2003-10-30 2005-05-05 Dalton Dan L. System and method for dual white balance compensation of images
US20100026853A1 (en) * 2008-07-30 2010-02-04 Micron Technology, Inc. Method and system for synchronizing a flash to an imager
US20170286792A1 (en) * 2016-03-31 2017-10-05 Princeton Identity, Inc. Systems And Methods Of Biometric Analysis With Adaptive Trigger
WO2018145030A1 (en) * 2017-02-06 2018-08-09 Intuitive Surgical Operations, Inc. System and method for extracting multiple feeds from a rolling-shutter sensor

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11800134B2 (en) 2019-11-06 2023-10-24 Koninklijke Philips N.V. System for performing image motion compensation
US11871117B2 (en) 2019-12-20 2024-01-09 Koninklijke Philips N.V. System for performing ambient light image correction
WO2021249857A1 (en) * 2020-06-10 2021-12-16 Koninklijke Philips N.V. Determining pixel information
US12126918B2 (en) 2020-06-10 2024-10-22 Koninklijke Philips N.V. Determining pixel information
US12376799B2 (en) 2020-06-10 2025-08-05 Koninklijke Philips N.V. Signal-to-noise ratio targeting
EP4220074A1 (en) 2022-01-28 2023-08-02 Koninklijke Philips N.V. Determining a parameter map for a region of a subject's body
EP4445830A1 (en) 2023-04-11 2024-10-16 Koninklijke Philips N.V. Optical sensing system for a body treatment device
WO2024213423A1 (en) 2023-04-11 2024-10-17 Koninklijke Philips N.V. Optical sensing system for a body treatment device

Also Published As

Publication number Publication date
EP3820134A1 (en) 2021-05-12
EP4055812B1 (en) 2024-02-14
CN114641982A (zh) 2022-06-17
US11700462B2 (en) 2023-07-11
CN114641982B (zh) 2023-11-28
JP2023500510A (ja) 2023-01-06
US20220400221A1 (en) 2022-12-15
EP4055812A1 (en) 2022-09-14

Similar Documents

Publication Publication Date Title
US11700462B2 (en) System for performing ambient light image correction
US8913156B2 (en) Capturing apparatus and method of capturing image
US20190132495A1 (en) Image processing method, and device
CN112785537B (zh) 图像处理方法、装置以及存储介质
KR20120016476A (ko) 영상 처리 방법 및 영상 처리 장치
CN107911625A (zh) 测光方法、装置、可读存储介质和计算机设备
CN110475063A (zh) 图像采集方法和装置、及存储介质
CN109544503B (zh) 图像处理方法、装置、电子设备及存储介质
JPWO2019078310A1 (ja) 顔三次元形状推定装置、顔三次元形状推定方法、及び、顔三次元形状推定プログラム
KR20160063794A (ko) 촬영 장치 및 그 제어 방법
JP5994301B2 (ja) 画像処理装置、情報処理装置、方法、プログラムおよび記録媒体
WO2016011872A1 (zh) 图像拍摄方法、装置和计算机存储介质
EP4078506B1 (en) A system for performing ambient light image correction
CN114731360B (zh) 用于执行图像运动补偿的系统
EP4055814B1 (en) A system for performing image motion compensation
JP2015233202A (ja) 画像処理装置および画像処理方法、並びにプログラム
CN112801932B (zh) 图像显示方法、装置、电子设备和存储介质
CN112435231A (zh) 图像质量标尺生成方法、评测图像质量的方法及装置
CN119835534B (zh) 图像处理方法、装置、电子设备及存储介质
Kinnevan et al. Efficient and Privacy-Protecting Background Removal for 2D Video Streaming using iPhone 15 Pro Max LiDAR
CN119383482A (zh) 一种图像处理方法、装置及存储介质
SE2251254A1 (en) Method for estimating pupil size
JP2016025522A (ja) 画像処理装置および画像処理装置の制御方法
JP2013182406A (ja) 画像処理装置
JP2018078528A (ja) 画像解析装置、画像解析方法およびプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20796837

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022525822

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020796837

Country of ref document: EP

Effective date: 20220607