WO2019223635A1 - 一种抗运动鬼影的hdr方法及便携式终端 - Google Patents

一种抗运动鬼影的hdr方法及便携式终端 Download PDF

Info

Publication number
WO2019223635A1
WO2019223635A1 PCT/CN2019/087555 CN2019087555W WO2019223635A1 WO 2019223635 A1 WO2019223635 A1 WO 2019223635A1 CN 2019087555 W CN2019087555 W CN 2019087555W WO 2019223635 A1 WO2019223635 A1 WO 2019223635A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
brightness
exposure
pixel
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/087555
Other languages
English (en)
French (fr)
Chinese (zh)
Inventor
谢亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Arashi Vision Co Ltd
Original Assignee
Shenzhen Arashi Vision Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Arashi Vision Co Ltd filed Critical Shenzhen Arashi Vision Co Ltd
Priority to EP19807643.2A priority Critical patent/EP3799413B1/en
Priority to JP2020564637A priority patent/JP7284767B2/ja
Priority to US17/057,688 priority patent/US11190707B2/en
Publication of WO2019223635A1 publication Critical patent/WO2019223635A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration using histogram techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range
    • H04N25/58—Control of the dynamic range involving two or more exposures
    • H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
    • H04N25/589—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields with different integration times, e.g. short and long exposures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the invention belongs to the field of image processing, and in particular relates to an HDR method and a portable terminal that are resistant to motion ghosts.
  • High dynamic range images are a series of low dynamic range images with different exposure To expand the dynamic range and image detail that a single image can cover. High dynamic range technology and its good visual experience are gradually applied to the fields of film and television special effects, which have very important theoretical research value and broad commercial basis.
  • the existing fusion technology ensures that a fused image without ghost images can be obtained.
  • the background of the image to be fused with different exposures is completely still.
  • most of the images obtained in real scenes contain dynamic elements such as moving objects, and the dynamic elements will cause ghost images in the high dynamic range images obtained after fusion.
  • the existing ghost removal technology usually removes all moving objects contained in the image to be fused directly in the fusion result, which to a certain extent causes the obtained high dynamic range image to lose the authenticity of the original image.
  • the invention proposes an anti-movement ghost HDR method, a computer-readable storage medium, and a portable terminal, which aims to solve the problem that current high dynamic range images contain motion ghost images, thereby improving the high dynamic range image after removing ghost images. Visual effect.
  • the present invention provides an HDR method for resisting motion ghosts, the method including:
  • the under-exposure image I 2, and I 3 are over-exposure image and the first image I 12, respectively, and a large difference in luminance pixels of the second image I 13 3 Comparative correcting underexposure images through exposure image I 2, and I, to get rid of motion
  • the brightness of the normal exposure image I 1 and the third image I 2 ′ are adjusted respectively to obtain a high-exposure fifth image I 1 that is consistent with the image brightness of the fourth image I 3 ′.
  • the fifth image I 1 ′′, the sixth image I 2 ′′, and the fourth image I 3 ′ are corresponding to the corresponding first weight map w 1 , the second weight map w 2, and the third weight map w 3 Perform weighted fusion separately to generate HDR images resistant to motion ghosts.
  • the normal-exposure image I 1 , the under-exposure image I 2, and the over-exposure image I 3 are three images captured in the HDR mode.
  • the mapping adjustment is to use a histogram mapping to map and adjust the histogram of the normal exposure image I 1 to be consistent with the brightness of the under-exposed image I 2 and the over-exposure image I 3 respectively , to obtain the first adjusted images I 12 and The second image I 13 .
  • the comparison is specifically:
  • the under-exposed image I 2 and the over-exposed image I 3 are compared with the first and second images I 12 and I 13 after the brightness adjustment corresponding to the normal exposure image I 1 , respectively, to correct the under-exposed image I 2 and Moving pixels in the overexposed image I 3 to obtain a third image I 2 ′ and a fourth image I 3 ′ from which the moving pixels are eliminated;
  • the formulas for calculating the first weight map w 1 , the second weight map w 2 and the third weight map w 3 are:
  • adjusting the brightness of the normal exposure image I 1 and the third image I 2 ′ to obtain a high-exposure fifth image I 1 ′′ and a sixth image I 2 ′′ with the same brightness as the fourth image I 3 ′ is specifically:
  • the pixels of the fifth image I 1 ′′ are given by the formula It is concluded that x is the pixel brightness in the normal exposure image I 1 , y is the pixel brightness in the fifth image I 1 ′′, and a 1 and b 1 are coefficients, which are calculated natural numbers;
  • the pixels of the sixth image I 2 ′′ are given by the formula It is obtained that x ′ is the pixel brightness in the third image I 2 ′, y ′ is the pixel brightness in the sixth image I 2 ′′, and a 2 and b 2 are coefficients, which are calculated natural numbers.
  • the weighted fusion is specifically:
  • the present invention provides a computer-readable storage medium.
  • the steps of the method for implementing HDR against motion ghosts as described above are implemented.
  • the present invention provides a portable terminal, including:
  • One or more processors are One or more processors;
  • One or more computer programs wherein the one or more computer programs are stored in the memory and configured to be executed by the one or more processors, which are implemented when the processors execute the computer programs Steps of the HDR method as described above.
  • FIG. 1 is a flowchart of an HDR method for resisting motion ghosts according to a first embodiment of the present invention.
  • FIG. 2 is a schematic structural diagram of a portable terminal according to a third embodiment of the present invention.
  • the HDR (High-Dynamic Range) method for anti-moving ghosts includes the following steps:
  • the normally-exposed image (I 1 ), the under-exposed image (I 2 ), and the over-exposed image (I 3 ) are three images taken in the HDR mode.
  • the mapping adjustment is to use a histogram mapping to map and adjust the histogram of the normal exposure image (I 1 ) to be consistent with the image brightness of the underexposed image (I 2 ) and the overexposed image (I 3 ), respectively.
  • the under-exposure image (I 2) and the over-exposure image (I 3) are respectively a first image (I 12) and the second image (I 13) that compensates underexposed image (I 2) and the over-exposure image (I 3 ) a pixel having a large difference in brightness, to obtain a third image (I 2 ′) and a fourth image (I 3 ′) from which moving pixels are eliminated;
  • Moving pixels are pixels with significant differences in brightness at corresponding positions in the two comparison images.
  • the first image (I 12 ) and the second image (I 13 ) after adjusting the brightness of the underexposed image (I 2 ) and the overexposed image (I 3 ) corresponding to the normal exposure image (I 1 ), respectively.
  • Pixel comparison correcting the moving pixels in the under-exposed image (I 2 ) and the over-exposed image (I 3 ) to obtain a third image (I 2 ′) and a fourth image (I 3 ′) from which the moving pixels are eliminated;
  • V 3 V 1 (1-W) + V 2 W
  • V 1 is the pixel brightness at a certain position in the underexposed image (I 2 ), and if its brightness value is greater than 240, it remains unchanged.
  • V 2 is the pixel brightness at the corresponding position in the first image (I 12 ), and V 3 is the pixel brightness at the corresponding position in the third image (I 2 ′).
  • V 3 ′ V 1 ′ (1-W ′) + V 2 ′ W ′
  • V 1 ′ is the pixel brightness at a certain position in the overexposed image (I 3 )
  • V 2 ′ is the pixel brightness at the corresponding position in the second image (I 13 )
  • V 3 ′ is the fourth image (I 3 ′ The pixel brightness at the corresponding position in).
  • the first weight map (w 1 ), the second weight map (w 2 ), and the third weight map (w 3 ) specifically adopt the formula:
  • the pixels of the fifth image (I 1 ′′) are given by the formula It is concluded that x is the pixel brightness in the normal exposure image (I 1 ), y is the pixel brightness in the fifth image (I 1 ′′), and a 1 and b 1 are coefficients, which are calculated natural numbers;
  • Gauss-Newton method and the estimation of parameters can be optimized and a 1 b 1, and further to obtain a 1, b 1 is determined value;
  • the pixels of the sixth image (I 2 ′′) are given by the formula It is obtained that x ′ is the pixel brightness in the third image (I 2 ′), y ′ is the pixel brightness in the sixth image (I 2 ′′), a 2 and b 2 are coefficients, and both are calculated natural numbers .
  • the above estimated parameters a 2 and b 2 can be optimized, and then the determined values of a 2 and b 2 can be obtained;
  • Image weighted fusion specifically uses the following formula
  • I is an HDR image
  • an HDR image I capable of resisting motion ghosts can be generated.
  • the value of the underexposed image is more considered in the light, and the value of the overexposed is considered in the dark, so that the dark and bright places have richer information.
  • the second embodiment of the present invention provides a computer-readable storage medium.
  • the steps of the HDR method for resisting motion ghosts provided by the first embodiment of the present invention are implemented.
  • FIG. 2 shows a specific structural block diagram of a portable terminal provided in Embodiment 3 of the present invention.
  • a portable terminal 100 includes: one or more processors 101, a memory 102, and one or more computer programs. 101 and the memory 102 are connected by a bus, the one or more computer programs are stored in the memory 102, and are configured to be executed by the one or more processors 101, the processors 101 executing all When describing the computer program, the steps of implementing an HDR method against motion ghosts provided by the first embodiment of the present invention are described.
  • the storage media such as ROM / RAM, magnetic disk, optical disk, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Exposure Control For Cameras (AREA)
PCT/CN2019/087555 2018-05-22 2019-05-20 一种抗运动鬼影的hdr方法及便携式终端 Ceased WO2019223635A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP19807643.2A EP3799413B1 (en) 2018-05-22 2019-05-20 Motion ghost resistant hdr method and portable terminal
JP2020564637A JP7284767B2 (ja) 2018-05-22 2019-05-20 運動ゴーストに対抗するｈｄｒ方法及び携帯端末
US17/057,688 US11190707B2 (en) 2018-05-22 2019-05-20 Motion ghost resistant HDR image generation method and portable terminal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810566525.XA CN108833775B (zh) 2018-05-22 2018-05-22 一种抗运动鬼影的hdr方法、装置及便携式终端
CN201810566525.X 2018-05-22

Publications (1)

Publication Number Publication Date
WO2019223635A1 true WO2019223635A1 (zh) 2019-11-28

Family

ID=64143674

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/087555 Ceased WO2019223635A1 (zh) 2018-05-22 2019-05-20 一种抗运动鬼影的hdr方法及便携式终端

Country Status (5)

Country Link
US (1) US11190707B2 (enExample)
EP (1) EP3799413B1 (enExample)
JP (1) JP7284767B2 (enExample)
CN (1) CN108833775B (enExample)
WO (1) WO2019223635A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112288664A (zh) * 2020-09-25 2021-01-29 北京迈格威科技有限公司 高动态范围图像的融合方法、装置和电子设备

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108833775B (zh) 2018-05-22 2020-04-03 深圳岚锋创视网络科技有限公司 一种抗运动鬼影的hdr方法、装置及便携式终端
CN109767413B (zh) * 2019-01-11 2022-11-29 影石创新科技股份有限公司 一种抗运动伪影的hdr方法、装置及便携式终端
CN110445989B (zh) * 2019-08-05 2021-03-23 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质及电子设备
CN110611750B (zh) * 2019-10-31 2022-03-22 北京迈格威科技有限公司 一种夜景高动态范围图像生成方法、装置和电子设备
CN111340730B (zh) * 2020-02-26 2023-05-09 Oppo广东移动通信有限公司 拖影现象的消除方法、终端及存储介质
CN111479072B (zh) * 2020-04-14 2021-12-17 深圳市道通智能航空技术股份有限公司 高动态范围图像合成方法、装置、图像处理芯片及航拍相机
CN111770282B (zh) * 2020-06-28 2021-06-01 Oppo广东移动通信有限公司 图像处理方法及装置、计算机可读介质及终端设备
CN115439384B (zh) * 2022-09-05 2025-01-21 中国科学院长春光学精密机械与物理研究所 一种无鬼影多曝光图像融合方法、装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103973958A (zh) * 2013-01-30 2014-08-06 阿里巴巴集团控股有限公司 图像处理方法及设备
US20150249779A1 (en) * 2014-02-28 2015-09-03 Konica Minolta Laboratory U.S.A., Inc. Smoothing of ghost maps in a ghost artifact detection method for hdr image creation
CN105163047A (zh) * 2015-09-15 2015-12-16 厦门美图之家科技有限公司 一种基于色彩空间转换的hdr图像生成方法、系统及拍摄终端
CN105551061A (zh) * 2015-12-09 2016-05-04 天津大学 高动态范围图像融合中保留无鬼影运动物体处理方法
US20180084181A1 (en) * 2016-09-22 2018-03-22 Apple Inc. Adaptive bracketing techniques
CN108833775A (zh) * 2018-05-22 2018-11-16 深圳岚锋创视网络科技有限公司 一种抗运动鬼影的hdr方法、装置及便携式终端

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7403707B2 (en) * 2005-07-28 2008-07-22 Mitsubishi Electric Research Laboratories, Inc. Method for estimating camera settings adaptively
KR101699919B1 (ko) * 2011-07-28 2017-01-26 삼성전자주식회사 다중 노출 퓨전 기반에서 고스트 흐림을 제거한 ｈｄｒ 영상 생성 장치 및 방법
US10382674B2 (en) * 2013-04-15 2019-08-13 Qualcomm Incorporated Reference image selection for motion ghost filtering
US8957984B2 (en) * 2013-06-30 2015-02-17 Konica Minolta Laboratory U.S.A., Inc. Ghost artifact detection and removal in HDR image processsing using multi-scale normalized cross-correlation
US9123141B2 (en) * 2013-07-30 2015-09-01 Konica Minolta Laboratory U.S.A., Inc. Ghost artifact detection and removal in HDR image processing using multi-level median threshold bitmaps
KR102106537B1 (ko) * 2013-09-27 2020-05-04 삼성전자주식회사 하이 다이나믹 레인지 영상 생성 방법 및, 그에 따른 장치, 그에 따른 시스템
US9185270B2 (en) * 2014-02-28 2015-11-10 Konia Minolta Laboratory U.S.A., Inc. Ghost artifact detection and removal in HDR image creation using graph based selection of local reference
US9613408B2 (en) * 2014-09-25 2017-04-04 Intel Corporation High dynamic range image composition using multiple images
WO2018113975A1 (en) * 2016-12-22 2018-06-28 Huawei Technologies Co., Ltd. Generation of ghost-free high dynamic range images
EP3631754B1 (en) * 2017-06-28 2021-03-31 Huawei Technologies Co., Ltd. Image processing apparatus and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103973958A (zh) * 2013-01-30 2014-08-06 阿里巴巴集团控股有限公司 图像处理方法及设备
US20150249779A1 (en) * 2014-02-28 2015-09-03 Konica Minolta Laboratory U.S.A., Inc. Smoothing of ghost maps in a ghost artifact detection method for hdr image creation
CN105163047A (zh) * 2015-09-15 2015-12-16 厦门美图之家科技有限公司 一种基于色彩空间转换的hdr图像生成方法、系统及拍摄终端
CN105551061A (zh) * 2015-12-09 2016-05-04 天津大学 高动态范围图像融合中保留无鬼影运动物体处理方法
US20180084181A1 (en) * 2016-09-22 2018-03-22 Apple Inc. Adaptive bracketing techniques
CN108833775A (zh) * 2018-05-22 2018-11-16 深圳岚锋创视网络科技有限公司 一种抗运动鬼影的hdr方法、装置及便携式终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3799413A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112288664A (zh) * 2020-09-25 2021-01-29 北京迈格威科技有限公司 高动态范围图像的融合方法、装置和电子设备

Also Published As

Publication number Publication date
JP7284767B2 (ja) 2023-05-31
US20210211567A1 (en) 2021-07-08
JP2021525029A (ja) 2021-09-16
CN108833775A (zh) 2018-11-16
EP3799413A1 (en) 2021-03-31
EP3799413C0 (en) 2024-03-06
CN108833775B (zh) 2020-04-03
EP3799413B1 (en) 2024-03-06
EP3799413A4 (en) 2022-03-09
US11190707B2 (en) 2021-11-30

Similar Documents

Publication Publication Date Title
WO2019223635A1 (zh) 一种抗运动鬼影的hdr方法及便携式终端
CN110062160B (zh) 图像处理方法和装置
CN104349070B (zh) 高动态范围图像曝光时间控制方法
CN108335279B (zh) 图像融合和hdr成像
WO2022000397A1 (zh) 低照度图像增强方法、装置及计算机设备
CN109767413B (zh) 一种抗运动伪影的hdr方法、装置及便携式终端
WO2019183813A1 (zh) 一种拍摄方法及设备
TWI697867B (zh) 測光補償方法及其相關監控攝影設備
CN104994306A (zh) 一种基于脸部亮度自动调整曝光度的摄像方法和摄像装置
CN111294575B (zh) 图像处理方法、装置、电子设备及存储介质
JP6218389B2 (ja) 画像処理装置及び画像処理方法
CN108416754A (zh) 一种自动去除鬼影的多曝光图像融合方法
CN100553301C (zh) 亮度的修正方法
WO2022116989A1 (zh) 图像处理方法、装置、设备和存储介质
CN113163127B (zh) 图像处理方法、装置、电子设备及存储介质
WO2020029679A1 (zh) 控制方法、装置、成像设备、电子设备及可读存储介质
CN111953893A (zh) 一种高动态范围图像生成方法、终端设备及存储介质
CN114240767A (zh) 一种基于曝光融合的图像宽动态范围处理方法及装置
CN108337446A (zh) 基于双摄像头的高动态范围图像获取方法、装置及设备
WO2023000878A1 (zh) 拍摄方法、装置、控制器、设备和计算机可读存储介质
WO2022206353A1 (zh) 图像处理方法、拍摄装置、图像处理装置及可读存储介质
WO2020107289A1 (zh) 拍摄方法、装置及无人机
CN102752512B (zh) 一种调节图像曝光效果的方法
KR101070057B1 (ko) 적응형 감마 보정 곡선을 이용한 영상 처리 방법
CN116033274B (zh) 一种兼容3d降噪的图像宽动态方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19807643

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020564637

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019807643

Country of ref document: EP

Effective date: 20201222