WO2019090909A1 - Method and device for improving contrast of bayer image - Google Patents

Method and device for improving contrast of bayer image Download PDF

Info

Publication number
WO2019090909A1
WO2019090909A1 PCT/CN2017/117315 CN2017117315W WO2019090909A1 WO 2019090909 A1 WO2019090909 A1 WO 2019090909A1 CN 2017117315 W CN2017117315 W CN 2017117315W WO 2019090909 A1 WO2019090909 A1 WO 2019090909A1
Authority
WO
WIPO (PCT)
Prior art keywords
image data
primary color
dark primary
color image
bayer
Prior art date
Application number
PCT/CN2017/117315
Other languages
French (fr)
Chinese (zh)
Inventor
周学兵
Original Assignee
深圳市华星光电半导体显示技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市华星光电半导体显示技术有限公司 filed Critical 深圳市华星光电半导体显示技术有限公司
Publication of WO2019090909A1 publication Critical patent/WO2019090909A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/92Dynamic range modification of images or parts thereof based on global image properties
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/20Image enhancement or restoration using local operators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration using histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • G06T2207/20028Bilateral filtering

Definitions

  • the present invention relates to the field of image processing technologies, and in particular, to a method and apparatus for improving Bayer image contrast.
  • image enhancement technology can effectively improve the performance of systems such as video capture, image recognition, and dynamic recognition under low illumination conditions.
  • the contrast enhancement method for Bayer image data in the prior art mainly comprises the following steps: first performing interpolation processing on Bayer image data to obtain interpolated RGB image data, and then acquiring dark primary color image data based on RGB image data; for dark primary color image
  • the integral map is calculated, and the acquired dark primary color image is bilaterally filtered by the integral map to obtain the filtered dark primary color image data;
  • the histogram statistics are performed on the RGB image data and the filtered dark primary color image data to obtain R/ G/B (three component values of pixel points R, G, and B) and histogram of dark primary image data; at the same time, cumulative statistics are performed on the filtered dark primary image data to obtain the sum of dark primary image data in the filtering window;
  • G/B dark primary image data histogram, total analysis of dark primary image data in the filtering window, comprehensive analysis, get gain value, dark channel mean and R/G/B corresponding atmospheric light value; use each frame to update the gain value And the atmospheric light value, the dark channel mean value and the filtered
  • the technical problem to be solved by the present invention is to provide a method and apparatus for improving the contrast of a Bayer image, which can simplify the intermediate processing process and reduce the processing delay while ensuring the contrast and detail information of the image.
  • the present invention provides a method for improving the contrast of a Bayer image, comprising:
  • the acquired dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the dark primary color image data of the top, and the left bottom region BL and the right are obtained by the dark primary color image data of the bottom.
  • the integrated values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are integrated to obtain a sum of dark primary color image data in the filtered window. Performing bilateral filtering processing on the sum of the dark primary color image data in the filtering window to obtain filtered dark primary color image data;
  • the gain value obtained by the Bayer image data and the atmospheric light value corresponding to the R/G/B image data, the filtered dark primary color image, and the Bayer image data are integrated to obtain Bayer image data with contrast enhancement.
  • the present invention also provides a method for improving the contrast of a Bayer image, comprising: a method for improving the contrast of a Bayer image, comprising respectively acquiring dark primary color image data of the bottom, middle and top of the pixel unit in the current Bayer image data.
  • the obtained dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the top dark primary image data of the top, and the left bottom region BL and the left bottom region BL are obtained by the bottom dark primary image data of the bottom An integral value of the right bottom region BR, and forming an integral map; an integral value of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR
  • the sum of the dark primary color image data in the filtering window is obtained, and the sum of the dark primary color image data in the filtering window is bilaterally processed to obtain the filtered dark primary color image data; and the filtered dark primary color image data is calculated and processed. , get the Bayer image data after the contrast is improved.
  • the present invention also provides an apparatus for improving the contrast of a Bayer image, comprising: a storage manager for realizing buffering of Bayer image line data in a bilateral filtering window; a bottom running module, the bottom running module And configured to obtain bottom dark primary image data of the pixel unit in the Bayer image data, and calculate an integrated value of the left bottom region BL and the right bottom region BR according to the bottom dark primary image data; the top running module, the top running module Obtaining top dark primary color image data of the pixel unit in the Bayer image data, and calculating an integrated value of the left top region TL and the right top region TR according to the top dark primary color image data; the middle running module, the middle running module is used to Forming an integral map, and integrating the integrated values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR to obtain a dark primary color in the filtering window Sum of image data, bilaterally filtering the sum of dark primary color image data
  • the invention has the beneficial effects that the method and the device for improving the contrast of the Bayer image are proposed differently from the prior art.
  • the method and the device of the invention adopt a pipeline and data parallel processing structure, while ensuring the contrast and detail information of the image. Simplify the intermediate processing process, reduce the processing delay, and improve the processing of Bayer images. Further, the method and device of the present invention converts the integral map required for bilateral filtering into an integral line mode for management, optimizes the dark state image, suppresses the over-bright area, and improves the contrast of the entire image.
  • FIG. 1 is a schematic flow chart of an embodiment of a method for improving Bayer image contrast according to the present invention
  • FIG. 2 is a schematic diagram of integration of regions of dark primary color image data of the present invention.
  • FIG. 3 is a schematic diagram of an integral line of dark primary color image data of the present invention.
  • FIG. 4 is a schematic diagram showing the calculation principle of the sum of the dark primary color image data in the filtering window of the present invention.
  • FIG. 5 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a first embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a second embodiment of the present invention.
  • Figure 7 is a block diagram showing the structure of an apparatus for improving the contrast of a Bayer image according to a third embodiment of the present invention.
  • FIG. 1 is a schematic flow chart of an embodiment of a method for improving the contrast of a Bayer image according to the present invention.
  • the method for improving the contrast of a Bayer image in this embodiment includes the following steps:
  • the current Bayer image data is interpolated to obtain the interpolated RGB image data; and the dark primary color image data of the bottom, middle, and top of the pixel unit is obtained according to the interpolated RGB image data.
  • the bottom running module acquires the bottom dark primary color image data of the pixel unit in the Bayer image data
  • the top running module obtains the top of the pixel unit in the Bayer image data.
  • the dark primary image data, the middle running module acquires part of the dark primary image data in the Bayer image data.
  • the dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the top dark primary image data, and the left bottom region BL and the left bottom region BL are obtained by the dark primary color image data at the bottom. Integrate the values and form an integral map.
  • the top running module and the bottom running module are time-divisionally managed, the bottom running module directly acquires Bayer image data, and the top running module acquires Bayer image data in the cache device.
  • the left top area TL201, the right top area TR202, the left bottom area BL203, and the left bottom area BL204 represent the areas of the respective pixel units to the base point 205, respectively.
  • the integral map is implemented by means of integral rows.
  • the integration line is used to simulate the implementation of the integral map function, and the left top region TL301 and the right top region TR302 and the left bottom region BL303 and the right are calculated according to the calculation of the cumulative sum in the filter window.
  • the integral value of the bottom area BR304 is managed by time sharing through the top running module and the bottom running module branch; each group of integral lines uses two static memories to simulate the integral value management in a time sharing manner, wherein the static memory A and B correspond to the top integral Lines; while static memories C and D correspond to the bottom of the integral line; when the first line of Bayer image data arrives, the data in static memories A, B, C, and D is cleared; when the first line of Bayer image data arrives,
  • the static memory A will refer to the static memory B as a reference, and simultaneously read the integrated values of (i-1, j-1), (i-1, j) from the static memory B; read from the static memory A (i, The value of j-1); after the integral value formula is calculated, the integral value (i, j) is updated to the corresponding position of the static memory A; when the second line of the Bayer image data arrives, the static memory A is saved at this time.
  • static memory B will use static memory A as a reference to calculate the integral value of the current line and update it to static memory B; when the third line of image frame arrives, static memory A and B switch again at this time.
  • the static memory A is again referenced to the static memory B, and the integral map data of the current line is calculated and updated to the static memory A; the static memory C and D are managed in the same manner as the static memories A and B. And so on, until the end of the calculation to get the integral map.
  • the integral value of the dark primary color image data in the filtering window is obtained by integrating the integral values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR, and the dark primary color image data in the filtering window is filtered. The sum is subjected to bilateral filtering processing to obtain filtered dark primary color image data.
  • the calculation principle of the sum of the dark primary image data in the filtering window is as shown in FIG. 4, and I(i, j) is that the information stored in the integral graph is (i, j) pixel unit to base point (0, 0) (Fig. The integral value of the sum of all the pixels in 405), P(i, j) is the pixel unit integral value.
  • I(0,1) P(0,1)+I(0,0).
  • I(1,0) P(1,0)+I(0,0).
  • I(1,1) I(1,0)+I(0,1)-I(0,0)+P(1,1).
  • I(i,j) I(i,j-1)+I(i-1,j)-I(i-1,j-1)+P(i,j).
  • the sum of the dark primary color image data in the filtering window is obtained by combining the integrated values of the left top region TL and the right bottom region BR, subtracting the integrated values of the right top region TR and the left bottom region BL, and the sum of the dark primary color image data in the window is obtained.
  • the radius of the filtering window is R
  • the size of the entire filtering window is (2R+1)*(2R+1).
  • the bottom running module and the top running module in the window have a distance difference on both sides.
  • the integrated values of the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are introduced into the above formula (1) to obtain the entire bilateral filter (2R+1)* ( 2R+1)
  • the sum of the dark primary color image data in the window, and the obtained sum of the dark primary color image data in the window is bilaterally filtered to realize the noise reduction processing of the Bayer image data.
  • the histogram statistics are performed according to the RGB image data and the filtered dark primary color image, and the R/G/B image data cumulative histogram, the dark primary color image data histogram, and the dark primary color image data cumulative total value are obtained; /G/B image data accumulation histogram, dark primary image data histogram, dark primary image data cumulative total value for comprehensive analysis, get the gain value and the atmospheric light value corresponding to the R/G/B image data; finally use the Bayer image data
  • the obtained gain value and the atmospheric light value corresponding to the R/G/B image data, the filtered dark primary color image, and the Bayer image data are subjected to comprehensive calculation processing to obtain Bayer image data with contrast enhancement.
  • the bottom, middle and top running modules respectively obtain dark primary color image data of the bottom, middle and top, and then integrate the bottom and top regions to obtain the sum of the dark primary color image data in the filtering window, and comprehensively calculate Processing to obtain Bayer image data with improved contrast.
  • the intermediate processing process is simplified, the processing delay is reduced, and the processing process of the Bayer image is improved.
  • FIG. 5 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a first embodiment of the present invention, which mainly includes: a storage manager 1 for buffering Bayer image line data in a bilateral filtering window, and the storage manager 1 follows
  • the transmission direction includes: a storage controller 18, an arbitration manager 19, and a bottom operation module (not shown) for acquiring bottom dark primary image data of the pixel unit in the Bayer image data, and according to the bottom dark primary color image.
  • the data is calculated to obtain the integrated values of the left bottom region BL and the right bottom region BR
  • the bottom running module includes, in order of the transmission direction, a row buffer management module 2, a color filter array interpolation module 3, a dark primary color calculation module 4, and an integral row management module 5; a top running module (not shown) for acquiring top dark primary color image data of the pixel unit in the Bayer image data, and calculating an integral value of the left top region TL and the right top region TR according to the top dark primary color image data
  • the top running module has the same structure as the bottom running module, and the top running module includes, in order of the transmission direction, a line buffer.
  • the regional TR integral value is integrated into four values of BL, BR, TL, and TR, and the sum of the dark primary color image data in the filtering window is obtained, and then the filtered dark primary color image data is obtained after the bilateral filtering calculation processing; the middle running module includes: The buffer management module 6, the color filter array interpolation module 7, the dark primary color calculation module 8, the barrel shifter 9, the bilateral filter calculation module 10, and the statistical analysis calculation module.
  • the statistical analysis calculation module includes a statistics module 11, an analysis module 12, and a
  • the line buffer management module (2, 6, and 14 in the figure) is used to rearrange Bayer image data before interpolation; the color filter array interpolation module (3, 7, and 15 in the figure) is used for Bayer image data interpolation calculation.
  • the dark primary color calculation module (4, 8, 16 in the figure) selects the minimum value in the RGB image as the dark primary image data; the integral row management module (5, 17 in the figure) is used to implement the top of the filtering window.
  • the calculation module 10 is configured to implement filtering and smoothing processing on the dark primary color image data to obtain a filtered dark primary color image; the statistical module 11 is configured to perform histogram statistics on the filtered dark primary color image to obtain R/G/B image data.
  • the Bayer image data is input to the bottom running module and the storage manager 1, respectively, and the image data is time-divisionally sent to the top running module and the middle running module through the storage controller 18 and the arbitration manager 19; Bayer image data
  • the dark primary image data of the bottom, middle and top of the pixel unit passes through the line buffer management module (2, 6, 14 in the figure), the color filter array interpolation module (3, 7, 15 in the figure) and the dark primary color calculation module ( After processing 4, 8, and 16), the respective dark primary color image data and RGB image data are obtained; the top and bottom dark primary color image data are implemented in the filtering window via the integral row management module (Fig. 5, 17).
  • the integral values of the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are obtained, and an integral map is formed; through the integral map, the left top region TL, the right top
  • the integral values of the region TR, the left bottom region BL and the right bottom region BR are integrated and processed to obtain the sum of the dark primary color image data in the filtering window, and the dark primary color image in the filtering window is obtained.
  • the statistic module 11 performs histogram statistics based on the RGB image data and the filtered dark primary color image to obtain an R/G/B image.
  • FIG. 6 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a second embodiment of the present invention.
  • the input image data format is an RGB image, and color interpolation array interpolation processing is not required (CFAI, Color).
  • Filter Array Interpolation For the processing, the color filter array interpolation module in the above embodiment can be used to directly obtain the RGB image data for subsequent processing.
  • the specific device structure is similar to the above embodiment, and will not be described here.
  • FIG. 7 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a third embodiment of the present invention.
  • the input data image is a YUV image
  • the YUV format needs to be converted to the RGB format when inputting.
  • the output port of the device 22 needs to be added to the RGB format to the YUV format converter 23.
  • the specific steps are similar to those of the above embodiment, and will not be described here.
  • the implementation of the Bayer image contrast enhancement device can also be extended to RGB FHD
  • the real-time image processing of the resolution such as (1920*1080) or UD (3840*2160) is not limited herein.
  • the present invention provides a method and a device for improving the contrast of a Bayer image.
  • the method and the device of the present invention adopt a pipeline and data parallel processing structure to simplify the intermediate processing process and reduce the processing while ensuring the contrast and detail information of the image.
  • the delay has improved the processing of Bayer images.
  • the method and device of the present invention converts the integral map required for bilateral filtering into an integral line mode for management, optimizes the dark state image, suppresses the over-bright area, and improves the contrast of the entire image.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The present invention provides a method and device for improving the contrast of a Bayer image. The method comprises: respectively obtaining dark primary color image data of a bottom portion, a middle portion, and a top portion of a pixel unit in the current Bayer image data; managing the obtained dark primary color image data in time-sharing fashion, obtaining integral values of a top left region TL and a top right region TR by means of the dark primary color image data of the top portion, obtaining integral values of a bottom left region BL and a bottom right region BR by means of the dark primary color image data of the bottom portion, and forming an integral image; performing comprehensive processing on the integral image and the integral values of the top left region TL, the top right region TR, the bottom left region BL, and the bottom right region BR, and then preforming bilateral filtering processing to obtain filtered dark primary color image data; and performing computational processing on the filtered dark primary image data to obtain Bayer image data having improved contrast. The method simplifies an intermediate processing procedure and reduces processing delays while ensuring the contrast and detailed information of an image.

Description

改善Bayer图像对比度的方法及装置 Method and device for improving Bayer image contrast
【技术领域】[Technical Field]
本发明涉及图像处理技术领域,特别是涉及改善Bayer图像对比度的方法及装置。The present invention relates to the field of image processing technologies, and in particular, to a method and apparatus for improving Bayer image contrast.
【背景技术】 【Background technique】
在图像拍摄和视频采集过程中,经常会遇到夜视或背光较差的时候,此时得到的图像对比度低,细节信息模糊,给后续图像分析工作带来诸多不便。利用图像增强技术可以有效提升视频采集、图像识别、动态识别等系统在低照度情况下的性能。In the process of image capture and video capture, when night vision or backlight is often encountered, the image obtained at this time has low contrast and blurred details, which brings inconvenience to subsequent image analysis work. The use of image enhancement technology can effectively improve the performance of systems such as video capture, image recognition, and dynamic recognition under low illumination conditions.
对于彩色图像,需要采集多种最基本的颜色,如RGB三种颜色,最简单的方法就是用滤镜的方法,红色的滤镜透过红色的波长,绿色的滤镜透过绿色的波长,蓝色的滤镜透过蓝色的波长。如果要采集RGB三个基本色,则需要三块滤镜,这样价格昂贵,且不好制造,因为三块滤镜都必须保证每一个像素点都对齐。当用bayer格式的时候,很好的解决了这个问题。bayer图像是在一块滤镜上设置的不同的颜色,通过分析人眼对颜色的感知发现。Bayer模式是颜色模式,被广泛应用于CCD和CMOS摄像头。现有技术中针对Bayer图像数据的对比度提升方法主要包含如下步骤:先针对Bayer图像数据进行插值处理,得到插值后的RGB图像数据,再基于RGB图像数据获取其暗原色图像数据;针对暗原色图像计算出其积分图,通过积分图对已获取的暗原色图像做双边滤波处理,得到滤波后的暗原色图像数据;针对RGB图像数据、滤波后的暗原色图像数据进行直方图统计,得到R/G/B(像素点R、G、B三个分量值)、暗原色图像数据直方图;同时针对滤波后的暗原色图像数据进行累加统计,得到滤波窗口内暗原色图像数据总和;针对R/G/B、暗原色图像数据直方图,滤波窗口内暗原色图像数据总和进行综合分析,得到增益值、暗通道均值及R/G/B对应的大气光值;利用每帧更新得到的增益值及R/G/B对应的大气光值、暗通道均值以及滤波后暗原色图像数据,对原始的Bayer图像数据进行计算处理,最终得到对比度提升后的Bayer图像数据。For color images, you need to collect a variety of basic colors, such as RGB three colors, the easiest way is to use the filter method, the red filter through the red wavelength, the green filter through the green wavelength, The blue filter passes through the blue wavelength. If you want to capture the three basic colors of RGB, you need three filters, which is expensive and not easy to manufacture, because all three filters must ensure that each pixel is aligned. When using the bayer format, this problem is solved very well. The bayer image is a different color set on a filter and is found by analyzing the perception of color by the human eye. Bayer mode is a color mode that is widely used in CCD and CMOS cameras. The contrast enhancement method for Bayer image data in the prior art mainly comprises the following steps: first performing interpolation processing on Bayer image data to obtain interpolated RGB image data, and then acquiring dark primary color image data based on RGB image data; for dark primary color image The integral map is calculated, and the acquired dark primary color image is bilaterally filtered by the integral map to obtain the filtered dark primary color image data; the histogram statistics are performed on the RGB image data and the filtered dark primary color image data to obtain R/ G/B (three component values of pixel points R, G, and B) and histogram of dark primary image data; at the same time, cumulative statistics are performed on the filtered dark primary image data to obtain the sum of dark primary image data in the filtering window; G/B, dark primary image data histogram, total analysis of dark primary image data in the filtering window, comprehensive analysis, get gain value, dark channel mean and R/G/B corresponding atmospheric light value; use each frame to update the gain value And the atmospheric light value, the dark channel mean value and the filtered dark primary color image data corresponding to R/G/B, and the original Bayer image data Calculation processing, Bayer finally obtained image data to enhance the contrast.
现有技术中,需要针对Bayer图像数据、双边滤波前/后暗原色图像数据、积分图进行缓存处理,占用内存的同时,需要多次访问内存;此外,原方法中,除了需要统计/维护R/G/B直方图,还需要做多个中间过程的计算处理。因此,现有的针对Bayer图像数据的对比度提升方法中,无论图形处理、还是数字信号处理实现都很满足实时要求,甚至出现处理延迟达到数个秒级。In the prior art, it is necessary to perform buffer processing on Bayer image data, bilaterally filtered front/back dark primary color image data, and integral map, and requires memory access multiple times while occupying memory; in addition, in the original method, in addition to statistics/maintenance R /G/B histogram, also need to do the calculation process of multiple intermediate processes. Therefore, in the existing contrast enhancement method for Bayer image data, both the graphics processing and the digital signal processing implementation meet the real-time requirements, and even the processing delay reaches several seconds.
因此,需要一种改善Bayer图像对比度方案,能够在保证图像的对比度和细节信息的同时,改善处理过程的延迟。Therefore, there is a need for an improved Bayer image contrast scheme that can improve the processing delay while ensuring image contrast and detail information.
【发明内容】 [Summary of the Invention]
本发明解决的技术问题是,提供改善Bayer图像对比度的方法及装置,在保证图像的对比度和细节信息的同时,简化中间处理过程,降低处理的延迟。The technical problem to be solved by the present invention is to provide a method and apparatus for improving the contrast of a Bayer image, which can simplify the intermediate processing process and reduce the processing delay while ensuring the contrast and detail information of the image.
为解决上述技术问题,本发明提供了一种改善Bayer图像对比度的方法,包括:To solve the above technical problems, the present invention provides a method for improving the contrast of a Bayer image, comprising:
将当前Bayer图像数据进行插值处理,得到插值后的RGB图像数据;Interpolating current Bayer image data to obtain interpolated RGB image data;
根据所述插值后的RGB图像数据,分别获取像素单元的底部、中部和顶部的暗原色图像数据;Obtaining dark primary color image data of the bottom, middle, and top of the pixel unit according to the interpolated RGB image data;
将获取的暗原色图像数据分时管理,通过所述顶部的暗原色图像数据得到左顶区域TL和右顶区域TR的积分值,通过所述底部的暗原色图像数据得到左底区域BL和右底区域BR的积分值,并形成积分图;The acquired dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the dark primary color image data of the top, and the left bottom region BL and the right are obtained by the dark primary color image data of the bottom. The integral value of the bottom region BR and form an integral map;
通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和,将所述滤波窗口内暗原色图像数据总和进行双边滤波处理,得到滤波后的暗原色图像数据;The integrated values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are integrated to obtain a sum of dark primary color image data in the filtered window. Performing bilateral filtering processing on the sum of the dark primary color image data in the filtering window to obtain filtered dark primary color image data;
根据所述RGB图像数据和所述滤波后的暗原色图像进行直方图统计,得到R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值;Performing histogram statistics on the RGB image data and the filtered dark primary color image to obtain an R/G/B image data cumulative histogram, a dark primary color image data histogram, and a dark primary color image data cumulative total value;
将所述R/G/B图像数据累积直方图、所述暗原色图像数据直方图、所述暗原色图像数据累积总值进行综合分析,得到增益值及R/G/B图像数据对应的大气光值;Integrating the R/G/B image data accumulation histogram, the dark primary color image data histogram, and the dark primary color image data cumulative total value to obtain a gain value and an atmosphere corresponding to the R/G/B image data. Light value
利用Bayer图像数据得到的增益值及R/G/B图像数据对应的大气光值以及所述滤波后的暗原色图像、所述Bayer图像数据,综合计算处理得到对比度提升后的Bayer图像数据。The gain value obtained by the Bayer image data and the atmospheric light value corresponding to the R/G/B image data, the filtered dark primary color image, and the Bayer image data are integrated to obtain Bayer image data with contrast enhancement.
为解决上述技术问题,本发明还提供了一种改善Bayer图像对比度的方法,包括:改善Bayer图像对比度的方法,包括分别获取当前Bayer图像数据中像素单元的底部、中部和顶部的暗原色图像数据;将获取的暗原色图像数据分时管理,通过所述顶部的暗原色图像数据得到左顶区域TL和右顶区域TR的积分值,通过所述底部的暗原色图像数据得到左底区域BL和右底区域BR的积分值,并形成积分图;通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和,将所述滤波窗口内暗原色图像数据总和进行双边滤波处理,得到滤波后的暗原色图像数据;将所述滤波后的暗原色图像数据计算处理,得到对比度提升后的Bayer图像数据。In order to solve the above technical problem, the present invention also provides a method for improving the contrast of a Bayer image, comprising: a method for improving the contrast of a Bayer image, comprising respectively acquiring dark primary color image data of the bottom, middle and top of the pixel unit in the current Bayer image data. The obtained dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the top dark primary image data of the top, and the left bottom region BL and the left bottom region BL are obtained by the bottom dark primary image data of the bottom An integral value of the right bottom region BR, and forming an integral map; an integral value of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR After the comprehensive processing, the sum of the dark primary color image data in the filtering window is obtained, and the sum of the dark primary color image data in the filtering window is bilaterally processed to obtain the filtered dark primary color image data; and the filtered dark primary color image data is calculated and processed. , get the Bayer image data after the contrast is improved.
为解决上述问题,本发明还提供改善Bayer图像对比度的装置,包括:存储管理器,所述存储管理器用于实现双边滤波窗口内的Bayer图像行数据的缓存;底部运行模块,所述底部运行模块用于获取Bayer图像数据中像素单元的底部暗原色图像数据,并根据所述底部暗原色图像数据计算得到左底区域BL和右底区域BR的积分值;顶部运行模块,所述顶部运行模块用于获取Bayer图像数据中像素单元的顶部暗原色图像数据,并根据所述顶部暗原色图像数据计算得到左顶区域TL和右顶区域TR的积分值;中部运行模块,所述中部运行模块用于形成积分图,通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和,将所述滤波窗口内暗原色图像数据总和进行双边滤波处理,得到滤波后的暗原色图像数据,使用所述滤波后的暗原色图像数据具进行计算处理,得到对比度提升后的Bayer图像数据。In order to solve the above problems, the present invention also provides an apparatus for improving the contrast of a Bayer image, comprising: a storage manager for realizing buffering of Bayer image line data in a bilateral filtering window; a bottom running module, the bottom running module And configured to obtain bottom dark primary image data of the pixel unit in the Bayer image data, and calculate an integrated value of the left bottom region BL and the right bottom region BR according to the bottom dark primary image data; the top running module, the top running module Obtaining top dark primary color image data of the pixel unit in the Bayer image data, and calculating an integrated value of the left top region TL and the right top region TR according to the top dark primary color image data; the middle running module, the middle running module is used to Forming an integral map, and integrating the integrated values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR to obtain a dark primary color in the filtering window Sum of image data, bilaterally filtering the sum of dark primary color image data in the filtering window to obtain filtered Primary color image data, the image data on dark after having calculated using the filtering process to obtain the image data Bayer enhance the contrast.
本发明的有益效果是:区别于现有技术,本发明提出改善Bayer图像对比度的方法及装置,本发明的方法和装置采用流水线、数据并行处理结构,在保证图像的对比度和细节信息的同时,简化中间处理过程,降低处理的延迟,完善了Bayer图像的处理过程。进一步的,本发明的方法和装置将双边滤波所需的积分图转换为积分行方式进行管理,优化暗态图像,抑制过亮区域,完成图像整体的对比度的提升。The invention has the beneficial effects that the method and the device for improving the contrast of the Bayer image are proposed differently from the prior art. The method and the device of the invention adopt a pipeline and data parallel processing structure, while ensuring the contrast and detail information of the image. Simplify the intermediate processing process, reduce the processing delay, and improve the processing of Bayer images. Further, the method and device of the present invention converts the integral map required for bilateral filtering into an integral line mode for management, optimizes the dark state image, suppresses the over-bright area, and improves the contrast of the entire image.
【附图说明】 [Description of the Drawings]
图1是本发明改善Bayer图像对比度的方法一实施方式的流程示意图;1 is a schematic flow chart of an embodiment of a method for improving Bayer image contrast according to the present invention;
图2是本发明暗原色图像数据各区域积分示意图;2 is a schematic diagram of integration of regions of dark primary color image data of the present invention;
图3是本发明暗原色图像数据积分行示意图;3 is a schematic diagram of an integral line of dark primary color image data of the present invention;
图4是本发明滤波窗口内暗原色图像数据总和计算原理示意图;4 is a schematic diagram showing the calculation principle of the sum of the dark primary color image data in the filtering window of the present invention;
图5是本发明第一实施例改善Bayer图像对比度的装置结构示意图;FIG. 5 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a first embodiment of the present invention; FIG.
图6是本发明第二实施例改善Bayer图像对比度的装置结构示意图;6 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a second embodiment of the present invention;
图7是本发明第三实施例改善Bayer图像对比度的装置结构示意图。Figure 7 is a block diagram showing the structure of an apparatus for improving the contrast of a Bayer image according to a third embodiment of the present invention.
【具体实施方式】【Detailed ways】
请参阅图1,图1是本发明改善Bayer图像对比度的方法一实施方式的流程示意图,本实施例的改善Bayer图像对比度的方法包括如下步骤:Please refer to FIG. 1. FIG. 1 is a schematic flow chart of an embodiment of a method for improving the contrast of a Bayer image according to the present invention. The method for improving the contrast of a Bayer image in this embodiment includes the following steps:
101:分别获取当前Bayer图像数据中像素单元的底部、中部和顶部的暗原色图像数据。101: Obtain dark primary color image data of the bottom, middle, and top of the pixel unit in the current Bayer image data, respectively.
具体的,将当前Bayer图像数据进行插值处理,得到插值后的RGB图像数据;再根据所述插值后的RGB图像数据,获取像素单元的底部、中部和顶部的暗原色图像数据。Specifically, the current Bayer image data is interpolated to obtain the interpolated RGB image data; and the dark primary color image data of the bottom, middle, and top of the pixel unit is obtained according to the interpolated RGB image data.
本实施例中,通过选取RGB图像中的最小值来做为暗原色图像数据,底部运行模块获取Bayer图像数据中像素单元的底部暗原色图像数据,顶部运行模块获取Bayer图像数据中像素单元的顶部暗原色图像数据,中部运行模块获取Bayer图像数据中部分的暗原色图像数据。In this embodiment, by selecting the minimum value in the RGB image as the dark primary color image data, the bottom running module acquires the bottom dark primary color image data of the pixel unit in the Bayer image data, and the top running module obtains the top of the pixel unit in the Bayer image data. The dark primary image data, the middle running module acquires part of the dark primary image data in the Bayer image data.
102:将暗原色图像数据分时管理,通过顶部的暗原色图像数据得到左顶区域TL和右顶区域TR的积分值,通过底部的暗原色图像数据得到左底区域BL和左底区域BL的积分值,并形成积分图。102: The dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the top dark primary image data, and the left bottom region BL and the left bottom region BL are obtained by the dark primary color image data at the bottom. Integrate the values and form an integral map.
优选地,为了同步进行积分,将顶部运行模块和底部运行模块进行分时管理,底部运行模块直接获取Bayer图像数据,顶部运行模块则获取缓存装置内的Bayer图像数据。Preferably, in order to integrate the synchronization, the top running module and the bottom running module are time-divisionally managed, the bottom running module directly acquires Bayer image data, and the top running module acquires Bayer image data in the cache device.
如图2所示,其中,左顶区域TL201、右顶区域TR202、左底区域BL203和左底区域BL204,分别代表各自像素单元到基点205的区域。As shown in FIG. 2, the left top area TL201, the right top area TR202, the left bottom area BL203, and the left bottom area BL204 represent the areas of the respective pixel units to the base point 205, respectively.
本实施例中,积分图采用积分行的方式实现。在一个具体的实施例中,如图3所示,采用积分行来模拟实现积分图功能,根据滤波窗口中计算累积和所需的左顶区域TL301和右顶区域TR302以及左底区域BL303和右底区域BR304积分值,通过顶部运行模块和底部运行模块分行,分时进行管理;每组积分行采用2个静态存储器以分时方式来模拟积分值的管理,其中静态存储器A和B对应顶部积分行;而静态存储器C和D对应底部的积分行;当Bayer图像数据第一行数据到达前,静态存储器A、B、C和D中的数据清零;Bayer图像数据第一行数据到达时,静态存储器A将以静态存储器B为参考,从静态存储器B中同时读取(i-1,j-1)、(i-1,j)的积分值;从静态存储器A中读取(i,j-1)的值;通过积分值公式计算后,将积分值(i,j)更新到静态存储器A对应位置中;当Bayer图像数据第二行数据到达时,此时静态存储器A中已保存第一行数据的积分数据;静态存储器B将以静态存储器A为参考,计算当前行的积分值,并将其更新到静态存储器B中;当图像帧第三行数据到达时,此时静态存储器A、B再次切换,静态存储器A再次以静态存储器B为参考,计算当前行的积分图数据,并更新到静态存储器A;静态存储器C和D管理方式与静态存储器A和B相同。以此类推,直到结束经过计算得到积分图。In this embodiment, the integral map is implemented by means of integral rows. In a specific embodiment, as shown in FIG. 3, the integration line is used to simulate the implementation of the integral map function, and the left top region TL301 and the right top region TR302 and the left bottom region BL303 and the right are calculated according to the calculation of the cumulative sum in the filter window. The integral value of the bottom area BR304 is managed by time sharing through the top running module and the bottom running module branch; each group of integral lines uses two static memories to simulate the integral value management in a time sharing manner, wherein the static memory A and B correspond to the top integral Lines; while static memories C and D correspond to the bottom of the integral line; when the first line of Bayer image data arrives, the data in static memories A, B, C, and D is cleared; when the first line of Bayer image data arrives, The static memory A will refer to the static memory B as a reference, and simultaneously read the integrated values of (i-1, j-1), (i-1, j) from the static memory B; read from the static memory A (i, The value of j-1); after the integral value formula is calculated, the integral value (i, j) is updated to the corresponding position of the static memory A; when the second line of the Bayer image data arrives, the static memory A is saved at this time. Product of the first line of data Data; static memory B will use static memory A as a reference to calculate the integral value of the current line and update it to static memory B; when the third line of image frame arrives, static memory A and B switch again at this time. The static memory A is again referenced to the static memory B, and the integral map data of the current line is calculated and updated to the static memory A; the static memory C and D are managed in the same manner as the static memories A and B. And so on, until the end of the calculation to get the integral map.
103:通过积分图、左顶区域TL、右顶区域TR、左底区域BL和右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和,将滤波窗口内暗原色图像数据总和进行双边滤波处理,得到滤波后的暗原色图像数据。103: The integral value of the dark primary color image data in the filtering window is obtained by integrating the integral values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR, and the dark primary color image data in the filtering window is filtered. The sum is subjected to bilateral filtering processing to obtain filtered dark primary color image data.
优选地,滤波窗口内暗原色图像数据总和的计算原理如图4所示,I(i,j)为积分图中存储的信息是(i,j)像素单元到基点(0,0)(图中405)的所有像素之和的积分值,P(i,j)为像素单元积分值。Preferably, the calculation principle of the sum of the dark primary image data in the filtering window is as shown in FIG. 4, and I(i, j) is that the information stored in the integral graph is (i, j) pixel unit to base point (0, 0) (Fig. The integral value of the sum of all the pixels in 405), P(i, j) is the pixel unit integral value.
P(0,0),其积分图对应位置的积分值为:P(0,0), the integral value of the corresponding position of the integral map is:
I(0,0)=P(0,0)。I(0,0)=P(0,0).
P(0,1),其积分图对应位置的积分值为:P(0,1), the integral value of the corresponding position of the integral map is:
I(0,1)=P(0,1)+I(0,0)。I(0,1)=P(0,1)+I(0,0).
P(1,0),其积分图对应位置的积分值为:P(1,0), the integral value of the corresponding position of the integral map is:
I(1,0)=P(1,0)+I(0,0)。I(1,0)=P(1,0)+I(0,0).
P(1,1),其积分图对应位置的积分值为:P(1,1), the integral value of the corresponding position of the integral map is:
I(1,1)=I(1,0)+I(0,1)-I(0,0)+P(1,1)。I(1,1)=I(1,0)+I(0,1)-I(0,0)+P(1,1).
则对于P(i,j),如图4中401~404所示,其积分图对应位置的积分值为:Then, for P(i,j), as shown in 401~404 in Fig. 4, the integral value of the corresponding position of the integral map is:
I(i,j)=I(i,j-1)+I(i-1,j)-I(i-1,j-1)+P(i,j)。I(i,j)=I(i,j-1)+I(i-1,j)-I(i-1,j-1)+P(i,j).
通过上述结果,滤波窗口内暗原色图像数据总和通过合并左顶区域TL和右底区域BR的积分值,减去右顶区域TR和左底区域BL的积分值得到,窗口内暗原色图像数据总和计算公式:Through the above result, the sum of the dark primary color image data in the filtering window is obtained by combining the integrated values of the left top region TL and the right bottom region BR, subtracting the integrated values of the right top region TR and the left bottom region BL, and the sum of the dark primary color image data in the window is obtained. Calculation formula:
Sum=BR+TL-TR-BL (1)Sum=BR+TL-TR-BL (1)
(其中,Sum,窗口内暗原色图像数据总和;BR,右底区域的积分值;TL,左顶区域的积分值;TR,右顶区域的积分值;BL,左底区域的积分值)(Where, Sum, the sum of the dark primary image data in the window; BR, the integral value of the right bottom region; TL, the integral value of the left top region; TR, the integral value of the right top region; BL, the integral value of the left bottom region)
在一个具体的实施例中,滤波窗口半径为R,整个滤波窗口的大小为(2R+1)*(2R+1),此时窗口内的底部运行模块和顶部运行模块,两侧距离均相差(2R+1)的距离,将左顶区域TL、右顶区域TR、左底区域BL和右底区域BR的积分值导入上述公式(1),得到整个双边滤波器(2R+1)*(2R+1)窗口内暗原色图像数据总和,将得到的窗口内暗原色图像数据总和进行双边滤波处理,实现对Bayer图像数据的降噪处理。 In a specific embodiment, the radius of the filtering window is R, and the size of the entire filtering window is (2R+1)*(2R+1). At this time, the bottom running module and the top running module in the window have a distance difference on both sides. For the distance of (2R+1), the integrated values of the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are introduced into the above formula (1) to obtain the entire bilateral filter (2R+1)* ( 2R+1) The sum of the dark primary color image data in the window, and the obtained sum of the dark primary color image data in the window is bilaterally filtered to realize the noise reduction processing of the Bayer image data.
104:将滤波后的暗原色图像数据计算处理,得到对比度提升后的Bayer图像数据。104: Calculate and process the filtered dark primary color image data to obtain Bayer image data with contrast enhancement.
具体的,首先根据RGB图像数据和滤波后的暗原色图像进行直方图统计,得到R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值;再将R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值进行综合分析,得到增益值及R/G/B图像数据对应的大气光值;最后利用Bayer图像数据得到的增益值及R/G/B图像数据对应的大气光值以及滤波后的暗原色图像、Bayer图像数据,综合计算处理得到对比度提升后的Bayer图像数据。Specifically, first, the histogram statistics are performed according to the RGB image data and the filtered dark primary color image, and the R/G/B image data cumulative histogram, the dark primary color image data histogram, and the dark primary color image data cumulative total value are obtained; /G/B image data accumulation histogram, dark primary image data histogram, dark primary image data cumulative total value for comprehensive analysis, get the gain value and the atmospheric light value corresponding to the R/G/B image data; finally use the Bayer image data The obtained gain value and the atmospheric light value corresponding to the R/G/B image data, the filtered dark primary color image, and the Bayer image data are subjected to comprehensive calculation processing to obtain Bayer image data with contrast enhancement.
区别于现有技术,本实施例通过底部、中部和顶部运行模块分别获取底部、中部和顶部的暗原色图像数据,再通过底部和顶部的区域积分得到滤波窗口内暗原色图像数据总和,综合计算处理,从而得到对比度提升后的Bayer图像数据。通过上述方式,在保证图像的对比度和细节信息的同时,简化中间处理过程,降低处理的延迟,完善了Bayer图像的处理过程。Different from the prior art, the bottom, middle and top running modules respectively obtain dark primary color image data of the bottom, middle and top, and then integrate the bottom and top regions to obtain the sum of the dark primary color image data in the filtering window, and comprehensively calculate Processing to obtain Bayer image data with improved contrast. In the above manner, while ensuring the contrast and detail information of the image, the intermediate processing process is simplified, the processing delay is reduced, and the processing process of the Bayer image is improved.
参阅图5,图5是本发明第一实施例改善Bayer图像对比度的装置结构示意图,主要包括:存储管理器1,用于实现双边滤波窗口内的Bayer图像行数据的缓存,存储管理器1按照传输方向依次包括:存储控制器18、仲裁管理器19;底部运行模块(图中未标出),用于获取Bayer图像数据中像素单元的底部暗原色图像数据,并根据所述底部暗原色图像数据计算得到左底区域BL和右底区域BR的积分值,底部运行模块按照传输方向依次包括:行缓冲管理模块2、色彩滤波阵列插值模块3、暗原色计算模块4和积分行管理模块5;顶部运行模块(图中未标出),用于获取Bayer图像数据中像素单元的顶部暗原色图像数据,并根据所述顶部暗原色图像数据计算得到左顶区域TL和右顶区域TR的积分值,顶部运行模块与底部运行模块结构相同,顶部运行模块按照传输方向依次包括:行缓冲管理模块14、色彩滤波阵列插值模块15、暗原色计算模块16和积分行管理模块17;中部运行模块(图中未标出),用于获取滤波窗口内中部所对应Bayer图像行所对应的暗原色图像数据;同时对Bayer图像行及暗原色图像行进行对齐处理;中部运行模块用于接收所述左底区域BL积分值、右底区域BR的积分值、左顶区域TL积分值和右顶区域TR积分值,综合BL、BR、TL、TR四个值,获得滤波窗口内暗原色图像数据总和,再经双边滤波计算处理后,得到滤波后的暗原色图像数据;中部运行模块包括:行缓冲管理模块6、色彩滤波阵列插值模块7、暗原色计算模块8、桶型移位器9、双边滤波计算模块10和统计分析计算模块。其中,统计分析计算模块包括统计模块11,分析模块12、计算模块13。底部运行模块、顶部运行模块和中部运行模块为并行模块,且均采用流水线结构。Referring to FIG. 5, FIG. 5 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a first embodiment of the present invention, which mainly includes: a storage manager 1 for buffering Bayer image line data in a bilateral filtering window, and the storage manager 1 follows The transmission direction includes: a storage controller 18, an arbitration manager 19, and a bottom operation module (not shown) for acquiring bottom dark primary image data of the pixel unit in the Bayer image data, and according to the bottom dark primary color image. The data is calculated to obtain the integrated values of the left bottom region BL and the right bottom region BR, and the bottom running module includes, in order of the transmission direction, a row buffer management module 2, a color filter array interpolation module 3, a dark primary color calculation module 4, and an integral row management module 5; a top running module (not shown) for acquiring top dark primary color image data of the pixel unit in the Bayer image data, and calculating an integral value of the left top region TL and the right top region TR according to the top dark primary color image data The top running module has the same structure as the bottom running module, and the top running module includes, in order of the transmission direction, a line buffer. The management module 14, the color filter array interpolation module 15, the dark primary color calculation module 16 and the integral row management module 17; the middle operation module (not shown) is used to obtain the dark corresponding to the Bayer image row corresponding to the middle portion of the filter window. Primary color image data; at the same time, the Bayer image line and the dark primary color image line are aligned; the middle running module is configured to receive the left bottom area BL integral value, the right bottom area BR integral value, the left top area TL integral value, and the right top The regional TR integral value is integrated into four values of BL, BR, TL, and TR, and the sum of the dark primary color image data in the filtering window is obtained, and then the filtered dark primary color image data is obtained after the bilateral filtering calculation processing; the middle running module includes: The buffer management module 6, the color filter array interpolation module 7, the dark primary color calculation module 8, the barrel shifter 9, the bilateral filter calculation module 10, and the statistical analysis calculation module. The statistical analysis calculation module includes a statistics module 11, an analysis module 12, and a calculation module 13. The bottom running module, the top running module and the middle running module are parallel modules, and both adopt a pipeline structure.
本实施例中,行缓冲管理模块(图中2、6、14)用于重排插值前的Bayer图像数据;色彩滤波阵列插值模块(图中3、7、15)用于Bayer图像数据插值计算,得到RGB图像;暗原色计算模块(图中4、8、16)通过选取RGB图像中的最小值为暗原色图像数据;积分行管理模块(图中5、17)用于实现滤波窗口中顶部和底部所对应的积分行的管理,并采用2个SRAM来更新与存储模拟暗原色图像行数据的积分值的;桶型移位器9用于指定Bayer图像数据传输的方向与位移;双边滤波计算模块10用于实现对暗原色图像数据的滤波和平滑处理,得到滤波后的暗原色图像;统计模块11用于将滤波后的暗原色图像进行直方图统计,得到R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值;分析模块12将R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值进行综合分析,得到增益值及R/G/B图像数据对应的大气光值;计算模块13根据Bayer图像数据得到的增益值及R/G/B图像数据对应的大气光值以及滤波后的暗原色图像、Bayer图像数据,综合计算处理得到对比度提升后的Bayer图像数据;存储控制器18用于对双边滤波窗口内的Bayer图像行数据的缓存;仲裁管理器19负责多个方向的Bayer图像行数据的读写管理。In this embodiment, the line buffer management module (2, 6, and 14 in the figure) is used to rearrange Bayer image data before interpolation; the color filter array interpolation module (3, 7, and 15 in the figure) is used for Bayer image data interpolation calculation. Obtain an RGB image; the dark primary color calculation module (4, 8, 16 in the figure) selects the minimum value in the RGB image as the dark primary image data; the integral row management module (5, 17 in the figure) is used to implement the top of the filtering window. Management of the integration line corresponding to the bottom, and using 2 SRAMs to update and store the integrated value of the simulated dark primary image line data; the barrel shifter 9 is used to specify the direction and displacement of the Bayer image data transmission; bilateral filtering The calculation module 10 is configured to implement filtering and smoothing processing on the dark primary color image data to obtain a filtered dark primary color image; the statistical module 11 is configured to perform histogram statistics on the filtered dark primary color image to obtain R/G/B image data. Cumulative histogram, dark primary image data histogram, dark primary image data cumulative total value; analysis module 12 accumulates R/G/B image data histogram, dark primary image data histogram, dark primary image number According to the cumulative total value, comprehensive analysis is performed to obtain the gain value and the atmospheric light value corresponding to the R/G/B image data; the gain value obtained by the calculation module 13 according to the Bayer image data and the atmospheric light value corresponding to the R/G/B image data and The filtered dark primary color image and the Bayer image data are integrated to obtain Bayer image data with contrast enhancement; the storage controller 18 is used for buffering Bayer image line data in the bilateral filtering window; the arbitration manager 19 is responsible for multiple directions. Bayer image line data read and write management.
在一个具体的实施例中,Bayer图像数据分别输入底部运行模块和存储管理器1,通过存储控制器18和仲裁管理器19将图像数据分时送入顶部运行模块和中部运行模块;Bayer图像数据中像素单元的底部、中部和顶部的暗原色图像数据依次经过行缓冲管理模块(图中2、6、14)、色彩滤波阵列插值模块(图中3、7、15)和暗原色计算模块(图中4、8、16)进行处理后,得到各自暗原色图像数据和RGB图像数据;顶部和底部的暗原色图像数据在经由积分行管理模块(图中5、17),实现滤波窗口中顶部和底部所对应的积分行的管理,得到左顶区域TL、右顶区域TR、左底区域BL和右底区域BR的积分值,并形成积分图;通过积分图、左顶区域TL、右顶区域TR、左底区域BL和右底区域BR的积分值经积分计算综合处理后得到滤波窗口内暗原色图像数据总和,将滤波窗口内暗原色图像数据总和经由双边滤波计算模块10双边滤波处理后,得到滤波后的暗原色图像数据;通过统计模块11,根据RGB图像数据和滤波后的暗原色图像进行直方图统计,得到R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值;通过分析模块12将R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值进行综合分析,得到增益值及R/G/B图像数据对应的大气光值;在计算模块13中利用Bayer图像数据得到的增益值及R/G/B图像数据对应的大气光值以及滤波后的暗原色图像、Bayer图像数据,综合计算处理得到对比度提升后的Bayer图像数据。In a specific embodiment, the Bayer image data is input to the bottom running module and the storage manager 1, respectively, and the image data is time-divisionally sent to the top running module and the middle running module through the storage controller 18 and the arbitration manager 19; Bayer image data The dark primary image data of the bottom, middle and top of the pixel unit passes through the line buffer management module (2, 6, 14 in the figure), the color filter array interpolation module (3, 7, 15 in the figure) and the dark primary color calculation module ( After processing 4, 8, and 16), the respective dark primary color image data and RGB image data are obtained; the top and bottom dark primary color image data are implemented in the filtering window via the integral row management module (Fig. 5, 17). And the management of the integral line corresponding to the bottom, the integral values of the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are obtained, and an integral map is formed; through the integral map, the left top region TL, the right top The integral values of the region TR, the left bottom region BL and the right bottom region BR are integrated and processed to obtain the sum of the dark primary color image data in the filtering window, and the dark primary color image in the filtering window is obtained. After the data summation is bilaterally filtered by the bilateral filtering calculation module 10, the filtered dark primary color image data is obtained; and the statistic module 11 performs histogram statistics based on the RGB image data and the filtered dark primary color image to obtain an R/G/B image. Data accumulation histogram, dark primary image data histogram, dark primary color image data cumulative total value; R/G/B image data accumulation histogram, dark primary color image data histogram, dark primary color image data cumulative total value by analysis module 12 Performing comprehensive analysis to obtain the gain value and the atmospheric light value corresponding to the R/G/B image data; the gain value obtained by using the Bayer image data in the calculation module 13 and the atmospheric light value corresponding to the R/G/B image data and the filtered The dark primary color image, the Bayer image data, and the comprehensive calculation process obtain the Bayer image data with the contrast enhancement.
在一实施例中,请参阅图6,图6是本发明第二实施例改善Bayer图像对比度的装置结构示意图,输入的图像数据格式为RGB图像,不需要做色彩滤波阵列插值处理(CFAI,Color Filter Array Interpolation )处理,可以去上述实施例中的掉色彩滤波阵列插值模块,直接获取RGB图像数据来进行后续处理,具体的装置结构与上述实施例类似,在此不再阐述。In an embodiment, please refer to FIG. 6. FIG. 6 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a second embodiment of the present invention. The input image data format is an RGB image, and color interpolation array interpolation processing is not required (CFAI, Color). Filter Array Interpolation For the processing, the color filter array interpolation module in the above embodiment can be used to directly obtain the RGB image data for subsequent processing. The specific device structure is similar to the above embodiment, and will not be described here.
在另一个具体的实施例中,请参阅图7,图7是本发明第三实施例改善Bayer图像对比度的装置结构示意图,输入的数据图像为YUV图像,输入时需要加入YUV格式向RGB格式转换器22,输出口需加入RGB格式向YUV格式转换器23,具体步骤与上述实施例类似,在此不再阐述。In another specific embodiment, please refer to FIG. 7. FIG. 7 is a schematic structural diagram of an apparatus for improving Bayer image contrast according to a third embodiment of the present invention. The input data image is a YUV image, and the YUV format needs to be converted to the RGB format when inputting. The output port of the device 22 needs to be added to the RGB format to the YUV format converter 23. The specific steps are similar to those of the above embodiment, and will not be described here.
该实现方法Bayer图像对比度提升的装置亦可扩展到RGB FHD (1920*1080)或UD(3840*2160)等解析率的实时图像处理,在此不作限定。The implementation of the Bayer image contrast enhancement device can also be extended to RGB FHD The real-time image processing of the resolution such as (1920*1080) or UD (3840*2160) is not limited herein.
区别于现有技术,本发明提出改善Bayer图像对比度的方法及装置,本发明的方法和装置采用流水线、数据并行处理结构,在保证图像的对比度和细节信息的同时,简化中间处理过程,降低处理的延迟,完善了Bayer图像的处理过程。进一步的,本发明的方法和装置将双边滤波所需的积分图转换为积分行方式进行管理,优化暗态图像,抑制过亮区域,完成图像整体的对比度的提升。Different from the prior art, the present invention provides a method and a device for improving the contrast of a Bayer image. The method and the device of the present invention adopt a pipeline and data parallel processing structure to simplify the intermediate processing process and reduce the processing while ensuring the contrast and detail information of the image. The delay has improved the processing of Bayer images. Further, the method and device of the present invention converts the integral map required for bilateral filtering into an integral line mode for management, optimizes the dark state image, suppresses the over-bright area, and improves the contrast of the entire image.
以上所述仅为本发明的实施方式,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Claims (16)

  1. 改善Bayer图像对比度的方法,其中,包括:A method for improving the contrast of a Bayer image, including:
    将当前Bayer图像数据进行插值处理,得到插值后的RGB图像数据;Interpolating current Bayer image data to obtain interpolated RGB image data;
    根据所述插值后的RGB图像数据,分别获取像素单元的底部、中部和顶部的暗原色图像数据;Obtaining dark primary color image data of the bottom, middle, and top of the pixel unit according to the interpolated RGB image data;
    将获取的暗原色图像数据分时管理,通过所述顶部的暗原色图像数据得到左顶区域TL和右顶区域TR的积分值,通过所述底部的暗原色图像数据得到左底区域BL和右底区域BR的积分值,并形成积分图;The acquired dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the dark primary color image data of the top, and the left bottom region BL and the right are obtained by the dark primary color image data of the bottom. The integral value of the bottom region BR and form an integral map;
    通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和,将所述滤波窗口内暗原色图像数据总和进行双边滤波处理,得到滤波后的暗原色图像数据;The integrated values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are integrated to obtain a sum of dark primary color image data in the filtered window. Performing bilateral filtering processing on the sum of the dark primary color image data in the filtering window to obtain filtered dark primary color image data;
    根据所述RGB图像数据和所述滤波后的暗原色图像进行直方图统计,得到R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值;Performing histogram statistics on the RGB image data and the filtered dark primary color image to obtain an R/G/B image data cumulative histogram, a dark primary color image data histogram, and a dark primary color image data cumulative total value;
    将所述R/G/B图像数据累积直方图、所述暗原色图像数据直方图、所述暗原色图像数据累积总值进行综合分析,得到增益值及R/G/B图像数据对应的大气光值;Integrating the R/G/B image data accumulation histogram, the dark primary color image data histogram, and the dark primary color image data cumulative total value to obtain a gain value and an atmosphere corresponding to the R/G/B image data. Light value
    利用Bayer图像数据得到的增益值及R/G/B图像数据对应的大气光值以及所述滤波后的暗原色图像、所述Bayer图像数据,综合计算处理得到对比度提升后的Bayer图像数据。The gain value obtained by the Bayer image data and the atmospheric light value corresponding to the R/G/B image data, the filtered dark primary color image, and the Bayer image data are integrated to obtain Bayer image data with contrast enhancement.
  2. 根据权利要求1所述的改善Bayer图像对比度的方法,其中,所述积分图采用积分行的方式实现。The method of improving Bayer image contrast according to claim 1, wherein said integral map is implemented by means of integrating lines.
  3. 根据权利要求1所述的改善Bayer图像对比度的方法,其中,所述通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和的步骤具体包括:The method of improving Bayer image contrast according to claim 1, wherein said passing through said integration map, said left top region TL, said right top region TR, said left bottom region BL, and said right bottom region The step of obtaining the sum of the dark primary color image data in the filtering window after the integral value of the BR is comprehensively processed includes:
    先合并所述左顶区域TL和所述右底区域BR的积分值,再减去所述右顶区域TR和所述左底区域BL的积分值,得到滤波窗口内暗原色图像数据总和。First, the integrated values of the left top region TL and the right bottom region BR are merged, and the integrated values of the right top region TR and the left bottom region BL are subtracted to obtain a sum of dark primary image data in the filtered window.
  4. 改善Bayer图像对比度的方法,其中,包括:A method for improving the contrast of a Bayer image, including:
    分别获取当前Bayer图像数据中像素单元的底部、中部和顶部的暗原色图像数据;Obtaining dark primary color image data of the bottom, middle, and top of the pixel unit in the current Bayer image data, respectively;
    将获取的暗原色图像数据分时管理,通过所述顶部的暗原色图像数据得到左顶区域TL和右顶区域TR的积分值,通过所述底部的暗原色图像数据得到左底区域BL和右底区域BR的积分值,并形成积分图;The acquired dark primary color image data is time-divisionally managed, and the integrated values of the left top region TL and the right top region TR are obtained by the dark primary color image data of the top, and the left bottom region BL and the right are obtained by the dark primary color image data of the bottom. The integral value of the bottom region BR and form an integral map;
    通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和,将所述滤波窗口内暗原色图像数据总和进行双边滤波处理,得到滤波后的暗原色图像数据;The integrated values of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR are integrated to obtain a sum of dark primary color image data in the filtered window. Performing bilateral filtering processing on the sum of the dark primary color image data in the filtering window to obtain filtered dark primary color image data;
    将所述滤波后的暗原色图像数据计算处理,得到对比度提升后的Bayer图像数据。The filtered dark primary color image data is calculated and processed to obtain Bayer image data with improved contrast.
  5. 根据权利要求4所述的改善Bayer图像对比度的方法,其中,所述积分图采用积分行的方式实现。The method of improving Bayer image contrast according to claim 4, wherein said integral map is implemented by means of integral lines.
  6. 根据权利要求4所述的改善Bayer图像对比度的方法,其中,所述通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和的步骤具体包括:The method of improving Bayer image contrast according to claim 4, wherein said passing through said integration map, said left top region TL, said right top region TR, said left bottom region BL, and said right bottom region The step of obtaining the sum of the dark primary color image data in the filtering window after the integral value of the BR is comprehensively processed includes:
    先合并所述左顶区域TL和所述右底区域BR的积分值,再减去所述右顶区域TR和所述左底区域BL的积分值,得到滤波窗口内暗原色图像数据总和。First, the integrated values of the left top region TL and the right bottom region BR are merged, and the integrated values of the right top region TR and the left bottom region BL are subtracted to obtain a sum of dark primary image data in the filtered window.
  7. 根据权利要求4所述的改善Bayer图像对比度的方法,其中,所述分别获取当前Bayer图像数据中像素单元的底部、中部和顶部的暗原色图像数据的具体步骤包括:The method for improving the contrast of a Bayer image according to claim 4, wherein the specific steps of respectively obtaining the dark primary color image data of the bottom, middle and top of the pixel unit in the current Bayer image data comprise:
    将当前Bayer图像数据进行插值处理,得到插值后的RGB图像数据;Interpolating current Bayer image data to obtain interpolated RGB image data;
    根据所述插值后的RGB图像数据,分别获取像素单元的底部、中部和顶部的暗原色图像数据。According to the interpolated RGB image data, dark primary color image data of the bottom, middle, and top of the pixel unit are respectively acquired.
  8. 根据权利要求4所述的改善Bayer图像对比度的方法,其中,所述将所述滤波后的暗原色图像数据计算处理,得到对比度提升后的Bayer图像数据的具体步骤包括:The method for improving the Bayer image contrast according to claim 4, wherein the step of calculating the filtered dark primary color image data to obtain the contrast-enhanced Bayer image data comprises:
    根据所述RGB图像数据和所述滤波后的暗原色图像进行直方图统计,得到R/G/B图像数据累积直方图、暗原色图像数据直方图、暗原色图像数据累积总值;Performing histogram statistics on the RGB image data and the filtered dark primary color image to obtain an R/G/B image data cumulative histogram, a dark primary color image data histogram, and a dark primary color image data cumulative total value;
    将所述R/G/B图像数据累积直方图、所述暗原色图像数据直方图、所述暗原色图像数据累积总值进行综合分析,得到增益值及R/G/B图像数据对应的大气光值;Integrating the R/G/B image data accumulation histogram, the dark primary color image data histogram, and the dark primary color image data cumulative total value to obtain a gain value and an atmosphere corresponding to the R/G/B image data. Light value
    利用Bayer图像数据得到的增益值及R/G/B图像数据对应的大气光值以及所述滤波后的暗原色图像、所述Bayer图像数据,综合计算处理得到对比度提升后的Bayer图像数据。The gain value obtained by the Bayer image data and the atmospheric light value corresponding to the R/G/B image data, the filtered dark primary color image, and the Bayer image data are integrated to obtain Bayer image data with contrast enhancement.
  9. 改善Bayer图像对比度的装置,其中,包括:A device for improving the contrast of a Bayer image, which includes:
    存储管理器,所述存储管理器用于实现双边滤波窗口内的Bayer图像行数据的缓存;a storage manager, configured to implement buffering of Bayer image line data in a bilateral filtering window;
    底部运行模块,所述底部运行模块用于获取Bayer图像数据中像素单元的底部暗原色图像数据,并根据所述底部暗原色图像数据计算得到左底区域BL和右底区域BR的积分值;a bottom running module, the bottom running module is configured to acquire bottom dark primary color image data of the pixel unit in the Bayer image data, and calculate an integrated value of the left bottom region BL and the right bottom region BR according to the bottom dark primary color image data;
    顶部运行模块,所述顶部运行模块用于获取Bayer图像数据中像素单元的顶部暗原色图像数据,并根据所述顶部暗原色图像数据计算得到左顶区域TL和右顶区域TR的积分值;a top running module, configured to acquire top dark primary color image data of the pixel unit in the Bayer image data, and calculate an integrated value of the left top region TL and the right top region TR according to the top dark primary color image data;
    中部运行模块,所述中部运行模块用于形成积分图,通过所述积分图、所述左顶区域TL、所述右顶区域TR、所述左底区域BL和所述右底区域BR的积分值经综合处理后得到滤波窗口内暗原色图像数据总和,将所述滤波窗口内暗原色图像数据总和进行双边滤波处理,得到滤波后的暗原色图像数据,使用所述滤波后的暗原色图像数据具进行计算处理,得到对比度提升后的Bayer图像数据。a middle running module, the middle running module is configured to form an integral map, and the integral of the integral map, the left top region TL, the right top region TR, the left bottom region BL, and the right bottom region BR After the values are comprehensively processed, the sum of the dark primary color image data in the filtering window is obtained, and the sum of the dark primary color image data in the filtering window is bilaterally processed to obtain the filtered dark primary color image data, and the filtered dark primary color image data is used. With calculation processing, Bayer image data with contrast enhancement is obtained.
  10. 根据权利要求9所述的改善Bayer图像对比度的装置,其中:所述底部运行模块包括:The apparatus for improving the contrast of a Bayer image according to claim 9, wherein: said bottom running module comprises:
    行缓冲管理模块;用于重排插值前的Bayer图像数据色彩滤波阵列插值模块;Line buffer management module; Bayer image data color filter array interpolation module for rearranging interpolation;
    暗原色计算模块,通过选取RGB图像中的最小值为暗原色图像数据;a dark primary color calculation module, which selects dark primary color image data by selecting a minimum value in the RGB image;
    积分行管理模块,用于实现滤波窗口中顶部和底部所对应的积分行的管理;a line management module for implementing management of the integral line corresponding to the top and bottom of the filtering window;
    所述顶部运行模块与所述底部运行模块结构相同。The top running module has the same structure as the bottom running module.
  11. 根据权利要求9所述的改善Bayer图像对比度的装置,其中:所述中部运行模块包括:The apparatus for improving the contrast of a Bayer image according to claim 9, wherein: said central running module comprises:
    行缓冲管理模块、用于重排插值前的Bayer图像数据色彩滤波阵列插值模块;a line buffer management module, a Bayer image data color filter array interpolation module for rearranging interpolation;
    色彩滤波阵列插值模块,用于Bayer图像数据插值计算,得到RGB图像;Color filter array interpolation module for Bayer image data interpolation calculation to obtain RGB images;
    暗原色计算模块,通过选取RGB图像中的最小值为暗原色图像数据;a dark primary color calculation module, which selects dark primary color image data by selecting a minimum value in the RGB image;
    桶型移位器,用于指定Bayer图像数据传输的方向与位移;a barrel shifter for specifying the direction and displacement of Bayer image data transmission;
    双边滤波计算模块,用于实现对暗原色图像数据的滤波和平滑处理,得到滤波后的暗原色图像;The bilateral filtering calculation module is configured to implement filtering and smoothing processing on the dark primary color image data to obtain a filtered dark primary color image;
    统计分析计算模块,所述计算模块用于综合分析处理所述暗原色图像数据、所述滤波后的暗原色图像数据,计算后得到对比度提升后的Bayer图像数据。The statistical analysis calculation module is configured to comprehensively analyze and process the dark primary color image data and the filtered dark primary color image data, and obtain Bayer image data with contrast enhancement after calculation.
  12. 根据权利要求9所述的改善Bayer图像对比度的装置,其中,所述底部运行模块、顶部运行模块和中部运行模块为并行模块。The apparatus for improving Bayer image contrast according to claim 9, wherein the bottom running module, the top running module, and the middle running module are parallel modules.
  13. 根据权利要求9所述的改善Bayer图像对比度的装置,其中,所述存储管理器包括:The apparatus for improving Bayer image contrast according to claim 9, wherein said storage manager comprises:
    存储控制器,所述存储控制器对双边滤波窗口内的Bayer图像行数据的缓存;a storage controller that caches Bayer image line data in a bilateral filtering window;
    仲裁管理器,所述仲裁管理器负责多个方向的Bayer图像行数据的读写管理。The arbitration manager is responsible for reading and writing management of Bayer image line data in multiple directions.
  14. 根据权利要求11所述的改善Bayer图像对比度的装置,其中,所述双边滤波计算模块通过先合并所述左顶区域TL和所述右底区域BR的积分值,再减去所述右顶区域TR和所述左底区域BL的积分值,得到滤波窗口内暗原色图像数据总和。The apparatus for improving contrast of a Bayer image according to claim 11, wherein said bilateral filtering calculation module subtracts said right top region by first combining the integrated values of said left top region TL and said right bottom region BR The integrated value of TR and the left bottom region BL is obtained as a sum of dark primary image data in the filter window.
  15. 根据权利要求11所述的改善Bayer图像对比度的装置,其中,所述暗原色计算模块根据所述插值后的RGB图像数据,分别获取像素单元的底部、中部和顶部的暗原色图像数据。The apparatus for improving Bayer image contrast according to claim 11, wherein the dark primary color calculation module acquires dark primary color image data of the bottom, middle, and top of the pixel unit according to the interpolated RGB image data.
  16. 根据权利要求10所述的改善Bayer图像对比度的装置,其中,所述积分行管理模块采用2个静态存储器来更新与存储模拟暗原色图像行数据的积分值的。 The apparatus for improving Bayer image contrast according to claim 10, wherein said integral line management module uses two static memories to update and store the integrated value of the simulated dark primary image line data.
PCT/CN2017/117315 2017-11-07 2017-12-20 Method and device for improving contrast of bayer image WO2019090909A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711096682.0 2017-11-07
CN201711096682.0A CN107886482B (en) 2017-11-07 2017-11-07 Method and device for improving Bayer image contrast

Publications (1)

Publication Number Publication Date
WO2019090909A1 true WO2019090909A1 (en) 2019-05-16

Family

ID=61779582

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/117315 WO2019090909A1 (en) 2017-11-07 2017-12-20 Method and device for improving contrast of bayer image

Country Status (2)

Country Link
CN (1) CN107886482B (en)
WO (1) WO2019090909A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101848343A (en) * 2009-03-24 2010-09-29 财团法人工业技术研究院 Image sensor with integral image output
US20120328160A1 (en) * 2011-06-27 2012-12-27 Office of Research Cooperation Foundation of Yeungnam University Method for detecting and recognizing objects of an image using haar-like features
CN102938136A (en) * 2012-07-19 2013-02-20 中国人民解放军国防科学技术大学 Method for defogging single images based on Bayer formats rapidly
US20140267351A1 (en) * 2013-03-14 2014-09-18 Microsoft Corporation Monochromatic edge geometry reconstruction through achromatic guidance
CN105991937A (en) * 2015-03-04 2016-10-05 深圳市朗驰欣创科技有限公司 Virtual exposure method and device based on Bayer format image
CN106657948A (en) * 2017-01-18 2017-05-10 聚龙智瞳科技有限公司 low illumination level Bayer image enhancing method and enhancing device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8958009B2 (en) * 2010-01-12 2015-02-17 Nikon Corporation Image-capturing device
US8160380B2 (en) * 2010-07-08 2012-04-17 Seiko Epson Corporation Bi-affinity filter: A bilateral type filter for color images
CN106504281B (en) * 2016-12-02 2019-01-22 中国电子科技集团公司第四十四研究所 Image quality enhancing and filtering method applied to cmos image sensor
CN106875358A (en) * 2017-02-09 2017-06-20 聚龙智瞳科技有限公司 Image enchancing method and image intensifier device based on Bayer format

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101848343A (en) * 2009-03-24 2010-09-29 财团法人工业技术研究院 Image sensor with integral image output
US20120328160A1 (en) * 2011-06-27 2012-12-27 Office of Research Cooperation Foundation of Yeungnam University Method for detecting and recognizing objects of an image using haar-like features
CN102938136A (en) * 2012-07-19 2013-02-20 中国人民解放军国防科学技术大学 Method for defogging single images based on Bayer formats rapidly
US20140267351A1 (en) * 2013-03-14 2014-09-18 Microsoft Corporation Monochromatic edge geometry reconstruction through achromatic guidance
CN105991937A (en) * 2015-03-04 2016-10-05 深圳市朗驰欣创科技有限公司 Virtual exposure method and device based on Bayer format image
CN106657948A (en) * 2017-01-18 2017-05-10 聚龙智瞳科技有限公司 low illumination level Bayer image enhancing method and enhancing device

Also Published As

Publication number Publication date
CN107886482A (en) 2018-04-06
CN107886482B (en) 2020-06-05

Similar Documents

Publication Publication Date Title
WO2021164234A1 (en) Image processing method and image processing device
WO2016068560A1 (en) Translucent mark, method for synthesis and detection of translucent mark, transparent mark, and method for synthesis and detection of transparent mark
WO2013103184A1 (en) Apparatus and method for improving image using color channels
DE69913560T2 (en) VERY FASTER PICTURES
CN107967668A (en) A kind of image processing method and device
CN111383200B (en) CFA image demosaicing method based on generated antagonistic neural network
WO2019056549A1 (en) Image enhancement method, and image processing device
CN1655588A (en) Method for compensating bad dots on digital images
CN107203966A (en) A kind of coloured image synthetic method and device
CN115064117A (en) Virtual pixel display screen brightness correction method, system and device and display system
WO2017080206A1 (en) Video panorama generation method and parallel computing system
WO2016148516A1 (en) Image compression method and image compression apparatus
WO2019090909A1 (en) Method and device for improving contrast of bayer image
WO2021132824A1 (en) Method for displaying three-dimensional image in integrated imaging microscope system, and integrated imaging microscope system for implementing same
CN106303527B (en) Video hierarchical code stream coding method and system of time division multiplexing neural network processor
CN111541886A (en) Vision enhancement system applied to muddy underwater
CN110675386A (en) Detection system of B-group streptococcus
WO2017086522A1 (en) Method for synthesizing chroma key image without requiring background screen
CN101729884B (en) Image acquiring device and image preprocessing method
TWM458747U (en) Image processing module
CN113012074B (en) Intelligent image processing method suitable for low-illumination environment
KR100930483B1 (en) Video Format Converter
CN113365035B (en) Calibration system for image color restoration
CN114549358A (en) Low-illumination image enhancement method and system based on camera characteristics of guided filtering
US20050063587A1 (en) Presentation supporting system and image processing method for the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17931599

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17931599

Country of ref document: EP

Kind code of ref document: A1