CN103220476B - Image processing apparatus and method - Google Patents

Image processing apparatus and method Download PDF

Info

Publication number
CN103220476B
CN103220476B CN201210019091.4A CN201210019091A CN103220476B CN 103220476 B CN103220476 B CN 103220476B CN 201210019091 A CN201210019091 A CN 201210019091A CN 103220476 B CN103220476 B CN 103220476B
Authority
CN
China
Prior art keywords
sub
pixel data
white balance
image processing
well capacity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201210019091.4A
Other languages
Chinese (zh)
Other versions
CN103220476A (en
Inventor
徐纬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Novatek Microelectronics Corp
Original Assignee
Novatek Microelectronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Novatek Microelectronics Corp filed Critical Novatek Microelectronics Corp
Priority to CN201210019091.4A priority Critical patent/CN103220476B/en
Publication of CN103220476A publication Critical patent/CN103220476A/en
Application granted granted Critical
Publication of CN103220476B publication Critical patent/CN103220476B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Color Television Image Signal Generators (AREA)
  • Processing Of Color Television Signals (AREA)

Abstract

An image processing device and method, the image processing device includes a sampling unit, an amplifier, an analog-digital converter and a white balance unit. The sampling unit is used for sampling a pixel to obtain a pixel voltage. The amplifier is used for amplifying the pixel voltage according to an analog gain. The analog-to-digital converter is used for converting the amplified pixel voltage into digital pixel data, and the digital pixel data comprises a plurality of first sub-pixel data corresponding to different colors. The white balance unit is used for respectively carrying out white balance compensation on the first sub-pixel data according to the analog gain and a plurality of white balance gains corresponding to different sub-pixels to obtain a plurality of second sub-pixel data.

Description

图像处理装置及方法Image processing device and method

技术领域 technical field

本发明涉及一种图像处理装置及方法。The invention relates to an image processing device and method.

背景技术 Background technique

现有感光元件包括电荷耦合元件(chargecoupleddevice,CCD)及互补式金属氧化物半导体(complementarymetaloxidesemiconductor,CMOS)两类型。由于感光元件的饱和电位(最大阱容)通常会设计在模拟数字转换器的工作范围内,所以当模拟数字转换器采用最小模拟增益时,饱和区会箝位在工作范围内。像素数据经过数字图像处理通常会导致高亮度色偏或是高亮度噪声。一般应用会给予较大的模拟增益值以让饱和区箝位在超过模拟数字转换器的工作范围之上,故可以避免产生图像瑕疵问题,但较大的增益值会牺牲动态范围并增加整体噪声。Existing photosensitive elements include two types: charge coupled device (CCD) and complementary metal oxide semiconductor (complementary metal oxide semiconductor, CMOS). Since the saturation potential (maximum well capacity) of the photosensitive element is usually designed within the working range of the analog-digital converter, when the analog-digital converter adopts the minimum analog gain, the saturation region will be clamped within the working range. Digital image processing of pixel data often results in high luminance color cast or high luminance noise. In general applications, a larger analog gain value is given to clamp the saturation region above the working range of the analog-to-digital converter, so that image artifacts can be avoided, but a larger gain value will sacrifice dynamic range and increase overall noise .

发明内容 Contents of the invention

本公开涉及一种图像处理装置及方法,可以改善图像的动态范围。The disclosure relates to an image processing device and method, which can improve the dynamic range of an image.

根据本公开的第一方面,提出一种图像处理装置,包括一采样单元、一放大器、一模拟数字转换器以及一白平衡单元。采样单元用以对一像素采样得到一像素电压。放大器用以依据一模拟增益放大像素电压。模拟数字转换器用以转换放大后的像素电压为一数字像素数据,数字像素数据包括对应到不同颜色的多个第一子像素数据。白平衡单元用以依据模拟增益与对应至不同子像素的多个白平衡增益,分别对此些第一子像素数据进行白平衡补偿得到多个第二子像素数据。According to a first aspect of the present disclosure, an image processing device is provided, including a sampling unit, an amplifier, an analog-to-digital converter, and a white balance unit. The sampling unit is used for sampling a pixel to obtain a pixel voltage. The amplifier is used for amplifying the pixel voltage according to an analog gain. The analog-to-digital converter is used to convert the amplified pixel voltage into digital pixel data, and the digital pixel data includes a plurality of first sub-pixel data corresponding to different colors. The white balance unit is used for respectively performing white balance compensation on the first sub-pixel data according to the analog gain and a plurality of white balance gains corresponding to different sub-pixels to obtain a plurality of second sub-pixel data.

根据本公开的第二方面,提出一种图像处理方法,包括下列步骤。对一像素采样得到一像素电压。依据一模拟增益放大像素电压。转换放大后的像素电压为一数字像素数据,数字像素数据包括对应到不同颜色的多个第一子像素数据。依据模拟增益与对应至不同子像素的多个白平衡增益,分别对此些第一子像素数据进行白平衡补偿得到多个第二子像素数据。According to a second aspect of the present disclosure, an image processing method is provided, including the following steps. A pixel voltage is obtained by sampling a pixel. The pixel voltage is amplified according to an analog gain. The amplified pixel voltage is converted into digital pixel data, and the digital pixel data includes a plurality of first sub-pixel data corresponding to different colors. According to the analog gain and a plurality of white balance gains corresponding to different sub-pixels, white balance compensation is performed on the first sub-pixel data respectively to obtain a plurality of second sub-pixel data.

为了对本公开的上述及其他方面有更佳的了解,下文特举一实施例,并配合附图,作详细说明如下:In order to have a better understanding of the above-mentioned and other aspects of the present disclosure, an embodiment is given below, together with the accompanying drawings, for detailed description as follows:

附图说明 Description of drawings

图1绘示依照一实施范例的图像处理装置的方块图。FIG. 1 is a block diagram of an image processing device according to an embodiment.

图2绘示依照一实施范例的白平衡单元的曝光扩展的流程图。FIG. 2 illustrates a flowchart of exposure expansion of a white balance unit according to an embodiment.

图3绘示依照一实施范例的第二子像素数据对曝光时间/感光度的示意图。FIG. 3 is a schematic diagram of second sub-pixel data versus exposure time/sensitivity according to an embodiment.

【主要元件符号说明】[Description of main component symbols]

100:图像处理装置100: image processing device

105:自动曝光单元105: Automatic Exposure Unit

110:采样单元110: sampling unit

120:放大器120: Amplifier

130:模拟数字转换器130: Analog-to-Digital Converter

140:黑色校准单元140: Black calibration unit

150:自动白平衡单元150: Automatic white balance unit

150:白平衡单元150: White balance unit

170:色彩内插单元170: Color interpolation unit

具体实施方式 detailed description

本公开所提出的图像处理装置及方法,可以改善图像的动态范围,并兼顾噪声较小的应用。The image processing device and method proposed in the present disclosure can improve the dynamic range of the image and take into account applications with less noise.

本公开提出一种图像处理装置,包括一采样单元、一放大器、一模拟数字转换器以及一白平衡单元。采样单元对一像素采样得到一像素电压。放大器依据一模拟增益放大像素电压。模拟数字转换器转换放大后的像素电压为一数字像素数据,数字像素数据包括对应到不同颜色的多个第一子像素数据。白平衡单元依据模拟增益与对应至不同子像素的多个白平衡增益,分别对此些第一子像素数据进行白平衡补偿得到多个第二子像素数据。The disclosure proposes an image processing device, including a sampling unit, an amplifier, an analog-to-digital converter, and a white balance unit. The sampling unit samples a pixel to obtain a pixel voltage. The amplifier amplifies the pixel voltage according to an analog gain. The analog-to-digital converter converts the amplified pixel voltage into digital pixel data, and the digital pixel data includes a plurality of first sub-pixel data corresponding to different colors. The white balance unit respectively performs white balance compensation on the first sub-pixel data according to the analog gain and a plurality of white balance gains corresponding to different sub-pixels to obtain a plurality of second sub-pixel data.

此外,白平衡单元于产生这些第二子像素数据的过程中,可以先依据这些第一子像素数据与这些白平衡增益,以产生多个第三子像素数据,继而依据模拟增益与像素的一最大阱容(fullwelllevel),判断是否箝位(clamp,又称之为“夹止”)此些第三子像素数据,以产生第二子像素数据。In addition, in the process of generating the second sub-pixel data, the white balance unit can generate a plurality of third sub-pixel data according to the first sub-pixel data and the white balance gains, and then according to the analog gain and a pixel The maximum well capacity (fullwell level) determines whether to clamp (clamp, also referred to as “clamping”) the third sub-pixel data to generate the second sub-pixel data.

请参照图1,其绘示依照一实施范例的图像处理装置的方块图。图像处理装置100包括一自动曝光(autoexposure,AE)单元105、一采样单元110、一放大器120、一模拟数字转换器130、一黑色校准(DigitalBlackLevelCalibration,DBLC)单元140、一自动白平衡(autowhitebalance,AWB)单元150、一白平衡单元160以及一色彩内插(CFAinterpolation)单元170。其中,采样单元110、放大器120以及模拟数字转换器130例如被整合于一图像传感器(imagesensor)中,而此图像传感器可还包括或对外耦接至一感光元件,譬如是电荷耦合元件(CCD,Charge-coupledDevice)或互补式金属氧化物半导体(complementarymetaloxidesemiconductor,CMOS),以提供采样单元110所需的图像输入信号。另外,黑色校准单元140、白平衡单元160以及色彩内插单元170例如被整合于一图像处理器中,但并不限制。另外,此图像处理器可还包括色彩校正单元、伽玛校正(GammaCorrection)单元以及图像增强(ImageEnhancement,又称之为“增显”)单元。Please refer to FIG. 1 , which shows a block diagram of an image processing device according to an embodiment. The image processing device 100 includes an automatic exposure (autoexposure, AE) unit 105, a sampling unit 110, an amplifier 120, an analog-to-digital converter 130, a black calibration (DigitalBlackLevelCalibration, DBLC) unit 140, an automatic white balance (autowhitebalance, AWB) unit 150 , a white balance unit 160 and a color interpolation (CFA interpolation) unit 170 . Wherein, the sampling unit 110, the amplifier 120 and the analog-to-digital converter 130 are, for example, integrated in an image sensor (image sensor), and the image sensor may also include or be externally coupled to a photosensitive element, such as a charge-coupled device (CCD, Charge-coupled Device) or complementary metal oxide semiconductor (complementary metal oxide semiconductor, CMOS) to provide the image input signal required by the sampling unit 110 . In addition, the black calibration unit 140 , the white balance unit 160 and the color interpolation unit 170 are, for example, integrated in an image processor, but not limited thereto. In addition, the image processor may further include a color correction unit, a gamma correction (GammaCorrection) unit, and an image enhancement (Image Enhancement, also referred to as “enhancement”) unit.

自动曝光单元105控制采样单元110以对一像素采样得到一像素电压。自动曝光单元105并提供一模拟增益Analog_Gain至放大器120,使得放大器120依据模拟增益Analog_Gain放大像素电压。模拟数字转换器130转换放大后的像素电压为一数字像素数据,此数字像素数据包括对应到不同颜色的多个第一子像素数据,例如红色子像素数据R、绿色子像素数据Gr/Gb及蓝色子像素数据B等。The automatic exposure unit 105 controls the sampling unit 110 to sample a pixel to obtain a pixel voltage. The automatic exposure unit 105 also provides an analog gain Analog_Gain to the amplifier 120 so that the amplifier 120 amplifies the pixel voltage according to the analog gain Analog_Gain. The analog-to-digital converter 130 converts the amplified pixel voltage into digital pixel data, which includes a plurality of first sub-pixel data corresponding to different colors, such as red sub-pixel data R, green sub-pixel data Gr/Gb and Blue sub-pixel data B, etc.

黑色校准单元140耦接于数字模拟转换器130与白平衡单元160之间,其对数字像素数据进行黑色校准。The black calibration unit 140 is coupled between the digital-to-analog converter 130 and the white balance unit 160 , and performs black calibration on the digital pixel data.

自动曝光单元105提供模拟增益Analog_Gain至白平衡单元160;同时,自动白平衡单元150亦提供对应至不同子像素的多个白平衡增益WB_Gains至白平衡单元160,此多个白平衡增益WB_Gains例如包括对应红色子像素数据R的白平衡增益WB_R_Gain、对应绿色子像素数据Gr/Gb的白平衡增益WB_Gr_Gain/WB_Gb_Gain及对应蓝色子像素数据B的白平衡增益WB_B_Gain等。白平衡单元160依据自动曝光单元105所提供的模拟增益Analog_Gain与自动白平衡单元150所提供的多个白平衡增益WB_Gains,分别对此些第一子像素数据进行白平衡补偿得到多个第二子像素数据,并提供给白平衡单元160包括这些第二子像素数据的一原始图像(RAWimage)数据。色彩内插单元170对白平衡单元160所输出的原始图像数据进行内插以得到一三原色图像(RGBimage)数据。The automatic exposure unit 105 provides the analog gain Analog_Gain to the white balance unit 160; meanwhile, the automatic white balance unit 150 also provides multiple white balance gains WB_Gains corresponding to different sub-pixels to the white balance unit 160. The multiple white balance gains WB_Gains include, for example The white balance gain WB_R_Gain corresponding to the red sub-pixel data R, the white balance gain WB_Gr_Gain/WB_Gb_Gain corresponding to the green sub-pixel data Gr/Gb, the white balance gain WB_B_Gain corresponding to the blue sub-pixel data B, and the like. According to the analog gain Analog_Gain provided by the automatic exposure unit 105 and the multiple white balance gains WB_Gains provided by the automatic white balance unit 150, the white balance unit 160 respectively performs white balance compensation on the first sub-pixel data to obtain a plurality of second sub-pixel data. pixel data, and provide a raw image (RAWimage) data including the second sub-pixel data to the white balance unit 160 . The color interpolation unit 170 interpolates the original image data output by the white balance unit 160 to obtain a three primary color image (RGB image) data.

请参照图2,其绘示依照一实施范例的白平衡单元的曝光扩展的流程图,其可应用于图1所示的白平衡单元160所进行的白平衡补偿操作中。在步骤S200中,白平衡单元160依据此些第一子像素数据与对应的此些白平衡增益WB_Gains得到多个第三子像素数据。较佳地,白平衡单元160分别计算此白平衡增益WB_Gains与此些第一子像素数据的乘积以作为此些第三子像素数据。例如,红色子像素数据R与白平衡增益WB_R_Gain的乘积为第三子像素数据R’、绿色子像素数据Gr/Gb与白平衡增益WB_Gr_Gain/WB_Gb_Gain的乘积为第三子像素数据Gr’/Gb’、及蓝色子像素数据B与白平衡增益WB_B_Gain的乘积为第三子像素数据B’。Please refer to FIG. 2 , which shows a flow chart of the exposure expansion of the white balance unit according to an embodiment, which can be applied to the white balance compensation operation performed by the white balance unit 160 shown in FIG. 1 . In step S200 , the white balance unit 160 obtains a plurality of third sub-pixel data according to the first sub-pixel data and the corresponding white balance gains WB_Gains. Preferably, the white balance unit 160 respectively calculates the product of the white balance gain WB_Gains and the first sub-pixel data as the third sub-pixel data. For example, the product of the red sub-pixel data R and the white balance gain WB_R_Gain is the third sub-pixel data R', the product of the green sub-pixel data Gr/Gb and the white balance gain WB_Gr_Gain/WB_Gb_Gain is the third sub-pixel data Gr'/Gb' , and the product of the blue sub-pixel data B and the white balance gain WB_B_Gain is the third sub-pixel data B′.

在步骤S210中,白平衡单元160判断此像素的一最大阱容(fullwelllevel)是否在模拟增益Analog_Gain对应的一范围内,此范围由模拟增益Analog_Gain与模拟数字转换器130的位数定义而得,例如此范围为模拟增益Analog_Gain为1倍时的数字像素数据与n位的模拟数字转换器130可转换的最大数字像素数据2n之间的范围。当最大阱容不在范围内,流程结束。换句话说,白平衡单元160不箝位此些第三子像素数据,并输出此些第三子像素数据作为此些第二子像素数据。In step S210, the white balance unit 160 determines whether a maximum well level of the pixel is within a range corresponding to the analog gain Analog_Gain, and the range is defined by the analog gain Analog_Gain and the number of bits of the analog-to-digital converter 130, For example, this range is the range between the digital pixel data when the analog gain Analog_Gain is 1 and the maximum digital pixel data 2n that can be converted by the n-bit ADC 130 . When the maximum well capacity is not within the range, the process ends. In other words, the white balance unit 160 does not clamp the third sub-pixel data, and outputs the third sub-pixel data as the second sub-pixel data.

然而,当最大阱容在范围内,则循序进行步骤S220与S230。在步骤220中,白平衡单元160可依据最大阱容与模拟增益Analog_Gain计算一当前最大阱容。较佳地,白平衡单元160可计算模拟增益Analog_Gain与最大阱容的乘积作为当前最大阱容。更进一步地,白平衡单元160会限制当前最大阱容不大于2n-1,n为像素的位数。换句话说,如果模拟增益Analog_Gain与最大阱容的乘积大于2n-1时,可设定当前最大阱容实质上等于2n-1However, when the maximum well capacity is within the range, steps S220 and S230 are performed sequentially. In step 220 , the white balance unit 160 can calculate a current maximum well capacity according to the maximum well capacity and the analog gain Analog_Gain. Preferably, the white balance unit 160 can calculate the product of the analog gain Analog_Gain and the maximum well capacity as the current maximum well capacity. Furthermore, the white balance unit 160 will limit the current maximum well capacity to no more than 2 n-1 , where n is the number of bits of a pixel. In other words, if the product of the analog gain Analog_Gain and the maximum well capacity is greater than 2 n-1 , the current maximum well capacity can be set to be substantially equal to 2 n-1 .

接下来,在步骤S230中,白平衡单元160将此些第三子像素数据与当前最大阱容进行比较,以分别判断此些第三子像素数据是否大于当前最大阱容。当判断结果为否时,流程结束,亦即白平衡单元160不箝位未大于当前最大阱容的第三子像素数据,并输出第三子像素数据作为对应的第二子像素数据。反之,当判断结果为是时,在步骤S240中,白平衡单元160箝位大于当前最大阱容的第三子像素数据,譬如可以输出当前最大阱容作为对应的第二子像素数据。Next, in step S230 , the white balance unit 160 compares the third sub-pixel data with the current maximum well capacity to determine whether the third sub-pixel data are greater than the current maximum well capacity. When the judgment result is no, the process ends, that is, the white balance unit 160 does not clamp the third sub-pixel data not larger than the current maximum well capacity, and outputs the third sub-pixel data as the corresponding second sub-pixel data. On the contrary, when the judgment result is yes, in step S240 , the white balance unit 160 clamps the third sub-pixel data larger than the current maximum well capacity, for example, may output the current maximum well capacity as the corresponding second sub-pixel data.

更具体而言,当第三子像素数据R’大于当前最大阱容,则可设定对应的第二子像素数据等于当前最大阱容;反之,当第三子像素数据R’未大于当前最大阱容,则可设定对应的第二子像素数据等于第三子像素数据R’。类似地,当三子像素数据Gr’/Gb’大于当前最大阱容,则可设定对应的第二子像素数据等于当前最大阱容;反之,当第三子像素数据Gr’/Gb’未大于当前最大阱容,则可设定对应的第二子像素数据等于第三子像素数据Gr’/Gb’。类似地,当第三子像素数据B’大于当前最大阱容,则可设定对应的第二子像素数据等于当前最大阱容;反之,当第三子像素数据B’未大于当前最大阱容,则可设定对应的第二子像素数据等于第三子像素数据B’。More specifically, when the third sub-pixel data R' is greater than the current maximum well capacity, the corresponding second sub-pixel data can be set equal to the current maximum well capacity; otherwise, when the third sub-pixel data R' is not greater than the current maximum well capacity Well capacity, the corresponding second sub-pixel data can be set equal to the third sub-pixel data R′. Similarly, when the three sub-pixel data Gr'/Gb' is greater than the current maximum well capacity, the corresponding second sub-pixel data can be set equal to the current maximum well capacity; otherwise, when the third sub-pixel data Gr'/Gb' is not If it is larger than the current maximum well capacity, the corresponding second sub-pixel data can be set to be equal to the third sub-pixel data Gr'/Gb'. Similarly, when the third sub-pixel data B' is greater than the current maximum well capacity, the corresponding second sub-pixel data can be set equal to the current maximum well capacity; otherwise, when the third sub-pixel data B' is not greater than the current maximum well capacity , then the corresponding second sub-pixel data can be set equal to the third sub-pixel data B′.

综上所述,在本实施例中第二子像素数据会箝位于当前最大阱容。请参照图3,其绘示依照一实施范例的第二子像素数据对曝光时间/感光度的示意图。由图3中可以得知,在图像处理装置提高感光度(亦即增加模拟增益Analog_Gain)的情况下,第二子像素数据会箝位于当前最大阱容,所以不会因为较大的模拟增益Analog_Gain而产生高亮度色偏或是高亮度噪声。To sum up, in this embodiment, the second sub-pixel data will be clamped at the current maximum well capacity. Please refer to FIG. 3 , which shows a schematic diagram of second sub-pixel data versus exposure time/sensitivity according to an embodiment. It can be seen from FIG. 3 that when the image processing device increases the sensitivity (that is, increases the analog gain Analog_Gain), the second sub-pixel data will be clamped at the current maximum well capacity, so it will not be affected by the larger analog gain Analog_Gain. Therefore, high-brightness color shift or high-brightness noise is generated.

本公开还提出一种图像处理方法,包括下列步骤。对一像素采样得到一像素电压。依据一模拟增益放大像素电压。转换放大后的像素电压为一数字像素数据,数字像素数据包括对应到不同颜色的多个第一子像素数据。依据模拟增益与对应至不同子像素的多个白平衡增益,分别对此些第一子像素数据进行白平衡补偿得到多个第二子像素数据。此图像处理方法的运作原理已详述图像处理装置100及其相关操作的内容中,故在此不再重述。The present disclosure also proposes an image processing method, including the following steps. A pixel voltage is obtained by sampling a pixel. The pixel voltage is amplified according to an analog gain. The amplified pixel voltage is converted into digital pixel data, and the digital pixel data includes a plurality of first sub-pixel data corresponding to different colors. According to the analog gain and a plurality of white balance gains corresponding to different sub-pixels, white balance compensation is performed on the first sub-pixel data respectively to obtain a plurality of second sub-pixel data. The operating principle of the image processing method has been described in detail in the content of the image processing device 100 and its related operations, so it will not be repeated here.

本公开上述实施例所公开的图像处理装置及方法,依据模拟增益与白平衡增益以对像素数据进行白平衡补偿,其中还可利用对于当前最大阱容与像素数据的比较以有效箝位像素数据。因此,上述实施例可改善亮度色偏及高亮度噪声的现象,故可以增加图像的动态范围,并兼顾噪声较小的应用,提升整体图像质量。The image processing device and method disclosed in the above-mentioned embodiments of the present disclosure perform white balance compensation on the pixel data according to the analog gain and the white balance gain, and the comparison between the current maximum well capacity and the pixel data can also be used to effectively clamp the pixel data . Therefore, the above-mentioned embodiments can improve the phenomenon of luminance color shift and high luminance noise, so the dynamic range of the image can be increased, and the application with less noise can be considered to improve the overall image quality.

综上所述,虽然本发明已以多个实施例公开如上,然其并非用以限定本发明。本领域技术人员在不脱离本发明的精神和范围内,当可作各种的更动与润饰。因此,本发明的保护范围当视所附权利要求书所界定者为准。In summary, although the present invention has been disclosed as above with a number of embodiments, they are not intended to limit the present invention. Those skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention should be defined by the appended claims.

Claims (20)

1.一种图像处理装置,包括:1. An image processing device, comprising: 一采样单元,用以对一像素采样得到一像素电压;a sampling unit for sampling a pixel to obtain a pixel voltage; 一放大器,用以依据一模拟增益放大该像素电压;an amplifier for amplifying the pixel voltage according to an analog gain; 一模拟数字转换器,用以转换放大后的该像素电压为一数字像素数据,该数字像素数据包括对应到不同颜色的多个第一子像素数据;以及an analog-to-digital converter for converting the amplified pixel voltage into digital pixel data, the digital pixel data including a plurality of first sub-pixel data corresponding to different colors; and 一白平衡单元,用以依据该模拟增益与对应至不同子像素的多个白平衡增益,分别对这些第一子像素数据进行白平衡补偿得到多个第二子像素数据,a white balance unit, for performing white balance compensation on the first sub-pixel data respectively according to the analog gain and a plurality of white balance gains corresponding to different sub-pixels to obtain a plurality of second sub-pixel data, 其中该白平衡单元依据这些第一子像素数据与这些白平衡增益,以产生多个第三子像素数据,并依据该模拟增益与该像素的一最大阱容(fullwelllevel),判断是否箝位(clamp)这些第三子像素数据,以产生这些第二子像素数据。Wherein the white balance unit generates a plurality of third sub-pixel data according to the first sub-pixel data and the white balance gains, and judges whether to clamp ( clamp) the third sub-pixel data to generate the second sub-pixel data. 2.如权利要求1所述的图像处理装置,其中该白平衡单元分别计算这些白平衡增益与这些第一子像素数据的乘积以作为这些第三子像素数据。2. The image processing device as claimed in claim 1, wherein the white balance unit respectively calculates the products of the white balance gains and the first sub-pixel data as the third sub-pixel data. 3.如权利要求1所述的图像处理装置,其中该白平衡单元判断该最大阱容是否在该模拟增益对应的一范围内,当该最大阱容在该范围内,依据该最大阱容与该模拟增益,计算一当前最大阱容,并将这些第三子像素数据分别与该当前最大阱容比较,以判断是否箝位这些第三子像素数据以产生这些第二子像素数据,其中该范围由该模拟增益与该模拟数字转换器的位数定义而得。3. The image processing device according to claim 1, wherein the white balance unit judges whether the maximum well capacity is within a range corresponding to the analog gain, and when the maximum well capacity is within the range, according to the maximum well capacity and The analog gain calculates a current maximum well capacity, and compares the third sub-pixel data with the current maximum well capacity to determine whether to clamp the third sub-pixel data to generate the second sub-pixel data, wherein the Range is defined by the analog gain and the number of bits of the ADC. 4.如权利要求3所述的图像处理装置,其中当该最大阱容不在该范围内,该白平衡单元不箝位这些第三子像素数据。4. The image processing device as claimed in claim 3, wherein when the maximum well capacity is not within the range, the white balance unit does not clamp the third sub-pixel data. 5.如权利要求3所述的图像处理装置,其中该白平衡单元计算该模拟增益与该最大阱容的乘积作为该当前最大阱容。5. The image processing device as claimed in claim 3, wherein the white balance unit calculates the product of the analog gain and the maximum well capacity as the current maximum well capacity. 6.如权利要求5所述的图像处理装置,其中该白平衡单元更限制该当前最大阱容不大于2(n-1),n为该像素的位数。6. The image processing device as claimed in claim 5, wherein the white balance unit further limits the current maximum well capacity to not more than 2 (n−1) , where n is the number of bits of the pixel. 7.如权利要求3所述的图像处理装置,其中该白平衡单元分别判断这些第三子像素数据是否大于该当前最大阱容,当判断结果为是时,该白平衡单元箝位这些第三子像素数据,当判断结果为否时,该白平衡单元不箝位这些第三子像素数据。7. The image processing device according to claim 3, wherein the white balance unit respectively judges whether the third sub-pixel data is larger than the current maximum well capacity, and when the judgment result is yes, the white balance unit clamps the third Sub-pixel data, when the determination result is negative, the white balance unit does not clamp the third sub-pixel data. 8.如权利要求3所述的图像处理装置,其中当该白平衡单元箝位这些第三子像素数据,该白平衡单元输出该当前最大阱容作为这些第二子像素数据,以及当该白平衡单元不箝位这些第三子像素数据,该白平衡单元输出这些第三子像素数据作为这些第二子像素数据。8. The image processing device as claimed in claim 3, wherein when the white balance unit clamps the third sub-pixel data, the white balance unit outputs the current maximum well capacity as the second sub-pixel data, and when the white balance unit The balance unit does not clamp the third sub-pixel data, and the white balance unit outputs the third sub-pixel data as the second sub-pixel data. 9.如权利要求1所述的图像处理装置,还包括:9. The image processing apparatus according to claim 1, further comprising: 一自动曝光单元,用以控制该采样单元,并提供该模拟增益至该放大器及该白平衡单元。An automatic exposure unit is used to control the sampling unit and provide the analog gain to the amplifier and the white balance unit. 10.如权利要求1所述的图像处理装置,还包括:10. The image processing apparatus according to claim 1, further comprising: 一自动白平衡单元,用以提供该白平衡单元这些白平衡增益。An automatic white balance unit is used to provide the white balance gains of the white balance unit. 11.如权利要求1所述的图像处理装置,还包括:11. The image processing apparatus according to claim 1, further comprising: 一黑色校准单元,耦接于该数字模拟转换器与该白平衡单元之间,用以对该数字像素数据进行黑色校准。A black calibration unit is coupled between the digital-to-analog converter and the white balance unit for performing black calibration on the digital pixel data. 12.如权利要求1所述的图像处理装置,还包括:12. The image processing apparatus according to claim 1, further comprising: 一色彩内插单元,用以对该白平衡单元所输出的一原始图像数据进行内插以得到一三原色图像数据,该原始图像数据包括这些第二子像素数据。A color interpolation unit is used for interpolating an original image data output by the white balance unit to obtain image data of three primary colors, and the original image data includes the second sub-pixel data. 13.一种图像处理方法,包括:13. An image processing method, comprising: (i)对一像素采样得到一像素电压;(i) sampling a pixel to obtain a pixel voltage; (ii)依据一模拟增益放大该像素电压;(ii) amplifying the pixel voltage according to an analog gain; (iii)将转换放大后的该像素电压为一数字像素数据,该数字像素数据包括对应到不同颜色的多个第一子像素数据;以及(iii) converting the amplified pixel voltage into digital pixel data, the digital pixel data including a plurality of first sub-pixel data corresponding to different colors; and (iv)依据该模拟增益与对应至不同子像素的多个白平衡增益,分别对这些第一子像素数据进行白平衡补偿得到多个第二子像素数据,(iv) performing white balance compensation on the first sub-pixel data according to the analog gain and a plurality of white balance gains corresponding to different sub-pixels to obtain a plurality of second sub-pixel data, 其中步骤(iv)包括:Wherein step (iv) comprises: (a)依据这些第一子像素数据与这些白平衡增益,以产生多个第三子像素数据;以及(a) generating a plurality of third sub-pixel data according to the first sub-pixel data and the white balance gains; and (b)依据该模拟增益与该像素的一最大阱容(fullwelllevel),判断是否箝位(clamp)这些第三子像素数据,以产生这些第二子像素数据。(b) judging whether to clamp the third sub-pixel data according to the analog gain and a maximum fullwell level of the pixel, so as to generate the second sub-pixel data. 14.如权利要求13所述的图像处理方法,其中步骤(a)包括分别计算这些白平衡增益与这些第一子像素数据的乘积以作为这些第三子像素数据。14. The image processing method as claimed in claim 13, wherein step (a) comprises calculating the products of the white balance gains and the first sub-pixel data respectively as the third sub-pixel data. 15.如权利要求13所述的图像处理方法,其中步骤(b)包括:15. The image processing method as claimed in claim 13, wherein step (b) comprises: (b1)判断该最大阱容是否在该模拟增益对应的一范围内;(b1) judging whether the maximum well capacity is within a range corresponding to the analog gain; (b2)当该最大阱容在该范围内,依据该最大阱容与该模拟增益,计算一当前最大阱容;以及(b2) When the maximum well capacity is within the range, calculate a current maximum well capacity according to the maximum well capacity and the simulation gain; and (b3)将这些第三子像素数据分别与该当前最大阱容比较,以判断是否箝位这些第三子像素数据以产生这些第二子像素数据。(b3) Comparing the third sub-pixel data with the current maximum well capacity to determine whether to clamp the third sub-pixel data to generate the second sub-pixel data. 16.如权利要求15所述的图像处理方法,其中步骤(b3)包括:16. The image processing method as claimed in claim 15, wherein step (b3) comprises: 当该最大阱容不在该范围内,不箝位这些第三子像素数据。When the maximum well capacity is not within the range, the third sub-pixel data are not clamped. 17.如权利要求15所述的图像处理方法,其中步骤(b2)包括:17. The image processing method as claimed in claim 15, wherein step (b2) comprises: 计算该模拟增益与该最大阱容的乘积作为该当前最大阱容。Calculate the product of the analog gain and the maximum well capacity as the current maximum well capacity. 18.如权利要求17所述的图像处理方法,还包括:18. The image processing method as claimed in claim 17, further comprising: 限制该当前最大阱容不大于2(n-1),n为该像素的位数。Limit the current maximum well capacity to no more than 2 (n-1) , where n is the number of bits of the pixel. 19.如权利要求15所述的图像处理方法,其中步骤(b3)包括:19. The image processing method as claimed in claim 15, wherein step (b3) comprises: 分别判断这些第三子像素数据是否大于该当前最大阱容;以及Respectively determine whether the third sub-pixel data is greater than the current maximum well capacity; and 当判断结果为是时,箝位这些第三子像素数据,且当判断结果为否时,不箝位这些第三子像素数据。When the judgment result is yes, the third sub-pixel data are clamped, and when the judgment result is no, the third sub-pixel data are not clamped. 20.如权利要求15所述的图像处理方法,其中当箝位这些第三子像素数据时,输出该当前最大阱容作为这些第二子像素数据;以及当不箝位这些第三子像素数据时,输出这些第三子像素数据作为这些第二子像素数据。20. The image processing method according to claim 15, wherein when clamping the third sub-pixel data, the current maximum well capacity is output as the second sub-pixel data; and when not clamping the third sub-pixel data , output the third sub-pixel data as the second sub-pixel data.
CN201210019091.4A 2012-01-20 2012-01-20 Image processing apparatus and method Expired - Fee Related CN103220476B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210019091.4A CN103220476B (en) 2012-01-20 2012-01-20 Image processing apparatus and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210019091.4A CN103220476B (en) 2012-01-20 2012-01-20 Image processing apparatus and method

Publications (2)

Publication Number Publication Date
CN103220476A CN103220476A (en) 2013-07-24
CN103220476B true CN103220476B (en) 2016-03-16

Family

ID=48817906

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210019091.4A Expired - Fee Related CN103220476B (en) 2012-01-20 2012-01-20 Image processing apparatus and method

Country Status (1)

Country Link
CN (1) CN103220476B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106454285B (en) * 2015-08-11 2019-04-19 比亚迪股份有限公司 The adjustment system and method for adjustment of white balance
CN106657828B (en) * 2016-11-30 2019-04-30 中国科学院西安光学精密机械研究所 Photoelectric system dynamic range optimization method based on hardware model
CN109147718B (en) * 2018-09-12 2020-05-12 京东方科技集团股份有限公司 Brightness control device, control method thereof and display device
CN114363480B (en) * 2020-09-29 2023-09-26 合肥君正科技有限公司 Adaptive lens shading correction method and system based on color temperature and illumination

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1418017A (en) * 2001-10-31 2003-05-14 凌阳科技股份有限公司 Automatic flash lamp device and automatic flash method for digital camera
CN1489862A (en) * 2001-10-03 2004-04-14 ���ṫ˾ Image capture device and image quality correction method
CN1577040A (en) * 2003-07-08 2005-02-09 索尼株式会社 Imaging apparatus and flicker reduction method
CN1625267A (en) * 2003-12-03 2005-06-08 三星电机株式会社 Digital automatic white balance equipment
CN1961571A (en) * 2004-06-01 2007-05-09 索尼株式会社 Imaging device and signal processing method
CN101204085A (en) * 2005-06-03 2008-06-18 柯尼卡美能达控股株式会社 camera device
CN101330564A (en) * 2007-06-21 2008-12-24 联詠科技股份有限公司 Signal correction method and circuit thereof, and image signal correction method and circuit thereof

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4522307B2 (en) * 2005-04-08 2010-08-11 キヤノン株式会社 Image capturing apparatus and image capturing method
US7801427B2 (en) * 2005-09-12 2010-09-21 Nokia Corporation Adjustment of shooting parameters in dependence of motion in a scene
JP4897593B2 (en) * 2007-07-09 2012-03-14 富士フイルム株式会社 Compound eye photographing apparatus and adjustment method thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1489862A (en) * 2001-10-03 2004-04-14 ���ṫ˾ Image capture device and image quality correction method
CN1418017A (en) * 2001-10-31 2003-05-14 凌阳科技股份有限公司 Automatic flash lamp device and automatic flash method for digital camera
CN1577040A (en) * 2003-07-08 2005-02-09 索尼株式会社 Imaging apparatus and flicker reduction method
CN1625267A (en) * 2003-12-03 2005-06-08 三星电机株式会社 Digital automatic white balance equipment
CN1961571A (en) * 2004-06-01 2007-05-09 索尼株式会社 Imaging device and signal processing method
CN101204085A (en) * 2005-06-03 2008-06-18 柯尼卡美能达控股株式会社 camera device
CN101330564A (en) * 2007-06-21 2008-12-24 联詠科技股份有限公司 Signal correction method and circuit thereof, and image signal correction method and circuit thereof

Also Published As

Publication number Publication date
CN103220476A (en) 2013-07-24

Similar Documents

Publication Publication Date Title
JP5112238B2 (en) Imaging apparatus, setting value changing method, and program
CN103220476B (en) Image processing apparatus and method
CN110290370A (en) Image processing method and device
KR101143833B1 (en) Image signal processing apparatus generating brightness signal of high reproducibility
WO2010146748A1 (en) Image pickup apparatus
US8896731B2 (en) Image processing apparatus, image processing method, and camera module
JP2007259434A (en) Image processing apparatus and method of the same
EP1729507B1 (en) Image signal processing unit and method
TWI516133B (en) Apparatus and method for image processing
JP2007274226A (en) Image processing device and method, information processing device and method, program, and recording medium
JP6413210B2 (en) Image processing apparatus, imaging apparatus, and program
JP2018022951A (en) Image processing apparatus and black-and-white image processing apparatus
JP2015008391A (en) Image processing apparatus, image processing method, and image processing program
JPH11331598A (en) Gradation correcting method of image pickup device
CN101330564A (en) Signal correction method and circuit thereof, and image signal correction method and circuit thereof
TW201712633A (en) Image processing method
JP5269016B2 (en) Image processing device
TW201318406A (en) Image signal processor and method for image enhancement
JP7364250B2 (en) Video processing device, video processing method, video processing system, and video processing program
JP6318497B2 (en) Image processing apparatus, imaging apparatus, and program
JP6261353B2 (en) Imaging apparatus and imaging method
CN101389040B (en) Image sharpness adjustment method and device
JP2019022228A (en) Image processing apparatus, imaging apparatus and program
JP2013145931A (en) Image conversion apparatus
JP6478482B2 (en) Image processing apparatus, imaging apparatus, image processing method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160316

Termination date: 20200120

CF01 Termination of patent right due to non-payment of annual fee