WO2017101558A1 - Image sensor, terminal comprising same, and imaging method - Google Patents

Image sensor, terminal comprising same, and imaging method Download PDF

Info

Publication number
WO2017101558A1
WO2017101558A1 PCT/CN2016/100880 CN2016100880W WO2017101558A1 WO 2017101558 A1 WO2017101558 A1 WO 2017101558A1 CN 2016100880 W CN2016100880 W CN 2016100880W WO 2017101558 A1 WO2017101558 A1 WO 2017101558A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
image sensor
unit
pixel units
analog signal
Prior art date
Application number
PCT/CN2016/100880
Other languages
French (fr)
Chinese (zh)
Inventor
李龙佳
Original Assignee
广东欧珀移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东欧珀移动通信有限公司 filed Critical 广东欧珀移动通信有限公司
Publication of WO2017101558A1 publication Critical patent/WO2017101558A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/12Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof

Definitions

  • the present invention belongs to the field of image processing technologies, and in particular, to an image sensor, and a terminal and an imaging method having the image sensor.
  • the HDR High-Dynamic Range
  • the present invention aims to solve at least one of the technical problems in the related art to some extent.
  • an aspect of the present invention provides an image sensor including: a pixel unit array including a plurality of pixel units; an amplification conversion unit for converting photogenerated charges generated by the pixel units into analog signals; a filter array on the pixel unit array, each filter array includes a plurality of filters, the filter of the same color corresponding to a plurality of pixel units; wherein the filters of the same color correspond to The photo-generated charge generated by the plurality of pixel units is converted by the amplification conversion unit to output a first analog signal and a second analog signal, the first analog signal and the second analog signal being different.
  • the filter based on the same color corresponds to a plurality of pixel units, and the plurality of pixel units corresponding to the filter of the same color are converted by the amplification conversion unit to output two different analog signals, thereby implementing HDR.
  • the function provides a hardware foundation. Compared with the software in the related art to implement the HDR function, the image sensor can realize the HDR function and improve the HDR effect by improving the hardware.
  • the photo-generated charges of all the pixel units for outputting the first analog signal in the plurality of pixel units corresponding to the filter of the same color share an amplification conversion unit output
  • the photo-generated charges of each of the pixel units for outputting the second analog signal among the plurality of pixel units corresponding to the filter of the same color are independently output using one amplification conversion unit.
  • the image sensor comprises a CMOS image sensor.
  • the filter array comprises a Bayer array.
  • the image sensor further includes: an analog-to-digital converter (ADC) for converting the first analog signal and the second analog signal into the first digital signal and the second Digital signal.
  • ADC analog-to-digital converter
  • a plurality of pixel cells corresponding to filters of the same color are located in different rows of the pixel cell array.
  • the filter of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, and the photo-generated charges generated by the 2 pixel units located in the first row are accumulated and converted into the first by the amplification conversion unit.
  • An analog signal, the photogenerated charge generated by each of the two pixel units in the second row is converted into a second analog signal by a corresponding amplification conversion unit, and the first analog signal and the second analog signal are passed through an ADC
  • the units are converted into a first digital signal and a second digital signal, respectively.
  • the image sensor further includes: a micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to one of the pixel units.
  • the image sensor further includes a control module and an image processing module, the control module is configured to control the pixel unit array to be sequentially exposed in rows, and the image processing module outputs the output to the analog to digital conversion unit.
  • the synthesis is performed to obtain a high dynamic range image.
  • another aspect of the present invention provides a terminal including the image sensor of the above aspect.
  • the HDR function can be realized based on the hardware structure of the image sensor, and the HDR image effect is improved.
  • the imaging terminal comprises a cell phone.
  • the imaging terminal further includes a central processing unit and a display device coupled to the image sensor, the central processor for controlling the display device to display a high dynamic range image of the image sensor output.
  • a further aspect of the present invention provides an imaging method based on the above image sensor, wherein a plurality of pixel units corresponding to the filter of the same color constitute a merged pixel, and the image processing method includes: reading the pixel An output of the cell array; and summing the outputs of the pixel cells of the same merged pixel to obtain pixel values of the merged pixels to generate a merged image.
  • the imaging method can obtain images with higher signal to noise ratio, brightness and sharpness, and less noise under low illumination.
  • the step of reading further comprises converting an analog signal output produced by the photosensitive pixel to a digital signal output.
  • a mobile terminal which includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed in the housing Inside the space, the processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; and the memory is used to store executable program code
  • the processor runs a program corresponding to the executable program code by reading executable program code stored in the memory for performing the imaging method of the above-described embodiments of the present invention.
  • the mobile terminal of the embodiment of the present invention by reading the output of the pixel unit array, adding the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel to generate a merged image, due to the noise of the merged pixel It is smaller than the sum of the noises of the pixels before the combination, and can obtain images with high signal-to-noise ratio, high brightness and sharpness, and less noise under low illumination.
  • a further aspect of the present invention provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instructions, the mobile terminal performs the implementation as described above The imaging method described in the example.
  • FIG. 1 is a schematic diagram of an image sensor in accordance with an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of an image sensor in accordance with another embodiment of the present invention.
  • FIG. 3 is a schematic diagram showing the distribution of a filter according to an embodiment of the present invention.
  • FIG. 4 is an equivalent circuit diagram of an image sensor in accordance with an embodiment of the present invention.
  • FIG. 5 is a schematic illustration of an image sensor in accordance with still another embodiment of the present invention.
  • Figure 6 is a block diagram of a terminal in accordance with one embodiment of the present invention.
  • FIG. 7 is a block diagram of a terminal in accordance with another embodiment of the present invention.
  • FIG. 8 is a flow chart of an imaging method in accordance with an embodiment of the present invention.
  • FIG. 9 is a flow chart of an imaging method in accordance with one embodiment of the present invention.
  • Figure 10 is a flow chart of an imaging method in accordance with another embodiment of the present invention.
  • the image sensor 100 includes a pixel unit array 10, an amplification conversion unit 20, and a filter array 30.
  • the pixel unit array 10 includes a plurality of pixel units 11; the amplification conversion unit 20 is configured to convert the photo-generated charges generated by the pixel units 11 into analog signals; the filter array 30 is disposed on the pixel unit array 10, and each of the filter arrays 30 includes The filter 31 and the filter 31 of the same color correspond to the plurality of pixel units 11.
  • the photo-generated charge generated by the plurality of pixel units 11 corresponding to the filter 31 of the same color is converted by the amplification conversion unit to output a first analog signal A1 and a second analog signal A2, and the first analog signal A1 and the second The analog signal A2 is different.
  • the filter 31 based on the same color corresponds to the plurality of pixel units 11, and the plurality of pixel units 11 corresponding to the filter 31 of the same color are converted by the amplification conversion unit 20 to output two different
  • the analog signal thereby providing a hardware foundation for implementing the HDR function, can realize the HDR function compared to the software in the related art, and the image sensor 100 can improve the HDR effect by implementing the HDR function on the hardware improvement.
  • the photo-generated charges of all the pixel units 11 for outputting the first analog signal A1 in the plurality of pixel units 11 corresponding to the filter 31 of the same color are shared by one amplification conversion unit 20.
  • the photo-generated charges of each of the pixel units 11 for outputting the second analog signal A2 in the plurality of pixel units 11 corresponding to the filter 31 of the same color are independently outputted by one amplification conversion unit 20.
  • the first analog signal A1 is equivalent to the sum of the photo-generated charges of a part of the pixel units 11 of the plurality of pixel units 11 corresponding to the filter 31 of the same color
  • the second analog signal A2 is equivalent to the The average of the photo-generated charges of the other portion of the pixel units 11 in the pixel unit 11, so that data can be provided for the synthesis of the HDR image based on the hardware structure.
  • image sensor 100 includes a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
  • Filter array 30 includes a Bayer array.
  • the image sensor 100 further includes an analog-to-digital conversion unit 40 that converts the first analog signal A1 and the second analog signal A2 into a first digital signal D1 and a second digital signal D2, respectively.
  • Image processing provides data.
  • a plurality of pixel units 11 corresponding to the filters 31 of the same color are located in different rows of the pixel unit array 10.
  • the filter 31 of the same color corresponds to 2 rows and 2 columns in total of 4 pixel units, and the photo-generated charges generated by the 2 pixel units 11 in the first row are accumulated and converted into the first analog signal A1 by the amplification conversion unit 20, The photogenerated charges generated by each of the two pixel units located in the second row are converted into the second analog signal A2 by the corresponding amplification conversion unit 20, and the first analog signal A1 and the second analog signal A2 are passed through a mode.
  • the number conversion unit 40 converts into a first digital signal D1 and a second digital signal D2, respectively.
  • the filter array 30 adopts a Bayer array color mode in which the same characters represent filters of the same color (for example, Gr, Gb, R, B).
  • the number after the character indicates the row number of the pixel unit corresponding to the filter of the same color, and the filters of different colors allow only the light of the corresponding wavelength to pass.
  • FIG. 4 is an equivalent circuit diagram of an image sensor according to an embodiment of the present invention, as shown in FIG. 4, including a first pixel unit PD1 and a first transfer switch GT1, a second pixel unit PD2, and a second transfer switch GT2.
  • ADC analog-to-digital conversion
  • the pixel unit 11 for example, a photodiode, receives light transmitted by the filter 31 to generate electric charge, and when the transfer switch is turned on, the charge generated by the corresponding pixel unit 11 is output, and then coupled and converted into a voltage signal by the amplification conversion unit 20, Converting to digital signal output through the ADC unit provides a data foundation for image processing.
  • the first pixel unit PD1, the second pixel unit PD2, the third pixel unit PD3, and the fourth pixel unit PD4 are respectively adjacent pixel units of the filter 31 of the same color, as shown in FIG. 4, wherein The pixel unit 11 corresponding to the filter 31 having the same character is received, that is, four adjacent pixel units receive light of the same color. Briefly, four pixel units constitute one large pixel. And the first pixel unit PD1 and the second pixel unit PD2 are located in the same row, and the third pixel unit PD3 and the fourth pixel unit PD4 are located in the same row.
  • the first pixel unit PD1 is connected to the first end of the first amplification conversion unit SF1 through the first transmission switch TG1
  • the second pixel unit PD2 is connected to the first end of the first amplification conversion unit SF1 through the second transmission switch TG2.
  • the second end of the first amplification conversion unit SF1 is connected to a preset power source such as Vdd; the third pixel unit PD3 is connected to the first end of the second amplification conversion unit SF2 through the third transmission switch TG3, and the second amplification conversion unit SF2
  • the second terminal unit PD4 is connected to the first end of the third amplification conversion unit SF3 through the fourth transmission switch TG4, and the third end of the third amplification conversion unit SF3 is connected to the preset power supply;
  • the control end of the TG1, the control end of the second transfer switch TG2, the control end of the third transfer switch TG3, and the control end of the fourth transfer switch TG4 are all connected to the control module, and the control module controls the switches of the four transfer switches in the transfer switch. When turned on, the corresponding pixel unit 11 transmits a signal.
  • the third end of the SF2 is connected to the third end of the third amplification conversion unit SF3.
  • circuit obtained by integrally swapping the circuit diagrams in FIG. 4 is also included in the scope of the present application, that is, the two pixel units of the lower side share an amplification conversion unit, and the two pixel units of the upper side are separately separated.
  • the use of an amplification conversion unit is also included in the scope of the present application, but differs in the component numbers.
  • the image sensor 100 further includes a control module, an image processor, a first reset unit RST1, a first selection unit SEL1, a second reset unit RET2, a third reset unit RET3, and a second The unit SEL2 is selected.
  • the first end of the first resetting unit RST1 is respectively connected to the first end of the first transfer switch TG1, the second transfer switch TG2 and the first amplification conversion unit SF1, and the second end of the first reset unit RST1 is connected to the preset power supply.
  • the first end of the first selection unit SEL1 is connected to the third end of the first amplification conversion unit SF1, and the second end of the first selection unit SEL1 is connected to the input end of the analog-to-digital conversion unit 40.
  • the first end of the second reset unit RET2 is connected to the first end of the third transfer switch TG3 and the second amplification conversion unit SF2, respectively, and the second end of the second reset unit RET2 is connected to the preset power supply;
  • the third reset unit RET3 One end is connected to the first end of the fourth transfer switch TG4 and the fourth booster conversion unit SF4, respectively, and the second end of the third reset unit RET3 is connected to the preset power supply;
  • the first end of the second selection unit SEL2 is respectively connected to the second increase
  • the third end of the conversion unit SF2 is connected to the third end of the third amplification conversion unit SF3, and the second end of the second selection unit SEL2 is connected to the input end of the analog-to-digital conversion unit 40.
  • the second end of the first selection unit SEL1 and the second end of the second selection unit SEL2 are connected to a readout line (READOUT COLUMN), and the input of the analog-to-digital conversion unit 40 is connected to READOUT COLUMN.
  • READOUT COLUMN a readout line
  • the terminal receives the control signal of the control module, and the control module controls the pixel unit array to sequentially expose according to the line, and controls the exposure time, that is, realizes the exposure control in the HDR process, thereby providing a data foundation for realizing HDR, and then the image sensing module performs analog to digital conversion.
  • the output of unit 40 is synthesized to obtain a high dynamic range image.
  • the corresponding pixel unit that is, the first pixel unit PD1 and the second pixel unit PD2
  • share an amplification conversion unit that is, the first amplification conversion unit SF1
  • the first amplification conversion unit SF1 converts the charge collected by the first pixel unit PD1 and the second pixel unit PD2 into a voltage signal, and further converts it into a digital signal output through the analog-to-digital conversion unit 40, and sets the output of the analog-to-digital conversion unit 40 at this time.
  • the conversion unit 40 converts to a digital signal output, At this time, the output value of the ADC unit 11 is ADC2.
  • the filter 31 of the same color corresponds to four pixel units adjacent to two rows and two columns as an example.
  • the control module controls two adjacent rows.
  • the output of the two pixel units 11 of the conversion unit SF1 is saturated.
  • the amplification conversion unit 20 can function as a summary coupling of the electric charge outputted by the pixel unit 11, and it can be understood that, at this time, the first amplification conversion unit SF1, the second amplification conversion unit SF2, and the third The amount of charge collected by the amplification conversion unit SF3 or the converted voltage value satisfies: SF1 ⁇ 2SF2 ⁇ 2SF3, wherein the value of the output of the ADC2 is a relatively low value of the average value of SF2 and SF3, so the filter corresponding to the same color is used.
  • the four pixel units 11 of 31 sequentially output a high ADC value and a low ADC value, thereby synthesizing the high ADC value and the low ADC value at the ISP (Image Signal Processor) end of the image sensor 100, thereby Obtain an HDR image that supports wide dynamics and improved HDR effects.
  • ISP Image Signal Processor
  • the image sensor 100 further includes a micromirror array 50 disposed on the filter array 30.
  • Each of the micromirrors 51 in the micromirror array 50 corresponds to one pixel unit 11, including formation, size, and position.
  • the micromirror 51 can collect light to the photosensitive portion of the pixel unit 11, and enhance the received light intensity of the pixel unit 11, thereby improving the image quality.
  • FIG. 6 is a block diagram of a terminal including the image sensor 100 of the above aspect, as shown in FIG. 6, in accordance with an embodiment of the present invention.
  • the terminal 1000 may include a mobile phone.
  • the terminal 1000 further includes a central processing unit 200 connected to the image sensor 100 and a display device 300 for controlling the display device 300 to display a high dynamic range image output by the image sensor 100.
  • the image taken by the terminal 1000 can be displayed on the display device 300 for viewing by the user.
  • the display device 300 includes an LED display or the like.
  • the terminal 1000 can implement the HDR function based on the hardware structure of the image sensor 100 by using the image sensor 100 to enhance the HDR image effect.
  • FIG. 8 is a flowchart of an imaging method according to an embodiment of the present invention. As shown in FIG. 8, the imaging method includes the following steps:
  • each filter of the same color of the image sensor corresponds to 2*2 pixel units
  • the image sensor includes a register
  • step S2 further includes:
  • step S2 further includes:
  • the image processing module which is generally a digital signal processing chip, can directly process the output of the image sensor, and secondly, compared with some schemes that directly process the output of the analog signal format of the image sensor through the circuit, The information of the image is well preserved.
  • the imaging method of the embodiment of the present invention can generate a combined image of 4 M pixels (merging 2*2 pixels) or 16 M pixels. The original image (ie not merged).
  • a further embodiment of the present invention further provides a mobile terminal, comprising: a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the housing, The processor and the memory are disposed on the circuit board; the power supply circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is configured to store executable program code; the processor A program corresponding to the executable program code is executed by reading executable program code stored in the memory for performing the imaging method of the above aspect.
  • the embodiment of the present invention further provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instruction, the mobile terminal performs the embodiment of the present invention as shown in FIG. Imaging method.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
  • computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
  • portions of the invention may be implemented in hardware, software, firmware or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

An image sensor, comprises a pixel unit array, an amplification conversion unit and filtering arrays, the pixel unit array comprising a plurality of pixel units; the amplification conversion unit being used for converting photo-generated charges generated by the pixel units into analog signals; the filtering arrays being arranged on the pixel unit array, each filtering array comprising a plurality of optical filters, and the optical filters of the same color corresponding to a plurality of pixel units; a first analog signal and a second analog signal being output after the photo-generated charges generated by the plurality of pixel units that the optical filters of the same color correspond to are converted by means of the amplification conversion unit, the first analog signal and the second analog signal being different. The image sensor provides a hardware basis for realizing an HDR function.

Description

图像传感器和具有其的终端、成像方法Image sensor and terminal therewith, imaging method
相关申请的交叉引用Cross-reference to related applications
本申请基于申请号为201510963291.9,申请日为2015年12月18日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。The present application is based on a Chinese patent application No. 20151096329, the entire disclosure of which is hereby incorporated by reference.
技术领域Technical field
本发明属于图像处理技术领域,尤其涉及一种图像传感器,以及一种具有该图像传感器的终端、成像方法。The present invention belongs to the field of image processing technologies, and in particular, to an image sensor, and a terminal and an imaging method having the image sensor.
背景技术Background technique
随着手机的普及,用手机拍照成为越来越多人的喜好。但是随着对拍照要求的提高,手机的图像处理的HDR(High-Dynamic Range,高动态范围)功能成为用户的需求,但是,目前,实现HDR功能,一般通过软件实现,效果不明显。With the popularity of mobile phones, taking pictures with mobile phones has become a favorite of more and more people. However, with the improvement of the photographing requirements, the HDR (High-Dynamic Range) function of the image processing of the mobile phone has become a demand of the user. However, at present, the HDR function is generally implemented by software, and the effect is not obvious.
发明内容Summary of the invention
本发明旨在至少在一定程度上解决相关技术中的技术问题之一。The present invention aims to solve at least one of the technical problems in the related art to some extent.
为了解决上述问题,本发明一方面提出一种图像传感器,该图像传感器包括:像素单元阵列,包括多个像素单元;增幅转换单元,用于将像素单元产生的光生电荷转换为模拟信号;设置于所述像素单元阵列上的滤光阵列,每个滤光阵列包括多个滤光片,同一颜色的所述滤光片对应于多个像素单元;其中,所述同一颜色的滤光片所对应的多个像素单元产生的光生电荷经增幅转换单元转换后输出一个第一模拟信号和一个第二模拟信号,所述第一模拟信号和所述第二模拟信号不相同。In order to solve the above problems, an aspect of the present invention provides an image sensor including: a pixel unit array including a plurality of pixel units; an amplification conversion unit for converting photogenerated charges generated by the pixel units into analog signals; a filter array on the pixel unit array, each filter array includes a plurality of filters, the filter of the same color corresponding to a plurality of pixel units; wherein the filters of the same color correspond to The photo-generated charge generated by the plurality of pixel units is converted by the amplification conversion unit to output a first analog signal and a second analog signal, the first analog signal and the second analog signal being different.
本发明的图像传感器,基于同一颜色的滤光片对应多个像素单元,且同一颜色的滤光片对应的多个像素单元经增幅转换单元转换后输出两个不同的模拟信号,从而为实现HDR功能提供硬件基础,相较于相关技术中的软件实现HDR功能,该图像传感器通过对硬件改进可实现HDR功能,提升HDR效果。In the image sensor of the present invention, the filter based on the same color corresponds to a plurality of pixel units, and the plurality of pixel units corresponding to the filter of the same color are converted by the amplification conversion unit to output two different analog signals, thereby implementing HDR. The function provides a hardware foundation. Compared with the software in the related art to implement the HDR function, the image sensor can realize the HDR function and improve the HDR effect by improving the hardware.
在本发明的一些实施例中,所述同一颜色的滤光片所对应的多个像素单元中用于输出第一模拟信号的所有像素单元的光生电荷累加后共用一个增幅转换单元输出,所述同一颜色的滤光片所对应的多个像素单元中用于输出第二模拟信号的所有像素单元中每一个像素单元的光生电荷均独立使用一个增幅转换单元输出。 In some embodiments of the present invention, the photo-generated charges of all the pixel units for outputting the first analog signal in the plurality of pixel units corresponding to the filter of the same color share an amplification conversion unit output, The photo-generated charges of each of the pixel units for outputting the second analog signal among the plurality of pixel units corresponding to the filter of the same color are independently output using one amplification conversion unit.
在至少一个实施例中,所述图像传感器包括CMOS图像传感器。In at least one embodiment, the image sensor comprises a CMOS image sensor.
在至少一个实施例中,所述滤光阵列包括拜耳阵列。In at least one embodiment, the filter array comprises a Bayer array.
在至少一个实施例中,该图像传感器还包括:模数转换单元(ADC,Analog-to-Digital Converter),用于将第一模拟信号和第二模拟信号分别转换为第一数字信号和第二数字信号。In at least one embodiment, the image sensor further includes: an analog-to-digital converter (ADC) for converting the first analog signal and the second analog signal into the first digital signal and the second Digital signal.
在至少一个实施例中,同一颜色的滤光片所对应的多个像素单元位于像素单元阵列的不同行。In at least one embodiment, a plurality of pixel cells corresponding to filters of the same color are located in different rows of the pixel cell array.
在至少一个实施例中,所述同一颜色的滤光片对应2行2列共计4个像素单元,位于第一行中的2个像素单元产生的光生电荷累加后经过增幅转换单元转换为第一模拟信号,位于第二行中的2个像素单元中每个像素单元产生的光生电荷经过对应的增幅转换单元转换为第二模拟信号,所述第一模拟信号和第二模拟信号在通过一个ADC单元分别转换为一个第一数字信号和第二数字信号。In at least one embodiment, the filter of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, and the photo-generated charges generated by the 2 pixel units located in the first row are accumulated and converted into the first by the amplification conversion unit. An analog signal, the photogenerated charge generated by each of the two pixel units in the second row is converted into a second analog signal by a corresponding amplification conversion unit, and the first analog signal and the second analog signal are passed through an ADC The units are converted into a first digital signal and a second digital signal, respectively.
在至少一个实施例中,上述图像传感器还包括:设置在所述滤光阵列上的微镜阵列,所述微镜阵列中的每个微镜与一个所述像素单元对应。In at least one embodiment, the image sensor further includes: a micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to one of the pixel units.
在至少一个实施例中,上述图像传感器还包括控制模块和图像处理模块,所述控制模块用于控制所述像素单元阵列按照行依次曝光,所述图像处理模块对所述模数转换单元的输出进行合成以获得高动态范围图像。In at least one embodiment, the image sensor further includes a control module and an image processing module, the control module is configured to control the pixel unit array to be sequentially exposed in rows, and the image processing module outputs the output to the analog to digital conversion unit. The synthesis is performed to obtain a high dynamic range image.
为了解决上述问题,本发明另一方面提出一种终端,该终端包括上述方面所述的图像传感器。In order to solve the above problems, another aspect of the present invention provides a terminal including the image sensor of the above aspect.
本发明的终端,通过采用所述的图像传感器,基于图像传感器的硬件结构可以实现HDR功能,提升HDR图像效果。According to the terminal of the present invention, by adopting the image sensor, the HDR function can be realized based on the hardware structure of the image sensor, and the HDR image effect is improved.
在至少一个实施例中,所述成像终端包括手机。In at least one embodiment, the imaging terminal comprises a cell phone.
在至少一个实施例中,所述成像终端还包括与所述图像传感器连接的中央处理器及显示装置,所述中央处理器用于控制所述显示装置显示所述图像传感器输出的高动态范围图像。In at least one embodiment, the imaging terminal further includes a central processing unit and a display device coupled to the image sensor, the central processor for controlling the display device to display a high dynamic range image of the image sensor output.
本发明再一方面提出一种基于上述的图像传感器的成像方法,其中,所述同一颜色的滤光片所对应的多个像素单元构成合并像素,所述图像处理方法包括:读取所述像素单元阵列的输出;以及将同一所述合并像素的所述像素单元的输出相加以得到所述合并像素的像素值从而生成合并图像。A further aspect of the present invention provides an imaging method based on the above image sensor, wherein a plurality of pixel units corresponding to the filter of the same color constitute a merged pixel, and the image processing method includes: reading the pixel An output of the cell array; and summing the outputs of the pixel cells of the same merged pixel to obtain pixel values of the merged pixels to generate a merged image.
由于合并像素的噪声小于合并之前各像素噪声之和,采用此成像方法能在低照度下得到信噪比、亮度和清晰度较高,噪点较少的图像。克服了现有某些成像方法的缺点。Since the noise of the combined pixels is smaller than the sum of the noises of the pixels before the combination, the imaging method can obtain images with higher signal to noise ratio, brightness and sharpness, and less noise under low illumination. Overcoming the shortcomings of some existing imaging methods.
在至少一个实施例中,所述成像装置包括寄存器,每个所述滤光单元覆盖2*2个所述感 光像素;所述读出步骤进一步包括:采集第k行及第k+1行的所述感光像素的输出并存入所述寄存器,其中k=2n-1,n为自然数,k+1小于等于所述感光像素阵列的总行数;及从所述寄存器中提取所述第k行及第k+1行的所述感光像素的输出,将同一所述合并像素的所述感光像素的输出相加以得到所述合并像素的像素值。In at least one embodiment, the imaging device includes a register, each of the filter units covering 2*2 of the senses a light pixel; the reading step further comprising: collecting an output of the photosensitive pixel of the kth row and the k+1th row and storing the register, wherein k=2n-1, n is a natural number, and k+1 is less than Equal to the total number of rows of the photosensitive pixel array; and extracting the output of the photosensitive pixels of the kth row and the k+1th row from the register, and outputting the photosensitive pixels of the same pixel The pixel values of the merged pixels are obtained.
在至少一个实施例中,所述读出步骤进一步包括:将所述感光像素产生的模拟信号输出转换为数字信号输出。In at least one embodiment, the step of reading further comprises converting an analog signal output produced by the photosensitive pixel to a digital signal output.
为了解决上述问题,本发明又一方面实施例提出了一种移动终端,该移动终端包括壳体、处理器、存储器、电路板和电源电路,其中,所述电路板安置在所述壳体围成的空间内部,所述处理器和所述存储器设置在所述电路板上;所述电源电路,用于为所述移动终端的各个电路或器件供电;所述存储器用于存储可执行程序代码;所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序,以用于执行本发明上述实施例所述的成像方法。In order to solve the above problems, another embodiment of the present invention provides a mobile terminal, which includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed in the housing Inside the space, the processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; and the memory is used to store executable program code The processor runs a program corresponding to the executable program code by reading executable program code stored in the memory for performing the imaging method of the above-described embodiments of the present invention.
本发明实施例的移动终端,通过读取所述像素单元阵列的输出,将同一合并像素的所述像素单元的输出相加以得到所述合并像素的像素值从而生成合并图像,由于合并像素的噪声小于合并之前各像素噪声之和,能在低照度下得到信噪比、亮度和清晰度较高,噪点较少的图像。The mobile terminal of the embodiment of the present invention, by reading the output of the pixel unit array, adding the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel to generate a merged image, due to the noise of the merged pixel It is smaller than the sum of the noises of the pixels before the combination, and can obtain images with high signal-to-noise ratio, high brightness and sharpness, and less noise under low illumination.
为了解决上述问题,本发明又一方面实施例提出了一种计算机可读存储介质,具有存储于其中的指令,当移动终端的处理器执行所述指令时,所述移动终端执行如上述方面实施例所述的成像方法。In order to solve the above problems, a further aspect of the present invention provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instructions, the mobile terminal performs the implementation as described above The imaging method described in the example.
本发明附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。The additional aspects and advantages of the invention will be set forth in part in the description which follows.
附图说明DRAWINGS
图1是根据本发明的一个实施例的图像传感器的示意图;1 is a schematic diagram of an image sensor in accordance with an embodiment of the present invention;
图2是根据本发明的另一个实施例的图像传感器的示意图;2 is a schematic diagram of an image sensor in accordance with another embodiment of the present invention;
图3是根据本发明的一个具体实施例的滤波片的分布示意图;3 is a schematic diagram showing the distribution of a filter according to an embodiment of the present invention;
图4是根据本发明的一个实施例的图像传感器的等效电路图;4 is an equivalent circuit diagram of an image sensor in accordance with an embodiment of the present invention;
图5是根据本发明的再一个实施例的图像传感器的示意图;Figure 5 is a schematic illustration of an image sensor in accordance with still another embodiment of the present invention;
图6是根据本发明的一个实施例的终端的框图;Figure 6 is a block diagram of a terminal in accordance with one embodiment of the present invention;
图7是根据本发明的另一个实施例的终端的框图;Figure 7 is a block diagram of a terminal in accordance with another embodiment of the present invention;
图8是根据本发明实施例的成像方法的流程图; 8 is a flow chart of an imaging method in accordance with an embodiment of the present invention;
图9是根据本发明一个实施例的成像方法的流程图;9 is a flow chart of an imaging method in accordance with one embodiment of the present invention;
图10是根据本发明的另一个实施例的成像方法的流程图。Figure 10 is a flow chart of an imaging method in accordance with another embodiment of the present invention.
具体实施方式detailed description
下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本发明,而不能理解为对本发明的限制。The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.
下面参照附图描述根据本发明实施例的图像传感器及具有该图像传感器的终端。An image sensor and a terminal having the same according to an embodiment of the present invention will be described below with reference to the accompanying drawings.
首先,对本发明实施例的图像传感器进行说明。如图1所示,该图像传感器100包括像素单元阵列10、增幅转换单元20和滤光阵列30。First, an image sensor according to an embodiment of the present invention will be described. As shown in FIG. 1, the image sensor 100 includes a pixel unit array 10, an amplification conversion unit 20, and a filter array 30.
像素单元阵列10包括多个像素单元11;增幅转换单元20用于将像素单元11产生的光生电荷转换为模拟信号;滤光阵列30设置于像素单元阵列10上,每个滤光阵列30包括多个滤光片31,同一颜色的滤光片31对应于多个像素单元11。The pixel unit array 10 includes a plurality of pixel units 11; the amplification conversion unit 20 is configured to convert the photo-generated charges generated by the pixel units 11 into analog signals; the filter array 30 is disposed on the pixel unit array 10, and each of the filter arrays 30 includes The filter 31 and the filter 31 of the same color correspond to the plurality of pixel units 11.
其中,同一颜色的滤光片31所对应的多个像素单元11产生的光生电荷经增幅转换单元转换后输出一个第一模拟信号A1和一个第二模拟信号A2,第一模拟信号A1和第二模拟信号A2不相同。The photo-generated charge generated by the plurality of pixel units 11 corresponding to the filter 31 of the same color is converted by the amplification conversion unit to output a first analog signal A1 and a second analog signal A2, and the first analog signal A1 and the second The analog signal A2 is different.
本发明实施例的图像传感器100,基于同一颜色的滤光片31对应多个像素单元11,且同一颜色的滤光片31对应的多个像素单元11经增幅转换单元20转换后输出两个不同的模拟信号,从而为实现HDR功能提供硬件基础,相较于相关技术中的软件实现HDR功能,该图像传感器100通过对硬件改进实现HDR功能,可以提升HDR效果。In the image sensor 100 of the embodiment of the present invention, the filter 31 based on the same color corresponds to the plurality of pixel units 11, and the plurality of pixel units 11 corresponding to the filter 31 of the same color are converted by the amplification conversion unit 20 to output two different The analog signal, thereby providing a hardware foundation for implementing the HDR function, can realize the HDR function compared to the software in the related art, and the image sensor 100 can improve the HDR effect by implementing the HDR function on the hardware improvement.
在本发明的一些实施例中,同一颜色的滤光片31所对应的多个像素单元11中用于输出第一模拟信号A1的所有像素单元11的光生电荷累加后共用一个增幅转换单元20输出,同一颜色的滤光片31所对应的多个像素单元11中用于输出第二模拟信号A2的所有像素单元11中每一个像素单元11的光生电荷均独立使用一个增幅转换单元20输出。可以理解的是,第一模拟信号A1相当于同一颜色的滤光片31所对应的多个像素单元11中的一部分像素单元11的光生电荷的和值,而第二模拟信号A2相当于该多个像素单元11中的另一部分像素单元11的光生电荷的均值,从而基于该硬件结构可以为HDR图像的合成提供数据。In some embodiments of the present invention, the photo-generated charges of all the pixel units 11 for outputting the first analog signal A1 in the plurality of pixel units 11 corresponding to the filter 31 of the same color are shared by one amplification conversion unit 20. The photo-generated charges of each of the pixel units 11 for outputting the second analog signal A2 in the plurality of pixel units 11 corresponding to the filter 31 of the same color are independently outputted by one amplification conversion unit 20. It can be understood that the first analog signal A1 is equivalent to the sum of the photo-generated charges of a part of the pixel units 11 of the plurality of pixel units 11 corresponding to the filter 31 of the same color, and the second analog signal A2 is equivalent to the The average of the photo-generated charges of the other portion of the pixel units 11 in the pixel unit 11, so that data can be provided for the synthesis of the HDR image based on the hardware structure.
在本发明的一些实施例中,图像传感器100包括CMOS(Complementary Metal Oxide Semiconductor),互补金属氧化物半导体)图像传感器。滤光阵列30包括拜耳阵列。In some embodiments of the invention, image sensor 100 includes a CMOS (Complementary Metal Oxide Semiconductor) image sensor. Filter array 30 includes a Bayer array.
如图2所示,图像传感器100还包括模数转换单元40,模数转换单元40将第一模拟信号A1和第二模拟信号A2分别转换为第一数字信号D1和第二数字信号D2,为图像处理提供数据。 As shown in FIG. 2, the image sensor 100 further includes an analog-to-digital conversion unit 40 that converts the first analog signal A1 and the second analog signal A2 into a first digital signal D1 and a second digital signal D2, respectively. Image processing provides data.
在本发明的一些实施例中,同一颜色的滤光片31所对应的多个像素单元11位于像素单元阵列10的不同行。In some embodiments of the present invention, a plurality of pixel units 11 corresponding to the filters 31 of the same color are located in different rows of the pixel unit array 10.
例如,同一颜色的滤光片31对应2行2列共计4个像素单元,位于第一行中的2个像素单元11产生的光生电荷累加后经过增幅转换单元20转换为第一模拟信号A1,位于第二行中的2个像素单元中每个像素单元11产生的光生电荷经过对应的增幅转换单元20转换为第二模拟信号A2,第一模拟信号A1和第二模拟信号A2再通过一个模数转换单元40分别转换为一个第一数字信号D1和第二数字信号D2。For example, the filter 31 of the same color corresponds to 2 rows and 2 columns in total of 4 pixel units, and the photo-generated charges generated by the 2 pixel units 11 in the first row are accumulated and converted into the first analog signal A1 by the amplification conversion unit 20, The photogenerated charges generated by each of the two pixel units located in the second row are converted into the second analog signal A2 by the corresponding amplification conversion unit 20, and the first analog signal A1 and the second analog signal A2 are passed through a mode. The number conversion unit 40 converts into a first digital signal D1 and a second digital signal D2, respectively.
参照图3所示,为根据本发明的一个实施例的滤光片分布示意图,滤波阵列30采用Bayer array颜色模式,其中,相同字符表示相同颜色的滤光片(例如Gr,Gb,R,B),字符后的数字表示相同颜色的滤波片对应的像素单元的排号,不同颜色的滤光片仅允许对应波长的光透过。Referring to FIG. 3, which is a schematic diagram of filter distribution according to an embodiment of the present invention, the filter array 30 adopts a Bayer array color mode in which the same characters represent filters of the same color (for example, Gr, Gb, R, B). The number after the character indicates the row number of the pixel unit corresponding to the filter of the same color, and the filters of different colors allow only the light of the corresponding wavelength to pass.
图4是根据本发明的一个实施例的图像传感器的等效电路图,如图4所示,包括第一像素单元PD1和第一传输开关GT1、第二像素单元PD2和第二传输开关GT2、第三像素单元PD3和第三传输开关GT3、第四像素单元PD4和第四传输开关GT4、第一增幅转换单元SF1、第二增幅转换单元SF2、第三增幅转换单元SF3、模数转换(ADC)单元40。其中,像素单元11,例如光电二极管,接收滤光片31透过的光而生成电荷,传输开关开启则对应的像素单元11生成的电荷输出,进而在增幅转换单元20耦合并转换为电压信号,通过ADC单元转换为数字信号输出,为图像处理提供数据基础。4 is an equivalent circuit diagram of an image sensor according to an embodiment of the present invention, as shown in FIG. 4, including a first pixel unit PD1 and a first transfer switch GT1, a second pixel unit PD2, and a second transfer switch GT2. The three pixel unit PD3 and the third transfer switch GT3, the fourth pixel unit PD4 and the fourth transfer switch GT4, the first amplification conversion unit SF1, the second amplification conversion unit SF2, the third amplification conversion unit SF3, and the analog-to-digital conversion (ADC) Unit 40. The pixel unit 11, for example, a photodiode, receives light transmitted by the filter 31 to generate electric charge, and when the transfer switch is turned on, the charge generated by the corresponding pixel unit 11 is output, and then coupled and converted into a voltage signal by the amplification conversion unit 20, Converting to digital signal output through the ADC unit provides a data foundation for image processing.
其中,第一像素单元PD1、第二像素单元PD2、第三像素单元PD3和第四像素单元PD4为分别相邻的对应相同颜色的滤光片31的像素单元,例如图4中所示,其中标识字符相同的滤光片31对应的像素单元11,也就是四个分别相邻的像素单元接收相同颜色的光,简单地说,即四个像素单元构成一个大的像素(pixel)。且第一像素单元PD1和第二像素单元PD2位于同一行,第三像素单元PD3和第四像素单元PD4位于同一行。The first pixel unit PD1, the second pixel unit PD2, the third pixel unit PD3, and the fourth pixel unit PD4 are respectively adjacent pixel units of the filter 31 of the same color, as shown in FIG. 4, wherein The pixel unit 11 corresponding to the filter 31 having the same character is received, that is, four adjacent pixel units receive light of the same color. Briefly, four pixel units constitute one large pixel. And the first pixel unit PD1 and the second pixel unit PD2 are located in the same row, and the third pixel unit PD3 and the fourth pixel unit PD4 are located in the same row.
具体地,第一像素单元PD1通过第一传输开关TG1与第一增幅转换单元SF1的第一端连接,第二像素单元PD2通过第二传输开关TG2与第一增幅转换单元SF1的第一端连接,第一增幅转换单元SF1的第二端连接预设电源例如Vdd;第三像素单元PD3通过第三传输开关TG3与第二增幅转换单元SF2的第一端连接,第二增幅转换单元SF2的第二端连接预设电源;第四像素单元PD4通过第四传输开关TG4与第三增幅转换单元SF3的第一端连接,第三增幅转换单元SF3的第三端连接预设电源;第一传输开关TG1的控制端、第二传输开关TG2的控制端、第三传输开关TG3的控制端和第四传输开关TG4的控制端均与控制模块连接,控制模块控制四个传输开关的开关,在传输开关开启时,对应的像素单元11传出信号。Specifically, the first pixel unit PD1 is connected to the first end of the first amplification conversion unit SF1 through the first transmission switch TG1, and the second pixel unit PD2 is connected to the first end of the first amplification conversion unit SF1 through the second transmission switch TG2. The second end of the first amplification conversion unit SF1 is connected to a preset power source such as Vdd; the third pixel unit PD3 is connected to the first end of the second amplification conversion unit SF2 through the third transmission switch TG3, and the second amplification conversion unit SF2 The second terminal unit PD4 is connected to the first end of the third amplification conversion unit SF3 through the fourth transmission switch TG4, and the third end of the third amplification conversion unit SF3 is connected to the preset power supply; the first transmission switch The control end of the TG1, the control end of the second transfer switch TG2, the control end of the third transfer switch TG3, and the control end of the fourth transfer switch TG4 are all connected to the control module, and the control module controls the switches of the four transfer switches in the transfer switch. When turned on, the corresponding pixel unit 11 transmits a signal.
模数转换单元40的输入端分别与第一增幅转换单元SF1的第三端、第二增幅转换单元 SF2的第三端和第三增幅转换单元SF3的第三端连接。The input ends of the analog-to-digital conversion unit 40 and the third end and the second amplification conversion unit of the first amplification conversion unit SF1, respectively The third end of the SF2 is connected to the third end of the third amplification conversion unit SF3.
可以理解的是,将图4中的电路图上下整体互换获得的电路也包括在本申请的范围内,即下边同行的两个像素单元共用一个增幅转换单元,上边同行的两个像素单元分别单独使用一个增幅转换单元,也包括在本申请的范围内,只是元件标号的不同。It can be understood that the circuit obtained by integrally swapping the circuit diagrams in FIG. 4 is also included in the scope of the present application, that is, the two pixel units of the lower side share an amplification conversion unit, and the two pixel units of the upper side are separately separated. The use of an amplification conversion unit is also included in the scope of the present application, but differs in the component numbers.
为了实现曝光的控制,如图4所示,图像传感器100还包括控制模块、图像处理器、第一复位单元RST1、第一选择单元SEL1,第二复位单元RET2、第三复位单元RET3和第二选择单元SEL2。In order to achieve the control of exposure, as shown in FIG. 4, the image sensor 100 further includes a control module, an image processor, a first reset unit RST1, a first selection unit SEL1, a second reset unit RET2, a third reset unit RET3, and a second The unit SEL2 is selected.
其中,第一复位单元RST1的第一端分别与第一传输开关TG1、第二传输开关TG2和第一增幅转换单元SF1的第一端连接,第一复位单元RST1的第二端连接预设电源,第一选择单元SEL1的第一端与第一增幅转换单元SF1的第三端连接,第一选择单元SEL1的第二端与模数转换单元40的输入端连接。第二复位单元RET2的第一端分别与第三传输开关TG3和第二增幅转换单元SF2的第一端连接,第二复位单元RET2的第二端连接预设电源;第三复位单元RET3的第一端分别与第四传输开关TG4和第四增幅转换单元SF4的第一端连接,第三复位单元RET3的第二端连接预设电源;第二选择单元SEL2的第一端分别与第二增幅转换单元SF2的第三端和第三增幅转换单元SF3的第三端连接,第二选择单元SEL2的第二端与模数转换单元40的输入端连接。具体地,如图4中所示,第一选择单元SEL1的第二端和第二选择单元SEL2的第二端连接读出线(READOUT COLUMN),模数转换单元40的输入端连接READOUT COLUMN。The first end of the first resetting unit RST1 is respectively connected to the first end of the first transfer switch TG1, the second transfer switch TG2 and the first amplification conversion unit SF1, and the second end of the first reset unit RST1 is connected to the preset power supply. The first end of the first selection unit SEL1 is connected to the third end of the first amplification conversion unit SF1, and the second end of the first selection unit SEL1 is connected to the input end of the analog-to-digital conversion unit 40. The first end of the second reset unit RET2 is connected to the first end of the third transfer switch TG3 and the second amplification conversion unit SF2, respectively, and the second end of the second reset unit RET2 is connected to the preset power supply; the third reset unit RET3 One end is connected to the first end of the fourth transfer switch TG4 and the fourth booster conversion unit SF4, respectively, and the second end of the third reset unit RET3 is connected to the preset power supply; the first end of the second selection unit SEL2 is respectively connected to the second increase The third end of the conversion unit SF2 is connected to the third end of the third amplification conversion unit SF3, and the second end of the second selection unit SEL2 is connected to the input end of the analog-to-digital conversion unit 40. Specifically, as shown in FIG. 4, the second end of the first selection unit SEL1 and the second end of the second selection unit SEL2 are connected to a readout line (READOUT COLUMN), and the input of the analog-to-digital conversion unit 40 is connected to READOUT COLUMN.
其中,第一复位单元RST1的第三端、第一选择单元SEL1的第三端、第二复位单元RET2的第三端、第三复位单元RET3的第三端和第二选择单元SEL2的第三端接收控制模块的控制信号,控制模块控制像素单元阵列按照行依次曝光,并控制曝光时间,即实现HDR过程中的曝光控制,进而为实现HDR提供数据基础,进而图像传感模块对模数转换单元40的输出进行合成以获得高动态范围图像。The third end of the first reset unit RST1, the third end of the first selection unit SEL1, the third end of the second reset unit RET2, the third end of the third reset unit RET3, and the third end of the second selection unit SEL2 The terminal receives the control signal of the control module, and the control module controls the pixel unit array to sequentially expose according to the line, and controls the exposure time, that is, realizes the exposure control in the HDR process, thereby providing a data foundation for realizing HDR, and then the image sensing module performs analog to digital conversion. The output of unit 40 is synthesized to obtain a high dynamic range image.
作为一个示例,像素单元阵列10内第2i+1(i=0,1,2,3,4…)行的每个滤光片31对应的两个像素单元(比如滤光片Gr1,Gr2所对应的像素单元),即第一像素单元PD1和第二像素单元PD2,共用一个增幅转换单元即第一增幅转换单元SF1,第一像素单元PD1和第二像素单元PD2产生的电荷汇集后,由第一增幅转换单元SF1将第一像素单元PD1和第二像素单元PD2汇集后的电荷转换为电压信号,并进一步通过模数转换单元40转换为数字信号输出,设此时模数转换单元40输出值为ADC1;另外,像素单元阵列10内邻近第2i+1行的第2i+2(i=0,1,2,3,4…)行的每个滤光片31的两个像素单元(比如滤光片Gr3,Gr4所对应的像素单元),即第三像素单元PD3和第四像素单元PD4分别通过一个第二增幅转换单元SF2和第三增幅转换单元SF3进行电荷转换,最后通过模数转换单元40转换为数字信号输出,设 此时ADC单元11输出值为ADC2。As an example, two pixel units corresponding to each of the filters 31 of the 2i+1 (i=0, 1, 2, 3, 4...) rows in the pixel unit array 10 (such as filters Gr1, Gr2) The corresponding pixel unit), that is, the first pixel unit PD1 and the second pixel unit PD2, share an amplification conversion unit, that is, the first amplification conversion unit SF1, and the charges generated by the first pixel unit PD1 and the second pixel unit PD2 are collected, The first amplification conversion unit SF1 converts the charge collected by the first pixel unit PD1 and the second pixel unit PD2 into a voltage signal, and further converts it into a digital signal output through the analog-to-digital conversion unit 40, and sets the output of the analog-to-digital conversion unit 40 at this time. The value is ADC1; in addition, two pixel units of each filter 31 adjacent to the 2i+2 (i=0, 1, 2, 3, 4...) line of the 2i+1th row in the pixel unit array 10 ( For example, the filter unit Gr3, the pixel unit corresponding to Gr4), that is, the third pixel unit PD3 and the fourth pixel unit PD4 are respectively subjected to charge conversion by a second amplification conversion unit SF2 and a third amplification conversion unit SF3, and finally pass the modulus. The conversion unit 40 converts to a digital signal output, At this time, the output value of the ADC unit 11 is ADC2.
具体地,以同一颜色的滤光片31对应2行2列相邻的4个像素单元为例,基于上述的电路结构,参照图4所示,在进行HDR时,控制模块控制相邻两行的相同颜色的像素单元依次曝光,例如,第2i+1与2i+2行依次曝光,其中,i=0,1,2,3.....,并控制曝光时间,避免共用第一增幅转换单元SF1的两个像素单元11的输出饱和。在本发明的实施例中,增幅转换单元20可以对像素单元11输出的电荷起到汇总耦合的作用,可以理解的是,此时第一增幅转换单元SF1、第二增幅转换单元SF2和第三增幅转换单元SF3汇集的电荷量或转换的电压值满足:SF1≈2SF2≈2SF3,其中,ADC2输出的值为SF2和SF3的均值即为一个相对较低的值,所以对应同一颜色的滤光片31的四个像素单元11依次输出一个高ADC值和一个低ADC值,进而在图像传感器100的ISP(Image Signal Processor,即图像处理器)端对高ADC值和低ADC值进行合成处理,从而获得HDR图像,该HDR图像支持宽动态,HDR效果得到改善。Specifically, the filter 31 of the same color corresponds to four pixel units adjacent to two rows and two columns as an example. Based on the above-described circuit configuration, as shown in FIG. 4, when performing HDR, the control module controls two adjacent rows. The pixel units of the same color are sequentially exposed, for example, the 2i+1 and 2i+2 lines are sequentially exposed, wherein i=0, 1, 2, 3....., and the exposure time is controlled to avoid sharing the first increase. The output of the two pixel units 11 of the conversion unit SF1 is saturated. In the embodiment of the present invention, the amplification conversion unit 20 can function as a summary coupling of the electric charge outputted by the pixel unit 11, and it can be understood that, at this time, the first amplification conversion unit SF1, the second amplification conversion unit SF2, and the third The amount of charge collected by the amplification conversion unit SF3 or the converted voltage value satisfies: SF1≈2SF2≈2SF3, wherein the value of the output of the ADC2 is a relatively low value of the average value of SF2 and SF3, so the filter corresponding to the same color is used. The four pixel units 11 of 31 sequentially output a high ADC value and a low ADC value, thereby synthesizing the high ADC value and the low ADC value at the ISP (Image Signal Processor) end of the image sensor 100, thereby Obtain an HDR image that supports wide dynamics and improved HDR effects.
如图5所示,图像传感器100还包括设置在滤光阵列30上的的微镜阵列50,微镜阵列50中的每个微镜51与一个像素单元11对应,包括形成、大小、位置对应。微镜51能将光聚集到像素单元11的感光部分,提升像素单元11的受光强度,从而改善成像画质。As shown in FIG. 5, the image sensor 100 further includes a micromirror array 50 disposed on the filter array 30. Each of the micromirrors 51 in the micromirror array 50 corresponds to one pixel unit 11, including formation, size, and position. . The micromirror 51 can collect light to the photosensitive portion of the pixel unit 11, and enhance the received light intensity of the pixel unit 11, thereby improving the image quality.
基于上述方面实施例的图像传感器,下面参照附图描述根据本发明另一方面实施例提出的终端。Based on the image sensor of the embodiment of the above aspect, a terminal according to another embodiment of the present invention will be described below with reference to the accompanying drawings.
图6是根据本发明的一个实施例的终端的框图,如图6所示,该终端1000包括上述方面的图像传感器100。具体地,终端1000可以包括手机。FIG. 6 is a block diagram of a terminal including the image sensor 100 of the above aspect, as shown in FIG. 6, in accordance with an embodiment of the present invention. Specifically, the terminal 1000 may include a mobile phone.
如图7所示,终端1000还包括与图像传感器100连接的中央处理器200及显示装置300,中央处理器200用于控制显示装置300显示图像传感器100输出的高动态范围图像。这样,终端1000拍摄的图像可以显示于显示装置300以供用户查看。显示装置300包括LED显示器等。As shown in FIG. 7, the terminal 1000 further includes a central processing unit 200 connected to the image sensor 100 and a display device 300 for controlling the display device 300 to display a high dynamic range image output by the image sensor 100. Thus, the image taken by the terminal 1000 can be displayed on the display device 300 for viewing by the user. The display device 300 includes an LED display or the like.
该终端1000,通过采用所述的图像传感器100,基于图像传感器100的硬件结构可以实现HDR功能,提升HDR图像效果。The terminal 1000 can implement the HDR function based on the hardware structure of the image sensor 100 by using the image sensor 100 to enhance the HDR image effect.
基于上述方面实施例的图像传感器,下面参照附图描述根据本发明实施例提出的成像方法,其中,同一颜色的滤光片所对应的多个像素单元构成合并像素。Based on the image sensor of the embodiment of the above aspect, an imaging method according to an embodiment of the present invention is described below with reference to the accompanying drawings, wherein a plurality of pixel units corresponding to filters of the same color constitute a merged pixel.
图8是根据本发明实施例的成像方法的流程图,如图8所示,该成像方法包括以下步骤:FIG. 8 is a flowchart of an imaging method according to an embodiment of the present invention. As shown in FIG. 8, the imaging method includes the following steps:
S1,读取像素单元阵列的输出。S1, reading the output of the pixel unit array.
S2,将同一合并像素的像素单元的输出相加以得到合并像素的像素值从而生成合并图像。S2, adding the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel to generate a merged image.
本发明实施方式的成像方法,假定原有每个像素单元的输出为S,噪声为N,合并像素 包括M个像素单元,则合并像素的像素值为n*m*S,而合并像素的噪声为
Figure PCTCN2016100880-appb-000001
在n=2,m=2的情况下,合成像素的噪声即为n*m*N/2左右。因此合并图像的亮度在低亮度环境下得到提升,而且性噪比提高。
The imaging method of the embodiment of the present invention assumes that the output of each pixel unit is S, the noise is N, and the merged pixel includes M pixel units, and the pixel value of the merged pixel is n*m*S, and the noise of the merged pixel for
Figure PCTCN2016100880-appb-000001
In the case of n=2 and m=2, the noise of the synthesized pixel is about n*m*N/2. Therefore, the brightness of the merged image is improved in a low-brightness environment, and the noise-to-noise ratio is improved.
请参阅图9,在某些实施方式中,图像传感器的每个同一颜色的滤光片对应2*2个像素单元,图像传感器包括寄存器,步骤S2进一步包括:Referring to FIG. 9, in some embodiments, each filter of the same color of the image sensor corresponds to 2*2 pixel units, the image sensor includes a register, and step S2 further includes:
S201,采集第k行及第k+1行的像素单元的输出并存入寄存器,其中k=2n-1,n为自然数,k+1小于等于像素单元阵列的总行数;S201, collecting the output of the pixel unit of the kth row and the k+1th row and storing the register, wherein k=2n-1, n is a natural number, and k+1 is less than or equal to the total number of rows of the pixel unit array;
S202,从寄存器中提取第k行及第k+1行的像素单元的输出,将同一合并像素的像素单元的输出相加以得到合并像素的像素值。S202. Extract the output of the pixel unit of the kth row and the k+1th row from the register, and add the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel.
如此,可以充分利用寄存器来实现像素单元的输出读出、缓存及合并的过程。In this way, the process of reading, buffering, and merging the output of the pixel unit can be fully utilized by the register.
请参图10,在某些实施方式中,步骤S2进一步包括:Referring to FIG. 10, in some embodiments, step S2 further includes:
S301,将像素单元产生的模拟信号输出转换为数字信号输出;及S301. Convert an analog signal output generated by the pixel unit into a digital signal output; and
S302,将同一合并像素的像素单元的数字信号输出相加以得到合并像素的像素值。S302. The digital signal outputs of the pixel units of the same merged pixel are added to obtain pixel values of the merged pixels.
如此,一来,一般为数字信号处理芯片的图像处理模块可以直接处理图像传感器的输出,二来,相对于某些通过电路直接对图像传感器的模拟信号格式的输出进行处理的方案来说,较好地保留了图像的信息,例如,对于16M像素的图像传感器来说,本发明实施方式的成像方法既可以成生4M像素(将2*2的像素合并)的合并图像,也可以生成16M像素(即不合并)的原图像。In this way, the image processing module, which is generally a digital signal processing chip, can directly process the output of the image sensor, and secondly, compared with some schemes that directly process the output of the analog signal format of the image sensor through the circuit, The information of the image is well preserved. For example, for an image sensor of 16 M pixels, the imaging method of the embodiment of the present invention can generate a combined image of 4 M pixels (merging 2*2 pixels) or 16 M pixels. The original image (ie not merged).
本发明再一方面实施例还提出一种移动终端,该移动终端包括壳体、处理器、存储器、电路板和电源电路,其中,所述电路板安置在所述壳体围成的空间内部,所述处理器和所述存储器设置在所述电路板上;所述电源电路,用于为所述移动终端的各个电路或器件供电;所述存储器用于存储可执行程序代码;所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序,以用于执行上述方面的成像方法。A further embodiment of the present invention further provides a mobile terminal, comprising: a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the housing, The processor and the memory are disposed on the circuit board; the power supply circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is configured to store executable program code; the processor A program corresponding to the executable program code is executed by reading executable program code stored in the memory for performing the imaging method of the above aspect.
本发明实施例还提供了一种计算机可读存储介质,具有存储于其中的指令,当移动终端的处理器执行所述指令时,所述移动终端执行如参考图8所示的本发明实施例的成像方法。The embodiment of the present invention further provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instruction, the mobile terminal performs the embodiment of the present invention as shown in FIG. Imaging method.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括 所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order between them. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. In the absence of more restrictions, the elements defined by the statement "including one..." are not excluded from inclusion. There are additional identical elements in the process, method, article or device of the elements.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
需要说明的是,在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。It should be noted that in the description of the specification, the descriptions of the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" and the like are meant to be combined with the embodiments or The specific features, structures, materials, or characteristics described in the examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。 In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.
尽管上面已经示出和描述了本发明的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本发明的限制,本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。 Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Claims (18)

  1. 一种图像传感器,其特征在于,包括:An image sensor, comprising:
    像素单元阵列,包括多个像素单元;a pixel unit array comprising a plurality of pixel units;
    增幅转换单元,用于将像素单元产生的光生电荷转换为模拟信号;及An amplification conversion unit for converting a photo-generated charge generated by the pixel unit into an analog signal; and
    设置于所述像素单元阵列上的滤光阵列,滤光阵列包括多个滤光片,同一颜色的所述滤光片对应于多个像素单元;a filter array disposed on the pixel unit array, the filter array includes a plurality of filters, and the filter of the same color corresponds to a plurality of pixel units;
    其中,所述同一颜色的滤光片所对应的多个像素单元产生的光生电荷经增幅转换单元转换后输出一个第一模拟信号和一个第二模拟信号,所述第一模拟信号和所述第二模拟信号不相同。The photo-generated charge generated by the plurality of pixel units corresponding to the filter of the same color is converted by the amplification conversion unit to output a first analog signal and a second analog signal, the first analog signal and the first The two analog signals are different.
  2. 如权利要求1所述的图像传感器,其特征在于,所述同一颜色的滤光片所对应的多个像素单元中用于输出第一模拟信号的所有像素单元的光生电荷累加后共用一个增幅转换单元输出,所述同一颜色的滤光片所对应的多个像素单元中用于输出第二模拟信号的所有像素单元中每一个像素单元的光生电荷均独立使用一个增幅转换单元输出。The image sensor according to claim 1, wherein the photo-generated charges of all the pixel units for outputting the first analog signal in the plurality of pixel units corresponding to the filter of the same color share an amplification conversion The unit outputs that the photo-generated charges of each of the pixel units for outputting the second analog signal in the plurality of pixel units corresponding to the filter of the same color are independently output by using an amplification conversion unit.
  3. 如权利要求1所述的图像传感器,其特征在于,所述图像传感器包括CMOS图像传感器。The image sensor of claim 1 wherein said image sensor comprises a CMOS image sensor.
  4. 如权利要求1所述的图像传感器,其特征在于,所述滤光阵列包括拜耳阵列。The image sensor of claim 1 wherein said filter array comprises a Bayer array.
  5. 如权利要求2所述的图像传感器,其特征在于,还包括:The image sensor of claim 2, further comprising:
    模数转换单元,用于将第一模拟信号和第二模拟信号分别转换为第一数字信号和第二数字信号。And an analog to digital conversion unit, configured to convert the first analog signal and the second analog signal into a first digital signal and a second digital signal, respectively.
  6. 如权利要求1-5任一项所述的图像传感器,其特征在于,所述同一颜色的滤光片所对应的多个像素单元位于像素单元阵列的不同行。The image sensor according to any one of claims 1 to 5, wherein the plurality of pixel units corresponding to the filters of the same color are located in different rows of the pixel unit array.
  7. 如权利要求1-6任一项所述的图像传感器,其特征在于,所述同一颜色的滤光片对应2行2列共计4个像素单元,位于第一行中的2个像素单元产生的光生电荷累加后经过增幅转换单元转换为第一模拟信号,位于第二行中的2个像素单元中每个像素单元产生的光生电荷经过对应的增幅转换单元转换为第二模拟信号,所述第一模拟信号和第二模拟信号再通过一个模数转换单元分别转换为一个第一数字信号和第二数字信号。The image sensor according to any one of claims 1 to 6, wherein the filter of the same color corresponds to two rows and two columns of a total of four pixel units, and is generated by two pixel units located in the first row. The photo-generated charge is converted into a first analog signal by the amplification conversion unit, and the photo-generated charge generated by each pixel unit in the two pixel units in the second row is converted into a second analog signal by the corresponding amplification conversion unit. An analog signal and a second analog signal are respectively converted into a first digital signal and a second digital signal by an analog to digital conversion unit.
  8. 如权利要求1所述的图像传感器,其特征在于,还包括:The image sensor of claim 1 further comprising:
    设置在所述滤光阵列上的微镜阵列,所述微镜阵列中的每个微镜与一个所述像素单元对应。A micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to one of the pixel units.
  9. 如权利要求5所述的图像传感器,其特征在于,还包括: The image sensor of claim 5, further comprising:
    控制模块和图像处理模块,所述控制模块用于控制所述像素单元阵列按照行依次曝光,所述图像处理模块对所述模数转换单元的输出进行合成以获得高动态范围图像。And a control module for controlling the pixel unit array to be sequentially exposed in rows, and the image processing module synthesizes the output of the analog to digital conversion unit to obtain a high dynamic range image.
  10. 一种终端,其特征在于,包括如权利要求1-9任一项所述的图像传感器。A terminal characterized by comprising the image sensor according to any one of claims 1-9.
  11. 如权利要求10所述的终端,其特征在于,所述终端包括手机。The terminal of claim 10 wherein said terminal comprises a handset.
  12. 如权利要求10所述的终端,其特征在于,所述终端还包括与所述图像传感器连接的中央处理器及显示装置,所述中央处理器用于控制所述显示装置显示所述图像传感器输出的高动态范围图像。The terminal according to claim 10, wherein said terminal further comprises a central processing unit and said display device coupled to said image sensor, said central processor for controlling said display device to display said image sensor output High dynamic range image.
  13. 一种基于如权利要求1所述的图像传感器的成像方法,其特征在于,所述同一颜色的滤光片所对应的多个像素单元构成合并像素,所述图像处理方法包括:An imaging method of the image sensor according to claim 1, wherein the plurality of pixel units corresponding to the filters of the same color constitute a merged pixel, and the image processing method comprises:
    读取所述像素单元阵列的输出;以及Reading the output of the array of pixel cells;
    将同一所述合并像素的所述像素单元的输出相加以得到所述合并像素的像素值从而生成合并图像。The outputs of the pixel units of the same merged pixel are added to obtain pixel values of the merged pixels to generate a merged image.
  14. 如权利要求13所述的成像方法,其特征在于,每个所述同一颜色的滤光片对应2*2个所述像素单元。The image forming method according to claim 13, wherein each of said filters of the same color corresponds to 2*2 of said pixel units.
  15. 如权利要求13或14所述的成像方法,其特征在于,所述图像传感器包括寄存器,所述读出步骤进一步包括:The imaging method according to claim 13 or 14, wherein said image sensor comprises a register, and said reading step further comprises:
    采集第k行及第k+1行的所述像素单元的输出并存入所述寄存器,其中k=2n-1,n为自然数,k+1小于等于所述像素单元的总行数;及Acquiring an output of the pixel unit of the kth row and the k+1th row and storing the register, wherein k=2n-1, n is a natural number, and k+1 is less than or equal to a total number of rows of the pixel unit;
    从所述寄存器中提取所述第k行及第k+1行的所述像素单元的输出,将同一所述合并像素的所述像素单元的输出相加以得到所述合并像素的像素值。Extracting an output of the pixel unit of the kth row and the k+1th row from the register, and adding an output of the pixel unit of the same merged pixel to obtain a pixel value of the merged pixel.
  16. 如权利要求13至15中任一项所述的成像方法,其特征在于,所述读出步骤进一步包括:The image forming method according to any one of claims 13 to 15, wherein the reading step further comprises:
    将所述像素单元产生的模拟信号输出转换为数字信号输出。The analog signal output produced by the pixel unit is converted to a digital signal output.
  17. 一种移动终端,包括壳体、处理器、存储器、电路板和电源电路,其中,所述电路板安置在所述壳体围成的空间内部,所述处理器和所述存储器设置在所述电路板上;所述电源电路,用于为所述移动终端的各个电路或器件供电;所述存储器用于存储可执行程序代码;所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序,以用于执行如权利要求13至16中任一项所述的成像方法。A mobile terminal includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the housing, and the processor and the memory are disposed in the a power supply circuit for supplying power to respective circuits or devices of the mobile terminal; the memory for storing executable program code; the processor reading an executable program stored in the memory The code runs a program corresponding to the executable program code for performing the imaging method according to any one of claims 13 to 16.
  18. 一种计算机可读存储介质,具有存储于其中的指令,当移动终端的处理器执行所述指令时,所述移动终端执行如权利要求13至16中任一项所述的成像方法。 A computer readable storage medium having instructions stored therein, the mobile terminal performing the imaging method of any one of claims 13 to 16 when the processor of the mobile terminal executes the instructions.
PCT/CN2016/100880 2015-12-18 2016-09-29 Image sensor, terminal comprising same, and imaging method WO2017101558A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510963291.9 2015-12-18
CN201510963291.9A CN105516695B (en) 2015-12-18 2015-12-18 Imaging sensor and with its terminal

Publications (1)

Publication Number Publication Date
WO2017101558A1 true WO2017101558A1 (en) 2017-06-22

Family

ID=55724290

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/100880 WO2017101558A1 (en) 2015-12-18 2016-09-29 Image sensor, terminal comprising same, and imaging method

Country Status (3)

Country Link
CN (1) CN105516695B (en)
TW (1) TWI615034B (en)
WO (1) WO2017101558A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516695B (en) * 2015-12-18 2018-06-15 广东欧珀移动通信有限公司 Imaging sensor and with its terminal
JP6461429B2 (en) * 2015-12-18 2019-01-30 広東欧珀移動通信有限公司 Image sensor, control method, and electronic apparatus
CN105578074B (en) * 2015-12-18 2017-11-10 广东欧珀移动通信有限公司 Imaging sensor and there is its terminal
CN106341617B (en) * 2016-11-16 2019-08-02 信利光电股份有限公司 A kind of method and device of camera crosstalk compensation

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060071254A1 (en) * 2004-09-28 2006-04-06 Rhodes Howard E High dynamic range image sensor
CN104780321A (en) * 2014-01-10 2015-07-15 全视科技有限公司 Method for capturing image data, HDR imaging system for use and pixel
CN105516695A (en) * 2015-12-18 2016-04-20 广东欧珀移动通信有限公司 Image sensor and terminal provided with image sensor
CN105578074A (en) * 2015-12-18 2016-05-11 广东欧珀移动通信有限公司 Image sensor and terminal having the same
CN105611198A (en) * 2015-12-18 2016-05-25 广东欧珀移动通信有限公司 Image sensor and terminal therewith

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101931756B (en) * 2009-06-19 2012-03-21 比亚迪股份有限公司 Device and method for improving dynamic range of CMOS image sensor
JP2011015219A (en) * 2009-07-02 2011-01-20 Toshiba Corp Solid-state imaging device
EP2442556A1 (en) * 2010-10-15 2012-04-18 ST-Ericsson SA Apparatus and method for capturing images with high dynamic range
JP2013021660A (en) * 2011-07-14 2013-01-31 Sony Corp Image processing apparatus, image pickup apparatus, image processing method, and program
JP2013066140A (en) * 2011-08-31 2013-04-11 Sony Corp Imaging device, signal processing method, and program
WO2014144391A1 (en) * 2013-03-15 2014-09-18 Rambus Inc. Threshold-monitoring, conditional-reset image sensor
CN103686007B (en) * 2013-12-31 2018-11-09 上海集成电路研发中心有限公司 Single shot generates the imaging sensor of high dynamic range images
CN103780850B (en) * 2014-01-30 2017-12-15 上海集成电路研发中心有限公司 Pixel divides with merging imaging sensor and its method for transmitting signals
CN103957345B (en) * 2014-04-08 2017-05-24 京东方科技集团股份有限公司 Method and system for processing image signals and displayer
US9666631B2 (en) * 2014-05-19 2017-05-30 Omnivision Technologies, Inc. Photodiode and filter configuration for high dynamic range image sensor
CN104580945B (en) * 2014-12-29 2018-08-10 上海集成电路研发中心有限公司 A kind of image sensor architecture and method for realizing high dynamic range images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060071254A1 (en) * 2004-09-28 2006-04-06 Rhodes Howard E High dynamic range image sensor
CN104780321A (en) * 2014-01-10 2015-07-15 全视科技有限公司 Method for capturing image data, HDR imaging system for use and pixel
CN105516695A (en) * 2015-12-18 2016-04-20 广东欧珀移动通信有限公司 Image sensor and terminal provided with image sensor
CN105578074A (en) * 2015-12-18 2016-05-11 广东欧珀移动通信有限公司 Image sensor and terminal having the same
CN105611198A (en) * 2015-12-18 2016-05-25 广东欧珀移动通信有限公司 Image sensor and terminal therewith

Also Published As

Publication number Publication date
CN105516695A (en) 2016-04-20
TW201724848A (en) 2017-07-01
CN105516695B (en) 2018-06-15
TWI615034B (en) 2018-02-11

Similar Documents

Publication Publication Date Title
WO2017101560A1 (en) Image sensor, terminal having image sensor, imaging method
TWI615029B (en) Image sensor, terminal having same and imaging method using same
JP6564462B2 (en) Image sensor imaging method, imaging apparatus, and electronic apparatus
WO2017101451A1 (en) Imaging method, imaging device, and electronic device
AU2016369789B2 (en) Image sensor, imaging device, mobile terminal and imaging method
WO2017101864A1 (en) Image sensor, control method, and electronic device
WO2017101558A1 (en) Image sensor, terminal comprising same, and imaging method
WO2017101561A1 (en) Method for generating high dynamic range image, and photographing apparatus, terminal and imaging method
TW200529658A (en) Method of controlling semiconductor device, signal processing method, semiconductor device, and electronic apparatus
KR20100006033A (en) Photo-electricity converter having wide dynamic range and method thereof
US9843746B2 (en) Image sensor combining high dynamic range techniques
WO2017101562A1 (en) Image sensor, terminal having same, and imaging method
US10051216B2 (en) Imaging apparatus and imaging method thereof using correlated double sampling
CN113676652A (en) Image sensor, control method, control device, electronic apparatus, and storage medium
JP2008177760A (en) Solid-state imaging apparatus, and imaging apparatus
KR20220166013A (en) Image sensing device and operating method thereof
KR20240082130A (en) Electronic device for obtaining image data and method of the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874618

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16874618

Country of ref document: EP

Kind code of ref document: A1