TWI615034B - Image sensor, imaging terminal having same and imaging method using same - Google Patents

Abstract

The invention discloses an image sensor comprising a pixel unit array, an amplification conversion unit and a filter array, wherein the pixel unit array comprises a plurality of pixel units; and the amplitude conversion unit is used for drawing The photo-generated charge generated by the element is converted into an analog signal; the filter array is disposed on the pixel unit array, each filter array includes a plurality of filter units, and the filter unit of the same color corresponds to the plurality of pixel units; wherein The photo-generated charge generated by the plurality of pixel units corresponding to the filter unit of the same color is converted by the amplification conversion unit to output a first analog signal and a second analog signal, and the first analog signal and the second analog signal are different. The invention also discloses an imaging terminal and an imaging method.

Description

Image sensor and imaging terminal and imaging method

The present invention belongs to the field of image processing technologies, and in particular, to an image sensor, and an imaging terminal and an imaging method having the image sensor.

With the popularity of mobile phones, taking pictures with mobile phones has become a favorite of more and more people. However, with the improvement of the requirements for photographing, the HDR (High-Dynamic Range) function of the image processing of the mobile phone has become a demand of the user. However, at present, the HDR function is generally implemented by software, and the effect is not obvious.

The present invention aims to solve at least one of the technical problems in the related art to some extent.

In order to solve the above problems, an aspect of the present invention provides an image sensor, the image sensor comprising: a pixel unit array including a plurality of pixel units; and an amplification conversion unit for generating light generated by the pixel unit The charge is converted into an analog signal; a filter array disposed on the pixel unit array, each filter array includes a plurality of filter units, and the filter unit of the same color corresponds to a plurality of pixel units; wherein the same color The photo-generated charge generated by the complex pixel unit corresponding to the filter unit is converted by the amplification conversion unit to output a first analog signal and a second analog signal, and the first analog signal and the second analog signal are different.

In the image sensor of the present invention, the filter unit based on the same color corresponds to a plurality of pixel units, and the plurality of pixel units corresponding to the filter unit of the same color are converted by the amplitude conversion unit to output two different analog signals, thereby To provide a hardware foundation for implementing HDR functions, the image sensor can realize HDR function and improve HDR effect by improving hardware by implementing HDR function compared with software in related art.

In some embodiments of the present invention, the photo-generated charges of all the pixel units for outputting the first analog signal in the complex pixel unit corresponding to the filter unit of the same color share an amplification conversion unit output, the same The photo-generated charges of each of the pixel units of the plurality of pixel units for outputting the second analog signal in the complex pixel unit corresponding to the color filter unit are independently output by using an amplification conversion unit.

In at least one embodiment, the image sensor comprises a CMOS image sensor.

In at least one embodiment, the filter array comprises a Bayer array.

In at least one embodiment, the image sensor further includes: an analog-to-digital converter (ADC) for converting the first analog signal and the second analog signal into the first digital signal respectively. And the second digit signal.

In at least one embodiment, the plurality of pixel units corresponding to the filter elements of the same color are located in different rows of the pixel unit array.

In at least one embodiment, the filter unit of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, and the photogenerated charges generated by the 2 pixel units in the first row are accumulated and converted into the first by the amplification conversion unit. A type of ratio signal, the photo-generated charge generated by each pixel unit in the two pixel units in the second row is converted into a second analog signal by the corresponding amplification conversion unit, and the first analog signal and the second analog signal are borrowed. It is converted into a first digital signal and a second digital signal by an analog digital conversion unit.

In at least one embodiment, the image sensor further includes: a micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to one of the pixel units.

In at least one embodiment, the image sensor further includes a control module and an image processing module, wherein the control module is configured to control the pixel unit array to sequentially expose the pixels, and the image processing module compares the analog digital The output of the conversion unit is synthesized to obtain a high dynamic range image.

In order to solve the above problems, another aspect of the present invention provides an imaging terminal including the image sensor of the above aspect.

In the imaging terminal of the present invention, by using the image sensor, the HDR function can be realized based on the hardware structure of the image sensor, and the HDR image effect is improved.

In at least one embodiment, the imaging terminal includes a cell phone.

In at least one embodiment, the imaging terminal further includes a central processing unit and a display device coupled to the image sensor, the central processor configured to control the display device to display a high dynamic range map of the image sensor output image.

Another aspect of the present invention provides an imaging method based on the image sensor described above, wherein the plurality of pixel units corresponding to the filter unit of the same color constitute a merged pixel, and the image processing method includes: reading the picture An output of the cell array; and adding the output of the pixel unit of the same merged pixel to obtain a pixel value of the merged pixel to generate a merged image.

Since the noise of the merged pixels is smaller than the sum of the pixel noises before the combination, the imaging method can obtain images with high signal-to-noise ratio, brightness and sharpness, and less noise under low illumination. Overcoming the shortcomings of some existing imaging methods.

In at least one embodiment, the imaging device includes a temporary memory, each of the filter units covering 2*2 of the photographic pixels; the reading step further comprising: collecting the kth line and the k+1th line The output of the photographic pixel is stored in the register, where k=2n-1, n is a natural number, and k+1 is less than or equal to the photographic image The total number of rows of the prime array; and extracting the output of the photosensitive pixel of the kth row and the k+1th row from the register, and adding the output of the photosensitive pixel of the same pixel to obtain the merge The prime value of the pixel.

In at least one embodiment, the step of reading further includes converting the analog signal output of the photoreceptor to a digital signal output.

In order to solve the above problems, another embodiment of the present invention provides a mobile terminal, which includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed in the housing Inside the space, the processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is used to store executable code; the processor borrows The program corresponding to the executable code is executed by reading the executable code stored in the memory for performing the imaging method described in the above embodiment of the present invention.

In the mobile terminal of the embodiment of the present invention, by reading the output of the pixel unit array, the output of the pixel unit of the same merged pixel is added to obtain a pixel value of the combined pixel to generate a merged image, The noise of the combined pixels is smaller than the sum of the pixel noises before the combination, and the image with higher signal to noise ratio, brightness and sharpness, and less noise can be obtained under low illumination.

In order to solve the above problems, a further embodiment of the present invention provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instruction, the mobile terminal performs the embodiment as in the above aspect. The imaging method described.

The additional aspects and advantages of the invention will be set forth in part in the description which follows.

10‧‧‧ pixel element array

11‧‧‧Photosensitive unit

20‧‧‧Incremental conversion unit

30‧‧‧Filter array

31‧‧‧ Filter unit

40‧‧‧ analog digital conversion unit

50‧‧‧Micromirror array

51‧‧‧Micromirror

100‧‧‧Image sensor

111‧‧‧Photosensitive part

200‧‧‧ central processor

300‧‧‧ display device

1000‧‧‧ imaging terminal

A1, A2‧‧‧ analog signal

D1, D2‧‧‧ digital signal

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from 1 is a schematic diagram of an image sensor according to an embodiment of the present invention; FIG. 2 is a schematic diagram of an image sensor according to another embodiment of the present invention; and FIG. 3 is a diagram according to the present invention. A schematic diagram of a distribution of filters of a specific embodiment; FIG. 4 is an equivalent circuit diagram of an image sensor according to an embodiment of the present invention; and FIG. 5 is an image sensor according to still another embodiment of the present invention. FIG. 6 is a functional block diagram of an imaging terminal according to an embodiment of the present invention; FIG. 7 is a functional module diagram of an imaging terminal according to another embodiment of the present invention; A flowchart of an imaging method of an embodiment of the invention; FIG. 9 is a flow chart of an imaging method according to an embodiment of the present invention; and FIG. 10 is a flow chart of an imaging method according to another embodiment of the present invention.

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

An image sensor and an imaging terminal having the image sensor according to an embodiment of the present invention will be described below with reference to the accompanying drawings.

First, an image sensor of an embodiment of the present invention will be described. As shown in FIG. 1, the image sensor 100 includes a pixel unit array 10, an amplification conversion unit 20, and a filter array 30.

The pixel unit array 10 includes a complex pixel unit 11; the amplification conversion unit 20 is configured to convert the photogenerated charges generated by the pixel unit 11 into analog signals; the filter array 30 is disposed on the pixel unit array 10, and each filter array The filter unit 31 includes a plurality of filter units 31, and the filter unit 31 of the same color corresponds to the plurality of pixel units 11.

The photo-generated charge generated by the complex pixel unit 11 corresponding to the filter unit 31 of the same color is converted by the amplification conversion unit 20 to output a first analog signal A1 and a second analog signal A2, the first analog signal A1 and the first The second type is different from the signal A2.

In the image sensor 100 of the embodiment of the present invention, the filter unit 31 based on the same color corresponds to the plurality of pixel units 11, and the plurality of pixel units 11 corresponding to the filter unit 31 of the same color are converted by the amplification unit 20 and output. The two different analog signals provide a hardware foundation for implementing the HDR function. Compared with the software in the related art, the image sensor 100 can improve the HDR effect by implementing the HDR function on the hardware. .

In some embodiments of the present invention, the photo-generated charges of all the pixel units 11 for outputting the first analog signal A1 in the complex pixel unit 11 corresponding to the filter unit 31 of the same color share an amplification conversion unit 20 The output, the photo-generated charge of each of the pixel units 11 of all the pixel units 11 for outputting the second analog signal A2 in the complex pixel unit 11 corresponding to the filter unit 31 of the same color independently uses an amplification conversion unit 20 Output. It can be understood that the first analog signal A1 is equivalent to the sum of the photo-generated charges of one of the pixel units 11 of the complex pixel unit 11 corresponding to the filter unit 31 of the same color, and the second analog signal A2 is equivalent to the The mean value of the photo-generated charges of the other portion of the pixel unit 11 in the complex pixel unit 11, whereby the synthesis of the HDR image can be provided based on the hardware structure.

In some embodiments of the invention, image sensor 100 includes a CMOS (Complementary Metal Oxide Semiconductor) image sensor. Filter array 30 includes a Bayer array.

As shown in FIG. 2, the image sensor 100 further includes an analog digital conversion unit 40 that converts the first analog signal A1 and the second analog signal A2 into a first digital signal D1 and a second digital signal, respectively. Signal D2 provides information for image processing.

In some embodiments of the present invention, the plurality of pixel units 11 corresponding to the filter unit 31 of the same color are located in different rows of the pixel unit array 10.

For example, the filter unit 31 of the same color corresponds to a total of four pixel units 11 in two rows and two columns, and the photo-generated charges generated by the two pixel units 11 in the first row are accumulated and converted into the first analogy by the amplification conversion unit 20. The signal A1, the photo-generated charge generated by each pixel unit 11 in the two pixel units in the second row is converted into the second analog signal A2 by the corresponding amplification conversion unit 20, and the first analog signal A1 and the second analog signal A2 is further converted into a first digital signal D1 and a second digital signal D2 by an analog digital conversion unit 40, respectively.

Referring to FIG. 3, which is a schematic diagram of the distribution of the filter array 30 according to an embodiment of the present invention, the filter array 30 adopts a Bayer array color mode in which the same character represents the filter unit 31 of the same color (for example, Gr, Gb, R, B), the number after the character indicates the row number of the pixel unit corresponding to the filter unit 31 of the same color, and the filter unit 31 of the different colors allows only the light of the corresponding wavelength to pass.

4 is an equivalent circuit diagram of an image sensor 100 according to an embodiment of the present invention. As shown in FIG. 4, the first pixel unit PD1 and the first transfer switch TG1 and the second pixel unit PD2 are included. And a second transfer switch TG2, a third pixel unit PD3 and a third transfer switch TG3, a fourth pixel unit PD4 and a fourth transfer switch TG4, a first amplification conversion unit SF1, a second amplification conversion unit SF2, and a third increase Conversion unit SF3, analog to digital conversion (ADC) unit 40. The pixel unit 11, for example, a photodiode, receives the light transmitted by the filter unit 31 to generate a charge, and the transfer switch is turned on, and the charge generated by the corresponding pixel unit 11 is output, and then coupled and converted in the amplification conversion unit 20. The voltage signal is converted into a digital signal output by an analog digital conversion unit to provide a data basis for image processing.

The first pixel unit PD1, the second pixel unit PD2, the third pixel unit PD3, and the fourth pixel unit PD4 are pixel units respectively adjacent to the filter unit 31 of the same color, for example, the fourth pixel unit. As shown in the figure, the pixel unit 11 corresponding to the filter unit 31 having the same identifier is received, that is, four adjacent pixel units receive light of the same color, in short, four pixel units. Form a large pixel (pixel). And the first pixel unit PD1 and the second pixel unit PD2 are located in the same row, and the third pixel unit PD3 and the fourth pixel unit PD4 are located in the same row.

Specifically, the first pixel unit PD1 is connected to the first end of the first amplification conversion unit SF1 by the first transmission switch TG1, and the second pixel unit PD2 is coupled to the first amplification conversion unit SF1 by the second transmission switch TG2. The first end is connected, the second end of the first amplification conversion unit SF1 is connected to a preset power source such as Vdd, and the third pixel unit PD3 is connected to the first end of the second amplification conversion unit SF2 by the third transmission switch TG3, and second The second end of the amplification conversion unit SF2 is connected to the preset power supply Vdd; the fourth pixel unit PD4 is connected to the first end of the third amplification conversion unit SF3 by the fourth transmission switch TG4, and the third end of the third amplification conversion unit SF3 The preset power supply Vdd is connected; the control end of the first transfer switch TG1, the control end of the second transfer switch TG2, the control end of the third transfer switch TG3, and the control end of the fourth transfer switch TG4 are all connected with the control module, and the control mode is The group controls the opening and closing of the four transmission switches, and when the transmission switch is turned on, the corresponding pixel unit 11 transmits a signal.

The input terminals of the analog-to-digital conversion unit 40 are respectively connected to the third end of the first amplification conversion unit SF1, the third end of the second amplification conversion unit SF2, and the third end of the third amplification conversion unit SF3.

It can be understood that the circuit obtained by integrally swapping the circuit diagrams in FIG. 4 is also included in the scope of the present application, that is, the two pixel units of the lower side share an amplification conversion unit, and the two pixel units of the upper side are adjacent. The use of an amplification conversion unit separately is also included in the scope of the present application, but differs from the component numbers.

In order to achieve the control of exposure, as shown in FIG. 4, the image sensor 100 further includes a control module, an image processor, a first reset unit RST1, a first selection unit SEL1, a second reset unit RST2, and a third reset. The unit RST3 and the second selection unit SEL2.

The first end of the first resetting unit RST1 is respectively connected to the first end of the first transfer switch TG1, the second transfer switch TG2 and the first amplification conversion unit SF1, and the second end of the first reset unit RST1 is connected to the preset power supply. Vdd, the first end of the first selection unit SEL1 is connected to the third end of the first amplification conversion unit SF1, and the second end of the first selection unit SEL1 is connected to the input end of the analog digital conversion unit 40. The first end of the second reset unit RST2 is connected to the first end of the third transfer switch TG3 and the second increase conversion unit SF2, respectively, and the second end of the second reset unit RST2 is connected to the preset power supply Vdd; the third reset unit RST3 The first end is connected to the first end of the fourth transfer switch TG4 and the third amplification conversion unit SF3, and the second end of the third reset unit RST3 is connected to the preset power supply Vdd; the first end of the second selection unit SEL2 is respectively The third end of the second amplification conversion unit SF2 is connected to the third end of the third amplification conversion unit SF3, and the second end of the second selection unit SEL2 is connected to the input end of the analog digital conversion unit 40. Specifically, as shown in FIG. 4, the second end of the first selection unit SEL1 and the second end of the second selection unit SEL2 are connected to the readout line (READOUT COLUMN), and the input of the analog-to-digital conversion unit 40 is connected to the READOUT COLUMN. .

The third end of the first reset unit RST1, the third end of the first selection unit SEL1, the third end of the second reset unit RST2, the third end of the third reset unit RST3, and the third of the second selection unit SEL2 The terminal receives the control signal of the control module, and the control module controls the pixel unit array 10 to sequentially expose according to the line, and controls the exposure time, that is, realizes the exposure control in the HDR process, thereby providing a data basis for realizing HDR, and then image sensing. Module 100 synthesizes the output of analog digital conversion unit 40 to obtain a high dynamic range image.

As an example, two pixel units corresponding to each filter unit 31 of the 2i+1 (i=0, 1, 2, 3, 4...) row in the pixel unit array 10 (such as the filter unit Gr1, The pixel unit corresponding to Gr2, that is, the first pixel unit PD1 and the second pixel unit PD2, share an amplification conversion unit, that is, a first amplification conversion unit SF1, a first pixel unit PD1 and a second pixel unit PD2. After the generated charge is collected, the charge accumulated by the first pixel unit PD1 and the second pixel unit PD2 is converted into a voltage signal by the first amplification conversion unit SF1, and further converted into a digital signal output by the analog digital conversion unit 40. In this case, the output value of the analog-to-digital conversion unit 40 is set to ADC1; in addition, each of the 2i+2 (i=0, 1, 2, 3, 4...) rows in the pixel unit array 10 adjacent to the 2i+1th row Two pixel units of the filter unit 31 (such as the pixel unit corresponding to the filter unit Gr3, Gr4), that is, the third pixel unit PD3 and the fourth pixel unit PD4 are respectively The second amplification conversion unit SF2 and the third amplification conversion unit SF3 perform charge conversion, and finally are converted into digital signal output by the analog digital conversion unit 40, and the analog digital conversion unit 40 outputs the output value of ADC2.

2SF2

2SF3，其中，ADC2輸出之值為SF2和SF3之均值即為一個相對較低的值，所以對應同一顏色之濾光單元31之四個畫素單元11依次輸出一個高ADC值和一個低ADC值，進而在圖像感測器100之ISP(Image Signal Processor,即影像處理器)端對高ADC值和低ADC值進行合成處理，從而獲得HDR圖像，該HDR圖像支持寬動態，HDR效果得到改善。 Specifically, the filter unit 31 of the same color is used as an example for the four pixel units adjacent to the two rows and two columns. Based on the above-mentioned circuit structure, as shown in FIG. 4, when the HDR is performed, the control module controls the phase. The pixel units of the same color in two adjacent rows are sequentially exposed. For example, the 2i+1 and 2i+2 lines are sequentially exposed, wherein i=0, 1, 2, 3, ..., and the exposure time is controlled to avoid sharing the first. The output of the two pixel units 11 of the amplification conversion unit SF1 is saturated. In the embodiment of the present invention, the amplification conversion unit 20 can function as a summary coupling to the charge output from the pixel unit 11. It can be understood that the first amplification conversion unit SF1, the second amplification conversion unit SF2, and the first The charge amount or the converted voltage value of the three-amplitude conversion unit SF3 is satisfied: SF1

2SF2

2SF3, wherein the value of the output of the ADC2 is a relatively low value of the average value of SF2 and SF3, so the four pixel units 11 of the filter unit 31 corresponding to the same color sequentially output a high ADC value and a low ADC value. Then, the high ADC value and the low ADC value are combined at the ISP (Image Signal Processor) end of the image sensor 100 to obtain an HDR image, and the HDR image supports wide dynamic and HDR effects. Improved.

As shown in FIG. 5, the image sensor 100 further includes a micromirror array 50 disposed on the filter array 30. Each of the micromirrors 51 in the micromirror array 50 corresponds to a pixel unit 11, including formation, Size and position correspond. The micromirror 51 can collect light to the photosensitive portion 111 of the pixel unit 11, and enhance the received light intensity of the pixel unit 11, thereby improving the image quality.

Based on the image sensor 100 of the above-described embodiments, an imaging terminal 1000 according to another embodiment of the present invention will be described below with reference to the accompanying drawings.

Fig. 6 is a functional block diagram of an imaging terminal according to an embodiment of the present invention. As shown in Fig. 6, the imaging terminal 1000 includes the image sensor 100 of the above aspect. Specifically, the imaging terminal 1000 may include a mobile phone.

As shown in FIG. 7, the imaging terminal 1000 further includes a central processing unit 200 and a display device 300 connected to the image sensor 100. The central processing unit 200 is configured to control the display device 300 to display the output of the image sensor 100. Dynamic range image. Thus, the image captured by the imaging terminal 1000 can be displayed on the display device 300 for viewing by the user. The display device 300 includes an LED display or the like.

The imaging terminal 1000 can implement the HDR function based on the hardware structure of the image sensor 100 by using the image sensor 100 to enhance the HDR image effect.

Based on the image sensor 100 of the embodiment of the above aspect, an imaging method according to an embodiment of the present invention is described below with reference to the accompanying drawings, wherein a plurality of pixel units corresponding to the filter unit 31 of the same color constitute a merged pixel.

Figure 8 is a flow chart of an imaging method according to an embodiment of the present invention. As shown in Figure 8, the imaging method includes the following steps:

S1, reading the output of the pixel unit array 10.

S2, the outputs of the pixels of the same merged pixel are added to obtain the pixel values of the combined pixels to generate a merged image.

，在n=2，m=2之情況下，合成畫素之雜訊即為n*m*N/2左右。因此合併圖像之亮度在低亮度環境下得到提升，而且性噪比提高。 In the imaging method of the embodiment of the present invention, it is assumed that the output of each pixel unit 11 is S, the noise is N, and the merged pixels include M pixel units 11, and the pixel value of the combined pixel is n*m. *S, and the noise of the merged pixels is

In the case of n=2 and m=2, the noise of the synthesized pixel is about n*m*N/2. Therefore, the brightness of the combined image is improved in a low-brightness environment, and the noise-to-noise ratio is improved.

Referring to FIG. 9 , in some embodiments, each filter unit 31 of the same color of the image sensor 100 corresponds to 2*2 pixel units 11 , and the image sensor 100 includes a temporary register. Step S2 further includes: S201, collecting the output of the pixel unit of the kth row and the k+1th row and storing the output in the register, wherein k=2n-1, n is a natural number, and k+1 is less than or equal to the pixel unit. The total number of rows in the array; S202. Extract the output of the pixel unit of the kth row and the k+1th row from the scratchpad, and add the output of the pixel unit of the same merged pixel to obtain the pixel value of the combined pixel.

In this way, the register can be fully utilized to implement the process of reading, buffering, and merging the pixel units.

Referring to FIG. 10, in some embodiments, step S2 further includes: S301, converting an analog signal output generated by the pixel unit into a digital signal output; and S302, digitizing the pixel unit of the same combined pixel. The outputs are added to obtain the pixel values of the combined pixels.

In this way, the image processing module of the digital signal processing chip can directly process the output of the image sensor, and the output of the analog signal format directly compared to the image sensor by the circuit. In the case of processing, the information of the image is better preserved. For example, for an image sensor of 16M pixels, the imaging method of the embodiment of the present invention can generate 4M pixels (2* will be generated). The merged image of 2 pixels combined can also generate the original image of 16M pixels (ie, not merged).

A further embodiment of the present invention further provides a mobile terminal, the mobile terminal comprising a housing, a processor, a memory, a circuit board and a power supply circuit, wherein the circuit board is disposed inside the space enclosed by the housing, the processing And the memory is disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is used to store executable code; the processor reads the memory by reading The executable code stored therein runs a program corresponding to the executable code for performing the imaging method of the above aspect.

The embodiment of the present invention further provides a computer readable storage medium having instructions stored therein. When the processor of the mobile terminal executes the instruction, the mobile terminal performs imaging according to the embodiment of the present invention as shown in FIG. method.

In this document, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order. Furthermore, the term "comprises" or "comprises" or "comprising" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a singular" does not exclude the presence of the same element in the process, method, item, or device that comprises the element.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, For use in an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device), or in conjunction with such instructions, execute systems, devices Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with such an instruction execution system, apparatus, or device. More specific examples of computer readable media (non-exhaustive list) include the following: electrical connections (electronic devices) with one or more wires, portable computer case (magnetic device), random access memory (RAM) ), read-only memory (ROM), which can erase programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable CD-ROM (CDROM). In addition, the computer readable medium may even be a paper on which the program or other suitable medium may be printed, as it may be optically scanned, for example by paper or other media, followed by editing, interpretation or, if necessary, other The program is processed in an appropriate manner to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware, or combinations thereof. In the above embodiments, the plurality of steps or methods may be implemented with software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following techniques known in the art or a combination thereof: having a logic gate circuit for implementing logic functions on data signals Discrete logic circuit, dedicated integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA), etc.

In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means that the embodiment or The specific features, structures, materials, or characteristics described in the examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or a plurality of embodiments or examples. In addition, various embodiments or examples described in the specification and features of the various embodiments or examples may be combined and combined.

In the description of the specification, the descriptions of the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" and the like are intended to refer to the specific features described in connection with the embodiments or examples. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or a plurality of embodiments or examples. In addition, various embodiments or examples described in the specification and features of the various embodiments or examples may be combined and combined.

Although the embodiments of the present invention have been shown and described, it is understood that the foregoing embodiments are illustrative, and are not to be construed as limiting the scope of the invention. The embodiments are subject to changes, modifications, substitutions and variations.

10‧‧‧ pixel element array

11‧‧‧Photosensitive unit

20‧‧‧Incremental conversion unit

30‧‧‧Filter array

31‧‧‧ Filter unit

100‧‧‧Image sensor

A1, A2‧‧‧ analog signal

Claims (17)

An image sensor, comprising: a pixel unit array comprising a plurality of pixel units; an amplification conversion unit for converting a photogenerated charge generated by the pixel unit into an analog signal; a filter array on the pixel unit array, the filter array includes a plurality of filter units, the filter unit of the same color corresponding to a plurality of pixel units; wherein the plurality of pixels corresponding to the filter unit of the same color The photogenerated charge generated by the unit is converted by the amplification conversion unit to output a first analog signal and a second analog signal. The first analog signal and the second analog signal are different, and the plurality of filters corresponding to the filter unit of the same color The photo-generated charge of all the pixel units for outputting the first analog signal in the prime unit is shared by an amplification conversion unit output, and the plurality of pixel units corresponding to the filter unit of the same color is used to output the second analog ratio The photo-generated charge of each pixel unit in all pixel units of the signal is independently output using an amplification conversion unit. The image sensor of claim 1, wherein the image sensor comprises a CMOS image sensor. The image sensor of claim 1, wherein the filter array comprises a Bayer array. The image sensor of claim 1, wherein the image sensor further comprises: an analog-to-digital conversion unit configured to convert the first analog signal and the second analog signal into A first digit signal and a second digit signal. The image sensor according to any one of claims 1 to 4, wherein the plurality of pixel units corresponding to the filter unit of the same color are located in different rows of the pixel unit array. The image sensor according to any one of claims 1 to 4, wherein the filter unit of the same color corresponds to 2 rows and 2 columns of a total of 4 pixel units, and is located in the first row. The photogenerated charges generated by the two pixel units are accumulated and converted into the first analog signal by the amplification conversion unit, and the photogenerated charges generated by each pixel unit in the two pixel units in the second row pass through the corresponding amplification conversion unit. Converted to the second analog signal, the first analog signal and the second analog signal are respectively converted into a first digital signal and a second digital signal by an analog digital conversion unit. The image sensor of claim 1, wherein the image sensor further comprises: a micromirror array disposed on the filter array, each micromirror in the micromirror array One of the pixel units corresponds. The image sensor of claim 4, wherein the image sensor further comprises: a control module and an image processing module, wherein the control module is configured to control the pixel unit array The image processing module synthesizes the outputs of the analog-to-digital conversion unit to obtain a high dynamic range image. An imaging terminal, comprising the image sensor according to any one of claims 1 to 8. The imaging terminal of claim 9, wherein the imaging terminal comprises a mobile phone. The imaging terminal of claim 9, wherein the imaging terminal further comprises a central processing unit and a display device connected to the image sensor, wherein the central processing unit is configured to control the display device to display the image High dynamic range image of the sensor output. An imaging method for an image sensor according to the first aspect of the invention, wherein the plurality of pixel units corresponding to the filter unit of the same color constitute a merged pixel, the image processing method comprising: a reading step of: reading an output of the pixel unit array; and adding the output of the pixel unit of the same combined pixel to obtain a pixel value of the combined pixel to generate a combined image. The imaging method of claim 12, wherein each of the filter units of the same color corresponds to 2*2 of the pixel units. The image forming method of claim 12, wherein the image sensor comprises a register, the reading step further comprising: collecting the kth row and the k+1th row The output of the pixel unit is stored in the register, where k=2n-1, n is a natural number, k+1 is less than or equal to the total number of rows of the pixel unit; and the kth line is extracted from the register And the output of the pixel unit of the k+1th row, the output of the pixel unit of the same merged pixel is added to obtain the pixel value of the combined pixel. The imaging method of claim 14, wherein the reading step further comprises: converting the analog signal output generated by the pixel unit to a digital signal output. A mobile terminal includes a casing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the casing, and the processor and the memory are disposed at The power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is configured to store executable code; the processor is configured by The executable code stored in the memory is read to run a program corresponding to the executable code for performing the imaging method according to any one of claims 12 to 15. A computer readable storage medium having an instruction stored therein, the mobile terminal performing an imaging method according to any one of claims 12 to 15, when the processor of the mobile terminal executes the instruction.