WO2017101559A1

WO2017101559A1 - Image sensor, terminal comprising same, and imaging method

Info

Publication number: WO2017101559A1
Application number: PCT/CN2016/100881
Authority: WO
Inventors: 李龙佳
Original assignee: 广东欧珀移动通信有限公司
Priority date: 2015-12-18
Filing date: 2016-09-29
Publication date: 2017-06-22
Also published as: CN105578074A; CN105578074B; TWI615029B; TW201724844A

Abstract

Disclosed in the present invention is an image sensor. The image sensor comprises a pixel unit array, amplification conversion units and a filtering array, the pixel unit array comprising a plurality of pixel units, the amplification conversion units being used for converting photo-generated charges generated by the pixel units into analog signals; the filtering array being arranged on the pixel unit array and comprising a plurality of optical filters, the optical filters of the same color corresponding to a plurality of pixel units; the photo-generated charges generated by each pixel unit of a part of the pixel units among the plurality of pixels units that the optical filters of the same color correspond to being output independently by means of an amplification conversion unit, respectively, and merged into a first analog signal, and the photo-generated charges generated by the pixel units of the remaining part sharing, after being accumulated, one amplification conversion unit to output a second analog signal, the first analog signal and the second analog signal being different. The image sensor realizes an HDR function on the basis of the improvement of the hardware. Further disclosed in the present invention are a terminal comprising the image sensor and an imaging method.

Description

Image sensor and terminal therewith, imaging method

Cross-reference to related applications

The present application is based on a Chinese patent application filed on Dec. 18, 2015, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present invention belongs to the field of image processing technologies, and in particular, to an image sensor, and a terminal and an imaging method having the image sensor.

Background technique

With the popularity of mobile phones, taking pictures with mobile phones has become a favorite of more and more people. However, with the improvement of the photographing requirements, the HDR (High-Dynamic Range) function of the image processing of the mobile phone has become a demand of the user. However, at present, the HDR function is generally implemented by software, and the effect is not obvious.

Summary of the invention

The present invention aims to solve at least one of the technical problems in the related art to some extent.

In order to solve the above problems, an aspect of the present invention provides an image sensor including: a pixel unit array including a plurality of pixel units; an amplification conversion unit for converting photogenerated charges generated by the pixel units into analog signals; a filter array on the pixel unit array, the filter array includes a plurality of filters, and the filter of the same color corresponds to a plurality of pixel units; wherein the filter of the same color corresponds to a plurality of a pixel unit, the photo-generated charges generated by each of the pixel units are respectively outputted by an amplification conversion unit and combined into a first analog signal, and the photo-generated charges generated by the remaining pixel units are accumulated and then share an amplification conversion unit output. a second analog signal, all pixel units outputting the first analog signal are located in the same column of the column of the pixel unit, and all pixel units outputting the second analog signal are located in the same column of the pixel unit array, The first analog signal and the second analog signal are different.

In the image sensor of the present invention, the filter based on the same color corresponds to a plurality of pixel units, and the plurality of pixel units corresponding to the filter of the same color are converted by the amplification conversion unit to output two different analog signals for implementing the HDR function. The hardware foundation is provided. Compared with the software in the related art to implement the HDR function, the image sensor realizes the HDR function through hardware improvement and improves the HDR effect.

In at least one embodiment, the image sensor comprises a CMOS image sensor.

In at least one embodiment, the filter array comprises a Bayer array.

In at least one embodiment, the image sensor further includes: an analog-to-digital converter (ADC) for converting the first analog signal and the second analog signal into the first digital signal and the second Digital signal.

In at least one embodiment, a plurality of pixel cells corresponding to filters of the same color are located in different columns of the array of pixel cells.

In at least one embodiment, the filter of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, and the photo-generated charges generated by the 2 pixel units in the first column are independently output and combined by using an amplification conversion unit. For the first analog signal, the photo-generated charges generated by the two pixel units in the second column are accumulated and converted into a second analog signal by an amplification conversion unit, and the first analog signal is converted into an The first digital signal is converted to the second digital signal by another analog to digital conversion unit.

In at least one embodiment, the image sensor further includes: a micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to one of the pixel units.

In at least one embodiment, the image sensor further includes a control module and an image processing module, wherein the control module is configured to control a plurality of pixel units corresponding to the filter of the same color to be simultaneously exposed in a row, the image processing The module synthesizes the output of the analog to digital conversion unit to obtain a high dynamic range image.

In order to solve the above problems, another aspect of the present invention provides a terminal including the image sensor of the above aspect.

According to the terminal of the present invention, by adopting the image sensor, the HDR function can be realized based on the hardware structure of the image sensor, and the HDR image effect is improved.

In some embodiments of the invention, the imaging terminal comprises a cell phone.

In some embodiments of the present invention, the imaging terminal further includes a central processing unit and a display device coupled to the image sensor, the central processor configured to control the display device to display a high dynamic range of the image sensor output image.

In some embodiments of the invention, the terminal includes a central processor coupled to the image sensor and an external memory, the central processor for controlling the external memory to store a high dynamic range image of the image sensor output.

A further aspect of the present invention provides an imaging method based on the above image sensor, wherein a plurality of pixel units corresponding to the filter of the same color constitute a merged pixel, and the image processing method includes: reading the pixel An output of the cell array; and summing the outputs of the pixel cells of the same merged pixel to obtain pixel values of the merged pixels to generate a merged image.

Since the noise of the combined pixels is smaller than the sum of the noises of the pixels before the combination, the imaging method can be obtained under low illumination. Images with high signal-to-noise ratio, brightness and sharpness, and less noise. Overcoming the shortcomings of some existing imaging methods.

In at least one embodiment, the imaging device includes a register, each of the filters covering 2*2 of the pixel units; the reading step further comprising: acquiring the kth row and the k+1th row The output of the pixel unit is stored in the register, where k=2n-1, n is a natural number, k+1 is less than or equal to the total number of rows of the pixel unit; and the kth row is extracted from the register and An output of the pixel unit of the k+1th row is added to an output of the pixel unit of the same merged pixel to obtain a pixel value of the merged pixel.

In at least one embodiment, the step of reading further comprises converting an analog signal output produced by the photosensitive pixel to a digital signal output.

In order to solve the above problems, another embodiment of the present invention provides a mobile terminal, which includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed in the housing Inside the space, the processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; and the memory is used to store executable program code The processor runs a program corresponding to the executable program code by reading executable program code stored in the memory for performing the imaging method of the above-described embodiments of the present invention.

The mobile terminal of the embodiment of the present invention, by reading the output of the pixel unit array, adding the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel to generate a merged image, due to the noise of the merged pixel It is smaller than the sum of the noises of the pixels before the combination, and can obtain images with high signal-to-noise ratio, high brightness and sharpness, and less noise under low illumination.

In order to solve the above problems, a further aspect of the present invention provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instructions, the mobile terminal performs the implementation as described above The imaging method described in the example.

The additional aspects and advantages of the invention will be set forth in part in the description which follows.

DRAWINGS

1 is a schematic diagram of an image sensor in accordance with an embodiment of the present invention;

2 is a schematic diagram of an image sensor in accordance with another embodiment of the present invention;

3 is a schematic diagram showing the distribution of a filter according to an embodiment of the present invention;

4 is a circuit diagram of an image sensor in accordance with an embodiment of the present invention;

Figure 5 is a block diagram of an image sensor in accordance with yet another embodiment of the present invention;

Figure 6 is a block diagram of a terminal in accordance with one embodiment of the present invention;

Figure 7 is a block diagram of a terminal in accordance with another embodiment of the present invention;

Figure 8 is a block diagram of a terminal in accordance with still another embodiment of the present invention;

9 is a flow chart of an imaging method according to an embodiment of the present invention.

Figure 10 is a flow chart of an imaging method in accordance with one embodiment of the present invention;

11 is a flow chart of an imaging method in accordance with another embodiment of the present invention.

detailed description

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

An image sensor and a terminal having the same according to an embodiment of the present invention will be described below with reference to the accompanying drawings.

First, an image sensor according to an embodiment of the present invention will be described. 1 is a block diagram of an image sensor in accordance with one embodiment of the present invention.

As shown in FIG. 1, the image sensor 100 includes a pixel unit array 10, an amplification conversion unit 20, and a filter array 30.

The pixel unit array 10 includes a plurality of pixel units 11; the amplification conversion unit 20 is configured to convert the photo-generated charges generated by the pixel units 11 into analog signals; the filter array 30 is disposed on the pixel unit array 10, and each of the filter arrays 30 includes The filter 31 and the filter 31 of the same color correspond to the plurality of pixel units 11.

Wherein, the plurality of pixel units corresponding to the filter 31 of the same color, the photo-generated charges generated by each of the pixel units 11 of each of the pixel units 11 are independently outputted by one amplification conversion unit 20 and combined into the first analog signal A1, and the remaining The photo-generated charges generated by the partial pixel units are accumulated and then shared by an amplification conversion unit 20 to output a second analog signal A2. All the pixel units outputting the first analog signal A1 are located in the same column of the pixel unit array 10, and output all of the second analog signal A2. The pixel units are located in the same column of the pixel unit array 10, and the first analog signal A1 and the second analog signal A2 are different.

In the image sensor 100 of the present invention, the filter 31 based on the same color corresponds to the plurality of pixel units 11, and the plurality of pixel units 11 corresponding to the filters 31 of the same color are converted by the amplification conversion unit 20 to output two different simulations. The signal provides a hardware foundation for implementing the HDR function. Compared with the software in the related art to implement the HDR function, the image sensor 100 implements the HDR function through hardware improvement to improve the HDR effect.

In some embodiments of the invention, image sensor 100 includes a CMOS (Complementary Metal Oxide Semiconductor) image sensor. Filter array 30 includes a Bayer array.

As shown in FIG. 2, the image sensor 100 further includes an analog to digital conversion unit 40, and the analog to digital conversion unit 40 will be the first mode. The pseudo signal A1 and the second analog signal A2 are converted into a first digital signal D1 and a second digital signal D2, respectively, to provide data for image processing.

In some embodiments of the present invention, a plurality of pixel units 11 corresponding to the filters 31 of the same color are located in different columns of the pixel unit array 10.

For example, the filter 31 of the same color corresponds to 2 rows and 2 columns in total of 4 pixel units, and the photo-generated charges generated by the 2 pixel units 11 in the first column are independently outputted by one amplification conversion unit 20 and combined into a first simulation. The signal A1, the photo-generated charge generated by the two pixel units 11 in the second column is accumulated and converted into the second analog signal A2 by the amplification conversion unit 20, and the first analog signal A1 is converted into the first number by an analog-to-digital conversion unit 40. The signal D1, the second analog signal A2 is converted into a second digital signal D2 by another analog to digital conversion unit 40.

Referring to FIG. 3, which is a schematic diagram of filter distribution according to an embodiment of the present invention, the filter array 30 adopts a Bayer array color mode in which the same characters represent filters of the same color (for example, Gr, Gb, R, B). The number after the character indicates the row number of the pixel unit corresponding to the filter of the same color, and the filters of different colors allow only the light of the corresponding wavelength to pass.

4 is an equivalent circuit diagram of an image sensor according to an embodiment of the present invention, as shown in FIG. 4, including: a first pixel unit PD1 and a first transfer switch TG1, a second pixel unit PD2, and a second transfer switch TG2. The third pixel unit PD3 and the third transfer switch TG3, the fourth pixel unit PD4 and the fourth transfer switch TG4, the first amplification conversion unit SF1, the second amplification conversion unit SF2, the third amplification conversion unit SF3, and the first analog-to-digital conversion Unit 41 and second analog to digital conversion unit 42. Wherein, the pixel unit, for example, the photodiode, receives the light transmitted by the filter 31 to generate a charge, and when the transfer switch is turned on, the charge generated by the corresponding pixel unit 11 is output, and then coupled and converted into a voltage signal by the amplification conversion unit 20, The analog to digital conversion unit 40 converts to a digital signal output, providing a data basis for image processing.

The first pixel unit PD1, the second pixel unit PD2, the third pixel unit PD3, and the fourth pixel unit PD4 are adjacent to each other and correspond to the filter 31 of the same color, for example, as shown in FIG. 4, that is, four respectively. The adjacent pixel units 11 receive light of the same color, and simply, that is, four pixel units 11 constitute one large pixel. And the first pixel unit PD1 and the third pixel unit PD3 are located in the same column in the pixel unit array 10, and the second pixel unit PD2 and the fourth pixel unit PD4 are located in the same column in the pixel unit array 10.

Specifically, the first pixel unit PD1 is connected to the first end of the first amplification conversion unit SF1 through the first transfer switch TG1, and the second pixel unit PD2 is connected to the first end of the second amplification conversion unit SF2 through the second transfer switch TG2. The third pixel unit PD3 is connected to the first end of the third amplification conversion unit SF3 through the third transfer switch TG3, and the fourth pixel unit PD4 is connected to the first end of the second amplification conversion unit SF2 via the fourth transfer switch TG4. a control terminal of the transmission switch TG1, a control terminal of the second transmission switch TG2, a control terminal of the third transmission switch TG3, and a The control ends of the four transmission switches TG4 are all connected to the control module, and the control module controls the switches of the four transmission switches. When the transmission switch is turned on, the corresponding pixel unit 11 transmits a signal.

The input ends of the first analog-to-digital conversion unit 41 are respectively connected to the second ends of the first amplification conversion unit SF1 and the second end of the third amplification conversion unit SF3, and the third end of the first amplification conversion unit SF1 is preset with a power supply, for example. The Vdd connection, the third end of the third amplification conversion unit SF3 is connected to the preset power supply, the input end of the second analog-to-digital conversion unit 42 is connected to the second end of the second amplification conversion unit SF2, and the second amplification conversion unit SF2 The three terminals are connected to a preset power source, and the output of the second analog to digital conversion unit 42 is connected to the output of the first analog to digital conversion unit 41.

The control module of the image sensor 100 controls the plurality of pixel units 11 corresponding to the filters 31 of the same color to be simultaneously exposed in a row, and the image processing module synthesizes the outputs of the analog-to-digital conversion unit 40 to obtain a high dynamic range image.

As an example, one pixel unit corresponding to each filter 31 of the 2i+1 (i=0, 1, 2, 3, 4...) row in the pixel unit array 10 (such as a pixel corresponding to the filter Gr1) a pixel unit of each of the filters 31 adjacent to the 2i+2th row of the 2i+1th row (such as a pixel unit corresponding to the filter Gr3), that is, the first pixel unit PD1 and the third pixel unit The PD3 performs charge conversion by a first amplification conversion unit SF1 and a third amplification conversion unit SF3, and is converted into a digital signal output by the first analog-to-digital conversion unit 41. The output value of the first analog-to-digital conversion unit 41 is set at this time. In addition, one pixel unit corresponding to each filter 31 of the 2i+1th row in the pixel unit array 10 (such as a pixel unit corresponding to the filter Gr2) and each filter of the 2i+2 row One pixel unit of 31 (such as a pixel unit corresponding to the filter Gr4), that is, the charge generated by the second pixel unit PD2 and the fourth pixel unit PD4 is collected, and the collected charge is converted into the second amplified conversion unit SF2 into The voltage signal is converted into a digital signal by the second analog to digital conversion unit 42. , At this time was 42 outputs the second conversion unit is ADC2.

Specifically, the filter 31 of the same color is exemplified by four pixel units adjacent to two rows and two columns. Based on the above configuration, when performing HDR control, the control module controls simultaneous exposure of the same color pixels of two adjacent rows. For example, controlling the 2i+1 and 2i+2 lines to simultaneously expose, wherein i=0, 1, 2, 3.., and controlling the exposure time to avoid sharing the two pixels of the second amplification conversion unit SF2 The output of the unit is saturated. In the embodiment of the present invention, the amplification conversion unit 20 can function as a summary coupling of the electric charge outputted by the pixel unit 11, and it can be understood that, at this time, the first amplification conversion unit SF1, the second amplification conversion unit SF2, and the third The amount of charge collected by the amplification conversion unit SF3 or the converted voltage value satisfies: SF2 = 2SF1 = 2SF3, wherein the value of the output of the ADC 1 is the average of SF1 and SF3, so that every four pixel units of the same color simultaneously output a high ADC2 value. And a low ADC1 value, and then the high ADC2 value and the low ADC1 value are synthesized on the image sensor's ISP (Image Signal Processor) end, thereby obtaining an HDR image and implementing the HDR function.

It can be understood that the circuit obtained by integrally swapping the left and right of the circuit diagram in FIG. 4 is also included in the scope of the present application, that is, two pixel units 11 in the same column on the left side share one amplification conversion unit 20, and two pixel units in the same column on the right side. 11 separately using an amplification conversion unit 20 is also included in the scope of the present application, but differs in the component numbers.

As shown in FIG. 5, the image sensor 100 further includes a micromirror array 50 disposed on the filter array 30. Each of the micromirrors 51 in the micromirror array 50 corresponds to one pixel unit 11, including formation, size, and position. The micromirror 51 can collect light to the photosensitive portion of the pixel unit 11, and enhance the received light intensity of the pixel unit 11, thereby improving the image quality.

Based on the image sensor of the embodiment of the above aspect, a terminal according to another embodiment of the present invention will be described below with reference to the accompanying drawings.

FIG. 6 is a block diagram of a terminal including the image sensor 100 of the above aspect, as shown in FIG. 6, in accordance with an embodiment of the present invention. Specifically, the terminal 1000 may include a mobile phone.

In some embodiments, as shown in FIG. 7, the terminal 1000 further includes a central processing unit 200 connected to the image sensor 100 and a display device 300 for controlling the display device 300 to display a high dynamic range output by the image sensor 100. image. Thus, the image taken by the terminal 1000 can be displayed on the display device 300 for viewing by the user. The display device 300 includes an LED display or the like.

In some embodiments, as shown in FIG. 8, the terminal 1000 includes a central processing unit 200 and an external memory 400 connected to the image sensor 100, and the central processing unit 200 is configured to control the external memory 400 to store the high dynamic range image output by the image sensor 100. .

In this way, the generated image can be stored for later viewing, use or transfer. The external memory 400 includes an SM (Smart Media) card, a CF (Compact Flash) card, and the like.

The terminal 1000 can implement the HDR function based on the hardware structure of the image sensor 100 by using the image sensor 100 to enhance the HDR image effect.

Based on the image sensor of the embodiment of the above aspect, an imaging method according to an embodiment of the present invention is described below with reference to the accompanying drawings, wherein a plurality of pixel units corresponding to filters of the same color constitute a merged pixel.

9 is a flow chart of an imaging method according to an embodiment of the present invention. As shown in FIG. 9, the imaging method includes the following steps:

S1, reading the output of the pixel unit array.

S2, adding the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel to generate a merged image.

The imaging method of the embodiment of the present invention assumes that the output of each pixel unit is S, the noise is N, and the merged pixel includes M pixel units, and the pixel value of the merged pixel is n*m*S, and the noise of the merged pixel for

In the case of n=2 and m=2, the noise of the synthesized pixel is about n*m*N/2. Therefore, the brightness of the merged image is improved in a low-brightness environment, and the noise-to-noise ratio is improved.

Referring to FIG. 10, in some embodiments, each filter of the same color of the image sensor corresponds to 2*2 pixel units, the image sensor includes a register, and step S2 further includes:

S201, collecting the output of the pixel unit of the kth row and the k+1th row and storing the register, wherein k=2n-1, n is a natural number, and k+1 is less than or equal to the total number of rows of the pixel unit array;

S202. Extract the output of the pixel unit of the kth row and the k+1th row from the register, and add the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel.

In this way, the process of reading, buffering, and merging the output of the pixel unit can be fully utilized by the register.

Referring to FIG. 11, in some embodiments, step S2 further includes:

S301. Convert an analog signal output generated by the pixel unit into a digital signal output; and

S302. The digital signal outputs of the pixel units of the same merged pixel are added to obtain pixel values of the merged pixels.

In this way, the image processing module, which is generally a digital signal processing chip, can directly process the output of the image sensor, and secondly, compared with some schemes that directly process the output of the analog signal format of the image sensor through the circuit, The information of the image is well preserved. For example, for an image sensor of 16 M pixels, the imaging method of the embodiment of the present invention can generate a combined image of 4 M pixels (merging 2*2 pixels) or 16 M pixels. The original image (ie not merged).

A further embodiment of the present invention further provides a mobile terminal, comprising: a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the housing, The processor and the memory are disposed on the circuit board; the power supply circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is configured to store executable program code; the processor A program corresponding to the executable program code is executed by reading executable program code stored in the memory for performing the imaging method of the above aspect.

The embodiment of the present invention further provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instruction, the mobile terminal performs the embodiment of the present invention as shown in FIG. Imaging method.

It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order between them. Moreover, the terms "comprise," "comprise," or "include" or "include" or "the" Include those elements, but also include other elements that are not explicitly listed, or include elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

It should be noted that in the description of the specification, the descriptions of the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" and the like are meant to be combined with the embodiments or The specific features, structures, materials, or characteristics described in the examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.

In the description of the present specification, reference is made to the terms "one embodiment", "some embodiments", "example", The description of the "specific examples", or "some examples", and the like, are intended to include the particular features, structures, materials or features described in connection with the embodiments or examples. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.

Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Claims

An image sensor, comprising:

a pixel unit array comprising a plurality of pixel units;

An amplification conversion unit for converting a photo-generated charge generated by the pixel unit into an analog signal; and

a filter array disposed on the pixel unit array, the filter array includes a plurality of filters, and the filter of the same color corresponds to a plurality of pixel units;

Wherein, the plurality of pixel units corresponding to the filter of the same color, the photo-generated charges generated by each pixel unit of a part of the pixel units are independently outputted by an amplification conversion unit and combined into a first analog signal, and the remaining part is The photo-generated charge generated by the pixel unit is accumulated and then shared by an amplification conversion unit to output a second analog signal. All pixel units outputting the first analog signal are located in the same column of the pixel unit array, and all pixels of the second analog signal are output. The cells are located in the same column of the pixel cell array, and the first analog signal and the second analog signal are different.
The image sensor of claim 1 wherein said image sensor comprises a CMOS image sensor.
The image sensor of claim 1 or 2 wherein said filter array comprises a Bayer array.
The image sensor according to any one of claims 1 to 3, further comprising:

And an analog to digital conversion unit, configured to convert the first analog signal and the second analog signal into a first digital signal and a second digital signal, respectively.
The image sensor according to any one of claims 1 to 4, wherein the plurality of pixel units corresponding to the filters of the same color are located in different columns of the pixel unit array.
The image sensor according to any one of claims 1 to 5, wherein the filter of the same color corresponds to two rows and two columns of a total of four pixel units, and is generated by two pixel units located in the first column. The photo-generated charges are separately outputted by an amplification conversion unit and combined into the first analog signal, and the photo-generated charges generated by the two pixel units in the second column are accumulated and converted into a second analog signal by the amplification conversion unit. An analog signal is converted to the first digital signal by an analog to digital conversion unit, and the second analog signal is converted to the second digital signal by another analog to digital conversion unit.
The image sensor of any of claims 1-6, further comprising:

A micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to one of the pixel units.
The image sensor according to any one of claims 1 to 7, further comprising:

a control module and an image processing module, wherein the control module is configured to control a plurality of filters corresponding to the same color The pixel cells are simultaneously exposed in a row, and the image processing module synthesizes the outputs of the analog to digital conversion unit to obtain a high dynamic range image.
A terminal characterized by comprising the image sensor according to any one of claims 1-8.
The terminal of claim 9 wherein said terminal comprises a handset.
The terminal according to claim 9 or 10, wherein the terminal further comprises a central processing unit and a display device connected to the image sensor, the central processor is configured to control the display device to display the image sensor High dynamic range image output.
The terminal according to claim 9, wherein said terminal comprises a central processor and an external memory connected to said image sensor, said central processor for controlling said external memory to store said image sensor output high Dynamic range image.
An imaging method of the image sensor according to claim 1, wherein the plurality of pixel units corresponding to the filters of the same color constitute a merged pixel, and the image processing method comprises:

Reading the output of the array of pixel cells;

The outputs of the pixel units of the same merged pixel are added to obtain pixel values of the merged pixels to generate a merged image.
The image forming method according to claim 13, wherein each of said filters of the same color corresponds to 2*2 of said pixel units.
The imaging method according to claim 13 or 14, wherein said image sensor comprises a register, and said reading step further comprises:

Acquiring an output of the pixel unit of the kth row and the k+1th row and storing the register, wherein k=2n-1, n is a natural number, and k+1 is less than or equal to a total number of rows of the pixel unit array;

Extracting an output of the pixel unit of the kth row and the k+1th row from the register, and adding an output of the pixel unit of the same merged pixel to obtain a pixel value of the merged pixel.
The image forming method according to any one of claims 13 to 15, wherein the reading step further comprises:

The analog signal output produced by the pixel unit is converted to a digital signal output.
A mobile terminal includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the housing, and the processor and the memory are disposed in the a power supply circuit for supplying power to respective circuits or devices of the mobile terminal; the memory for storing executable program code; the processor reading an executable program stored in the memory The code runs a program corresponding to the executable program code for performing the imaging method according to any one of claims 13 to 16.
A computer readable storage medium having instructions stored therein, the mobile terminal performing the imaging method of any one of claims 13 to 16 when the processor of the mobile terminal executes the instructions.