TWI615030B - Image sensor, terminal device having same sensor, imaging method using same, mobile terminal device and computer readable storage media - Google Patents

Abstract

The invention discloses an image sensor. The image sensor includes a pixel unit array, an amplification conversion unit, and a filter array. The pixel unit array includes a plurality of pixel units. The amplification conversion unit is used to convert the pixel unit. The generated photogenerated charges are converted into analog signals; the filter array is arranged on the pixel unit array, the filter array includes a plurality of filters, and the filters of the same color correspond to the complex pixel units; among them, the filters of the same color The photo-generated charges generated by some pixel units of the corresponding complex pixel unit are accumulated and shared by an amplification conversion unit to output a first analog signal. The remaining pixel units of the complex pixel unit corresponding to the filter of the same color The generated photo-generated charges are accumulated and used to share a boost conversion unit to output a second analog signal. The image sensor has improved sensitivity and signal-to-noise ratio. The invention also discloses a terminal having the image sensor and an imaging method.

Description

Image sensor, terminal device having the same, imaging method, and mobile terminal Device and computer-readable storage medium

The invention relates to imaging technology; in particular, it relates to an image sensor, a terminal having the image sensor, and an imaging method.

With the popularity of mobile phones, taking photos with mobile phones has become the preference of more and more people. However, with the increase of people's requirements for taking photos, excellent dark-state photo effects have become urgent needs of consumers, and furthermore, sensors have to have higher sensitivity and better signal-to-noise ratio. However, current image sensors The sensitivity and signal-to-noise ratio need to be further improved.

The present invention aims to solve at least one of the technical problems in the related technology.

In order to solve the above problems, an aspect of the present invention provides an image sensor, wherein the image sensor includes: an array of pixel units, including a complex pixel unit; and a complex amplification conversion unit for generating a pixel unit The photo-generated charge is converted into an analog signal; the filter set on the pixel cell array Light array, the filter array includes a plurality of filters, and the filters of the same color correspond to the plurality of pixel units; wherein the photogenerated charges generated by the plurality of pixel units corresponding to the same color filter are converted by the amplification conversion unit A first analog signal and a second analog signal are output, and the first analog signal is the same as the second analog signal.

According to the image sensor of the present invention, based on the same color filter corresponding to the complex pixel unit, and the complex pixel unit corresponding to the same color filter is converted by the amplification conversion unit to output two identical analog signals, compared to The output of a single pixel unit can obtain more photo-generated charges, which improves the sensitivity and signal-to-noise ratio through hardware improvement.

In at least one embodiment, the image sensor includes a CMOS image sensor.

In at least one embodiment, the filter array includes a Bayer array.

In at least one embodiment, among the plurality of pixel units corresponding to the same color filter, the photo-generated charges of all the pixel units for outputting the first analog signal are accumulated and shared by an amplification conversion unit for output. The same color filter The photo-generated charges of all the pixel units in the complex pixel unit corresponding to the slice which are used to output the second analog signal are shared and output by an amplifier conversion unit.

In some embodiments of the present invention, the image sensor further includes: an analog-to-digital converter (ADC), configured to convert the first analog signal and the second analog signal to the first digital respectively. Signal and second digital signal.

In some embodiments of the present invention, the complex pixel units corresponding to the filters of the same color are located in different rows of the pixel unit array.

In some embodiments of the present invention, the filter of the same color corresponds to a total of 4 pixel units in 2 rows and 2 columns, and the photo-generated charges generated by the 2 pixel units in the first row are accumulated and converted by the amplification conversion unit to the first pixel unit. An analog signal, the photogenerated charges generated by the two pixel units in the second row are accumulated and then increased. The amplitude conversion unit converts the second analog signal, and the first analog signal and the second analog signal are converted into a first digital signal and a second digital signal by an analog digital conversion unit, respectively.

In some embodiments of the present invention, the image sensor further includes: a micromirror array disposed on the filter array, and each micromirror in the micromirror array corresponds to a pixel unit.

In some embodiments of the present invention, the image sensor further includes a control module and an image processing module. The control module is configured to control simultaneous exposure of the plurality of pixel units corresponding to the same color filter in rows. The image processing module synthesizes the outputs of the analog digital conversion unit to obtain an image.

In order to solve the above problem, another aspect of the present invention provides a terminal, which includes the image sensor described in the above aspect.

The terminal of the present invention adopts the image sensor to correspond to a plurality of pixel units based on the same color filter, and the plurality of pixel units corresponding to the same color filter are converted by the amplification conversion unit to output two identical analogs. Compared with the output of a single pixel unit, the signal can obtain more photo-generated charges, which improves the sensitivity and signal-to-noise ratio through hardware improvement.

In some embodiments of the present invention, the terminal includes a mobile phone.

In some embodiments of the present invention, the terminal further includes a central processing unit and a display device connected to the image sensor, and the central processing unit is used to control the display device to display an image output by the image sensor.

In some embodiments of the present invention, the terminal includes a central processing unit and an external memory connected to the image sensor, and the central processor is configured to control the external memory to store an image output by the image sensor.

The invention also provides an imaging method, wherein the plurality of pixel units corresponding to the same color filter constitute a merged pixel, and the image processing method includes: reading the output of the pixel unit array; And the outputs of the pixel units of the same merged pixel are added to obtain the pixel value of the merged pixel to generate a merged image.

Since the noise of the pixel structural unit is smaller than the sum of the noise of each pixel before the combination, this imaging method can obtain an image with higher signal-to-noise ratio, brightness and sharpness and less noise under low illumination. The shortcomings of some existing imaging methods are overcome.

In at least one embodiment, the imaging device includes a register, and each of the filters covers 2 * 2 of the pixel units; the reading step further includes: collecting the k-th and k + 1-th rows of the picture The output of the pixel unit is stored in the register, where k = 2n-1, n is a natural number, and k + 1 is less than or equal to the total number of rows of the pixel unit; and the k-th row and The output of the pixel unit in the k + 1th line is added to the output of the pixel unit of the same merged pixel to obtain the pixel value of the pixel structural unit.

In at least one embodiment, the reading step further includes: converting an analog signal output generated by the pixel unit into a digital signal output.

In order to solve the above problem, an embodiment of another aspect of the present invention provides a mobile terminal. The mobile terminal includes a housing, a processor, a memory, a circuit board, and a power supply circuit. The circuit board is disposed in the housing. Inside the space, the processor and the memory are arranged on the circuit board; the power circuit is used to power various circuits or devices of the mobile terminal; the memory is used to store executable program code; the processor uses The executable code stored in the memory is read to run a program corresponding to the executable code, and is used to execute the imaging method according to the foregoing embodiment of the present invention.

The mobile terminal according to the embodiment of the present invention, by reading the output of the pixel array, adds the output of the same merged pixel and the pixel unit to obtain the pixel value of the merged pixel to generate a merged image. The noise of the pixels is less than the sum of the noise of the pixels before the merge, and an image with higher signal-to-noise ratio, brightness and sharpness, and less noise can be obtained under low illumination.

Another embodiment of the present invention provides a computer-readable storage medium having instructions stored therein. When the processor of the mobile terminal executes the instructions, the mobile terminal executes the imaging method according to the embodiment of the above aspect.

Additional aspects and advantages of the present invention will be given in part in the following description, and part of them will become apparent from the following description, or be learned through the practice of the present invention.

An embodiment of the present invention is described in detail below. An example of the embodiment is shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or the same or similar functions throughout. element. The embodiments described below with reference to the drawings are exemplary and are intended to explain the present invention, but should not be construed as limiting the present invention.

An image sensor and a terminal having the same according to an embodiment of the present invention will be described below with reference to the drawings.

First, an image sensor according to an embodiment of the present invention will be described. FIG. 1 is a block diagram of an image sensor according to an embodiment of the present invention.

As shown in FIG. 1, the image sensor 100 includes a pixel unit array 10, an amplification conversion unit 20, and a filter array 30.

The filter array 30 is disposed on the pixel unit array 10. The pixel unit array 10 includes a plurality of pixel units 11. Each of the filter arrays 30 includes a plurality of filters 31. The filters 31 of the same color correspond to the plurality of pixels. The unit 11 and the amplification conversion unit 20 are configured to convert the photo-generated charges generated by the pixel unit 11 into an analog signal.

Among them, the photo-generated charges generated by the complex pixel unit 11 corresponding to the filter 31 of the same color are converted by the amplification conversion unit 20 and output a first analog signal D1 and a second analog signal D2, and the first analog signal D1 and the first The second analog signal D2 is the same.

In the image sensor of the present invention, the filter 31 based on the same color corresponds to the complex pixel unit 11, and the complex pixel unit 11 corresponding to the filter 31 of the same color is converted by the amplification conversion unit 20 to output two identical pixels. Compared with the output of a single pixel unit 11, the analog signal can obtain more photo-generated electrons, and the sensitivity and signal-to-noise ratio are improved by hardware improvement.

In some embodiments of the present invention, among the plurality of pixel units 11 corresponding to the filters 31 of the same color, the photo-generated charges of all the pixel units 11 for outputting the first analog signal A1 are accumulated to share an amplification conversion unit 20 The output, the pixel unit 11 of the complex pixel unit 11 corresponding to the filter 31 of the same color for outputting the second analog signal A2, the photo-generated charges of the pixel unit 11 are accumulated and shared by an amplifier conversion unit 20 for output. The output is equivalent to the sum of the photogenerated charges of the complex pixel unit, and more photogenerated charges can be obtained.

In some embodiments of the present invention, the image sensor 100 includes a Complementary Metal Oxide Semiconductor (CMOS) image sensor. The filter array 30 includes a Bayer array.

As shown in FIG. 2, the image sensor 100 further includes an analog digital conversion unit 40. The analog digital conversion unit 40 converts the first analog signal A1 and the second analog signal A2 into the first digital signal D1 and the second digital signal, respectively. Signal D2 provides data for image processing.

In some embodiments of the present invention, the complex pixel units 11 corresponding to the filters 31 of the same color are located in different rows of the pixel unit array 10.

For example, a filter 31 of the same color corresponds to a total of 4 pixel units 11 in 2 rows and 2 columns, and the photogenerated charges generated by the 2 pixel units 11 in the first row are accumulated and converted by the amplification conversion unit 20 into a first analogy. Signal A1, the photogenerated charges generated by each pixel unit 11 of the 2 pixel units in the second row are accumulated and converted by the amplitude conversion unit 20 into a second analog signal A2, the first analog signal A1 and the second analog signal A2 is further converted into a first digital signal D1 and a second digital signal D2 by an analog digital conversion unit 40, respectively.

Referring to FIG. 3, which is a schematic diagram of a filter distribution according to an embodiment of the present invention, the filter array 30 uses a Bayer array color mode, where the same characters represent filters of the same color (for example, Gr, Gb, R , B), the digits after the character indicate the row number of the pixel unit corresponding to the filter of the same color, and the filters of different colors only allow light of the corresponding wavelength to pass through.

FIG. 4 is an equivalent circuit diagram of an image sensor according to an embodiment of the present invention. As shown in FIG. 4, the image sensor includes a first pixel unit PD1, a first transmission switch TG1, and a second pixel unit PD2. And second transmission switch TG2, third pixel unit PD3 and third transmission switch TG3, fourth pixel unit PD4 and fourth transmission switch TG4, first amplification conversion unit SF1, second amplification conversion unit SF2, analog digital conversion Unit 40. The pixel unit 11, such as a photodiode, receives the light transmitted by the filter 31 to generate a charge. When the transmission switch is turned on, the charge output generated by the corresponding pixel unit 11 is output, which is further coupled and converted into an amplification conversion unit 20. The voltage signal is converted into digital signal output by analog digital conversion 40, which provides a data basis for image processing.

The first pixel unit PD1, the second pixel unit PD2, the third pixel unit PD3, and the fourth pixel unit PD4 are adjacent pixel units 11 corresponding to the filters 31 of the same color, that is, Four adjacent pixel units 11 receive light of the same color, in short, that is, the four pixel units constitute a large pixel. And the first pixel unit PD1 and the second pixel unit PD2 are located in the same row, and the third pixel unit PD3 and the fourth pixel unit PD4 are located in the same row.

Specifically, the first pixel unit PD1 is connected to the first end of the first amplification conversion unit SF1 through the first transmission switch TG1, and the second pixel unit PD2 is connected to the first amplification conversion unit SF1 through the second transmission switch TG2. The first end is connected, and the second end of the first amplification conversion unit SF1 is connected to a preset power source such as Vdd; the third pixel unit PD3 is connected to the first end of the second amplification conversion unit SF2 through a third transmission switch TG3, and the fourth The pixel unit PD4 is connected to the first end of the third amplification conversion unit SF3 through a fourth transmission switch TG4, and the second end of the second amplification conversion unit SF2 is connected to a preset power source; the control end of the first transmission switch TG1 and the second The control terminal of the transmission switch TG2, the control terminal of the third transmission switch TG3, and the control terminal of the fourth transmission switch TG4 are all connected to the control module. The control module controls the switches of the four transmission switches. When the transmission switch is turned on, the corresponding The pixel unit 11 sends a signal.

The input terminals of the analog digital conversion unit 40 are respectively connected to the third terminal of the first amplification conversion unit SF1 and the third terminal of the second amplification conversion unit SF2.

In order to implement exposure control, as shown in FIG. 4, the image sensor 100 further includes a control module, an image processor, a first reset unit RST1, a first selection unit SEL1, a second reset unit RST2, and a second selection. Unit SEL2.

The first end of the first resetting unit RT1 is connected to the first transmission switch TG1, the second transmission switch TG2, and the first end of the first amplification conversion unit SF1, and the second end of the first resetting unit RST1 is connected to a preset power source. The first terminal of the first selection unit SEL1 is connected to the third terminal of the first amplification conversion unit SF1, and the second terminal of the first selection unit SEL1 is connected to the input terminal of the analog digital conversion unit 40. The first end of the second resetting unit RET2 is connected to the first end of the third transmission switch TG3, the fourth transmission switch TG4, and the second amplification conversion unit SF2, and the second end of the second resetting unit RST2 is connected to a preset power source; A first terminal of the second selection unit SEL2 is connected to a third terminal of the second amplification conversion unit SF2, and a second terminal of the second selection unit SEL2 is connected to an input terminal of the analog digital conversion unit 40. Specifically, as shown in FIG. 4, the second end of the first selection unit SEL1 and the second end of the second selection unit SEL2 are connected to a readout line (READOUT COLUMN), and the input terminal of the analog digital conversion unit 40 is connected to the READOUT COLUMN.

The third terminal of the first resetting unit RST1, the third terminal of the first selecting unit SEL1, the third terminal of the second resetting unit RST2, and the third terminal of the second selecting unit SEL2 receive control signals, and the control module controls the same The plurality of pixel units 11 corresponding to the color filters 31 are exposed simultaneously in a row and the exposure time is controlled, that is, exposure control is achieved, and then the image sensor module synthesizes the outputs of the analog digital conversion unit 40 to obtain an image. . Based on the above structure, not only the clarity of taking pictures in normal scenes is ensured, but also the photographing effect in night scenes can be improved.

As an example, two pixel units corresponding to each filter 31 in the 2i + 1 (i = 0,1,2,3,4 ...) row in the pixel unit array 10 (for example, filter Gr1, The pixel unit corresponding to Gr2), namely the first pixel unit PD1 and the second pixel unit PD2, share an amplification conversion unit, namely the first amplification conversion unit SF1, the first pixel unit PD1 and the second pixel unit PD2. The generated charge is collected by the first amplification conversion unit SF1 to convert the charges collected by the first pixel unit PD1 and the second pixel unit PD2 into a voltage signal, and further converted to a digital signal output by the analog digital conversion unit 40. It is assumed that the output value of the analog digital conversion unit 40 at this time is ADC1; in addition, each of the 2i + 2 (i = 0,1,2,3,4 ...) rows adjacent to the 2i + 1 row in the pixel unit array 10 The two pixel units of the filter 31 (for example, the pixel units corresponding to the filters Gr3 and Gr4), that is, the third pixel unit PD3 and the fourth pixel unit PD4 share an amplification conversion unit, that is, a second amplification conversion The charge generated by the unit SF2, the third pixel unit PD3 and the fourth pixel unit PD4 is collected by the second amplification conversion unit SF2. After PD3 and PD4 of the fourth pixel units integrate charge into a voltage signal, and further by analog to digital conversion unit 40 converts the output signals are digital, analog output at this time was digital conversion unit 40 is ADC2.

Specifically, a filter 31 of the same color corresponds to four pixel units 11 adjacent to two rows and two columns is taken as an example. Based on the circuit structure described above, and referring to FIG. 4, the control module controls The pixel units 11 of the same color in two adjacent rows are exposed at the same time, for example, the 2i + 1 and 2i + 2 rows are exposed at the same time, where i = 0,1,2,3, ..., and the exposure time is controlled. , To avoid the output saturation of two pixel units 11 sharing the same amplification conversion unit. In the embodiment of the present invention, the amplification conversion unit 20 can play a summary coupling effect on the charge output by the pixel unit. It can be understood that, at this time, the charges collected by the first amplification conversion unit SF1 or the second amplification conversion unit SF2 The quantity or converted voltage value is the sum of the photocharges generated by two pixel units, which is about twice the photocharges generated by a single pixel unit, so the four pixel units 11 corresponding to the same color filter 31 Compared with a single pixel unit, the photocharge increases, which greatly improves the sensitivity of the image sensor 100 (about twice).

As shown in FIG. 5, the image sensor 100 further includes a micro-mirror array 50 disposed on the filter array 30. Each micro-mirror 51 in the micro-mirror array 50 corresponds to a pixel unit 11. Corresponds to size and position. The micro-mirror 51 can collect light onto the photosensitive portion of the pixel unit 11, and enhance the light receiving intensity of the pixel unit 11, thereby improving the image quality.

Based on the image sensor according to the embodiment of the above aspect, a terminal according to another embodiment of the present invention is described below with reference to the accompanying drawings.

FIG. 6 is a block diagram of a terminal according to an embodiment of the present invention. As shown in FIG. 6, the terminal 1000 includes the image sensor 100 in the above aspect. Specifically, the terminal 1000 may include a mobile phone.

In some embodiments, as shown in FIG. 7, the terminal 1000 further includes a central processing unit 200 and a display device 300 connected to the image sensor 100. The central processing unit 200 is configured to control the display device 300 to display image sensing. Image output by the monitor 100. In this way, the image captured by the terminal 1000 can be displayed on the display device 300 for viewing by the user. The display device 300 includes an LED display and the like.

In some embodiments, as shown in FIG. 8, the terminal 1000 includes a central processing unit 200 and an external memory 400 connected to the image sensor 100, and the central processing unit 200 is configured to control the external memory 400 to store image sense. The image output by the tester 100.

In this way, the generated images can be stored for later viewing, use or transfer. The external memory 400 includes a SM (Smart Media) card, a CF (Compact Flash) card, and the like.

The terminal 1000 adopts the image sensor 100 described above. Based on the hardware structure of the image sensor 100, the photographing sensitivity can be improved and the signal-to-noise ratio can be reduced.

Based on the image sensor according to the embodiment of the above aspect, an imaging method according to an embodiment of the present invention is described below with reference to the accompanying drawings, in which a plurality of pixel units corresponding to filters of the same color constitute a merged pixel.

FIG. 9 is a flowchart of an imaging method according to an embodiment of the present invention. As shown in FIG. 9, the imaging method includes the following steps: S1, reading the output of the pixel unit array; S2, drawing the same merged pixel The output of the pixel unit is added to obtain the pixel value of the merged pixel to generate a merged image.

，在n=2，m=2的情況下，合成畫素的雜訊即為n*m*N/2左右。因此合併圖像的亮度在低亮度環境下得到提升，而且性噪比提高。The imaging method of the embodiment of the present invention assumes that the original output of each pixel unit is S and the noise is N. The merged pixel includes M pixel units, and the pixel value of the merged pixel is n * m * S. And the noise of the merged pixels is

In the case of n = 2 and m = 2, the noise of the synthesized pixels is about n * m * N / 2. Therefore, the brightness of the merged image is improved in a low-brightness environment, and the sexual noise ratio is improved.

Referring to FIG. 10, in some embodiments, each filter of the same color of the image sensor corresponds to 2 * 2 pixel units. The image sensor includes a register, and step S2 further includes : S201. Collect the output of the pixel units in the kth and k + 1th lines and store them in the temporary register, where k = 2n-1, n is a natural number, and k + 1 is less than or equal to the total number of pixel units; S202: Extract the output of the pixel units of the kth row and the k + 1th row from the register, and add the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel.

In this way, it is possible to make full use of the register to realize the process of outputting, caching and merging of the pixel unit.

Please refer to FIG. 11. In some embodiments, step S2 further includes: S301, converting the analog signal output generated by the pixel unit into a digital signal output; and S302, converting the digital signal of the pixel unit of the same merged pixel The outputs are summed to get the pixel value of the merged pixel.

In this way, first, the image processing module, which is generally a digital signal processing chip, can directly process the output of the image sensor. Second, compared to some analog signal format output of the image sensor directly through the circuit. For the processing scheme, the information of the image is better retained. For example, for a 16M pixel image sensor, the imaging method of the embodiment of the present invention can generate 4M pixels (2 * 2 pixels combined) can also generate the original image of 16M pixels (that is, not merged).

A still further embodiment of the present invention further provides a mobile terminal including a casing, a processor, a memory, a circuit board, and a power circuit, wherein the circuit board is disposed in a space surrounded by the casing, and the processing The memory and the memory are arranged on the circuit board; the power circuit is used to supply power to the circuits or devices of the mobile terminal; the memory is used to store executable code; the processor reads the memory by The executable code stored in the program is used to run a program corresponding to the executable code for performing the imaging method in the above aspect.

The embodiment of the present invention also provides a computer-readable storage medium having instructions stored therein. When the processor of the mobile terminal executes the instruction, the mobile terminal executes the imaging of the embodiment of the present invention as shown in FIG. 9 method.

It should be noted that in this article, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or operations There is any such actual relationship or order among them. Moreover, the terms "including", "comprising", or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or device that includes a series of elements includes not only those elements but also those that are not explicitly listed Or other elements that are inherent to this process, method, article, or device. Without more restrictions, the elements defined by the sentence "including one ..." do not exclude the existence of other identical elements in the process, method, article, or device that includes the elements.

The logic and / or steps represented in the flowchart or otherwise described herein, for example, a sequenced list of executable instructions that can be considered to implement a logical function, can be embodied in any computer-readable medium, For use by, or in combination with, an instruction execution system, device, or device (such as a computer-based system, a system that includes a processor, or another system that can fetch and execute instructions from an instruction execution system, device, or device) Or equipment. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM) ), Read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). In addition, computer-readable media may even be paper or other suitable media on which the program can be printed, because, for example, by optically scanning the paper or other media and then editing, interpreting, or otherwise Process it appropriately to obtain the program electronically and then store it in computer memory.

It should be understood that each part of the present invention may be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, the plurality of steps or methods may be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it may be implemented using any one or a combination of the following techniques known in the art: a logic gate circuit for implementing a logic function on the data signal Discrete logic circuits, dedicated integrated circuits with suitable combinational logic gate circuits, programmable gate array (PGA), field programmable gate array (FPGA), etc.

It should be noted that, in the description of the present specification, the description with reference to the terms “an embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” means in combination with this embodiment or The specific features, structures, materials, or characteristics described in the examples are included in at least one embodiment or example of the present invention. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any or multiple embodiments or examples. In addition, without any contradiction, those skilled in the art may combine and combine different embodiments or examples and features of the different embodiments or examples described in this specification.

In the description of this specification, the description with reference to the terms “an embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” and the like means specific features described in conjunction with the embodiments or examples , Structures, materials, or features are included in at least one embodiment or example of the present invention. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any or multiple embodiments or examples. In addition, without any contradiction, those skilled in the art may combine and combine different embodiments or examples and features of the different embodiments or examples described in this specification.

Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present invention. Those skilled in the art can interpret the above within the scope of the present invention. Embodiments are subject to change, modification, substitution, and modification.

10‧‧‧ pixel cell array
11‧‧‧ pixel unit c
20‧‧‧ Amplification conversion unit
30‧‧‧ Filter Array
31‧‧‧ Filter
40‧‧‧ Analog Digital Conversion Unit (ADC)
50‧‧‧ Micromirror Array
51‧‧‧Micromirror
100‧‧‧Image Sensor
200‧‧‧ CPU
300‧‧‧ display device
400‧‧‧ external memory
1000‧‧‧ terminal
A1, A2, D1, D2‧‧‧ analog signals
B, Gb, Gr1, Gr2, Gr3, Gr4, R‧‧‧ filters
PD1, PD2, PD3, PD4 ‧‧‧ pixel units
RST1, RST2 ‧‧‧Relocation unit
SEL1, SEL2 ‧‧‧ selection unit
SF1, SF2‧‧‧Amplification conversion unit
TG1, TG2, TG3, TG4 ‧‧‧ transmission switch

FIG. 1 is a schematic diagram of an image sensor according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of an image sensor according to another embodiment of the present invention.

FIG. 3 is a schematic diagram of the distribution of filters in a specific embodiment of the present invention.

FIG. 4 is a circuit diagram of an image sensor according to an embodiment of the present invention.

FIG. 5 is a schematic diagram of an image sensor according to another embodiment of the present invention.

FIG. 6 is a block diagram of a terminal according to an embodiment of the present invention.

FIG. 7 is a block diagram of a terminal according to another embodiment of the present invention.

FIG. 8 is a block diagram of a terminal according to still another embodiment of the present invention.

FIG. 9 is a flowchart of an imaging method according to an embodiment of the present invention.

FIG. 10 is a flowchart of an imaging method according to an embodiment of the present invention.

FIG. 11 is a flowchart of an imaging method according to another embodiment of the present invention.

10‧‧‧ pixel cell array

11‧‧‧ Pixel Unit

20‧‧‧ Amplification conversion unit

30‧‧‧ Filter Array

31‧‧‧ Filter

100‧‧‧Image Sensor

A1, A2‧‧‧ analog signal

Claims (16)

An image sensor, comprising: an array of pixel units, including a plurality of pixel units; a complex amplification conversion unit for converting the photo-generated charge generated by the pixel unit into an analog signal; and A filter array provided on the pixel unit array. The filter array includes a plurality of filters. The plurality of pixel units corresponding to the same color filter constitute a merged pixel, and each of the same color filters corresponds to 2 *. 2 pixel units; wherein the photo-generated charges generated by the complex pixel units corresponding to the same color filter are converted by the amplification conversion unit to output a first analog signal and a second analog signal, the first analog signal The image signal is the same as the second analog signal; the image sensor further includes an image processing module, the image processing module includes a register, and the image processing module is used to read the pixel unit array Output: Collect the output of the pixel unit in line k and k + 1 and store it in the register, where k = 2n-1, n is a natural number, and k + 1 is less than or equal to the total line of the pixel unit Number; and fetch from this register K-th row and the k + 1 output lines of the pixel unit, the output of the unit pixel of the same pixel merge of the pixel value are summed to obtain the merging of the pixel. The image sensor according to item 1 of the patent application scope, wherein the image sensor includes a CMOS image sensor. The image sensor according to item 1 or item 2 of the patent application scope, wherein the filter array comprises a Bayer array. The image sensor according to item 1 of the scope of patent application, wherein after the photogenerated charges of all the pixel units corresponding to the same color filter for outputting the first analog signal are accumulated, The output of the amplification conversion unit is shared, and the photo-generated charges of all the pixel units corresponding to the same color filter for outputting the second analog signal are accumulated and shared by the output of the amplification conversion unit. The image sensor according to item 1 of the scope of patent application, further comprising: an analog digital conversion unit for converting the first analog signal and the second analog signal into a first digital signal and a first digital signal, respectively. Two-digit signal. The image sensor according to item 1 of the scope of patent application, wherein the plurality of pixel units corresponding to the same color filter are located in different rows of the pixel unit array. The image sensor according to item 1 of the scope of patent application, wherein the same color filter corresponds to a total of 4 pixel units in 2 rows and 2 columns, and the photogenerated charges generated by the 2 pixel units in the first row After the accumulation, the amplification conversion unit converts the first analog signal, and the two pixel units in the second row generate the photo-generated charges, and after the accumulation, the amplification conversion unit converts the second analog signal. The first analog signal and the second analog signal The signal is converted into a first digital signal and a second digital signal by an analog digital conversion unit. The image sensor according to item 1 of the scope of patent application, wherein a micromirror array disposed on the filter array, each micromirror in the micromirror array corresponds to a pixel unit. The image sensor according to item 7 of the scope of patent application, further comprising a control module and an image processing module. The control module is used to control the pixel units corresponding to the same color filter. Simultaneous exposure, the image processing module synthesizes the output of the analog digital conversion unit to obtain an image. A terminal device includes the image sensor according to any one of claims 1 to 9 of the scope of patent application. The terminal device according to item 10 of the patent application scope, wherein the terminal device includes a mobile phone. The terminal device according to item 10 of the scope of patent application, wherein the terminal device further includes a central processing unit and a display device connected to the photographing device, and the central processing unit is configured to control the display device to display the image sensor. Image output from the monitor. An imaging method according to the image sensor of the first patent application scope, characterized in that the imaging method comprises: reading the output of the pixel unit array; and the pixels of the same merged pixel. The output of the unit is added to obtain the pixel value of the merged pixel to generate a merged image; the output of the pixel unit of the same merged pixel is added to obtain the pixel value of the merged pixel to generate a merged image The steps further include: collecting the output of the pixel unit in the kth row and the k + 1th row and storing them in the register, where k = 2n-1, n is a natural number, and k + 1 is less than or equal to the pixel The total number of lines of the unit; and extracting the output of the pixel unit of the kth and k + 1th lines from the register, adding the output of the pixel unit of the same merged pixel to obtain the merged image Prime pixel value. The imaging method according to item 13 of the scope of patent application, wherein the step of generating the merged image by adding the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel further includes: An analog signal output generated by the pixel unit is converted into a digital signal output. A mobile terminal device is characterized by comprising a casing, a processor, a memory, a circuit board and a power circuit, wherein the circuit board is disposed in a space surrounded by the casing, the processor and The memory is disposed on the circuit board; the power circuit is used to power each circuit or device of the mobile terminal device; the memory is used to store executable program code; the processor reads the memory by The stored executable code runs a program corresponding to the executable code for performing the imaging method described in item 13 or item 14 of the scope of patent application. A computer-readable storage medium has an instruction stored therein. When the processor of a mobile terminal executes the instruction, the mobile terminal executes the imaging method according to item 13 or item 14 of the scope of patent application.