TWI615029B - Image sensor, terminal having same and imaging method using same - Google Patents

Abstract

The invention discloses an image sensor comprising a pixel unit array, an amplification conversion unit element including an amplification conversion unit, and a filter array disposed on the pixel unit array. The pixel unit array includes a pixel unit; the amplification conversion unit is configured to convert the photogenerated charge generated by the pixel unit into an analog signal; the filter array includes a filter unit, and the filter unit of the same color corresponds to the plurality of pixel units; The photo-generated charges generated by each pixel unit in a part of the pixel unit are separately outputted by an amplification conversion unit and combined into a first analog signal, and the photo-generated charges generated by the remaining pixel units are added together to share an amplification conversion unit output second. Analog signal, the first analog signal and the second analog signal are not the same. The invention also discloses a terminal and an imaging method.

Description

Image sensor and terminal and imaging method

The present invention belongs to the field of image processing technologies, and in particular, to an image sensor, and a terminal and imaging method having the image sensor.

With the popularity of mobile phones, taking pictures with mobile phones has become a favorite of more and more people. However, with the improvement of the requirements for photographing, the HDR (High-Dynamic Range) function of the image processing of the mobile phone has become a demand of the user. However, at present, the HDR function is generally implemented by software, and the effect is not obvious.

The present invention aims to solve at least one of the technical problems in the related art to some extent.

In order to solve the above problems, an aspect of the present invention provides an image sensor including: a pixel unit array including a plurality of pixel units; and an amplification conversion unit element including a plurality of amplification conversion units, each The amplification conversion unit is configured to convert the photo-generated charge generated by the pixel unit into an analog signal; the filter array disposed on the pixel unit array, the filter array includes a plurality of filter units, and the filter unit of the same color corresponds to the plurality of filter units a pixel unit; wherein, the plurality of pixel units corresponding to the filter unit of the same color, and the photo-generated charges generated by each pixel unit in a part of the pixel units are independently outputted by an amplification unit and merged into a first analogy Signal, the remaining part of the pixel unit The generated photo-generated charge is accumulated and then shared by an amplification conversion unit to output a second analog signal. All pixel units outputting the first analog signal are located in the same column of the pixel unit array, and all pixel units outputting the second analog signal are located. In the same column of the pixel unit array, the first analog signal and the second analog signal are different.

In the image sensor of the present invention, the filter unit based on the same color corresponds to a plurality of pixel units, and the plurality of pixel units corresponding to the filter unit of the same color are converted by the amplitude conversion unit to output two different analog signals. The HDR function provides a hardware foundation. Compared with the software in the related art to implement the HDR function, the image sensor realizes the HDR function by hardware improvement and improves the HDR effect.

In at least one embodiment, the image sensor comprises a CMOS image sensor.

In at least one embodiment, the filter array comprises a Bayer array.

In at least one embodiment, the image sensor further includes: an analog-to-digital converter (ADC) including a plurality of analog-to-digital conversion units, the analog-to-digital conversion unit element being used to The analog signal and the second analog signal are converted into a first digital signal and a second digital signal, respectively.

In at least one embodiment, the plurality of pixel units corresponding to the filter elements of the same color are located in different columns of the pixel unit array.

In at least one embodiment, the filter unit of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, and the photogenerated charges generated by the 2 pixel units in the first column are independently output and combined by an amplification conversion unit. And for the first analog signal, the photo-generated charges generated by the two pixel units in the second column are accumulated and converted into the second analog signal by the amplification conversion unit, and the first analog signal is converted into an analog-type digital conversion unit by an analog-to-digital conversion unit. The first digital signal is converted into the second digital signal by another analog digital conversion unit.

In at least one embodiment, the image sensor further includes: a micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to one of the pixel units.

In at least one embodiment, the image sensor further includes a control module and an image processing module, wherein the control module is configured to control the plurality of pixel units corresponding to the filter unit of the same color to be simultaneously exposed according to the line. The image processing module synthesizes the output of the analog-to-digital conversion unit to obtain a high dynamic range image.

In order to solve the above problems, another aspect of the present invention provides a terminal including the image sensor of the above aspect.

According to the terminal of the present invention, the HDR function can be realized based on the hardware structure of the image sensor by using the image sensor, and the HDR image effect is improved.

In some embodiments of the invention, the imaging terminal comprises a cell phone.

In some embodiments of the present invention, the imaging terminal further includes a central processing unit and a display device connected to the image sensor, and the central processing unit is configured to control the display device to display the high dynamics of the image sensor output. Range image.

In some embodiments of the present invention, the terminal includes a central processing unit and an external memory connected to the image sensor, and the central processing unit is configured to control the external memory to store the high dynamics of the image sensor output. Range image.

Another aspect of the present invention provides an imaging method based on the image sensor described above, wherein the plurality of pixel units corresponding to the filter unit of the same color constitute a merged pixel, and the image processing method includes: reading the picture An output of the cell array; and adding the output of the pixel unit of the same merged pixel to obtain a pixel value of the merged pixel to generate a merged image.

Since the noise of the merged pixels is smaller than the sum of the pixel noises before the combination, the imaging method can obtain images with high signal-to-noise ratio, brightness and sharpness, and less noise under low illumination. Overcoming the shortcomings of some existing imaging methods.

In at least one embodiment, the imaging device includes a temporary memory, each of the filtering units covering 2*2 of the pixel units; the reading step further comprising: collecting the kth row and the k+1th row Pixel The output of the unit is stored in the register, where k=2n-1, n is a natural number, k+1 is less than or equal to the total number of rows of the pixel unit; and the kth line and the first line are extracted from the register The output of the pixel unit of k+1 lines is added to the output of the pixel unit of the same combined pixel to obtain the pixel value of the combined pixel.

In at least one embodiment, the step of reading further includes converting the analog signal output of the photoreceptor to a digital signal output.

In order to solve the above problems, another embodiment of the present invention provides a mobile terminal, which includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed in the housing Inside the space, the processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is used to store executable code; the processor borrows The program corresponding to the executable code is executed by reading the executable code stored in the memory for performing the imaging method described in the above embodiment of the present invention.

In the mobile terminal of the embodiment of the present invention, by reading the output of the pixel unit array, the output of the pixel unit of the same merged pixel is added to obtain a pixel value of the combined pixel to generate a merged image, The noise of the combined pixels is smaller than the sum of the pixel noises before the combination, and the image with higher signal to noise ratio, brightness and sharpness, and less noise can be obtained under low illumination.

In order to solve the above problems, a further embodiment of the present invention provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instruction, the mobile terminal performs the embodiment as in the above aspect. The imaging method described.

The additional aspects and advantages of the invention will be set forth in part in the description which follows.

100‧‧‧Image sensor

10‧‧‧ pixel element array

11‧‧‧Photosensitive unit

111‧‧‧Photosensitive part

20‧‧‧Amplification conversion unit components

30‧‧‧Filter array

31‧‧‧ Filter unit

32‧‧‧ Filter structure

40‧‧‧ analog digital conversion unit components

41‧‧‧First analog-to-digital conversion unit

42‧‧‧Second analog digital conversion unit

50‧‧‧Micromirror array

51‧‧‧Micromirror

100‧‧‧ Terminal

200‧‧‧ central processor

300‧‧‧ display device

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of the embodiments of the invention in which: FIG. 1 is an image sensor in accordance with an embodiment of the present invention. 2 is a schematic view of an image sensor according to another embodiment of the present invention; FIG. 3 is a schematic view showing a distribution of a filter array according to an embodiment of the present invention; A circuit diagram of an image sensor according to an embodiment of the invention; FIG. 5 is a schematic structural view of an image sensor according to still another embodiment of the present invention; and FIG. 6 is a terminal diagram according to an embodiment of the present invention. FIG. 7 is a functional block diagram of a terminal according to another embodiment of the present invention; FIG. 8 is a functional block diagram of a terminal according to still another embodiment of the present invention; A flowchart of an imaging method according to an embodiment of the present invention, FIG. 10 is a flowchart of an imaging method according to an embodiment of the present invention; and FIG. 11 is a flowchart of an imaging method according to another embodiment of the present invention.

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

An image sensor and a terminal having the same according to an embodiment of the present invention will be described below with reference to the accompanying drawings.

First, an image sensor of an embodiment of the present invention will be described. Figure 1 is a functional block diagram of an image sensor in accordance with one embodiment of the present invention.

As shown in FIG. 1, the image sensor 100 includes a pixel unit array 10, an amplification conversion unit element 20, and a filter array 30.

The pixel unit array 10 includes a complex pixel unit 11; the amplification conversion unit element 20 is configured to convert the photo-generated charge generated by the pixel unit 11 into an analog signal; and the filter array 30 is disposed on the pixel unit array 10, each filter The array 30 includes a plurality of filter units 31, and the filter unit 31 of the same color corresponds to the plurality of pixel units 11.

Wherein, the plurality of pixel units 11 corresponding to the filter unit 31 of the same color, and the photo-generated charges generated by each of the pixel units 11 of the pixel unit 11 are independently outputted by an amplification conversion unit SF and combined into a first analogy. The signal A1, the photo-generated charge generated by the remaining pixel unit 11 is accumulated, and an amplification conversion unit SF is outputted to output the second analog signal A2, and all the pixel units 11 outputting the first analog signal A1 are located in the same pixel element array 10. In the first column, all of the pixel units 11 outputting the second analog signal A2 are located in the same second column of the pixel unit array 10, and the second column is in a different column from the first column, the first analog signal A1 and the second analogy Signal A2 is not the same.

In the image sensor 100 of the present invention, the filter unit 31 based on the same color corresponds to the plurality of pixel units 11, and the plurality of pixel units 11 corresponding to the filter unit 31 of the same color are converted by the amplitude conversion unit element 20 and output two. A different analog signal provides a hardware foundation for implementing the HDR function. Compared with the software in the related art, the image sensor 100 implements the HDR function by hardware improvement and improves the HDR effect.

In some embodiments of the invention, image sensor 100 includes a CMOS (Complementary Metal Oxide Semiconductor) image sensor. Filter array 30 includes a Bayer array.

As shown in FIG. 2, the image sensor 100 further includes an analog-to-digital conversion unit component 40 that converts the first analog signal A1 and the second analog signal A2 into the first A digital signal D1 and a second digital signal D2 provide information for image processing. The analog digital conversion unit element 40 includes a complex first analog digital conversion unit 41 and a complex second analog digital conversion unit 42.

In some embodiments of the present invention, the plurality of pixel units 11 corresponding to the filter unit 31 of the same color are located in different columns of the pixel unit array 10.

For example, the filter unit 31 of the same color corresponds to a total of four pixel units 11 in two rows and two columns, and the photo-generated charges generated by the two pixel units 11 in the first column are independently output and combined using one amplification conversion unit SF. The first analog signal A1, the photo-generated charge generated by the two pixel units 11 in the second column is accumulated and converted into the second analog signal A2 by the amplification conversion unit SF, and the first analog signal A1 is converted by the first analog-to-digital conversion unit. 41 is converted into a first digital signal D1, and the second analog signal A2 is converted into a second digital signal D2 by the second analog digital conversion unit 42.

Referring to FIG. 3, which is a schematic diagram of the distribution of the filter array 30 according to an embodiment of the present invention, the filter array 30 adopts a Bayer array color mode in which the same character represents the filter unit 31 of the same color ( For example, Gr, Gb, R, B), the number after the character indicates the row number of the pixel unit corresponding to the filter unit 31 of the same color, and the filter unit 31 of different colors allows only the light of the corresponding wavelength to pass.

Bayer arrays are a common filter array structure. In the Bayer array, the filter unit 31 can be a green (G), red (R), and blue (B) filter unit, wherein the two green filter units, one red filter unit, and one blue filter unit A filter structure 32 is formed. In the present embodiment, each of the filter units 31 corresponds to four pixel units 11.

4 is an equivalent circuit diagram of an image sensor according to an embodiment of the present invention. As shown in FIG. 4, the fourth pixel unit includes a first pixel unit PD1 and a first transfer switch TG1 and a second pixel unit PD2. And a second transfer switch TG2, a third pixel unit PD3 and a third transfer switch TG3, a fourth pixel unit PD4 and a fourth transfer switch TG4, a first amplification conversion unit SF1, a second amplification conversion unit SF2, and a third increase The conversion unit SF3, the first analog digital conversion unit 41, and the second analog digital conversion unit 42. among them, A pixel unit, such as a photodiode, receives light transmitted by the filter unit 31 to generate a charge, and the transfer switch turns on the charge output generated by the corresponding pixel unit 11, and is coupled and converted into a voltage signal by the amplification conversion unit element 20. The analog digital conversion unit component 40 is converted into a digital signal output to provide a data basis for image processing.

The first pixel unit PD1, the second pixel unit PD2, the third pixel unit PD3, and the fourth pixel unit PD4 are adjacent to each other and correspond to the filter unit 31 of the same color, for example, as shown in FIG. That is, four adjacent pixel units 11 receive light of the same color. Briefly, the four pixel units 11 constitute a large pixel. And the first pixel unit PD1 and the third pixel unit PD3 are located in the same first column in the pixel unit array 10, and the second pixel unit PD2 and the fourth pixel unit PD4 are located in the same in the pixel unit array 10. The second column, the second column is in a different column than the first column.

Specifically, the first pixel unit PD1 is connected to the first end of the first amplification conversion unit SF1 by the first transmission switch TG1, and the second pixel unit PD2 is coupled to the second amplification conversion unit SF2 by the second transmission switch TG2. The third pixel unit PD3 is connected to the first end of the third amplification conversion unit SF3 by the third transmission switch TG3, and the fourth pixel unit PD4 is connected to the second amplification conversion unit by the fourth transmission switch TG4. The first end of the SF2 is connected, the control end of the first transfer switch TG1, the control end of the second transfer switch TG2, the control end of the third transfer switch TG3, and the control end of the fourth transfer switch TG4 are all connected with the control module, and are controlled. The module controls the opening and closing of the four transmission switches, and when the transmission switch is turned on, the corresponding pixel unit 11 transmits a signal.

The input ends of the first analog-to-digital conversion unit 41 are respectively connected to the second end of the first amplification conversion unit SF1 and the second end of the third amplification conversion unit SF3, and the third end of the first amplification conversion unit SF1 is preset with a power supply, for example. The Vdd connection, the third end of the third amplification conversion unit SF3 is connected to a preset power source such as Vdd, the input end of the second analog conversion unit 42 is connected to the second end of the second amplification conversion unit SF2, and the second amplification conversion unit SF2 The third end is connected to a preset power source such as Vdd, and the output of the second analog bit conversion unit 42 is connected to the output of the first analog-to-digital conversion unit 41.

The control module of the image sensor 100 controls the plurality of pixel units 11 corresponding to the filter unit 31 of the same color to be simultaneously exposed according to the line, and the image processing module synthesizes the output of the analog digital conversion unit 40 to obtain a high dynamic range. image.

As an example, one pixel unit 11 corresponding to each filter unit 31 of the 2i+1 (i=0, 1, 2, 3, 4...) row in the pixel unit array 10 (such as the filter unit 31) a pixel unit 11 corresponding to Gr1 and a pixel unit 11 of each of the filter units 31 of the 2i+2th row adjacent to the 2i+1th row (such as a pixel unit corresponding to Gr3 in the filter unit) 11), that is, the first pixel unit PD1 and the third pixel unit PD3 are respectively subjected to charge conversion by a first amplification conversion unit SF1 and a third amplification conversion unit SF3, and then converted by the first analog digital conversion unit 41. For digital signal output, it is assumed that the output value of the first analog-to-digital conversion unit 41 is ADC1; in addition, one pixel unit 11 corresponding to each filter unit 31 of the 2i+1th row in the pixel unit array 10 (such as filtering a pixel unit 11 corresponding to Gr2 in the light unit and one pixel unit 11 of each of the filter units 31 of the 2i+2th row (such as the pixel unit 11 corresponding to Gr4 in the filter unit 31), That is, the charge generated by the second pixel unit PD2 and the fourth pixel unit PD4 is collected, and the collected charge is converted by the second amplification conversion unit SF2. Voltage signal, and then by a second analog to digital conversion unit 42 converts the output signal of several bits, at this time was 42 outputs a second analog to digital conversion unit value ADC2.

Specifically, the filter unit 31 of the same color corresponds to two pixel units adjacent to two rows and two columns. Based on the above structure, when performing HDR control, the control module controls the same color of two adjacent rows. Simultaneous exposure, for example, controlling the 2i+1 and 2i+2 lines simultaneously, wherein i=0, 1, 2, 3...., and controlling the exposure time to avoid sharing the second amplification conversion unit SF2 The output of the two pixel units is saturated. In the embodiment of the present invention, the amplification conversion unit element 20 can function as a summary coupling to the charge output from the pixel unit 11, which can be understood, in this case, the first amplification conversion unit SF1, the second amplification conversion unit SF2, and The charge amount or the converted voltage value collected by the third amplification conversion unit SF3 satisfies: SF2=2SF1=2SF3, wherein the output value of the ADC 1 is the average of the sum of SF1 and SF3, so every four A pixel unit of the same color simultaneously outputs a high ADC2 value and a low ADC1 value, and then synthesizes the high ADC2 value and the low ADC1 value at the ISP (Image Signal Processor) end of the image sensor. To obtain an HDR image and implement the HDR function.

It can be understood that the circuit obtained by integrally swapping the left and right of the circuit diagram in FIG. 4 is also included in the scope of the present application, that is, two pixel units 11 in the same column on the left side share an amplification conversion unit SF1, and two paintings on the right side are in the same column. The prime unit 11 uses a single amplification conversion unit SF2, SF3, respectively, and is also included in the scope of the present application, and only the component numbers are different.

As shown in FIG. 5, the image sensor 100 further includes a micromirror array 50 disposed on the filter array 30. Each of the micromirrors 51 in the micromirror array 50 corresponds to a pixel unit 11, including formation, Size and position correspond. The micromirror 51 can collect light to the photosensitive portion 111 of the pixel unit 11, and enhance the received light intensity of the pixel unit 11, thereby improving the image quality.

Based on the image sensor 100 of the above-described embodiments, a terminal 1000 according to another embodiment of the present invention will be described below with reference to the accompanying drawings.

FIG. 6 is a functional block diagram of a terminal 1000 according to an embodiment of the present invention. As shown in FIG. 6, the terminal 1000 includes the image sensor 100 of the above aspect. Specifically, the terminal 1000 may include a mobile phone.

In some embodiments, as shown in FIG. 7, the terminal 1000 further includes a central processing unit 200 and a display device 300 connected to the image sensor 100, and the central processing unit 200 is configured to control the display device 300 to display image sensing. The high dynamic range image output by the device 100. Thus, the image captured by the terminal 1000 can be displayed on the display device 300 for viewing by the user. The display device 300 includes an LED display or the like.

In some embodiments, as shown in FIG. 8, the terminal 1000 includes a central processing unit 200 and an external memory 400 connected to the image sensor 100. The central processing unit 200 is configured to control the external memory 400 to store an image sense. The high dynamic range image output by the detector 100.

In this way, the generated image can be stored for later viewing, use or transfer. outer The part memory 400 includes an SM (Smart Media) card, a CF (Compact Flash) card, and the like.

The terminal 1000 can implement the HDR function based on the hardware structure of the image sensor 100 by using the image sensor 100 to enhance the HDR image effect.

Based on the image sensor of the embodiment of the above aspect, an imaging method according to an embodiment of the present invention is described below with reference to the accompanying drawings, wherein the plurality of pixel units corresponding to the filter unit of the same color constitute a merged pixel.

Figure 9 is a flow chart of an imaging method according to an embodiment of the present invention. As shown in Figure 9, the imaging method includes the following steps:

S1, reading the output of the pixel unit array.

S2, adding the output of the pixel elements of the same merged pixel to obtain the combined pixel values of the pixels to generate a merged image.

，在n=2，m=2的情況下，合成畫素之雜訊即為n*m*N/2左右。因此合併圖像之亮度在低亮度環境下得到提升，而且性噪比提高。 In the imaging method of the embodiment of the present invention, it is assumed that the output of each pixel unit is S, the noise is N, and the merged pixels include M pixel units, and the pixel value of the combined pixel is n*m*S. And the noise of the merged pixels is

In the case of n=2 and m=2, the noise of the synthesized pixel is about n*m*N/2. Therefore, the brightness of the combined image is improved in a low-brightness environment, and the noise-to-noise ratio is improved.

Referring to FIG. 10, in some embodiments, each of the filter units 31 of the same color of the image sensor 100 corresponds to 2*2 pixel units, and the image sensor 100 includes a register. S2 further includes: S201, collecting the output of the pixel unit of the kth row and the k+1th row and storing the output in the register, wherein k=2n-1, n is a natural number, and k+1 is less than or equal to the pixel unit array. The total number of rows; S202, extracting the output of the pixel unit of the kth row and the k+1th row from the scratchpad, and adding the output of the pixel unit of the same merged pixel to obtain the pixel value of the merged pixel.

In this way, the program for reading, caching, and merging the pixel units can be fully utilized by the scratchpad.

Referring to FIG. 11 , in some embodiments, step S2 further includes: S301, converting an analog signal output generated by the pixel unit into a digital signal output; and S302, digitizing the pixel unit of the same combined pixel. The outputs are added to obtain the pixel values of the combined pixels.

In this way, the image processing module of the digital signal processing chip can directly process the output of the image sensor, and the output of the analog signal format directly compared to the image sensor by the circuit. In the case of processing, the information of the image is better preserved. For example, for an image sensor of 16M pixels, the imaging method of the embodiment of the present invention can generate 4M pixels (2* will be generated). The merged image of 2 pixels combined can also generate the original image of 16M pixels (ie, not merged).

A further embodiment of the present invention further provides a mobile terminal, the mobile terminal comprising a housing, a processor, a memory, a circuit board and a power supply circuit, wherein the circuit board is disposed inside the space enclosed by the housing, the processing And the memory is disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is used to store executable code; the processor reads the memory by reading The executable code stored therein runs a program corresponding to the executable code for performing the imaging method of the above aspect.

The embodiment of the present invention further provides a computer readable storage medium having instructions stored therein. When the processor of the mobile terminal executes the instruction, the mobile terminal performs imaging according to the embodiment of the present invention as shown in FIG. method.

In this document, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order. Moreover, the terms "including", "comprising" or "comprising" or any other variations thereof are intended to encompass a non-exclusive inclusion so as to include A series of elements of a procedure, method, article, or device include not only those elements but also other elements that are not explicitly listed, or the elements that are inherent to such a procedure, method, article, or device. An element that is defined by the phrase "comprising a singular" does not exclude the presence of the same element in the process, method, article, or device.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, For use in an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device), or in conjunction with such instructions, execute systems, devices Or use with the device. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with such an instruction execution system, apparatus, or device. More specific examples of computer readable media (non-exhaustive list) include the following: electrical connections (electronic devices) with one or more wires, portable computer case (magnetic device), random access memory (RAM) ), read-only memory (ROM), which erases programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable CD-ROM (CDROM). In addition, the computer readable medium may even be a paper on which the program or other suitable medium may be printed, as it may be optically scanned, for example by paper or other media, followed by editing, interpretation or, if necessary, other The program is processed in an appropriate manner to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware, or combinations thereof. In the above embodiments, the plurality of steps or methods may be implemented with software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following techniques known in the art or a combination thereof: having a logic gate circuit for implementing logic functions on data signals Discrete logic circuit with A dedicated integrated circuit for a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), and the like.

In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means that the embodiment or The specific features, structures, materials, or characteristics described in the examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or a plurality of embodiments or examples. In addition, various embodiments or examples described in the specification and features of the various embodiments or examples may be combined and combined.

In the description of the specification, the descriptions of the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" and the like are intended to refer to the specific features described in connection with the embodiments or examples. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or a plurality of embodiments or examples. In addition, various embodiments or examples described in the specification and features of the various embodiments or examples may be combined and combined.

Although the embodiments of the present invention have been shown and described, it is understood that the foregoing embodiments are illustrative, and are not to be construed as limiting the scope of the invention. The embodiments are subject to changes, modifications, substitutions and variations.

100‧‧‧Image sensor

10‧‧‧ pixel element array

11‧‧‧Amplification conversion unit components

20‧‧‧Amplification conversion unit components

30‧‧‧Filter array

31‧‧‧ Filter unit

Claims (18)

An image sensor comprising: a pixel unit array comprising a plurality of pixel units; an amplification conversion unit element comprising a plurality of amplification conversion units, each amplification conversion unit for generating a pixel unit The photo-generated charge is converted into an analog signal; and a filter array disposed on the pixel unit array, the filter array includes a plurality of filter units, the filter unit of the same color corresponding to the plurality of pixel units; the same color In the complex pixel unit corresponding to the filter unit, the photo-generated charges generated by each of the pixel units in a part of the pixel units are independently outputted by an amplification conversion unit and combined into a first analog signal, and the remaining pixel units are The generated photo-generated charge is accumulated and then shared by an amplification conversion unit to output a second analog signal. All pixel units outputting the first analog signal are located in the same column of the pixel unit array, and all pixel units of the second analog signal are output. Located in the same column of the pixel unit array, the first analog signal and the second analog signal are different. The image sensor of claim 1, wherein the image sensor comprises a CMOS image sensor. The image sensor of claim 1, wherein the filter array comprises a Bayer array. The image sensor of claim 1, further comprising: an analog-to-digital conversion unit component including a plurality of analog-to-digital conversion units, wherein the analog-to-digital conversion unit component is configured to use the first analog signal and The second analog signal is converted into a first digital signal and a second digital signal, respectively. The image sensor according to any one of claims 1 to 4, wherein the plurality of pixel units corresponding to the filter unit of the same color are located in different columns of the pixel unit array. The image sensor of claim 4, wherein the filter unit of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, and the 2 pixel units in the first column are generated. The photo-generated charges are separately outputted by an amplification conversion unit and combined into the first analog signal. The photo-generated charges generated by the two pixel units in the second column are accumulated and converted into the second analog signal by an amplification conversion unit. The first analog signal is converted into the first digital signal by an analog-to-digital conversion unit, and the second analog signal is converted into the second digital signal by another analog-to-digital conversion unit. The image sensor according to any one of claims 1 to 4, further comprising: a micromirror array disposed on the filter array, each of the micro mirror arrays The micromirror corresponds to a pixel unit. The image sensor of claim 4, further comprising: a control module and an image processing module, wherein the control module is configured to control a plurality of paintings corresponding to the filter unit of the same color The element units are simultaneously exposed in a row, and the image processing module synthesizes the output of the analog-to-digital conversion unit to obtain a high dynamic range image. A terminal characterized by comprising the image sensor according to any one of claims 1 to 8. The terminal of claim 9, wherein the terminal comprises a mobile phone. The terminal of claim 9 or 10, wherein the terminal further comprises a central processing unit and a display device connected to the image sensor, the central processor is configured to control the display device to display the The high dynamic range image output by the image sensor. The terminal of claim 9 or 10, wherein the terminal comprises a central processing unit and an external memory connected to the image sensor, wherein the central processing unit is configured to control the external memory storage. The image sensor outputs the high dynamic range image. An image sensor imaging method, comprising: a pixel unit array, an amplification conversion unit component including a plurality of amplification conversion units, and an array disposed on the pixel unit array a filter array, the pixel unit array includes a plurality of pixel units, each of the amplification conversion units is configured to convert the photo-generated charge generated by the pixel unit into an analog signal, the filter array includes a plurality of filter units, and the filter of the same color The unit corresponds to a plurality of pixel units, and the photo-generated charges generated by each of the pixel units in the pixel unit of the same color are independently outputted by an amplification unit and combined into The first analog signal, the remaining part of the pixel unit generates a photo-generated charge and then shares an amplification conversion unit to output a second analog signal, and all pixel units outputting the first analog signal are located in the same column of the pixel unit array, and output All pixel units of the second analog signal are located in the same column of the pixel unit array, the first analog signal and the first The analog signal is different, and the complex pixel unit corresponding to the filter unit of the same color constitutes a merged pixel, the image processing method includes: reading an output of the pixel unit array; and drawing the same pixel of the same pixel The outputs of the prime cells are added to obtain the pixel values of the merged pixels to generate a merged image. The imaging method of claim 13, wherein each of the filter units of the same color corresponds to 2*2 of the pixel units. The imaging method of claim 13 or claim 14, wherein the image sensor comprises a temporary memory, the reading step further comprising: collecting the picture of the kth line and the k+1th line The output of the prime unit is stored in the register, where k=2n-1, n is a natural number, k+1 is less than or equal to the total number of rows of the pixel unit array; and the kth row is extracted from the register And the output of the pixel unit of the k+1th row, the output of the pixel unit of the same merged pixel is added to obtain the pixel value of the combined pixel. The imaging method of claim 13, wherein the reading step further comprises: converting the analog signal output generated by the pixel unit to a digital signal output. A mobile terminal includes a casing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the casing, and the processor and the memory are disposed at The power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is configured to store executable code; and the processor reads the executable code stored in the memory The program corresponding to the executable code is executed for performing the imaging method according to any one of claims 13 to 16. A computer readable storage medium having instructions stored therein, the mobile terminal performing an imaging method according to any one of claims 13 to 16 when the processor of the mobile terminal executes the instruction.