TW201724843A - Image sensor, terminal having same and imaging method using same - Google Patents

Image sensor, terminal having same and imaging method using same Download PDF

Info

Publication number
TW201724843A
TW201724843A TW105141889A TW105141889A TW201724843A TW 201724843 A TW201724843 A TW 201724843A TW 105141889 A TW105141889 A TW 105141889A TW 105141889 A TW105141889 A TW 105141889A TW 201724843 A TW201724843 A TW 201724843A
Authority
TW
Taiwan
Prior art keywords
unit
pixel
image sensor
filter
array
Prior art date
Application number
TW105141889A
Other languages
Chinese (zh)
Other versions
TWI615028B (en
Inventor
李龍佳
Original Assignee
廣東歐珀移動通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 廣東歐珀移動通信有限公司 filed Critical 廣東歐珀移動通信有限公司
Publication of TW201724843A publication Critical patent/TW201724843A/en
Application granted granted Critical
Publication of TWI615028B publication Critical patent/TWI615028B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/77Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • H04N25/57Control of the dynamic range
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/71Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/75Circuitry for providing, modifying or processing image signals from the pixel array

Abstract

The present disclosure describes an image sensor. The image sensor includes a photosensitive unit array, an amplitude conversion unit assembly having a number of amplitude conversion units, and a filter array. The photosensitive unit array includes a number of photosensitive units. The amplitude conversion units are configured for converting photogenerated charge of the photosensitive units to analog signals. The filter array is arranged on the photosensitive unit array and includes a number of filter units. Each filter unit having the same color corresponds to number of photosensitive units. In photosensitive units corresponding to a filter unit having the same color, photogenerated charge generated by portions of the photosensitive units is combined and then converted by one amplitude conversion unit to a first analog signal, photogenerated charge of the rest of the photosensitive units is combined and then converted by the other one amplitude conversion unit to a second analog signal. The first analog signal is different from the second analog signal. The present disclosure also describes a terminal and an imaging method.

Description

圖像感測器及終端與成像方法Image sensor and terminal and imaging method

本發明屬於影像處理技術領域,尤其涉及一種圖像感測器,以及一種具有該圖像感測器之終端、成像方法。The present invention belongs to the field of image processing technologies, and in particular, to an image sensor, and a terminal and imaging method having the image sensor.

隨著手機的普及,用手機拍照成為越來越多人的喜好。但是隨著對拍照要求的提高,手機的影像處理之HDR(High-Dynamic Range,高動態範圍)功能成為使用者的需求,但是,目前,實現HDR功能,一般藉由軟體實現,效果不明顯。With the popularity of mobile phones, taking pictures with mobile phones has become a favorite of more and more people. However, with the improvement of the requirements for photographing, the HDR (High-Dynamic Range) function of the image processing of the mobile phone has become a demand of the user. However, at present, the HDR function is generally implemented by software, and the effect is not obvious.

本發明旨在至少在一定程度上解決相關技術中之技術問題之一。The present invention aims to solve at least one of the technical problems in the related art to some extent.

為了解決上述問題,本發明一方面提出一種圖像感測器,該圖像感測器包括:畫素單元陣列,包括複數畫素單元;包括複數增幅轉換單元之增幅轉換單元元件,每個增幅轉換單元用於將畫素單元產生之光生電荷轉換為類比訊號;設置於該畫素單元陣列上之濾光陣列,濾光陣列包括複數濾光單元,同一顏色之該濾光單元對應於複數畫素單元;其中,該同一顏色之濾光單元所對應的複數畫素單元中一部分之畫素單元產生之光生電荷累加後共用一增幅轉換單元輸出第一類比訊號,該同一顏色之濾光單元所對應的複數畫素單元中剩餘部分之畫素單元產生之光生電荷累加後共用一增幅轉換單元輸出第二類比訊號,該第一類比訊號和該第二類比訊號不相同。In order to solve the above problems, an aspect of the present invention provides an image sensor, the image sensor comprising: a pixel unit array including a plurality of pixel units; and an amplification conversion unit element including a plurality of amplification conversion units, each increasing The conversion unit is configured to convert the photo-generated charge generated by the pixel unit into an analog signal; the filter array disposed on the pixel unit array, the filter array includes a plurality of filter units, and the filter unit of the same color corresponds to the plurality of pictures a prime unit; wherein the photo-generated charges generated by a part of the pixel units of the plurality of pixel units corresponding to the filter unit of the same color are combined and output by an amplification conversion unit to output a first analog signal, and the filter unit of the same color The photo-generated charge generated by the remaining pixel units of the corresponding plurality of pixel units is accumulated and then shared by an increasing conversion unit to output a second analog signal, the first analog signal and the second analog signal being different.

本發明之圖像感測器,基於同一顏色之濾光單元對應複數畫素單元,且同一顏色之濾光單元對應的複數畫素單元經增幅轉換單元轉換後輸出二不同之類比訊號,為實現HDR功能提供硬體基礎,相較於相關技術中之軟體實現HDR功能,該圖像感測器藉由硬體改進實現HDR功能,提升HDR效果。In the image sensor of the present invention, the filter unit based on the same color corresponds to a plurality of pixel units, and the plurality of pixel units corresponding to the filter unit of the same color are converted by the amplitude conversion unit to output two different analog signals. The HDR function provides a hardware foundation. Compared with the software in the related art, the HDR function is implemented by the hardware sensor to improve the HDR effect.

在至少一實施例中,該圖像感測器包括CMOS圖像感測器。In at least one embodiment, the image sensor comprises a CMOS image sensor.

在至少一實施例中,該濾光陣列包括拜耳陣列。In at least one embodiment, the filter array comprises a Bayer array.

在至少一實施例中,該圖像感測器還包括:包括複數模數轉換單元(ADC,Analog-to-Digital Converter)之模數轉換單元元件,模數轉換單元元件用於將第一類比訊號和第二類比訊號分別轉換為第一數位訊號和第二數位訊號。In at least one embodiment, the image sensor further includes: an analog to digital conversion unit element including an analog-to-digital converter (ADC), and the analog-to-digital conversion unit element is used to compare the first analogy The signal and the second analog signal are converted into a first digital signal and a second digital signal, respectively.

在至少一實施例中,同一顏色之濾光單元所對應的複數畫素單元位於畫素單元陣列之不同行。In at least one embodiment, the plurality of pixel units corresponding to the filter elements of the same color are located in different rows of the pixel unit array.

在至少一實施例中,該同一顏色之濾光單元對應2行2列共計4個畫素單元,位於第一行中之二畫素單元產生之光生電荷和位於第二行之一畫素單元產生之光生電荷累加後經過增幅轉換單元轉換為該第一類比訊號,位於第二行中之另1個畫素單元產生之光生電荷經過增幅轉換單元轉換為該第二類比訊號,該第一類比訊號藉由一模數轉換單元轉換為該第一數位訊號,該第二類比訊號藉由另一模數轉換單元轉換為該第二數位訊號。In at least one embodiment, the filter unit of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, the photo-generated charge generated by the two-pixel unit in the first row and the pixel unit located in the second row. The generated photo-generated charge is converted into the first analog signal by the amplification conversion unit, and the photo-generated charge generated by the other pixel unit in the second row is converted into the second analog signal by the amplification conversion unit, the first analogy The signal is converted into the first digital signal by an analog to digital conversion unit, and the second analog signal is converted into the second digital signal by another analog to digital conversion unit.

在至少一實施例中,上述圖像感測器還包括:設置在該濾光陣列上之微鏡陣列,該微鏡陣列中之每個微鏡與一該畫素單元對應。In at least one embodiment, the image sensor further includes: a micromirror array disposed on the filter array, each micromirror in the micromirror array corresponding to a pixel unit.

在至少一實施例中,上述圖像感測器還包括控制模組和影像處理模組,該控制模組用於控制該同一顏色之濾光單元所對應的複數畫素單元按照行同時曝光,該影像處理模組對該模數轉換單元之輸出進行合成以獲得高動態範圍圖像。In at least one embodiment, the image sensor further includes a control module and an image processing module, wherein the control module is configured to control the plurality of pixel units corresponding to the filter unit of the same color to be simultaneously exposed according to the line. The image processing module synthesizes the output of the analog to digital conversion unit to obtain a high dynamic range image.

為了解決上述問題,本發明另一方面提出一種終端,該終端包括上述方面該之圖像感測器。In order to solve the above problems, another aspect of the present invention provides a terminal including the image sensor of the above aspect.

本發明之終端,藉由採用該之圖像感測器,基於圖像感測器之硬體結構可以實現HDR功能,提升HDR圖像效果。According to the terminal of the present invention, the HDR function can be realized based on the hardware structure of the image sensor by using the image sensor, and the HDR image effect is improved.

在至少一實施例中,該成像終端包括手機。In at least one embodiment, the imaging terminal includes a cell phone.

在至少一實施例中,該成像終端還包括與該圖像感測器連接之中央處理器及顯示裝置,該中央處理器用於控制該顯示裝置顯示該圖像感測器輸出之高動態範圍圖像。In at least one embodiment, the imaging terminal further includes a central processing unit and a display device coupled to the image sensor, the central processor configured to control the display device to display a high dynamic range map of the image sensor output image.

在至少一實施例中,該終端包括與該圖像感測器連接之中央處理器及外部記憶體,該中央處理器用於控制該外部記憶體儲存該圖像感測器輸出之高動態範圍圖像。In at least one embodiment, the terminal includes a central processing unit and an external memory connected to the image sensor, and the central processing unit is configured to control the external memory to store a high dynamic range map of the image sensor output. image.

本發明再一方面提出一種基於上述之圖像感測器之成像方法,其中,該同一顏色之濾光單元所對應的複數畫素單元構成合併畫素,該影像處理方法包括:讀取該畫素單元陣列之輸出;以及將同一該合併畫素之該畫素單元之輸出相加以得到該合併畫素之畫素值從而生成合併圖像。Another aspect of the present invention provides an imaging method based on the image sensor described above, wherein the plurality of pixel units corresponding to the filter unit of the same color constitute a merged pixel, and the image processing method includes: reading the picture An output of the cell array; and adding the output of the pixel unit of the same merged pixel to obtain a pixel value of the merged pixel to generate a merged image.

由於合併畫素之雜訊小於合併之前各畫素雜訊之和,採用此成像方法能在低照度下得到信噪比、亮度和清晰度較高,噪點較少之圖像。克服了現有某些成像方法之缺點。Since the noise of the merged pixels is smaller than the sum of the pixel noises before the combination, the imaging method can obtain images with high signal-to-noise ratio, brightness and sharpness, and less noise under low illumination. Overcoming the shortcomings of some existing imaging methods.

在至少一實施例中,該成像裝置包括暫存器,每個該濾光單元覆蓋2*2個該感光畫素;該讀出步驟進一步包括:採集第k行及第k+1行之該畫素單元之輸出並存入該暫存器,其中k=2n-1,n為自然數,k+1小於等於該畫素單元之總行數;及從該暫存器中提取該第k行及第k+1行之該畫素單元之輸出,將同一該合併畫素之該畫素單元之輸出相加以得到該合併畫素之畫素值。In at least one embodiment, the imaging device includes a temporary memory, each of the filtering units covering 2*2 of the photographic pixels; the reading step further comprising: collecting the kth row and the k+1th row The output of the pixel unit is stored in the register, where k=2n-1, n is a natural number, k+1 is less than or equal to the total number of rows of the pixel unit; and the kth line is extracted from the register And the output of the pixel unit of the k+1th row, the output of the pixel unit of the same merged pixel is added to obtain the pixel value of the combined pixel.

在至少一實施例中,該讀出步驟進一步包括:將該感光畫素產生之類比訊號輸出轉換為數位訊號輸出。In at least one embodiment, the step of reading further comprises converting the analog signal output of the photoreceptor to a digital signal output.

為了解決上述問題,本發明又一方面實施例提出了一種行動終端,該行動終端包括殼體、處理器、記憶體、電路板和電源電路,其中,該電路板安置在該殼體圍成之空間內部,該處理器和該記憶體設置在該電路板上;該電源電路,用於為該行動終端之各個電路或裝置供電;該記憶體用於儲存可執行程式碼;該處理器藉由讀取該記憶體中儲存之可執行程式碼來運行與該可執行程式碼對應之程式,以用於執行本發明上述實施例該之成像方法。In order to solve the above problems, another embodiment of the present invention provides a mobile terminal, which includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed in the housing Inside the space, the processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is used to store executable code; the processor is configured by The executable code stored in the memory is read to run a program corresponding to the executable code for performing the imaging method of the above embodiment of the present invention.

本發明實施例之行動終端,藉由讀取該畫素單元陣列之輸出,將同一合併畫素之該畫素單元之輸出相加以得到該合併畫素之畫素值從而生成合併圖像,由於合併畫素之雜訊小於合併之前各畫素雜訊之和,能在低照度下得到信噪比、亮度和清晰度較高,噪點較少之圖像。In the mobile terminal of the embodiment of the present invention, by reading the output of the pixel unit array, the output of the pixel unit of the same merged pixel is added to obtain a pixel value of the combined pixel to generate a merged image, The noise of the combined pixels is smaller than the sum of the pixel noises before the combination, and the image with higher signal to noise ratio, brightness and sharpness, and less noise can be obtained under low illumination.

為了解決上述問題,本發明又一方面實施例提出了一種電腦可讀儲存媒體,具有儲存於其中之指令,當行動終端之處理器執行該指令時,該行動終端執行如上述方面實施例該之成像方法。In order to solve the above problems, another embodiment of the present invention provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instruction, the mobile terminal performs the embodiment as in the above aspect. Imaging method.

本發明附加之方面和優點將在下面之描述中部分給出,部分將從下面之描述中變得明顯,或藉由本發明之實踐瞭解到。The additional aspects and advantages of the invention will be set forth in part in the description which follows.

下面詳細描述本發明之實施方式,該實施方式之示例在附圖中示出,其中自始至終相同或類似之標號表示相同或類似之元件或具有相同或類似功能之元件。下面藉由參考附圖描述之實施方式係示例性之,旨在用於解釋本發明,而不能理解為對本發明之限制。The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

首先,對本發明實施例之圖像感測器進行說明。第1圖係根據本發明之一實施例之圖像感測器之功能模組圖。First, an image sensor of an embodiment of the present invention will be described. 1 is a functional block diagram of an image sensor in accordance with an embodiment of the present invention.

如第1圖所示,該圖像感測器100包括畫素單元陣列10、增幅轉換單元元件20和濾光陣列30。As shown in FIG. 1, the image sensor 100 includes a pixel unit array 10, an amplification conversion unit element 20, and a filter array 30.

畫素單元陣列10包括複數畫素單元11;增幅轉換單元元件20用於將畫素單元11產生之光生電荷轉換為類比訊號;濾光陣列30設置於畫素單元陣列10上,每個濾光陣列30包括複數濾光單元31,同一顏色之濾光單元31對應於複數畫素單元11。The pixel unit array 10 includes a complex pixel unit 11; the amplification conversion unit element 20 is configured to convert the photo-generated charge generated by the pixel unit 11 into an analog signal; and the filter array 30 is disposed on the pixel unit array 10, each filter The array 30 includes a plurality of filter units 31, and the filter unit 31 of the same color corresponds to the plurality of pixel units 11.

其中,同一顏色之濾光單元31所對應的複數畫素單元11中一部分之畫素單元11產生之光生電荷累加後共用一增幅轉換單元SF輸出第一類比訊號A1,同一顏色之濾光單元31所對應的複數畫素單元11中剩餘部分之畫素單元11產生之光生電荷累加後共用一增幅轉換單元SF輸出第二類比訊號A2,第一類比訊號A1和該第二類比訊號A2不相同。The photo-generated charge generated by a part of the pixel units 11 of the plurality of pixel units 11 corresponding to the filter unit 31 of the same color is shared by an amplification conversion unit SF to output the first analog signal A1, and the filter unit 31 of the same color. The photo-generated charge generated by the remaining pixel unit 11 in the corresponding pixel unit 11 is shared by an amplification conversion unit SF to output a second analog signal A2. The first analog signal A1 and the second analog signal A2 are different.

本發明之圖像感測器100,基於同一顏色之濾光單元31對應複數畫素單元11,且同一顏色之濾光單元31對應的複數畫素單元11經增幅轉換單元元件20轉換後輸出二不同之類比訊號,為實現HDR功能提供硬體基礎,相較於相關技術中之軟體實現HDR功能,該圖像感測器100藉由硬體改進實現HDR功能,提升HDR效果。In the image sensor 100 of the present invention, the filter unit 31 based on the same color corresponds to the plurality of pixel units 11, and the plurality of pixel units 11 corresponding to the filter unit 31 of the same color are converted by the amplitude conversion unit element 20 and output two. Different analog signals provide a hardware foundation for implementing the HDR function. Compared with the software in the related art, the image sensor 100 implements the HDR function by hardware improvement and improves the HDR effect.

如第2圖所示,圖像感測器100還包括模數轉換單元元件40,模數轉換單元4元件0將第一類比訊號A1和第二類比訊號A2分別轉換為第一數位訊號D1和第二數位訊號D2,為影像處理提供資料。模數轉換單元元件40包括複數第一模數轉換單元41和複數第二模數轉換單元42。As shown in FIG. 2, the image sensor 100 further includes an analog-to-digital conversion unit component 40. The analog-to-digital conversion unit 4 component 0 converts the first analog signal A1 and the second analog signal A2 into a first digital signal D1 and The second digit signal D2 provides information for image processing. The analog to digital conversion unit element 40 includes a complex first analog to digital conversion unit 41 and a complex second analog to digital conversion unit 42.

在本發明之一些實施例中,圖像感測器100包括CMOS圖像感測器。濾光陣列30包括拜耳陣列。In some embodiments of the invention, image sensor 100 includes a CMOS image sensor. Filter array 30 includes a Bayer array.

在本發明之一些實施例中,同一顏色之濾光單元31所對應的複數畫素單元11位於畫素單元陣列10之不同行。In some embodiments of the present invention, the plurality of pixel units 11 corresponding to the filter unit 31 of the same color are located in different rows of the pixel unit array 10.

例如,同一顏色之濾光單元31對應2行2列共計4個畫素單元11,位於第一行中之二畫素單元11產生之光生電荷和位於第二行之一畫素單元產生之光生電荷累加後經過增幅轉換單元SF轉換為第一類比訊號A1,位於第二行中之另一畫素單元11產生之光生電荷經過增幅轉換單元SF轉換為第二類比訊號A2,第一類比訊號A1藉由一第一模數轉換單元41轉換為第一數位訊號D1,第二類比訊號A2藉由第二模數轉換單元42轉換為第二數位訊號D2。For example, the filter unit 31 of the same color corresponds to a total of four pixel units 11 in two rows and two columns, the photo-generated charge generated by the two-pixel unit 11 in the first row, and the photo-generated from the pixel unit in the second row. After the charge is accumulated, the amplification signal SF is converted into the first analog signal A1, and the photo-generated charge generated by the other pixel unit 11 in the second row is converted into the second analog signal A2 by the amplification conversion unit SF, and the first analog signal A1. The first analog-to-digital signal D2 is converted into the first digital signal D1 by the first analog-to-digital conversion unit 41, and the second analog-to-digital signal A2 is converted into the second digital signal D2 by the second analog-to-digital conversion unit 42.

參照第3圖所示,為根據本發明之一實施例之濾光陣列30分佈示意圖,濾光陣列30採用拜耳陣列(Bayer array)顏色模式,其中,相同字符表示相同顏色之濾光單元31(例如Gr,Gb,R,B),字符後之數字表示相同顏色之濾波單元31對應的畫素單元之排號,不同顏色之濾光單元31僅允許對應波長之光透過。Referring to FIG. 3, which is a schematic diagram of the distribution of the filter array 30 according to an embodiment of the present invention, the filter array 30 adopts a Bayer array color mode in which the same characters represent the filter unit 31 of the same color ( For example, Gr, Gb, R, B), the number after the character indicates the row number of the pixel unit corresponding to the filtering unit 31 of the same color, and the filter unit 31 of different colors allows only the light of the corresponding wavelength to pass.

拜耳陣列係一種常見之濾光單元陣列結構。在拜耳陣列中,濾光單元31可以係綠色(G)、紅色(R)及藍色(B)濾光單元,其中二綠色濾光單元、一紅色濾光單元及一藍色濾光單元構成一濾光結構32。在本實施方式中,每個濾光單元31對應四畫素單元11。The Bayer array is a common filter cell array structure. In the Bayer array, the filter unit 31 can be a green (G), red (R), and blue (B) filter unit, wherein the two green filter units, a red filter unit, and a blue filter unit are formed. A filter structure 32. In the present embodiment, each of the filter units 31 corresponds to the four pixel unit 11.

第4圖係根據本發明之一實施例之圖像感測器之等效電路圖,如第4圖所示,包括:第一畫素單元PD1和第一傳輸開關TG1、第二畫素單元PD2和第二傳輸開關TG2、第三畫素單元PD3和第三傳輸開關TG3、第四畫素單元PD4和第四傳輸開關TG4、第一增幅轉換單元SF1和第一模數轉換單元41、第二增幅轉換單元SF2和第二模數轉換單元42。其中,畫素單元,例如光電二極體,接收濾光單元31透過之光而生成電荷,傳輸開關開啟則對應的畫素單元11生成之電荷輸出,進而在增幅轉換單元元件20耦合並轉換為電壓訊號,藉由模數轉換單元元件40轉換為數位訊號輸出,為影像處理提供資料基礎。4 is an equivalent circuit diagram of an image sensor according to an embodiment of the present invention. As shown in FIG. 4, the fourth pixel unit includes a first pixel unit PD1 and a first transfer switch TG1 and a second pixel unit PD2. And a second transfer switch TG2, a third pixel unit PD3 and a third transfer switch TG3, a fourth pixel unit PD4 and a fourth transfer switch TG4, a first amplification conversion unit SF1 and a first analog to digital conversion unit 41, and a second The amplification conversion unit SF2 and the second analog-to-digital conversion unit 42. Wherein, a pixel unit, such as a photodiode, receives light transmitted by the filter unit 31 to generate a charge, and when the transfer switch is turned on, the charge generated by the corresponding pixel unit 11 is output, and then coupled and converted to the amplification conversion unit element 20 The voltage signal is converted into a digital signal output by the analog-to-digital conversion unit component 40 to provide a data basis for image processing.

具體地,第一畫素單元PD1與第一傳輸開關TG1之第一端連接,第二畫素單元PD2與第二傳輸開關TG2之第一端連接,第三畫素單元PD3與第三傳輸開關TG3之第一端連接,第四畫素單元PD4與第四傳輸開關TG4之第一端連接,第一傳輸開關TG1之控制端、第二傳輸開關TG2之控制端、第三傳輸開關TG3之控制端和第四傳輸開關TG4之控制端均與控制模組連接,控制模組控制四傳輸開關之開啟與關閉,在傳輸開關開啟時,對應的畫素單元傳出訊號。其中,第一畫素單元PD1、第二畫素單元PD2、第三畫素單元PD3和第四畫素單元PD4為分別相鄰之對應相同顏色之濾光單元之畫素單元,例如第4圖中所示,四畫素單元11為對應其中標識字符相同之濾光單元31對應的畫素單元11,也就係四分別相鄰之畫素單元11接收相同顏色之光,簡單地說,即四畫素單元11構成一大之畫素(pixel)。Specifically, the first pixel unit PD1 is connected to the first end of the first transfer switch TG1, the second pixel unit PD2 is connected to the first end of the second transfer switch TG2, and the third pixel unit PD3 and the third transfer switch are connected. The first end of the TG3 is connected, the fourth pixel unit PD4 is connected to the first end of the fourth transfer switch TG4, the control end of the first transfer switch TG1, the control end of the second transfer switch TG2, and the third transfer switch TG3 are controlled. The control ends of the terminal and the fourth transmission switch TG4 are both connected to the control module, and the control module controls the opening and closing of the four transmission switches. When the transmission switch is turned on, the corresponding pixel unit transmits a signal. The first pixel unit PD1, the second pixel unit PD2, the third pixel unit PD3, and the fourth pixel unit PD4 are pixel units respectively adjacent to the filter unit of the same color, for example, FIG. As shown in the figure, the four pixel unit 11 is a pixel unit 11 corresponding to the filter unit 31 in which the same character is identified, that is, four adjacent pixel units 11 receive light of the same color, simply, that is, The four pixel unit 11 constitutes a large pixel.

第一增幅轉換單元SF1之第一端分別與第一傳輸開關TG1之第二端、第二傳輸開關TG2之第二端和第三傳輸開關TG3之第二端連接,第一增幅轉換單元SF1之第二端與預設電源Vdd連接,第一增幅轉換單元SF1之第三端與第一模數轉換單元41之輸入端連接;The first end of the first amplification conversion unit SF1 is respectively connected to the second end of the first transmission switch TG1, the second end of the second transmission switch TG2, and the second end of the third transmission switch TG3, and the first amplification conversion unit SF1 The second end is connected to the preset power supply Vdd, and the third end of the first amplification conversion unit SF1 is connected to the input end of the first analog-to-digital conversion unit 41;

第二增幅轉換單元SF2之第一端與第四傳輸開關TG4之第二端連接,第二增幅轉換單元SF2之第二端與預設電源Vdd連接,第二增幅轉換單元SF2之第三端與第二模數轉換單元42之輸入端連接,第二模數轉換單元42之輸出端與第一模數轉換單元41之輸出端連接。The first end of the second amplification conversion unit SF2 is connected to the second end of the fourth transmission switch TG4, the second end of the second amplification conversion unit SF2 is connected to the preset power supply Vdd, and the third end of the second amplification conversion unit SF2 is The input of the second analog-to-digital conversion unit 42 is connected, and the output of the second analog-to-digital conversion unit 42 is connected to the output of the first analog-to-digital conversion unit 41.

圖像感測器100之控制模組用於控制同一顏色之濾光單元31所對應的複數畫素單元11按照行同時曝光,影像處理模組對模數轉換單元40之輸出進行合成以獲得高動態範圍圖像。The control module of the image sensor 100 is configured to control the plurality of pixel units 11 corresponding to the filter unit 31 of the same color to be simultaneously exposed according to the line, and the image processing module synthesizes the output of the analog-to-digital conversion unit 40 to obtain a high Dynamic range image.

作為一示例,畫素單元陣列10內第2i+1(i=0,1,2,3,4…)行和鄰近第2i+1行之第2i+2行之每個濾光單元31對應的三畫素單元(比如濾光單元Gr1,Gr2 、Gr4所對應的畫素單元),即第一畫素單元PD1和第二畫素單元PD2和第三畫素單元PD3,共用一增幅轉換單元即第一增幅轉換單元SF1,第一畫素單元PD1、第二畫素單元PD2和第三畫素單元PD3產生之電荷彙集,由第一增幅轉換單元SF1將彙集後之電荷轉換為電壓訊號,並進一步藉由第一模數轉換單元41轉換為數位訊號輸出,設此時第一模數轉換單元41輸出值為ADC1;另外,畫素單元陣列10內第2i+2行之每個濾光單元31之一畫素單元(比如濾光單元Gr3所對應的畫素單元),即第四畫素單元PD4藉由第二增幅轉換單元SF2進行電荷轉換,最後藉由第二模數轉換單元42轉換為數位訊號輸出,設此時第二模數轉換單元42輸出值為ADC2。As an example, the 2i+1 (i=0, 1, 2, 3, 4...) rows in the pixel unit array 10 correspond to each of the filter units 31 in the 2i+2th row adjacent to the 2i+1th row. The three pixel units (such as the pixel units corresponding to the filter units Gr1, Gr2, and Gr4), that is, the first pixel unit PD1 and the second pixel unit PD2 and the third pixel unit PD3 share an amplification conversion unit That is, the first amplification conversion unit SF1, the charge generated by the first pixel unit PD1, the second pixel unit PD2, and the third pixel unit PD3 are collected, and the collected charge is converted into a voltage signal by the first amplification conversion unit SF1. And further converted into a digital signal output by the first analog-to-digital conversion unit 41, wherein the output value of the first analog-to-digital conversion unit 41 is set to ADC1; in addition, each of the 2i+2 rows in the pixel unit array 10 is filtered. One pixel unit of the unit 31 (such as a pixel unit corresponding to the filter unit Gr3), that is, the fourth pixel unit PD4 performs charge conversion by the second amplification conversion unit SF2, and finally by the second analog-to-digital conversion unit 42. Converted to digital signal output, it is assumed that the output value of the second analog-to-digital conversion unit 42 is ADC2.

具體地,以同一顏色之濾光單元31對應2行2列相鄰之4個畫素單元11為例,基於上述之結構,在進行HDR控制時,控制模組可以控制相鄰兩行之相同顏色畫素同時曝光,例如,第2i+1與2i+2行同時曝光,其中,i=0,1,2,3..... ,並控制曝光時間,避免共用第一增幅轉換單元SF1之三畫素單元11之輸出飽和。在本發明之實施例中,增幅轉換單元元件20可以對畫素單元11輸出之電荷起到匯總耦合之作用,可以理解的係,如果設第一增幅轉換單元SF1輸出為S1,設第二增幅轉換單元SF2輸出為S2,則滿足S1=3S2,所以每四相同顏色之畫素單元11同時輸出一高ADC值和一低ADC值,進而在圖像感測器100之ISP(Image Signal Processor,即影像處理器)端進行合成處理,可以實現HDR功能。Specifically, the filter unit 31 of the same color is used as an example for the four pixel units 11 adjacent to the two rows and two columns. Based on the above configuration, the control module can control the same two adjacent lines when performing HDR control. The color pixels are simultaneously exposed. For example, the 2i+1 and 2i+2 lines are simultaneously exposed, wherein i=0, 1, 2, 3...., and the exposure time is controlled to avoid sharing the first amplification conversion unit SF1. The output of the three pixel unit 11 is saturated. In the embodiment of the present invention, the amplification conversion unit component 20 can function as a summary coupling to the charge output from the pixel unit 11. It can be understood that if the output of the first amplification conversion unit SF1 is S1, the second amplification is set. When the output of the conversion unit SF2 is S2, then S1=3S2 is satisfied, so every four pixel units of the same color simultaneously output a high ADC value and a low ADC value, and further, at the ISP (Image Signal Processor, Image Sensor 100, That is, the image processor) performs synthesis processing to implement the HDR function.

如第5圖所示,圖像感測器100還包括設置在濾光陣列30上之微鏡陣列50,微鏡陣列50中之每個微鏡51與一畫素單元11對應,包括形成、大小、位置對應。微鏡51能將光聚集到畫素單元11之感光部分111,提升畫素單元11之受光強度,從而改善成像畫質。As shown in FIG. 5, the image sensor 100 further includes a micromirror array 50 disposed on the filter array 30. Each of the micromirrors 51 in the micromirror array 50 corresponds to a pixel unit 11, including formation, Size and position correspond. The micromirror 51 can collect light to the photosensitive portion 111 of the pixel unit 11, and enhance the received light intensity of the pixel unit 11, thereby improving the image quality.

基於上述方面實施例之圖像感測器100,下面參照附圖描述根據本發明另一方面實施例提出之終端1000。Based on the image sensor 100 of the above-described embodiments, a terminal 1000 according to another embodiment of the present invention will be described below with reference to the accompanying drawings.

第6圖係根據本發明之一實施例之終端1000之功能模組圖,如第6圖所示,該終端1000包括上述方面之圖像感測器100。具體地,終端1000可以包括手機。Figure 6 is a functional block diagram of a terminal 1000 in accordance with an embodiment of the present invention. As shown in Figure 6, the terminal 1000 includes the image sensor 100 of the above aspect. Specifically, the terminal 1000 may include a mobile phone.

在一些實施例中,如第7圖所示,終端1000還包括與圖像感測器100連接之中央處理器200及顯示裝置300,中央處理器200用於控制顯示裝置300顯示圖像感測器100輸出之高動態範圍圖像。這樣,終端1000拍攝之圖像可以顯示於顯示裝置300以供使用者查看。顯示裝置300包括LED顯示器等。In some embodiments, as shown in FIG. 7, the terminal 1000 further includes a central processing unit 200 and a display device 300 connected to the image sensor 100, and the central processing unit 200 is configured to control the display device 300 to display image sensing. The high dynamic range image output by the device 100. Thus, the image captured by the terminal 1000 can be displayed on the display device 300 for viewing by the user. The display device 300 includes an LED display or the like.

在一些實施例中,如第8圖所示,終端1000包括與圖像感測器100連接之中央處理器200及外部記憶體400,中央處理器200用於控制外部記憶體400儲存圖像感測器100輸出之高動態範圍圖像。In some embodiments, as shown in FIG. 8, the terminal 1000 includes a central processing unit 200 and an external memory 400 connected to the image sensor 100. The central processing unit 200 is configured to control the external memory 400 to store an image sense. The high dynamic range image output by the detector 100.

這樣,生成之圖像可以被儲存,方便以後查看、使用或轉移。外部記憶體400包括SM(Smart Media)卡及CF(Compact Flash)卡等。In this way, the generated image can be stored for later viewing, use or transfer. The external memory 400 includes an SM (Smart Media) card, a CF (Compact Flash) card, and the like.

該終端1000,藉由採用該之圖像感測器100,基於圖像感測器100之硬體結構可以實現HDR功能,提升HDR圖像效果。The terminal 1000 can realize the HDR function based on the hardware structure of the image sensor 100 by using the image sensor 100, thereby improving the HDR image effect.

基於上述方面實施例之圖像感測器,下面參照附圖描述根據本發明實施例提出之成像方法,其中,同一顏色之濾光單元所對應的複數畫素單元構成合併畫素。Based on the image sensor of the embodiment of the above aspect, an imaging method according to an embodiment of the present invention is described below with reference to the accompanying drawings, wherein the plurality of pixel units corresponding to the filter unit of the same color constitute a merged pixel.

第9圖係根據本發明實施例之成像方法之流程圖,如第9圖所示,該成像方法包括以下步驟:Figure 9 is a flow chart of an imaging method according to an embodiment of the present invention. As shown in Figure 9, the imaging method includes the following steps:

S1,讀取畫素單元陣列之輸出。S1, reading the output of the pixel unit array.

S2,將同一合併畫素之畫素單元之輸出相加以得到合併畫素之畫素值從而生成合併圖像。S2, adding the output of the pixel elements of the same merged pixel to obtain the combined pixel values of the pixels to generate a merged image.

本發明實施方式之成像方法,假定原有每個畫素單元之輸出為S,雜訊為N,合併畫素包括M個畫素單元,則合併畫素之畫素值為n*m*S,而合併畫素之雜訊為,在n=2,m=2之情況下,合成畫素之雜訊即為n*m*N/2左右。因此合併圖像之亮度在低亮度環境下得到提升,而且性噪比提高。In the imaging method of the embodiment of the present invention, it is assumed that the output of each pixel unit is S, the noise is N, and the merged pixels include M pixel units, and the pixel value of the combined pixel is n*m*S. And the noise of the merged pixels is In the case of n=2 and m=2, the noise of the synthesized pixel is about n*m*N/2. Therefore, the brightness of the combined image is improved in a low-brightness environment, and the noise-to-noise ratio is improved.

請參閱第10圖,在某些實施方式中,圖像感測器之每個同一顏色之濾光單元對應2*2個畫素單元,圖像感測器包括暫存器,步驟S2進一步包括:Referring to FIG. 10, in some embodiments, each filter unit of the same color of the image sensor corresponds to 2*2 pixel units, the image sensor includes a register, and step S2 further includes :

S201,採集第k行及第k+1行之畫素單元之輸出並存入暫存器,其中k=2n-1,n為自然數,k+1小於等於畫素單元之總行數;S201, collecting the output of the pixel unit of the kth row and the k+1th row and storing the result in the register, wherein k=2n-1, n is a natural number, and k+1 is less than or equal to the total number of rows of the pixel unit;

S202,從暫存器中提取第k行及第k+1行之畫素單元之輸出,將同一合併畫素之畫素單元之輸出相加以得到合併畫素之畫素值。S202. Extract the output of the pixel unit of the kth row and the k+1th row from the scratchpad, and add the output of the pixel unit of the same merged pixel to obtain the pixel value of the combined pixel.

如此,可以充分利用暫存器來實現畫素單元之輸出讀出、快取及合併之過程。In this way, the register can be fully utilized to implement the process of reading, buffering, and merging the pixel units.

請參第11圖,在某些實施方式中,步驟S2進一步包括:Referring to FIG. 11, in some embodiments, step S2 further includes:

S301,將畫素單元產生之類比訊號輸出轉換為數位訊號輸出;及S301, converting the analog signal output generated by the pixel unit into a digital signal output; and

S302,將同一合併畫素之畫素單元之數位訊號輸出相加以得到合併畫素之畫素值。S302. The digital signal outputs of the pixel elements of the same merged pixel are added to obtain a pixel value of the combined pixel.

如此,一來,一般為數位訊號處理晶片之影像處理模組可以直接處理圖像感測器之輸出,二來,相對於某些藉由電路直接對圖像感測器之類比訊號格式之輸出進行處理之方案來說,較好地保留了圖像之資訊,例如,對於16M畫素之圖像感測器來說,本發明實施方式之成像方法既可以成生4M畫素(將2*2之畫素合併)之合併圖像,也可以生成16M畫素(即不合併)之原圖像。In this way, the image processing module of the digital signal processing chip can directly process the output of the image sensor, and the output of the analog signal format directly compared to the image sensor by the circuit. In the case of processing, the information of the image is better preserved. For example, for an image sensor of 16M pixels, the imaging method of the embodiment of the present invention can generate 4M pixels (2* will be generated). The merged image of 2 pixels combined can also generate the original image of 16M pixels (ie, not merged).

本發明再一方面實施例還提出一種行動終端,該行動終端包括殼體、處理器、記憶體、電路板和電源電路,其中,該電路板安置在該殼體圍成之空間內部,該處理器和該記憶體設置在該電路板上;該電源電路,用於為該行動終端之各個電路或裝置供電;該記憶體用於儲存可執行程式碼;該處理器藉由讀取該記憶體中儲存之可執行程式碼來運行與該可執行程式碼對應之程式,以用於執行上述方面之成像方法。A further embodiment of the present invention further provides a mobile terminal, the mobile terminal comprising a housing, a processor, a memory, a circuit board and a power supply circuit, wherein the circuit board is disposed inside the space enclosed by the housing, the processing And the memory is disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is used to store executable code; the processor reads the memory by reading The executable code stored therein runs a program corresponding to the executable code for performing the imaging method of the above aspect.

本發明實施例還提供了一種電腦可讀儲存媒體,具有儲存於其中之指令,當行動終端之處理器執行該指令時,該行動終端執行如參考第9圖所示之本發明實施例之成像方法。The embodiment of the present invention further provides a computer readable storage medium having instructions stored therein. When the processor of the mobile terminal executes the instruction, the mobile terminal performs imaging according to the embodiment of the present invention as shown in FIG. method.

需要說明的係,在本文中,諸如第一和第二等之類之關係術語僅僅用來將一實體或者操作與另一實體或操作區分開來,而不一定要求或者暗示這些實體或操作之間存在任何這種實際之關係或者順序。而且,術語“包括”、“包含”或者其任何其他變體意在涵蓋非排他性之包含,從而使得包括一系列要素之過程、方法、物品或者裝置不僅包括那些要素,而且還包括沒有明確列出之其他要素,或者係還包括為這種過程、方法、物品或者裝置所固有之要素。在沒有更多限制之情況下,由語句“包括一……”限定之要素,並不排除在包括該要素之過程、方法、物品或者裝置中還存在另外之相同要素。In this document, relational terms such as first and second are used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order. Furthermore, the term "comprises" or "comprises" or "comprising" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that includes a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a singular" is not to be construed as a limitation of the invention.

在流程圖中表示或在此以其他方式描述之邏輯和/或步驟,例如,可以被認為係用於實現邏輯功能之可執行指令之定序列表,可以具體實現在任何電腦可讀媒體中,以供指令執行系統、裝置或設備(如基於電腦之系統、包括處理器之系統或其他可以從指令執行系統、裝置或設備取指令並執行指令之系統)使用,或結合這些指令執行系統、裝置或設備而使用。就本說明書而言,"電腦可讀媒體"可以係任何可以包含、儲存、通信、傳播或傳輸程式以供指令執行系統、裝置或設備或結合這些指令執行系統、裝置或設備而使用之裝置。電腦可讀媒體之更具體之示例(非窮盡性列表)包括以下:具有一或複數佈線之電連接部(電子裝置),可擕式電腦碟盒(磁裝置),隨機存取記憶體(RAM),唯讀記憶體(ROM),可抹除可程式化唯讀記憶體(EPROM或閃速記憶體),光纖裝置,以及可擕式光碟唯讀記憶體(CDROM)。另外,電腦可讀媒體甚至可以係可在其上列印該程式之紙或其他合適之媒體,因為可以例如藉由對紙或其他媒體進行光學掃描,接著進行編輯、解譯或必要時以其他合適方式進行處理來以電子方式獲得該程式,然後將其儲存在電腦記憶體中。The logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, For use in an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device), or in conjunction with such instructions, execute systems, devices Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with such an instruction execution system, apparatus, or device. More specific examples of computer readable media (non-exhaustive list) include the following: electrical connections (electronic devices) with one or more wires, portable computer case (magnetic device), random access memory (RAM) ), read-only memory (ROM), which erases programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable CD-ROM (CDROM). In addition, the computer readable medium may even be a paper on which the program or other suitable medium may be printed, as it may be optically scanned, for example by paper or other media, followed by editing, interpretation or, if necessary, other The program is processed in an appropriate manner to obtain the program electronically and then stored in computer memory.

應當理解,本發明之各部分可以用硬體、軟體、韌體或它們之組合來實現。在上述實施方式中,複數步驟或方法可以用儲存在記憶體中且由合適之指令執行系統執行之軟體或韌體來實現。例如,如果用硬體來實現,和在另一實施方式中一樣,可用本領域公知之下列技術中之任一項或他們之組合來實現:具有用於對資料訊號實現邏輯功能之邏輯閘電路之離散邏輯電路,具有合適之組合邏輯閘電路之專用積體電路,可程式閘陣列(PGA),現場可程式閘陣列(FPGA)等。It should be understood that portions of the invention may be implemented in hardware, software, firmware, or combinations thereof. In the above embodiments, the plurality of steps or methods may be implemented with software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following techniques known in the art or a combination thereof: having a logic gate circuit for implementing logic functions on data signals Discrete logic circuit, dedicated integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA), etc.

需要說明的係,在本說明書之描述中,參考術語“一實施方式”、“一些實施方式”、“示例”、“具體示例”、或“一些示例”等之描述意指結合該實施方式或示例描述之具體特徵、結構、材料或者特點包含於本發明之至少一實施方式或示例中。在本說明書中,對上述術語之示意性表述不必須針對的係相同之實施方式或示例。而且,描述之具體特徵、結構、材料或者特點可以在任一或複數實施方式或示例中以合適之方式結合。此外,在不相互矛盾之情況下,本領域之技術人員可以將本說明書中描述之不同實施方式或示例以及不同實施方式或示例之特徵進行結合和組合。In the description of the present specification, the descriptions of the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" and the like are meant to be combined with the embodiments or The specific features, structures, materials, or characteristics described in the examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any or a plurality of embodiments or examples. In addition, various embodiments or examples described in the specification and features of the various embodiments or examples may be combined and combined.

在本說明書之描述中,參考術語“一實施方式”、“一些實施方式”、“示例”、“具體示例”、或“一些示例”等之描述意指結合該實施方式或示例描述之具體特徵、結構、材料或者特點包含於本發明之至少一實施方式或示例中。在本說明書中,對上述術語之示意性表述不必須針對的係相同之實施方式或示例。而且,描述之具體特徵、結構、材料或者特點可以在任一或複數實施方式或示例中以合適之方式結合。此外,在不相互矛盾之情況下,本領域之技術人員可以將本說明書中描述之不同實施方式或示例以及不同實施方式或示例之特徵進行結合和組合。In the description of the present specification, the descriptions of the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" and the like are intended to refer to the specific features described in connection with the embodiments or examples. The structure, material or features are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any or a plurality of embodiments or examples. In addition, various embodiments or examples described in the specification and features of the various embodiments or examples may be combined and combined.

儘管上面已經示出和描述了本發明之實施方式,可以理解的係,上述實施方式係示例性的,不能理解為對本發明之限制,本領域之普通技術人員在本發明之範圍內可以對上述實施方式進行變化、修改、替換和變型。Although the embodiments of the present invention have been shown and described, it is understood that the foregoing embodiments are illustrative, and are not to be construed as limiting the scope of the invention. The embodiments are subject to changes, modifications, substitutions and variations.

100‧‧‧圖像感測器
10‧‧‧畫素單元陣列
11‧‧‧感光單元
111‧‧‧感光部分
20‧‧‧增幅轉換單元元件
30‧‧‧濾光陣列
31‧‧‧濾光單元
32‧‧‧濾光結構
40‧‧‧模數轉換單元元件
41‧‧‧第一模數轉換單元
42‧‧‧第二模數轉換單元
50‧‧‧微鏡陣列
51‧‧‧微鏡
1000‧‧‧終端
200‧‧‧中央處理器
300‧‧‧顯示裝置
100‧‧‧Image sensor
10‧‧‧ pixel element array
11‧‧‧Photosensitive unit
111‧‧‧Photosensitive part
20‧‧‧Amplification conversion unit components
30‧‧‧Filter array
31‧‧‧ Filter unit
32‧‧‧ Filter structure
40‧‧•Analog-to-digital conversion unit components
41‧‧‧ first analog to digital conversion unit
42‧‧‧Second analog to digital conversion unit
50‧‧‧Micromirror array
51‧‧‧Micromirror
1000‧‧‧ Terminal
200‧‧‧ central processor
300‧‧‧ display device

本發明之上述和/或附加之方面和優點從結合下面附圖對實施方式之描述中將變得明顯和容易理解,其中: 第1圖係根據本發明之一實施例之圖像感測器之示意圖; 第2圖係根據本發明之另一實施例之圖像感測器之示意圖; 第3圖係根據本發明之一具體實施例之濾光陣列之分佈示意圖; 第4圖係根據本發明之一實施例之圖像感測器之電路圖; 第5圖係根據本發明之又一實施例之圖像感測器之結構示意圖; 第6圖係根據本發明之一實施例之終端之功能模組圖; 第7圖係根據本發明之另一實施例之終端之功能模組圖; 第8圖係根據本發明之再一實施例之終端之功能模組圖; 第9圖係根據本發明實施例之成像方法之流程圖, 第10圖係根據本發明一實施例之成像方法之流程圖;以及 第11圖係根據本發明之另一實施例之成像方法之流程圖。The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the embodiments in which 2 is a schematic diagram of an image sensor according to another embodiment of the present invention; FIG. 3 is a schematic diagram showing a distribution of a filter array according to an embodiment of the present invention; BRIEF DESCRIPTION OF THE DRAWINGS FIG. 5 is a block diagram of an image sensor according to still another embodiment of the present invention; FIG. 6 is a diagram of a terminal according to an embodiment of the present invention; FIG. 7 is a functional module diagram of a terminal according to another embodiment of the present invention; FIG. 8 is a functional module diagram of a terminal according to still another embodiment of the present invention; A flowchart of an imaging method according to an embodiment of the present invention, FIG. 10 is a flowchart of an imaging method according to an embodiment of the present invention; and FIG. 11 is a flowchart of an imaging method according to another embodiment of the present invention.

100‧‧‧圖像感測器 100‧‧‧Image sensor

10‧‧‧畫素單元陣列 10‧‧‧ pixel element array

11‧‧‧感光單元 11‧‧‧Photosensitive unit

20‧‧‧增幅轉換單元元件 20‧‧‧Amplification conversion unit components

30‧‧‧濾光陣列 30‧‧‧Filter array

31‧‧‧濾光單元 31‧‧‧ Filter unit

Claims (18)

一種圖像感測器,其特徵在於,包括: —畫素單元陣列,包括複數畫素單元; —包括複數增幅轉換單元之增幅轉換單元元件,每增幅轉換單元用於將畫素單元產生之光生電荷轉換為類比訊號;及 設置於該畫素單元陣列上之一濾光陣列,該濾光陣列包括複數濾光單元,同一顏色之該濾光單元對應於複數畫素單元; 其中,該同一顏色之濾光單元所對應的複數畫素單元中一部分之畫素單元產生之光生電荷累加後共用一增幅轉換單元輸出第一類比訊號,該同一顏色之濾光單元所對應之複數畫素單元中剩餘部分之畫素單元產生之光生電荷累加後共用一增幅轉換單元輸出第二類比訊號,該第一類比訊號和該第二類比訊號不相同。An image sensor, comprising: - an array of pixel units, comprising a plurality of pixel units; - an amplification conversion unit element comprising a complex amplification unit, each of the amplification units for generating light from the pixel unit The charge is converted into an analog signal; and a filter array disposed on the pixel unit array, the filter array includes a plurality of filter units, the filter unit of the same color corresponding to the plurality of pixel units; wherein the same color The photo-generated charge generated by a part of the pixel units in the plurality of pixel units corresponding to the filter unit is shared by an amplification conversion unit to output a first analog signal, and the remaining pixel units corresponding to the filter unit of the same color remain The photo-generated charge generated by the part of the pixel unit is shared by an amplification conversion unit to output a second analog signal, and the first analog signal and the second analog signal are different. 如申請專利範圍第1項所述之圖像感測器,其中,該圖像感測器包括一CMOS圖像感測器。The image sensor of claim 1, wherein the image sensor comprises a CMOS image sensor. 如申請專利範圍第1項所述之圖像感測器,其中,該濾光陣列包括一拜耳陣列。The image sensor of claim 1, wherein the filter array comprises a Bayer array. 如申請專利範圍第1項所述之圖像感測器,其中,還包括: —包括複數模數轉化單元之模數轉換單元元件,該模數轉換單元元件用於將該第一類比訊號和該第二類比訊號分別轉換為第一數位訊號和第二數位訊號。The image sensor of claim 1, further comprising: - an analog to digital conversion unit component comprising a complex analog to digital conversion unit, the analog to digital conversion unit component for using the first analog signal and The second analog signal is converted into a first digital signal and a second digital signal, respectively. 如申請專利範圍第1項至第4項任一項所述之圖像感測器,其中,該同一顏色之濾光單元所對應的複數畫素單元位於畫素單元陣列之不同行。The image sensor according to any one of claims 1 to 4, wherein the plurality of pixel units corresponding to the filter unit of the same color are located in different rows of the pixel unit array. 如申請專利範圍第1項至第4項任一項所述之圖像感測器,其中,該同一顏色之濾光單元對應2行2列共計4畫素單元,位於第一行中之二畫素單元產生之光生電荷和位於第二行之一畫素單元產生之光生電荷累加後經過增幅轉換單元轉換為該第一類比訊號,位於第二行中之另一畫素單元產生之光生電荷經過增幅轉換單元轉換為該第二類比訊號,該第一類比訊號藉由一模數轉換單元轉換為該第一數位訊號,該第二類比訊號藉由另一模數轉換單元轉換為該第二數位訊號。The image sensor according to any one of claims 1 to 4, wherein the filter unit of the same color corresponds to 2 rows and 2 columns totaling 4 pixel units, and is located in the first row. The photogenerated charge generated by the pixel unit and the photogenerated charge generated by the pixel unit in the second row are converted into the first analog signal by the amplification conversion unit, and the photogenerated charge generated by the other pixel unit in the second row Converted to the second analog signal by the amplification conversion unit, the first analog signal is converted into the first digital signal by an analog to digital conversion unit, and the second analog signal is converted into the second by another analog to digital conversion unit Digital signal. 如申請專利範圍第1項至第4項任一項所述之圖像感測器,其中,還包括: 設置在該濾光陣列上之一微鏡陣列,該微鏡陣列中之每微鏡與一該畫素單元對應。The image sensor according to any one of claims 1 to 4, further comprising: a micromirror array disposed on the filter array, each micromirror in the micromirror array Corresponding to a pixel unit. 如申請專利範圍第4項所述之圖像感測器,其中,還包括: —控制模組和一影像處理模組,該控制模組用於控制該同一顏色之濾光單元所對應的複數畫素單元按照行同時曝光,該影像處理模組對該模數轉換單元之輸出進行合成以獲得一高動態範圍圖像。The image sensor of claim 4, further comprising: a control module and an image processing module, wherein the control module is configured to control a plurality of filter elements corresponding to the filter unit of the same color The pixel unit is simultaneously exposed in a row, and the image processing module synthesizes the output of the analog to digital conversion unit to obtain a high dynamic range image. 一種終端,其特徵在於,包括如申請專利範圍第1項至第8項任一項所述之圖像感測器。A terminal characterized by comprising the image sensor according to any one of claims 1 to 8. 如申請專利範圍第9項所述之終端,其中,該終端包括一手機。The terminal of claim 9, wherein the terminal comprises a mobile phone. 如申請專利範圍第9項或第10項所述之終端,其中,該終端還包括與該圖像感測器連接之一中央處理器及一顯示裝置,該中央處理器用於控制該顯示裝置顯示該圖像感測器輸出之一高動態範圍圖像。The terminal according to claim 9 or 10, wherein the terminal further comprises a central processing unit and a display device connected to the image sensor, wherein the central processor is configured to control the display of the display device The image sensor outputs one of the high dynamic range images. 如申請專利範圍第9項或第10項所述之終端,其中,該終端包括與該圖像感測器連接之一中央處理器及外部記憶體,該中央處理器用於控制該外部記憶體儲存該圖像感測器輸出之一高動態範圍圖像。The terminal of claim 9 or 10, wherein the terminal comprises a central processing unit and an external memory connected to the image sensor, wherein the central processing unit is configured to control the external memory storage. The image sensor outputs one of the high dynamic range images. 一種基於如申請專利範圍第1項所述之圖像感測器之成像方法,其特徵在於,該同一顏色之濾光單元所對應的複數畫素單元構成一合併畫素,該影像處理方法包括: 讀取該畫素單元陣列之輸出;以及 將同一該合併畫素之該畫素單元之輸出相加以得到該合併畫素之畫素值從而生成一合併圖像。An imaging method for an image sensor according to claim 1, wherein the plurality of pixel units corresponding to the filter unit of the same color constitute a merged pixel, and the image processing method comprises : reading an output of the pixel unit array; and adding the output of the pixel unit of the same merged pixel to obtain a pixel value of the combined pixel to generate a merged image. 如申請專利範圍第13項所述之成像方法,其中,每該同一顏色之濾光單元對應2*2個該畫素單元。The imaging method of claim 13, wherein each of the filter units of the same color corresponds to 2*2 of the pixel units. 如申請專利範圍第13項或第14項所述之成像方法,其中,該圖像感測器包括一暫存器,該讀出步驟進一步包括: 採集第k行及第k+1行之該畫素單元之輸出並存入該暫存器,其中k=2n-1,n為自然數,k+1小於等於該畫素單元之總行數;及 從該暫存器中提取該第k行及第k+1行之該畫素單元之輸出,將同一該合併畫素之該畫素單元之輸出相加以得到該合併畫素之畫素值。The imaging method of claim 13 or claim 14, wherein the image sensor comprises a register, the reading step further comprising: collecting the kth row and the k+1th row The output of the pixel unit is stored in the register, where k=2n-1, n is a natural number, k+1 is less than or equal to the total number of rows of the pixel unit; and the kth line is extracted from the register And the output of the pixel unit of the k+1th row, the output of the pixel unit of the same merged pixel is added to obtain the pixel value of the combined pixel. 如申請專利範圍第13項所述之成像方法,其中,該讀出步驟進一步包括: 將該畫素單元產生之類比訊號輸出轉換為數位訊號輸出。The imaging method of claim 13, wherein the reading step further comprises: converting the analog signal output generated by the pixel unit into a digital signal output. 一種行動終端,包括一殼體、一處理器、一記憶體、一電路板和一電源電路,其中,該電路板安置在該殼體圍成之空間內部,該處理器和該記憶體設置在該電路板上;該電源電路,用於為該行動終端之各電路或裝置供電;該記憶體用於儲存可執行程式碼;該處理器藉由讀取該記憶體中儲存之可執行程式碼來運行與該可執行程式碼對應的程式,以用於執行如申請專利範圍第13項至第16項任一項所述之成像方法。A mobile terminal includes a casing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the casing, and the processor and the memory are disposed at The power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory is configured to store executable code; and the processor reads the executable code stored in the memory A program corresponding to the executable code is executed for performing the imaging method according to any one of claims 13 to 16. 一種電腦可讀儲存媒體,具有儲存於其中之指令,當行動終端之處理器執行該指令時,該行動終端執行如申請專利範圍第13項至第16項任一項所述之成像方法。A computer readable storage medium having instructions stored therein, wherein when the processor of the mobile terminal executes the instruction, the mobile terminal performs the imaging method according to any one of claims 13 to 16.
TW105141889A 2015-12-18 2016-12-16 Image sensor, imaging terminal having same and imaging method using same TWI615028B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
??201510960708.6 2015-12-18
CN201510960708.6A CN105611198B (en) 2015-12-18 2015-12-18 Imageing sensor and the terminal with it

Publications (2)

Publication Number Publication Date
TW201724843A true TW201724843A (en) 2017-07-01
TWI615028B TWI615028B (en) 2018-02-11

Family

ID=55990707

Family Applications (1)

Application Number Title Priority Date Filing Date
TW105141889A TWI615028B (en) 2015-12-18 2016-12-16 Image sensor, imaging terminal having same and imaging method using same

Country Status (3)

Country Link
CN (1) CN105611198B (en)
TW (1) TWI615028B (en)
WO (1) WO2017101560A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105611198B (en) * 2015-12-18 2017-06-27 广东欧珀移动通信有限公司 Imageing sensor and the terminal with it
CN105516695B (en) * 2015-12-18 2018-06-15 广东欧珀移动通信有限公司 Imaging sensor and with its terminal
WO2017101864A1 (en) * 2015-12-18 2017-06-22 广东欧珀移动通信有限公司 Image sensor, control method, and electronic device
CN107734231B (en) * 2017-11-07 2019-12-27 西北核技术研究所 Optical filtering-based imaging system dynamic range expansion method
CN107786818B (en) * 2017-11-07 2020-06-26 西北核技术研究所 Transient imaging dynamic range extension method based on multicolor filtering
CN116261052A (en) * 2019-12-30 2023-06-13 Oppo广东移动通信有限公司 Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method
CN114143514A (en) * 2021-11-30 2022-03-04 维沃移动通信有限公司 Image sensor, camera module and electronic equipment

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11298800A (en) * 1998-04-10 1999-10-29 Nikon Corp Image-pickup element and image-pickup device using the same
JP4689620B2 (en) * 2004-11-02 2011-05-25 パナソニック株式会社 Image sensor
JP2012105225A (en) * 2010-11-12 2012-05-31 Sony Corp Image processing system, imaging apparatus, image processing method and program
JP2013021660A (en) * 2011-07-14 2013-01-31 Sony Corp Image processing apparatus, image pickup apparatus, image processing method, and program
JP2013066140A (en) * 2011-08-31 2013-04-11 Sony Corp Imaging device, signal processing method, and program
TWI504251B (en) * 2012-07-04 2015-10-11 Vivotek Inc An audio hint method of the focusing
WO2014144391A1 (en) * 2013-03-15 2014-09-18 Rambus Inc. Threshold-monitoring, conditional-reset image sensor
CN103531603B (en) * 2013-10-30 2018-10-16 上海集成电路研发中心有限公司 A kind of cmos image sensor
CN103686007B (en) * 2013-12-31 2018-11-09 上海集成电路研发中心有限公司 Single shot generates the imaging sensor of high dynamic range images
US9571763B2 (en) * 2014-01-10 2017-02-14 Omnivision Technologies, Inc. Split pixel high dynamic range sensor
CN103780850B (en) * 2014-01-30 2017-12-15 上海集成电路研发中心有限公司 Pixel divides with merging imaging sensor and its method for transmitting signals
CN105611198B (en) * 2015-12-18 2017-06-27 广东欧珀移动通信有限公司 Imageing sensor and the terminal with it

Also Published As

Publication number Publication date
WO2017101560A1 (en) 2017-06-22
CN105611198B (en) 2017-06-27
CN105611198A (en) 2016-05-25
TWI615028B (en) 2018-02-11

Similar Documents

Publication Publication Date Title
TWI615029B (en) Image sensor, terminal having same and imaging method using same
TW201724843A (en) Image sensor, terminal having same and imaging method using same
JP6676704B2 (en) Imaging method of image sensor, imaging device, and electronic device
TWI617196B (en) Image sensor, imaging device, mobile terminal and imaging method
TW201724015A (en) Imaging method, imaging device, and electronic device
TWI615027B (en) High dynamic range image generation method, imaging device, terminal device and imaging method
TWI615034B (en) Image sensor, imaging terminal having same and imaging method using same
CN105592303B (en) imaging method, imaging device and electronic device
WO2017101864A1 (en) Image sensor, control method, and electronic device
WO2018098983A1 (en) Image processing method and device, control method and device, imaging device and electronic device
TWI615030B (en) Image sensor, terminal device having same sensor, imaging method using same, mobile terminal device and computer readable storage media
JP2017103752A (en) Image sensor and imaging apparatus
TWI766411B (en) Imaging sensor and electronic device