CN105578079B - Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal - Google Patents

Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal Download PDF

Info

Publication number
CN105578079B
CN105578079B CN201510964249.9A CN201510964249A CN105578079B CN 105578079 B CN105578079 B CN 105578079B CN 201510964249 A CN201510964249 A CN 201510964249A CN 105578079 B CN105578079 B CN 105578079B
Authority
CN
China
Prior art keywords
optical filtering
filter unit
predetermined threshold
threshold value
filtering subelement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510964249.9A
Other languages
Chinese (zh)
Other versions
CN105578079A (en
Inventor
康健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201510964249.9A priority Critical patent/CN105578079B/en
Publication of CN105578079A publication Critical patent/CN105578079A/en
Application granted granted Critical
Publication of CN105578079B publication Critical patent/CN105578079B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Blocking Light For Cameras (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

The invention discloses a kind of imaging sensor, including:Photosensitive pixel array with multiple sensitive pixel elements, each sensitive pixel elements include M photosensitive pixel;Optical filter, optical filter include the filter unit array with multiple filtration modules, and each filtration module includes being covered each by N number of filter unit of N number of sensitive pixel elements, and each filter unit includes the subelement that filters corresponding with M photosensitive pixel;Obtain the brightness detection module of ambient brightness parameter;Control module, for judging whether ambient brightness parameter is less than the first predetermined threshold value, and when judging to be less than the first predetermined threshold value, to be switched optical filtering subelement is determined according to ambient brightness parameter, and to be switched optical filtering subelement is switched into white.Thus, high signal to noise ratio, definition height, less image of making an uproar are obtained under low-light level, and reduces image color loss as far as possible.The invention also discloses adjusting method, imaging device, imaging method and the mobile terminal of a kind of imaging sensor imaging image quality.

Description

Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal
Technical field
The present invention relates to imaging technique, more particularly to a kind of imaging sensor, a kind of tune of imaging sensor imaging image quality Section method, a kind of imaging device, a kind of imaging method of imaging sensor and a kind of mobile terminal.
Background technology
The image that the imaging sensor of dependent imaging device generates under low-light level environment there may be that noise is big, definition The problem of poor.
The content of the invention
It is contemplated that at least solves one of technical problem in correlation technique to a certain extent.Therefore, the present invention One purpose is to propose a kind of imaging sensor for the problem of can solve the problem that big noise under low-light level environment, poor definition.
It is another object of the present invention to propose a kind of adjusting method of imaging sensor imaging image quality.The present invention is again One purpose is to propose a kind of imaging device.Another object of the present invention is to propose a kind of imaging method.The present invention's Further object is to propose a kind of mobile terminal.
To reach above-mentioned purpose, one aspect of the present invention embodiment proposes a kind of imaging sensor, including:Light-sensitive image primitive matrix Row, the photosensitive pixel array have multiple sensitive pixel elements, and each sensitive pixel elements include M photosensitive pixel; The optical filter being arranged on the photosensitive pixel array, the optical filter include the filter unit battle array with multiple filtration modules Row, each filtration module include being covered each by N number of filter unit of N number of sensitive pixel elements, each optical filtering Unit includes the subelement that filters corresponding with the M photosensitive pixel, wherein, M and N are positive integer:Brightness detection module, it is described Brightness detection module is used to obtain ambient brightness parameter;Control module, the control module are used to judge the ambient brightness ginseng Whether number is less than the first predetermined threshold value, and when judging that the ambient brightness parameter is less than first predetermined threshold value, according to institute State ambient brightness parameter and determine to be switched optical filtering subelement in N number of filter unit, and the to be switched son that filters is single Member switches to white.
The imaging sensor proposed according to embodiments of the present invention, control module can determine N number of filter according to ambient brightness parameter To be switched optical filtering subelement in light unit, and to be switched optical filtering subelement is switched into white.Thus, pass through under low-light level Switch out white optical filtering subelement, it is possible to increase light-inletting quantity, and then obtain under low-light level higher signal to noise ratio, brightness and clear Degree, the less image of generation noise, also, according to the quantity of the white optical filtering subelement of ambient brightness adjustment, so as to be made an uproar in generation In the case of the less image of point, image color loss is reduced as far as possible.
According to some embodiments of the present invention, the filter unit array is arranged with Bayer array, each optical filtering mould Block includes the first green filter unit, the second green filter unit, red filter unit and blue filter unit.
According to some embodiments of the present invention, the control module is further used for, and judges that the ambient brightness parameter is It is no to be more than the second predetermined threshold value, and when the ambient brightness parameter is more than second predetermined threshold value, by the described first green An optical filtering subelement in filter unit and the second green filter unit as the to be switched optical filtering subelement, wherein, institute State the second predetermined threshold value and be less than first predetermined threshold value.
According to some embodiments of the present invention, the control module is further used for, and judges that the ambient brightness parameter is It is no to be more than the 3rd predetermined threshold value, and when the ambient brightness parameter is more than three predetermined threshold value, by the described first green M1 optical filtering subelement in filter unit and the second green filter unit as the to be switched optical filtering subelement, wherein, institute State the 3rd predetermined threshold value and be less than second predetermined threshold value, M1 is the positive integer more than 1 and less than M.
According to some embodiments of the present invention, the control module is further used for, and judges that the ambient brightness parameter is It is no to be more than the 4th predetermined threshold value, and when the ambient brightness parameter is more than four predetermined threshold value, by the described first green M optical filtering subelement in filter unit and the second green filter unit is used as the to be switched optical filtering subelement, Yi Ji When the ambient brightness parameter is less than or equal to four predetermined threshold value, by the first green filter unit, described second M2 optical filtering subelement in green filter unit, the red filter unit and the blue filter unit is as described to be cut Optical filtering subelement is changed, wherein, the 4th predetermined threshold value is less than the 3rd predetermined threshold value, and M2 is more than 1 and just whole less than M Number.
According to some embodiments of the present invention, described image sensor also includes:The institute of each filter unit covering State M photosensitive pixel and form a merging pixel.
According to some embodiments of the present invention, the optical filter is made up of electrochromic material, wherein, the control module It is further used for, the to be switched optical filtering subelement into N number of filter unit is passed through the first electric current with by the to be switched filter Photon unit switches to white.
To reach above-mentioned purpose, another aspect of the present invention embodiment proposes a kind of regulation of imaging sensor imaging image quality Method, described image sensor include the photosensitive pixel array with multiple sensitive pixel elements and are arranged at the light-sensitive image Optical filter in pixel array, the optical filter include the filter unit array with multiple filtration modules, each optical filtering mould Block includes the N number of filter unit for being covered each by N number of sensitive pixel elements, and each sensitive pixel elements include M sense Light pixel, each filter unit include the subelement that filters corresponding with the M photosensitive pixel, wherein, M and N are just whole Number, the described method comprises the following steps:Ambient brightness parameter is detected, and it is pre- to judge whether the ambient brightness parameter is less than first If threshold value;When judging that the ambient brightness parameter is less than first predetermined threshold value, determined according to the ambient brightness parameter To be switched optical filtering subelement in N number of filter unit, and the to be switched optical filtering subelement is switched into white.
The adjusting method of the imaging sensor imaging image quality proposed according to embodiments of the present invention, can be according to ambient brightness parameter The to be switched optical filtering subelement in N number of filter unit is determined, and to be switched optical filtering subelement is switched into white.Thus, low By switching out white optical filtering subelement under brightness, it is possible to increase light-inletting quantity, and then obtain under low-light level higher signal to noise ratio, bright Degree and definition, the less image of generation noise, also, according to the quantity of the white optical filtering subelement of ambient brightness adjustment, so that In the case of the less image of generation noise, image color loss is reduced as far as possible.
According to some embodiments of the present invention, wherein, the filter unit array is arranged with Bayer array, each filter Optical module includes the first green filter unit, the second green filter unit, red filter unit and blue filter unit.
It is described to be determined according to the ambient brightness parameter in N number of filter unit according to some embodiments of the present invention To be switched optical filtering subelement include:Judge whether the ambient brightness parameter is more than the second predetermined threshold value, wherein, described second Predetermined threshold value is less than first predetermined threshold value;If the ambient brightness parameter is more than second predetermined threshold value, by institute The optical filtering subelement stated in the first green filter unit and the second green filter unit is single as the to be switched son that filters Member.
It is described to be determined according to the ambient brightness parameter in N number of filter unit according to some embodiments of the present invention To be switched optical filtering subelement also include:Judge whether the ambient brightness parameter is more than the 3rd predetermined threshold value, wherein, described Three predetermined threshold values are less than second predetermined threshold value;, will if the ambient brightness parameter is more than the 3rd predetermined threshold value M1 optical filtering subelement in the first green filter unit and the second green filter unit is as the to be switched son that filters Unit, M1 are the positive integer more than 1 and less than M.
It is described to be determined according to the ambient brightness parameter in N number of filter unit according to some embodiments of the present invention To be switched optical filtering subelement also include:Judge whether the ambient brightness parameter is more than the 4th predetermined threshold value, wherein, described Four predetermined threshold values are less than the 3rd predetermined threshold value;, will if the ambient brightness parameter is more than the 4th predetermined threshold value M optical filtering subelement in the first green filter unit and the second green filter unit is as the to be switched son that filters Unit;If the ambient brightness parameter is less than or equal to the 4th predetermined threshold value, by the first green filter unit, M2 optical filtering subelement conduct in the second green filter unit, the red filter unit and the blue filter unit The to be switched optical filtering subelement, M2 are the positive integer more than 1 and less than M.
According to some embodiments of the present invention, the M photosensitive pixel of each filter unit covering forms one Merge pixel,
According to some embodiments of the present invention, the optical filter is made up of electrochromic material, wherein, it is described to be treated described Switching optical filtering subelement switches to white to further comprise:To be switched optical filtering subelement into N number of filter unit is passed through First electric current by the to be switched optical filtering subelement to switch to white.
Another aspect of the invention embodiment proposes a kind of imaging device, including:Described imaging sensor;With the figure As the image processing module that sensor connects, described image processing module is used to read and handle described in described image sensor The output of photosensitive pixel array is to obtain the pixel value of the sensitive pixel elements so as to form merging image.
The imaging device proposed according to embodiments of the present invention, by reading and handling the output of above-mentioned imaging sensor, By switching out white optical filtering subelement under low-light level, it is possible to increase light-inletting quantity, and then obtain under low-light level higher signal to noise ratio, Brightness and definition, the less image of noise is generated, also, the quantity of white optical filtering subelement is adjusted according to ambient brightness, from And in the case of the less image of generation noise, image color loss is reduced as far as possible.
Further aspect of the present invention embodiment proposes a kind of imaging method, comprises the following steps:Read described image sensing The output of photosensitive pixel array in device;The output of M photosensitive pixel calculates the sense according to the sensitive pixel elements The pixel value of light pixel unit is to generate merging image.
The imaging method proposed according to embodiments of the present invention, by reading and handling the output of above-mentioned imaging sensor, by This, by switching out white optical filtering subelement under low-light level, it is possible to increase light-inletting quantity, and then higher letter is obtained under low-light level Make an uproar ratio, brightness and definition, the less image of generation noise, also, adjust according to ambient brightness the number of white optical filtering subelement Amount, so as in the case of the less image of generation noise, reduce image color loss as far as possible.
Further aspect of the present invention embodiment proposes a kind of mobile terminal, including described imaging device.
The mobile terminal proposed according to embodiments of the present invention, by above-mentioned imaging device, it can be obtained under low-light level higher Signal to noise ratio, brightness and definition, the less image of generation noise, and to the greatest extent may be used in the case of the less image of generation noise Image color loss can be reduced.
According to some embodiments of the present invention, the mobile terminal is mobile phone.
According to some embodiments of the present invention, the imaging device is the Front camera of the mobile phone.
According to some embodiments of the present invention, described mobile terminal also includes:The center being connected with the imaging device Processor and external memory, the central processing unit are used to control the external memory to store the merging image.
According to some embodiments of the present invention, described mobile terminal also includes:The center being connected with the imaging device Processor and display device, the central processing unit are used to control the display device to show the merging image.
Brief description of the drawings
Fig. 1 is the schematic side view of imaging sensor according to embodiments of the present invention;
Fig. 2 is the dimensional structure diagram of imaging sensor according to an embodiment of the invention;
Fig. 3 is the schematic diagram of the part filter unit array of imaging sensor according to an embodiment of the invention;
Fig. 4 is the filter unit array schematic diagram of Bayer structure;
Fig. 5 is the schematic diagram that optical filtering subelement according to an embodiment of the invention switches to white;
Fig. 6 is the schematic diagram that optical filtering subelement in accordance with another embodiment of the present invention switches to white;
Fig. 7 is the schematic diagram that white is switched to according to the optical filtering subelement of another embodiment of the invention;
Fig. 8 is the schematic diagram that white is switched to according to the optical filtering subelement of further embodiment of the present invention;
Fig. 9 is the block diagram of imaging sensor according to an embodiment of the invention;
Figure 10 is the electrical block diagram of the photosensitive pixel of imaging sensor according to an embodiment of the invention;
Figure 11 is the block diagram of imaging sensor according to an embodiment of the invention, wherein, imaging sensor bag Include analog-digital converter;
Figure 12 is the dimensional structure diagram of imaging sensor according to an embodiment of the invention, wherein imaging sensor Including micro mirror array;
Figure 13 is the flow chart of the adjusting method of imaging sensor imaging image quality according to embodiments of the present invention;
Figure 14 is the determination method of to be switched optical filtering subelement in N number of filter unit according to an embodiment of the invention Flow chart;
Figure 15 is the determination method of to be switched optical filtering subelement in N number of filter unit in accordance with another embodiment of the present invention Flow chart;
Figure 16 is the determination method of to be switched optical filtering subelement in N number of filter unit according to another embodiment of the invention Flow chart;
Figure 17 is the block diagram of imaging device according to embodiments of the present invention;
Figure 18 is the flow chart of imaging method according to embodiments of the present invention;
Figure 19 is the block diagram of mobile terminal according to an embodiment of the invention;And
Figure 20 is the block diagram of mobile terminal in accordance with another embodiment of the present invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings imaging sensor, the imaging sensor proposed to describe the embodiment of the present invention is imaged the tune of image quality Section method, imaging device, imaging method and mobile terminal.
According to Fig. 1-8 embodiment, the imaging sensor 10 of the embodiment of the present invention includes:Photosensitive pixel array 11, filter Piece 12, brightness detection module 13 and control module 14.
Wherein, as shown in Figure 1-2, photosensitive pixel array 11 has multiple sensitive pixel elements 111, each photosensitive pixel list Member 111 includes M photosensitive pixel 1111;Optical filter 12 is arranged on photosensitive pixel array 11, and optical filter 12 is included with multiple The filter unit array 121 of filtration module 123, each filtration module 123 include being covered each by the N of N number of sensitive pixel elements 111 Individual filter unit 122, each filter unit 122 include optical filtering subelement 1211 corresponding with M photosensitive pixel 1111, wherein, M It is positive integer with N.Felt with producing electric signal the photosensitive part that extraneous light is irradiated to photosensitive pixel 1111 by optical filter 12 The output of light pixel 1111.
Brightness detection module 13 is used to obtain ambient brightness parameter;Control module 14 is used for whether judging ambient brightness parameter Less than the first predetermined threshold value, and when judging that ambient brightness parameter is in low-light level environment less than the first predetermined threshold value, according to Ambient brightness parameter determines to be switched in the i.e. each filtration module 123 of to be switched optical filtering subelement in N number of filter unit 122 Optical filtering subelement, and to be switched optical filtering subelement is switched into white W.
Wherein, the non-to be switched optical filtering subelement in N number of filter unit 122 then keeps correspondingly colored for example red, green Color or blueness, the optical filtering subelement in N number of filter unit 122 outside to be switched optical filtering subelement are that the non-to be switched son that filters is single Member.
It should be noted that the optical filtering subelement for remaining colour is used for the color information for obtaining sensitive pixel elements.Cut The optical filtering subelement for being changed to white is used for the information for obtaining whole " white light ", that is, says, because white optical filtering subelement has preferably The translucent effect and then brightness value of photosensitive pixel output corresponding to making is higher, therefore, white optical filtering subelement is used in low-light level In the case of obtain the monochrome informations of sensitive pixel elements, and the noise of the monochrome information is less.
It should be noted that ambient brightness can be divided into multiple brightness degrees, different brightness degrees correspond to different to be cut Change optical filtering subelement.So control module 14 judges bright belonging to ambient brightness parameter after ambient brightness parameter is got Grade is spent, and obtains to be switched optical filtering subelement corresponding to the brightness degree, so can determine that in N number of filter unit 122 To be switched optical filtering subelement.
The imaging sensor of the embodiment of the present invention, control module can determine in N number of filter unit according to ambient brightness parameter To be switched optical filtering subelement, and to be switched optical filtering subelement is switched into white, it is thus, white by switching out under low-light level Color optical filtering subelement, so that light-inletting quantity can be increased under low-light level, the image that is generated with this have higher signal to noise ratio, brightness and Definition is preferable and noise is few.Also, the quantity of white optical filtering subelement is adjusted according to ambient brightness, so as to be made an uproar in generation In the case of the less image of point, image color loss is reduced as far as possible.
In addition, according to some embodiments of the present invention, control module 14 is judging that ambient brightness parameter is more than or equal to the When one predetermined threshold value is in high-brightness environment, optical filtering subelement 1211 remains correspondingly colour, without switching to white, from And avoid image color from losing, ensure that image color is complete.
According to some embodiments of the present invention, the filter unit array 121 of the embodiment of the present invention is substantially according to shown in Fig. 4 Bayer array (Bayer pattern) arranges, and Bayer array includes multiple filtration modules 123, and each filtration module 123 can wrap Include the individual filter units 122 of 2*2 (i.e. N=4), the respectively first green Gr filter units, the second green Gb filter units, red R Filter unit and blue B filter units.
Picture signal can be handled to the algorithm of Bayer structure using conventional needle using Bayer structure, without hardware Big adjustment is done in structure.
According to some embodiments of invention, ambient brightness can be divided into five grades, it is bright to be followed successively by first from high to low Grade, the second brightness degree, the 3rd brightness degree, the 4th brightness degree and the 5th brightness degree are spent, wherein, first brightness etc. The brightness of level is sufficient, and without filtering subunit is switched into white, and the luminance shortage of the second to the 5th brightness degree will be, it is necessary to will Filtering subunit switches to white.
Specifically, the first brightness degree is greater than or equal to the first predetermined threshold value, the second brightness degree may be greater than Two predetermined threshold values and it may be greater than the 3rd predetermined threshold value and pre- less than or equal to second less than the first predetermined threshold value, the 3rd brightness degree If threshold value, the 4th brightness degree may be greater than the 4th predetermined threshold value and can less than or equal to the 3rd predetermined threshold value, the 5th brightness degree For less than or equal to the 5th predetermined threshold value.Wherein, the first predetermined threshold value, the second predetermined threshold value, the 3rd predetermined threshold value, the 4th preset Threshold value is sequentially reduced, and according to the preferred exemplary of the present invention, the first predetermined threshold value can be preset for 200Lux (lux), second Threshold value can be that 100Lux, the 3rd predetermined threshold value can be 50Lux and the 4th predetermined threshold value can be 20Lux.
According to one embodiment of present invention, control module 14 is further used for, and judges whether ambient brightness parameter is more than Second predetermined threshold value such as 100Lux, and when ambient brightness parameter is more than the second predetermined threshold value, the first green Gr is filtered single An optical filtering subelement in member and the second green Gb filter units as to be switched optical filtering subelement, wherein, the second default threshold Value is less than the first predetermined threshold value.
Such as Fig. 5 example, filter unit 122 may include the individual optical filtering subelements 1211 of 2*2 (i.e. M=4), join in ambient brightness , can be using the optical filtering subelement in the upper right corner in the first green Gr filter units as to be switched optical filtering when number is more than the second predetermined threshold value Subelement, and white W is switched to by the first green Gr, and other optical filtering subelements remain as non-to be switched optical filtering subelement First green Gr;And using the optical filtering subelement in the upper right corner in the second green Gb filter units as to be switched optical filtering subelement simultaneously White W is switched to by the second green Gb, and other optical filtering subelements remain the second green as non-to be switched optical filtering subelement Gb。
Certainly, also can be single by optical filtering of other positions in the first green Gr filter units and the second green Gb filter units Member is used as to be switched optical filtering subelement, the upper right corner being not limited in Fig. 5.
It should be appreciated that when ambient brightness parameter is more than the second predetermined threshold value and is less than the first predetermined threshold value, explanation Ambient brightness parameter belongs to the second brightness degree, it is necessary to switch to white to reduce image noise simultaneously on to be switched optical filtering subelement Image definition is improved, but now ambient brightness is only second to the first brightness degree, ambient brightness is than relatively low, it is only necessary to will be less Optical filtering subelement switches to white, by one in the first green Gr filter units and the second green Gb filter units in the present embodiment Individual optical filtering subelement switches to white, so as to avoid image color loss excessive in the case where image noise is less.
According to one embodiment of present invention, control module 14 is further used for, and judges whether ambient brightness parameter is more than 3rd predetermined threshold value such as 50Lux, and when ambient brightness parameter is more than three predetermined threshold values, by the first green filter Gr units With M1 optical filtering subelement in the second green Gb filter units as to be switched optical filtering subelement, wherein, the 3rd predetermined threshold value Less than the second predetermined threshold value, M1 is the positive integer more than 1 and less than M.
Such as Fig. 6 example, filter unit 122 may include the individual optical filtering subelements 1211 of 2*2 (i.e. M=4), join in ambient brightness , can be using the optical filtering subelement of secondary series in the first green Gr filter units as to be switched optical filtering when number is more than three predetermined threshold values Subelement simultaneously switches to white W by the first green Gr, and other optical filtering subelements remain as non-to be switched optical filtering subelement First green Gr;And using the optical filtering subelement of secondary series in the second green Gb filter units as to be switched optical filtering subelement simultaneously White W is switched to by the second green Gb, and other optical filtering subelements remain the second green as non-to be switched optical filtering subelement Gb。
Certainly, also can be single by optical filtering of other positions in the first green Gr filter units and the second green Gb filter units Member is used as to be switched optical filtering subelement, the secondary series being not limited in Fig. 6.
It should be appreciated that when ambient brightness parameter is more than the 3rd predetermined threshold value and is less than or equal to the second predetermined threshold value, Illustrate that ambient brightness parameter belongs to the 3rd brightness degree, it is necessary to switch to white to be made an uproar to reduce image on to be switched optical filtering subelement Put and improve image definition, but now ambient brightness is low relative to the second brightness degree, need to be by more optical filtering subelement White is switched to, by optical filtering of secondary series in the first green Gr filter units and the second green Gb filter units in the present embodiment Unit switches to white, so as to avoid image color loss excessive in the case where image noise is less.
According to one embodiment of present invention, control module 14 is further used for, and judges whether ambient brightness parameter is more than 4th predetermined threshold value such as 20Lux, and when ambient brightness parameter is more than four predetermined threshold values, by the first green Gr filter units To be switched optical filtering subelement is used as with M optical filtering subelement 1211 in the second green Gb filter units.
Such as Fig. 7 example, filter unit 122 may include the individual optical filtering subelements 1211 of 2*2 (i.e. M=4), join in ambient brightness , can be using optical filtering subelement in the first green Gr filter units as to be switched optical filtering subelement when number is more than four predetermined threshold values And white W is switched to by the first green Gr;And using the optical filtering subelement in the second green Gb filter units as to be switched Optical filtering subelement simultaneously switches to white W by the second green Gb.
It should be appreciated that when ambient brightness parameter is more than the 4th predetermined threshold value and is less than or equal to three predetermined threshold values, Illustrate that ambient brightness parameter belongs to the 4th brightness degree, it is necessary to switch to white to be made an uproar to reduce image on to be switched optical filtering subelement Put and improve image definition, and now ambient brightness is very low, more optical filtering subelements need to be switched into white, this implementation The optical filtering subelement in the first green Gr filter units and the second green Gb filter units is switched into white in example, so that compared with Few image noise.
When ambient brightness parameter is less than or equal to four predetermined threshold values, by the first green Gr filter units, the second green M2 optical filtering subelement in Gb filter units, red R filter unit and blue B filter units is single as the to be switched son that filters Member, wherein, the 4th predetermined threshold value is less than the 3rd predetermined threshold value, and M2 is the positive integer more than 1 and less than M.
Such as Fig. 8 example, filter unit 122 may include the individual optical filtering subelements 1211 of 2*2 (i.e. M=4), join in ambient brightness , can be using the optical filtering subelement of secondary series in the first green Gr filter units as to be cut when number is less than or equal to four predetermined threshold values Change optical filtering subelement and white W is switched to by the first green Gr, and other optical filtering subelements are as non-to be switched optical filtering subelement Remain the first green Gr;Using the optical filtering subelement of secondary series in the second green Gb filter units as to be switched optical filtering subelement And white W is switched to by the second green Gb, and as non-to be switched optical filtering subelement to remain second green for other optical filtering subelements Color Gb;Switched to using the optical filtering subelement of secondary series in red R filter unit as to be switched optical filtering subelement and by red R white Color W, and other optical filtering subelements remain red R as non-to be switched optical filtering subelement;By secondary series in blue B filter units Optical filtering subelement as to be switched optical filtering subelement and white W is switched to by blue B, and other optical filtering subelements are treated as non- Switching optical filtering subelement remains blue B.
Certainly, also can be by the first green Gr filter units, the second green Gb filter units, red R filter unit and blue B The optical filtering subelement of other positions is as to be switched optical filtering subelement in filter unit, the secondary series being not limited in Fig. 8.
It should be appreciated that when ambient brightness parameter is less than or equal to four predetermined threshold values, illustrate ambient brightness parameter category In the 5th brightness degree, it is necessary to switch to white to reduce image noise and improve image clearly on to be switched optical filtering subelement Degree, and now ambient brightness is very low, and more optical filtering subelements need to switch to white and each filter unit have and treat Switch optical filtering subelement, the first green Gr filter units, the second green Gb filter units, red R filter in the present embodiment single The optical filtering subelement of secondary series switches to white in first and blue B filter units, so as to less image noise.
Further, according to one embodiment of present invention, optical filter 12 can be made up of electrochromic material, wherein, control The to be switched optical filtering subelement that molding block 14 is further used for into N number of filter unit 122 is passed through the first electric current with will to be switched Optical filtering subelement switches to white.
It should be noted that electrochromic material can be added in glass so that the optical filter of the embodiment of the present invention is made 12, the electrochromic material in optical filter 12 can be changed under electric current driving between certain color and white, for example, With the addition of the optical filter of red electrochromic material can switch between red and white, with the addition of blueness, the first green Or second the optical filter of electrochromic material of green can also be switched between corresponding color and white.
Thus, control module 14 can be carried out according to ambient brightness parameter to the electric current for being applied to each optical filtering subelement 1211 Control, so that each optical filtering subelement 1211 switches between corresponding color and white.Specifically, control module 14 can Control power supply module applies the first electric current so as to be switched optical filtering subelement switched into white to be switched optical filtering subelement, and to Non- to be switched optical filtering subelement apply the second electric current so that non-to be switched optical filtering subelement remain corresponding color it is for example red, Blueness, the first green or the second green.
In addition, according to some embodiments of the present invention, the M photosensitive pixel 1111 that each filter unit 122 covers is formed One merging pixel, that is, say that the M photosensitive pixel 1111 in each sensitive pixel elements 111 forms a merging pixel.According to Fig. 1-3 and Fig. 5-8 example, each filter unit 1311 cover 2*2 photosensitive pixel 111 to form merging pixel.
In addition to 2*2 structures, the also structure such as 3*3,4*4, even any n*m (n, m are natural number), it will be understood that The number of sequencable photosensitive pixel 1111 is limited on photosensitive pixel array 11, each light-sensitive image for merging pixel and being included If element 1111 is excessive, the resolution sizes of image can be restricted, and e.g., if the pixel value of photosensitive pixel array 11 is 16M, be adopted Can obtain the merging image that resolution ratio is 4M with 2*2 merging dot structure, and use 4*4 structures just can only obtain resolution ratio for 1M merging image.Therefore 2*2 merging dot structure is a preferred arrangement mode, is sacrificing the premise of resolution ratio less as far as possible Lower lifting brightness of image and definition.Meanwhile facilitated using 2*2 structures and reading and conjunction to photosensitive pixel output are realized on hardware And handle.
According to one embodiment of present invention, as shown in figure 9, imaging sensor also includes control module 14, control module 14 are used to control photosensitive pixel array 11 to expose line by line.Specifically, control module 14 be connected with row selection logic unit 15 and Column selection logic unit 16, to control the output line by line to photosensitive pixel 1111 to handle.
The mode for exposing and exporting line by line is easier to realize on hardware.
Further, as shown in figure 9, imaging sensor 10 also includes register 17, control module 14 is used to gather successively The output of the row k of current exposure completion and the photosensitive pixel 111 of the row of kth+1 is simultaneously stored in register 17, wherein k=2n-1, and n is Natural number, k+1 are less than or equal to total line number of photosensitive pixel array 11.
In this way, register can be made full use of to realize output reading, caching and the process merged of photosensitive unit, hardware Easily realize and processing speed is very fast.
Specifically, as shown in Figures 9 and 10, imaging sensor 10 includes row selection logic unit 15 and column selection logic unit 16.Wherein, row selection logic unit 15 and column selection logic unit 16 are connected with control module 14 respectively, row selection logic unit 15 and the switching tube 1115 corresponding with each photosensitive pixel 1111 of column selection logic unit 16 connect, control module 14 be used for control System row selects logic unit 15 and column selection logic unit 16 to gate the switching tube 1115 of the photosensitive pixel 1111 of ad-hoc location.
Control module 14 gathers the output of the photosensitive pixel of the first row and the second row and is stored in register 17 first.Follow-up electricity Output of the road to four photosensitive pixels 1111 that position coordinates is 1-1,1-2,2-1,2-2 is handled to obtain merging pixel Pixel value.The wherein left side digitized representation row of position coordinates, digits right represent row.
The output to four photosensitive pixels that position coordinates is 1-3,1-4,2-3,2-4 is handled again, is accordingly felt The pixel value of light pixel unit.
By that analogy, until having handled last four photosensitive pixel of group of the first row and the second row.
By above processing mode, the output to the photosensitive pixel of the third line and fourth line, fifth line and the 6th row etc. is carried out Processing, until the output of whole photosensitive pixels handles completion.
According to one embodiment of present invention, as shown in FIG. 10 and 11, imaging sensor 10 also includes analog-digital converter 21 Array, each analog-digital converter 21 are connected with a photosensitive pixel 1111, and analog-digital converter 21 is used for photosensitive pixel 1111 Analog signal output is converted to data signal output.
Such as Figure 10 example, photosensitive pixel 1111 includes photodiode 1113.Photodiode 1113 is used for illumination It is converted into electric charge, and caused electric charge relation proportional to intensity of illumination.Switching tube 1115 is used to select logic unit according to row 15 and the control signal of column selection logic unit 16 come the conducting and disconnection of control circuit, when circuit turn-on, source follower 1117 (source follower) are used to photodiode 1113 being converted into voltage signal through charge signal caused by illumination. Analog-digital converter 211 (Analog-to-digital converter) is used to voltage signal being converted to data signal, with transmission To subsequent conditioning circuit processing.
This output processing mode makes the output of photosensitive pixel be converted into data signal, in following digital circuit or in chip It is middle to be handled with software.Therefore the output information of each photosensitive pixel can be retained, for example, the image for 16M pixels For sensor, the imaging method of embodiment of the present invention can retain the information of 16M pixels (image before merging), in this base On plinth the merging image of 4M pixels or the image of other resolution ratio are obtained by processing.Ultimately generate image and the probability of bad point occur It is relatively low.In addition, the noise of this output processing mode is smaller, signal to noise ratio is higher.
According to one embodiment of present invention, as shown in figure 12, imaging sensor 10 includes being arranged on optical filter 12 Micro mirror array 23, each micro mirror 231 are corresponding with a photosensitive pixel 1111.
Specifically, each micro mirror 231 is corresponding with a photosensitive pixel 1111, including size, position correspondence.In some implementations In mode, the corresponding 2*2 photosensitive pixel 1111 of each filter unit 122 and 2*2 micro mirror 231.It is terrible as technology develops The image higher to resolution ratio, the photosensitive pixel 1111 on sensitive film is more and more, arranges more and more intensive, single photosensitive pixel 1111 is also less and less, and its light is affected, and the photosensitive area of photosensitive pixel 1111 is limited, the energy of micro mirror 231 Light is gathered into photosensitive part, so as to lift the light reception intensity of photosensitive pixel 1111 to improve image quality.
In summary, the imaging sensor proposed according to embodiments of the present invention, control module can be according to ambient brightness parameters The to be switched optical filtering subelement in N number of filter unit is determined, and to be switched optical filtering subelement is switched into white.Thus, low By switching out white optical filtering subelement under brightness, it is possible to increase light-inletting quantity, and then obtain under low-light level higher signal to noise ratio, bright Degree and definition, the less image of generation noise, also, according to the quantity of the white optical filtering subelement of ambient brightness adjustment, so that In the case of the less image of generation noise, image color loss is reduced as far as possible.
The embodiment of the present invention also proposed a kind of adjusting method of imaging sensor imaging image quality.Wherein, imaging sensor Including the photosensitive pixel array with multiple sensitive pixel elements and the optical filter being arranged on photosensitive pixel array, optical filter Including the filter unit array with multiple filtration modules, each filtration module includes being covered each by the N of N number of sensitive pixel elements Individual filter unit, each sensitive pixel elements include M photosensitive pixel, and each filter unit includes corresponding with M photosensitive pixel Optical filtering subelement, wherein, M and N are positive integer.
Figure 13 is the flow chart of the adjusting method of imaging sensor imaging image quality according to embodiments of the present invention.Such as Figure 13 institutes Show, the adjusting method of imaging sensor imaging image quality comprises the following steps:
S1:Ambient brightness parameter is detected, and judges whether ambient brightness parameter is less than the first predetermined threshold value.
S2:When judging that ambient brightness parameter is less than the first predetermined threshold value, N number of list that filters is determined according to ambient brightness parameter To be switched optical filtering subelement in member, and to be switched optical filtering subelement is switched into white.
Wherein, optical filtering subelement that can be in N number of filter unit outside to be switched optical filtering subelement is non-to be switched filter Photon unit, the non-to be switched optical filtering subelement in N number of filter unit then keep correspondingly colored for example red, green or blue Color.
It should be noted that the optical filtering subelement for remaining colour is used for the color information for obtaining sensitive pixel elements.Cut The optical filtering subelement for being changed to white is used for the information for obtaining whole " white light ", that is, says, because white optical filtering subelement has preferably The translucent effect and then brightness value of photosensitive pixel output corresponding to making is higher, therefore, white optical filtering subelement is used in low-light level In the case of obtain the monochrome informations of sensitive pixel elements, and the noise of the monochrome information is less.
It should be noted that ambient brightness can be divided into multiple brightness degrees, different brightness degrees correspond to different to be cut Change optical filtering subelement.So after ambient brightness parameter is got, the brightness degree belonging to ambient brightness parameter is judged, and obtain To be switched optical filtering subelement corresponding to the brightness degree is taken, so can determine that to be switched optical filtering in N number of filter unit is single Member.
The adjusting method of the imaging sensor imaging image quality of the embodiment of the present invention, can be determined N number of according to ambient brightness parameter To be switched optical filtering subelement in filter unit, and to be switched optical filtering subelement is switched into white, thus, lead under low-light level Cross and switch out white optical filtering subelement, so as to increase light-inletting quantity under low-light level, the image generated with this has higher letter Make an uproar than, brightness and definition preferably and noise is few.Also, the quantity of white optical filtering subelement is adjusted according to ambient brightness, from And in the case of the less image of generation noise, image color loss is reduced as far as possible.
In addition, according to some embodiments of the present invention, judging that ambient brightness parameter is more than or equal to the first predetermined threshold value When being in high-brightness environment, optical filtering subelement remains correspondingly colour, without switching to white, so as to avoid image color Loss, ensure that image color is complete.
According to some embodiments of the present invention, the filter unit array of the embodiment of the present invention is substantially according to visiing shown in Fig. 4 Ear array (Bayer pattern) arranges, and Bayer array includes multiple filtration modules, and each filtration module may include 2*2 (i.e. N=4) individual filter unit, the respectively first green Gr filter units, the second green Gb filter units, red R filter unit and indigo plant Color B filter units.
Picture signal can be handled to the algorithm of Bayer structure using conventional needle using Bayer structure, without hardware Big adjustment is done in structure.
According to some embodiments of invention, ambient brightness can be divided into five grades, it is bright to be followed successively by first from high to low Grade, the second brightness degree, the 3rd brightness degree, the 4th brightness degree and the 5th brightness degree are spent, wherein, first brightness etc. The brightness of level is sufficient, and without filtering subunit is switched into white, and the luminance shortage of the second to the 5th brightness degree will be, it is necessary to will Filtering subunit switches to white.
Specifically, the first brightness degree is greater than or equal to the first predetermined threshold value, the second brightness degree may be greater than Two predetermined threshold values and it may be greater than the 3rd predetermined threshold value and pre- less than or equal to second less than the first predetermined threshold value, the 3rd brightness degree If threshold value, the 4th brightness degree may be greater than the 4th predetermined threshold value and can less than or equal to the 3rd predetermined threshold value, the 5th brightness degree For less than or equal to the 5th predetermined threshold value.Wherein, the first predetermined threshold value, the second predetermined threshold value, the 3rd predetermined threshold value, the 4th preset Threshold value is sequentially reduced, and according to the preferred exemplary of the present invention, the first predetermined threshold value can be preset for 200Lux (lux), second Threshold value can be that 100Lux, the 3rd predetermined threshold value can be 50Lux and the 4th predetermined threshold value can be 20Lux.
According to one embodiment of present invention, as shown in figure 14, determined according to ambient brightness parameter in N number of filter unit To be switched optical filtering subelement is that step S2 includes:
S101:Judge whether ambient brightness parameter is more than the second predetermined threshold value, wherein, it is pre- that the second predetermined threshold value is less than first If threshold value.
S102:If ambient brightness parameter is more than the second predetermined threshold value, by the first green filter unit and the second green An optical filtering subelement in filter unit is as to be switched optical filtering subelement.
Specifically, filter unit may include the individual optical filtering subelements of 2*2 (i.e. M=4), and it is pre- to be more than second in ambient brightness parameter If during threshold value, can using the optical filtering subelement in the upper right corner in the first green Gr filter units as to be switched optical filtering subelement, and by First green Gr switches to white W, and other optical filtering subelements remain the first green Gr as non-to be switched optical filtering subelement; And using the optical filtering subelement in the upper right corner in the second green Gb filter units as to be switched optical filtering subelement and by the second green Gb switches to white W, and other optical filtering subelements remain the second green Gb as non-to be switched optical filtering subelement.
Certainly, also can be single by optical filtering of other positions in the first green Gr filter units and the second green Gb filter units Member is used as to be switched optical filtering subelement, is not limited to the upper right corner.
It should be appreciated that when ambient brightness parameter is more than the second predetermined threshold value and is less than the first predetermined threshold value, explanation Ambient brightness parameter belongs to the second brightness degree, it is necessary to switch to white to reduce image noise simultaneously on to be switched optical filtering subelement Image definition is improved, but now ambient brightness is only second to the first brightness degree, ambient brightness is than relatively low, it is only necessary to will be less Optical filtering subelement switches to white, by one in the first green Gr filter units and the second green Gb filter units in the present embodiment Individual optical filtering subelement switches to white, so as to avoid image color loss excessive in the case where image noise is less.
According to one embodiment of present invention, as shown in figure 15, determined according to ambient brightness parameter in N number of filter unit To be switched optical filtering subelement is that step S2 also includes:
S201:Judge whether ambient brightness parameter is more than the 3rd predetermined threshold value, wherein, it is pre- that the 3rd predetermined threshold value is less than second If threshold value.
S202:If ambient brightness parameter is more than the 3rd predetermined threshold value, by the first green filter unit and the second green For M1 optical filtering subelement in filter unit as to be switched optical filtering subelement, M1 is the positive integer more than 1 and less than M.
Specifically, filter unit may include the individual optical filtering subelements of 2*2 (i.e. M=4), and it is pre- to be more than the 3rd in ambient brightness parameter If, can be using the optical filtering subelement of secondary series in the first green Gr filter units as to be switched optical filtering subelement and by during threshold value One green Gr switches to white W, and other optical filtering subelements remain the first green Gr as non-to be switched optical filtering subelement;With And using the optical filtering subelement of secondary series in the second green Gb filter units as to be switched optical filtering subelement and by the second green Gb White W is switched to, and other optical filtering subelements remain the second green Gb as non-to be switched optical filtering subelement.
Certainly, also can be single by optical filtering of other positions in the first green Gr filter units and the second green Gb filter units Member is used as to be switched optical filtering subelement, is not limited to secondary series.
It should be appreciated that when ambient brightness parameter is more than the 3rd predetermined threshold value and is less than or equal to the second predetermined threshold value, Illustrate that ambient brightness parameter belongs to the 3rd brightness degree, it is necessary to switch to white to be made an uproar to reduce image on to be switched optical filtering subelement Put and improve image definition, but now ambient brightness is low relative to the second brightness degree, need to be by more optical filtering subelement White is switched to, by optical filtering of secondary series in the first green Gr filter units and the second green Gb filter units in the present embodiment Unit switches to white, so as to avoid image color loss excessive in the case where image noise is less.
According to one embodiment of present invention, as shown in figure 16, determined according to ambient brightness parameter in N number of filter unit To be switched optical filtering subelement is that step S2 also includes:
S301:Judge whether ambient brightness parameter is more than the 4th predetermined threshold value, wherein, it is pre- that the 4th predetermined threshold value is less than the 3rd If threshold value.
S302:If ambient brightness parameter is more than the 4th predetermined threshold value, by the first green filter unit and the second green M optical filtering subelement in filter unit is used as to be switched optical filtering subelement.
Specifically, filter unit may include the individual optical filtering subelements 1211 of 2*2 (i.e. M=4), be more than the in ambient brightness parameter , can be using optical filtering subelement in the first green Gr filter units as to be switched optical filtering subelement and by first during four predetermined threshold values Green Gr switches to white W;It is and the optical filtering subelement in the second green Gb filter units is single as the to be switched son that filters Member simultaneously switches to white W by the second green Gb.
It should be appreciated that when ambient brightness parameter is more than the 4th predetermined threshold value and is less than or equal to three predetermined threshold values, Illustrate that ambient brightness parameter belongs to the 4th brightness degree, it is necessary to switch to white to be made an uproar to reduce image on to be switched optical filtering subelement Put and improve image definition, and now ambient brightness is very low, more optical filtering subelements need to be switched into white, this implementation The optical filtering subelement in the first green Gr filter units and the second green Gb filter units is switched into white in example, so that compared with Few image noise.
S303:If ambient brightness parameter is less than or equal to the 4th predetermined threshold value, by the first green filter unit, second M2 optical filtering subelement in green filter unit, red filter unit and blue filter unit is single as the to be switched son that filters Member, M2 are the positive integer more than 1 and less than M.
Specifically, filter unit may include the individual optical filtering subelements of 2*2 (i.e. M=4), be less than or equal in ambient brightness parameter , can be using the optical filtering subelement of secondary series in the first green Gr filter units as to be switched optical filtering subelement during four predetermined threshold values And white W is switched to by the first green Gr, and as non-to be switched optical filtering subelement to remain first green for other optical filtering subelements Color Gr;Using the optical filtering subelement of secondary series in the second green Gb filter units as to be switched optical filtering subelement and by the second green Gb switches to white W, and other optical filtering subelements remain the second green Gb as non-to be switched optical filtering subelement;By red R The optical filtering subelement of secondary series switches to white W as to be switched optical filtering subelement and by red R in filter unit, and other are filtered Photon unit remains red R as non-to be switched optical filtering subelement;By the optical filtering subelement of secondary series in blue B filter units White W is switched to as to be switched optical filtering subelement and by blue B, and other optical filtering subelements are single as the non-to be switched son that filters Member remains blue B.
Certainly, also can be by the first green Gr filter units, the second green Gb filter units, red R filter unit and blue B The optical filtering subelement of other positions is not limited to secondary series as to be switched optical filtering subelement in filter unit.
It should be appreciated that when ambient brightness parameter is less than or equal to four predetermined threshold values, illustrate ambient brightness parameter category In the 5th brightness degree, it is necessary to switch to white to reduce image noise and improve image clearly on to be switched optical filtering subelement Degree, and now ambient brightness is very low, and more optical filtering subelements need to switch to white and each filter unit have and treat Switch optical filtering subelement, the first green Gr filter units, the second green Gb filter units, red R filter in the present embodiment single The optical filtering subelement of secondary series switches to white in first and blue B filter units, so as to less image noise.
Further, according to one embodiment of present invention, optical filter can be made up of electrochromic material, wherein, it will treat Switching optical filtering subelement switches to white to further comprise:
To be switched optical filtering subelement into N number of filter unit is passed through the first electric current so as to be switched optical filtering subelement to be switched For white.
It should be noted that electrochromic material can be added to so that the optical filter of the embodiment of the present invention is made in glass, Electrochromic material in optical filter can be changed under electric current driving between certain color and white, for example, addition The optical filter of red electrochromic material can switch between red and white, with the addition of blueness, the first green or the The optical filter of the electrochromic material of two greens can also switch between corresponding color and white.
Thus, the electric current for being applied to each optical filtering subelement can be controlled according to ambient brightness parameter, so that each Optical filtering subelement switches between corresponding color and white.Specifically, first can be applied to be switched optical filtering subelement Electric current applies the second electric current so that non-treat so as to be switched optical filtering subelement is switched into white to non-to be switched optical filtering subelement Switching optical filtering subelement remains for example red corresponding color, blueness, the first green or the second green.
In addition, according to some embodiments of the present invention, M photosensitive pixel of each filter unit covering forms a merging Pixel, that is, say that M photosensitive pixel in each sensitive pixel elements forms a merging pixel.In a preferred exemplary, often Individual filter unit can cover 2*2 photosensitive pixel to form merging pixel.
In addition to 2*2 structures, the also structure such as 3*3,4*4, even any n*m (n, m are natural number), it will be understood that The number of sequencable photosensitive pixel is limited on photosensitive pixel array, and the photosensitive pixel that each merging pixel is included is excessive If, the resolution sizes of image can be restricted, e.g., if the pixel value of photosensitive pixel array is 16M, using 2*2 merging Dot structure can obtain resolution ratio and be 4M merging image, and use 4*4 structures just to can only obtain merging figure of the resolution ratio for 1M Picture.Therefore 2*2 merging dot structure is a preferred arrangement mode, and image is lifted on the premise of resolution ratio is sacrificed less as far as possible Brightness and definition.Meanwhile facilitated using 2*2 structures and the reading to photosensitive pixel output and merging treatment are realized on hardware.
In summary, the adjusting method of the imaging sensor imaging image quality proposed according to embodiments of the present invention, can be according to ring Border luminance parameter determines the to be switched optical filtering subelement in N number of filter unit, and to be switched optical filtering subelement is switched into white. Thus, by switching out white optical filtering subelement under low-light level, it is possible to increase light-inletting quantity, and then obtain under low-light level higher Signal to noise ratio, brightness and definition, the less image of generation noise, also, white optical filtering subelement is adjusted according to ambient brightness Quantity, so as in the case of the less image of generation noise, reduce image color loss as far as possible.
The embodiment of the present invention also proposed imaging device 100.
According to Figure 17, the imaging device 100 of the embodiment of the present invention includes the imaging sensor of embodiment of the present invention 10 and the image processing module 50 that is connected with imaging sensor 10.Image processing module 50 is used to read and handle photosensitive pixel The output of array 11 is to obtain the pixel value of sensitive pixel elements so as to form merging image.Wherein, each sensitive pixel elements M photosensitive pixel form one merging pixel.
Specifically, imaging sensor 10 may include control module 14, row selection logic unit 15, column selection logic unit 16th, analog-digital converter array 21, register 17 etc., the output of photosensitive pixel array 11 are converted to number through analog-digital converter array 21 Word signal, is stored in register 17 and is sent to image processing module 50 and handle line by line, until the output quilt of all photosensitive pixels Handle to generate merging image.
Closed in this way, the output of M photosensitive pixel of the image processing module 50 in same sensitive pixel elements calculates And the pixel value of pixel is to generate merging image.
Specifically, image processing module 50 can be by the output phase of M photosensitive pixel in same sensitive pixel elements Add as the pixel value for merging pixel.
In this way, the output of M photosensitive pixel is added, the merging pixel signal to noise ratio of formation is higher.It is for example it is assumed that original every The output of individual photosensitive pixel is S, noise Ns, and merging pixel includes M photosensitive pixel, then the pixel value for merging pixel is M*S, And the noise for merging pixel isM is positive integer.It is understood that in M>In the case of 1, merge making an uproar for pixel Sound is less than the noise sum of each photosensitive pixel output before merging, such as M=4, the noise for merging pixel is Ns/2, Ns/2 Less than the noise sum 4*Ns of each photosensitive pixel output before merging.And the output for merging pixel is defeated for each photosensitive pixel before merging Go out sum, therefore noise declines signal to noise ratio raising, definition lifting to the image after merging on the whole.
In summary, the imaging device proposed according to embodiments of the present invention, by reading and handling above-mentioned imaging sensor Output, by switching out white optical filtering subelement under low-light level, so that light-inletting quantity can be increased under low-light level, generated with this Image have compared with high signal to noise ratio, brightness and definition preferably and noise it is few.Also, white is adjusted according to ambient brightness The quantity of optical filtering subelement, so as in the case of the less image of generation noise, reduce image color loss as far as possible.
The embodiment of the present invention has reintroduced a kind of imaging method of imaging sensor.
According to Figure 18 embodiment, the imaging method of the imaging sensor of the embodiment of the present invention comprises the following steps:
S10:Read the output of photosensitive pixel array in imaging sensor.
Wherein, imaging sensor includes the photosensitive pixel array with multiple sensitive pixel elements and is arranged at light-sensitive image Optical filter in pixel array, optical filter include the filter unit array with multiple filtration modules, and each filtration module includes dividing N number of filter unit of N number of sensitive pixel elements is not covered, and each sensitive pixel elements include M photosensitive pixel, each list that filters Member includes the subelement that filters corresponding with M photosensitive pixel, wherein, M and N are positive integer.Extraneous light is irradiated by optical filter To the photosensitive part of photosensitive pixel to produce the output of electric signal, i.e. photosensitive pixel.
Imaging sensor is used to obtain ambient brightness parameter, and judges whether ambient brightness parameter is less than the first default threshold Value, and when judging that ambient brightness parameter is in low-light level environment less than the first predetermined threshold value, it is true according to ambient brightness parameter To be switched optical filtering subelement in fixed N number of filter unit is the to be switched optical filtering subelement in each filtration module, and will be to be cut Change optical filtering subelement and switch to white W.
Thus, by switching out white optical filtering subelement under low-light level, so as to which light-inletting quantity can be increased under low-light level, with The image of this generation has preferable compared with high signal to noise ratio, brightness and definition and noise is few.Also, adjusted according to ambient brightness The quantity of whole white optical filtering subelement, so as in the case of the less image of generation noise, reduce image color damage as far as possible Lose.
S20:The pixel values of sensitive pixel elements is calculated according to the output of M photosensitive pixel in sensitive pixel elements to generate Merge image.
Wherein, M photosensitive pixel of each sensitive pixel elements forms a merging pixel.
Specifically, the pixel value that merging pixel is calculated according to the output of the photosensitive pixel of same merging pixel is merged with generating Image is that step S20 further comprises:The output of M photosensitive pixel in same sensitive pixel elements is added as corresponding Merge the pixel value of pixel.
In this way, using the method for potting gum, the output for merging pixel is the sum of each pixel output before merging, and is merged The noise of pixel be less than merge before each pixel noise sum, therefore merge after generate image noise it is less, signal to noise ratio compared with It is high.
Further, according to one embodiment of present invention, according to the output meter of M photosensitive pixel in sensitive pixel elements The pixel value for calculating sensitive pixel elements is that step S2 further comprises:
The output of the photosensitive pixel of collection row k and the row of kth+1 is simultaneously stored in register, and wherein k=2n-1, n are natural number, K+1 is less than or equal to total line number of photosensitive pixel array.
The output of the photosensitive pixel of row k and the row of kth+1 is extracted from register to obtain the pixel value for merging pixel.
In this way, register can be made full use of to realize output reading, caching and the process merged of photosensitive unit, hardware Easily realize and processing speed is very fast.
In addition, each photosensitive pixel is connected with an analog-digital converter respectively, imaging method of the embodiment of the present invention is further Including:
Analog signal output caused by photosensitive pixel is converted into data signal output.
The data signal output of the photosensitive pixel of same merging pixel is added to obtain merging the pixel value of pixel.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor) Processing module can directly handle the output of imaging sensor, two, relative to it is some by circuit directly to imaging sensor Analog signal format the scheme that is handled of output for, the information of image is preferably remained, for example, for 16M pictures For the imaging sensor of element, the imaging method of embodiment of the present invention can retain the letter of 16M pixels (image before merging) Breath, obtain the merging image of 4M pixels or the image of other resolution ratio by processing on this basis.
In summary, the imaging method proposed according to embodiments of the present invention, by reading and handling above-mentioned imaging sensor Output, thus, by switching out white optical filtering subelement under low-light level, it is possible to increase light-inletting quantity, and then under low-light level To higher signal to noise ratio, brightness and definition, the less image of generation noise, also, white is adjusted according to ambient brightness and filtered The quantity of subelement, so as in the case of the less image of generation noise, reduce image color loss as far as possible.
The present invention provides a kind of mobile terminal using imaging device again.
According to an embodiment of the invention, mobile terminal includes the imaging device of above-described embodiment.Therefore, mobile terminal has Camera function and the merging image that signal to noise ratio is high, definition is high and noise is few can be generated under low-light (level).
Mobile terminal can be mobile phone.
According to one embodiment of present invention, imaging device can be the Front camera of mobile phone.Because Front camera uses In self-timer, and self-timer typically requires to require the definition of image and it is not high to image resolution requirement, using of the invention real This requirement can be met by applying the mobile terminal of example.
Further, according to Figure 19 embodiment, mobile terminal 200 includes the central processing being connected with imaging device 100 Device 81 and external memory 83, central processing unit 81 are used to control the storage of external memory 83 to merge image.
So, the merging image of generation can be stored, and be checked after convenient, use or transfer.External memory 83 includes SM (Smart Media) blocks and CF (Compact Flash) blocks etc..
Further, according to Figure 20 embodiment, mobile terminal 200 also includes the centre being connected with imaging device 100 Device 81 and display device 85 are managed, central processing unit 81 is used to control the display of display device 85 to merge image.So, mobile terminal The image of 200 shootings can be shown in display device so that user checks.Display device is including light-emitting diode display etc..
In summary, using the mobile terminal of embodiment of the present invention, there is camera function and can be generated under low-light level Signal to noise ratio is high, noise is few, definition is high, image color loses small merging image.Particularly, when this mobile terminal is mobile phone During Front camera, the brightness of self-timer image and definition under low-light level can be lifted, reduces noise.
In the description of the invention, it is to be understood that term " " center ", " longitudinal direction ", " transverse direction ", " length ", " width ", " thickness ", " on ", " under ", "front", "rear", "left", "right", " vertical ", " level ", " top ", " bottom " " interior ", " outer ", " up time The orientation or position relationship of the instruction such as pin ", " counterclockwise ", " axial direction ", " radial direction ", " circumference " be based on orientation shown in the drawings or Position relationship, it is for only for ease of and describes the present invention and simplify description, rather than indicates or imply that signified device or element must There must be specific orientation, with specific azimuth configuration and operation, therefore be not considered as limiting the invention.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three It is individual etc., unless otherwise specifically defined.
In the present invention, unless otherwise clearly defined and limited, term " installation ", " connected ", " connection ", " fixation " etc. Term should be interpreted broadly, for example, it may be fixedly connected or be detachably connected, or integrally;Can be that machinery connects Connect or electrically connect;Can be joined directly together, can also be indirectly connected by intermediary, can be in two elements The connection in portion or the interaction relationship of two elements, limited unless otherwise clear and definite.For one of ordinary skill in the art For, the concrete meaning of above-mentioned term in the present invention can be understood as the case may be.
In the present invention, unless otherwise clearly defined and limited, fisrt feature can be with "above" or "below" second feature It is that the first and second features directly contact, or the first and second features pass through intermediary mediate contact.Moreover, fisrt feature exists Second feature " on ", " top " and " above " but fisrt feature are directly over second feature or oblique upper, or be merely representative of Fisrt feature level height is higher than second feature.Fisrt feature second feature " under ", " lower section " and " below " can be One feature is immediately below second feature or obliquely downward, or is merely representative of fisrt feature level height and is less than second feature.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification Close and combine.
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned Embodiment is changed, changed, replacing and modification.

Claims (15)

  1. A kind of 1. imaging sensor, it is characterised in that including:
    Photosensitive pixel array, the photosensitive pixel array have multiple sensitive pixel elements, each sensitive pixel elements bag Include M photosensitive pixel;And
    The optical filter being arranged on the photosensitive pixel array, the optical filter include the filter unit with multiple filtration modules Array, each filtration module include being covered each by N number of filter unit of N number of sensitive pixel elements, each filter Light unit includes M optical filtering subelement corresponding with the M photosensitive pixel, wherein, M and N are the integer more than 1:
    Brightness detection module, the brightness detection module are used to obtain ambient brightness parameter;
    Control module, the control module is used to judge whether the ambient brightness parameter is less than the first predetermined threshold value, and is sentencing When the ambient brightness parameter of breaking is less than first predetermined threshold value, N number of optical filtering is determined according to the ambient brightness parameter To be switched optical filtering subelement in unit, and the to be switched optical filtering subelement is switched into white;
    Wherein, the filter unit array is arranged with Bayer array, each filtration module include the first green filter unit, Second green filter unit, red filter unit and blue filter unit;
    Wherein, the control module is further used for, and judges whether the ambient brightness parameter is more than the second predetermined threshold value, and When the ambient brightness parameter is more than second predetermined threshold value, by the first green filter unit and the second green filter list An optical filtering subelement in member as the to be switched optical filtering subelement, wherein, second predetermined threshold value is less than described the One predetermined threshold value;
    Wherein, the control module is further used for, and judges whether the ambient brightness parameter is more than the 3rd predetermined threshold value, and It is green by described first when the ambient brightness parameter is more than the 3rd predetermined threshold value and is less than or equal to second predetermined threshold value M1 optical filtering subelement in color filter unit and the second green filter unit as the to be switched optical filtering subelement, wherein, 3rd predetermined threshold value is less than second predetermined threshold value, and M1 is the positive integer more than 1 and less than M.
  2. 2. imaging sensor as claimed in claim 1, it is characterised in that the control module is further used for, described in judgement Whether ambient brightness parameter is more than the 4th predetermined threshold value, and is more than the 4th predetermined threshold value and small in the ambient brightness parameter When equal to three predetermined threshold value, by M optical filtering in the first green filter unit and the second green filter unit Subelement is used as the to be switched optical filtering subelement, and is less than or equal to the described 4th in the ambient brightness parameter and presets During threshold value, by the first green filter unit, the second green filter unit, the red filter unit and the blueness M2 optical filtering subelement in filter unit as the to be switched optical filtering subelement, wherein, the 4th predetermined threshold value is less than 3rd predetermined threshold value, M2 are the positive integer more than 1 and less than M.
  3. 3. the imaging sensor as described in any one in claim 1-2, wherein, each filter unit covers described M photosensitive pixel forms a merging pixel.
  4. 4. the imaging sensor as described in any one in claim 1-2, the optical filter is made up of electrochromic material, its In, the control module is further used for, the to be switched optical filtering subelement into N number of filter unit be passed through the first electric current with The to be switched optical filtering subelement is switched into white.
  5. 5. a kind of adjusting method of imaging sensor imaging image quality, it is characterised in that described image sensor is included with multiple The photosensitive pixel array of sensitive pixel elements and the optical filter being arranged on the photosensitive pixel array, the optical filter include Filter unit array with multiple filtration modules, each filtration module include being covered each by N number of photosensitive pixel list N number of filter unit of member, each sensitive pixel elements include M photosensitive pixel, and each filter unit includes and institute M optical filtering subelement corresponding to M photosensitive pixel is stated, wherein, M and N are the integer more than 1, be the described method comprises the following steps:
    Ambient brightness parameter is detected, and judges whether the ambient brightness parameter is less than the first predetermined threshold value;And
    When judging that the ambient brightness parameter is less than first predetermined threshold value, according to determining the ambient brightness parameter To be switched optical filtering subelement in N number of filter unit, and the to be switched optical filtering subelement is switched into white;
    Wherein, the filter unit array is arranged with Bayer array, each filtration module include the first green filter unit, Second green filter unit, red filter unit and blue filter unit;
    Wherein, the to be switched optical filtering subelement determined according to the ambient brightness parameter in N number of filter unit includes:
    Judge whether the ambient brightness parameter is more than the second predetermined threshold value, wherein, second predetermined threshold value is less than described the One predetermined threshold value;
    If the ambient brightness parameter is more than second predetermined threshold value, and the first green filter unit and second is green An optical filtering subelement in color filter unit is as the to be switched optical filtering subelement;
    Wherein, the to be switched optical filtering subelement determined according to the ambient brightness parameter in N number of filter unit also wraps Include:
    Judge whether the ambient brightness parameter is more than the 3rd predetermined threshold value, wherein, the 3rd predetermined threshold value is less than described the Two predetermined threshold values;
    If the ambient brightness parameter is more than the 3rd predetermined threshold value and is less than or equal to second predetermined threshold value, by institute The M1 optical filtering subelement stated in the first green filter unit and the second green filter unit is single as the to be switched son that filters Member, M1 are the positive integer more than 1 and less than M.
  6. 6. the adjusting method of imaging sensor imaging image quality as claimed in claim 5, it is characterised in that described according to the ring Border luminance parameter determines that the to be switched optical filtering subelement in N number of filter unit also includes:
    Judge whether the ambient brightness parameter is more than the 4th predetermined threshold value, wherein, the 4th predetermined threshold value is less than described the Three predetermined threshold values;
    If the ambient brightness parameter is more than the 4th predetermined threshold value and is less than or equal to the 3rd predetermined threshold value, by institute It is single as the to be switched son that filters to state M optical filtering subelement in the first green filter unit and the second green filter unit Member;
    If the ambient brightness parameter is less than or equal to the 4th predetermined threshold value, by the first green filter unit, M2 optical filtering subelement conduct in the second green filter unit, the red filter unit and the blue filter unit The to be switched optical filtering subelement, M2 are the positive integer more than 1 and less than M.
  7. 7. the adjusting method of the imaging sensor imaging image quality as described in any one in claim 5-6, wherein, it is each described The M photosensitive pixel of filter unit covering forms a merging pixel,
  8. 8. as described in any one in claim 5-6 imaging sensor imaging image quality adjusting method, the optical filter by Electrochromic material is made, wherein, it is described to switch to white to further comprise on the to be switched optical filtering subelement:
    To be switched optical filtering subelement into N number of filter unit is passed through the first electric current with by the to be switched optical filtering subelement Switch to white.
  9. 9. a kind of imaging device, it is characterised in that including:
    Imaging sensor as described in claim 1-4 any one;
    The image processing module being connected with described image sensor, described image processing module are used to read and handle described image The output of photosensitive pixel array described in sensor is to obtain the pixel value of the sensitive pixel elements so as to form merging image.
  10. A kind of 10. imaging method of imaging sensor according to claim 1-4 any one, it is characterised in that including Following steps:
    Read the output of photosensitive pixel array in described image sensor;
    The output of M photosensitive pixel according to the sensitive pixel elements calculate the pixel values of the sensitive pixel elements with Generation merges image.
  11. 11. a kind of mobile terminal, it is characterised in that including imaging device as claimed in claim 9.
  12. 12. mobile terminal as claimed in claim 11, it is characterised in that the mobile terminal is mobile phone.
  13. 13. mobile terminal as claimed in claim 12, it is characterised in that the imaging device is the preposition phase of the mobile phone Machine.
  14. 14. mobile terminal as claimed in claim 11, it is characterised in that also include:
    The central processing unit and external memory being connected with the imaging device, the central processing unit are used to control the outer storage Device stores the merging image.
  15. 15. mobile terminal as claimed in claim 11, it is characterised in that also include:
    The central processing unit and display device being connected with the imaging device, the central processing unit are used to control the display dress Put the display merging image.
CN201510964249.9A 2015-12-18 2015-12-18 Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal Expired - Fee Related CN105578079B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510964249.9A CN105578079B (en) 2015-12-18 2015-12-18 Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510964249.9A CN105578079B (en) 2015-12-18 2015-12-18 Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal

Publications (2)

Publication Number Publication Date
CN105578079A CN105578079A (en) 2016-05-11
CN105578079B true CN105578079B (en) 2017-11-17

Family

ID=55887685

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510964249.9A Expired - Fee Related CN105578079B (en) 2015-12-18 2015-12-18 Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal

Country Status (1)

Country Link
CN (1) CN105578079B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106210532B (en) * 2016-07-29 2019-10-11 宇龙计算机通信科技(深圳)有限公司 One kind is taken pictures processing method and terminal device
CN106504218B (en) 2016-11-29 2019-03-12 Oppo广东移动通信有限公司 Control method, control device and electronic device
CN106341670B (en) 2016-11-29 2017-09-22 广东欧珀移动通信有限公司 Control method, control device and electronic installation
CN106454054B (en) * 2016-11-29 2019-03-19 Oppo广东移动通信有限公司 Control method, control device and electronic device
CN110221500B (en) * 2019-06-04 2022-11-04 Oppo广东移动通信有限公司 Control method, control device, storage medium, electronic device and control system
WO2022011547A1 (en) * 2020-07-14 2022-01-20 深圳市汇顶科技股份有限公司 Image sensor and related electronic device
CN114205566A (en) * 2020-09-18 2022-03-18 北京小米移动软件有限公司 Photosensitive element, photosensitive control method, photosensitive control device and medium
CN114650377A (en) * 2022-03-22 2022-06-21 维沃移动通信有限公司 Camera module, control method of camera module and electronic equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006352715A (en) * 2005-06-17 2006-12-28 Casio Comput Co Ltd Digital camera and exposure control method thereof
EP2833635B1 (en) * 2012-03-27 2018-11-07 Sony Corporation Image processing device, image-capturing element, image processing method, and program
CN104345523B (en) * 2013-08-05 2017-07-28 杭州海康威视数字技术股份有限公司 Method and its device that intelligent transportation video camera part light-inletting quantity is automatically controlled

Also Published As

Publication number Publication date
CN105578079A (en) 2016-05-11

Similar Documents

Publication Publication Date Title
CN105578079B (en) Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal
CN105516697B (en) Imaging sensor, imaging device, mobile terminal and imaging method
CN105578078B (en) Imaging sensor, imaging device, mobile terminal and imaging method
CN105430359B (en) Imaging method, imaging sensor, imaging device and electronic device
CN105578005B (en) Imaging method, imaging device and the electronic installation of imaging sensor
CN105430361B (en) Imaging method, imaging sensor, imaging device and electronic installation
CN106412592B (en) Image processing method, image processing apparatus, imaging device and electronic device
CN105611185B (en) image generating method, device and terminal device
CN105592303B (en) imaging method, imaging device and electronic device
CN107040724A (en) Double-core focus image sensor and its focusing control method and imaging device
CN105578081B (en) Imaging method, imaging sensor, imaging device and electronic installation
CN105578006B (en) Imaging method, imaging device and electronic installation
CN106604001B (en) Image processing method, image processing apparatus, imaging device and electronic device
CN105430362B (en) Imaging method, imaging device and electronic installation
CN105578080B (en) Imaging method, imaging device and electronic device
CN105611123B (en) imaging method, image sensor, imaging device and electronic device
CN106791477B (en) Image processing method, image processing apparatus, imaging device and manufacturing method
CN105578066B (en) Imaging method, imaging device and electronic installation
CN106507069B (en) Control method, control device and electronic device
CN105430363B (en) imaging method, imaging device and electronic device
CN105578067B (en) image generating method, device and terminal device
CN105611257B (en) Imaging method, imaging sensor, imaging device and electronic device
CN107146797B (en) Dual-core focusing image sensor, focusing control method thereof and imaging device
CN106507068B (en) Image processing method and device, control method and device, imaging and electronic device
CN105578071B (en) Imaging method, imaging device and the electronic installation of imaging sensor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18

Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CP03 Change of name, title or address
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20171117

CF01 Termination of patent right due to non-payment of annual fee