CN115118891A - Signal control circuit, image sensor, electronic device, and image processing method - Google Patents

Signal control circuit, image sensor, electronic device, and image processing method Download PDF

Info

Publication number
CN115118891A
CN115118891A CN202210731452.1A CN202210731452A CN115118891A CN 115118891 A CN115118891 A CN 115118891A CN 202210731452 A CN202210731452 A CN 202210731452A CN 115118891 A CN115118891 A CN 115118891A
Authority
CN
China
Prior art keywords
image
target
control module
photosensitive
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210731452.1A
Other languages
Chinese (zh)
Inventor
陈泓至
周新泽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202210731452.1A priority Critical patent/CN115118891A/en
Publication of CN115118891A publication Critical patent/CN115118891A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02BCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
    • Y02B20/00Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
    • Y02B20/40Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

The application discloses a signal control circuit, an image sensor, electronic equipment and an image processing method, and belongs to the technical field of camera shooting. Wherein, this signal control circuit includes: the first end of the photosensitive unit is grounded; the first control module is connected with the second end of the photosensitive unit and used for adjusting the signal voltage corresponding to the photosensitive unit; and the second control module is connected with the first control module, is also connected with the output end of the signal control circuit, and is used for adjusting the conversion gain. The conversion gain is used for indicating a gain for converting the signal voltage corresponding to the first control module into the output voltage.

Description

Signal control circuit, image sensor, electronic device, and image processing method
Technical Field
The application belongs to the technical field of camera shooting, and particularly relates to a signal control circuit, an image sensor, electronic equipment and an image processing method.
Background
Generally, an electronic device may output a raw (raw) image through an image sensor of the electronic device, and perform image processing (e.g., vignetting correction, multi-frame image fusion, etc.) on the raw image through an Image Signal Processor (ISP) of the electronic device to obtain a captured image with high definition and high dynamic range.
However, when the ISP performs image processing on the raw image, a large amount of noise may be introduced, which may result in poor image quality of the obtained captured image, and thus poor imaging effect of the electronic device.
Disclosure of Invention
An object of the embodiments of the present application is to provide a signal control circuit, an image sensor, an electronic device, and an image processing method, which can obtain a captured image with a higher signal-to-noise ratio in a low-brightness environment and a higher dynamic range in a high-brightness environment, and can achieve an effect of improving a capturing effect of the electronic device.
In a first aspect, an embodiment of the present application provides a signal control circuit, including: the first end of the photosensitive unit is grounded; the first control module is connected with the second end of the photosensitive unit and used for adjusting the signal voltage corresponding to the photosensitive unit; and the second control module is connected with the first control module, is also connected with the output end of the signal control circuit, and is used for adjusting the conversion gain. The conversion gain is used for indicating a gain for converting the signal voltage corresponding to the first control module into the output voltage.
In a second aspect, the present application provides an image sensor including at least one signal control circuit as described in the first aspect.
In a third aspect, the present application provides an electronic device, which includes the image sensor as described in the second aspect.
In a fourth aspect, an embodiment of the present application provides an image processing method, including: acquiring a preview image through an image sensor of electronic equipment, wherein the preview image comprises N image areas, the brightness parameters of each image area are different, each image area corresponds to a photosensitive area of the image sensor, and N is a positive integer greater than 1; respectively adjusting output voltages of signal control circuits corresponding to the N photosensitive areas based on the brightness parameters of the N image areas; acquiring N groups of image data through the adjusted signal control circuits corresponding to the N photosensitive areas, wherein the N groups of image data correspond to the N photosensitive areas one by one; and obtaining a target image according to the N groups of image data.
In a fifth aspect, an embodiment of the present application provides an image processing apparatus, including:
the image processing device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a preview image through an image sensor of the image processing device, the preview image comprises N image areas, the brightness parameters of each image area are different, each image area corresponds to a photosensitive area of the image sensor, and N is a positive integer greater than 1. And the adjusting module is used for respectively adjusting the output voltage of the signal control circuit corresponding to the N photosensitive areas based on the brightness parameters of the N image areas. The acquisition module is also used for acquiring N groups of image data through the signal control circuit corresponding to the N photosensitive areas after the adjustment of the adjustment module, wherein the N groups of image data correspond to the N photosensitive areas one by one. And the processing module is used for obtaining the target image according to the N groups of image data acquired by the acquisition module.
In a sixth aspect, embodiments of the present application provide an electronic device, which includes a processor and a memory, where the memory stores a program or instructions executable on the processor, and the program or instructions, when executed by the processor, implement the steps of the method according to the fourth aspect.
In a seventh aspect, the present application provides a readable storage medium, on which a program or instructions are stored, and when executed by a processor, the program or instructions implement the steps of the method according to the fourth aspect.
In an eighth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the steps of the method according to the fourth aspect.
In a ninth aspect, the present application provides a computer program product, stored on a storage medium, for execution by at least one processor to implement the steps of the method according to the fourth aspect.
In this embodiment, the signal control circuit includes a light sensing unit with a first end grounded, a first control module connected to a second end of the light sensing unit, and a second control module connected to the first control module and an output end of the signal control circuit, where the first control module is configured to adjust a signal voltage corresponding to the light sensing unit, the second control module is configured to adjust a conversion gain, and the conversion gain is used to indicate a gain for converting the signal voltage corresponding to the first control module into an output voltage, so that the signal control circuit can adjust the signal voltage corresponding to the light sensing unit and convert the signal voltage corresponding to the first control module into the output voltage according to the adjusted conversion gain. Because the signal control circuit adjusts the signal voltage corresponding to the photosensitive unit and converts the signal voltage corresponding to the first control module into the output voltage according to the adjusted conversion gain, the shot image with higher signal-to-noise ratio in the low-brightness environment and higher dynamic range in the high-brightness environment can be obtained without image processing through the ISP, so that more noise can be avoided when the image processing is carried out by the ISP, the image quality of the obtained shot image can be improved, and the shooting effect can be improved.
In this embodiment, the electronic device may first acquire, by using an image sensor of the electronic device, a preview image including N image areas (each image area has a different brightness parameter and corresponds to a photosensitive area of the image sensor), respectively adjust output voltages of signal control circuits corresponding to the N photosensitive areas based on the brightness parameters of the N image areas, and acquire N sets of image data (the N sets of image data correspond to the N photosensitive areas one to one) by using the signal control circuits corresponding to the N photosensitive areas after adjustment, so that the electronic device may obtain a target image according to the N sets of image data. Because the electronic device can obtain the shot image with higher dynamic ranges of the low-brightness environment and the high-brightness environment without image processing through the ISP (internet service provider) by determining different image areas (namely N image areas) corresponding to different brightness parameters of the preview image and adjusting the output voltages of the signal control circuits of different photosensitive areas corresponding to the different image areas based on the brightness parameters of the different image areas, more noise can be prevented from being introduced when the ISP performs image processing, the image quality of the obtained shot image can be improved, and the shooting effect of the electronic device can be improved.
Drawings
Fig. 1 is a schematic structural diagram of a signal control circuit according to an embodiment of the present disclosure;
fig. 2 is a second schematic structural diagram of a signal control circuit according to an embodiment of the present disclosure;
fig. 3 is a third schematic structural diagram of a signal control circuit according to an embodiment of the present disclosure;
fig. 4 is a fourth schematic structural diagram of a signal control circuit according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an image sensor provided in an embodiment of the present application;
FIG. 6 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
FIG. 7 is a flowchart illustrating an image processing method according to an embodiment of the present disclosure;
fig. 8 is a second flowchart of an image processing method according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
fig. 10 is a second schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 11 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/", and generally means that the former and latter related objects are in an "or" relationship.
The signal control circuit, the image sensor, the electronic device, and the image processing method provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings and application scenarios thereof.
Fig. 1 shows a schematic diagram of a possible structure of a signal control circuit provided in an embodiment of the present application, where as shown in fig. 1, the signal control circuit includes: a light sensing unit PD1, the first end of the light sensing unit PD1 is grounded; the first control module 10, the first control module 10 is connected to the second end of the light sensing unit PD1, and the first control module 10 is configured to adjust a signal voltage corresponding to the light sensing unit PD 1; and a second control module 11, wherein the second control module 11 is connected to the first control module 10, the second control module 11 is further connected to an output end of the signal control circuit, and the second control module 11 is configured to adjust the conversion gain. The conversion gain is used to indicate a gain for converting the signal voltage corresponding to the first control module 10 into the output voltage.
Optionally, in this embodiment of the application, the photosensitive unit PD1 may include at least one photosensitive unit, and the photosensitive unit PD1 may specifically be a photodiode.
It is understood that, when the photo unit PD1 is exposed, the photo unit PD1 may generate electrons and holes according to the optical signal, wherein the electrons may move to the N region of the photo unit PD1 and the holes may move to the P region of the photo unit PD1, so that the photo unit PD1 may generate and output charges to output the signal voltage.
Alternatively, in the embodiment of the present application, in conjunction with fig. 1, the cathode electrode of the photo sensing unit PD1 may be grounded, and the anode electrode of the photo sensing unit PD1 (i.e., the second end of the photo sensing unit PD 1) may be connected to the first control module 10 through the switch tube TX1, so that the signal voltage generated by the photo sensing unit PD1 may enter the first control module 10.
In the embodiment of the present application, the first control module 10 is configured to adjust the signal voltage corresponding to the light sensing unit PD 1.
Note that, the above "signal voltage corresponding to the photosensitive cell PD 1" can be understood as: when the light sensing unit PD1 performs exposure, the light sensing unit PD1 generates and outputs a signal voltage.
Optionally, in this embodiment of the present application, the first control module 10 includes N switching transistors and N capacitors, where each capacitor in the N capacitors is connected to the light sensing unit PD1 through one switching transistor in the N switching transistors, and N is a positive integer greater than 1.
Further optionally, in this embodiment of the application, each of the N switching tubes may be: a metal-oxide-semiconductor field effect transistor (mos) tube.
Further optionally, in this embodiment of the application, each capacitor of the N capacitors may be regarded as a charge storage capacitor.
It should be noted that, for the number of at least N capacitors, a person skilled in the art may select the number according to the size requirement of the signal control circuit, and the embodiment of the present application does not limit this.
Optionally, in this embodiment of the application, the capacitance value of each of the N capacitors may be the same or different.
For example, assuming that at least N capacitors include a capacitor 1, a capacitor 2, and a capacitor 3, the capacitance values of the N capacitors may be the same, for example, the capacitance value of the capacitor 1 may be a, the capacitance value of the capacitor 2 may be a, the capacitance value of the capacitor 3 may be a, and the ratio of the capacitance values of the capacitor 1, the capacitor 2, and the capacitor 3 may be 1:1: 1.
For another example, assuming that the N capacitors include a capacitor 1, a capacitor 2, and a capacitor 3, the capacitance values of the N capacitors may be different, for example, the capacitance value of the capacitor 1 may be a, the capacitance value of the capacitor 2 may be 2a, and the capacitance value of the capacitor 3 may be 4a, and the ratio of the capacitance values of the capacitor 1, the capacitor 2, and the capacitor 3 may be 1:2: 4.
Alternatively, in this embodiment, N capacitors may be connected in parallel, and the second terminal of each capacitor of the N capacitors may be grounded, and the first terminal of each capacitor of the N capacitors may be connected to the second terminal of the light sensing unit PD1 through a switch tube.
Optionally, in this embodiment of the application, the first control module 10 may determine a target signal voltage, determine P target capacitors from the N capacitors according to the target signal voltage, then control the switching tubes connected to the first ends of the P target capacitors to be in an on state, and control the switching tubes connected to the first ends of the other capacitors (that is, the capacitors except the P target capacitors in the N capacitors) to be in an off state, so as to adjust the signal voltage corresponding to the light sensing unit PD 1; wherein the P target capacitances may include at least one capacitance, and P is a positive integer.
It is understood that the first control module 10 can adjust the signal voltage corresponding to the light sensing unit PD1 by adjusting the capacitance connected to the second terminal of the light sensing unit PD 1.
In the embodiment of the application, in the case that the shooting environment is a highlight environment (i.e., an environment with a luminance value greater than or equal to a preset luminance value), the target capacitor may include P1 capacitors (i.e., P1 capacitors with a number greater than or equal to a preset value), and therefore, the signal voltage output by the photosensitive unit PD1 may enter the P1 capacitors, so that the full-well capacity of the photosensitive unit PD1 may be improved, and further, the strong light signal detection capability of the photosensitive unit PD1 may be improved, so that the dynamic range of the highlight environment of the shot image may be improved.
In the embodiment of the application, in the case that the shooting environment is a low-luminance environment (i.e. an environment with a luminance value smaller than a preset luminance value), the target capacitor may include P2 capacitors (i.e. P2 capacitors with a number smaller than a preset value), and therefore, the signal voltage output by the photosensitive unit PD1 may enter the P2 capacitors, so that the signal sensing capability (sensitivity) of the photosensitive unit PD1 may be improved, and thus the signal-to-noise ratio of the low-luminance environment of the shot image may be improved.
In the embodiment of the present application, the value of P1 may be greater than the value of P2.
It can be understood that, since the capacitance value of the capacitor is inversely proportional to the voltage under the condition of fixed charges, the target capacitor may include P1 capacitors, so that after the charges (i.e. signal voltages) output by the light sensing unit PD1 enter the P1 capacitors, the P1 capacitors may amplify the signal voltages, and thus, the signal sensing capability of the light sensing unit PD1 may be improved.
In this embodiment, after the first control module 10 adjusts the signal voltage corresponding to the photo sensing unit PD1, the first control module 10 may output the signal voltage to the second control module 11, so that the signal voltage may enter the second control module 11.
In this embodiment, the second control module 11 is configured to adjust a conversion gain, where the conversion gain is used to indicate a gain for converting a signal voltage corresponding to the first control module 10 into an output voltage.
It should be noted that the above "signal voltage corresponding to the first control module 10" can be understood as: the first control module 10 adjusts the signal voltage corresponding to the photosensitive cell PD1, and then outputs the adjusted signal voltage to the second control module 11.
Optionally, in this embodiment of the application, the second control module 11 includes M switching tubes and M target source followers, each target source follower is connected to the first control module 10 through one of the M switching tubes, and M is a positive integer greater than 1.
Further optionally, in this embodiment of the application, each of the M switching tubes may be: mos tubes.
Further optionally, in this embodiment of the application, the M target source followers may include at least two target source followers. Wherein each target source follower of the M target source followers may be regarded as a voltage signal amplifier.
It should be noted that, regarding the number of the M target source followers, a person skilled in the art may select the number according to the size requirement of the signal control circuit, and the embodiment of the present application does not limit this.
Optionally, in this embodiment of the application, for each target source follower in the M target source followers, the amplification gain (gain) of one target source follower is greater than 1, and the amplification gain of the one target source follower may be the same as or different from the amplification gains of other target source followers, and the other target source followers are: and the target source followers except the target source follower in the M target source followers.
For each target source follower in the M target source followers, a target manner may be adopted for one target source follower, so that the amplification gain of the one target source follower is greater than 1.
The target mode includes at least one of: and a pixel stack (stacked pixel), wherein a target transistor is adopted, the quality of a gate oxide layer is improved, and the thickness of the gate oxide layer is reduced.
The above "pixel stack" can be understood as: the signal control circuit may be disposed below the photosensitive layer. The above "employing the target transistor" can be understood as: taking a target transistor as a target source follower, wherein the target transistor can be any one of the following: a Fin-shaped Field Effect Transistor (FinFET) -like Transistor, a P-type metal-oxide-semiconductor Field Effect Transistor (mos) tube.
Alternatively, in the embodiment of the present application, the M target source followers may be connected in series.
Optionally, in this embodiment of the application, for each target source follower in the M target source followers, the third terminal of one target source follower may be connected to one power supply, so as to supply power to the one target source follower through the one power supply.
Optionally, in this embodiment of the application, a first end of each of the M target source followers may be connected to the first control module 10 through a switch tube; the second end of the first target source follower in the M target source followers is connected with the first end of the second target source follower, the second end of the second target source follower is connected with the first end of the third target source follower, the second end of the third target source follower is connected with the first end of the fourth target source follower, and so on.
Optionally, in this embodiment of the application, the second control module 11 may determine a target conversion gain, determine Q target source followers from M target source followers according to the target conversion gain, then control the switch tube connected to the first end of the first one of the Q target source followers to be in an on state, and control the switch tube connected to the first end of the other target source followers (i.e., the target source followers, except the first target source follower, in the M target source followers) to be in an off state, so as to adjust the conversion gain; q is a positive integer.
It is understood that the second control module 11 can adjust the conversion gain by adjusting the target source follower connected to the first control module 10.
In the embodiment of the present application, under the condition that the shooting environment is a highlight environment, the Q target source followers may include Q1 target source followers (that is, the number of Q1 target source followers is less than the target source follower of the preset value), that is, the signal voltage corresponding to the first control module 10 may be amplified by the Q1 target source followers, and then the condition of overexposure of the shot image may be avoided, and therefore, the highlight environment dynamic range of the shot image may be improved.
In the embodiment of the application, when the shooting environment is a low-luminance environment, the Q target source followers may include Q2 target source followers (i.e., the number of the Q2 target source followers is greater than or equal to the preset value of the target source followers), that is, the signal voltage corresponding to the first control module 10 may be amplified by the Q2 target source followers, and therefore, the signal perception capability of the photosensitive unit PD1 may be improved, so that the signal-to-noise ratio of the low-luminance environment of the shot image may be improved.
In the embodiment of the application, the value of Q1 can be smaller than that of Q2.
In the embodiment of the application, noise introduced by amplifying the Q target source followers is less than noise introduced by analog gain (analog gain) of an ISP (analog gate), so that the signal to noise ratio of a shot image can be further improved.
In this embodiment, after the second control module 11 adjusts the conversion gain, the output end of the circuit may output a signal voltage corresponding to the second control module 11.
It should be noted that the above "signal voltage corresponding to the second control module 11" can be understood as: the second control module 11 adjusts the conversion gain of the signal voltage corresponding to the first control module 11, and then outputs the signal voltage to the output terminal.
Optionally, in this embodiment, with reference to fig. 1, the second control module 11 may be connected to the output terminal Vout of the signal control circuit through a switch transistor SET, the switch transistor SET is further connected to a first terminal of a direct current power supply DC, and a second terminal of the direct current power supply DC is grounded.
Of course, in order to further reduce the noise of the signal control circuit, a reset module may be further provided to reset the first control module 10 and the second control module 11 through the reset module, which will be illustrated below.
Optionally, in this embodiment of the application, with reference to fig. 1, as shown in fig. 2, the signal control circuit further includes: the target power supply VDD 1; a reset switch RST1, a first terminal of the reset switch RST1 being connected to the target power supply VDD1, and a second terminal of the reset switch RST1 being connected to the first control module 10 and the second control module 11, respectively.
Further optionally, in this embodiment of the application, the reset switch RST1 may specifically be: mos tubes.
In the embodiment of the present application, the target power supply VDD1 is configured to send a reset signal to the first control module 10 and the second control module 11 through the reset switch RST1 to reset the first control module 10 and the second control module 11.
Further alternatively, in the embodiment of the present application, before the exposure of the photosensitive unit PD1, the target power supply VDD1 may send a reset signal to the first control module 10 and the second control module 11 through the reset switch RST 1; alternatively, after the photo sensing unit PD1 is exposed, the switch tube TX1 may be controlled to be in an off state and the reset switch RST1 may be controlled to be in an on state, and then the target power supply VDD1 may send a reset signal to the first control module 10 and the second control module 11 through the reset switch RST 1.
Therefore, the first control module and the second control module can be reset through the target power supply, so that the noise of the first control module and the noise of the second control module can be reduced, the noise of the signal output by the signal control circuit can be reduced, and the signal-to-noise ratio of the shot image can be improved.
The signal control circuit provided by the embodiment of the application, the signal control circuit includes a photosensitive unit with a first end grounded, a first control module connected with a second end of the photosensitive unit, and a second control module connected with the first control module and an output end of the signal control circuit, wherein the first control module is used for adjusting signal voltage corresponding to the photosensitive unit, the second control module is used for adjusting conversion gain, and the conversion gain is used for indicating gain for converting the signal voltage corresponding to the first control module into output voltage, so that the signal control circuit can adjust the signal voltage corresponding to the photosensitive unit, and convert the signal voltage corresponding to the first control module into the output voltage according to the adjusted conversion gain. Because the signal control circuit adjusts the signal voltage corresponding to the photosensitive unit and converts the signal voltage corresponding to the first control module into the output voltage according to the adjusted conversion gain, the shot image with higher signal-to-noise ratio in the low-brightness environment and higher dynamic range in the high-brightness environment can be obtained without image processing through the ISP, so that more noise can be avoided when the image processing is carried out by the ISP, the image quality of the obtained shot image can be improved, and the shooting effect can be improved.
Moreover, the signal control circuit can implement the algorithm operation in the ISP in the related art in the signal control circuit, so that the noise component can be reduced, the image noise can be suppressed, the dynamic range of the captured image can be improved, and the signal-to-noise ratio of the obtained captured image can be improved, thereby improving the user experience.
The specific structures of the first control module 10 and the second control module 11 will be exemplified below, respectively.
For the first control module 10:
optionally, in this embodiment of the application, with reference to fig. 1, as shown in fig. 3, the first control module 10 includes: a first capacitor FD1, a first end of the first capacitor FD1 is grounded, and a second end of the first capacitor FD1 is connected to a second end of the photosensitive unit PD1 through a first switch tube TG 1; a second capacitor FD2, a first end of the second capacitor FD2 is grounded, and a second end of the second capacitor FD2 is connected to a second end of the photosensitive unit PD1 through a second switching tube TG 2; and a third capacitor FD3, wherein a first end of the third capacitor FD3 is grounded, and a second end of the third capacitor FD3 is connected to a second end of the photosensitive unit PD1 through a third switching tube TG 3.
Further optionally, in this embodiment of the application, the first switching tube TG1, the second switching tube TG2, and the third switching tube TG3 may be: mos tubes.
Further optionally, in this embodiment of the application, a ratio of the capacitance values of the first capacitor FD1, the second capacitor FD2, and the third capacitor FD3 may specifically be: 1:2:4.
It is understood that the first control module 10 can adjust the signal voltage corresponding to the light sensing unit PD1 to: the first signal voltage is 1 to 7 times of the first signal voltage, and the first signal voltage may be specifically a signal voltage obtained by adjusting the signal voltage corresponding to the photosensitive cell PD1 by the first control module 10 when only the first capacitor FD1 is connected to the photosensitive cell PD 1.
For example, in a case where the first switch tube TG1 is in a conducting state and the second switch tube TG2 and the third switch tube TG3 are in a blocking state, the first control module 10 may adjust the signal voltage corresponding to the light sensing unit PD1 to: 1 times the first signal voltage.
Under the condition that the first switch transistor TG1, the second switch transistor TG2, and the third switch transistor TG3 are all in a conducting state, the first control module 10 may adjust the signal voltage corresponding to the light sensing unit PD1 to: 7 times the first signal voltage.
Therefore, the signal voltage corresponding to the photosensitive unit can be adjusted through at least one of the first capacitor, the second capacitor and the third capacitor, so that a shot image with a high signal-to-noise ratio in a low-brightness environment and a high-brightness environment dynamic range can be obtained, and more capacitors are not required to be arranged, so that the size of the signal control circuit can be reduced, and the cost can be saved.
Optionally, in this embodiment of the application, with reference to fig. 3, the second end of the first capacitor FD1 is further connected to the second control module 11 through a first switch tube TG 1; the second end of the second capacitor FD2 is further connected to the second control module 11 through a second switch tube TG 2; the second end of the third capacitor FD3 is further connected to the second control module 11 through a third switching tube TG 3.
Further alternatively, in this embodiment, after the photo sensing unit PD1 outputs all the signal voltages, the switch tube TX1 may be controlled to be in a turned-off state, so that the first capacitor FD1, and/or the second capacitor FD2, and/or the third capacitor FD3 may output the signal voltage corresponding to the photo sensing unit PD1 to the second control module 11.
Therefore, the second end of the first capacitor, the second end of the second capacitor and the second end of the third capacitor can be directly connected with the second control module without arranging other circuit structures, so that the size of the signal control circuit can be reduced, and the cost can be saved.
For the second control module 11:
optionally, in this embodiment of the application, as shown in fig. 4, the second control module 11 includes: a first target source follower SF1, a first end of the first target source follower SF1 being connected to the first control module 10 through a fourth switching tube TG 4; a second target source follower SF2, a first end of the second target source follower SF2 is connected to the first control module 10 through a fifth switch tube TG5, and a first end of the second target source follower SF2 is further connected to a second end of the first target source follower SF 1; a third target source follower SF3, a first end of the third target source follower SF3 is connected to the first control module 10 through a sixth switching tube TG6, a first end of the third target source follower SF3 is further connected to a second end of the second target source follower SF2, and a second end of the third target source follower SF3 is connected to the output terminal Vout of the signal control circuit.
Further alternatively, in the embodiment of the present application, the amplification gains of the first target source follower SF1, the second target source follower SF2 and the third target source follower SF3 may be the same.
Specifically, the amplification gains of the first target source follower SF1, the second target source follower SF2 and the third target source follower SF3 may be: 1.2.
it is understood that the amplification gain of the second control module 11 may be: 1.2 to 1.73.
For example, in the case that the sixth switching transistor TG6 is in the on state, and the fourth switching transistor TG4 and the fifth switching transistor TG5 are in the off state, the amplification gain of the second control module 11 may be 1.2, that is, the signal voltage corresponding to the first control module 10 is amplified by the third target source follower SF 3.
With the fifth switching transistor TG5 in the on state and the fourth switching transistor TG4 and the sixth switching transistor TG6 in the off state, the amplification gain of the second control module 11 may be 1.44, that is, the signal voltage corresponding to the first control module 10 is amplified by the second target source follower SF2 and the third target source follower SF 3.
When the fourth switching transistor TG4 is in a conducting state and the fifth switching transistor TG5 and the sixth switching transistor TG6 are in a blocking state, the amplification gain of the second control module 11 may be 1.73, that is, the signal voltage corresponding to the first control module 10 is amplified by the first target source follower SF1, the second target source follower SF2 and the third target source follower SF 3.
Therefore, the second control module can adjust the conversion gain to amplify the signal voltage corresponding to the first control module through at least one target source follower of the first target source follower, the second target source follower and the third target source follower, so as to obtain a shot image with a high low-luminance environment signal-to-noise ratio and a high-luminance environment dynamic range, and no more target source followers need to be arranged, so that the size of the signal control circuit can be reduced, and therefore, the cost can be saved.
Fig. 5 shows a schematic diagram of a possible structure of an image sensor provided in an embodiment of the present application, and as shown in fig. 5, the image sensor 20 includes at least one signal control circuit 21 in the above embodiment.
Alternatively, in this embodiment of the present application, the image sensor 20 may include a pixel array, where the pixel array includes at least one pixel unit, and each pixel unit in the at least one pixel unit includes one signal control circuit 21 in the above embodiment.
Optionally, in this embodiment of the application, the image sensor 20 may send a control signal to the first control module and/or the second control module of a certain (or some) pixel unit of the at least one pixel unit, so that the first control module of the certain (or some) pixel unit may adjust a signal voltage corresponding to the light sensing unit, and/or the second control module of the certain (or some) pixel unit may adjust the conversion gain.
It should be noted that, for the description of the first control module adjusting the signal voltage corresponding to the light sensing unit and the second control module adjusting the conversion gain, reference may be made to the specific description in the foregoing embodiments, and details of the embodiments of the present application are not repeated herein.
The image sensor provided by the embodiment of the application comprises at least one signal control circuit in the above embodiment. Because the signal control circuit of the image sensor adjusts the signal voltage corresponding to the photosensitive unit and converts the signal voltage corresponding to the first control module into the output voltage according to the adjusted conversion gain, the shot image with high signal-to-noise ratio in the low-brightness environment and high-brightness environment dynamic range can be obtained without image processing through the ISP, so that more noise can be avoided when the image processing is carried out by the ISP, the image quality of the obtained shot image can be improved, and the shooting effect can be improved.
Fig. 6 shows a schematic diagram of a possible structure of an electronic device provided in an embodiment of the present application, and as shown in fig. 6, the electronic device 30 includes the image sensor 31 in the above embodiment.
Optionally, in this embodiment of the application, the electronic device 30 may send control information (e.g., a control matrix) to the image sensor 31, so that the image sensor 31 may send a control signal to the first control module and/or the second control module of a certain (or some) pixel unit in at least one pixel unit of the image sensor 31 according to the control matrix, so that the first control module of the certain (or some) pixel unit may adjust a signal voltage corresponding to the light sensing unit, and/or the second control module of the certain (or some) pixel unit may adjust the conversion gain.
It should be noted that, for the description of the first control module of the image sensor 31 adjusting the signal voltage corresponding to the light sensing unit and the second control module adjusting the conversion gain, reference may be made to the detailed description in the foregoing embodiments, and details of the embodiments of the present application are not repeated herein.
The electronic device provided by the embodiment of the application comprises the image sensor in the embodiment. Because the signal control circuit of the image sensor of the electronic equipment adjusts the signal voltage corresponding to the photosensitive unit and converts the signal voltage corresponding to the first control module into the output voltage according to the adjusted conversion gain, the shot image with high signal-to-noise ratio in the low-brightness environment and high-brightness environment dynamic range can be obtained without image processing through the ISP, therefore, more noise can be avoided when the image processing is carried out by the ISP, the image quality of the obtained shot image can be improved, and the shooting effect can be improved.
Fig. 7 shows a flowchart of an image processing method provided in an embodiment of the present application, which is applied to the electronic device in the above embodiment. As shown in fig. 7, the image processing method provided in the embodiment of the present application may include steps 101 to 104 described below.
Step 101, the electronic device acquires a preview image through an image sensor of the electronic device.
Optionally, in this embodiment of the application, under the condition of the target application of the electronic device, the electronic device may display a shooting preview interface, and acquire a preview image through an image sensor.
Wherein the target application may be any one of: a shooting type application, a chat type application, a short video interaction type application, etc.
In an embodiment of the present application, the preview image includes N image areas, where luminance parameters of each of the N image areas are different, each of the N image areas corresponds to a photosensitive area of the image sensor, and N is a positive integer.
Optionally, in this embodiment of the application, the brightness parameter may specifically be a brightness value.
Optionally, in this embodiment of the application, after the electronic device acquires the preview image, the electronic device may acquire the luminance parameters of all pixels of the preview image, and divide the preview image into N image areas according to the luminance parameters of all pixels.
Optionally, in this embodiment of the present application, with reference to fig. 7, as shown in fig. 8, after step 101 described above, the image processing method provided in this embodiment of the present application may further include step 201 and step 202 described below.
Step 201, the electronic device performs graying processing on the preview image to obtain a first image.
It should be noted that, for the description of the "graying processing", reference may be made to specific descriptions in the related art, and details of the embodiments of the present application are not repeated herein.
It is understood that the first image is a grayscale image.
Step 202, the electronic device determines N image regions based on the brightness parameter of each pixel point in the first image.
Further optionally, in this embodiment of the application, the first image includes M pixel points, where M is a positive integer greater than 1. It can be understood that the M pixel points may be all pixel points of the first image.
Further optionally, in this embodiment, the electronic device may divide the M pixel points into N groups of pixel points according to X preset luminance ranges, determine image regions where the N groups of pixel points are located as N regions, and determine the N image regions according to the N regions.
Specifically, the X preset luminance ranges may be continuous luminance ranges; each of the N regions corresponds to an image region where a group of pixel points are located; the N image areas correspond to the N areas one by one.
The "continuous luminance range" may be understood as follows: the X preset brightness ranges are not overlapped, the maximum boundary value of any one preset brightness range is adjacent to the minimum boundary value of one preset brightness range in the X preset brightness ranges, and the minimum boundary value of any one preset brightness range is adjacent to the maximum boundary value of the other preset brightness range in the X preset brightness ranges.
Illustratively, the X preset luminance ranges include: the luminance range includes a preset luminance range 1, a preset luminance range 2, and a preset luminance range 3, where the preset luminance range 1 is [20, 50], the preset luminance range 2 is (50, 120), and the preset luminance range 3 is (120, 200), that is, the preset luminance range 1, the preset luminance range 2, and the preset luminance range 3 are continuous luminance ranges.
Specifically, the brightness values of each of the N groups of pixel points are respectively within a preset brightness range, and X is a positive integer greater than or equal to N.
Specifically, the electronic device can obtain the brightness values of the M pixel points, and divide the M pixel points into N groups of pixel points according to the brightness values of the M pixel points and the X preset brightness ranges.
In an example, when X is greater than N, the electronic device may determine N preset luminance ranges from X preset luminance ranges according to luminance values of the M pixel points, and then perform grouping processing on the luminance values of the M pixel points according to the N preset luminance ranges to obtain N groups of pixel points.
It can be understood that the brightness values of the M pixel points are within N preset brightness ranges.
In another example, when X is equal to N, the electronic device may directly perform grouping processing on the luminance values of M pixel points according to N preset luminance ranges to obtain N groups of pixel points.
Specifically, the electronic device may respectively obtain position information of pixels in each of the N groups of pixels, and then determine an area according to the position information of the pixels in each of the groups of pixels, so as to determine the N areas.
Specifically, in this embodiment of the application, the electronic device may map the N regions one by one onto the preview image according to the position information of each of the N regions, so as to determine the N image regions.
Therefore, since the electronic device can perform graying processing on the preview image to obtain the first image, and the brightness parameters of the regions in the first image are different, the electronic device can accurately determine the N image regions of the preview image based on the brightness parameter of each pixel point in the first image.
Step 102, the electronic device respectively adjusts output voltages of the signal control circuits corresponding to the N photosensitive areas based on the brightness parameters of the N image areas.
Optionally, in this embodiment of the application, the output voltage may be adjusted by the first control module or the second control module, and the electronic device may respectively adjust the output voltages of the signal control circuits corresponding to the N photosensitive regions by using N target signal voltages (obtained by adjustment by the first control module) and N target conversion gains (obtained by adjustment by the second control module), where the N target signal voltages correspond to the N photosensitive regions one to one, and the N target conversion gains correspond to the N photosensitive regions one to one.
The N target signal voltages and the N target conversion gains may be determined according to N image regions, the N image regions corresponding to the N target signal voltages one to one, and the N image regions corresponding to the N target conversion gains one to one.
Further optionally, in this embodiment of the application, for each photosensitive region of the N photosensitive regions, the electronic device may adjust a signal voltage of a signal control circuit corresponding to one photosensitive region (i.e., a signal voltage corresponding to a photosensitive cell) to be a target signal voltage, and adjust a conversion gain of the signal control circuit corresponding to the one photosensitive region to be a target conversion gain.
Optionally, in this embodiment of the application, the electronic device may send a control matrix to the image sensor, where the control matrix includes N sets of parameters, and each set of parameters is respectively used to adjust an output voltage of a signal control circuit corresponding to one photosensitive region of the image sensor, so that the image sensor may respectively adjust states of switching tubes of the signal control circuits corresponding to the N photosensitive regions according to the N sets of parameters, so as to respectively adjust output voltages of the signal control circuits corresponding to the N photosensitive regions.
Further optionally, in this embodiment of the application, after the electronic device determines N target signal voltages and N target conversion gains according to the N image regions, the electronic device may generate a control matrix according to the position information of the N image regions, the N target signal voltages, and the N target conversion gains, so that the electronic device may send the control matrix to the image sensor.
Optionally, in this embodiment of the application, after the output voltages of the signal control circuits corresponding to the N photosensitive regions are adjusted, the signal voltage and the conversion gain of the signal control circuit corresponding to each photosensitive region in the N photosensitive regions may be different.
And 103, acquiring N groups of image data by the electronic equipment through the adjusted signal control circuits corresponding to the N photosensitive areas.
In the embodiment of the present application, the N sets of image data correspond to the N photosensitive regions one to one.
Optionally, in this embodiment of the application, the electronic device may control the image sensor to perform exposure, so that the light sensing unit of the signal control circuit corresponding to each light sensing area in the N light sensing areas may output a signal voltage, and thus the first control module of the signal control circuit corresponding to each light sensing area may adjust the signal voltage corresponding to the light sensing unit, so that the second control module of the signal control circuit corresponding to each light sensing area may adjust the conversion gain, and output a signal voltage corresponding to the second control module, so as to obtain N sets of image data.
And step 104, the electronic equipment obtains a target image according to the N groups of image data.
Optionally, in this embodiment of the application, the electronic device may send the N sets of image data to the ISP, so that the ISP may perform algorithm processing on the N sets of image data to obtain the target image.
Optionally, in this embodiment of the application, after obtaining the target image, the electronic device may store the target image to a preset storage area, for example, a storage area corresponding to an album.
In this embodiment of the application, since there may be areas with different brightness parameters (e.g., low-brightness environment areas, high-brightness environment areas, etc.) in a captured image obtained by capturing, an electronic device may first acquire a preview image through an image sensor to determine different image areas (i.e., N image areas) corresponding to different brightness parameters of the preview image, and then adjust output voltages of signal control circuits corresponding to different photosensitive areas corresponding to the different image areas to adjust strong light signal detection capabilities or signal sensing capabilities of the different photosensitive areas, and acquire N sets of image data through signal control circuits corresponding to the adjusted different photosensitive areas, so that the electronic device may obtain a target image according to the N sets of image data.
In the image processing method provided in the embodiment of the application, the electronic device may first acquire, through an image sensor of the electronic device, a preview image including N image areas (each image area has a different brightness parameter, and each image area corresponds to one photosensitive area of the image sensor), and adjust output voltages of signal control circuits corresponding to the N photosensitive areas, respectively, based on the brightness parameters of the N image areas, and acquire N sets of image data (the N sets of image data correspond to the N photosensitive areas one to one), so that the electronic device may obtain a target image according to the N sets of image data. Because the electronic device can obtain the shot image with higher dynamic ranges of the low-brightness environment and the high-brightness environment without image processing through the ISP (internet service provider) by determining different image areas (namely N image areas) corresponding to different brightness parameters of the preview image and adjusting the output voltages of the signal control circuits of different photosensitive areas corresponding to the different image areas based on the brightness parameters of the different image areas, more noise can be prevented from being introduced when the ISP performs image processing, the image quality of the obtained shot image can be improved, and the shooting effect of the electronic device can be improved.
An example of how the electronic device adjusts the output voltages of the signal control circuits corresponding to the N photosensitive regions will be described below.
Alternatively, in this embodiment of the application, the step 102 may be specifically implemented by the following step 102a and step 102 b.
Step 102a, the electronic device determines a target signal voltage and a target conversion gain of a signal control circuit corresponding to a target photosensitive area in the N photosensitive areas according to a brightness parameter of the target image area in the N image areas.
It is to be understood that the target image area may specifically be: any one of the N image areas.
In the embodiment of the present application, the target image area corresponds to a target photosensitive area. It is understood that the target image area is captured by the signal control circuit corresponding to the target photosensitive area.
Further optionally, in this embodiment of the application, the electronic device may determine, according to the luminance values of the pixel points in the target image region, a target luminance range from the X preset luminance ranges, and then determine, from the T corresponding relationships, a target signal voltage and a target conversion gain corresponding to the target luminance range.
The brightness values of the pixel points of the target image area are all located in a target brightness range; each of the T correspondences is a correspondence between a luminance range and a signal voltage and a conversion gain.
Specifically, the electronic device may determine one luminance range that is the same as the target luminance range from among T luminance ranges in the T correspondence relationships, and determine one signal voltage and one conversion gain corresponding to the one luminance range as the target signal voltage and the target conversion gain.
Exemplarily, assuming that the target brightness range is [20, 50], that is, the target image area is a low-brightness environment area, the signal voltage corresponding to the target brightness range is a signal voltage 1 time of the first signal voltage, and the conversion gain corresponding to the target brightness range is 1.73, the electronic device may determine the signal voltage 1 time of the signal voltage as the target signal voltage, and determine 1.73 as the target conversion gain, at this time, the signal sensing capability of the light sensing unit of the signal control circuit corresponding to the target image area is the maximum, and therefore, the signal-to-noise ratio and the dynamic range of the obtained captured image are both high.
Further exemplarily, assuming that the target luminance range is (50, 120], that is, the target image area is a medium-bright environment area, the signal voltage corresponding to the target luminance range is a signal voltage 4 times as large as the first signal voltage, and the conversion gain corresponding to the target luminance range is 1.44, the electronic device may determine the signal voltage 4 times as large as the signal voltage as the target signal voltage, and determine 1.44 as the target conversion gain, at this time, the light sensing unit of the signal control circuit corresponding to the target image area has a large strong light signal detection capability and a large signal sensing capability, and therefore, the signal-to-noise ratio and the dynamic range of the obtained captured image are both high.
Further exemplarily, assuming that the target luminance range is (120, 200), that is, the target image area is a highlight environment area, the signal voltage corresponding to the target luminance range is 7 times the signal voltage of the first signal voltage, and the conversion gain corresponding to the target luminance range is 1.2, the electronic device may determine the signal voltage 7 times the signal voltage as the target signal voltage, and determine 1.2 as the target conversion gain, at this time, the highlight signal detection capability of all the signal control circuits is the maximum, and the signal perception capability is the minimum, so that the signal-to-noise ratio and the dynamic range of the obtained captured image are both high.
And step 102b, the electronic equipment determines the capacitance of the signal control circuit and the target source follower corresponding to the target photosensitive area based on the target signal voltage and the target conversion gain.
It is understood that the electronic device may determine, based on the target signal voltage and the target conversion gain, a capacitance connected to the second terminal of the light sensing unit among N capacitances of the signal control circuit corresponding to the target light sensing region, and a target source follower connected to the first control module among M target source followers of the signal control circuit corresponding to the target light sensing region.
Further optionally, in this embodiment of the application, the electronic device may determine, according to a voltage value of the target signal voltage, a target capacitor from the N capacitors to determine a capacitor of the signal control circuit corresponding to the target photosensitive region, and determine, according to a gain value of the target conversion gain, Q target source followers from the M target source followers to determine a target source follower of the signal control circuit corresponding to the target photosensitive region.
Further alternatively, in the embodiment of the present application, after determining the capacitance of the signal control circuit and the target source follower corresponding to the target photosensitive area, the electronic device can control the switch tube of the signal control circuit corresponding to the target photosensitive area and connected with the first end of the target capacitor to be in a conducting state, and controls the switch tube connected with the first end of other capacitors (namely the capacitors except the target capacitor) to be in a cut-off state, and controlling a switching tube connected with a first end of a first target source follower in the Q target source followers to be in a conducting state, and controlling a switching tube connected with the first end of other target source followers (namely, the target source followers except the first target source follower in the Q target source followers) to be in a cut-off state so as to adjust the output voltage of the signal control circuit corresponding to the target photosensitive region.
It is understood that the electronic device may adjust the signal voltage of the signal control circuit corresponding to the target photosensitive region to the target signal voltage, and adjust the conversion gain of the signal control circuit corresponding to the target photosensitive region to the target conversion gain.
Therefore, because the electronic device determines the target signal voltage and the target conversion gain of the signal control circuit corresponding to the photosensitive region corresponding to the target image region according to the brightness parameter of the target image region, and determines the capacitance and the target source follower of the signal control circuit corresponding to the photosensitive region corresponding to the target image region based on the target signal voltage and the target conversion gain, the electronic device can adjust the output voltage of the signal control circuit corresponding to the target photosensitive region based on the target signal voltage and the target conversion gain to obtain a shot image with a high low-luminance environment signal-to-noise ratio and a high-luminance environment dynamic range, without performing image processing through an ISP, and therefore, introduction of more noise during image processing through the ISP can be avoided.
In the image processing method provided by the embodiment of the application, the execution main body can be an image processing device. In the embodiment of the present application, an image processing apparatus executing an image processing method is taken as an example, and the image processing apparatus provided in the embodiment of the present application is described.
Fig. 9 is a schematic diagram showing a possible configuration of the image processing apparatus according to the embodiment of the present application. As shown in fig. 9, the image processing apparatus 60 includes: an acquiring module 61, where the acquiring module 61 is configured to acquire a preview image through an image sensor of the image processing apparatus 60, where the preview image includes N image areas, brightness parameters of each image area are different, each image area corresponds to a photosensitive area of the image sensor, and N is a positive integer greater than 1. And an adjusting module 62, where the adjusting module 62 is configured to adjust output voltages of the signal control circuits corresponding to the N photosensitive areas respectively based on the brightness parameters of the N image areas. The acquisition module 61 is further configured to acquire N sets of image data through the signal control circuit corresponding to the N photosensitive areas adjusted by the adjustment module 62, where the N sets of image data correspond to the N photosensitive areas one to one. And the processing module 63, wherein the processing module 63 is configured to obtain a target image according to the N groups of image data acquired by the acquisition module 61.
In a possible implementation manner, the processing module 63 is further configured to perform graying processing on the preview image to obtain a first image; and determining N image areas based on the brightness parameter of each pixel point in the first image.
In a possible implementation manner, the adjusting module 62 is specifically configured to determine a target signal voltage and a target conversion gain of a signal control circuit corresponding to a target photosensitive area in N photosensitive areas according to a brightness parameter of the target image area in the N image areas; and determining a capacitance of a signal control circuit and a target source follower corresponding to the target photosensitive region based on the target signal voltage and the target conversion gain.
According to the image processing device provided by the embodiment of the application, the image processing device can obtain the shot image with high low-brightness environment signal-to-noise ratio and high-brightness environment dynamic range by determining the different image areas (namely N image areas) corresponding to the different brightness parameters of the preview image and adjusting the output voltages of the signal control circuits of the different photosensitive areas corresponding to the different image areas based on the brightness parameters of the different image areas, and the image processing is not required to be performed through an ISP (internet service provider), so that more noise can be prevented from being introduced when the ISP performs the image processing, the quality of the obtained shot image can be improved, and the shooting effect of the image processing device can be improved.
The image processing apparatus in the embodiment of the present application may be an electronic device, or may be a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be a device other than a terminal. The electronic device may be, for example, a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an Augmented Reality (AR)/Virtual Reality (VR) device, a robot, a wearable device, a super-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and may also be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, or the like, and the embodiments of the present application are not limited in particular.
The image processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
The image processing apparatus provided in the embodiment of the present application can implement each process implemented in the method embodiments of fig. 7 and fig. 8, achieve the same technical effect, and is not described here again to avoid repetition.
Optionally, in this embodiment, as shown in fig. 10, an electronic device 80 is further provided in this embodiment, and includes a processor 81 and a memory 82, where the memory 82 stores a program or an instruction that can be executed on the processor 81, and when the program or the instruction is executed by the processor 81, the steps of the image processing method in this embodiment are implemented, and the same technical effect can be achieved, and are not described again here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 11 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 100 includes, but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.
Those skilled in the art will appreciate that the electronic device 100 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
The electronic device 100 may further include a signal control circuit including: the first end of the photosensitive unit is grounded; the first control module is connected with the second end of the photosensitive unit and used for adjusting the signal voltage corresponding to the photosensitive unit; the second control module is connected with the first control module, is also connected with the output end of the signal control circuit, and is used for adjusting conversion gain; the conversion gain is used for indicating the gain for converting the signal voltage corresponding to the first control module into the output voltage.
Optionally, in this embodiment of the application, the first control module of the signal control circuit includes N switching tubes and N capacitors, each capacitor is connected to the light sensing unit through one of the N switching tubes, and N is a positive integer greater than 1; the second control module comprises M switching tubes and M target source electrode followers, each target source electrode follower is connected with the first control module through one of the M switching tubes, and M is a positive integer larger than 1.
Optionally, in this embodiment of the present application, the first control module includes: the first end of the first capacitor is grounded, and the second end of the first capacitor is connected with the second end of the photosensitive unit through a first switching tube; a first end of the second capacitor is grounded, and a second end of the second capacitor is connected with a second end of the photosensitive unit through a second switching tube; and a first end of the third capacitor is grounded, and a second end of the third capacitor is connected with the second end of the photosensitive unit through a third switching tube.
Optionally, in this embodiment of the application, the second end of the first capacitor is further connected to the second control module through the first switching tube; the second end of the second capacitor is also connected with the second control module through the second switch tube; the second end of the third capacitor is also connected with the second control module through the third switching tube.
Optionally, in this embodiment of the present application, the second control module includes: the first end of the first target source electrode follower is connected with the first control module through a fourth switching tube;
a first end of the second target source follower is connected with the first control module through a fifth switching tube, and the first end of the second target source follower is also connected with a second end of the first target source follower; and the first end of the third target source follower is connected with the first control module through a sixth switching tube, the first end of the third target source follower is also connected with the second end of the second target source follower, and the second end of the third target source follower is connected with the output end of the signal control circuit.
Optionally, in this embodiment of the present application, the signal control circuit further includes: a target power supply; a first end of the reset switch is connected with the target power supply, and a second end of the reset switch is respectively connected with the first control module and the second control module; the target power supply is used for sending reset signals to the first control module and the second control module through the reset switch so as to reset the first control module and the second control module.
The electronic device structure shown in fig. 11 does not constitute a limitation to the electronic device, and the electronic device may include more or less components than those shown in the drawings, or combine some components, or arrange different components, and thus, the description is omitted here.
The processor 110 is configured to acquire a preview image through an image sensor of the electronic device, where the preview image includes N image areas, brightness parameters of each image area are different, each image area corresponds to a photosensitive area of the image sensor, and N is a positive integer greater than 1; respectively adjusting output voltages of signal control circuits corresponding to the N photosensitive areas based on the brightness parameters of the N image areas; acquiring N groups of image data through the adjusted signal control circuits corresponding to the N photosensitive areas, wherein the N groups of image data correspond to the N photosensitive areas one by one; and obtaining a target image according to the N groups of image data.
According to the electronic device provided by the embodiment of the application, because the electronic device can adjust the output voltages of the signal control circuits of the different photosensitive areas corresponding to the different brightness parameters of the preview image by determining the different image areas (namely, the N image areas) corresponding to the different brightness parameters of the preview image and based on the brightness parameters of the different image areas, a shot image with a high dynamic range of a low-brightness environment and a high-brightness environment can be obtained, and image processing by an ISP is not needed, therefore, more noise can be prevented from being introduced when the ISP performs image processing, the quality of the obtained shot image can be improved, and thus, the shooting effect of the electronic device can be improved.
Optionally, in this embodiment of the application, the processor 110 is further configured to perform graying processing on the preview image to obtain a first image; and determining N image areas based on the brightness parameter of each pixel point in the first image.
Therefore, since the electronic device can perform graying processing on the preview image to obtain the first image, and the brightness parameters of the regions in the first image are different, the electronic device can accurately determine the N image regions of the preview image based on the brightness parameter of each pixel point in the first image.
Optionally, in this embodiment of the present application, the processor 110 is specifically configured to determine, according to a luminance parameter of a target image area in the N image areas, a target signal voltage and a target conversion gain of a signal control circuit corresponding to the target photosensitive area in the N photosensitive areas, where the target image area corresponds to the target photosensitive area; and determining a capacitance of a signal control circuit and a target source follower corresponding to the target photosensitive region based on the target signal voltage and the target conversion gain.
Therefore, because the electronic device determines the target signal voltage and the target conversion gain of the signal control circuit corresponding to the photosensitive region corresponding to the target image region according to the brightness parameter of the target image region, and determines the capacitance and the target source follower of the signal control circuit corresponding to the photosensitive region corresponding to the target image region based on the target signal voltage and the target conversion gain, the electronic device can adjust the output voltage of the signal control circuit corresponding to the target photosensitive region based on the target signal voltage and the target conversion gain to obtain a shot image with a high low-luminance environment signal-to-noise ratio and a high-luminance environment dynamic range, without performing image processing through an ISP, and therefore, introduction of more noise during image processing through the ISP can be avoided.
It should be understood that, in the embodiment of the present application, the input unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 processes image data of a still picture or a video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a first storage area storing a program or an instruction and a second storage area storing data, wherein the first storage area may store an operating system, an application program or an instruction (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, memory 109 may include volatile memory or non-volatile memory, or memory 109 may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. Volatile memory may be Random Access Memory (RAM), static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous DRAM (ddr SDRAM), enhanced synchronous SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and direct bus RAM (DRRAM). Memory 109 in the embodiments of the subject application includes, but is not limited to, these and any other suitable types of memory.
Processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor, which primarily handles operations involving the operating system, user interface, and applications, etc., and a modem processor, which primarily handles wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read only memory ROM, a random access memory RAM, a magnetic or optical disk, and the like.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
Embodiments of the present application provide a computer program product, where the program product is stored in a storage medium, and the program product is executed by at least one processor to implement the processes of the foregoing embodiments of the image processing method, and achieve the same technical effects, and in order to avoid repetition, details are not repeated here.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application or portions thereof that contribute to the prior art may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes several instructions for enabling a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the method of the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (16)

1. A signal control circuit, comprising:
the first end of the photosensitive unit is grounded;
the first control module is connected with the second end of the photosensitive unit and used for adjusting the signal voltage corresponding to the photosensitive unit;
the second control module is connected with the first control module, is also connected with the output end of the signal control circuit, and is used for adjusting conversion gain;
the conversion gain is used for indicating the gain for converting the signal voltage corresponding to the first control module into the output voltage.
2. The signal control circuit of claim 1,
the first control module comprises N switching tubes and N capacitors, each capacitor is connected with the photosensitive unit through one of the N switching tubes, and N is a positive integer greater than 1;
the second control module comprises M switching tubes and M target source electrode followers, each target source electrode follower is connected with the first control module through one of the M switching tubes, and M is a positive integer greater than 1.
3. The signal control circuit of claim 1, wherein the first control module comprises:
a first end of the first capacitor is grounded, and a second end of the first capacitor is connected with a second end of the photosensitive unit through a first switching tube;
a first end of the second capacitor is grounded, and a second end of the second capacitor is connected with a second end of the photosensitive unit through a second switching tube;
and the first end of the third capacitor is grounded, and the second end of the third capacitor is connected with the second end of the photosensitive unit through a third switching tube.
4. The signal control circuit of claim 2, wherein the second end of the first capacitor is further connected to the second control module through the first switching tube; the second end of the second capacitor is also connected with the second control module through the second switching tube; and the second end of the third capacitor is also connected with the second control module through the third switching tube.
5. The signal control circuit of claim 1, wherein the second control module comprises:
a first target source follower, a first end of which is connected with the first control module through a fourth switch tube;
a first end of the second target source follower is connected with the first control module through a fifth switching tube, and the first end of the second target source follower is also connected with a second end of the first target source follower;
and the first end of the third target source electrode follower is connected with the first control module through a sixth switching tube, the first end of the third target source electrode follower is also connected with the second end of the second target source electrode follower, and the second end of the third target source electrode follower is connected with the output end of the signal control circuit.
6. The signal control circuit of claim 1, further comprising:
a target power supply;
a first end of the reset switch is connected with the target power supply, and a second end of the reset switch is respectively connected with the first control module and the second control module;
the target power supply is used for sending reset signals to the first control module and the second control module through the reset switch so as to reset the first control module and the second control module.
7. An image sensor comprising at least one signal control circuit as claimed in any one of claims 1 to 6.
8. An electronic device, characterized in that the electronic device comprises an image sensor as claimed in claim 7.
9. An image processing method applied to the electronic device according to claim 8, the method comprising:
acquiring a preview image through an image sensor of the electronic device, wherein the preview image comprises N image areas, the brightness parameters of the image areas are different, each image area corresponds to a photosensitive area of the image sensor, and N is a positive integer greater than 1;
respectively adjusting output voltages of signal control circuits corresponding to the N photosensitive areas based on brightness parameters of the N image areas;
acquiring N groups of image data through the adjusted signal control circuits corresponding to the N photosensitive areas, wherein the N groups of image data correspond to the N photosensitive areas one by one;
and obtaining a target image according to the N groups of image data.
10. The method of claim 9, wherein after the capturing of the preview image by the image sensor of the electronic device, the method further comprises:
carrying out graying processing on the preview image to obtain a first image;
and determining N image areas based on the brightness parameter of each pixel point in the first image.
11. The method of claim 9, wherein the adjusting the output voltages of the signal control circuits corresponding to the N photosensitive regions based on the brightness parameters of the N image regions respectively comprises:
determining target signal voltage and target conversion gain of a signal control circuit corresponding to a target photosensitive area in N photosensitive areas according to brightness parameters of the target image area in the N image areas, wherein the target image area corresponds to the target photosensitive area;
and determining a capacitance of a signal control circuit and a target source follower corresponding to the target photosensitive area based on the target signal voltage and the target conversion gain.
12. An image processing apparatus characterized by comprising:
the image processing device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a preview image through an image sensor of the image processing device, the preview image comprises N image areas, the brightness parameters of the image areas are different, each image area corresponds to a photosensitive area of the image sensor, and N is a positive integer greater than 1;
the adjusting module is used for respectively adjusting the output voltages of the signal control circuits corresponding to the N photosensitive areas based on the brightness parameters of the N image areas;
the acquisition module is further used for acquiring N groups of image data through the signal control circuits corresponding to the N photosensitive areas after the adjustment of the adjustment module, wherein the N groups of image data correspond to the N photosensitive areas one by one;
and the processing module is used for obtaining a target image according to the N groups of image data acquired by the acquisition module.
13. The image processing apparatus according to claim 12, wherein the processing module is further configured to perform a graying process on the preview image to obtain a first image; and determining N image regions based on the brightness parameter of each pixel point in the first image.
14. The image processing apparatus according to claim 12, wherein the adjusting module is specifically configured to determine a target signal voltage and a target conversion gain of a signal control circuit corresponding to a target photosensitive area in the N photosensitive areas according to a brightness parameter of the target image area in the N image areas; and determining a capacitance of a signal control circuit and a target source follower corresponding to the target photosensitive area based on the target signal voltage and the target conversion gain.
15. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions when executed by the processor implementing the steps of the image processing method of any of claims 9 to 11.
16. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the image processing method according to any one of claims 9 to 11.
CN202210731452.1A 2022-06-24 2022-06-24 Signal control circuit, image sensor, electronic device, and image processing method Pending CN115118891A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210731452.1A CN115118891A (en) 2022-06-24 2022-06-24 Signal control circuit, image sensor, electronic device, and image processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210731452.1A CN115118891A (en) 2022-06-24 2022-06-24 Signal control circuit, image sensor, electronic device, and image processing method

Publications (1)

Publication Number Publication Date
CN115118891A true CN115118891A (en) 2022-09-27

Family

ID=83330528

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210731452.1A Pending CN115118891A (en) 2022-06-24 2022-06-24 Signal control circuit, image sensor, electronic device, and image processing method

Country Status (1)

Country Link
CN (1) CN115118891A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130048831A1 (en) * 2011-08-30 2013-02-28 Omnivision Technologies, Inc. Multilevel reset voltage for multi-conversion gain image sensor
CN104580945A (en) * 2014-12-29 2015-04-29 上海集成电路研发中心有限公司 Image sensor structure and method for achieving high-dynamic-range image
CN106057840A (en) * 2015-04-02 2016-10-26 松下知识产权经营株式会社 Imaging device
US20200195870A1 (en) * 2018-12-18 2020-06-18 Samsung Electronics Co., Ltd. Image sensor with controllable conversion gain

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130048831A1 (en) * 2011-08-30 2013-02-28 Omnivision Technologies, Inc. Multilevel reset voltage for multi-conversion gain image sensor
CN104580945A (en) * 2014-12-29 2015-04-29 上海集成电路研发中心有限公司 Image sensor structure and method for achieving high-dynamic-range image
CN106057840A (en) * 2015-04-02 2016-10-26 松下知识产权经营株式会社 Imaging device
US20200195870A1 (en) * 2018-12-18 2020-06-18 Samsung Electronics Co., Ltd. Image sensor with controllable conversion gain
CN111343396A (en) * 2018-12-18 2020-06-26 三星电子株式会社 Image sensor with controllable conversion gain

Similar Documents

Publication Publication Date Title
US8629935B2 (en) Solid-state imaging device and imaging apparatus
US7586523B2 (en) Amplification-type CMOS image sensor of wide dynamic range
US11336844B2 (en) Imaging device, imaging system, and movable object
US20080211948A1 (en) Photoelectric conversion apparatus and image sensing system using the same
US20150319384A1 (en) Solid-state imaging device and method of driving the same
JP2017005435A (en) Imaging apparatus and signal processing circuit
US20150062364A1 (en) Imaging Systems and Methods for Image Signal Gain Adjustment
JP2003018471A (en) Solid-state imaging apparatus
CN109889712B (en) Pixel circuit, image sensor, terminal equipment and signal control method
CN112492227A (en) Exposure method, camera module and electronic equipment
CN115278058A (en) Image acquisition method and device, electronic equipment and storage medium
CN113571538A (en) Pixel structure, image sensor, control method and device and electronic equipment
CN115633265A (en) Photosensitive pixel structure, image sensor and electronic device
US10348991B2 (en) Solid-state image pickup device with load transistors, method for controlling the same, and electronic apparatus
JP2022075568A (en) Integrated video sensor with internal feedback and operating method for the same
US11272135B2 (en) Methods of operating image sensors and image sensors performing the same
CN115118891A (en) Signal control circuit, image sensor, electronic device, and image processing method
CN113301261B (en) Pixel processing circuit, method and device and electronic equipment
JP2017092554A (en) Solid-state image pickup device and imaging system
CN115278057A (en) Image acquisition method and device, electronic equipment and storage medium
CN113286092A (en) Pixel processing circuit, method and device and electronic equipment
US10623642B2 (en) Image capturing apparatus and control method thereof with change, in exposure period for generating frame, of conversion efficiency
JP2004023380A (en) Solid state imaging device
US20230139967A1 (en) Image sensor, image acquisition apparatus, and electronic apparatus including the image acquisition apparatus
CN115118881A (en) Signal processing circuit, image sensor, electronic device, and image processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination