CN116095519A - Image sensor, sensor architecture, camera module and electronic equipment - Google Patents
Image sensor, sensor architecture, camera module and electronic equipment Download PDFInfo
- Publication number
- CN116095519A CN116095519A CN202211724163.5A CN202211724163A CN116095519A CN 116095519 A CN116095519 A CN 116095519A CN 202211724163 A CN202211724163 A CN 202211724163A CN 116095519 A CN116095519 A CN 116095519A
- Authority
- CN
- China
- Prior art keywords
- pixel
- signal
- conversion gain
- output signal
- comparator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000006243 chemical reaction Methods 0.000 claims abstract description 131
- 239000000872 buffer Substances 0.000 claims abstract description 36
- 238000004891 communication Methods 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims description 3
- 230000003139 buffering effect Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 10
- 229910052710 silicon Inorganic materials 0.000 description 5
- 239000010703 silicon Substances 0.000 description 5
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 4
- 239000003990 capacitor Substances 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- ALKZAGKDWUSJED-UHFFFAOYSA-N dinuclear copper ion Chemical compound [Cu].[Cu] ALKZAGKDWUSJED-UHFFFAOYSA-N 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/51—Control of the gain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The application discloses an image sensor, sensor architecture, camera module and electronic equipment belongs to the image processing field. Comprising the following steps: the pixel array, the conversion gain selection module and the conversion gain signal buffer and driving module; the pixel array comprises N rows of pixel units and M columns of pixel units, N pixel units in the same column are connected with the conversion gain signal buffer and the driving module through first connecting wires, N pixel units in the same column are connected with the conversion gain selection module through second connecting wires, and M and N are positive integers; the conversion gain selection module is used for generating a conversion gain selection table according to pixel signals output by the pixel array, wherein the conversion gain selection table comprises conversion gain mode selection signals corresponding to each pixel unit; the conversion gain signal buffer and driving module is used for reading gain mode selection signals corresponding to each pixel unit row by row from the conversion gain selection table, and sending the gain mode selection signals to the corresponding pixel units.
Description
Technical Field
The application belongs to the field of image processing, and particularly relates to an image sensor, a sensor architecture, a camera module and electronic equipment.
Background
In image sensors (Complementry Metal-Oxide Semiconductor, CMOS), dynamic range adjustment of an image is typically achieved by changing the pixel exposure time of all pixels and making an overall adjustment to the pixel signal gain.
In the related art, in the three-conversion gain high dynamic range (Triple Conversion Gain, TCG-HDR) technology, all pixels are commonly exposed, signals output by the pixels are amplified by different gains, all pixel units are required to be exposed in a high gain mode, a middle gain mode and a low gain mode respectively, three frames of images are read at a time, and then the three frames of images are synthesized, so that color layering and signal to noise ratio (Signal to Noise Ratio, SNR) fall occur in the synthesized HDR image due to processing defects. For example, there may be partial pixel local overexposure or partial pixel underexposure in the image output by some scenes.
Disclosure of Invention
An object of the embodiment of the application is to provide an image sensor, a sensor architecture, a camera module and electronic equipment, which can solve the problem that the imaging effect of an output image is poor because the conversion gain high dynamic range technology cannot be modulated pixel by pixel.
In a first aspect, an embodiment of the present application provides an image sensor method, including: the pixel array, the conversion gain selection module and the conversion gain signal buffer and driving module;
the pixel array comprises N rows of pixel units and M columns of pixel units, N pixel units in the same column are connected with the conversion gain signal buffer and the driving module through first connecting wires, N pixel units in the same column are connected with the conversion gain selection module through second connecting wires, and M and N are positive integers;
the conversion gain selection module is used for generating a conversion gain selection table according to pixel signals output by the pixel array, wherein the conversion gain selection table comprises conversion gain mode selection signals corresponding to each pixel unit;
the conversion gain signal buffer and driving module is used for reading gain mode selection signals corresponding to each pixel unit row by row from the conversion gain selection table, and sending the gain mode selection signals to the corresponding pixel units.
In a second aspect, embodiments of the present application provide a sensor architecture, comprising: a pixel layer and a circuit layer;
the pixel layer includes: the pixel array is in communication connection with the first bonding area;
the circuit layer includes: the device comprises a first bonding area, a conversion gain selection module, a conversion gain signal buffer and a driving module, wherein the first bonding area is in bonding connection with the first bonding area.
In a third aspect, an embodiment of the present application provides an image capturing module, including an image processor as described in the first aspect.
In a fourth aspect, an embodiment of the present application provides an electronic device, including an image capturing module according to the third aspect.
In the embodiment of the application, through the conversion gain mode selection module, the corresponding conversion gain mode selection signal can be automatically determined for each pixel unit according to the pixel signal output by each pixel unit, and further after the conversion gain signal buffer and driving module reads the gain mode selection signal corresponding to each pixel unit from the conversion gain selection table line by line, the gain mode selection signal is transmitted to each pixel unit, each pixel automatically selects to operate in a low gain mode, a medium gain mode or a high gain mode according to the self-adaptive logic within each frame time, so that the gain adjustment of a pixel level is realized, the problem of partial pixel local overexposure or partial pixel underexposure caused by three exposure is avoided.
Drawings
Fig. 1 is a schematic structural diagram of a pixel unit in an embodiment of the present application;
FIG. 2 is a schematic diagram of an image sensor according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a conversion gain selection module according to an embodiment of the present application;
FIG. 4 is a second schematic diagram of an image sensor according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a sensor architecture according to an embodiment of the present application.
Detailed Description
Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
The image sensor, the sensor architecture, the camera module and the electronic device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings by means of specific embodiments and application scenarios thereof.
Fig. 1 is a schematic structural diagram of a pixel unit according to an embodiment of the present application, and a Photodiode (PD) in an optical module of the pixel unit is responsible for light sensing and photoelectric conversion during each frame time. The generated charge e-is buffered in a floating diffusion (Floating Diffusion, FD) capacitance after passing through the TX transistor switching transistor. In the read (Readout) phase, the charge e-in the FD will be converted to a corresponding voltage after being amplified by a Source Follower (SF) transistor, and the pixel signal pix_out will be output to the outside of the pixel after being switched by the SEL transistor. The RST transistor is responsible for resetting the FD to the voltage VDD. Implementation of TCG function the function is to change the size of FD, which needs to be as small as possible in high conversion gain (High Conversion Gain, HCG) mode. While in the low conversion gain (Low Conversion Gain, LCG) mode, FD needs to be as large as possible. Therefore, conversion gain (Middle Conversion Gain, MCG), LCG transistor switches, and capacitors C1, C2 are added to the pixel circuit. The MCG transistor switch is responsible for mode conversion between HCG and MCG, while the capacitor C1 is responsible for expanding the FD capacitance. The LCG transistor switch is responsible for the mode switching of the LCG, while the capacitor C2 is responsible for further expansion of the FD capacitor. When the pixel needs to be under HCG, the MCG and LCG transistor switches are open and FD is responsible for taking up the charge e-transferred out by PD. When the pixel needs to be in MCG mode, the MCG transistor is turned on to connect FD to C1 for expansion (RST transistor switch must be kept off to prevent reset). Thus, the charge e-transferred out by the receiving PD is FD+C1. When the pixel needs to be in LCG mode, the MCG and LCG transistors are simultaneously turned on to connect FD to C1 and C2 for expansion (RST transistor switch must remain off to prevent reset). Thus, the charge e-transferred out by the receiving PD is FD+C1+C2. In summary, an essential way to implement TCG functionality is to vary the size of FD capacitance as desired.
Fig. 2 is a schematic structural diagram of an image sensor according to an embodiment of the present application, as shown in fig. 2, including: a pixel array 11, a conversion gain selection module 12 and a conversion gain signal buffer and driving module 13;
the pixel array 11 includes N rows of pixel units 110 and M columns of pixel units 110, where N pixel units 110 in the same column are connected to the conversion gain signal buffer and driving module 13 through a first connection line, N pixel units 110 in the same column are connected to the conversion gain selecting module 12 through a second connection line, and M and N are both positive integers;
the conversion gain selection module 12 is configured to generate a conversion gain selection table according to the pixel signals output by the pixel array 11, where the conversion gain selection table includes conversion gain mode selection signals corresponding to each pixel unit;
the conversion gain signal buffer and driving module 13 is configured to read gain mode selection signals corresponding to each pixel unit row by row from the conversion gain selection table, and send the gain mode selection signals to the corresponding pixel units.
Specifically, the pixel array described in the embodiments of the present application includes a plurality of pixel units, which may specifically include N pixel rows in the same row and M pixel columns in the same column, where NxM pixel units exist in each pixel array.
In order to further save wiring space, N pixel units in the same pixel column are connected with the driving module through the same first connection line and the conversion gain signal buffer, and N pixel units in the same pixel column are also connected with the conversion gain selection module through the same second connection line.
In the embodiment of the present application, each pixel unit is divided into 3 in the operation period of each Frame (Frame): a Reset period (Reset), an Exposure period (Exposure), and a read period (Readout). The row driver of the pixel array controls the reset and read related signals of each row of pixels, and there is a certain time difference in reset and read from row to row. Thus, the pixel signals of each row of pixels and the pixel signals of other rows of pixels are output with time difference, and the column parallel ADC can only process the pixel signals output by one row of pixels at a time. Each row of pixels directly enters the next frame time after the reading is completed, without having to take account of the state of the other rows of pixels. When all the rows of pixels are read, the pixel signals corresponding to one frame of picture are output to the conversion gain selection module.
In this embodiment of the present application, the pixel signal output by the pixel array may be a signal output by a pixel unit after the current frame is reset and exposed, and the pixel signal output by each pixel unit may be a different pixel signal.
In an alternative embodiment, the conversion gain selection module is configured to determine a corresponding gain mode selection signal according to the pixel signal output by each pixel unit, and then generate the conversion gain selection table according to the gain mode selection signal corresponding to each pixel unit.
In the embodiment of the present application, the conversion gain selection table records the gain mode selection signals corresponding to each pixel unit, and alternatively, the gain mode selection signals in the conversion gain selection table may be ordered according to the arrangement of the pixel array.
In an alternative embodiment, the conversion gain selection module may include a line buffer sub-module and a line driving sub-module, where the line buffer sub-module in the conversion gain selection module may read the gain mode selection signals corresponding to the pixel units line by line according to the pixel line arrangement of the pixel array, and the line buffer sub-module in the conversion gain signal buffer and driving module may buffer only the gain mode selection signals of one line of pixel units at a time.
In the process of shutter exposure, when a pixel unit of a certain row in the pixel array enters a reading Period (Readout Period) and needs to provide a gain mode selection signal to perform reading mode selection, the row driving sub-module drives the row caching sub-module to send the cached gain mode selection signal to the pixel unit of the corresponding row.
More specifically, the gain mode selection signal corresponding to each pixel unit may be a digital signal or an analog signal, and the gain mode selection signal controls the pixel unit to output the pixel signal according to the gain mode indicated by the gain mode selection signal in the time of the next image frame.
In the embodiment of the application, through the conversion gain mode selection module, the corresponding conversion gain mode selection signal can be automatically determined for each pixel unit according to the pixel signal output by each pixel unit, and further after the conversion gain signal buffer and driving module reads the gain mode selection signal corresponding to each pixel unit from the conversion gain selection table line by line, the gain mode selection signal is transmitted to each pixel unit, each pixel automatically selects to operate in a low gain mode, a medium gain mode or a high gain mode according to the self-adaptive logic within each frame time, so that the gain adjustment of a pixel level is realized, the problem of partial pixel local overexposure or partial pixel underexposure caused by three exposure is avoided.
Optionally, the conversion gain selection module includes: the device comprises a first comparator, a second comparator and a conversion gain indicator, wherein the conversion gain indicator is respectively connected with the first comparator and the second comparator in a communication way;
the first comparator is used for comparing the pixel signals corresponding to the pixel units with a first preset threshold value signal to obtain first comparator output signals corresponding to the pixel units;
the second comparator is used for comparing the pixel signals corresponding to the pixel units with a second preset threshold value signal to obtain second comparator output signals corresponding to the pixel units;
the conversion gain indicator is used for buffering the first comparator output signal and the second comparator output signal and generating the conversion gain selection table according to the first comparator output signal and the second comparator output signal.
Fig. 3 is a schematic structural diagram of a conversion gain selection module according to an embodiment of the present application, as shown in fig. 3, including: a first comparator 21, a second comparator 22 and a conversion gain indicator 23, the conversion gain indicator 23 being communicatively connected to said first and second comparators 21, 22, respectively.
In an alternative embodiment, the first comparator and the second comparator may be digital comparators, the first preset threshold signal and may be a user preset threshold value, which may specifically be a fixed preset threshold signal. Alternatively, different first and second preset threshold signals may be set when comparing pixel signals of different pixel units.
In an alternative embodiment, the first preset threshold signal and the second preset threshold signal may be the same threshold signal or may be different threshold signals.
In an alternative embodiment, the first preset threshold signal may be used to determine whether the MCG mode is selected or not, and the second preset threshold signal may be used to determine whether the LCG mode is selected or not, and in the case that the pixel signal is a binary digital signal, the first preset threshold signal and the second preset threshold signal may also be binary 10-bit binary digits.
In an alternative embodiment, after the image data output by each pixel unit is converted into the data signal, the data signal may be compared with a first preset threshold signal preset by a user and entered into a first Comparator (COMP), and a comparison result may be obtained for each signal output by each pixel, so as to obtain a corresponding first comparator output signal of each pixel unit.
Correspondingly, the signal can be compared with a second preset threshold signal preset by a user in the second comparator, and a comparison result can be obtained for the signal output by each pixel, so that the corresponding second comparator output signal of each pixel unit is obtained.
In an alternative embodiment, a conversion gain indicator is required to buffer the first comparator output signal and the second comparator output signal, since there may be a certain time difference between the comparison result outputs of the first comparator and the second comparator.
After the comparison result of each pixel is completed, the comparison result is transferred to the conversion gain selection table for storage, and after the comparison of all pixel units is completed, the conversion gain selection table is obtained.
In the embodiment of the application, the first comparator and the second comparator can effectively conduct targeted analysis on the pixel signals output by different pixel units, so that a gain mode suitable for each pixel unit is effectively obtained, the quality of finally generated pictures is effectively ensured, the output signals of the first comparator and the output signals of the second comparator are effectively cached through the conversion gain indicator, and a conversion gain selection table is generated.
Optionally, the first comparator is specifically configured to:
when the pixel signal is larger than the first preset threshold signal, outputting a first comparator output signal corresponding to the pixel unit as a first high-level output signal;
when the pixel signal is smaller than or equal to the first preset threshold signal, the output signal of the first comparator corresponding to the pixel unit is a first low-level output signal;
the second comparator is specifically configured to:
when the pixel signal is larger than the second preset threshold signal, outputting a second comparator output signal corresponding to the pixel unit as a second high-level output signal;
and outputting a second comparator output signal corresponding to the pixel unit as a second low-level output signal under the condition that the pixel signal is smaller than or equal to the second preset threshold signal.
Specifically, in the embodiment of the present application, the high-level output signal may be recorded as "1" in the conversion gain selection table, the low-level output signal may be recorded as "0" in the conversion gain selection table, a comparison result may be obtained for each signal output by each pixel, and the binary digital signal "1" is agreed to indicate that the pixel is put into the high-gain mode for reading, and the binary digital signal "0" indicates that the pixel is put into the low-gain mode for reading, according to the position of the pixel unit in the pixel array and buffered in the conversion gain selection table. The convention can be used vice versa in implementations, but a 1-bit binary signal must be employed.
In an alternative embodiment, the conversion gain signal buffer and driver module may be forcibly masked and its operation may be stopped if the TCG-HDR functionality is not required by the user.
The conversion gain indicator is particularly for:
obtaining a gain mode selection signal of the pixel unit as a low gain mode selection signal when the first comparator output signal is a first high level output signal and the second comparator output signal is a second high level output signal;
obtaining a gain mode selection signal of the pixel unit as a medium gain mode selection signal when the first comparator output signal is a first low level output signal and the second comparator output signal is a second high level output signal;
obtaining a gain mode selection signal of the pixel unit as a low gain mode selection signal when the first comparator output signal is a first high level output signal and the second comparator output signal is a second low level output signal;
and obtaining a gain mode selection signal of the pixel unit as a high gain mode selection signal when the first comparator output signal is a first low level output signal and the second comparator output signal is a second low level output signal.
In an alternative embodiment, the first comparator output signal is a first high level output signal, which indicates that the low gain mode is selected for the first comparison, and the second comparator output signal is a second high level output signal, which indicates that the medium gain mode is selected for the second comparison, and the gain mode selection signal of the final pixel unit is a low gain mode selection signal.
In an alternative embodiment, the first comparator output signal is a first low level output signal, which indicates that the low gain mode is not selected for the first comparison, and the second comparator output signal is a second high level output signal, which indicates that the medium gain mode is selected for the second comparison, so as to obtain the gain mode selection signal of the pixel unit as the medium gain mode selection signal.
In an alternative embodiment, the first comparator output signal is a first high level output signal, which indicates that the first comparison selects the low gain mode, and the second comparator output signal is a second low level output signal, which indicates that the second comparison does not select the medium gain mode, so as to obtain the gain mode selection signal of the pixel unit as the low gain mode selection signal;
in an alternative embodiment, the first comparator output signal is a first level output signal, which indicates that the low gain mode is not selected for the first comparison, and the second comparator output signal is a second low level output signal, which indicates that the medium gain mode is not selected for the second comparison, so as to obtain the gain mode selection signal of the pixel unit as the high gain mode selection signal;
in an alternative embodiment, when any column of the pixel array is in a reading period and it is required to determine HCG or MCG or LCG reading mode selection, the conversion gain signal buffer and driving module uses the push buffered 2-bit conversion gain selection signal as an LCG signal and an MCG signal, and transmits the push buffered 2-bit conversion gain selection signal to the pixel array for providing to the column of pixels for LCG or MCG or HCG reading after driving by the corresponding column driver. Here, the default digital signals "lcg=1 and mcg=1" represent letting the pixel enter the LCG mode reading, the digital signals "lcg=0 and mcg=1" represent letting the pixel enter the MCG mode reading, and the digital signals "lcg=0 and mcg=0" represent letting the pixel enter the HCG mode reading. If the user does not need the adaptive TCG-HDR function, the column buffer in the forced column parallel TCG mode signal buffer and drive module stores/buffers binary digital signals "0" or "1"
In the embodiment of the application, the comparator can effectively conduct targeted analysis on the pixel signals output by different pixel units, so that the gain mode suitable for each pixel unit is effectively obtained, and the quality of the finally generated picture is effectively ensured.
Optionally, the conversion gain selection module includes: an independent image signal processor;
the independent image signal processor is used for carrying out pixel-by-pixel analysis on pixel signals output by the pixel array according to a stored program algorithm to obtain gain mode selection signals corresponding to the pixel units;
and generating the conversion gain selection table according to the gain mode selection signals corresponding to the pixel units.
Specifically, in the embodiment of the present application, the program algorithm may specifically be an algorithm for analyzing the image data of each pixel unit and determining the gain mode of each pixel, and the algorithm may specifically be an algorithm capable of outputting a corresponding gain mode selection signal after inputting the pixel signal of each pixel unit.
In an alternative embodiment, the algorithm may be an algorithm that simulates a comparator by using a program algorithm, so as to obtain pixel signals output by the pixel array, and perform pixel-by-pixel analysis on the pixel signals to obtain gain mode selection signals corresponding to each pixel unit, where the algorithm may also be other algorithms capable of implementing corresponding functions.
In an alternative embodiment, after obtaining the gain mode selection signals corresponding to the pixel units, the gain mode selection signals may be further stored in corresponding positions according to the arrangement of the pixel array and the row-column distribution of the pixel units, so as to obtain a final conversion gain selection table.
In an alternative embodiment, the stored program algorithm may be stored in the image sensor, or may be integrated in the image sensor.
And when the program algorithm is integrated outside the image sensor, it may be stored in a separate image signal processor outside the image sensor.
In the embodiment of the application, the pixel units can be analyzed one by one in a software mode through a program algorithm integrated by the software program module, so that the number of transistors of the image sensor can be effectively reduced and the cost is saved on the premise of effectively ensuring the image quality.
Optionally, the sensor further comprises: the interface module is respectively in communication connection with the conversion gain signal buffer, the driving module and the pixel array;
the interface module is used for transmitting the pixel signals output by the pixel array to the independent image signal processor and receiving gain mode selection signals corresponding to each pixel unit transmitted by the independent image signal processor.
In an alternative embodiment, the interface module may in particular be an interface for data transmission with a separate image signal processor.
Fig. 4 is a second schematic diagram of an image sensor according to an embodiment of the present application, as shown in fig. 4, including: a pixel array 11, an independent image signal processor 31, a conversion gain signal buffer and drive module 13 and an interface module 32.
In this embodiment of the present application, the interface module is respectively connected with the conversion gain signal buffer and the driving module and the pixel array in a communication manner, and the interface module may transmit the pixel signals of each pixel unit in the pixel array to the independent image signal processor, so that the independent image signal processor may analyze the gain mode corresponding to each pixel unit according to the pixel signals, and obtain the conversion gain selection table.
The interface module may then also receive a gain mode selection signal for each column of pixel cells sent by the independent image signal processor.
In the embodiment of the application, the interface module can effectively send the image data to the independent image signal processor for gain mode analysis and receive the gain mode selection signals corresponding to the pixel units sent back by the independent image signal processor, so that the quality of the image can be effectively ensured under the condition of effectively reducing the number of transistors.
Optionally, the pixel array further includes: the signal reading module is connected with the N pixel units in the same column through the second connecting lines;
the signal reading module is used for carrying out analog-to-digital conversion on pixel signals output by the pixel units and then transmitting the pixel signals to the conversion gain selection module.
In an alternative embodiment, the signal reading module reads the image data generated by each pixel unit after the reset and exposure of each pixel unit is completed in each frame time.
The signal reading module reads the image data, and the image data at this time is often an analog signal and is inconvenient to directly process, so that the signal reading module can perform analog-to-digital conversion processing on the image data, convert the image data into a digital signal, and then transmit the digital signal to the high dynamic range logic module.
In an alternative embodiment, the signal reading module may include an analog-to-digital conversion module and an image signal processor, where the analog-to-digital conversion module is connected to the image signal processor, and N pixel units in the same column are connected to the conversion gain selection module through the signal reading module by a second connection line.
In the embodiment of the application, the pixel signals output by the pixel units are subjected to analog-to-digital conversion, so that the subsequent effective analysis of the pixel signals can be effectively ensured.
Fig. 5 is a schematic structural diagram of a sensor architecture according to an embodiment of the present application, as shown in fig. 5, including: a pixel layer 51 and a circuit layer 52;
the pixel layer 51 includes: a first bonding region 510 and a pixel array 11, the pixel array 11 being in communication with the first bonding region 510;
the circuit layer 52 includes: the second bonding area 520, the conversion gain selection module 12 and the conversion gain signal buffer and driving module 13 are respectively in communication connection with the conversion gain selection module 12 and the conversion gain signal buffer and driving module 13, and the first bonding area 510 is in bonding connection with the second bonding area 520.
Specifically, in the embodiment of the application, the pixel layer and the circuit layer may be specifically formed by a silicon wafer layer, the pixel layer is specifically a pixel silicon wafer layer, all pixel units are disposed on the pixel layer, and the pixel layer may be specifically manufactured by Front-Side Illumination (FSI) or Back-Side Illumination (BSI) technology.
The pixel layer in the embodiment of the application is provided with the effective pixel array, and the periphery of the pixel array can be provided with the first bonding area for signal wiring, so that the connection between the pixel layer and the circuit layer is realized.
The Pixel layer silicon chip only places a Pixel Array (Pixel Array), and all input and output signals of the pixels are provided by the circuit layer silicon chip at the bottom layer. The connection of the signals between the two layers adopts TSVs (Trans-Silicon Via) or Cu-Cu Hybrid Bonding (copper-copper hybrid bonding) and other modes.
The conversion gain selection module, the conversion gain signal buffer and driving module and the interface module can be all arranged in the circuit layer.
In an alternative embodiment, where the conversion gain selection module is integrated in the software of the pixel sensor, no high dynamic range logic module is provided in the corresponding circuit layer.
External HDR logic software can be in signal connection with the column parallel TCG mode signal cache and the driving module through the I/O pin of the image sensor under the coordination of the port module.
In the embodiment of the application, through the conversion gain mode selection module, the corresponding conversion gain mode selection signal can be automatically determined for each pixel unit according to the pixel signal output by each pixel unit, and further after the conversion gain signal buffer and driving module reads the gain mode selection signal corresponding to each pixel unit from the conversion gain selection table line by line, the gain mode selection signal is transmitted to each pixel unit, each pixel automatically selects to operate in a low gain mode, a medium gain mode or a high gain mode according to the self-adaptive logic within each frame time, so that the gain adjustment of a pixel level is realized, the problem of partial pixel local overexposure or partial pixel underexposure caused by three exposure is avoided.
Optionally, the embodiment of the application also provides a camera module including the image sensor, and by using the camera module, pixel-by-pixel modulation can be performed in the process of realizing the TCG-HDR function, so that the imaging effect of an output image is effectively ensured.
Optionally, the embodiment of the application further provides an electronic device, where the electronic device includes the camera module in the embodiment, and the electronic device may be a terminal, or may be other devices except the terminal. By way of example, the electronic device may be a mobile phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, mobile internet appliance (Mobile Internet Device, MID), augmented reality (augmented reality, AR)/Virtual Reality (VR) device, robot, wearable device, ultra-mobile personal computer, UMPC, netbook or personal digital assistant (personal digital assistant, PDA), etc., but may also be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.
The electronic device in the embodiment of the application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.
Claims (10)
1. An image sensor, comprising: the pixel array, the conversion gain selection module and the conversion gain signal buffer and driving module;
the pixel array comprises N rows of pixel units and M columns of pixel units, N5 pixel units in the same column are connected with the conversion gain signal buffer and the driving module through first connecting wires, N pixel units in the same column are connected with the conversion gain selection module through second connecting wires, and M and N are positive integers;
the conversion gain selection module is used for generating a conversion gain selection table according to pixel signals output by the pixel array, wherein the conversion gain selection table comprises conversion gain mode 0 selection signals corresponding to each pixel unit;
the conversion gain signal buffer and driving module is used for reading gain mode selection signals corresponding to each pixel unit row by row from the conversion gain selection table, and sending the gain mode selection signals to the corresponding pixel units.
2. The image sensor of claim 1, wherein the conversion gain selection module 5 comprises: the device comprises a first comparator, a second comparator and a conversion gain indicator, wherein the conversion gain indicator is respectively connected with the first comparator and the second comparator in a communication way;
the first comparator is used for comparing the pixel signals corresponding to the pixel units with a first preset threshold value signal to obtain first comparator output signals corresponding to the pixel units;
the second comparator is used for comparing the pixel signals corresponding to the pixel units with a second preset threshold signal 0 to obtain second comparator output signals corresponding to the pixel units;
the conversion gain indicator is used for buffering the first comparator output signal and the second comparator output signal and generating the conversion gain selection table according to the first comparator output signal and the second comparator output signal.
3. The image sensor according to claim 2, wherein the first comparator body 5 is configured to:
when the pixel signal is larger than the first preset threshold signal, outputting a first comparator output signal corresponding to the pixel unit as a first high-level output signal;
when the pixel signal is smaller than or equal to the first preset threshold signal, the output signal of the first comparator corresponding to the pixel unit is a first low-level output signal;
the second comparator is specifically configured to:
when the pixel signal is larger than the second preset threshold signal, outputting a second comparator output signal corresponding to the pixel unit as a second high-level output signal;
and outputting a second comparator output signal corresponding to the pixel unit as a second low-level output signal under the condition that the pixel signal is smaller than or equal to the second preset threshold signal.
4. The image sensor of claim 3, wherein the conversion gain indicator is specifically configured to:
obtaining a gain mode selection signal of the pixel unit as a low gain mode selection signal when the first comparator output signal is a first high level output signal and the second comparator output signal is a second high level output signal;
obtaining a gain mode selection signal of the pixel unit as a medium gain mode selection signal when the first comparator output signal is a first low level output signal and the second comparator output signal is a second high level output signal;
obtaining a gain mode selection signal of the pixel unit as a low gain mode selection signal when the first comparator output signal is a first high level output signal and the second comparator output signal is a second low level output signal;
and obtaining a gain mode selection signal of the pixel unit as a high gain mode selection signal when the first comparator output signal is a first low level output signal and the second comparator output signal is a second low level output signal.
5. The image sensor of claim 1, wherein the conversion gain selection module comprises: an independent image signal processor;
the independent image signal processor is used for carrying out pixel-by-pixel analysis on pixel signals output by the pixel array according to a stored program algorithm to obtain gain mode selection signals corresponding to the pixel units;
and generating the conversion gain selection table according to the gain mode selection signals corresponding to the pixel units.
6. The image sensor of claim 5, wherein the sensor further comprises: the interface module is respectively in communication connection with the conversion gain signal buffer, the driving module and the pixel array;
the interface module is used for transmitting the pixel signals output by the pixel array to the independent image signal processor and receiving gain mode selection signals corresponding to each pixel unit transmitted by the independent image signal processor.
7. The image sensor of claim 1, wherein the pixel array further comprises: the signal reading module is connected with the N pixel units in the same column through the second connecting lines;
the signal reading module is used for carrying out analog-to-digital conversion on pixel signals output by the pixel units and then transmitting the pixel signals to the conversion gain selection module.
8. A sensor architecture based on the image sensor of any of the preceding claims 1-7, characterized by comprising: a pixel layer and a circuit layer;
the pixel layer includes: the pixel array is in communication connection with the first bonding area;
the circuit layer includes: the device comprises a first bonding area, a conversion gain selection module, a conversion gain signal buffer and a driving module, wherein the first bonding area is in bonding connection with the first bonding area.
9. An imaging module comprising an image sensor according to any one of claims 1-7.
10. An electronic device comprising the camera module of claim 9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211724163.5A CN116095519A (en) | 2022-12-30 | 2022-12-30 | Image sensor, sensor architecture, camera module and electronic equipment |
| PCT/CN2023/142587 WO2024140873A1 (en) | 2022-12-30 | 2023-12-28 | Image sensor, sensor architecture, camera module and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211724163.5A CN116095519A (en) | 2022-12-30 | 2022-12-30 | Image sensor, sensor architecture, camera module and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116095519A true CN116095519A (en) | 2023-05-09 |
Family
ID=86198587
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211724163.5A Pending CN116095519A (en) | 2022-12-30 | 2022-12-30 | Image sensor, sensor architecture, camera module and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116095519A (en) |
| WO (1) | WO2024140873A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024140873A1 (en) * | 2022-12-30 | 2024-07-04 | 维沃移动通信有限公司 | Image sensor, sensor architecture, camera module and electronic device |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9628732B2 (en) * | 2013-08-23 | 2017-04-18 | Semiconductor Components Industries, Llc | Imaging systems and methods for performing column-based image sensor pixel gain adjustments |
| CN106716992B (en) * | 2014-08-20 | 2020-02-07 | 塞克热量股份有限公司 | Method for gain calibration of an imaging system and imaging system |
| US9888191B2 (en) * | 2015-04-21 | 2018-02-06 | Semiconductor Components Industries, Llc | Imaging systems and methods for performing unboosted image sensor pixel conversion gain adjustments |
| US9854186B2 (en) * | 2016-02-05 | 2017-12-26 | Semiconductor Components Industries, Llc | Methods and apparatus for an images sensor with row-level gain control |
| CN109741717A (en) * | 2019-03-26 | 2019-05-10 | 京东方科技集团股份有限公司 | Pixel compensation method, device, sequence controller, array substrate and display device |
| CN110233979B (en) * | 2019-06-06 | 2021-11-19 | 锐芯微电子股份有限公司 | Image sensor, reading circuit thereof and pixel structure |
| JP2021022921A (en) * | 2019-07-29 | 2021-02-18 | キヤノン株式会社 | Imaging element, imaging apparatus, and control method |
| KR20210156458A (en) * | 2020-06-18 | 2021-12-27 | 삼성전자주식회사 | Image sensing device and electronic device comprising the same |
| KR20220000118A (en) * | 2020-06-25 | 2022-01-03 | 에스케이하이닉스 주식회사 | Image sensor |
| JP2022180791A (en) * | 2021-05-25 | 2022-12-07 | ブリルニクス シンガポール プライベート リミテッド | Solid-state imaging apparatus, method for driving solid-state imaging apparatus, and electronic apparatus |
| US11368646B1 (en) * | 2021-08-05 | 2022-06-21 | Shenzhen GOODIX Technology Co., Ltd. | Per-color adaptive in-pixel programmable gain amplification for high dynamic range in CMOS image sensors |
| CN115174831A (en) * | 2022-07-07 | 2022-10-11 | 北京安酷智芯科技有限公司 | Reading circuit capable of automatically expanding dynamic range |
| CN116095519A (en) * | 2022-12-30 | 2023-05-09 | 维沃移动通信有限公司 | Image sensor, sensor architecture, camera module and electronic equipment |
-
2022
- 2022-12-30 CN CN202211724163.5A patent/CN116095519A/en active Pending
-
2023
- 2023-12-28 WO PCT/CN2023/142587 patent/WO2024140873A1/en unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024140873A1 (en) * | 2022-12-30 | 2024-07-04 | 维沃移动通信有限公司 | Image sensor, sensor architecture, camera module and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024140873A1 (en) | 2024-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9077917B2 (en) | Image sensor having HDR capture capability | |
| US9344649B2 (en) | Floating point image sensors with different integration times | |
| US7619674B2 (en) | CMOS image sensor with wide dynamic range | |
| US7986363B2 (en) | High dynamic range imager with a rolling shutter | |
| CN101536491A (en) | Imaging device and imaging method | |
| JP6614133B2 (en) | Imaging device, control method, and imaging apparatus | |
| WO2024140873A1 (en) | Image sensor, sensor architecture, camera module and electronic device | |
| US11589059B2 (en) | Video compression apparatus, electronic apparatus, and video compression program | |
| JPH10224696A (en) | Solid-state image pickup element and image system using the solid-state image pickup element | |
| WO2024140769A1 (en) | Image sensor, sensor architecture, camera module, and electronic device | |
| US11637963B2 (en) | Image sensor and image processing system comprising the same | |
| WO2023025229A1 (en) | Image sensor, control method, control apparatus, electronic device, and storage medium | |
| US20240340444A1 (en) | Video compression apparatus and video compression program | |
| US10051216B2 (en) | Imaging apparatus and imaging method thereof using correlated double sampling | |
| JP2019161577A (en) | Imaging device, pixel correction processing circuit, and pixel correction processing method | |
| WO2024140886A1 (en) | Image processor, photographic module and electronic device | |
| WO2024140724A1 (en) | Image sensor, camera module and electronic device | |
| KR20160015712A (en) | Apparatus and method for capturing images | |
| US10630922B1 (en) | Local exposure sensor and method for operating the same | |
| US9979919B2 (en) | Solid-state imaging device and imaging system | |
| JP2010068414A (en) | Image pickup apparatus | |
| US20230209226A1 (en) | Image Sensors with On-Chip ADC Data Compression for Multi-Bit Electron-Number Outputs | |
| CN115118856B (en) | Image sensor, image processing method, camera module and electronic equipment | |
| US20240348949A1 (en) | Pixel Array Readout Circuitry | |
| WO2023129566A1 (en) | Image sensors with on-chip adc data compression for multi-bit electron-number outputs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |