WO2024140724A1 - Image sensor, camera module and electronic device - Google Patents

Image sensor, camera module and electronic device Download PDF

Info

Publication number
WO2024140724A1
WO2024140724A1 PCT/CN2023/142085 CN2023142085W WO2024140724A1 WO 2024140724 A1 WO2024140724 A1 WO 2024140724A1 CN 2023142085 W CN2023142085 W CN 2023142085W WO 2024140724 A1 WO2024140724 A1 WO 2024140724A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
unit
signal
mode selection
gain
Prior art date
Application number
PCT/CN2023/142085
Other languages
French (fr)
Chinese (zh)
Inventor
罗轶
易铃棋
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2024140724A1 publication Critical patent/WO2024140724A1/en

Links

Abstract

The present application belongs to the technical field of image processing. Disclosed are an image sensor, a camera module and an electronic device. The image sensor comprises a pixel array, a conversion gain selection logic module and a cache line decoding driving module, wherein the pixel array comprises N rows of pixel units and M columns of pixel units; N pixel units in the same column are connected to the conversion gain selection logic module by means of a first connection line, and M pixel units in the same row are connected to the cache line decoding driving module by means of a second connection line; the conversion gain selection logic module is used for determining, according to a first pixel output signal of each pixel unit, a dual-gain mode selection signal corresponding to each pixel unit; and the pixel unit is used for writing, when receiving a cache control signal sent by the cache line decoding driving module, the dual-gain mode selection signal corresponding to the pixel unit, both M and N being positive integers.

Description

图像传感器、摄像头模组及电子设备Image sensors, camera modules and electronic devices
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本申请要求在2022年12月30日提交中国专利局、申请号为202211736330.8、名称为“图像传感器、摄像模组及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application filed with the China Patent Office on December 30, 2022, with application number 202211736330.8 and title “Image sensor, camera module and electronic device”, the entire contents of which are incorporated by reference into this application.
技术领域Technical Field
本申请属于图像处理技术领域,具体涉及一种图像传感器、摄像模组及电子设备。The present application belongs to the field of image processing technology, and specifically relates to an image sensor, a camera module and an electronic device.
背景技术Background technique
在图像传感器(Complementry Metal-Oxide Semiconductor,CMOS)中,对于图像的动态范围调整,一般都是通过改变所有像素的像素曝光时间以及对像素信号增益进行整体调整来实现的。In image sensors (Complementry Metal-Oxide Semiconductor, CMOS), the dynamic range adjustment of an image is generally achieved by changing the pixel exposure time of all pixels and making an overall adjustment to the pixel signal gain.
主流的高动态范围(High Dynamic Range,HDR)或广动态范围(Wide Dynamic Range,WDR)技术中,无论是多帧,行交织,还是双增益方案,都是所有像素采用相同的曝光时间。通过曝光时间的长短以及输出信号增益调整来改变HDR的调制效果,例如,双增益(Dual Conversion Gain,DCG)技术中,所有的像素都是共同进行长/短曝光,只是输出的信号进行了不同增益的放大,即只是对读出信号进行高/低增益放大。In mainstream High Dynamic Range (HDR) or Wide Dynamic Range (WDR) technologies, whether it is multi-frame, line interleaving, or dual gain scheme, all pixels use the same exposure time. The modulation effect of HDR is changed by adjusting the exposure time and the output signal gain. For example, in Dual Conversion Gain (DCG) technology, all pixels are exposed long/short together, but the output signal is amplified with different gains, that is, only the readout signal is amplified with high/low gain.
但是,相关技术中,基于DCG-HDR功能,在实现过程中,由于无法进行逐像素调制,因此像素阵列中的所有像素单元往往需要先在高增益(High Conversion Gain,HCG)模式下曝光,读取后再进行低增益(Low Conversion Gain,LCG)模式下曝光,这种方式,不仅对计算能力存在较高的要求,并且合成得到的HDR图像往往由于处理缺陷,出现亮度/色彩分层以及信噪比(Signal to Noise Ratio,SNR)落差。例如,在亮暗变化复杂的场景中,现有的DCG-HDR技术在某些场景输出的图像中有部分像素局域过曝或者部分像素欠曝。However, in the related technology, based on the DCG-HDR function, in the implementation process, since pixel-by-pixel modulation cannot be performed, all pixel units in the pixel array often need to be exposed in the high gain (High Conversion Gain, HCG) mode first, and then exposed in the low gain (Low Conversion Gain, LCG) mode after reading. This method not only has high requirements on computing power, but also the synthesized HDR image often has brightness/color stratification and signal-to-noise ratio (SNR) drop due to processing defects. For example, in scenes with complex changes in brightness and darkness, the existing DCG-HDR technology has some pixels locally overexposed or some pixels underexposed in the output images of certain scenes.
发明内容Summary of the invention
本申请实施例的目的是提供一种图像传感器、摄像模组及电子设备,能够解决在DCG-HDR功能的实现过程中,无法进行逐像素调制,导致的输出图像成像效果较差的问题。The purpose of the embodiments of the present application is to provide an image sensor, a camera module and an electronic device, which can solve the problem of poor output image imaging effect caused by the inability to perform pixel-by-pixel modulation during the implementation of the DCG-HDR function.
第一方面,本申请实施例提供了一种图像传感器,包括:像素阵列,转换增益选择逻辑模块,缓存行解码驱动模块;In a first aspect, an embodiment of the present application provides an image sensor, comprising: a pixel array, a conversion gain selection logic module, and a cache line decoding drive module;
所述像素阵列包括N行像素单元和M列像素单元,同一列的N个像素单元通过第一连接线与所述转换增益选择逻辑模块连接;同一行的M个像素单元通过第二连接线与 所述缓存行解码驱动模块连接;The pixel array includes N rows of pixel units and M columns of pixel units. The N pixel units in the same column are connected to the conversion gain selection logic module through a first connection line; the M pixel units in the same row are connected to the conversion gain selection logic module through a second connection line. The cache line decoding driver module is connected;
其中,所述转换增益选择逻辑模块用于根据各所述像素单元的第一像素输出信号,确定各像素单元对应的双增益模式选择信号;Wherein, the conversion gain selection logic module is used to determine the dual gain mode selection signal corresponding to each pixel unit according to the first pixel output signal of each pixel unit;
所述像素单元用于在接收到所述缓存行解码驱动模块发送的缓存控制信号的情况下,写入所述像素单元对应的双增益模式选择信号,M和N均为正整数。The pixel unit is used to write a dual gain mode selection signal corresponding to the pixel unit when receiving a cache control signal sent by the cache row decoding driving module, and both M and N are positive integers.
第二方面,本申请实施例提供了一种摄像模组,包括如第一方面所述的图像传感器。In a second aspect, an embodiment of the present application provides a camera module, comprising an image sensor as described in the first aspect.
第三方面,本申请实施例提供了一种电子设备,包括如第二方面所述的摄像模组。In a third aspect, an embodiment of the present application provides an electronic device, comprising the camera module as described in the second aspect.
在本申请实施例中,转换增益选择逻辑模块可以根据每个像素单元的像素输出信号的采样,自动为每个像素单元确定其对应的双增益模式选择信号,并将双增益模式选择信号发送到对应的像素单元中,使得每个像素单元在每一帧时间内,可以根据双增益模式选择信号确定其应当工作于高增益模式或者低增益模式,从而实现像素级的增益调整,避免了对像素阵列整体调整导致的算力要求较高,以及调整效果较差的问题,并且每个像素单元的调整模式均是根据当前时间内的像素输出信号来确定的,保证了像素调整的准确性和有效性。In an embodiment of the present application, the conversion gain selection logic module can automatically determine the corresponding dual gain mode selection signal for each pixel unit based on the sampling of the pixel output signal of each pixel unit, and send the dual gain mode selection signal to the corresponding pixel unit, so that each pixel unit can determine whether it should operate in high gain mode or low gain mode according to the dual gain mode selection signal within each frame time, thereby realizing pixel-level gain adjustment, avoiding the high computing power requirements and poor adjustment effect caused by the overall adjustment of the pixel array, and the adjustment mode of each pixel unit is determined according to the pixel output signal in the current time, ensuring the accuracy and effectiveness of the pixel adjustment.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为相关技术中像素阵列的结构示意图;FIG1 is a schematic diagram of the structure of a pixel array in the related art;
图2为本申请实施例提供的图像传感器结构示意图之一;FIG2 is a schematic diagram of a structure of an image sensor according to an embodiment of the present application;
图3为本申请实施例提供的转换增益选择逻辑模块结构示意图之一;FIG3 is a schematic diagram of a conversion gain selection logic module structure according to an embodiment of the present application;
图4为本申请实施例提供的图像传感器结构示意图之二;FIG4 is a second schematic diagram of the structure of an image sensor provided in an embodiment of the present application;
图5为本申请实施例提供的转换增益选择逻辑模块结构示意图之二;FIG5 is a second schematic diagram of the conversion gain selection logic module structure provided in an embodiment of the present application;
图6为本申请实施例提供的图像传感器结构示意图之三。FIG. 6 is a third schematic diagram of the image sensor structure provided in an embodiment of the present application.
具体实施例Specific embodiments
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员获得的所有其他实施例,都属于本申请保护的范围。The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施,且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and/or" in the specification and claims represents at least one of the connected objects, and the character "/" generally indicates that the objects associated with each other are in an "or" relationship.
下面结合附图,通过具体的实施例及其应用场景对本申请实施例提供的图像传感器、摄像模组及电子设备进行详细地说明。 The image sensor, camera module and electronic device provided in the embodiments of the present application are described in detail below through specific embodiments and their application scenarios in combination with the accompanying drawings.
相关技术中,DCG-HDR技术的实现依靠对传统4合1像素阵列(4-Transistor Active Pixel Sensor,4T-APS)像素的改进,图1为相关技术中像素阵列的结构示意图,如图1所示,传统的RGGB像素阵列或者合成像素阵列(例如4合1像素阵列),其在像素电路模块中均包含了用于实现DCG功能的元器件:典型设计为DCG晶体管以及相应的电容C。In the related art, the realization of DCG-HDR technology relies on the improvement of the traditional 4-in-1 pixel array (4-Transistor Active Pixel Sensor, 4T-APS) pixels. Figure 1 is a structural schematic diagram of the pixel array in the related art. As shown in Figure 1, the traditional RGGB pixel array or synthetic pixel array (such as a 4-in-1 pixel array) includes components for realizing the DCG function in the pixel circuit module: the typical design is a DCG transistor and a corresponding capacitor C.
其具体的工作基本原理为:像素的光学模块中的光电二极管(Photodiode,PD)在每一帧时间内负责感光以及光电转换。生成的电荷e-通过TX晶体管开关后缓存在浮动扩散(Floating Diffusion,FD)电容中。在读取(Readout)阶段,FD内的电荷e-将由源跟随器(Source Follower,SF)晶体管放大后转换成相应的电压,通过SEL晶体管开关后输出像素信号PIX_OUT至像素外。RST晶体管负责将FD重置至电压VDD。DCG功能的实现功能为改变FD的大小,在HCG模式下,FD需要尽可能的小。而在LCG模式下,FD需要尽可能的大。因此增设DCG晶体管开关以及电容C。DCG晶体管开关负责HCG与LCG之间的模式转换,而电容C负责将FD电容进行扩容。当像素需要进行在HCG下时,DCG晶体管开关断开,FD负责承接由PD转移出的电荷e-。当像素需要进行在LCG模式下时,DCG晶体管闭合将FD与C连接扩容(RST晶体管开关必须保持断开防止重置)。因此,承接PD转移出的电荷e-为FD+C。综上,DCG功能的实现本质方法为根据所需改变FD电容的大小。The specific working principle is as follows: the photodiode (PD) in the optical module of the pixel is responsible for photosensitivity and photoelectric conversion in each frame time. The generated charge e- is cached in the floating diffusion (FD) capacitor after passing through the TX transistor switch. In the readout stage, the charge e- in the FD will be amplified by the source follower (SF) transistor and converted into a corresponding voltage, and the pixel signal PIX_OUT is output to the outside of the pixel after passing through the SEL transistor switch. The RST transistor is responsible for resetting the FD to the voltage VDD. The DCG function is implemented to change the size of the FD. In the HCG mode, the FD needs to be as small as possible. In the LCG mode, the FD needs to be as large as possible. Therefore, a DCG transistor switch and a capacitor C are added. The DCG transistor switch is responsible for the mode conversion between HCG and LCG, and the capacitor C is responsible for expanding the FD capacitor. When the pixel needs to be in HCG, the DCG transistor switch is disconnected, and the FD is responsible for receiving the charge e- transferred from the PD. When the pixel needs to be in LCG mode, the DCG transistor is closed to connect FD and C to expand the capacitance (the RST transistor switch must remain open to prevent resetting). Therefore, the charge e- transferred from PD is FD+C. In summary, the essential method of realizing the DCG function is to change the size of the FD capacitor according to the needs.
在运算摄影领域中,逐像素控制技术可以实现像素级的动态范围控制,避免图像过曝或者欠曝的问题,其具体可以是对于过曝或者欠曝的像素,进行逐像素的单独编码,进行增益控制,可以有效消除过曝或者欠曝的问题,通过单个像素的调制,可以有效避免区域边缘过于突兀的问题。In the field of computational photography, pixel-by-pixel control technology can achieve pixel-level dynamic range control to avoid image overexposure or underexposure. Specifically, it can encode overexposed or underexposed pixels pixel by pixel and perform gain control, which can effectively eliminate the problem of overexposure or underexposure. By modulating a single pixel, the problem of the edge of the area being too abrupt can be effectively avoided.
图2为本申请实施例提供的图像传感器结构示意图之一,如图2所示,包括:像素阵列11,转换增益选择逻辑模块12,缓存行解码驱动模块13;FIG. 2 is one of the schematic diagrams of the structure of the image sensor provided by the embodiment of the present application. As shown in FIG. 2 , the image sensor comprises: a pixel array 11, a conversion gain selection logic module 12, and a cache line decoding driving module 13;
所述像素阵列11包括N行像素单元和M列像素单元110,同一行的M个像素单元110通过第二连接线111与所述缓存行解码驱动模块13连接;同一列的N个像素单元110通过第一连接线112与所述转换增益选择逻辑模块12连接;The pixel array 11 includes N rows of pixel units and M columns of pixel units 110. The M pixel units 110 in the same row are connected to the cache row decoding driving module 13 via a second connection line 111; the N pixel units 110 in the same column are connected to the conversion gain selection logic module 12 via a first connection line 112.
其中,所述转换增益选择逻辑模块12用于根据各所述像素单元110的第一像素输出信号,确定各像素单元110对应的双增益模式选择信号;The conversion gain selection logic module 12 is used to determine the dual gain mode selection signal corresponding to each pixel unit 110 according to the first pixel output signal of each pixel unit 110;
所述像素单元110用于在接收到所述缓存行解码驱动模块13发送的缓存控制信号的情况下,写入所述像素单元110对应的双增益模式选择信号,M和N均为正整数。The pixel unit 110 is used to write a dual gain mode selection signal corresponding to the pixel unit 110 when receiving a cache control signal sent by the cache row decoding driving module 13 , where M and N are both positive integers.
具体地,本申请实施例中所描述的像素阵列包括多个像素单元,其具体可以包括N个处于同一行的像素行,以及M个处于同一列的像素列,对应每个像素阵列中存在有NxM个像素单元。Specifically, the pixel array described in the embodiment of the present application includes a plurality of pixel units, which may specifically include N pixel rows in the same row and M pixel columns in the same column, corresponding to NxM pixel units in each pixel array.
本申请实施例中,转换增益选择逻辑模块,缓存行解码驱动模块均使用行/列并行走线布局对像素阵列进行信号传输或控制。 In the embodiment of the present application, the conversion gain selection logic module and the cache row decoding driving module both use a row/column parallel wiring layout to transmit or control signals to the pixel array.
具体地,为了进一步节省布线空间,同一行的M个像素单元会通过同一个连接线与缓存行解码驱动模块连接,相应地,像素阵列中的每个像素行均会通过其对应的连接线与缓存行解码驱动模块连接。Specifically, in order to further save wiring space, M pixel units in the same row are connected to the cache row decoding driver module through the same connection line. Accordingly, each pixel row in the pixel array is connected to the cache row decoding driver module through its corresponding connection line.
相应地,缓存行解码驱动模块可以分别向每个像素行传输缓存控制信号,更具体地,缓存行解码驱动模块可以向像素行中的每个像素单元传输对应的缓存控制信号。Accordingly, the cache row decoding driving module may transmit a cache control signal to each pixel row respectively. More specifically, the cache row decoding driving module may transmit a corresponding cache control signal to each pixel unit in the pixel row.
具体地,同样出于节省布线空间的考虑,同一列的N个像素单元也可以通过同一连接线与转换增益选择逻辑模块连接。Specifically, also for the consideration of saving wiring space, the N pixel units in the same column may also be connected to the conversion gain selection logic module through the same connection line.
本申请实施例中所描述的像素单元的第一像素输出信号具体可以是像素单元在当前帧,经过重置,曝光处理后输出的像素输出信号,每个像素单元的第一像素输出信号可以是不同的像素输出信号。The first pixel output signal of the pixel unit described in the embodiment of the present application may specifically be a pixel output signal output by the pixel unit in the current frame after being reset and exposed. The first pixel output signal of each pixel unit may be a different pixel output signal.
本申请实施例中所描述的转换增益选择逻辑模块具体用于根据各个像素单元的第一像素输出信号,根据该第一像素输出信号进一步判定各像素单元适合高增益模式还是低增益模式,进而得到各个像素单元对应的双增益模式选择信号。The conversion gain selection logic module described in the embodiment of the present application is specifically used to further determine whether each pixel unit is suitable for a high gain mode or a low gain mode based on the first pixel output signal of each pixel unit, and then obtain a dual gain mode selection signal corresponding to each pixel unit.
本申请实施例中,各像素单元对应的双增益模式选择信号可以是数字信号,也可以是模拟信号,该双增益模式选择信号会在这一帧时间内,控制像素单元按照双增益模式选择信号指示的增益模式进行像素信号的输出。In an embodiment of the present application, the dual gain mode selection signal corresponding to each pixel unit can be a digital signal or an analog signal. The dual gain mode selection signal will control the pixel unit to output the pixel signal according to the gain mode indicated by the dual gain mode selection signal within this frame time.
本申请实施例中所描述的缓存行解码驱动模块具体可以包括控制逻辑单元控制的解码和驱动器,缓存行解码驱动模块可以输出一行或者多行像素行的缓存控制信号,像素单元接收到该缓存控制信号后,可以激活像素单元内的缓存,并将双增益模式选择信号写入到像素单元的缓存中,以便于后续在进行像素输出信号读取时,根据双增益模式选择信号指示的增益模式对像素输出信号进行增益放大。The cache row decoding driver module described in the embodiment of the present application may specifically include a decoder and a driver controlled by a control logic unit. The cache row decoding driver module can output a cache control signal for one or more pixel rows. After the pixel unit receives the cache control signal, it can activate the cache in the pixel unit and write the dual gain mode selection signal into the cache of the pixel unit, so that when the pixel output signal is subsequently read, the pixel output signal can be gain amplified according to the gain mode indicated by the dual gain mode selection signal.
在本申请实施例中,转换增益选择逻辑模块可以根据每个像素单元的像素输出信号的采样,自动为每个像素单元确定其对应的双增益模式选择信号,并将双增益模式选择信号发送到对应的像素单元中,使得每个像素单元在每一帧时间内,可以根据双增益模式选择信号确定其应当工作于高增益模式或者低增益模式,从而实现像素级的增益调整,避免了对像素阵列整体调整导致的算力要求较高,以及调整效果较差的问题,并且每个像素单元的调整模式均是根据当前时间内的像素输出信号来确定的,保证了像素调整的准确性和有效性。In an embodiment of the present application, the conversion gain selection logic module can automatically determine the corresponding dual gain mode selection signal for each pixel unit based on the sampling of the pixel output signal of each pixel unit, and send the dual gain mode selection signal to the corresponding pixel unit, so that each pixel unit can determine whether it should operate in high gain mode or low gain mode according to the dual gain mode selection signal within each frame time, thereby realizing pixel-level gain adjustment, avoiding the high computing power requirements and poor adjustment effect caused by the overall adjustment of the pixel array, and the adjustment mode of each pixel unit is determined according to the pixel output signal in the current time, ensuring the accuracy and effectiveness of the pixel adjustment.
可选地,所述像素单元具体包括:像素内缓存器件,所述像素内缓存器件通过所述第一连接线与所述缓存行解码驱动模块连接;Optionally, the pixel unit specifically includes: an in-pixel cache device, the in-pixel cache device is connected to the cache row decoding driving module via the first connecting line;
其中,所述像素内缓存器件用于缓存所述双增益模式选择信号。Wherein, the in-pixel cache device is used to cache the dual-gain mode selection signal.
更具体地,在本申请实施例中,每个像素单元中均新增设置有像素内缓存器件,该像素内存换模块具体用于缓存该像素单元在当前帧时间内的双增益模式选择信号。More specifically, in the embodiment of the present application, an in-pixel cache device is newly provided in each pixel unit, and the in-pixel cache module is specifically used to cache the dual-gain mode selection signal of the pixel unit within the current frame time.
同一行的像素单元的像素内缓存器件均通过第一连接线与缓存行解码驱动模块连接,缓存行解码驱动模块在根据各像素单元的第一像素输出信号,确定各像素单元对应 的双增益模式选择信号后,会通过第一连接线将各像素单元对应的双增益模式选择信号传输到像素内缓存器件。The pixel cache devices in the same row of pixel units are connected to the cache row decoding driving module through the first connecting line. The cache row decoding driving module determines the corresponding pixel units according to the first pixel output signal of each pixel unit. After receiving the dual gain mode selection signal, the dual gain mode selection signal corresponding to each pixel unit is transmitted to the buffer device in the pixel through the first connecting line.
在像素单元接收到缓存行解码驱动模块发送的缓存控制信号后,像素单元会激活像素内缓存器件,接收缓存行解码驱动模块通过第一连接线输出的双增益模式选择信号,将接收到的双增益模式选择信号写入到像素内缓存器件中,删除像素内缓存器件中原本存储的上一帧时间的双增益模式选择信号。After the pixel unit receives the cache control signal sent by the cache row decoding driving module, the pixel unit activates the in-pixel cache device, receives the dual-gain mode selection signal output by the cache row decoding driving module through the first connecting line, writes the received dual-gain mode selection signal into the in-pixel cache device, and deletes the dual-gain mode selection signal of the previous frame time originally stored in the in-pixel cache device.
在本申请实施例中,通过像素内缓存器件可以分别存储每个像素单元对应的双增益模式选择信号,能够有效的实现逐个像素的像素调整,并且,像素内缓存器件可以在每一帧时间内有效更新像素内缓存器件中的双增益模式选择信号,有效实现逐个时间帧的像素调整处理,保证了图像调整的准确性。In the embodiment of the present application, the dual gain mode selection signal corresponding to each pixel unit can be stored separately through the in-pixel cache device, which can effectively realize pixel adjustment on a pixel by pixel basis, and the in-pixel cache device can effectively update the dual gain mode selection signal in the in-pixel cache device within each frame time, effectively realizing pixel adjustment processing on a time frame by time frame, thereby ensuring the accuracy of image adjustment.
可选地,所述转换增益选择逻辑模块包括:M个第一转换增益选择逻辑子模块,所述第一转换增益选择逻辑子模块包括:第一模式选择单元和第一模数转换单元,所述第一模式选择单元和第一模数转换单元连接;Optionally, the conversion gain selection logic module includes: M first conversion gain selection logic submodules, the first conversion gain selection logic submodule includes: a first mode selection unit and a first analog-to-digital conversion unit, the first mode selection unit and the first analog-to-digital conversion unit are connected;
其中,同一列的所述像素单元通过第三连接线与对应的所述第一模数转换单元连接,同一列的像素单元中的所述像素内缓存器件通过所述第一连接线与对应的所述第一模式选择单元连接;The pixel units in the same column are connected to the corresponding first analog-to-digital conversion unit through a third connection line, and the in-pixel buffer devices in the pixel units in the same column are connected to the corresponding first mode selection unit through the first connection line;
所述第一模数转换单元用于对所述像素单元的第一像素输出信号进行模数转换,得到第一像素输出数字信号;The first analog-to-digital conversion unit is used to perform analog-to-digital conversion on the first pixel output signal of the pixel unit to obtain a first pixel output digital signal;
所述第一模式选择单元用于对所述第一像素输出数字信号进行分析,得到双增益模式选择信号,并将所述双增益模式选择信号传输到对应像素单元的像素内缓存器件。The first mode selection unit is used to analyze the first pixel output digital signal to obtain a dual-gain mode selection signal, and transmit the dual-gain mode selection signal to the in-pixel cache device of the corresponding pixel unit.
图3为本申请实施例提供的转换增益选择逻辑模块结构示意图之一,如图3所示,包括:每个第一转换增益选择逻辑子模块121中包括:第一模式选择单元1211和第一模数转换单元1212,该第一模数转换单元具体可以是渐次逼近寄存器,第一模式选择单元1211和第一模数转换单元1212连接,图4为本申请实施例提供的图像传感器结构示意图之二,如图4所示,第一转换增益选择逻辑子模块121中包括:第一模式选择单元1211和第一模数转换单元1212,每一像素列中的像素单元110可以通过第三连接线与其对应的第一转换增益选择逻辑子模块121连接,即M个像素列连接有M个第一转换增益选择逻辑子模块。FIG3 is one of the schematic diagrams of the conversion gain selection logic module structure provided in an embodiment of the present application. As shown in FIG3 , each first conversion gain selection logic submodule 121 includes: a first mode selection unit 1211 and a first analog-to-digital conversion unit 1212. The first analog-to-digital conversion unit can specifically be a successive approximation register. The first mode selection unit 1211 and the first analog-to-digital conversion unit 1212 are connected. FIG4 is a second schematic diagram of the image sensor structure provided in an embodiment of the present application. As shown in FIG4 , the first conversion gain selection logic submodule 121 includes: a first mode selection unit 1211 and a first analog-to-digital conversion unit 1212. The pixel unit 110 in each pixel column can be connected to the corresponding first conversion gain selection logic submodule 121 via a third connecting line, that is, M pixel columns are connected with M first conversion gain selection logic submodules.
更具体地,在本申请实施例中,同一列的各个像素单元会通过第三连接线与其对应的第一模数转换单元连接,同时同一列的像素单元中的所述像素内缓存器件通过所述第一连接线与对应的所述第一模式选择单元连接。More specifically, in an embodiment of the present application, each pixel unit in the same column is connected to its corresponding first analog-to-digital conversion unit through a third connecting line, and at the same time, the pixel in-pixel cache device in the pixel unit in the same column is connected to the corresponding first mode selection unit through the first connecting line.
所述第一模数转换单元为逐次逼近寄存器;The first analog-to-digital conversion unit is a successive approximation register;
所述逐次逼近寄存器用于通过逐次逼近寄存器逻辑将所述第一像素输出信号转换为2比特数字信号,得到第一像素输出数字信号。The successive approximation register is used to convert the first pixel output signal into a 2-bit digital signal through a successive approximation register logic to obtain a first pixel output digital signal.
更具体地,像素列中各个像素单元的第一像素输出信号通过第三连接线首先进入第 一模数转换单元实现模数转换处理,将第一像素输出信号转换为数字信号,得到第一像素输出数字信号。More specifically, the first pixel output signal of each pixel unit in the pixel column first enters the first An analog-to-digital conversion unit implements analog-to-digital conversion processing to convert the first pixel output signal into a digital signal to obtain a first pixel output digital signal.
更具体地,本申请实施例中的第一模数转换单元具体可以采用采用了2-bit分辨率的逐次逼近寄存器(Successive Approximation Register,SAR)模数转换架构。通过逐次逼近寄存器逻辑SAR Logic将第一像素输出信号(φPIX)转换成2-bit数字信号(SAR_OUT[S1,S0]),即第一像素输出数字信号。More specifically, the first analog-to-digital conversion unit in the embodiment of the present application can specifically adopt a successive approximation register (SAR) analog-to-digital conversion architecture with a 2-bit resolution. The first pixel output signal (φPIX) is converted into a 2-bit digital signal (SAR_OUT[S1, S0]) through the successive approximation register logic SAR Logic, that is, the first pixel output digital signal.
第一模数转换单元中的VSAR和VREF为调制偏置(Bias)电压,用户可以通过改变这两个电压的大小以改变第一模数转换单元的可输入电压范围以及分辨率。V SAR and V REF in the first analog-to-digital conversion unit are modulation bias voltages. The user can change the input voltage range and resolution of the first analog-to-digital conversion unit by changing the magnitudes of these two voltages.
更具体地,第一模式选择单元会根据第一像素输出数字信息进行模式选择分析,进而得到各像素单元的双增益模式选择信号。More specifically, the first mode selection unit performs mode selection analysis according to the first pixel output digital information, and thereby obtains a dual-gain mode selection signal for each pixel unit.
第一模式选择单元在计算得到双增益模式选择信号后,可以通过第一连接线,将各像素单元对应的双增益选择信号传输到像素单元的像素内缓存器件。After calculating and obtaining the dual-gain mode selection signal, the first mode selection unit may transmit the dual-gain selection signal corresponding to each pixel unit to the in-pixel buffer device of the pixel unit through the first connection line.
可选地,所述第一模式选择单元,包括:第一加法器和模式选择逻辑子单元;Optionally, the first mode selection unit comprises: a first adder and a mode selection logic subunit;
其中,所述第一加法器用于将所述第一像素输出数字信号与预设增加阈值信号相加,得到加法器输出信号;Wherein, the first adder is used to add the first pixel output digital signal and a preset increase threshold signal to obtain an adder output signal;
所述模式选择逻辑子单元用于根据所述加法器输出信号得到双增益模式选择信号,并将所述双增益模式选择信号传输到对应像素单元的像素内缓存器件。The mode selection logic subunit is used to obtain a dual-gain mode selection signal according to the adder output signal, and transmit the dual-gain mode selection signal to the in-pixel cache device of the corresponding pixel unit.
更具体地,本申请实施例中用户也可能希望人为增加第一像素输出数字信号SAR_OUT[S1,S0]的输出值,因此可以进一步在第一模式选择单元中增加第一加法器,该第一加法器具体可以是配合2-bit第一像素输出数字信号的2-bit加法器。More specifically, in the embodiment of the present application, the user may also wish to artificially increase the output value of the first pixel output digital signal SAR_OUT[S1, S0], and therefore a first adder may be further added to the first mode selection unit. The first adder may specifically be a 2-bit adder that cooperates with the 2-bit first pixel output digital signal.
本申请实施例中所描述的预设增加阈值信号具体可以是预先设定的增加阈值信号CG_THR[T1,T0]。The preset increase threshold signal described in the embodiment of the present application may specifically be a preset increase threshold signal CG_THR[T1, T0].
第一加法器具体可以将第一像素输出数字信号SAR_OUT[S1,S0]和预设增加阈值信号CG_THR[T1,T0]相加后得到加法器输出信号,将加法器输出信号给逻辑选择单元进行处理。The first adder may specifically add the first pixel output digital signal SAR_OUT[S1, S0] and the preset increase threshold signal CG_THR[T 1 , T 0 ] to obtain an adder output signal, and send the adder output signal to the logic selection unit for processing.
本申请实施例中的模式选择逻辑子单元中具体可以配置有预设的真值表,其具体可以通过真值表一来匹配加法器输出信号对应的双增益模式选择信号。The mode selection logic subunit in the embodiment of the present application may be specifically configured with a preset truth table, which may specifically match the dual-gain mode selection signal corresponding to the adder output signal through truth table 1.
例如,真值表一如下表1所示: For example, the truth table 1 is shown in Table 1 below:
表1
Table 1
其中,[C,A1,A0]为加法器输出信号,(φDCG_SEL)为双增益模式选择信号,在(φDCG_SEL)取0时,双增益模式选择信号对应低增益模式,在(φDCG_SEL)取1时,双增益模式选择信号对应高增益模式。Among them, [C, A1, A0] is the adder output signal, (φDCG_SEL) is the dual gain mode selection signal, when (φDCG_SEL) is 0, the dual gain mode selection signal corresponds to the low gain mode, when (φDCG_SEL) is 1, the dual gain mode selection signal corresponds to the high gain mode.
可选地,在本申请实施例中,选择逻辑子单元中还预设有一个用户控制的主控信号CG_SET[I1,I0],通过这个预设的主控信号,可以指定输出的双增益模式选择信号的形式,从而实现在转换增益选择逻辑模块被屏蔽或者故障的情况下,继续通过高增益或者低增益模式进行正常运作,采集并输出图像。Optionally, in an embodiment of the present application, a user-controlled master control signal CG_SET[I1, I0] is preset in the selection logic subunit. Through this preset master control signal, the form of the output dual gain mode selection signal can be specified, so that when the conversion gain selection logic module is shielded or fails, it can continue to operate normally in high gain or low gain mode to collect and output images.
在模式选择逻辑子单元分析得到各像素对应的双增益模式选择信号,会将该双增益模式选择信号传输到对应像素单元的像素内缓存器件。The mode selection logic subunit analyzes and obtains the dual-gain mode selection signal corresponding to each pixel, and transmits the dual-gain mode selection signal to the pixel in-pixel cache device of the corresponding pixel unit.
在本申请实施例中,通过包含有第一模数转换单元的第一转换增益选择逻辑子模块来进行第一像素输出信号的采样,且该第一模数转换单元可以采用高速低功耗的模数转换单元,可以有效提高模式选择的速率,并降低运行功耗,同时该双增益模式选择信号的生成不依赖于外部设备的干预。In an embodiment of the present application, the first pixel output signal is sampled by a first conversion gain selection logic submodule including a first analog-to-digital conversion unit, and the first analog-to-digital conversion unit can adopt a high-speed and low-power analog-to-digital conversion unit, which can effectively improve the mode selection rate and reduce the operating power consumption. At the same time, the generation of the dual-gain mode selection signal does not rely on the intervention of external devices.
可选地,所述转换增益选择逻辑模块包括:M个第二转换增益选择逻辑子模块,所述第二转换增益选择逻辑子模块包括:第二模式选择单元和比较器单元,所述第二模式选择单元和所述比较器单元连接;Optionally, the conversion gain selection logic module includes: M second conversion gain selection logic submodules, the second conversion gain selection logic submodule includes: a second mode selection unit and a comparator unit, the second mode selection unit is connected to the comparator unit;
其中,同一列的所述像素单元通过第四连接线与对应的所述比较器单元连接,同一列的像素单元中的所述像素内缓存器件通过所述第一连接线与对应的所述第二模式选择单元连接;The pixel units in the same column are connected to the corresponding comparator units through a fourth connection line, and the in-pixel cache devices in the pixel units in the same column are connected to the corresponding second mode selection units through the first connection line;
其中,所述比较器单元用于根据预设调制偏置电压信号与所述第一像素输出信号,得到比较器单元输出信号;The comparator unit is used to obtain a comparator unit output signal according to a preset modulation bias voltage signal and the first pixel output signal;
所述第二模式选择单元用于根据所述比较器单元输出信号,确定双增益模式选择信号,并将所述双增益模式选择信号传输到对应像素单元的像素内缓存器件。The second mode selection unit is used to determine a dual-gain mode selection signal according to the output signal of the comparator unit, and transmit the dual-gain mode selection signal to the in-pixel buffer device of the corresponding pixel unit.
图5为本申请实施例提供的转换增益选择逻辑模块结构示意图之二,如图5所示,包括:M个第二转换增益选择逻辑子模块141,第二转换增益选择逻辑子模块141包括:第二模式选择单元1411和比较器单元1412,所述第二模式选择单元1411和所述比较器单元1412连接; FIG5 is a second schematic diagram of the conversion gain selection logic module structure provided in an embodiment of the present application. As shown in FIG5 , it includes: M second conversion gain selection logic submodules 141, the second conversion gain selection logic submodule 141 includes: a second mode selection unit 1411 and a comparator unit 1412, the second mode selection unit 1411 and the comparator unit 1412 are connected;
图6为本申请实施例提供的图像传感器结构示意图之三,如图6所示,第二转换增益选择逻辑子模块141包括:第二模式选择单元1411和比较器单元1412,每一像素列中的像素单元110可以通过第四连接线与其对应的第二转换增益选择逻辑子模块141连接,即M个像素列连接有M个第二转换增益选择逻辑子模块。FIG6 is a third schematic diagram of the image sensor structure provided in an embodiment of the present application. As shown in FIG6 , the second conversion gain selection logic submodule 141 includes: a second mode selection unit 1411 and a comparator unit 1412. The pixel unit 110 in each pixel column can be connected to its corresponding second conversion gain selection logic submodule 141 via a fourth connecting line, that is, M pixel columns are connected to M second conversion gain selection logic submodules.
更具体地,像素列通过第四连接线直接与第二转换增益选择逻辑子模块中的比较器单元连接,第二模式选择单元串联在比较器单元后,各像素单元的第一像素输出信号首先输入比较器单元与预设调制偏置电压信号VTHR进行比较分析,进而根据比较分析结果得到比较器单元输出信号。More specifically, the pixel column is directly connected to the comparator unit in the second conversion gain selection logic submodule through a fourth connecting line. After the second mode selection unit is connected in series to the comparator unit, the first pixel output signal of each pixel unit is first input into the comparator unit for comparison and analysis with a preset modulation bias voltage signal V THR , and then the comparator unit output signal is obtained according to the comparison and analysis result.
第二模式选择单元会进一步根据比较器单元输出信号来进行增益模式分析,得到各像素单元对应的双增益模式选择信号,然后第二模式选择单元会通过第一连接线,将该双增益模式选择信号传输到对应像素单元的像素内缓存器件。The second mode selection unit will further perform gain mode analysis based on the output signal of the comparator unit to obtain a dual gain mode selection signal corresponding to each pixel unit, and then the second mode selection unit will transmit the dual gain mode selection signal to the pixel cache device in the corresponding pixel unit through the first connecting line.
可选地,所述比较器单元,具体用于:Optionally, the comparator unit is specifically used to:
在所述预设调制偏置电压信号大于所述第一像素输出信号的情况下,所述比较器单元输出信号为低电平输出信号;When the preset modulation bias voltage signal is greater than the first pixel output signal, the comparator unit output signal is a low level output signal;
在所述预设调制偏置电压信号小于或等于所述第一像素输出信号的情况下,所述比较器单元输出信号为高电平输出信号;When the preset modulation bias voltage signal is less than or equal to the first pixel output signal, the comparator unit output signal is a high level output signal;
其中,所述第二模式选择单元用于根据所述低电平输出信号,确定所述双增益模式选择信号为低增益模式选择信号;Wherein, the second mode selection unit is used to determine that the dual-gain mode selection signal is a low-gain mode selection signal according to the low-level output signal;
或,所述第二模式选择单元用于根据所述高电平输出信号,确定所述双增益模式选择信号为高增益模式选择信号。Alternatively, the second mode selection unit is used to determine that the dual-gain mode selection signal is a high-gain mode selection signal according to the high-level output signal.
本申请实施例中所描述的预设调制偏置电压信号可以是外部输入的电压信号,其电压大小和周期均可以由用户进行预先调制。The preset modulation bias voltage signal described in the embodiment of the present application may be an externally input voltage signal, and its voltage magnitude and period may be pre-modulated by the user.
各像素单元输入的第一像素输出信号在进比较器单元后,会首先与预设调制偏置电压信号进行比较。After entering the comparator unit, the first pixel output signal inputted by each pixel unit is firstly compared with the preset modulation bias voltage signal.
当在所述预设调制偏置电压信号大于所述第一像素输出信号的情况下,比较器单元始终输出低电平(COMP_OUT=0),即此时的比较器单元输出信号为低电平输出信号。When the preset modulation bias voltage signal is greater than the first pixel output signal, the comparator unit always outputs a low level (COMP_OUT=0), that is, the output signal of the comparator unit at this time is a low level output signal.
在所述预设调制偏置电压信号小于或等于所述第一像素输出信号的情况下,比较器单元始终输出高电平(COMP_OUT=1),即此时的比较器单元输出信号为高电平输出信号。When the preset modulation bias voltage signal is less than or equal to the first pixel output signal, the comparator unit always outputs a high level (COMP_OUT=1), that is, the comparator unit output signal at this time is a high level output signal.
在得到比较器单元输出信号后,将其输入第二模式选择单元中进行计算,第二模式选择单元中可以配置有预设的真值表二,通过真值表2来匹配比较器单元输出对应的双增益模式选择。After the comparator unit output signal is obtained, it is input into the second mode selection unit for calculation. The second mode selection unit may be configured with a preset truth table 2, and the dual gain mode selection corresponding to the comparator unit output is matched through truth table 2.
例如,真值表二如下表2所示:
For example, truth table 2 is shown in Table 2 below:
其中,COMP_OUT为比较器单元输出信号,在比较器单元输出信号为低电平输出信号0时,确定双增益模式选择信号(φDCG_SEL)为低增益模式选择信号0,在比较器单元输出信号为高电平输出信号1时,确定所述双增益模式选择信号为高增益模式选择信号1。Among them, COMP_OUT is the comparator unit output signal. When the comparator unit output signal is a low-level output signal 0, the dual gain mode selection signal (φDCG_SEL) is determined to be a low gain mode selection signal 0. When the comparator unit output signal is a high-level output signal 1, the dual gain mode selection signal is determined to be a high gain mode selection signal 1.
可选地,本申请实施例中的第二模式选择单元中也预先配置有一个由用户控制的主控信号CG_SET[I1,I0]。通过这个预设的主控信号,可以指定输出的双增益模式选择信号的形式,从而实现在转换增益选择逻辑模块被屏蔽或者故障的情况下,继续通过高增益或者低增益模式进行正常运作,采集并输出图像。Optionally, the second mode selection unit in the embodiment of the present application is also pre-configured with a master control signal CG_SET[I1, I0] controlled by the user. Through this preset master control signal, the form of the output dual gain mode selection signal can be specified, so that when the conversion gain selection logic module is shielded or fails, it can continue to operate normally in high gain or low gain mode to collect and output images.
在本申请实施例中,通过一个简单的比较器单元,可以有效的提高增益模式选择信号的生成效率,同时有效精简转换增益选择逻辑模块在图像传感器中的占用面积,而转换增益选择逻辑模块针对于每个像素单元的第一像素输出信号计算其对应的双增益模式选择信号,能够有效实现针对于每个像素单元的增益模式调节,有效保证最后的成像效果。In the embodiment of the present application, a simple comparator unit is used to effectively improve the generation efficiency of the gain mode selection signal, while effectively reducing the occupied area of the conversion gain selection logic module in the image sensor. The conversion gain selection logic module calculates the corresponding dual gain mode selection signal for the first pixel output signal of each pixel unit, which can effectively implement the gain mode adjustment for each pixel unit and effectively ensure the final imaging effect.
可选地,所述像素阵列还包括:信号读取模块;Optionally, the pixel array further comprises: a signal reading module;
同一列的所述N个像素单元通过第五连接线与所述信号读取模块连接;The N pixel units in the same column are connected to the signal reading module via a fifth connecting line;
其中,所述信号读取模块用于读取各像素单元的第二像素输出信号,所述第二像素输出信号是所述像素单元根据写入的所述双增益模式选择信号对应的信号增益模式进行信号增益处理后得到的。The signal reading module is used to read the second pixel output signal of each pixel unit, and the second pixel output signal is obtained after the pixel unit performs signal gain processing according to the signal gain mode corresponding to the written dual gain mode selection signal.
具体地,本申请实施例中所描述的第五连接线可以与上述实施例中的第三连接线或者第四连接线是同一连接线。Specifically, the fifth connection line described in the embodiment of the present application may be the same connection line as the third connection line or the fourth connection line in the above embodiment.
本申请实施例中,在每一帧时间内,在各像素单元完成重置和曝光后,会进入读取阶段,此时信号读取模块会读取各像素单元的像素输出信号。In the embodiment of the present application, in each frame time, after each pixel unit completes resetting and exposure, it will enter the reading phase, at which time the signal reading module will read the pixel output signal of each pixel unit.
而在读取像素输出信号的过程中,会根据各像素单元中像素内缓存器件缓存的双增益模式选择信号确定该像素单元对应增益模式,即确定各像素单元是适用于高增益模式还是低增益模式。In the process of reading the pixel output signal, the corresponding gain mode of the pixel unit is determined according to the dual gain mode selection signal cached by the in-pixel cache device in each pixel unit, that is, whether each pixel unit is suitable for high gain mode or low gain mode.
在读取像素输出信号的过程中,根据像素单元对应的增益模式来输出信号,最终得到增益处理后的第二像素输出信号。In the process of reading the pixel output signal, the signal is output according to the gain mode corresponding to the pixel unit, and finally a second pixel output signal after gain processing is obtained.
可选地,在本申请实施例中,在得到第二像素输出信号后,该第二像素输出信号可以作为后一帧时间内的第一像素输出信号,来帮助后一帧的各像素单元选择其对应的双 增益模式选择信号。Optionally, in the embodiment of the present application, after the second pixel output signal is obtained, the second pixel output signal can be used as the first pixel output signal in the next frame time to help each pixel unit in the next frame select its corresponding dual Gain mode selection signal.
在一个可选地实施例中,本申请实施例中所描述的转换增益选择逻辑模块具体可以是简单的解码器,而每个像素单元所需的双增益模式选择信号具体可以是由外部模块提供的,通过转换增益选择逻辑模块可以将各像素单元所需的双增益模式选择信号进行发布。In an optional embodiment, the conversion gain selection logic module described in the embodiment of the present application can be specifically a simple decoder, and the dual gain mode selection signal required by each pixel unit can be specifically provided by an external module. The dual gain mode selection signal required by each pixel unit can be issued through the conversion gain selection logic module.
可选地,本申请实施例还提供一种包括上述图像传感器的摄像模组,通过该摄像模组能够在实现DCG-HDR功能的过程中,进行逐像素的调制,有效保证输出图像的成像效果。Optionally, an embodiment of the present application also provides a camera module including the above-mentioned image sensor, through which pixel-by-pixel modulation can be performed in the process of realizing the DCG-HDR function, thereby effectively ensuring the imaging effect of the output image.
可选地,本申请实施例还提供一种电子设备,该电子设备包括上述实施例中的摄像模组,该电子设备可以是终端,也可以为除终端之外的其他设备。示例性的,电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、移动上网装置(Mobile Internet Device,MID)、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、机器人、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,还可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。Optionally, the embodiment of the present application further provides an electronic device, which includes the camera module in the above embodiment, and the electronic device can be a terminal or other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.
本申请实施例中的电子设备可以为具有操作系统的装置。该操作系统可以为安卓The electronic device in the embodiment of the present application may be a device having an operating system. The operating system may be Android
(Android)操作系统,可以为iOS操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。(Android) operating system, may be an iOS operating system, or may be other possible operating systems, which are not specifically limited in the embodiments of the present application.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be noted that the scope of the method and device in the embodiment of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实 施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。 The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above specific embodiments. The above-mentioned specific implementation modes are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims (10)

  1. 一种图像传感器,包括:像素阵列,转换增益选择逻辑模块,缓存行解码驱动模块;An image sensor comprises: a pixel array, a conversion gain selection logic module, and a cache line decoding drive module;
    所述像素阵列包括N行像素单元和M列像素单元,同一列的N个像素单元通过第一连接线与所述转换增益选择逻辑模块连接;同一行的M个像素单元通过第二连接线与所述缓存行解码驱动模块连接;The pixel array includes N rows of pixel units and M columns of pixel units, the N pixel units in the same column are connected to the conversion gain selection logic module through a first connection line; the M pixel units in the same row are connected to the cache row decoding drive module through a second connection line;
    其中,所述转换增益选择逻辑模块用于根据各所述像素单元的第一像素输出信号,确定各像素单元对应的双增益模式选择信号;Wherein, the conversion gain selection logic module is used to determine the dual gain mode selection signal corresponding to each pixel unit according to the first pixel output signal of each pixel unit;
    所述像素单元用于在接收到所述缓存行解码驱动模块发送的缓存控制信号的情况下,写入所述像素单元对应的双增益模式选择信号,M和N均为正整数。The pixel unit is used to write a dual gain mode selection signal corresponding to the pixel unit when receiving a cache control signal sent by the cache row decoding driving module, and both M and N are positive integers.
  2. 根据权利要求1所述的图像传感器,其中,所述像素单元具体包括:像素内缓存器件,所述像素内缓存器件通过所述第一连接线与所述缓存行解码驱动模块连接;The image sensor according to claim 1, wherein the pixel unit specifically comprises: an in-pixel cache device, the in-pixel cache device is connected to the cache row decoding driver module through the first connection line;
    其中,所述像素内缓存器件用于缓存所述双增益模式选择信号。Wherein, the in-pixel cache device is used to cache the dual-gain mode selection signal.
  3. 根据权利要求2所述的图像传感器,其中,所述转换增益选择逻辑模块包括:M个第一转换增益选择逻辑子模块,所述第一转换增益选择逻辑子模块包括:第一模式选择单元和第一模数转换单元,所述第一模式选择单元和第一模数转换单元连接;The image sensor according to claim 2, wherein the conversion gain selection logic module comprises: M first conversion gain selection logic submodules, the first conversion gain selection logic submodule comprising: a first mode selection unit and a first analog-to-digital conversion unit, the first mode selection unit and the first analog-to-digital conversion unit are connected;
    其中,同一列的所述像素单元通过第三连接线与对应的所述第一模数转换单元连接,同一列的所述像素单元中的所述像素内缓存器件通过所述第一连接线与对应的所述第一模式选择单元连接;The pixel units in the same column are connected to the corresponding first analog-to-digital conversion unit through a third connection line, and the in-pixel buffer devices in the pixel units in the same column are connected to the corresponding first mode selection unit through the first connection line;
    所述第一模数转换单元用于对所述像素单元的第一像素输出信号进行模数转换,得到第一像素输出数字信号;The first analog-to-digital conversion unit is used to perform analog-to-digital conversion on the first pixel output signal of the pixel unit to obtain a first pixel output digital signal;
    所述第一模式选择单元用于对所述第一像素输出数字信号进行分析,得到双增益模式选择信号,并将所述双增益模式选择信号传输到对应像素单元的像素内缓存器件。The first mode selection unit is used to analyze the first pixel output digital signal to obtain a dual-gain mode selection signal, and transmit the dual-gain mode selection signal to the in-pixel cache device of the corresponding pixel unit.
  4. 根据权利要求3所述的图像传感器,其中,所述第一模数转换单元为逐次逼近寄存器;The image sensor according to claim 3, wherein the first analog-to-digital conversion unit is a successive approximation register;
    所述逐次逼近寄存器用于通过逐次逼近寄存器逻辑将所述第一像素输出信号转换为2比特数字信号,得到第一像素输出数字信号。The successive approximation register is used to convert the first pixel output signal into a 2-bit digital signal through a successive approximation register logic to obtain a first pixel output digital signal.
  5. 根据权利要求3所述的图像传感器,其中,所述第一模式选择单元,包括:第一加法器和模式选择逻辑子单元;The image sensor according to claim 3, wherein the first mode selection unit comprises: a first adder and a mode selection logic subunit;
    其中,所述第一加法器用于将所述第一像素输出数字信号与预设增加阈值信号相加,得到加法器输出信号;Wherein, the first adder is used to add the first pixel output digital signal and a preset increase threshold signal to obtain an adder output signal;
    所述模式选择逻辑子单元用于根据所述加法器输出信号得到双增益模式选择信号,并将所述双增益模式选择信号传输到对应像素单元的像素内缓存器件。The mode selection logic subunit is used to obtain a dual-gain mode selection signal according to the adder output signal, and transmit the dual-gain mode selection signal to the in-pixel cache device of the corresponding pixel unit.
  6. 根据权利要求2所述的图像传感器,其中,所述转换增益选择逻辑模块包括:M个第二转换增益选择逻辑子模块,所述第二转换增益选择逻辑子模块包括:第二模式选 择单元和比较器单元,所述第二模式选择单元和所述比较器单元连接;The image sensor according to claim 2, wherein the conversion gain selection logic module comprises: M second conversion gain selection logic submodules, and the second conversion gain selection logic submodule comprises: a second mode selection A selection unit and a comparator unit, wherein the second mode selection unit is connected to the comparator unit;
    其中,同一列的所述像素单元通过第四连接线与对应的所述比较器单元连接,同一列的像素单元中的所述像素内缓存器件通过所述第一连接线与对应的所述第二模式选择单元连接;The pixel units in the same column are connected to the corresponding comparator units through a fourth connection line, and the in-pixel cache devices in the pixel units in the same column are connected to the corresponding second mode selection units through the first connection line;
    所述比较器单元用于根据预设调制偏置电压信号与所述第一像素输出信号,得到比较器单元输出信号;The comparator unit is used to obtain a comparator unit output signal according to a preset modulation bias voltage signal and the first pixel output signal;
    所述第二模式选择单元用于根据所述比较器单元输出信号,确定双增益模式选择信号,并将所述双增益模式选择信号传输到对应像素单元的像素内缓存器件。The second mode selection unit is used to determine a dual-gain mode selection signal according to the output signal of the comparator unit, and transmit the dual-gain mode selection signal to the in-pixel buffer device of the corresponding pixel unit.
  7. 根据权利要求6所述的图像传感器,其中,所述比较器单元,具体用于:The image sensor according to claim 6, wherein the comparator unit is specifically used for:
    在所述预设调制偏置电压信号大于所述第一像素输出信号的情况下,所述比较器单元输出信号为低电平输出信号;When the preset modulation bias voltage signal is greater than the first pixel output signal, the comparator unit output signal is a low level output signal;
    在所述预设调制偏置电压信号小于或等于所述第一像素输出信号的情况下,所述比较器单元输出信号为高电平输出信号;When the preset modulation bias voltage signal is less than or equal to the first pixel output signal, the comparator unit output signal is a high level output signal;
    其中,所述第二模式选择单元用于根据所述低电平输出信号,确定所述双增益模式选择信号为低增益模式选择信号;Wherein, the second mode selection unit is used to determine that the dual-gain mode selection signal is a low-gain mode selection signal according to the low-level output signal;
    或,所述第二模式选择单元用于根据所述高电平输出信号,确定所述双增益模式选择信号为高增益模式选择信号。Alternatively, the second mode selection unit is used to determine that the dual-gain mode selection signal is a high-gain mode selection signal according to the high-level output signal.
  8. 根据权利要求1所述的图像传感器,其中,所述像素阵列还包括:信号读取模块;The image sensor according to claim 1, wherein the pixel array further comprises: a signal reading module;
    同一列的所述N个像素单元通过第五连接线与所述信号读取模块连接;The N pixel units in the same column are connected to the signal reading module via a fifth connecting line;
    其中,所述信号读取模块用于读取各像素单元的第二像素输出信号,所述第二像素输出信号是所述像素单元根据写入的所述双增益模式选择信号对应的信号增益模式进行信号增益处理后得到的。The signal reading module is used to read the second pixel output signal of each pixel unit, and the second pixel output signal is obtained after the pixel unit performs signal gain processing according to the signal gain mode corresponding to the written dual gain mode selection signal.
  9. 一种摄像模组,包括如权利要求1-8任一所述的图像传感器。A camera module, comprising the image sensor as described in any one of claims 1-8.
  10. 一种电子设备,包括如权利要求9所述的摄像模组。 An electronic device comprises the camera module as claimed in claim 9.
PCT/CN2023/142085 2022-12-30 2023-12-26 Image sensor, camera module and electronic device WO2024140724A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211736330.8 2022-12-30

Publications (1)

Publication Number Publication Date
WO2024140724A1 true WO2024140724A1 (en) 2024-07-04

Family

ID=

Similar Documents

Publication Publication Date Title
US20070211156A1 (en) Image sensor with interleaved image output
JP6614133B2 (en) Imaging device, control method, and imaging apparatus
AU2016370324A1 (en) Imaging method, imaging device, and electronic device
US11323638B2 (en) Method of correcting dynamic vision sensor (DVS) events and image sensor performing the same
US11317038B2 (en) Pixel unit with a design for half row reading, an imaging apparatus including the same, and an imaging method thereof
WO2023173634A1 (en) Image output method, and image sensor and application thereof
US6922210B2 (en) Memory updating for digital pixel sensors
US9843746B2 (en) Image sensor combining high dynamic range techniques
KR20230135501A (en) Image sensor and its image output method and application
WO2017101864A1 (en) Image sensor, control method, and electronic device
US10051216B2 (en) Imaging apparatus and imaging method thereof using correlated double sampling
Tang et al. A high-dynamic range CMOS camera based on dual-gain channels
JP2024079754A (en) Image pickup device, image pickup method, and program
JP2002218455A (en) Method and device for data transmission
KR20160015712A (en) Apparatus and method for capturing images
WO2017101562A1 (en) Image sensor, terminal having same, and imaging method
WO2024140724A1 (en) Image sensor, camera module and electronic device
US11729531B2 (en) Image sensor using multiple transfer, and operating method of the image sensor
CN116055905A (en) Image sensor, camera module and electronic equipment
WO2024140769A1 (en) Image sensor, sensor architecture, camera module, and electronic device
WO2024140873A1 (en) Image sensor, sensor architecture, camera module and electronic device
US20190147560A1 (en) Frameless random-access image sensing
US20240098375A1 (en) Method of operating image sensor and image device performing the same
WO2024140886A1 (en) Image processor, photographic module and electronic device
US20230209226A1 (en) Image Sensors with On-Chip ADC Data Compression for Multi-Bit Electron-Number Outputs