WO2024050947A1 - Module de détection de variation d'intensité lumineuse et capteur d'image - Google Patents

Module de détection de variation d'intensité lumineuse et capteur d'image Download PDF

Info

Publication number
WO2024050947A1
WO2024050947A1 PCT/CN2022/129069 CN2022129069W WO2024050947A1 WO 2024050947 A1 WO2024050947 A1 WO 2024050947A1 CN 2022129069 W CN2022129069 W CN 2022129069W WO 2024050947 A1 WO2024050947 A1 WO 2024050947A1
Authority
WO
WIPO (PCT)
Prior art keywords
light intensity
intensity change
change detection
subunit
current
Prior art date
Application number
PCT/CN2022/129069
Other languages
English (en)
Chinese (zh)
Inventor
陈守顺
郭梦晗
杨文磊
Original Assignee
豪威芯仑传感器(上海)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 豪威芯仑传感器(上海)有限公司 filed Critical 豪威芯仑传感器(上海)有限公司
Publication of WO2024050947A1 publication Critical patent/WO2024050947A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/47—Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data

Definitions

  • the present invention relates to the technical field of image sensors, and in particular, to a light intensity change detection module and an image sensor.
  • a dynamic visual image sensor that only senses dynamic information in the field of view has attracted more and more attention due to its advantages in the field of motion detection.
  • the dynamic vision image sensor abandons the concept of image frames. It only focuses on the dynamic components in the field of view that cause light intensity changes and automatically filters out useless background information.
  • each pixel unit in the sensor no longer passively senses the external light intensity, but actively monitors light intensity changes in real time and outputs its own position information when the light intensity changes meet certain conditions.
  • useless background information is automatically filtered out at the sensor level, and the dynamic vision image sensor only outputs data stream information of useful pixel units, thus saving output bandwidth.
  • the back-end image processing system can directly obtain and process useful dynamic information in the field of view, which can greatly reduce its storage and computing power requirements and achieve better real-time performance.
  • flash short-term light intensity changes
  • this "flash” has nothing to do with the movement of the object but is just an instantaneous or periodic change in light intensity at certain locations in the field of view.
  • LED light that flashes at a fixed frequency indoors.
  • Periodic flashes appear in all areas of the field of view, causing all pixel units to detect changes in light intensity and output them by the sensor.
  • this part of the data output by the sensor It cannot accurately represent the motion information of the object. If data is not differentiated, the performance of various motion detection algorithms executed by the back-end processor will decrease, which limits the application scenarios of dynamic vision sensors. .
  • the present invention provides a light intensity change detection module and an image sensor, in an attempt to solve or at least alleviate at least one of the above problems.
  • a light intensity change detection module including: a plurality of light intensity change detection pixel units, the light intensity change detection pixel unit being adapted to respond to light intensity changes in the field of view and detect the light intensity change in the field of view.
  • the light intensity change detection control unit is coupled to each light intensity change detection pixel unit and is adapted to be based on the current pulse signal from each light intensity change detection pixel unit.
  • the light intensity change detection pixel unit is also adapted to be set after entering the trigger state to re-respond to light intensity changes in the field of view and Continuously output the current pulse signal to the light intensity change detection control unit; and the light intensity change detection control unit is also adapted to determine whether the light intensity change is a periodic light intensity change based on the pulse signal, and when the light intensity change is a periodic light intensity change, When, the frequency information of the light intensity change is generated and output.
  • the light intensity change detection control unit includes: a light intensity change determination subunit, adapted to receive current pulses from all light intensity change detection units via the current pulse output signal line signal, and when the total pulse current is greater than the threshold, a pulse signal is generated; the pulse frequency judgment subunit is suitable for judging whether the pulse signal is a periodic signal by calculating the time difference between multiple pulse signals. If the pulse signal is Periodic signal, then the light intensity changes are periodic light intensity changes.
  • the pulse frequency judgment subunit is also adapted to calculate the time difference between adjacent pulses, and when the time difference between adjacent pulse signals is the same,
  • the pulse signal is determined to be a periodic signal; and the pulse frequency determination subunit is also adapted to calculate the frequency information of the light intensity change based on the time difference when it is determined that the light intensity change is a periodic light intensity change.
  • the light intensity change detection pixel unit includes: a photoelectric detection subunit, suitable for real-time monitoring of the light signal irradiated on it, and outputting a corresponding electrical signal; triggering generation A subunit, a first input end of which is coupled to the photodetection subunit, and a first output end of which is coupled to the logic subunit, and the trigger generation subunit is adapted to generate a trigger generation signal to the logic when the electrical signal meets a predetermined condition.
  • Subunit a logic subunit, the input end of which is coupled to the trigger generation subunit, the output end is coupled to the current pulse generation subunit, and the logic subunit is adapted to output a signal to the current pulse generation subunit when receiving the trigger generation signal;
  • the current pulse generating subunit is adapted to generate and output the current pulse signal when receiving the output signal of the logic subunit.
  • the logic subunit includes a latch and a delay circuit.
  • the latch When the trigger generation signal is received, the latch is set and delayed. After the delay of the circuit, the latch is restored to the reset state; and the output signal of the latch is the reset signal of the trigger generation subunit, so that during the latch setting period, the trigger generation subunit is reset.
  • the current pulse generation subunit includes: a current source; a transistor, its gate is connected to the output of the logic subunit, its source is connected to the current source, and its drain passes the current
  • the pulse output signal line is coupled with the light intensity change detection control unit.
  • the light intensity change determination subunit includes: a reference current source; a current comparator, the non-inverting input terminal of which is connected to the current pulse output signal line, and the inverting input terminal is connected to the reference current source, the output end of which is connected to the pulse frequency confirmation subunit, and is suitable for outputting a pulse signal to the pulse frequency judgment subunit when it is judged that the total pulse current from the current pulse output signal line exceeds the reference current source.
  • the light intensity change determination subunit includes: a current analog-to-digital converter, the input terminal of which is connected to the current pulse output signal line, and the output terminal of which is connected to a digital comparator, suitable for Quantize the total current pulse into a digital signal and output it to a digital comparator; the input terminal of the digital comparator is connected to the current analog-to-digital converter, and its output terminal is connected to the pulse frequency judgment subunit, which is suitable for confirming the output of the current analog-to-digital converter. After exceeding the threshold, the pulse signal is output to the pulse frequency judgment subunit.
  • the threshold value is determined based on at least the number of light intensity change detection pixel units.
  • a plurality of light intensity change detection pixel units are arranged around the main pixel array, and the main pixel array is adapted to trigger the corresponding response when the light intensity change in the field of view reaches a predetermined condition.
  • main pixel unit and output at least the address information of the triggered main pixel unit; and the number of light intensity change detection pixel units is determined based on the main pixel array.
  • a method for detecting periodic light intensity changes is provided, which is suitable for execution in the light intensity change detection module as described above, including: generating a current by monitoring light intensity changes in the field of view. Pulse signal, wherein the current pulse signal is generated when the light intensity change meets a predetermined condition; determine whether to generate a pulse signal by judging the size of the current pulse signal; repeat the steps of iteratively monitoring changes in light intensity and judging the size of the current pulse signal to generate Multi-segment pulse signals; and determining whether the light intensity change is a periodic light intensity change by calculating the time difference between the multi-segment pulse signals.
  • the method according to the present invention further includes: when it is determined that the light intensity change is a periodic light intensity change, outputting frequency information of the light intensity change.
  • determining whether to generate a pulse signal by judging the size of the current pulse signal includes: when the total instantaneous current of the received current pulse signal is greater than the threshold, confirming that the pulse signal is generated.
  • an image sensor including: core circuit components, adapted to trigger the corresponding main pixel unit when the light intensity change in the field of view meets a predetermined condition, and at least output the triggered main pixel unit
  • the address information e.g., the light intensity change detection module as described above is arranged around the main pixel array and is suitable for detecting periodic light intensity changes based on light intensity changes in the field of view.
  • the core circuit component includes a main pixel array, and the main pixel array includes a plurality of main pixel units; the number of light intensity change detection pixel units in the light intensity change detection module is determined by the main pixel array. Determine the number of rows and columns.
  • the detection of periodic light intensity changes in the field of view can be realized, and the changes in the visual field can be detected.
  • the frequency information of the light intensity changes is output to the back-end processing unit. According to the solution of the present invention, the interference of such periodic light intensity changes in the field of view on the output data of the dynamic vision sensor can be effectively reduced, and the performance of motion detection can be improved.
  • the light intensity change detection module does not need to be coupled to the core circuit components.
  • the core circuit components and the light intensity change detection module can independently complete their respective tasks without affecting each other, improving the working efficiency of the image sensor; on the other hand, the light intensity change detection module
  • the change detection module is easy to deploy by simply determining the number of light intensity change detection pixel units based on the main pixel array in the core circuit assembly.
  • Figure 1 shows a schematic diagram of an image sensor 100 according to some embodiments of the invention
  • Figure 2 shows a schematic diagram of a light intensity change detection module 200 according to some embodiments of the present invention
  • Figure 3 shows a schematic diagram of a current pulse generation subunit 240 according to some embodiments of the present invention
  • Figure 4 shows a schematic diagram of a light intensity change detection control unit 400 according to some embodiments of the present invention
  • 5A and 5B respectively show a schematic diagram of the light intensity change determination subunit 410 according to some embodiments of the present invention.
  • Figure 6 shows a schematic flowchart of a method 600 for detecting periodic light intensity changes according to some embodiments of the present invention.
  • the dynamic vision image sensor detects dynamic information in the field of view at the pixel level.
  • Each pixel unit in the dynamic vision sensor monitors changes in light intensity in real time, and confirms that a pixel event occurs after the change reaches a predetermined condition (the predetermined condition is, for example, a preset value or a preset interval, etc., but is not limited to this), and Output pixel event information (for example, position information of the pixel unit). Since the movement of the object will cause the light intensity of the corresponding area in the field of view perceived by the corresponding pixel unit to change, the moving object in the field of view can be detected.
  • the back-end processor can extract valid objects in a variety of ways Events generated by motion improve the signal-to-noise ratio of event signals. For example, the back-end processing unit can extract events generated by object movement within this period of time by differencing the corresponding event frames according to the light intensity conversion frequency. Due to the periodicity of light intensity changes, it will generate irrelevant events at fixed times and locations. This redundant information can be easily removed by making a difference between the previous and later event frames. In addition, for light intensity changes with a short change time, the back-end processing unit can also periodically reset the dynamic vision sensor for a short period of time according to the frequency of light intensity changes to block out the light intensity changes.
  • a solution for detecting periodic light intensity changes in the field of view is provided.
  • the frequency information of the light intensity change can be provided to the back-end processing unit for processing by the back-end processing unit.
  • Figure 1 shows a schematic diagram of an image sensor 100 according to some embodiments of the invention.
  • the image sensor 100 adds an independent circuit component to the existing structure of the dynamic vision sensor for detecting periodic light intensity changes in the field of view. According to an implementation manner, the image sensor 100 is coupled to an external image acquisition system and transmits the output data to the external image acquisition system for further calculation and processing.
  • the embodiments of the present invention are not limited to this.
  • the image sensor 100 at least includes: a core circuit component 110 and a light intensity change detection module 120 .
  • the core circuit component 110 completes the core function of the image sensor 100: detecting changes in light intensity and outputting pixel event information.
  • the core circuit component 110 mainly includes a plurality of main pixel units. When the light intensity change in the field of view reaches a predetermined condition, the main pixel unit in the corresponding area will be triggered, and the output of the core circuit component 110 will be triggered. Address information of the pixel unit.
  • the core circuit component 110 can also output time information of the triggered main pixel unit.
  • the light intensity change detection module 120 is arranged around the core circuit component 110 and is used to detect and determine periodic light intensity changes in the field of view. At the same time, the light intensity change detection module 120 will also detect periodic light when it detects periodic light. When the intensity changes, calculate the frequency of light intensity changes.
  • the core circuit component 110 detects and outputs dynamic information in the field of view. Further, the core circuit component 110 further includes: a main pixel array 112, a readout unit 114, and a main pixel array control unit 116. 1 , the main pixel array 112 is composed of multiple identical pixel acquisition circuits (or “main pixel units”) in one or two dimensions. A 3 ⁇ 3 main pixel array is shown in Figure 1, but is not limited thereto. Each main pixel unit independently and real-time monitors the light intensity changes in the corresponding area of the field of view, and enters the trigger state when it senses that the light intensity changes meet predetermined conditions (for example, the light intensity changes exceed a preset value).
  • the preset value of the light intensity change that can be determined by the main pixel unit can be adjusted according to different application scenarios through a filter (such as a high-pass filter) arranged in the main pixel unit to ensure that only a certain preset value is reached. Changes in light intensity at the set value are considered "movement" and are monitored.
  • the main pixel unit enters the trigger state, it sends a request signal to the peripheral readout unit 114.
  • the readout unit 114 sends the address information (including row address and column address) of the main pixel unit 200. ) is encoded and output.
  • the main pixel array control unit 116 is coupled to each main pixel unit through a global reset signal line, and sends a global reset signal to the main pixel unit to control the state of each main pixel unit.
  • the working state of the core circuit component 110 depends on the global reset signal sent by the main pixel array control unit 116 .
  • the main pixel array control unit 116 sends a global reset signal to each main pixel unit in the main pixel array 112 through the global reset signal line to turn off the main pixel unit so that it no longer responds to changes in light intensity in the field of view.
  • the entire main pixel array 112 is initialized.
  • the readout unit 114 is also reset, and the core circuit component 110 enters the light intensity detection reset state, does not respond to light intensity changes in the field of view, and does not output data.
  • the core circuit component 110 of the image sensor 100 enters the light intensity detection enable state and begins to operate normally.
  • the light intensity change detection module 120 arranged on the periphery of the core circuit component 110 is mainly used to detect periodic light intensity changes in the field of view that are not related to the movement of objects.
  • the light intensity change is global.
  • the light intensity change detection module 120 further includes a plurality of light intensity change detection pixel units 200 and a light intensity change detection control unit 400 .
  • the light intensity change detection pixel unit 200 is used to detect whether there is a global light intensity change phenomenon in the field of view.
  • the light intensity change detection control unit 400 serves as the global light intensity change determiner of the dynamic vision sensor, used to manage the light intensity change detection pixel unit 200, and obtains the result by calculating the interval time of the light intensity change when determining that the global light intensity change phenomenon occurs. The frequency of light intensity changes.
  • the light intensity change detection pixel units 200 are distributed in the form of an array on the periphery of the main pixel array 112 .
  • at least one row/column of light intensity change detection pixel units 200 are respectively arranged in the four directions of upper, lower, left and right of the main pixel array 112, that is, light intensity change detection pixel rows or light intensity Change detection pixel column.
  • the number of light intensity change detection pixel units 200 is determined by the number of rows and columns of the main pixel units in the main pixel array.
  • the number of light intensity change detection pixel units 200 in the light intensity change detection pixel row is consistent with the number of columns of the main pixel array 112; the number of light intensity change detection pixel units 200 in the light intensity change detection pixel column is consistent. , consistent with the number of rows of the main pixel array 112 .
  • one row/column of light intensity change detection pixel units 200 are respectively arranged in the four directions of the main pixel array 112 in the upper, lower, left, and right directions, and the number of light intensity change detection pixel units 200 in each row/column is Both are 3.
  • FIG. 1 only shows that the light intensity change detection pixel units 200 are distributed above and to the right of the main pixel array 112, and three light intensity change detection pixel units 200 form a light intensity change unit.
  • the detection pixel row consists of three light intensity change detection pixel units 200 forming a light intensity change detection pixel column. It should be understood that FIG. 1 is only for illustration, and only shows part of the light intensity change detection pixel unit 200 .
  • the basic function of the light intensity change detection pixel unit 200 is basically the same as that of the main pixel unit, which is to detect light intensity in a corresponding area in the field of view.
  • the light intensity change detection pixel unit 200 can respond to the light intensity change in the corresponding area of the field of view and enter the trigger state and generate a current pulse signal after the change meets a predetermined condition.
  • the light intensity change detection control unit 400 is connected to all the light intensity change detection pixel units 200 through current pulse output signal lines. In this way, the light intensity change detection control unit 400 determines whether there is a global light intensity change in the field of view through the received current pulse signal; and when it is confirmed that there is a global light intensity change, it continues to determine the global light intensity change. Is it cyclical? When it is a periodic light intensity change, the light intensity change detection control unit 400 calculates and outputs the frequency information of the light intensity change to the back-end processing unit.
  • the image sensor 100 of the present invention without changing the structure of the original dynamic vision sensor, it is possible to detect periodic light intensity changes in the field of view by adding a set of pixel units for detecting changes in light intensity. detection, and when there are periodic light intensity changes in the field of view, the frequency information of the light intensity changes is output to the back-end processing unit. According to the solution of the present invention, the interference of such periodic light intensity changes in the field of view on the output data of the dynamic vision sensor can be effectively reduced, and the performance of motion detection can be improved.
  • the light intensity change detection module 120 does not need to be coupled to the core circuit component 110.
  • the core circuit component 110 and the light intensity change detection module 120 can independently complete their respective tasks without affecting each other, improving the working efficiency of the image sensor; on the other hand,
  • the light intensity change detection module 120 is easy to deploy, and only the number of light intensity change detection pixel units is determined according to the main pixel array in the core circuit component 110 .
  • the core circuit component 110 please refer to the relevant content of the dynamic vision sensor, and there will not be too many restrictions here.
  • the light intensity change detection module 120 in the image sensor 100 will be further explained below with reference to the figures.
  • FIG. 2 shows a schematic diagram of the light intensity change detection pixel unit 200 in the light intensity change detection module 120 according to an embodiment of the present invention.
  • the light intensity change detection pixel unit 200 includes a photodetection subunit 210 , a trigger generation subunit 220 , a logic subunit 230 and a current pulse generation subunit 240 .
  • the structures and functions of the photodetection subunit 210 and the trigger generation subunit 220 are completely consistent with those of the main pixel unit.
  • the photodetection subunit 210 monitors the light signal irradiated thereon in real time and outputs a corresponding electrical signal.
  • the photodetection subunit 210 is a logarithmic photodetector, which includes a photodiode PD1 with an anode grounded, a first transistor T1 and a first amplifier A1 .
  • the source of the first transistor T1 is connected to the cathode of the photodiode PD1, and the drain of the first transistor T1 is connected to the power supply VDD.
  • the first amplifier A1 is connected between the cathode of the photodiode PD1 and the gate of the first transistor T1.
  • A1 can improve the response speed of voltage changes between the source and gate of T1.
  • the first input end of the trigger generation subunit 220 is coupled to the photodetection subunit 210, and its first output end is coupled to the logic subunit 230.
  • the trigger generation subunit 220 When the electrical signal meets the predetermined condition, the trigger generation subunit 220 generates a trigger generation signal to Logic subunit 230.
  • the trigger generation subunit 220 further includes a preprocessing module 221 and a threshold comparison module 222.
  • the preprocessing module 221 in the trigger generation subunit 220 includes an amplifier A2.
  • the threshold comparison module 222 in the trigger generation sub-unit 220 includes a first voltage comparator VC1, a second voltage comparator VC2 and an OR logic unit.
  • the inverting input terminal of the first voltage comparator VC1 is connected to a fixed level, which is the first threshold of the threshold comparison module 222, and the non-inverting input terminal of the first voltage comparator VC1 is connected to the output of the preprocessing module 221.
  • the non-inverting input terminal of the second voltage comparator VC2 is connected to a fixed level, which is the second threshold of the threshold comparison module 222 , and its inverting input terminal is connected to the output of the preprocessing module 221 .
  • the OR logic unit ORs the outputs of the two voltage comparators.
  • the OR logic unit When the output signal of the preprocessing module 221 is greater than the first threshold or less than the second threshold (that is, the light intensity change meets the predetermined condition), the OR logic unit outputs a valid trigger generation signal and sends it to the back-end logic sub-unit 230 .
  • the input terminal of the logic subunit 230 is coupled to the trigger generation subunit 220 , and the output terminal is coupled to the current pulse generation subunit 240 .
  • the logic subunit 230 When receiving the trigger generation signal, the logic subunit 230 outputs a signal to the current pulse generation subunit 240 .
  • the logic subunit 230 when receiving the trigger generation signal, the logic subunit 230 outputs a high level to the current pulse generation subunit 240; otherwise, the logic subunit 230 outputs a low level to the current pulse generation subunit 240.
  • the current pulse generating subunit 240 After receiving the output signal of the logic subunit 230, the current pulse generating subunit 240 generates and outputs a current pulse signal.
  • logic subunit 230 includes a latch and delay circuit.
  • the latch When the trigger generation signal is received, the latch is set, and after the delay of the delay circuit, the latch is restored to the reset state.
  • the output signal of the latch serves as a reset signal for the trigger generation subunit 220, so that during the latch setting period, the trigger generation subunit is reset to prepare for the next detection of light intensity change.
  • the output signal of the latch serves as a reset signal for the amplifier in the preprocessing module 221 to reset the trigger generation subunit 220 .
  • the current pulse generating subunit 240 receives the output signal of the logic subunit 230, converts it into a current pulse signal, and sends it to the current pulse output signal line. Specifically, during the period when the light intensity change detection pixel unit 200 detects a change in light intensity and sets the latch, the current pulse generation subunit 240 generates a fixed current to the current pulse output signal line; conversely, when there is no change in light intensity When detected, there is no current on the current pulse output signal line.
  • Figure 3 shows a schematic diagram of a current pulse generation subunit 240 according to some embodiments of the present invention.
  • the current pulse generation subunit 240 includes a transistor M1 and a current source I1. As shown in FIG. 3 , the gate of the transistor M1 is connected to the output of the logic subunit 230 , the source is connected to the current source I1 , and the drain is coupled to the light intensity change detection control unit 400 through the current pulse output signal line. It should be noted that the current pulse output signal line is coupled to all the light intensity change detection pixel units 200 in the light intensity change detection module 120 to automatically realize the current summation function.
  • the logic subunit 230 When the light intensity change detection pixel unit 200 is not triggered, the logic subunit 230 outputs a low level, the transistor M1 is turned off, and the current of the current source I1 will not flow through the current pulse output signal line; when the light intensity change detection pixel unit 200 is triggered When triggered, the logic subunit 230 outputs a high level, the transistor M1 is turned on, and the current of the current source I1 flows through the current pulse output signal line.
  • each sub-unit in the light intensity change detection pixel unit 200 has multiple implementation methods, and embodiments of the present invention are not limited thereto.
  • Figure 4 shows a schematic diagram of a light intensity change detection control unit 400 according to some embodiments of the present invention.
  • the light intensity change detection control unit 400 resets all light intensity change detection pixel units 200 at the initial moment of power-on, and then monitors the current magnitude on the current pulse output signal line in real time. In some embodiments, at the initial power-on moment, the light intensity change detection control unit 400 resets the trigger generation sub-unit 220 and the logic sub-unit 230 in the light intensity change detection pixel unit 200 through the initial reset signal line (see Figure 2).
  • the light intensity change detection control unit 400 mainly includes: a light intensity change judgment sub-unit 410 and a pulse frequency judgment sub-unit 420.
  • the light intensity change determination subunit 410 receives current pulse signals from all light intensity change detection pixel units 200 through the current pulse output signal line. As mentioned above, the current pulse output signal line is coupled to all light intensity change detection pixel units 200 , can automatically realize the function of current summation. Therefore, the light intensity change determination subunit 410 obtains the total pulse current at the current moment, that is, the total instantaneous current, through the current pulse output signal line.
  • the total instantaneous current represents the number of light intensity change detection pixel units 200 triggered in the light intensity change detection module 120 at the current moment, that is, the global light intensity change in the field of view. When the total pulse current is greater than the threshold, it outputs a pulse signal to the pulse frequency determination subunit 420.
  • 5A and 5B respectively show schematic diagrams of the light intensity change determination subunit according to some embodiments of the present invention.
  • the light intensity change determination subunit 410 includes a current comparator and a reference current source.
  • the non-inverting input terminal of the current comparator is connected to the current pulse output signal line
  • the inverting input terminal is connected to the reference current source
  • the output terminal of the current comparator is connected to the pulse frequency confirmation subunit 420 .
  • the current comparator determines the size of the total pulse current from the current pulse output signal line and the reference current source, and outputs the pulse signal to the pulse frequency determination subunit 420 when the total pulse current exceeds the reference current source.
  • the reference current source indicates the threshold.
  • the threshold is determined based on at least the number of light intensity change detection pixel units 200. Generally speaking, while keeping other conditions unchanged, the greater the number of light intensity change detection pixel units 200 in the light intensity change detection module 120, the greater the threshold value. The bigger.
  • the light intensity change determination subunit 410 includes a current analog-to-digital converter (ADC, Analog-to-Digital Converter) and a digital comparator.
  • ADC Analog-to-Digital Converter
  • the current ADC quantizes the input total current pulse into a digital signal, and the back-end digital
  • the comparator determines whether the output of the current ADC exceeds the threshold, and after confirming that the output of the current ADC exceeds the threshold, outputs a pulse signal to the pulse frequency determination subunit 420 .
  • the selection of the threshold please refer to the relevant description of Figure 5A.
  • the pulse frequency determination subunit 420 determines whether the pulse signal output by the light intensity change determination subunit 410 is a periodic signal. According to one embodiment, the pulse frequency determination subunit 420 calculates the time difference between adjacent pulses, and determines that the received pulse signal is a periodic signal when the time difference between adjacent pulses is the same.
  • the pulse frequency determination subunit 420 confirms that the corresponding light intensity change is a periodic light intensity change.
  • the pulse frequency determination subunit 420 calculates the frequency of light intensity change based on the time difference between adjacent pulses. Specifically, the time difference between adjacent pulses is the light intensity change period, and the frequency of light intensity change can also be obtained through conversion.
  • the pulse frequency determination subunit 420 outputs the frequency of light intensity changes to the back-end processing unit as a detection output of periodic light intensity.
  • the pulse frequency determination subunit 420 can adopt a general period detection method, such as a counter-based detection method, which will not be described again here.
  • the detection of periodic light intensity changes in the field of view can be realized.
  • the light intensity change detection module does not need to be coupled to the core circuit components.
  • the core circuit components and the light intensity change detection module can independently complete their respective tasks without affecting each other, improving the working efficiency of the image sensor; on the other hand, the light intensity change detection module
  • the detection module is easy to deploy, just determine the number of light intensity change detection pixel units according to the main pixel array in the core circuit component.
  • the light intensity change detection module will also output the frequency information of the light intensity change to the back-end processing unit when it detects periodic light intensity changes in the field of view. According to the solution of the present invention, the interference of such periodic light intensity changes in the field of view on the output data of the dynamic vision sensor can be effectively reduced, and the performance of motion detection can be improved.
  • the present invention also provides a method for detecting periodic light intensity changes using the above-mentioned image sensor 100 or the light intensity change detection module 120 .
  • Figure 6 shows a schematic flowchart of a method 600 for detecting periodic light intensity changes according to some embodiments of the present invention. According to some embodiments of the present invention, the method 600 is performed in the light intensity change detection module 120.
  • method 600 begins at 610.
  • the light intensity change detection pixel unit 200 generates a current pulse signal by monitoring the light intensity change in the field of view, where the current pulse signal is generated when the light intensity change meets a predetermined condition.
  • the light intensity change detection control unit 400 determines whether to generate a pulse signal by judging the size of the current pulse signal. According to some embodiments, when the total instantaneous current of the received current pulse signal is greater than the threshold, it is considered that a global light intensity change has occurred, and a pulse signal is generated.
  • the steps of monitoring changes in light intensity (ie 610) and the steps of judging the size of the current pulse signal (ie 620) are iteratively repeated to generate multi-segment pulse signals.
  • the light intensity change is a periodic light intensity change. According to some embodiments, when the time difference between adjacent pulses is the same, the light intensity change is determined to be a periodic light intensity change.
  • frequency information of the light intensity change is output.
  • the various techniques described here may be implemented in conjunction with hardware or software, or a combination thereof. Therefore, the methods and devices of the present disclosure, or certain aspects or parts of the methods and devices of the present disclosure, may be embedded in tangible media, such as removable hard disks, USB disks, floppy disks, CD-ROMs or any other machine-readable storage media.
  • program code ie, instructions
  • the machine becomes an apparatus for practicing the present disclosure.
  • the computing device In the case where the program code executes on a programmable computer, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
  • the memory is configured to store the program code; the processor is configured to execute the method of detecting periodic light intensity changes of the present disclosure according to instructions in the program code stored in the memory.
  • readable media includes readable storage media and communication media.
  • Readable storage media store information such as computer-readable instructions, data structures, program modules or other data.
  • Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of readable media.
  • modules or units or components of the device in the examples disclosed herein may be arranged in the device as described in this embodiment, or may alternatively be located in a different device than in this example. in one or more devices.
  • the modules in the preceding examples can be combined into one module or further divided into sub-modules.
  • modules in the devices in the embodiment can be adaptively changed and arranged in one or more devices different from that in the embodiment.
  • the modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of the equipment are combined.
  • Each feature disclosed in this specification may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Photometry And Measurement Of Optical Pulse Characteristics (AREA)

Abstract

L'invention concerne un module de détection de variation d'intensité lumineuse (120), un capteur d'image (100) et un procédé de détection d'une variation d'intensité lumineuse périodique. Le module de détection de variation d'intensité lumineuse (120) comprend : une pluralité d'unités de pixels de détection de variation d'intensité lumineuse (200), qui sont appropriées pour répondre à une variation d'intensité lumineuse dans un champ de vision, et lorsque la variation d'intensité lumineuse satisfait à une condition prédéterminée, passer dans un état déclenché, et délivrer des signaux d'impulsion de courant; et une unité de commande de détection de variation d'intensité lumineuse (400), qui est couplée à chaque unité de pixel de détection de variation d'intensité lumineuse (200), et est appropriée pour déterminer, sur la base des signaux d'impulsion de courant, si un courant d'impulsion total est supérieur à une valeur de seuil, et générer un signal d'impulsion lorsque le courant d'impulsion total est supérieur à la valeur de seuil, les unités de pixels de détection de variation d'intensité lumineuse (200) étant en outre appropriées pour être réglées, après être passées dans l'état déclenché, de sorte à répondre à nouveau à la variation d'intensité lumineuse dans le champ de vision et à délivrer en continu les signaux d'impulsion de courant, et l'unité de commande de détection de variation d'intensité lumineuse (400) étant en outre appropriée pour déterminer, sur la base des signaux d'impulsion, si la variation d'intensité lumineuse est une variation d'intensité lumineuse périodique, et générer et délivrer des informations de fréquence de la variation d'intensité lumineuse lorsque la variation d'intensité lumineuse est une variation d'intensité lumineuse périodique.
PCT/CN2022/129069 2022-09-06 2022-11-01 Module de détection de variation d'intensité lumineuse et capteur d'image WO2024050947A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211084123.9 2022-09-06
CN202211084123.9A CN115474008A (zh) 2022-09-06 2022-09-06 一种光强变化检测模块及图像传感器

Publications (1)

Publication Number Publication Date
WO2024050947A1 true WO2024050947A1 (fr) 2024-03-14

Family

ID=84368414

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/129069 WO2024050947A1 (fr) 2022-09-06 2022-11-01 Module de détection de variation d'intensité lumineuse et capteur d'image

Country Status (2)

Country Link
CN (1) CN115474008A (fr)
WO (1) WO2024050947A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160093273A1 (en) * 2014-09-30 2016-03-31 Samsung Electronics Co., Ltd. Dynamic vision sensor with shared pixels and time division multiplexing for higher spatial resolution and better linear separable data
CN107147856A (zh) * 2017-03-30 2017-09-08 深圳大学 一种像素单元及其去噪方法、动态视觉传感器、成像装置
CN109842768A (zh) * 2019-01-29 2019-06-04 上海芯仑光电科技有限公司 一种像素采集电路及图像传感器
CN109842767A (zh) * 2019-01-09 2019-06-04 上海芯仑光电科技有限公司 一种防闪光电路组件及图像传感器
CN112019835A (zh) * 2020-08-08 2020-12-01 欧菲微电子技术有限公司 动态视觉传感器模组的帧率验证装置、方法及存储介质
CN112449130A (zh) * 2019-08-28 2021-03-05 半导体元件工业有限责任公司 具有闪烁分析电路的事件传感器

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160093273A1 (en) * 2014-09-30 2016-03-31 Samsung Electronics Co., Ltd. Dynamic vision sensor with shared pixels and time division multiplexing for higher spatial resolution and better linear separable data
CN107147856A (zh) * 2017-03-30 2017-09-08 深圳大学 一种像素单元及其去噪方法、动态视觉传感器、成像装置
CN109842767A (zh) * 2019-01-09 2019-06-04 上海芯仑光电科技有限公司 一种防闪光电路组件及图像传感器
CN109842768A (zh) * 2019-01-29 2019-06-04 上海芯仑光电科技有限公司 一种像素采集电路及图像传感器
CN112449130A (zh) * 2019-08-28 2021-03-05 半导体元件工业有限责任公司 具有闪烁分析电路的事件传感器
CN112019835A (zh) * 2020-08-08 2020-12-01 欧菲微电子技术有限公司 动态视觉传感器模组的帧率验证装置、方法及存储介质

Also Published As

Publication number Publication date
CN115474008A (zh) 2022-12-13

Similar Documents

Publication Publication Date Title
EP3238436B1 (fr) Capteur d'image ayant une limite supérieure de gamme dynamique étendue
US10395376B2 (en) CMOS image sensor on-die motion detection using inter-pixel mesh relationship
EP3734549B1 (fr) Système et procédé de détection et de correction de défaut
CN111510650B (zh) 一种图像传感器
KR102443490B1 (ko) 아날로그 프론트엔드를 위한 저전력 컨텍스트 인식 제어
US20160093273A1 (en) Dynamic vision sensor with shared pixels and time division multiplexing for higher spatial resolution and better linear separable data
WO2019205217A1 (fr) Circuit d'acquisition de pixels et capteur de flux optique
US20220150433A1 (en) Pixel collection circuit, dynamic vision sensor, and image capture device
US9749528B1 (en) Multi-stage wakeup battery-powered IP camera
WO2008062404A2 (fr) Pixel optique et capteur d'image
US9661250B2 (en) Image sensor and operating method thereof, motion sensor including the same
US9621829B1 (en) Imaging system unit cell and methods for dynamic range imaging
TW201734721A (zh) 偵測光學滑鼠休眠／喚醒之電路與其方法
US20230007208A1 (en) Methods and systems of low power facial recognition
US11627260B2 (en) Anti-flashlight circuit assembly and image sensor
WO2012093387A2 (fr) Conception de pixel présentant des capacités d'analyse temporelle pour une interprétation de scène
KR20180081144A (ko) 이득 적응 가능한 유닛 셀
US20240048859A1 (en) Image sensor and image processing system
WO2024050947A1 (fr) Module de détection de variation d'intensité lumineuse et capteur d'image
JPWO2019050024A1 (ja) 距離測定方法および距離測定装置
KR102431248B1 (ko) 아날로그-디지털 변환 장치 및 그 방법과 그에 따른 씨모스 이미지 센서
KR102514432B1 (ko) 비교 장치 및 그 동작 방법과 그를 이용한 씨모스 이미지 센서
EP3267678A1 (fr) Circuit d'acquisition de pixels, capteur d'images et système d'acquisition d'images
CN113498473A (zh) 使用动态视觉传感器和图案投影的三维成像和感测
US11825221B2 (en) Sensor system with low power sensor devices and high power sensor devices

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22957910

Country of ref document: EP

Kind code of ref document: A1