EP3358367A1 - Ereignisausgelöste bildgebende pixel - Google Patents
Ereignisausgelöste bildgebende pixel Download PDFInfo
- Publication number
- EP3358367A1 EP3358367A1 EP18155412.2A EP18155412A EP3358367A1 EP 3358367 A1 EP3358367 A1 EP 3358367A1 EP 18155412 A EP18155412 A EP 18155412A EP 3358367 A1 EP3358367 A1 EP 3358367A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- switch
- terminal
- photodetector
- charge
- input buffer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 70
- 230000001960 triggered effect Effects 0.000 title claims abstract description 7
- 238000005070 sampling Methods 0.000 claims abstract description 13
- 238000005286 illumination Methods 0.000 claims description 16
- 239000003990 capacitor Substances 0.000 claims description 5
- 230000010354 integration Effects 0.000 claims description 5
- 238000000034 method Methods 0.000 description 10
- 238000001514 detection method Methods 0.000 description 5
- 230000002596 correlated effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003071 parasitic effect Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4861—Circuits for detection, sampling, integration or read-out
- G01S7/4863—Detector arrays, e.g. charge-transfer gates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/14609—Pixel-elements with integrated switching, control, storage or amplification elements
- H01L27/14612—Pixel-elements with integrated switching, control, storage or amplification elements involving a transistor
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/1463—Pixel isolation structures
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14643—Photodiode arrays; MOS imagers
- H01L27/14649—Infrared imagers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/214—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spectral multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/702—SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Definitions
- the present disclosure relates to sensing, and more particularly to systems and methods for sensing three-dimensional range and intensity data.
- Range gating is an imaging technique commonly employed to gather range information of an object in a scene.
- the technique involves actively illuminating the scene with pulsed laser light and capturing an associated image using a very short exposure, generally by electronically controlling shutter duration with nanosecond precision, to obtain an image plane correlated to the laser pulse return time. Only objects in the image plane appear in the captured image and range to a given image plane is calculated based on the time interval between emission of the reflected laser pulse and acquisition of the image plane.
- Range gating is often used to image through obscurants, such as smoke or haze.
- LiDAR i.e., light imaging, detection, and ranging
- LiDAR is a type of sensing commonly employed for surveying a scene for purposes of making three-dimensional (3D) maps of the scene.
- LiDAR generally entails illuminating a scene using a pulsed illumination source and measuring the time of arrival of the pulsed illumination at pixels within a pixel array.
- the pixel array provides a return signal indicative of the arrival time of reflected illumination, arrival time of each pixel corresponding spatially to a range, or Z-distance, in the scene for 3D-mapping.
- An imaging pixel includes a photodetector for generating a charge signal, an input buffer, a control device, and a switch.
- the input buffer is connected to the photodetector for amplifying the charge signal.
- the control device is connected to the photodetector and the input buffer to separate high-frequency charge signals from low frequency charge signals.
- the switch is operably connected to the output of the input buffer for sampling of high-frequency charge signals in a charge storage device once an amplitude threshold of high-frequency charge signals provided by the input buffer is exceeded.
- the input buffer can include an input terminal, a reference terminal, and an output terminal.
- the input terminal can be connected to the photodetector.
- the reference terminal can be connected to a reference voltage source to receive a reference signal therefrom for amplifying the charge signal.
- the output terminal can be connected to the control device and the switch. It is contemplated that the input buffer can be arranged to apply an amplified charge signal to the output terminal based on the charge signal and reference signal.
- the photodetector can include a shortwave infrared photodiode.
- the control device can include a transistor with source, gate, and drain terminals.
- the source terminal can be connected to the photodetector.
- the gate terminal can be connected to the input buffer.
- the drain terminal can be connected to an integration capacitor for generating image data according to low-frequency charge signals from the photodetector.
- the switch can be dedicated to a single photodiode of the photodetector.
- the switch can have an input terminal and an output terminal.
- the switch input terminal can be connected to the input buffer to receive an amplified charge signal therefrom.
- the switch output terminal can be connected to the charge storage device to generate image data according to state of the switch.
- comparator can be connected between the input buffer and the switch to change state according to an amplified charge signal provided by the input buffer.
- the comparator can include an input terminal, a threshold terminal, and an output terminal.
- the input terminal can be connected to the input buffer to receive therefrom an amplified charge signal.
- the threshold terminal is connected to a trigger voltage source for comparing the amplified charge signal to a trigger voltage.
- the output terminal can be operably connected to the switch to change state of the switch according to a comparison of the amplified charge signal and the trigger voltage.
- the comparator circuit can be arranged to sample the amplified charge signal for a predetermined time interval subsequent to the amplified charge signal exceeding the trigger voltage.
- An imaging device includes first and second imaging pixels as described above.
- the switch of the first imaging pixel is electrically isolated from the switch of the second imaging pixel for connecting to the charge storage device of the first imaging pixel independent of state of the second imaging pixel switch.
- An imaging method includes receiving illumination at first and second photodetectors.
- a first charge signal is generated using the first photodetector.
- the first photodetector is connected to a first charge storage device based on the first charge signal.
- a second charge signal can be generated using the second photodetector.
- Connection of the first photodetector can be independent of connection of the second photodetector with a second photodetector.
- the second photodetector can be connected to the second charge storage device according to the second charge signal. Connection of the second photodetector can be synchronous or asynchronous of connection of the first photodetector.
- FIG. 1 a partial view of an exemplary embodiment of an imaging pixel in accordance with the disclosure is shown in Fig. 1 and is designated generally by reference character 100.
- FIGs. 2-4 Other embodiments of imaging pixels, imaging devices, and methods triggering imaging array in accordance with the disclosure, or aspects thereof, are provided in Figs. 2-4 , as will be described.
- the systems and methods described herein can be used for acquiring three-dimensional range information along with high resolution image overlay, such as with shortwave infrared (SWIR) illumination, though the present disclosure is not limited to SWIR illumination or to coincident acquisition of range and imagery in general.
- SWIR shortwave infrared
- Imaging pixel 100 is shown.
- Imaging pixel includes a photodetector 102 for generating a charge signal 1.0, an input buffer 104, a control device 106, and a sampling circuit 108 with a switch 110.
- Input buffer 104 is connected to photodetector 102 for amplifying charge signal 10.
- Control device 106 is connected to photodetector 102 and input buffer 104 for separating high-frequency charge signals 12 from low-frequency charge signals 14.
- Switch 110 is operably connected to input buffer 104 for sampling high-frequency charge signals in a charge storage device 112 triggered by amplitude of high-frequency charge signals provided by input buffer 104.
- Photodetector 102 is arranged to detect an excitation signal 2, e.g., reflected illumination, and convert the excitation signal into electrical charge signal 10.
- photodetector 102 includes a photodiode 114 arranged to generate a current in response to SWIR illumination reflected by objects.
- a capacitance 116 which may be parasitic capacitance or a physical device, is arranged in parallel with photodiode 114 to convert the current into a voltage, which forms charge signal 10.
- Photodetector 102 is connected to input buffer 104 by buffer input lead 118 and to control device 106 by a control device input lead 120 for applying charge signal 10 to both input buffer 104 and control device 106.
- photodiode 114 may be a single photodiode and switch 110 can be a single switch dedicated to photodiode 114 for capturing image data triggering recognition of an event based on charge signal 10, provided by photodiode 114.
- photodetector 102 can be arranged to generate charge signal 10 responsive to incident infrared light, such as light within a shortwave infrared (SWIR) waveband.
- SWIR shortwave infrared
- Input buffer 104 is a high-frequency amplifier and has an input terminal 122, a reference terminal 124, and an output terminal 126.
- Input terminal 122 is connected to photodetector 102 by buffer input lead 118.
- Reference terminal 124 is connected to a reference voltage source and receives therefrom a reference signal 16.
- Output terminal 126 is connected to control device 106 by a gate lead 128 and switch 110 by a switch input lead 130.
- input buffer 104 can include an amplifier to amplify charge signal 10, received at input terminal 122, according to a comparison with reference signal 16, received at reference terminal 124.
- the amplified signal forms high-frequency signal 12, which is provided to switch input lead 130 and gate lead 128.
- Control device 106 is a low-frequency diverting signal path and includes a transistor 132 and an integration capacitor 135.
- Transistor 132 has a source terminal 136, a gate 138, and a drain terminal 140.
- Source terminal 136 is connected to photodetector 102 through buffer input lead 118 to receive therethrough charge signal 10.
- Gate 138 is connected to output terminal 126 of input buffer 104 through gate lead 128 to receive therethrough high-frequency charge signal 12. Based on high-frequency charge signal 12, gate 138 selectively connects drain terminal 140 with source terminal 136, which allows charge signal 10 to enter integration capacitor 135 as low-frequency charge signal 14.
- low-frequency charge signal 14 can be provided as image data to imaging circuitry and/or software communicate with integration capacitor 135.
- direct injection transistor 134 is a p-type MOSFET otherwise referred to as a PMOS transistor.
- Sampling circuit 108 includes switch 110, a comparator 142, and a charge storage device 144.
- Switch 110 has a closed state A and an open state B.
- In the open state B switch 110 is electrically open such that charge storage device 112 is electrically isolated from switch input lead 130 and high-frequency charge signal 12 does not propagate to charge storage device 112 for sampling.
- In the closed state B switch 110 is electrically closed. Closure of switch 110 places charge storage device 112 in electrical communication with switch input lead 130, and therethrough to output terminal 126 of input buffer 104, thereby allowing high-frequency charge signal 12 to propagate to and be sampled on charge storage device 112.
- the sampled charge forms image data 18 suitable for constructing imagery and/or providing ranging information.
- Comparator 142 functions as an event detector and is operatively connected to switch 110 and arranged to control state of switch 110 according high-frequency charge signal 12.
- comparator 142 is connected between input buffer 104 and switch 110 to electrically close switch 110 upon detection of an event to the amplified high-frequency charge signal 12 provided by input buffer 104, the charge thereby flowing to charge storage device 112 by the closure of switch 110.
- comparator 142 has input terminal 146, a threshold terminal 148, and an output terminal 150.
- Input terminal 146 is connected to output terminal 126 of input buffer 104 to receive therefrom an amplified charge signal as high-frequency charge signal 12.
- Threshold terminal 148 is connected to a trigger voltage source for comparing the high-frequency charge signal 12 to a trigger voltage, which may be fixed or user-defined based on imaging conditions.
- Output terminal 150 is operably connected to switch 110 to change state of the switch according to a comparison of high-frequency charge signal 12 and the trigger voltage.
- Comparator 142 can function to generate a fixed duration sample signal, e.g., with a predetermined time interval 149, at output terminal 150 in response to voltages applied input terminal 146 and threshold terminal 148.
- the fixed duration sample signal causes sampling of high-frequency charge signal 12 at charge storage device 112 for the predetermined time interval upon detection of an event by comparator 142.
- comparator 142 and switch 110 be connected to a single photodetector, e.g., photodetector 102, for triggering acquisition of a single imaging pixel, e.g., imaging pixel 100, triggered by an event witnessed by the imaging pixel and independent of events reported by other imaging pixels within an imaging array.
- exemplary high-frequency charge signals i.e., high-frequency charge signals 12A-12C
- V Threshold a trigger threshold voltage
- the time elapsed between issue of a pulse from the pulsed illuminator and high-frequency charge signals 12A-12C exceeding the trigger threshold voltage provides an indication of the range of an object in spatial relation the pixels.
- the use of a comparator to control the sampling of returned charge signals means that charge signals may arrive asynchronously at any time, and thus discrete pixels at different locations on a focal plane may be sampling return signals associated with different ranges within the same readout frame. Further, there is no need to control or gate an exposure window to synchronize to an image plane at a pre-determined range. As exposure is effectively triggered by the output of the comparator, discrete pixels may act asynchronously and sample individual charge return signals at different times associated with different ranges. The generated image is a capture of the first significant return at each pixel location, and may achieve 3D image data collection with a single illumination pulse and high signal to noise ratio.
- High signal to noise is achieved as the sampling window duration, or effective exposure window, is controlled by the bandwidth of input buffer 104 (shown in Fig. 1 ), comparator 142 (shown in Fig. 1 ), and sampling circuit 108 (shown in Fig. 1 ), which can be tuned for desired signal-to-noise ratio in a given imaging condition.
- exemplary high-frequency charge signals e.g., high-frequency charge signals 12D-12F, each having different peak intensities and each occurring at different times, are shown.
- Each exemplary high-frequency charge signal 12D-12F asynchronously exceed a trigger threshold voltage, e.g., V Threshold , has relative intensity that differ from the others. Even though the return signal arrives at a different time in each imaging pixel, the independent event-triggering functionality provided by comparator 142 and switch 110 allows each to be sampled.
- Imaging device 200 includes a focal plane array 202, e.g., a readout integrated circuit (ROIC).
- Focal plane array 202 includes an array of imaging pixels 100 arranged on a substrate 204. Two or more of imaging pixels 100 are arranged for event triggering as described above, and suitable optics, row and column drivers, decoders, signal processing circuits, image processing circuits (not shown), and pulsed illuminator such as in a LiDAR system are provided for acquiring image data for creating 3D "painted” maps showing 3D range information along with high resolution image overlay. In certain embodiments, 3D "painted" maps can be acquired with a single exposure.
- ROIC readout integrated circuit
- Range gating is an active illumination technique which can be used to see through obscurants to capture an image using a very short exposure that is correlated to an image plane illuminated with an active laser pulse at a specific moment time. It typically images only a single image plane at a time.
- LiDAR is an active imaging technique used to generate 3D maps which typically employs pulsed illumination and measures the time of arrival of the returning pulsed illumination on a pixel by pixel basis. The map is generally binary; a binary return signal is created where a time of arrival is determined when the received signal overcomes a threshold but no analog signal intensity is observed.
- imaging circuits are provided that perform event-triggered exposure.
- the imaging circuits e.g., imaging pixel 100, includes an input photodetector, a high-frequency amplifier, a low-frequency signal diverting path, a comparator, and a sampling circuit.
- a high-frequency pulse is received by the photodetector, charge representative of the received photocurrent accumulates at an input terminal of the amplifier, is amplified by the amplifier, and is compared by the comparator to a threshold. If the amplified signal associated with the charge exceeds a voltage threshold applied to the comparator an event is detected, a sample signal is generated, which closes a switch to sample the amplified signal, thereby detecting an event.
- imaging pixels, imaging devices, and imaging methods with superior properties including the capability to penetrate obscurant similar to range gating while simultaneously capturing additional relevant information about the obscured scene in a single exposure.
- imaging pixels, imaging devices, and imaging methods described herein can be used in conjunction with LiDAR to create "painted" 3D maps including 3D range information in conjunction with high resolution image overlay. While the apparatus and methods of the subject disclosure have been shown and described with reference to preferred embodiments, those skilled in the art will readily appreciate that changes and/or modifications may be made thereto without departing from the scope of the invention as defined by the claims.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Power Engineering (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Electromagnetism (AREA)
- Computer Hardware Design (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Computer Networks & Wireless Communication (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/426,521 US10154207B2 (en) | 2017-02-07 | 2017-02-07 | Event-triggered imaging pixels |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3358367A1 true EP3358367A1 (de) | 2018-08-08 |
EP3358367B1 EP3358367B1 (de) | 2022-11-02 |
Family
ID=61187115
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18155412.2A Active EP3358367B1 (de) | 2017-02-07 | 2018-02-06 | Ereignisausgelöste bildgebende pixel |
Country Status (3)
Country | Link |
---|---|
US (1) | US10154207B2 (de) |
EP (1) | EP3358367B1 (de) |
IL (1) | IL257236B (de) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11587962B2 (en) * | 2020-07-15 | 2023-02-21 | Raytheon Company | Imaging system including analog compression for simultaneous pulse detection and imaging |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120248288A1 (en) * | 2011-03-29 | 2012-10-04 | Linder Lloyd F | Dual well read-out integrated circuit (roic) |
US20160057366A1 (en) * | 2014-08-22 | 2016-02-25 | Voxtel, Inc. | Asynchronous readout array |
US20160295148A1 (en) * | 2015-03-30 | 2016-10-06 | Hamilton Sundstrand Corporation | Imaging circuit including frame asynchronous pulse detection |
US20160370226A1 (en) * | 2015-03-30 | 2016-12-22 | Sensors Unlimited, Inc. | Digital imaging and pulse detection pixel |
Family Cites Families (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6498620B2 (en) * | 1993-02-26 | 2002-12-24 | Donnelly Corporation | Vision system for a vehicle including an image capture device and a display system having a long focal length |
US6040568A (en) * | 1998-05-06 | 2000-03-21 | Raytheon Company | Multipurpose readout integrated circuit with in cell adaptive non-uniformity correction and enhanced dynamic range |
US6323941B1 (en) * | 1999-08-06 | 2001-11-27 | Lockheed Martin Corporation | Sensor assembly for imaging passive infrared and active LADAR and method for same |
US6535275B2 (en) | 2000-08-09 | 2003-03-18 | Dialog Semiconductor Gmbh | High resolution 3-D imaging range finder |
US6982743B2 (en) * | 2002-01-31 | 2006-01-03 | Trustees Of The University Of Pennsylvania | Multispectral omnidirectional optical sensor and methods therefor |
US6864965B2 (en) * | 2002-03-12 | 2005-03-08 | Bae Systems Information And Electronic Systems Integration Inc. | Dual-mode focal plane array for missile seekers |
JP4455215B2 (ja) * | 2004-08-06 | 2010-04-21 | キヤノン株式会社 | 撮像装置 |
US7262402B2 (en) | 2005-02-14 | 2007-08-28 | Ecole Polytechnique Federal De Lausanne | Integrated imager circuit comprising a monolithic array of single photon avalanche diodes |
US7925973B2 (en) * | 2005-08-12 | 2011-04-12 | Brightcove, Inc. | Distribution of content |
US8319166B2 (en) * | 2006-01-18 | 2012-11-27 | National University Corporation Shizuoka University | Solid-state image pick-up device and pixel signal readout method having dual potential well, dual transfer gate electrode and dual floating-diffusion region for separately transferring and storing charges respectively |
US7974771B2 (en) * | 2006-09-22 | 2011-07-05 | Nortel Networks Limited | Method and apparatus for enabling commuter groups |
AT504582B1 (de) | 2006-11-23 | 2008-12-15 | Arc Austrian Res Centers Gmbh | Verfahren zur generierung eines bildes in elektronischer form, bildelement für einen bildsensor zur generierung eines bildes sowie bildsensor |
GB2450075A (en) * | 2007-03-08 | 2008-12-17 | Selex Sensors & Airborne Sys | Tracking device for guiding a flight vehicle towards a target |
DE102008060231A1 (de) * | 2007-12-06 | 2009-06-10 | Continental Teves Ag & Co. Ohg | Verwendung des WLAN-Standards für eine C2C-Kommunikation durch Hinzufügen von neuen Pakettypen |
DE102008035419A1 (de) * | 2007-12-06 | 2009-06-10 | Continental Teves Ag & Co. Ohg | Verwendung des WLAN-Standards für C2C durch Hinzufügen von neuen Pakettypen |
CN101896953B (zh) * | 2007-12-11 | 2014-07-02 | 大陆-特韦斯贸易合伙股份公司及两合公司 | 经由移动通信的车辆的车辆相关数据传输 |
US9043483B2 (en) * | 2008-03-17 | 2015-05-26 | International Business Machines Corporation | View selection in a vehicle-to-vehicle network |
DE102009015513A1 (de) * | 2008-04-14 | 2009-10-15 | Continental Teves Ag & Co. Ohg | Ortungssignal für Einsatzkräfte |
EP2401176B1 (de) * | 2009-02-27 | 2019-05-08 | Magna Electronics | Fahrzeugalarmsystem |
US8995327B2 (en) * | 2009-12-02 | 2015-03-31 | Mitsubishi Electric Research Laboratories, Inc. | Broadcasting messages in multi-channel vehicular networks |
EP2745096B1 (de) * | 2011-08-17 | 2016-10-12 | Public Service Solutions Inc | Passive detektoren für bildgebungssysteme |
US9151604B1 (en) * | 2011-10-06 | 2015-10-06 | Laser Technology, Inc. | Non-saturating receiver design and clamping structure for high power laser based rangefinding instruments |
EP2815251B1 (de) | 2012-02-15 | 2017-03-22 | Heptagon Micro Optics Pte. Ltd. | Tof-kamera mit streifenbeleuchtung |
CN104380468B (zh) * | 2012-06-29 | 2018-05-22 | 索尼半导体解决方案公司 | 固态成像装置、固态成像装置的制造方法和电子设备 |
KR101444263B1 (ko) * | 2012-12-04 | 2014-09-30 | (주)실리콘화일 | 분광특성이 강화된 적외선 픽셀을 구비한 씨모스 이미지센서 및 그 제조방법 |
US9277204B2 (en) | 2013-01-23 | 2016-03-01 | Advanced Scientific Concepts, Inc. | Modular LADAR sensor |
US9575184B2 (en) | 2014-07-03 | 2017-02-21 | Continental Advanced Lidar Solutions Us, Inc. | LADAR sensor for a dense environment |
US9810777B2 (en) * | 2014-08-22 | 2017-11-07 | Voxtel, Inc. | Asynchronous LADAR and imaging array |
JP6555890B2 (ja) * | 2015-01-23 | 2019-08-07 | キヤノン株式会社 | 撮像装置、撮像システム、および撮像装置の駆動方法 |
US9812488B2 (en) * | 2015-05-19 | 2017-11-07 | Taiwan Semiconductor Manufacturing Company Ltd. | Backside illuminated image sensor and method of manufacturing the same |
US9769400B2 (en) * | 2016-01-15 | 2017-09-19 | Sensors Unlimited, Inc. | Pulse detection bandpass filter with gain stage |
US9871066B2 (en) * | 2016-01-15 | 2018-01-16 | Sensors Unlimited, Inc. | Enhanced pixel for multiband sensing including a signal path to receive a flow of signals flowing through a control device |
US9948880B2 (en) * | 2016-08-02 | 2018-04-17 | Sensors Unlimited, Inc. | Asynchronous multimode focal plane array |
-
2017
- 2017-02-07 US US15/426,521 patent/US10154207B2/en active Active
-
2018
- 2018-01-30 IL IL257236A patent/IL257236B/en active IP Right Grant
- 2018-02-06 EP EP18155412.2A patent/EP3358367B1/de active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120248288A1 (en) * | 2011-03-29 | 2012-10-04 | Linder Lloyd F | Dual well read-out integrated circuit (roic) |
US20160057366A1 (en) * | 2014-08-22 | 2016-02-25 | Voxtel, Inc. | Asynchronous readout array |
US20160295148A1 (en) * | 2015-03-30 | 2016-10-06 | Hamilton Sundstrand Corporation | Imaging circuit including frame asynchronous pulse detection |
US20160370226A1 (en) * | 2015-03-30 | 2016-12-22 | Sensors Unlimited, Inc. | Digital imaging and pulse detection pixel |
Also Published As
Publication number | Publication date |
---|---|
US20180227508A1 (en) | 2018-08-09 |
IL257236B (en) | 2020-03-31 |
US10154207B2 (en) | 2018-12-11 |
IL257236A (en) | 2018-03-29 |
EP3358367B1 (de) | 2022-11-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6535275B2 (en) | High resolution 3-D imaging range finder | |
US6448572B1 (en) | Ranging three-dimensional laser imager and method | |
US7834985B2 (en) | Surface profile measurement | |
US6373557B1 (en) | Method and apparatus for picking up a three-dimensional range image | |
US7947939B2 (en) | Detection of optical radiation using a photodiode structure | |
US5703639A (en) | Charge coupled device pulse discriminator | |
US9052381B2 (en) | Detector array for high speed sampling of an optical pulse | |
WO2019178939A1 (zh) | 像素采集电路、光流传感器和光流及图像信息采集系统 | |
JP2004538491A (ja) | 三次元距離画像を記録するための方法及び装置 | |
JP2004523769A (ja) | 表面形状測定 | |
WO2019205217A1 (zh) | 像素采集电路及光流传感器 | |
US8547170B1 (en) | Multimode integration circuit for sensor readout | |
US11233966B1 (en) | Breakdown voltage monitoring for avalanche diodes | |
US20210013257A1 (en) | Pixel circuit and method of operating the same in an always-on mode | |
TW201923308A (zh) | 具有雷射測距(lrf)能力之模roic像素 | |
EP3358367B1 (de) | Ereignisausgelöste bildgebende pixel | |
US20210270969A1 (en) | Enhanced depth mapping using visual inertial odometry | |
JP2022510859A (ja) | 飛行時間測定用cmosイメージセンサ | |
CN108700649B (zh) | 用于检测激光光斑的设备 | |
JP6735515B2 (ja) | 固体撮像装置 | |
Golitsyn et al. | The implementation of gated-viewing system based on CCD image sensor | |
CN114829970A (zh) | 飞行时间成像电路、飞行时间成像系统和飞行时间成像方法 | |
Browder et al. | Three-dimensional imaging sensors program | |
JP2022522952A (ja) | 飛行時間型装置および3d光学検出器 | |
US20240121535A1 (en) | An image sensing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190208 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20200326 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 5/3745 20110101ALI20220304BHEP Ipc: G01S 17/894 20200101ALI20220304BHEP Ipc: G01S 7/487 20060101ALI20220304BHEP Ipc: G01S 7/4863 20200101ALI20220304BHEP Ipc: G01S 17/42 20060101ALI20220304BHEP Ipc: G01S 17/88 20060101ALI20220304BHEP Ipc: H01L 27/146 20060101ALI20220304BHEP Ipc: H04N 5/369 20110101ALI20220304BHEP Ipc: G01S 7/486 20060101AFI20220304BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20220519 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1529140 Country of ref document: AT Kind code of ref document: T Effective date: 20221115 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602018042462 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20221102 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1529140 Country of ref document: AT Kind code of ref document: T Effective date: 20221102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230302 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230202 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230119 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230302 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230203 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602018042462 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
26N | No opposition filed |
Effective date: 20230803 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20230228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230206 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230228 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221102 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230206 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230228 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240123 Year of fee payment: 7 Ref country code: GB Payment date: 20240123 Year of fee payment: 7 |