WO2023153218A1 - 光電変換装置 - Google Patents
光電変換装置 Download PDFInfo
- Publication number
- WO2023153218A1 WO2023153218A1 PCT/JP2023/002358 JP2023002358W WO2023153218A1 WO 2023153218 A1 WO2023153218 A1 WO 2023153218A1 JP 2023002358 W JP2023002358 W JP 2023002358W WO 2023153218 A1 WO2023153218 A1 WO 2023153218A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pixel
- photoelectric conversion
- circuit
- signal
- detection signal
- Prior art date
Links
- 238000006243 chemical reaction Methods 0.000 title claims abstract description 189
- 238000001514 detection method Methods 0.000 claims abstract description 148
- 239000000758 substrate Substances 0.000 claims description 19
- 238000010791 quenching Methods 0.000 claims description 17
- 238000000034 method Methods 0.000 claims description 8
- 230000000171 quenching effect Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 46
- 238000012545 processing Methods 0.000 description 41
- 238000003384 imaging method Methods 0.000 description 27
- 239000004065 semiconductor Substances 0.000 description 21
- 230000002123 temporal effect Effects 0.000 description 19
- 238000007493 shaping process Methods 0.000 description 14
- 230000003287 optical effect Effects 0.000 description 12
- 210000005252 bulbus oculi Anatomy 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 230000004048 modification Effects 0.000 description 9
- 238000012986 modification Methods 0.000 description 9
- 238000000098 azimuthal photoelectron diffraction Methods 0.000 description 8
- 239000012535 impurity Substances 0.000 description 8
- 238000004904 shortening Methods 0.000 description 7
- 210000001519 tissue Anatomy 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 238000002674 endoscopic surgery Methods 0.000 description 6
- ORQBXQOJMQIAOY-UHFFFAOYSA-N nobelium Chemical compound [No] ORQBXQOJMQIAOY-UHFFFAOYSA-N 0.000 description 6
- 210000003128 head Anatomy 0.000 description 5
- 239000004984 smart glass Substances 0.000 description 5
- 239000000969 carrier Substances 0.000 description 4
- 230000005284 excitation Effects 0.000 description 4
- 239000011521 glass Substances 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000001914 filtration Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- 210000004204 blood vessel Anatomy 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 2
- 239000003153 chemical reaction reagent Substances 0.000 description 2
- 230000000052 comparative effect Effects 0.000 description 2
- MOFVSTNWEDAEEK-UHFFFAOYSA-M indocyanine green Chemical compound [Na+].[O-]S(=O)(=O)CCCCN1C2=CC=C3C=CC=CC3=C2C(C)(C)C1=CC=CC=CC=CC1=[N+](CCCCS([O-])(=O)=O)C2=CC=C(C=CC=C3)C3=C2C1(C)C MOFVSTNWEDAEEK-UHFFFAOYSA-M 0.000 description 2
- 229960004657 indocyanine green Drugs 0.000 description 2
- 230000001678 irradiating effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001179 pupillary effect Effects 0.000 description 2
- 238000001028 reflection method Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 238000002366 time-of-flight method Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 210000004087 cornea Anatomy 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010336 energy treatment Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000010030 laminating Methods 0.000 description 1
- 230000031700 light absorption Effects 0.000 description 1
- 210000004400 mucous membrane Anatomy 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N25/772—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising A/D, V/T, V/F, I/T or I/F converters
- H04N25/773—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising A/D, V/T, V/F, I/T or I/F converters comprising photon counting circuits, e.g. single photon detection [SPD] or single photon avalanche diodes [SPAD]
Definitions
- the present invention relates to a photoelectric conversion device and a photoelectric conversion system.
- the TOF (Time-Of-Flight) method is often used when measuring the distance to the measurement object.
- Japanese Patent Application Laid-Open No. 2014-059302 discloses a TOF rangefinder using an APD (Avalanche Photo Diode). A plurality of adjacent APDs are grouped, and a pulse signal is output when a predetermined number or more of the APDs in the group detect a signal at close timing. As a result, it is possible to selectively detect signals with strong temporal and spatial correlations, and to suppress the effects of external light with weak temporal and spatial correlations on signals.
- the present invention has been made in view of the above problems, and an object of the present invention is to provide a photoelectric conversion device and an imaging system that achieve both high spatial resolution and suppression of false signals.
- One aspect of the present invention is a photoelectric conversion device comprising: a first photoelectric conversion unit; and a first detection circuit that outputs a first detection signal based on photons incident on the first photoelectric conversion unit. , a first output circuit for outputting a first pixel signal to the outside of the pixel according to the first detection signal, and controlling whether or not to input the first detection signal to the first output circuit. a first control circuit, a first pixel, a second photoelectric conversion unit, and a second detection circuit that outputs a second detection signal based on a photon incident on the second photoelectric conversion unit.
- a second output circuit for outputting a second pixel signal to the outside of the pixel according to the second detection signal, and controlling whether or not to input the second detection signal to the second output circuit.
- FIG. 1 is a schematic diagram of a photoelectric conversion device according to an embodiment
- FIG. 1 is a schematic diagram of a PD substrate of a photoelectric conversion device according to an embodiment
- FIG. 1 is a schematic diagram of a circuit board of a photoelectric conversion device according to an embodiment
- FIG. 4 is a configuration example of a pixel circuit of the photoelectric conversion device according to the embodiment
- FIG. 4 is a schematic diagram showing driving of the pixel circuit of the photoelectric conversion device according to the embodiment
- It is a block diagram per two pixels according to a comparative example of the first embodiment.
- 2 is a block diagram for two pixels according to the first embodiment
- FIG. 3 is a circuit diagram for one pixel according to the first embodiment
- FIG. 4 is a timing chart of pixel driving according to the first embodiment;
- FIG. FIG. 4 is a diagram showing the control relationship of the pixel array according to the first embodiment;
- FIG. It is a circuit diagram for one pixel according to the second embodiment.
- FIG. 9 is a timing chart of pixel driving according to the second embodiment;
- FIG. 11 is a circuit diagram for one pixel according to the third embodiment;
- FIG. 11 is a timing chart of pixel driving according to the third embodiment;
- FIG. 10 is a diagram showing control relationships of a pixel array according to the third embodiment;
- FIG. 11 is a diagram showing control relationships of a pixel array according to a modification of the third embodiment;
- FIG. 11 is a diagram showing control relationships of a pixel array according to a modification of the third embodiment;
- FIG. 10 is a diagram showing control relationships of a pixel array according to a modification of the third embodiment;
- FIG. 11 is a diagram showing control relationships of a pixel array according to a
- FIG. 11 is a diagram showing control relationships of a pixel array according to a modification of the third embodiment;
- FIG. 11 is a diagram showing control relationships of a pixel array according to a modification of the third embodiment;
- FIG. 13 is a circuit diagram for one pixel according to the fourth embodiment;
- FIG. 11 is a timing chart of pixel driving according to the fourth embodiment;
- FIG. 11 is a timing chart of pixel driving according to the fourth embodiment;
- FIG. 12 is a diagram showing control relationships of a pixel array according to the fifth embodiment;
- FIG. 12 is a diagram showing control relationships of a pixel array according to the fifth embodiment;
- FIG. 12 is a diagram showing control relationships of a pixel array according to the fifth embodiment;
- FIG. 12 is a diagram showing control relationships of a pixel array according to the fifth embodiment;
- FIG. 12 is a diagram showing control relationships of a pixel array according to the fifth embodiment;
- FIG. 14 is a diagram showing a control relationship of a pixel array according to a modified example of the fifth embodiment;
- FIG. FIG. 14 is a diagram showing a control relationship of a pixel array according to a modified example of the fifth embodiment;
- FIG. FIG. 14 is a diagram showing a control relationship of a pixel array according to a modified example of the fifth embodiment;
- FIG. FIG. 11 is a functional block diagram of a photoelectric conversion system according to a sixth embodiment;
- FIG. 11 is a functional block diagram of a photoelectric conversion system according to a seventh embodiment;
- FIG. 11 is a functional block diagram of a photoelectric conversion system according to a seventh embodiment;
- FIG. 11 is a functional block diagram of a photoelectric conversion system according to an eighth embodiment;
- FIG. 20 is a functional block diagram of a photoelectric conversion system according to a ninth embodiment
- FIG. 20 is a functional block diagram of a photoelectric conversion system according to a tenth embodiment
- FIG. 20 is a functional block diagram of a photoelectric conversion system according to a tenth embodiment
- planar view means viewing from a direction perpendicular to the light incident surface of the semiconductor layer.
- a cross-sectional view refers to a plane in a direction perpendicular to the light incident surface of the semiconductor layer.
- the plane view is defined based on the light incident surface of the semiconductor layer macroscopically.
- the anode of the APD (avalanche photodiode) is set to a fixed potential and the signal is extracted from the cathode side. Therefore, the semiconductor region of the first conductivity type in which majority carriers are the same polarity as the signal charges is an N-type semiconductor region, and the semiconductor region of the second conductivity type in which majority carriers are charges of a different polarity from the signal charges. is a P-type semiconductor region.
- the present invention can also be applied when the cathode of the APD is set at a fixed potential and the signal is extracted from the anode side.
- the semiconductor region of the first conductivity type having majority carriers of the same polarity as the signal charges is a P-type semiconductor region
- the semiconductor region of the second conductivity type having majority carriers of charges having a polarity different from that of the signal charges. is an N-type semiconductor region.
- impurity concentration when the term “impurity concentration” is simply used, it means the net impurity concentration after subtracting the amount compensated by the impurity of the opposite conductivity type. In other words, “impurity concentration” refers to NET doping concentration.
- a region in which the P-type impurity concentration is higher than the N-type impurity concentration is a P-type semiconductor region.
- a region where the N-type impurity concentration is higher than the P-type impurity concentration is an N-type semiconductor region.
- FIG. 1 A configuration common to each embodiment of a photoelectric conversion device and a driving method thereof according to the present invention will be described with reference to FIGS. 1 to 5.
- FIG. 1 A configuration common to each embodiment of a photoelectric conversion device and a driving method thereof according to the present invention will be described with reference to FIGS. 1 to 5.
- FIG. 1 A configuration common to each embodiment of a photoelectric conversion device and a driving method thereof according to the present invention will be described with reference to FIGS. 1 to 5.
- FIG. 1 is a diagram showing the configuration of a stacked photoelectric conversion device 100 according to an embodiment of the present invention.
- the photoelectric conversion device 100 is configured by laminating and electrically connecting two substrates, a sensor substrate 11 and a circuit substrate 21 .
- the sensor substrate 11 has a first semiconductor layer having photoelectric conversion elements 102, which will be described later, and a first wiring structure.
- the circuit board 21 has a second semiconductor layer having circuits such as the signal processing unit 103, which will be described later, and a second wiring structure.
- the photoelectric conversion device 100 is configured by stacking a second semiconductor layer, a second wiring structure, a first wiring structure, and a first semiconductor layer in this order.
- the photoelectric conversion device described in each embodiment is a backside illumination type photoelectric conversion device in which light enters from the first surface and a circuit board is disposed on the second surface.
- each substrate may be a wafer. Further, each substrate may be laminated in a wafer state and then diced, or may be chipped and then laminated and bonded.
- a pixel region 12 is arranged on the sensor substrate 11 , and a circuit region 22 for processing signals detected by the pixel region 12 is arranged on the circuit substrate 21 .
- FIG. 2 is a diagram showing an arrangement example of the sensor substrate 11.
- FIG. Pixels 101 having photoelectric conversion elements 102 including APDs are arranged in a two-dimensional array in plan view to form a pixel region 12 .
- the pixels 101 are typically pixels for forming an image, but when used for TOF (Time of Flight), they do not necessarily form an image. That is, the pixel 101 may be a pixel for measuring the time and amount of light that light reaches.
- TOF Time of Flight
- FIG. 3 is a configuration diagram of the circuit board 21.
- FIG. It has a signal processing unit 103 that processes charges photoelectrically converted by the photoelectric conversion element 102 in FIG. there is
- the photoelectric conversion element 102 in FIG. 2 and the signal processing unit 103 in FIG. 3 are electrically connected via connection wiring provided for each pixel.
- the vertical scanning circuit section 110 receives the control pulse supplied from the control pulse generating section 115 and supplies the control pulse to each pixel.
- Logic circuits such as shift registers and address decoders are used in the vertical scanning circuit unit 110 .
- a signal output from the photoelectric conversion element 102 of the pixel is processed by the signal processing unit 103 .
- the signal processing unit 103 is provided with a counter, a memory, and the like, and a digital value is held in the memory.
- the horizontal scanning circuit unit 111 inputs a control pulse for sequentially selecting each column to the signal processing unit 103 in order to read the signal from the memory of each pixel holding the digital signal.
- a signal is output to the signal line 113 from the signal processing unit 103 of the pixel selected by the vertical scanning circuit unit 110 for the selected column.
- the signal output to the signal line 113 is output to the external recording unit or signal processing unit of the photoelectric conversion device 100 via the output circuit 114 .
- the array of photoelectric conversion elements in the pixel area may be arranged one-dimensionally.
- the function of the signal processing unit does not necessarily have to be provided for each photoelectric conversion element.
- one signal processing unit may be shared by a plurality of photoelectric conversion elements, and signal processing may be performed sequentially.
- a plurality of signal processing units 103 are arranged in a region overlapping the pixel region 12 in plan view.
- a vertical scanning circuit portion 110, a horizontal scanning circuit portion 111, a column circuit 112, an output circuit 114, and a control pulse generating portion 115 are arranged so as to overlap between the edge of the sensor substrate 11 and the edge of the pixel region 12 in plan view. is distributed.
- the sensor substrate 11 has the pixel area 12 and the non-pixel area arranged around the pixel area 12, and the vertical scanning circuit section 110 and the horizontal scanning circuit section are provided in the area overlapping the non-pixel area in plan view.
- 111, a column circuit 112, an output circuit 114, and a control pulse generator 115 are arranged.
- FIG. 4 is an example of a block diagram including the equivalent circuits of FIGS. 2 and 3.
- the photoelectric conversion element 102 having the APD 201 is provided on the sensor substrate 11, and the other members are provided on the circuit substrate 21.
- the APD 201 is a photoelectric conversion unit that generates charge pairs according to incident light through photoelectric conversion.
- a voltage VL first voltage
- the cathode of the APD 201 is supplied with a voltage VH (second voltage) higher than the voltage VL supplied to the anode.
- a reverse bias voltage is supplied to the anode and cathode so that the APD 201 performs an avalanche multiplication operation. By supplying such a voltage, charges generated by the incident light undergo avalanche multiplication, generating an avalanche current.
- An APD operated in Geiger mode is called a SPAD.
- the voltage VL (first voltage) is -30V
- the voltage VH (second voltage) is 1V.
- the APD 201 may operate in linear mode or in Geiger mode. In the case of SPAD, the potential difference is larger than that of linear mode APD, and the effect of withstand voltage is remarkable. Therefore, SPAD is preferable.
- the quenching element 202 is connected to the APD 201 and the power supply that supplies the voltage VH.
- the quench element 202 functions as a load circuit (quench circuit) during signal multiplication by avalanche multiplication, suppresses the voltage supplied to the APD 201, and has a function of suppressing avalanche multiplication (quench operation). Also, the quench element 202 has a function of returning the voltage supplied to the APD 201 to the voltage VH by causing a current corresponding to the voltage drop due to the quench operation (recharge operation).
- the signal processing section 103 has a waveform shaping section 210 , a counter circuit 211 and a selection circuit 212 .
- the signal processing section 103 may have any one of the waveform shaping section 210 , the counter circuit 211 and the selection circuit 212 .
- the waveform shaping section 210 shapes the potential change of the cathode of the APD 201 obtained during photon detection, and outputs a pulse signal.
- an inverter circuit is used as the waveform shaping section 210 .
- FIG. 4 shows an example in which one inverter is used as the waveform shaping section 210, a circuit in which a plurality of inverters are connected in series may be used, or another circuit having a waveform shaping effect may be used.
- the counter circuit 211 counts the pulse signals output from the waveform shaping section 210 and holds the count value. Further, when the control pulse pRES is supplied via the drive line 213, the signal held in the counter circuit 211 is reset.
- the selection circuit 212 is supplied with a control pulse pSEL from the vertical scanning circuit section 110 in FIG. 3 through the drive line 214 in FIG. connection or non-connection.
- the selection circuit 212 includes, for example, a buffer circuit for outputting a signal.
- a switch such as a transistor may be provided between the quench element 202 and the APD 201 or between the photoelectric conversion element 102 and the signal processing section 103 to switch the electrical connection.
- the voltage VH or the voltage VL supplied to the photoelectric conversion element 102 may be electrically switched using a switch such as a transistor.
- the configuration using the counter circuit 211 is shown.
- a time-to-digital converter hereinafter referred to as TDC
- a memory may be used as the photoelectric conversion device 100 that obtains the pulse detection timing.
- TDC time-to-digital converter
- a control pulse pREF reference signal
- the TDC acquires a signal as a digital signal when the input timing of the signal output from each pixel via the waveform shaping section 210 is relative to the control pulse pREF.
- FIG. 5 is a diagram schematically showing the relationship between the operation of the APD and the output signal.
- FIG. 5(a) is a diagram extracting the APD 201, the quenching element 202, and the waveform shaping section 210 in FIG.
- the input side of the waveform shaping section 210 is nodeA
- the output side is nodeB.
- FIG. 5(b) shows waveform changes of nodeA in FIG. 5(a)
- FIG. 5(c) shows waveform changes of nodeB in FIG. 5(a).
- a potential difference of VH-VL is applied to the APD 201 in FIG. 5(a).
- a photon enters the APD 201 at time t1 avalanche multiplication occurs in the APD 201, an avalanche multiplication current flows through the quench element 202, and the voltage of nodeA drops.
- the voltage drop amount increases further and the potential difference applied to the APD 201 decreases the avalanche multiplication of the APD 201 stops as at time t2, and the voltage level of nodeA does not drop beyond a certain value.
- nodeA stabilizes at the original potential level.
- a portion of the output waveform at nodeA exceeding a certain threshold is waveform-shaped by the waveform shaping section 210 and output as a signal at nodeB.
- the arrangement of the signal lines 113, the arrangement of the column circuits 112, and the output circuits 114 are not limited to those shown in FIG.
- the signal lines 113 may be arranged extending in the row direction, and the column circuits 112 may be arranged beyond the extension of the signal lines 113 .
- FIG. 6 A photoelectric conversion device according to the first embodiment will be described with reference to FIGS. 6 to 11.
- FIG. 6 A photoelectric conversion device according to the first embodiment will be described with reference to FIGS. 6 to 11.
- FIG. 6 A circuit configuration of a pixel in a comparative example of the first photoelectric conversion device will be described using FIG.
- Each of the first pixel 31 and the second pixel 32 shown in FIG. 6 has an APD 301 , a quench circuit 302 and a signal detection circuit 303 .
- the first pixel 31 and the second pixel 32 have common readout circuits 304 , signal lines 305 , and control circuits 306 .
- the APD 301 is connected to the quench circuit 302 and the output terminal of the APD 301 is connected to the signal detection circuit 303.
- Detection signals based on photons photoelectrically converted by the APDs 301 of the first pixels 31 and the second pixels 32 pass through the readout circuit 304 and the control circuit 306 common to the first pixels 31 and the second pixels 32. , is output to the signal line 305 as a pixel signal.
- the control circuit 306 controls whether to output a pulse signal to the readout circuit 304 based on the output signals of the signal detection circuits 303 of the first pixels 31 and the second pixels 32 .
- the control circuit 306 is configured by, for example, a combinational circuit or a sequential circuit.
- the control circuit 306 there is an operation of outputting a pulse signal to the readout circuit 304 when signals based on photons are detected at the first pixel 31 and the second pixel 32 at the same time or at close timing. .
- This selectively reads photon signals with high temporal and spatial correlations and filters photon signals with weak temporal and spatial correlations.
- the signal light has strong temporal and spatial correlations, and external light and dark current, which are spurious signals, enter randomly and have weak temporal and spatial correlations. Therefore, by filtering signals with weak temporal and spatial correlations, it is possible to efficiently distinguish between signal light and external light or dark current.
- the circuit configuration shown in FIG. 6 is employed, the number of pixel signals output to the signal line 305 is smaller than the number of APDs 301, so there is a problem that the spatial resolution is lowered.
- FIG. 7 is an example of a block diagram for two pixels in the photoelectric conversion device according to this embodiment. Unlike the conventional circuit configuration shown in FIG. 6, a readout circuit 304 and a control circuit 306 are provided for each of the first pixel 31 and the second pixel 32 .
- the control circuit 306 (first control circuit) of the first pixel 31 controls the signal detection circuit 303 (second control circuit) of the second pixel 32 input via the control line 308 .
- detection circuit) of the first pixel 31 based on the output (second detection signal) of the signal detection circuit 303 (first detection circuit) of the first pixel 31, the output (first detection signal) of the first pixel 31 It controls whether or not to input to the readout circuit 304 (first output circuit).
- the control circuit 306 (second control circuit) of the second pixel 32 controls the second pixel 32 based on the output of the signal detection circuit 303 of the first pixel 31 input via the control line 307 . It controls whether or not to input the output of the signal detection circuit 303 of the second pixel 32 to the readout circuit 304 (second output circuit) of the second pixel 32 .
- the readout circuit 304 of the first pixel 31 As an example of the operation of the control circuit 306 of the first pixel 31, when the first pixel 31 and the second pixel 32 detect photons at the same time or at close timing, the readout circuit 304 of the first pixel 31 An operation of outputting a pulse signal, which is a first pixel signal, can be mentioned.
- the control circuit 306 of the second pixel 32 when the first pixel 31 and the second pixel 32 detect photon signals at the same time or at close timing, the second pixel 32 An operation of outputting a pulse signal, which is a second pixel signal, to the readout circuit 304 can be given.
- the control circuit 306 of the first pixel 31 may control signal output based on the output of the signal detection circuit 303 of pixels other than the second pixel 32 . Further, the control circuit 306 of the second pixel 32 may control signal output based on the output of the signal detection circuit 303 of pixels other than the first pixel 31 .
- the photon detection timing at which the pulse signal is output to the readout circuit 304 in each pixel will be described later.
- the strength of the temporal and spatial correlation of the photon signal detected by the APD 301 of each pixel can be determined for each pixel, thus reducing the spatial resolution. False signals can be suppressed without
- FIG. 8 shows an example of a circuit diagram for one pixel of this embodiment.
- a first pixel 31 of a photoelectric conversion device in which a first pixel 31, a second pixel 32, and a third pixel 33 are arranged in a one-dimensional array will be described as an example.
- the APD 301 (first photoelectric conversion unit) of the first pixel 31 is connected to a quench circuit 302 that is a first quench element made up of a P-type transistor.
- the quench circuit 302 is an element arranged to control the current flowing through the APD 301, and may be a resistor element, a capacitative element, or a circuit combining a plurality of transistors.
- the signal detection circuit 303 includes an inverter circuit 401 that performs waveform shaping, but a resistor element, a capacitor element, a circuit combining a plurality of transistors, or the like may be used.
- the width td of the output pulse signal of the signal detection circuit 303 is determined according to the recovery time of the APD 301 .
- a pull-down circuit 405 consisting of an N-type transistor is arranged in the readout circuit 304 .
- the signal line 305 is reset to "H” level through the pull-up circuit 406, and is switched to "L” level when the pulse signal is input to the pull-down circuit 405.
- the control circuit 306 includes a first logic circuit 402 , a second logic circuit 403 and a third logic circuit 404 .
- the first logic circuit 402, the second logic circuit 403, and the third logic circuit 404 are all NAND circuits.
- the first logic circuit 402 takes a negative logical product of the output signal of the inverter circuit 401 of the first pixel 31 and the output signal of the inverter circuit 401 of the third pixel 33 .
- the second logic circuit 403 takes a NAND of the output signal of the inverter circuit 401 of the first pixel 31 and the output signal of the inverter circuit 401 of the second pixel 32 .
- the third logic circuit 404 takes a NAND of the output signals of the first logic circuit 402 and the second logic circuit 403 .
- the control circuit 306 detects that at least one of the signals input from the adjacent second pixels 32 and 33 is "H". " level, it outputs "H" level to the readout circuit 304 .
- the first pixel 31 detects a photon at time t0
- either the second pixel 32 or the third pixel 33 detects a photon between time t0 ⁇ td and time t0+td. Then, the signal detected at the first pixel 31 is determined to be the true signal.
- a period of 2td which is a period corresponding to two output pulse signals from the detection circuit 303, is regarded as the aforementioned close timing.
- the first pixel 31 can output a pulse signal to the reading circuit 304 .
- the output of the signal detection circuit 303 of the first pixel 31 is connected to the control circuits 306 of the adjacent second and third pixels 32 and 33 via control lines 309 .
- control circuit 306 is not limited to that shown in FIG. 8, and any configuration capable of performing similar operations may be used.
- the first logic circuit 402 and the second logic circuit 403 may be AND circuits
- the third logic circuit 404 may be an OR circuit.
- FIG. 9 is a timing chart showing the operation of the pixels of the photoelectric conversion device according to this embodiment.
- the cathode potential of the APD 301 in FIG. 8 is VC
- the potential of the output terminal of the signal detection circuit 303 is V1
- the potential of the control line 308 is V2
- the potential of the control line 309 is V3
- the potential of the output terminal of the control circuit 306 is V4.
- the potential output to the signal line 305 is V5.
- Photon1, Photon2, and Photon3 indicate timings at which photons enter the APDs 301 of the first pixel 31, the second pixel 32, and the third pixel 33, respectively.
- the cathode potential VC is the potential of the output terminal of the APD 301, and changes due to photoelectric conversion that occurs according to the timing of Photon1 at times t1, t4, and t7.
- V1 indicates the signal waveform after the change in the cathode potential VC is waveform-shaped by the inverter circuit 401; Similarly, V2 is a pulse generated according to the timing of Photon2, and V3 is a pulse generated according to the timing of Photon3.
- V4 is at "H” level during the period when V1 is at “H” level and either V2 or V3 is at “H” level.
- V5 is the inverted logic of V4.
- V1 Due to Photon1 incident on the APD 301 at time t1, V1 becomes “H” level during the period from t1 to t2. However, since V2 and V3 are at "L” level at close timing, V4 does not go to "H” level and the photon detection pulse is not output to V5.
- V1 becomes "H” level during period t4-t6.
- the period t3 to t4 is shorter than the aforementioned pulse width td, and the time t3 is within the range of the period t4-td to t4+td. That is, Photon2 is incident at time t3, which is a timing close to time t4, and V2 becomes "H” level during period t3-t5, so V4 becomes "H” level during period t4-t5, and the signal detection pulse is output to V5.
- Photon 1 enters at time t7
- Photon 3 enters at time t8, which is a close timing.
- output to Photon2 and Photon3 incident at time t10 cause V2 and V3 to go to "H” level during the period from t10 to t11, but V1 does not go to "H” level at close timing. Not output to V5.
- a circuit configuration is adopted in which a signal detected at a timing when adjacent pixels are close to each other is regarded as a true signal, and any other signal is regarded as a false signal.
- the first detected signal is regarded as a false signal
- the later detected signal is regarded as a true signal.
- a circuit configuration may be employed for distinguishing the signal from the fake signal.
- FIG. 10 shows the control relationship of the pixel array of the photoelectric conversion device according to this embodiment.
- the control circuit of the target pixel is controlled by the vertically adjacent pixels.
- the control circuit for the pixel of interest is not controlled by pixels other than adjacent pixels.
- the control circuit of the target pixel is controlled only by the lower adjacent pixel. Pixels located at the ends of the array have fewer neighboring pixels than pixels located near the center of the array. Therefore, the number of pixels for controlling the control circuit of the pixel of interest is also reduced.
- the control circuit for the pixel of interest is controlled with a small number of pixels, there is a high possibility that the true signal cannot be detected correctly or a false signal is output compared to the case of controlling the control pixel using a sufficient number of pixels. Therefore, for example, it is possible to take measures such that the outermost pixels are not used in subsequent image processing.
- FIG. 11 A photoelectric conversion device according to the second embodiment will be described with reference to FIGS. 11 and 12.
- FIG. This embodiment differs from the first embodiment in the internal circuit configurations of the signal detection circuit 303 and the control circuit 306 . Descriptions common to the first embodiment will be omitted, and differences from the first embodiment will be mainly described.
- FIG. 11 shows an example of a circuit diagram for one pixel of this embodiment.
- the first pixel 31 of a photoelectric conversion device in which the first pixel 31, the second pixel 32, and the third pixel 33 are arranged in a one-dimensional array is taken as an example. to explain.
- An output signal of the APD 301 of the first pixel 31 is input to the first signal detection circuit 303 .
- the first control circuit 306 inputs the output of the first signal detection circuit 303 to the first readout circuit 304 according to the output of the signal detection circuit 303 of the second pixel 32 and the third pixel 33 . control whether to
- the signal detection circuit 303 of this embodiment includes an inverter circuit 401 and a pulse shortening circuit 407 .
- the pulse shortening circuit 407 is a circuit that generates a pulse signal having a predetermined pulse width shorter than the pulse width of the input signal according to the input signal.
- a monostable circuit or the like is used, but other combinational circuits, sequential circuits, capacitive coupling elements, or the like may also be used.
- the output of the signal detection circuit 303 is divided into two systems, the output of the inverter circuit 401 is directly connected to the control line 307 and the output of the pulse shortening circuit 407 is input to the control circuit 306 .
- the control circuit 306 includes logic circuitry 408 .
- the output signal of the pulse shortening circuit 407 is output to the reading circuit 304 only when the signals input via the control lines 308 and 309 are both at the "L" level.
- FIG. 12 is a timing chart showing the operation of the pixels of the photoelectric conversion device according to this embodiment.
- V1 the potential of the output terminal of the inverter circuit 401 in FIG. 11
- V1' the potential of the output terminal of the pulse shortening circuit 407
- a pulse wave is generated at the cathode potential VC according to the Photon1 signal incident on the APD 301 at times t1, t5, and t8.
- V1 indicates the signal waveform after the change in the cathode potential VC is waveform-shaped by the inverter circuit 401.
- FIG. A pulse signal obtained by shortening V1 is generated at V1'.
- V1' becomes “H” level during the period from t1 to t2. Since V2 and V3 are at “L” level at close timing, V4 becomes “H” level and a photon detection pulse is output to V5 during the period from t1 to t2.
- V1 Due to Photon1 incident at time t5, V1 becomes “H” level during period t5 to t7. Photon 2 is incident at time t4, which is a close timing, and V2 becomes “H” level earlier than V1, so V4 becomes “L” level and the photon detection pulse is not output to V5.
- Photon 1 which is incident at time t8, is incident on Photon 3 at time t9, which is close timing, and V3 becomes "H” level.
- a signal based on Photon1 is detected during the period t8-t9 when V3 is at the "L” level, a photon detection pulse is output to V5 during the period t8-t9.
- the first detected signal is regarded as a true signal
- the later detected signal is regarded as a false signal. It has a circuit configuration that sharply distinguishes between a false signal and a false signal.
- signal quality may be degraded by false signals such as crosstalk between the light source and the light receiving element due to reflection of emitted light within the TOF module housing, and crosstalk between pixels due to the avalanche light emission phenomenon. . It is known that signals due to such crosstalk components have very strong temporal and spatial correlations.
- signals with weak temporal and spatial correlations are read out as true signals, and signals with strong temporal and spatial correlations are regarded as false signals and filtered. This makes it possible to suppress false signals due to crosstalk while achieving high spatial resolution. Furthermore, by providing the pulse shortening circuit 407, the period for judging the photons as close timing is shortened. As a result, signals with stronger temporal correlation can be filtered as false signals.
- circuit configuration and circuit operation for realizing the present embodiment are not limited to the configuration described above. For example, when signals are detected at close timings, temporal and spatial correlation may occur due to a circuit configuration that regards them as false signals regardless of the order of detection. Strong signals may be filtered.
- FIG. 13 to 15 A photoelectric conversion device according to a third embodiment of the present invention will be described with reference to FIGS. 13 to 15.
- FIG. The photoelectric conversion device according to this embodiment differs from the first embodiment in that pixels are arranged in a two-dimensional array. Descriptions common to the first embodiment will be omitted, and differences from the first embodiment will be mainly described.
- FIG. 13 shows an example of a circuit diagram for one pixel of this embodiment.
- a first pixel 31 surrounded by a vertically adjacent second pixel 32 and a third pixel 33, and horizontally adjacent a fourth pixel 34 and a fifth pixel 35 will be described as an example.
- the first pixel 31 and the second pixel 32 are arranged in a first direction
- the second pixel 32 and the fourth pixel 34 are arranged in a second direction crossing the first direction.
- the first pixel 31 and the fifth pixel 35 are arranged in a third direction crossing the first direction.
- the first pixel 31 has an APD 301 (first photoelectric conversion unit), a signal detection circuit 303 (first detection circuit) that outputs a first detection signal, and a control circuit 306 (first control circuit).
- the second pixel 32 includes an APD 301 (second photoelectric conversion unit), a signal detection circuit 303 (second detection circuit) that outputs a second detection signal, and a control circuit 306 (second control circuit). ).
- the third pixel 33 has an APD 301 (third photoelectric conversion unit), a signal detection circuit 303 (third detection circuit) that outputs a third detection signal, and a control circuit 306 (third control circuit).
- the fourth pixel 34 has an APD 301 (fourth photoelectric conversion unit), a signal detection circuit 303 (fourth detection circuit) that outputs a fourth detection signal, and a control circuit 306 (fourth control circuit).
- the fifth pixel 31 has an APD 301 (fifth photoelectric conversion unit), a signal detection circuit 303 (fifth detection circuit) that outputs a fifth detection signal, and a control circuit 306 (fifth control circuit). .
- the control circuit 306 of the first pixel 31 outputs the output signal of the signal detection circuit 303 of the first pixel 31 according to the output signal of the signal detection circuit 303 of each of the second to fifth pixels. It controls whether or not to input to the readout circuit 304 of 31. Also, the output signal of the signal detection circuit 303 of the first pixel 31 is sent to the control circuit 306 of the second pixel 32, the third pixel 33, the fourth pixel 34, and the fifth pixel 35 through the control line 307. is entered.
- the signal detection circuit 303 of this embodiment includes an inverter circuit 501 for waveform shaping and a gate circuit 502 (first selection circuit).
- the gate circuit 502 outputs the output signal of the inverter circuit 501 to the control circuit 306 while the gate signal VG input from the outside of the pixel is at "H” level.
- the output signal of the inverter circuit 501 is not output to the control circuit 306 while the gate signal VG is at "L” level.
- the readout circuit 304 in this embodiment includes a counter circuit 505 and an output circuit 506 .
- the counter circuit 505 measures the incident intensity of photons detected by the first pixel 31 by counting the number of input pulses.
- An example of the counter circuit 505 is a multi-bit digital counter or the like, but a 1-bit digital memory, an analog memory using a capacitive element, or the like may also be used.
- the counter circuit 505 and the output circuit 506 are connected by the number of wires corresponding to the number of bits of the counter circuit 505 .
- the output circuit 506 receives a selection signal input from the outside of the pixel and outputs a signal output from the counter circuit 505 to the signal line 305 .
- the control circuit 306 in this embodiment includes a logic circuit 503 and a logic circuit 504 .
- the logic circuit 503 takes the logical sum of the four signal lines 308, 309, 310 and 311, and the logic circuit 504 takes the logical product of the output of the gate circuit 502 and the output of the logic circuit 503. is taking By adopting such a circuit configuration, the first pixel 31 and at least one of the second pixel 32, the third pixel 33, the fourth pixel 34, and the fifth pixel 35 are brought close to each other. A signal when a photon is detected in time can be regarded as a true signal.
- the logic circuit 503 and the logic circuit 504 may be configured using NOR circuits or NAND circuits instead of OR circuits or AND circuits, or other combinational circuits or sequential circuits.
- FIG. 14 is a timing chart showing the operation of the pixels of the photoelectric conversion device according to this embodiment.
- 13 is VR
- the output terminal potential of the inverter circuit 501 is V0
- the output terminal potential of the control circuit 306 is V6
- the output terminal of the counter circuit 505 is V7.
- Photon1 to Photon5 indicate timings at which photons enter the APDs 301 of the first to fifth pixels, respectively.
- VR is set to "L" level.
- a unit time is defined as the period until VR is changed to “L” level again at time t10.
- the potential VR is a reset signal that resets the cathode potential VC of the APD 301 by switching the resistance value of the quench element.
- VG is set to "H” level.
- the output signal of the inverter circuit 501 is output to the control circuit 306 during the period t2 to t5 in which VG is at the "H” level.
- the period during which VG is at "H” level is the detection period of the detection signal based on the photons incident on the APD 301
- the period during which VG is at "L” level is the non-detection period of the detection signal.
- Photon 1 is incident at times t6 and t8, Photon 2 is incident at time t7, Photon 3 is incident at time t9, and Photon 5 is incident at time t10. Since VG is at "L" level, the output signal of the inverter circuit 501 of each pixel is not output to the control circuit 306.
- FIG. 15 shows the control relationship of the pixel array of the photoelectric conversion device according to this embodiment.
- the control circuit of the target pixel is controlled by four adjacent pixels on the top, bottom, left, and right.
- the control circuit for the target pixel is not controlled for pixels other than adjacent pixels, such as pixels arranged in a diagonal direction.
- the control circuit of the target pixel is controlled only by the pixels arranged above and below and the three adjacent pixels on the left side of the target pixel. Pixels arranged at the outermost periphery of the array have fewer neighboring pixels than pixels arranged at other than the outermost periphery of the array. Therefore, the number of pixels for controlling the control circuit of the pixel of interest is also reduced.
- the control circuit for the pixel of interest is controlled with a small number of pixels, there is a high possibility that the true signal cannot be detected correctly or a false signal is output compared to the case of controlling the control pixel using a sufficient number of pixels. Therefore, for example, it is possible to take measures such that the outermost pixels are not used in subsequent image processing.
- the circuit is configured such that a signal detected at a timing close to one of four adjacent pixels is regarded as a true signal, and any other signal is regarded as a false signal.
- 16A to 16D show the control relationship of the pixel array in this modified example.
- the configuration and driving timing of the pixel circuit conform to those of the third embodiment.
- a different point from the third embodiment is that the arrangement of pixels for controlling the pixel of interest is different.
- Four types of connection relationships, pattern 1 to pattern 4 will be described below.
- the control circuit 306 of the pixel of interest is controlled by eight pixels surrounding the pixel of interest.
- the 8 pixels surrounding the pixel of interest are the 4 pixels adjacent to the pixel of interest on the top, bottom, left, and right, and the 4 pixels arranged in the diagonal direction of the pixel of interest. Since the number of pixels that control the pixel of interest is greater than in the third embodiment, the light utilization efficiency is increased, and even weaker signals can be detected with high accuracy.
- the control circuit 306 for the pixel of interest is controlled by four pixels arranged in a diagonal direction, and is not controlled by the nearest four pixels on the top, bottom, left, and right.
- crosstalk caused by avalanche light emission tends to generate false signals with strong temporal correlations in the nearest pixels.
- the control circuit 306 of the pixel of interest is controlled by 12 pixels including a pixel that is not in direct contact with the pixel of interest and is separated from the pixel of interest by two pixels.
- the pixels controlled by the control circuit 306 of the pixel of interest are arranged in a biased manner with respect to the X and Y directions.
- the control circuit 306 of the pixel of interest is controlled by three pixels, ie, the pixel adjacent to the pixel of interest in the downward direction and the left direction, and the pixel arranged in the lower left direction of the pixel of interest.
- the "pixel group controlling the target pixel” and the "pixel group controlled by the target pixel” do not necessarily match.
- the number of pixels controlling the target pixel and the number of pixels controlled by the target pixel are not limited to the same number.
- the effect of this embodiment can be obtained similarly to the patterns shown in FIGS. 15 and 16A to 16D.
- FIG. 17 shows an example of a circuit diagram for one pixel of this embodiment. This embodiment differs from the third embodiment in the circuit configuration inside the control circuit 306 . Descriptions common to the first to third embodiments will be omitted, and differences from the third embodiment will be mainly described.
- the control circuit 306 in this embodiment includes a multiplexer circuit 508 and a logic circuit 509 .
- the multiplexer circuit 508 can switch Enable/Disable of the function of the control circuit 306 according to the signal S input from outside the pixel.
- the control circuit 306 of the first pixel 31 detects the output of the signal detection circuit 303 of the first pixel 31 according to the signals of the adjacent second to fifth pixels. It controls whether or not to output to the readout circuit 304 of the first pixel 31 .
- the output of the signal detection circuit 303 of the first pixel 31 is directly output to the readout circuit 304 of the first pixel 31 regardless of the outputs of adjacent pixels.
- the logic circuit 509 similarly to the third embodiment, after obtaining the logical sum of the outputs of the signal detection circuits 303 of the adjacent pixels, the output of the logical sum and the signal detection circuit 303 of the first pixel 31 are obtained.
- a circuit configuration is conceivable in which the AND of the outputs of .
- the logic circuit 509 detects the output of the signal detection circuit 303 of the first pixel 31 only when the output of the signal detection circuit 303 of N pixels or more (N is an integer of 2 or more) among adjacent pixels is at "H" level.
- a circuit configuration that outputs to the readout circuit 304 of the first pixel 31 may be employed.
- the logic circuit 509 selects the first pixel 31 and the first pixel 31 only when the outputs of the signal detection circuits 303 of N pixels or more (N is an integer equal to or greater than 2) among the pixels adjacent to the first pixel 31 are at the "H" level.
- a circuit configuration may be adopted in which a “H” level is output to the readout circuit 304 of one pixel 31 .
- a configuration in which the output of the signal detection circuit 303 is weighted according to the arrangement of adjacent pixels involved in the control of the control circuit 306 is also conceivable.
- the output of the signal detection circuit 303 of the first pixel 31 is output to the readout circuit 304 of the first pixel 31 only when the weighted addition value of the "H" level signal exceeds a certain threshold value M.
- the circuit configuration may be such that Each of the thresholds N and M may be a predetermined value, or may be a variable rewritable from outside the pixel.
- the signal detection circuit 303 of this embodiment includes an inverter circuit 501, a gate circuit 502, and a latch circuit 507 (first latch circuit).
- the latch circuit 507 is latched to the "H” level state when a photon is detected while the gate signal VG is at the "H” level.
- the recharge signal VR becomes “L” level the latch circuit 507 is also reset to "L” level. In this way, by holding the signal based on photon detection in the latch circuit 507, even if timing variations occur in the circuits of the first pixel 31 and adjacent pixels, the true signal and the false signal can be discriminated with high accuracy. be able to.
- FIG. 18A and 18B are timing charts showing the operation of the pixels of the photoelectric conversion device according to this embodiment.
- FIG. 18A shows a timing chart of the first drive mode in which the control circuit is enabled
- FIG. 18B shows a timing chart of the second drive mode in which the control circuit is disabled.
- VR is set to "L" level.
- a unit time is defined as the period until VR is changed to "L” level again at time t10.
- VG is set to "H” level.
- the output signal of the inverter circuit 501 is output to the control circuit 306 during the period t2 to t5 in which VG is at the "H” level.
- Photon 1 is incident at times t6 and t8, Photon 2 is incident at time t7, Photon 3 is incident at time t9, and Photon 5 is incident at time t10. Since VG is at "L" level, the output signal of inverter circuit 501 is not output to control circuit 306.
- VR is set to "L" level at time t1 as in FIG. 18A.
- a unit time is defined as the period until VR is changed to "L" level again at time t10.
- VG is set to "H” level.
- the output signal of the inverter circuit 501 is output to the control circuit 306 during the period t2 to t5 in which VG is at the "H” level.
- Photon 1 enters at time t6 and time t8, Photon 4 at t4, Photon 2 at time t7, Photon 3 at time t9, and Photon 5 at time t10, but these signals do not contribute to the change in V6. Since VG is at "L" level, the output signal of inverter circuit 501 is not output to control circuit 306.
- FIG. 1 the output signal of inverter circuit 501 is not output to control circuit 306.
- the first detected signal when signals are detected at timings when adjacent pixels are close to each other, the first detected signal is regarded as a true signal, and the later detected signal is regarded as a fake signal, thereby filtering signals due to crosstalk components. I showed the configuration to do.
- the first detected signal when signals are detected at timings when adjacent pixels are close to each other, the first detected signal is regarded as a false signal and the later detected signal is regarded as a true signal. Filtering is also possible.
- a drive mode that distinguishes true signals from false signals based on the strength of temporal and spatial correlation
- a drive mode that outputs a signal regardless of the strength of temporal and spatial correlation. You can switch. By selecting the optimum drive mode according to the scene, it is possible to improve the signal quality during shooting.
- FIGS. 19A to 19C are diagrams showing the control relationship of the pixel array of the photoelectric conversion device according to this embodiment.
- pixels having different connection relationships with pixels involved in control of the control circuit are mixed.
- pixels A and pixels B are arranged in a two-dimensional array.
- the pixel A and the pixel B have different connection relationships with the pixels involved in the control of the control circuit.
- pixel rows in which pixels A are arranged and pixel rows in which pixels B are arranged are alternately arranged.
- the control relationship of pixel A is shown in FIG. 19B, and the control relationship of pixel B is shown in FIG. 19C.
- the control circuit for pixel A is controlled by two pixels adjacent to the left and right of the pixel of interest.
- the control circuit for the pixel B is controlled by pixels for one row in which the pixel of interest is arranged. In an arrangement in which pixel rows in which pixels A are arranged and pixel rows in which pixels B are arranged are alternately arranged as shown in FIG. Connected.
- the strength of the spatial correlation of the detected signals also differs. According to such a photoelectric conversion device, since a signal with a strong spatial correlation and a signal with a weak spatial correlation can be obtained at the same time, it is possible to obtain the effect of being able to improve the accuracy of distinguishing between a true signal and a false signal.
- 20A to 20C show the control relationship of the pixel array in this modified example. It is common to the fifth embodiment that pixels having different connection relationships with pixels related to the control of the control circuit are mixed, but differs from the fifth embodiment in that pixels having different connection relationships are connected to each other. ing.
- pixels A and pixels B are arranged in a two-dimensional array.
- the pixel A and the pixel B have different connection relationships with the pixels involved in the control of the control circuit.
- pixels A and pixels B are alternately arranged.
- the control relationship of pixel A is shown in FIG. 20B, and the control relationship of pixel B is shown in FIG. 20C.
- the control circuit of pixel A is controlled by four pixels adjacent to the upper, lower, right, and left sides of the pixel of interest.
- the control circuit for the pixel B is controlled by a total of 8 pixels, 4 pixels arranged diagonally to the pixel of interest and 4 pixels separated from the pixel of interest by 2 pixels.
- pixels A and pixels B are alternately arranged as shown in FIG. 20A, pixels A and pixels B are connected to each other for control of the control circuit.
- the strength of the spatial correlation of the detected signals also differs. According to such a photoelectric conversion device, since a signal with a strong spatial correlation and a signal with a weak spatial correlation can be obtained at the same time, it is possible to obtain the effect of being able to improve the accuracy of distinguishing between a true signal and a false signal.
- FIG. 21 is a block diagram showing a schematic configuration of a photoelectric conversion system according to this embodiment.
- the photoelectric conversion devices described in the first to sixth embodiments can be applied to various photoelectric conversion systems.
- Examples of applicable photoelectric conversion systems include digital still cameras, digital camcorders, surveillance cameras, copiers, facsimiles, mobile phones, vehicle-mounted cameras, and observation satellites.
- a camera module including an optical system such as a lens and an imaging device is also included in the photoelectric conversion system.
- FIG. 21 illustrates a block diagram of a digital still camera as an example of these.
- the photoelectric conversion system illustrated in FIG. 21 includes an imaging device 1004 that is an example of a photoelectric conversion device, and a lens 1002 that forms an optical image of a subject on the imaging device 1004 . Furthermore, it has an aperture 1003 for varying the amount of light passing through the lens 1002 and a barrier 1001 for protecting the lens 1002 .
- a lens 1002 and a diaphragm 1003 are an optical system for condensing light onto an imaging device 1004 .
- the imaging device 1004 is a photoelectric conversion device according to any of the above embodiments, and converts an optical image formed by the lens 1002 into an electrical signal.
- the photoelectric conversion system also has a signal processing unit 1007 that is an image generation unit that generates an image by processing an output signal output from the imaging device 1004 .
- a signal processing unit 1007 performs an operation of performing various corrections and compressions as necessary and outputting image data.
- the signal processing unit 1007 may be formed on the semiconductor substrate on which the imaging device 1004 is provided, or may be formed on a semiconductor substrate separate from the imaging device 1004 .
- the photoelectric conversion system further includes a memory unit 1010 for temporarily storing image data, and an external interface unit (external I/F unit) 1013 for communicating with an external computer or the like. Further, the photoelectric conversion system includes a recording medium 1012 such as a semiconductor memory for recording or reading image data, and a recording medium control interface section (recording medium control I/F section) 1011 for recording or reading from the recording medium 1012. have Note that the recording medium 1012 may be built in the photoelectric conversion system or may be detachable.
- the photoelectric conversion system has an overall control/calculation unit 1009 that controls various calculations and the entire digital still camera, and a timing generation unit 1008 that outputs various timing signals to the imaging device 1004 and signal processing unit 1007 .
- the timing signal and the like may be input from the outside, and the photoelectric conversion system may have at least the imaging device 1004 and the signal processing unit 1007 that processes the output signal output from the imaging device 1004 .
- the imaging device 1004 outputs the imaging signal to the signal processing unit 1007 .
- a signal processing unit 1007 performs predetermined signal processing on the imaging signal output from the imaging device 1004 and outputs image data.
- a signal processing unit 1007 generates an image using the imaging signal.
- a photoelectric conversion system that applies the photoelectric conversion device (imaging device) of any of the above embodiments can be realized.
- FIGS. 22A and 22B are diagrams showing the configurations of the photoelectric conversion system and the moving body of this embodiment.
- FIG. 22A shows an example of a photoelectric conversion system for an in-vehicle camera.
- the photoelectric conversion system 1300 has an imaging device 1310 .
- the imaging device 1310 is the photoelectric conversion device described in any of the above embodiments.
- the photoelectric conversion system 1300 includes an image processing unit 1312 that performs image processing on a plurality of image data acquired by the imaging device 1310, and a parallax (phase difference of the parallax image) from the plurality of image data acquired by the photoelectric conversion system 1300. It has a parallax acquisition unit 1314 that performs calculation.
- the photoelectric conversion system 1300 also includes a distance acquisition unit 1316 that calculates the distance to the object based on the calculated parallax, and a collision determination unit that determines whether there is a possibility of collision based on the calculated distance. 1318 and .
- the parallax acquisition unit 1314 and the distance acquisition unit 1316 are examples of distance information acquisition means for acquiring distance information to the target object. That is, the distance information is information related to parallax, defocus amount, distance to the object, and the like.
- the collision determination unit 1318 may use any of these distance information to determine the possibility of collision.
- the distance information acquisition means may be implemented by specially designed hardware, or may be implemented by a software module.
- FPGA Field Programmable Gate Array
- ASIC Application Specific Integrated Circuit
- the photoelectric conversion system 1300 is connected to a vehicle information acquisition device 1320, and can acquire vehicle information such as vehicle speed, yaw rate, and steering angle.
- the photoelectric conversion system 1300 is also connected to a control ECU 1330 which is a control unit that outputs a control signal for generating a braking force to the vehicle based on the determination result of the collision determination unit 1318 .
- the photoelectric conversion system 1300 is also connected to an alarm device 1340 that issues an alarm to the driver based on the determination result of the collision determination section 1318 . For example, if the collision determination unit 1318 determines that there is a high probability of collision, the control ECU 1330 performs vehicle control to avoid collisions and reduce damage by applying the brakes, releasing the accelerator, or suppressing the engine output.
- the alarm device 1340 warns the user by sounding an alarm such as sound, displaying alarm information on the screen of a car navigation system, or vibrating a seat belt or steering wheel.
- the photoelectric conversion system 1300 captures an image of the surroundings of the vehicle, for example, the front or rear.
- FIG. 22B shows a photoelectric conversion system for capturing an image in front of the vehicle (imaging range 1350).
- a vehicle information acquisition device 1320 sends an instruction to the photoelectric conversion system 1300 or imaging device 1310 .
- the photoelectric conversion system can be applied not only to vehicles such as own vehicles but also to moving bodies (moving devices) such as ships, aircraft, and industrial robots.
- the present invention can be applied not only to mobile objects but also to devices that widely use object recognition, such as intelligent transportation systems (ITS).
- ITS intelligent transportation systems
- FIG. 23 is a block diagram showing a configuration example of a distance image sensor, which is the photoelectric conversion system of this embodiment.
- the distance image sensor 401 includes an optical system 407, a photoelectric conversion device 408, an image processing circuit 404, a monitor 405, and a memory 406.
- the distance image sensor 401 receives the light (modulated light or pulsed light) projected from the light source device 409 toward the subject and reflected by the surface of the subject, thereby producing a distance image corresponding to the distance to the subject. can be obtained.
- the optical system 407 includes one or more lenses, guides the image light (incident light) from the subject to the photoelectric conversion device 408, and forms an image on the light receiving surface (sensor section) of the photoelectric conversion device 408.
- the photoelectric conversion device of each embodiment described above is applied as the photoelectric conversion device 408 , and a distance signal indicating the distance obtained from the received light signal output from the photoelectric conversion device 408 is supplied to the image processing circuit 404 .
- the image processing circuit 404 performs image processing to construct a distance image based on the distance signal supplied from the photoelectric conversion device 408 .
- a distance image (image data) obtained by the image processing is supplied to the monitor 405 to be displayed, or supplied to the memory 406 to be stored (recorded).
- the distance image sensor 401 configured in this manner, by applying the above-described photoelectric conversion device, it is possible to obtain, for example, a more accurate distance image as the characteristics of the pixels are improved.
- FIG. 24 is a diagram showing an example of a schematic configuration of an endoscopic surgery system, which is the photoelectric conversion system of this embodiment.
- FIG. 24 shows how an operator (physician) 1131 uses an endoscopic surgery system 1150 to perform surgery on a patient 1132 on a patient bed 1133 .
- the endoscopic surgery system 1150 is composed of an endoscope 1100, a surgical tool 1110, and a cart 1134 loaded with various devices for endoscopic surgery.
- An endoscope 1100 is composed of a lens barrel 1101 whose distal end is inserted into the body cavity of a patient 1132 and a camera head 1102 connected to the proximal end of the lens barrel 1101 .
- the illustrated example shows an endoscope 1100 configured as a so-called rigid endoscope having a rigid lens barrel 1101, but the endoscope 1100 may be configured as a so-called flexible endoscope having a flexible lens barrel. good.
- the tip of the lens barrel 1101 is provided with an opening into which the objective lens is fitted.
- a light source device 1203 is connected to the endoscope 1100, and light generated by the light source device 1203 is guided to the tip of the lens barrel 1101 by a light guide extending inside the lens barrel 1101, whereupon the objective lens through the body cavity of the patient 1132 toward the object to be observed.
- the endoscope 1100 may be a straight scope, a perspective scope, or a side scope.
- An optical system and a photoelectric conversion device are provided inside the camera head 1102, and the reflected light (observation light) from the observation target is focused on the photoelectric conversion device by the optical system.
- the photoelectric conversion device photoelectrically converts the observation light to generate an electrical signal corresponding to the observation light, that is, an image signal corresponding to the observation image.
- the photoelectric conversion device the photoelectric conversion device described in each of the above embodiments can be used.
- the image signal is transmitted to a camera control unit (CCU: Camera Control Unit) 1135 as RAW data.
- CCU Camera Control Unit
- the CCU 1135 is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and controls the operations of the endoscope 1100 and the display device 1136 in an integrated manner. Further, the CCU 1135 receives an image signal from the camera head 1102 and performs various image processing such as development processing (demosaicing) for displaying an image based on the image signal.
- CPU Central Processing Unit
- GPU Graphics Processing Unit
- the display device 1136 displays an image based on the image signal subjected to image processing by the CCU 1135 under the control of the CCU 1135 .
- the light source device 1203 is composed of, for example, a light source such as an LED (Light Emitting Diode), and supplies the endoscope 1100 with irradiation light for photographing a surgical site or the like.
- a light source such as an LED (Light Emitting Diode)
- LED Light Emitting Diode
- the input device 1137 is an input interface for the endoscopic surgery system 1150.
- the user can input various information and instructions to the endoscopic surgery system 1150 via the input device 1137 .
- the treatment instrument control device 1138 controls driving of the energy treatment instrument 1112 for tissue cauterization, incision, blood vessel sealing, or the like.
- the light source device 1203 that supplies irradiation light to the endoscope 1100 for photographing the surgical site can be composed of, for example, a white light source composed of an LED, a laser light source, or a combination thereof.
- a white light source is configured by a combination of RGB laser light sources
- the output intensity and output timing of each color (each wavelength) can be controlled with high accuracy. It can be carried out.
- the observation target is irradiated with laser light from each of the RGB laser light sources in a time-sharing manner, and by controlling the drive of the imaging device of the camera head 1102 in synchronization with the irradiation timing, each of the RGB can be handled. It is also possible to pick up images by time division. According to this method, a color image can be obtained without providing a color filter in the imaging element.
- the driving of the light source device 1203 may be controlled so as to change the intensity of the output light every predetermined time.
- the driving of the imaging device of the camera head 1102 in synchronism with the timing of the change in the intensity of the light to acquire images in a time-division manner and synthesizing the images, a high dynamic A range of images can be generated.
- the light source device 1203 may be configured to be able to supply light in a predetermined wavelength band corresponding to special light observation.
- Special light observation utilizes the wavelength dependence of light absorption in body tissues. Specifically, a predetermined tissue such as a blood vessel on the surface of the mucous membrane is imaged with high contrast by irradiating light with a narrower band than the irradiation light (that is, white light) used during normal observation.
- irradiation light that is, white light
- fluorescence observation may be performed in which an image is obtained from fluorescence generated by irradiation with excitation light.
- body tissue is irradiated with excitation light and fluorescence from the body tissue is observed, or a reagent such as indocyanine green (ICG) is locally injected into the body tissue and the fluorescence wavelength of the reagent is observed in the body tissue. It is possible to obtain a fluorescent image by irradiating excitation light corresponding to .
- the light source device 1203 can be configured to supply narrowband light and/or excitation light corresponding to such special light observation.
- FIG. 25A illustrates glasses 1600 (smart glasses) that are the photoelectric conversion system of this embodiment.
- Glasses 1600 have a photoelectric conversion device 1602 .
- the photoelectric conversion device 1602 is the photoelectric conversion device described in each of the above embodiments.
- a display device including a light emitting device such as an OLED or an LED may be provided on the rear surface side of the lens 1601 .
- One or more photoelectric conversion devices 1602 may be provided. Further, a plurality of types of photoelectric conversion devices may be used in combination.
- the arrangement position of the photoelectric conversion device 1602 is not limited to that shown in FIG. 25A.
- the spectacles 1600 further include a control device 1603 .
- the control device 1603 functions as a power source that supplies power to the photoelectric conversion device 1602 and the display device. Further, the control device 1603 controls operations of the photoelectric conversion device 1602 and the display device.
- An optical system for condensing light onto the photoelectric conversion device 1602 is formed in the lens 1601 .
- FIG. 25B illustrates glasses 1610 (smart glasses) according to one application example.
- the glasses 1610 have a control device 1612, and the control device 1612 is equipped with a photoelectric conversion device corresponding to the photoelectric conversion device 1602 and a display device.
- a photoelectric conversion device in the control device 1612 and an optical system for projecting light emitted from the display device are formed in the lens 1611 , and an image is projected onto the lens 1611 .
- the control device 1612 functions as a power source that supplies power to the photoelectric conversion device and the display device, and controls the operation of the photoelectric conversion device and the display device.
- the control device may have a line-of-sight detection unit that detects the line of sight of the wearer.
- Infrared rays may be used for line-of-sight detection.
- the infrared light emitting section emits infrared light to the eyeballs of the user who is gazing at the display image.
- a captured image of the eyeball is obtained by detecting reflected light of the emitted infrared light from the eyeball by an imaging unit having a light receiving element.
- the user's line of sight to the displayed image is detected from the captured image of the eyeball obtained by capturing infrared light.
- Any known method can be applied to line-of-sight detection using captured images of eyeballs.
- line-of-sight detection processing is performed based on the pupillary corneal reflection method.
- the user's line of sight is detected by calculating a line of sight vector representing the orientation (rotational angle) of the eyeball based on the pupil image and the Purkinje image included in the captured image of the eyeball using the pupillary corneal reflection method. be.
- the display device of the present embodiment may have a photoelectric conversion device having a light receiving element, and may control the display image of the display device based on the user's line-of-sight information from the photoelectric conversion device.
- the display device determines a first visual field area that the user gazes at and a second visual field area other than the first visual field area, based on the line-of-sight information.
- the first viewing area and the second viewing area may be determined by the control device of the display device, or may be determined by an external control device.
- the display resolution of the first viewing area may be controlled to be higher than the display resolution of the second viewing area. That is, the resolution of the second viewing area may be lower than that of the first viewing area.
- the display area has a first display area and a second display area different from the first display area. may be determined.
- the first viewing area and the second viewing area may be determined by the control device of the display device, or may be determined by an external control device.
- the resolution of areas with high priority may be controlled to be higher than the resolution of areas other than areas with high priority. In other words, the resolution of areas with relatively low priority may be lowered.
- AI may be used to determine the first field of view area and areas with high priority.
- the AI is a model configured to estimate the angle of the line of sight from the eyeball image and the distance to the object ahead of the line of sight, using the image of the eyeball and the direction in which the eyeball of the image was actually viewed as training data. It's okay.
- the AI program may be owned by the display device, the photoelectric conversion device, or the external device. If the external device has it, it is communicated to the display device via communication.
- Smart glasses can display captured external information in real time.
- the photoelectric conversion systems shown in the sixth and seventh embodiments are examples of photoelectric conversion systems to which the photoelectric conversion device can be applied, and the photoelectric conversion device of the present invention can be applied.
- This photoelectric conversion system is not limited to the configurations shown in FIGS. 21 to 22A and 22B. The same applies to the ToF system shown in the eighth embodiment, the endoscope shown in the ninth embodiment, and the smart glasses shown in the tenth embodiment.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Light Receiving Elements (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
Description
第1の実施形態にかかる光電変換装置について図6から図11までを用いて説明する。
第2の実施形態にかかる光電変換装置について、図11及び図12を用いて説明する。本実施形態は、信号検出回路303と制御回路306の内部の回路構成において第1の実施形態と異なっている。第1の実施形態と共通する説明は省略し、主に第1の実施形態と異なる部分について説明する。
本発明の第3の実施形態にかかる光電変換装置について、図13から図15までを用いて説明する。本実施形態にかかる光電変換装置は、画素が2次元状にアレイ配置されている点において第1の実施形態と異なっている。第1の実施形態と共通する説明は省略し、主に第1の実施形態と異なる部分について説明する。
第3の実施形態の変形例について、図16A~図16Dを用いて説明する。
本発明の第4の実施形態について、図17及び図18A、図18Bを用いて説明する。
第5の実施形態にかかる光電変換装置について図19A~図19Cを用いて説明する。図19A~図19Cは本実施形態にかかる光電変換装置の画素アレイの制御関係を示す図である。本実施形態にかかる光電変換装置では、制御回路の制御に関わる画素との接続関係の異なる画素が混在している。
第5の実施形態の変形例について、図20A~図20Cを用いて説明する。
本実施形態による光電変換システムについて、図21を用いて説明する。図21は、本実施形態による光電変換システムの概略構成を示すブロック図である。
本実施形態の光電変換システム及び移動体について、図22A、図22Bを用いて説明する。図22A、図22Bは、本実施形態の光電変換システム及び移動体の構成を示す図である。
本実施形態の光電変換システムについて、図23を用いて説明する。図23は、本実施形態の光電変換システムである距離画像センサの構成例を示すブロック図である。
本実施形態の光電変換システムについて、図24を用いて説明する。図24は、本実施形態の光電変換システムである内視鏡手術システムの概略的な構成の一例を示す図である。
本実施形態の光電変換システムについて、図25A、図25Bを用いて説明する。図25Aは、本実施形態の光電変換システムである眼鏡1600(スマートグラス)を説明する。眼鏡1600には、光電変換装置1602を有する。光電変換装置1602は、上記の各実施形態に記載の光電変換装置である。また、レンズ1601の裏面側には、OLEDやLED等の発光装置を含む表示装置が設けられていてもよい。光電変換装置1602は1つでもよいし、複数でもよい。また、複数種類の光電変換装置を組み合わせて用いてもよい。光電変換装置1602の配置位置は図25Aに限定されない。
本発明は、上記実施形態に限らず種々の変形が可能である。
Claims (23)
- 第1の光電変換部と、
前記第1の光電変換部に入射した光子に基づく第1の検出信号を出力する第1の検出回路と、
前記第1の検出信号に応じて画素外に第1の画素信号を出力する第1の出力回路と、
前記第1の検出信号を前記第1の出力回路に入力するか否かを制御する第1の制御回路と、を含む、第1の画素と、
第2の光電変換部と、
前記第2の光電変換部に入射した光子に基づく第2の検出信号を出力する第2の検出回路と、
前記第2の検出信号に応じて画素外に第2の画素信号を出力する第2の出力回路と、
前記第2の検出信号を前記第2の出力回路に入力するか否かを制御する第2の制御回路と、を含む、第2の画素と、を含む複数の画素がアレイ状に配された画素領域を有し、
前記第1の制御回路は、前記第2の検出信号に応じて、前記第1の検出信号を前記第1の出力回路に入力するか否かを制御することを特徴とする光電変換装置。 - 前記第1の光電変換部と、前記第2の光電変換部と、はアバランシェフォトダイオードであることを特徴とする請求項1に記載の光電変換装置。
- 前記第1の出力回路は前記第1の検出信号を保持するメモリ又は前記第1の検出信号をカウントするカウンタ回路を有することを特徴とする請求項1又は請求項2に記載の光電変換装置。
- 前記第1の制御回路は前記第1の検出信号と前記第2の検出信号との論理積をとる論理回路であることを特徴とする請求項1乃至請求項3のいずれか一項に記載の光電変換装置。
- 前記第2の制御回路は、前記第1の検出信号に応じて前記第2の出力回路に前記第2の検出信号を入力するか否かを決定することを特徴とする請求項1乃至請求項4のいずれか一項に記載の光電変換装置。
- 第3の光電変換部と、
前記第3の光電変換部に入射した光子に基づく第3の検出信号を出力する第3の検出回路と、
前記第3の検出信号に応じて画素外に第3の画素信号を出力する第3の出力回路と、
前記第3の検出信号を前記第3の出力回路に入力するか否かを制御する第3の制御回路と、を含む、第3の画素を含み、
前記第3の制御回路は前記第2の検出信号に応じて前記第3の出力回路に前記第3の検出信号を出力するか否かを決定することを特徴とする請求項1乃至請求項5のいずれか一項に記載の光電変換装置。 - 前記第1の画素と、前記第2の画素と、は第1の方向に並び、
前記第2の画素と、前記第3の画素と、は前記第1の方向に交差する第2の方向に並ぶことを特徴とする請求項6に記載の光電変換装置。 - 前記第1の制御回路は、前記第3の検出信号に応じて前記第1の出力回路に前記第1の検出信号を出力するか否かを決定することを特徴とする請求項6又は請求項7に記載の光電変換装置。
- 第4の光電変換部と、
前記第4の光電変換部に入射した光子に基づく第4の検出信号を出力する第4の検出回路と、
前記第4の検出信号に応じて画素外に第4の画素信号を出力する第4の出力回路と、
前記第4の検出信号を前記第4の出力回路に入力するか否かを制御する第4の制御回路と、を含む、第4の画素を含み、
前記第1の制御回路は前記第2の検出信号と、前記第4の検出信号と、に応じて前記第1の出力回路に前記第1の検出信号を出力するか否かを決定することを特徴とする請求項1乃至請求項6のいずれか一項に記載の光電変換装置。 - 前記第1の画素と、前記第2の画素と、は第1の方向に並び、
前記第2の画素と、前記第4の画素と、は前記第1の方向に交差する第3の方向に並ぶことを特徴とする請求項9に記載の光電変換装置。 - 前記画素領域に含まれる前記複数の画素のうち、前記第2の画素は前記第1の画素に最近接の画素ではないことを特徴とする請求項1乃至請求項10のいずれか一項に記載の光電変換装置。
- 前記第1の検出回路は、前記第1の検出信号を検出する検出期間と、前記第1の検出信号を検出しない非検出期間とを選択する第1の選択回路を有することを特徴とする請求項1乃至請求項11のいずれか一項に記載の光電変換装置。
- 前記第1の画素は、第1のクエンチ素子を有し、
前記第1の検出回路は、第1のラッチ回路を有し、
前記第1のラッチ回路と、前記第1のクエンチ素子と、は共通のリセット信号によって制御されることを特徴とする請求項1乃至請求項12のいずれか一項に記載の光電変換装置。 - 前記第1の検出回路は、前記第1の検出回路への入力信号のパルス幅よりも短いパルス幅を有する前記第1の検出信号を出力するモノステーブル回路を有することを特徴とする請求項1乃至請求項13のいずれか一項に記載の光電変換装置。
- 前記第1の制御回路を制御する検出信号を出力する画素の数と、
前記第1の制御回路によって制御される出力回路を含む画素の数と、が同数であることを特徴とする請求項1乃至請求項14のいずれか一項に記載の光電変換装置。 - 前記画素領域の最外周に配された画素の制御回路を制御する検出信号の数は、
前記画素領域の最外周以外に配された画素の制御回路を制御する検出信号の数より少ないことを特徴とする請求項1乃至請求項14のいずれか一項に記載の光電変換装置。 - 単位時間内に、前記第2の画素で光子が検出されるよりも前に前記第1の画素で光子が検出されたときに前記第1の出力回路に前記第1の検出信号を入力することを特徴とする請求項1乃至請求項16のいずれか一項に記載の光電変換装置。
- 単位時間内に、前記第1の画素で光子が検出されるよりも前に前記第2の画素で光子が検出されたときに前記第1の出力回路に前記第1の検出信号を入力することを特徴とする請求項1乃至請求項16のいずれか一項に記載の光電変換装置。
- 前記第2の検出信号に応じて前記第1の制御回路に前記第1の検出信号を入力するか否かを決定する第1の駆動モードと、
前記第2の検出信号に拠らず前記第1の制御回路に前記第1の検出信号を入力する第2の駆動モードと、を有することを特徴とする請求項1乃至請求項18のいずれか一項に記載の光電変換装置。 - 前記第1の光電変換部が配されたセンサ基板と、
前記第1の出力回路が配された回路基板と、が積層された積層型のセンサであることを特徴とする請求項1乃至請求項19のいずれか一項に記載の光電変換装置。 - 前記第1の制御回路は前記回路基板に配されることを特徴とする請求項20に記載の光電変換装置。
- 請求項1乃至請求項21のいずれか1項に記載の光電変換装置を複数有する光電変換システムであって、
前記光電変換装置によって検出される光を発光する発光部と、
前記光電変換装置に保持されたデジタル信号を用いて距離の算出を行う算出手段と、を有することを特徴とする光電変換システム。 - 移動体であって、
請求項1乃至請求項21のいずれか1項に記載の光電変換装置と、
前記光電変換装置からの信号に基づく視差画像から、対象物までの距離情報を取得する距離情報取得手段と、
前記距離情報に基づいて前記移動体を制御する制御手段と、を有することを特徴とする移動体。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020247029262A KR20240146025A (ko) | 2022-02-08 | 2023-01-26 | 광전 변환 장치 |
CN202380020260.2A CN118648299A (zh) | 2022-02-08 | 2023-01-26 | 光电转换装置 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022-018105 | 2022-02-08 | ||
JP2022018105A JP2023115727A (ja) | 2022-02-08 | 2022-02-08 | 光電変換装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023153218A1 true WO2023153218A1 (ja) | 2023-08-17 |
Family
ID=87564108
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2023/002358 WO2023153218A1 (ja) | 2022-02-08 | 2023-01-26 | 光電変換装置 |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP2023115727A (ja) |
KR (1) | KR20240146025A (ja) |
CN (1) | CN118648299A (ja) |
WO (1) | WO2023153218A1 (ja) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014059302A (ja) | 2012-09-18 | 2014-04-03 | Sick Ag | 光電センサおよび物体検出方法 |
JP2020120175A (ja) * | 2019-01-21 | 2020-08-06 | キヤノン株式会社 | 撮像装置およびその制御方法 |
JP2020127122A (ja) * | 2019-02-04 | 2020-08-20 | キヤノン株式会社 | 撮像装置 |
JP2021022875A (ja) * | 2019-07-29 | 2021-02-18 | キヤノン株式会社 | 光電変換装置、光電変換システム、および移動体 |
JP2022018105A (ja) | 2020-07-14 | 2022-01-26 | 東レ株式会社 | 積層シート、電磁波抑制体、電機製品、通信機器、及び交通機関 |
-
2022
- 2022-02-08 JP JP2022018105A patent/JP2023115727A/ja active Pending
-
2023
- 2023-01-26 CN CN202380020260.2A patent/CN118648299A/zh active Pending
- 2023-01-26 WO PCT/JP2023/002358 patent/WO2023153218A1/ja active Application Filing
- 2023-01-26 KR KR1020247029262A patent/KR20240146025A/ko unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014059302A (ja) | 2012-09-18 | 2014-04-03 | Sick Ag | 光電センサおよび物体検出方法 |
JP2020120175A (ja) * | 2019-01-21 | 2020-08-06 | キヤノン株式会社 | 撮像装置およびその制御方法 |
JP2020127122A (ja) * | 2019-02-04 | 2020-08-20 | キヤノン株式会社 | 撮像装置 |
JP2021022875A (ja) * | 2019-07-29 | 2021-02-18 | キヤノン株式会社 | 光電変換装置、光電変換システム、および移動体 |
JP2022018105A (ja) | 2020-07-14 | 2022-01-26 | 東レ株式会社 | 積層シート、電磁波抑制体、電機製品、通信機器、及び交通機関 |
Also Published As
Publication number | Publication date |
---|---|
CN118648299A (zh) | 2024-09-13 |
KR20240146025A (ko) | 2024-10-07 |
JP2023115727A (ja) | 2023-08-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP2022146231A (ja) | 光電変換装置、光電変換システム、および移動体 | |
US20240267651A1 (en) | Photoelectric conversion device, photoelectric conversion system, and moving body | |
US20220236420A1 (en) | Photoelectric conversion device, photodetection system, and movable object | |
JP2022106649A (ja) | 光電変換装置、光検出システム | |
JP2022170442A (ja) | 光電変換装置及び光検出システム | |
US20230217137A1 (en) | Photoelectric conversion device and photodetection system | |
US20230117198A1 (en) | Photoelectric conversion apparatus having avalanche photodiode | |
US20230120430A1 (en) | Photoelectric conversion apparatus | |
US11855106B2 (en) | Signal processing device having counter counting pulses from avalanche photodiode | |
WO2023153218A1 (ja) | 光電変換装置 | |
JP2023178687A (ja) | 光電変換装置、光電変換システム | |
KR20230128061A (ko) | 광전변환장치, 광 검출 시스템, 및 이동체 | |
JP2022112735A (ja) | 光電変換装置及び光検出システム | |
US20240347573A1 (en) | Apparatus | |
JP7377334B2 (ja) | 光電変換装置及び光電変換システム | |
WO2023131997A1 (ja) | 光電変換装置、光電変換システム、および移動体 | |
WO2023131996A1 (ja) | 光電変換装置及び光検出システム | |
US11937006B2 (en) | Photoelectric conversion apparatus and photoelectric conversion system | |
US20240357259A1 (en) | Photoelectric conversion device and optical detection system | |
US20230215899A1 (en) | Photoelectric conversion apparatus and photoelectric conversion system | |
US20240255620A1 (en) | Semiconductor device having time-to-digital converter | |
JP2023061883A (ja) | 光電変換装置 | |
JP2023159648A (ja) | 光電変換装置および光電変換システム | |
JP2023066913A (ja) | 光電変換素子及び光電変換装置 | |
JP2023077759A (ja) | 光電変換素子及び光電変換装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23752683 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20247029262 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023752683 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2023752683 Country of ref document: EP Effective date: 20240909 |