WO2022230520A1 - 投光ユニットおよびそれを用いた測距装置 - Google Patents
投光ユニットおよびそれを用いた測距装置 Download PDFInfo
- Publication number
- WO2022230520A1 WO2022230520A1 PCT/JP2022/014805 JP2022014805W WO2022230520A1 WO 2022230520 A1 WO2022230520 A1 WO 2022230520A1 JP 2022014805 W JP2022014805 W JP 2022014805W WO 2022230520 A1 WO2022230520 A1 WO 2022230520A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- light source
- pixel
- time
- source array
- Prior art date
Links
- 238000005259 measurement Methods 0.000 title claims abstract description 92
- 230000003287 optical effect Effects 0.000 claims description 30
- 238000012545 processing Methods 0.000 claims description 26
- 230000035945 sensitivity Effects 0.000 claims description 17
- 238000000034 method Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 4
- 230000010355 oscillation Effects 0.000 description 52
- 238000010586 diagram Methods 0.000 description 34
- 230000001360 synchronised effect Effects 0.000 description 30
- 239000000872 buffer Substances 0.000 description 27
- 239000000758 substrate Substances 0.000 description 24
- 230000004907 flux Effects 0.000 description 12
- 238000012937 correction Methods 0.000 description 8
- 238000009826 distribution Methods 0.000 description 8
- 239000004065 semiconductor Substances 0.000 description 8
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 6
- 230000003595 spectral effect Effects 0.000 description 6
- 240000001973 Ficus microcarpa Species 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 230000007423 decrease Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 230000001629 suppression Effects 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 3
- 239000010408 film Substances 0.000 description 3
- 230000000630 rising effect Effects 0.000 description 3
- 238000002834 transmittance Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 229910001218 Gallium arsenide Inorganic materials 0.000 description 2
- 239000000969 carrier Substances 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005684 electric field Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 239000010409 thin film Substances 0.000 description 2
- 229910000980 Aluminium gallium arsenide Inorganic materials 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 239000012212 insulator Substances 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- WFKWXMTUELFFGS-UHFFFAOYSA-N tungsten Chemical compound [W] WFKWXMTUELFFGS-UHFFFAOYSA-N 0.000 description 1
- 229910052721 tungsten Inorganic materials 0.000 description 1
- 239000010937 tungsten Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
- G01C3/06—Use of electric means to obtain final indication
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
- G01C3/06—Use of electric means to obtain final indication
- G01C3/08—Use of electric radiation detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/484—Transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4861—Circuits for detection, sampling, integration or read-out
- G01S7/4863—Detector arrays, e.g. charge-transfer gates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/023—Mountings, adjusting means, or light-tight connections, for optical elements for lenses permitting adjustment
Definitions
- the present invention relates to a projection unit and a rangefinder using the same.
- a ToF (Time-of-Flight) distance measurement method in which the distance to an object that reflects light is measured by measuring the time difference from when the light is emitted until the reflected light is detected. Also, in order to accurately measure the object distance, attempts have been made to increase the density of the region irradiated with light.
- Patent Document 1 a luminous flux emitted from each light emitting element constituting a light emitting element array is separated into a plurality of luminous fluxes using a diffractive optical element.
- a light projecting unit for emitting a light flux is disclosed.
- Patent Document 1 it is possible to increase the density of the luminous flux, but since it is configured such that one luminous flux is split into a plurality of light fluxes by an optical element, the energy per split luminous flux decreases. Therefore, the maximum measurable distance is shortened. In addition, since the intensity of the reflected light is reduced compared to the case where the beam is not separated, there is a possibility that the distance measurement accuracy will be reduced.
- One aspect of the present invention provides a light projecting unit of a distance measuring device capable of increasing the density of the light flux without separating the light flux.
- a light projecting unit is a light projecting unit used in a distance measuring device that calculates the distance to an object that reflects light by measuring the time difference from the time the light is emitted until the reflected light is detected.
- the projection unit includes a light source array in which a plurality of light emitting elements are arranged two-dimensionally, a projection lens for adjusting the projection range of light emitted from the light source array, and a relative position between the light source array and the projection lens. and a light source control means for lighting the light source array in different positions.
- a light projecting unit of a distance measuring device capable of increasing the density of the luminous flux without separating the luminous flux.
- FIG. 1 is a block diagram showing a functional configuration example of a distance measuring device 100 using a light receiving device according to an embodiment
- FIG. FIG. 4 is a diagram showing a configuration example of the light source unit 111
- FIG. 4 is a diagram showing a configuration example of the light source unit 111
- FIG. 4 is a diagram showing a configuration example of the light source unit 111
- FIG. 4 shows an example of a light projection pattern of the light source unit 111
- FIG. 4 shows an example of a light projection pattern of the light source unit 111
- a diagram related to a configuration example of the light receiving unit 121 A diagram related to a configuration example of the light receiving unit 121 FIG.
- FIG. 5 is a diagram showing an example of spectral characteristics of an optical bandpass filter provided in a pixel 511;
- FIG. 5 is a diagram showing an example of spectral characteristics of an optical bandpass filter provided in a pixel 511;
- Vertical cross-sectional view showing a configuration example of the light receiving element of the pixel 511
- a diagram showing an example of potential distribution in the cross section of FIG. A diagram showing an example of potential distribution in the cross section of FIG.
- Circuit diagram showing a configuration example of the pixel 511 Block diagram showing a configuration example of the TDC array unit 122
- Circuit diagram showing a configuration example of the high-resolution TDC1501 Diagram of the operation of the high-resolution TDC1501 Timing chart for ranging operation Timing chart in which a part of FIG. 13 is enlarged
- Block diagram showing a functional configuration example of the first oscillation adjustment circuit 1541 and the second oscillation adjustment circuit 1542 4 is a flow chart relating to an example of ranging operation according to the embodiment;
- a diagram showing an example of a histogram of distance measurement results A diagram showing an example of a histogram of distance measurement results
- a diagram showing an example of a histogram of distance measurement results A diagram showing an example of a histogram of distance measurement results
- a diagram showing an example of a histogram of distance measurement results A diagram showing an example of a histogram of distance measurement results
- a diagram showing an example of a histogram of distance measurement results is showing an example of a histogram of distance measurement results
- the fact that the characteristics of the light-receiving elements are the same means that the physical configuration and bias voltage of the light-receiving elements are not intentionally different. Therefore, there may be differences in characteristics due to unavoidable factors such as manufacturing variations.
- FIG. 1 is a block diagram showing a functional configuration example of a distance measuring device using a light receiving device according to the present invention.
- the distance measuring device 100 has a projecting unit 110 , a measuring unit 120 , a light receiving lens 132 and an overall control section 140 .
- the light projecting unit 110 includes a light source unit 111 in which light emitting elements are arranged in a two-dimensional array, a light source unit driving section 112 , a light source control section 113 , and a light projecting lens 131 .
- the measurement unit 120 has a light receiving section 121 , a TDC (Time-to-Digital Converter) array section 122 , a signal processing section 123 and a measurement control section 124 .
- the combination of the light receiving lens 132 and the light receiving section 121 may be referred to as a light receiving unit 133 .
- the general control unit 140 controls the operation of the entire distance measuring device 100 .
- the overall control unit 140 has, for example, a CPU, a ROM, and a RAM, and controls each unit of the distance measuring device 100 by loading a program stored in the ROM into the RAM and executing it with the CPU. At least part of the overall control unit 140 may be realized by a dedicated hardware circuit.
- pulsed light (pulsed light) is emitted through the projection lens 131 .
- Pulsed lights emitted from individual light emitting elements irradiate different spaces.
- a part of the pulsed light emitted from the light source unit 111 is reflected by the subject and enters the light receiving section 121 via the light receiving lens 132 .
- the light emitting element 211 that emits light is configured to optically correspond to a specific pixel among the plurality of pixels arranged in the light receiving section 121 .
- a pixel optically corresponding to a certain light emitting element 211 is a pixel having a positional relationship such that reflected light emitted from the light emitting element 211 is detected most often.
- the time from the light emission of the light source unit 111 until the reflected light enters the light receiving section 121 is measured by the TDC array section 122 as the time of flight ToF. Note that the flight time ToF is measured a plurality of times in order to reduce the influence of noise components such as ambient light and dark counts and noise of the TDC array unit 122 on the measurement results.
- FIG. 2A is a side view showing a configuration example of the collimator lens array 220 forming the light source unit 111
- FIG. 2B is a side view showing a configuration example of the light source array 210 forming the light source unit 111.
- FIG. 2A is a side view showing a configuration example of the collimator lens array 220 forming the light source unit 111
- FIG. 2B is a side view showing a configuration example of the light source array 210 forming the light source unit 111.
- the light source array 210 has a configuration in which light emitting elements 211, which are, for example, vertical cavity surface emitting laser elements (VCSEL), are arranged in a two-dimensional array.
- a light source controller 113 controls turning on and off of the light source array 210 .
- the light source control unit 113 can control lighting and extinguishing of the light source array 210 in units of the light emitting elements 211 .
- the light emitting element 211 may be an element other than the VCSEL, such as an edge emitting laser element or an LED (light emitting diode).
- an edge-emitting laser element is used as the light emitting element 211
- a laser bar in which elements are arranged one-dimensionally on a substrate, or a laser bar stack in which laser bars are stacked to form a two-dimensional array can be used as the light source array 210.
- LEDs are used as the light emitting elements 211
- a light source array 210 in which LEDs are arranged in a two-dimensional array on a substrate can be used.
- a VCSEL can be produced by a semiconductor process using materials used for edge-emitting lasers and surface-emitting lasers.
- a GaAs-based semiconductor material can be used for a configuration that emits laser light having a wavelength in the near-infrared band.
- the dielectric multilayer film that forms the DBR (distributed reflection type) reflector that constitutes the VCSEL is a structure in which two thin films made of materials with different refractive indices are alternately and periodically stacked (GaAs/AlGaAs). can do.
- the wavelength of light emitted by a VCSEL can be changed by adjusting the combination of elements in the compound semiconductor and the composition.
- the VCSELs that make up the VCSEL array are provided with electrodes for injecting current and holes into the active layer.
- Arbitrary pulsed light or modulated light can be emitted by controlling the timing of injection of current and holes into the active layer.
- the light source controller 113 can drive the light emitting elements 211 individually, or drive the light source array 210 in units of rows, columns, or rectangular areas.
- the collimator lens array 220 has a configuration in which a plurality of collimator lenses 221 are arranged in a two-dimensional array such that each collimator lens 221 corresponds to one light emitting element 211 . Light rays emitted by the light emitting elements 211 are converted into parallel rays by the corresponding collimator lenses 221 .
- FIG. 2C is a vertical sectional view showing an arrangement example of the light source unit driving section 112, the light source unit 111, and the projection lens 131.
- the projection lens 131 is an optical system for adjusting the projection range of parallel light emitted from the light source unit 111 (light source array 210).
- the projection lens 131 is a concave lens in FIG. 2C, it may be a convex lens, an aspherical lens, or an optical system composed of a plurality of lenses.
- the projection lens 131 is configured so that light is emitted within a range of ⁇ 45 degrees from the projection unit 110 .
- the projection lens 131 may be omitted by controlling the light emission direction with the collimator lens 221 .
- FIG. 3A shows a light projection pattern formed by the light emitting elements of 3 rows and 3 columns in the light source array 210 on a plane facing the light emitting surface of the light projecting unit 110 at a predetermined distance.
- Nine light projection areas 311 represent areas of the intensity distribution of light from individual light-emitting elements on the plane 310 whose diameter is about the full width at half maximum (FWHM).
- the emitted light from the light emitting element 211 converted into parallel light by the collimator lens 221 is given a slight divergence angle by the projection lens 131, so that it forms a finite area on the irradiation surface (plane 310).
- a light projection area 311 equal in number to the light emitting elements 211 forming the light source array 210 is formed on the plane 310 .
- the light projection unit 110 of this embodiment has a light source unit driving section 112 capable of moving the light source unit 111 within the same plane. By moving the position of the light source unit 111 by the light source unit driving section 112, the relative positional relationship between the light emitting element 211 and the collimator lens 221 or the projection lens 131 can be changed.
- the method for driving the light source unit 111 by the light source unit driving section 112 is not particularly limited. mechanism can be used.
- the light source unit driving section 112 moves the light source unit 111, for example, in a plane parallel to the substrate of the light source unit 111 (perpendicular to the optical axis of the projection lens 131), the projection area 311 on the plane 310 is moved substantially parallel. It is possible. For example, by lighting the light source unit 111 a plurality of times while moving the light source unit 111 in a plane parallel to the substrate of the light source unit 111, the spatial resolution of the light projection area can be increased in a pseudo manner.
- the light source unit 111 having the same light source array 210 as in FIG. 3A is rotated once in a plane parallel to the substrate of the light source unit 111, and the light source unit 111 is turned on four times at a constant cycle.
- the spatial resolution of the projected area 411 at 410 is shown in FIG. 3B. Four times the spatial resolution is obtained compared to the case where the light source unit 111 is not moved, as shown in FIG. 3A.
- the density of distance measurement points can be increased. Since the spatial resolution of the light projection area 411 can be increased without separating the light flux, the measurable distance is not shortened, and the distance accuracy is not lowered due to the decrease in the intensity of the reflected light.
- the relative position between the light source unit 111 and the light projection lens 131 may be changed by moving the light projection lens 131 in a plane parallel to the substrate of the light source unit 111 .
- the entire projection lens 131 may be moved, or only a part of the lenses may be moved.
- the light source unit 111 may be configured to be movable in the direction perpendicular to the substrate of the light source array 210 (the optical axis direction of the projection lens 131) by the light source unit driving section 112. This makes it possible to control the divergence angle of light and the projection angle.
- the light source control unit 113 controls light emission of the light source unit 111 (light source array 210) according to the light receiving timing and light receiving resolution of the light receiving unit 133.
- FIG. 4 is an exploded perspective view schematically showing a mounting example of the measuring unit 120. As shown in FIG. FIG. 4 shows the light receiving section 121, the TDC array section 122, the signal processing section 123, and the measurement control section . The light receiving section 121 and the TDC array section 122 constitute a light receiving device.
- the measurement unit 120 has a structure in which a light receiving element substrate 510 including a light receiving portion 121 in which pixels 511 are arranged in a two-dimensional array, and a logic substrate 520 including a TDC array portion 122, a signal processing portion 123, and a measurement control portion 124 are stacked.
- the light receiving element substrate 510 and the logic substrate 520 are electrically connected through an inter-substrate connection 530 .
- FIG. 4 shows the light receiving element substrate 510 and the logic substrate 520 separated from each other.
- the inter-substrate connection 530 is configured by, for example, a Cu-Cu connection, and one or more may be arranged for each column of the pixels 511 , or one may be arranged for each pixel 511 .
- the light receiving section 121 has a pixel array in which pixels 511 are arranged in a two-dimensional array.
- the light receiving element of the pixel 511 is an avalanche photodiode (APD) or SPAD element.
- pixels H (first pixels) having a first sensitivity and pixels L (second pixels) having a second sensitivity lower than the first sensitivity are arranged in the row direction. and are alternately arranged in the column direction.
- the pixel H and the pixel L so as to be adjacent to each other, offset correction of the pixel H based on the measurement result of the pixel L can be performed.
- the pixel H may be called a high-sensitivity pixel H
- the pixel L may be called a low-sensitivity pixel L.
- FIG. 5B is a vertical cross-sectional view showing a structural example of the pixel H and the pixel L.
- the refractive index of the high refractive index layer 901 be nH
- the refractive index of the low refractive index layer 902 be nL ( ⁇ nH).
- a low refractive index layer 902 having a film thickness dE1 (to dE4) m1 (to m4) ⁇ 0.5 ⁇ c/nL (m1 to m4 are natural numbers) is sandwiched between high refractive index layers 901 from both sides.
- the pixel L has a configuration in which a second optical bandpass filter is provided on a light reducing layer 903 made of a tungsten thin film with a thickness of 30 nm and having a transmittance of about 45%.
- the second optical bandpass filter has a structure in which optical resonators 911 to 914 are stacked with a low refractive index layer 902 having a thickness of dL interposed therebetween.
- the second optical bandpass filter has spectral characteristics shown in FIG. 6A and is an example of an optical element added to the light receiving element.
- the pixel H has a transmittance layer 904 with a transmittance of about 100% made up of a low refractive index layer with a thickness of 30 nm, a multilayer interference mirror 915, and a low refractive index layer with a thickness of dE4. It has a configuration in which an adjustment layer 905 and a first optical bandpass filter are provided.
- the first optical bandpass filter is an example of an optical element added to the light receiving element, and has spectral characteristics shown in FIG. 6B.
- the first optical bandpass filter has a structure in which optical resonators 911 to 913 are stacked with a low refractive index layer 902 having a thickness of dL sandwiched therebetween.
- the central wavelength can be the peak wavelength of the light emitted by the light source unit 111 .
- the half width WL of the spectral characteristics of the second optical bandpass filter is narrower than the half width WH of the spectral characteristics of the first optical bandpass filter.
- the half-value width WL is narrower than the half-value width WH is that it is assumed that the low-sensitivity pixels L mainly perform long-distance ranging, and the high-sensitivity pixels H mainly perform short-distance ranging. be.
- the half width WL is narrowed so as to cope with a long ToF, thereby suppressing noise light from being measured before the reflected light reaches it.
- the pixel L is configured to have lower sensitivity than the pixel H by providing the light reducing layer 903 .
- the dimming layer 903 is an example of an optical element for reducing the sensitivity of pixels. Note that instead of the light reducing layer 903, other optical elements such as masks having different aperture sizes may be used to make the pixels H and L have different sensitivities.
- the light receiving area of the light receiving element of the pixel L can be made narrower than the light receiving area of the light receiving element of the pixel H.
- the pixel H does not have to be provided with a mask.
- the pixel L may be provided with a mask having an aperture ratio of less than 100%.
- the mask can be made of any material that can form a light shielding film.
- the sensitivity of the pixels is varied by using an optical element added to the light receiving element, instead of varying the configuration of the light receiving element itself and the applied voltage. Therefore, the configuration of the light-receiving element and the applied voltage can be common to the pixel H and the pixel L. FIG. Therefore, the light receiving element array can be easily manufactured, and variations in the characteristics of the light receiving elements can be suppressed.
- FIG. 7 is a cross-sectional view including a semiconductor layer of a light-receiving element common to pixels H and L.
- FIG. 1005 is the semiconductor layer of the light receiving element substrate 510
- 1006 is the wiring layer of the light receiving element substrate 510
- 1007 is the wiring layer of the logic substrate 520 .
- the wiring layers of the light receiving element substrate 510 and the logic substrate 520 are joined so as to face each other.
- a semiconductor layer 1005 of the light-receiving element substrate 510 includes a light-receiving region (photoelectric conversion region) 1001 and an avalanche region 1002 that generates an avalanche current by signal charges generated by photoelectric conversion.
- a light shielding wall 1003 is provided between adjacent pixels in order to prevent light that is obliquely incident on the light receiving region 1001 from reaching the light receiving regions 1001 of adjacent pixels.
- the light shielding wall 1003 is made of metal, and an insulator region 1004 is provided between the light shielding wall 1003 and the light receiving region 1001 .
- FIG. 8A is a diagram showing the potential distribution of the semiconductor region in the aa' section of FIG.
- FIG. 8B is a diagram showing the potential distribution of the b-b' section of FIG.
- FIG. 8C is a diagram showing the potential distribution of the c-c'' section of FIG.
- a signal charge reaching the avalanche region 1002 causes an avalanche breakdown due to the strong electric field of the avalanche region 1002, generating an avalanche current. This phenomenon occurs not only with signal light (reflected light emitted by the light source unit 111) but also with ambient light, which is noise light, and becomes a noise component. Carriers are generated not only by incident light but also thermally. An avalanche current due to thermally generated carriers is called a dark count and becomes a noise component.
- FIG. 9 is an equivalent circuit diagram of the pixel 511.
- FIG. Pixel 511 has SPAD element 1401 , load transistor 1402 , inverter 1403 , pixel selection switch 1404 and pixel output line 1405 .
- the SPAD element 1401 corresponds to the combined area of the light receiving area 1001 and the avalanche area 1002 in FIG.
- the output signal of the inverter 1403 is output to the pixel output line 1405 as a pixel output signal.
- the voltage of the anode electrode Vbd is set so that a reverse bias higher than the breakdown voltage is applied to the SPAD element 1401 when no avalanche current is flowing. At this time, no current flows through the load transistor 1402, so the cathode potential Vc is close to the power supply voltage Vdd, and the pixel output signal is "0".
- FIG. 10 is a diagram schematically showing a configuration example of the TDC array section 122.
- a high-resolution TDC 1501 having a first measurement resolution and a low-resolution TDC 1502 having a second measurement resolution are provided, each half the number of pixels constituting one pixel row of the pixel array. , and the ToF is measured pixel by pixel.
- the second measurement resolution is lower than the first measurement resolution.
- a synchronous clock is supplied from the overall control unit 140, for example.
- the output signal of the high-sensitivity pixel H is input to the high-resolution TDC 1501
- the output signal of the low-sensitivity pixel L is input to the low-resolution TDC 1502, driven by the relay buffer. That is, for the high-sensitivity pixels H, time is measured with a higher measurement resolution than for the low-sensitivity pixels L.
- the odd-numbered pixel output is the pixel H output
- the even-numbered pixel output is the pixel L output.
- High-resolution TDCs 1501 and low-resolution TDCs 1502 are alternately arranged in order to make the delay time in the relay buffer substantially equal.
- the high resolution TDC 1501 has a first oscillator 1511 , a first oscillation count circuit 1521 and a first synchronous clock count circuit 1531 .
- the low resolution TDC 1502 has a second oscillator 1512 , a second oscillation counting circuit 1522 and a second synchronous clock counting circuit 1532 .
- the first oscillation count circuit 1521 and the second oscillation count circuit 1522 are second counters that count changes in the output value of the corresponding oscillator.
- the first synchronous clock count circuit 1531 and the second synchronous clock count circuit 1532 are first counters that count synchronous clocks.
- the count result of the synchronous clock count circuit constitutes the upper bits
- the internal signal of the oscillator constitutes the lower bits
- the count result of the oscillation count circuit constitutes the middle bits. That is, the synchronous clock count circuit performs rough measurement, the internal signal of the oscillator is finely measured, and the oscillation count circuit measures the interval between them. Note that each measurement bit may have a redundant bit.
- FIG. 11 is a diagram schematically showing a configuration example of the first oscillator 1511 of the high-resolution TDC 1501.
- the first oscillator 1511 has an oscillation start/stop signal generation circuit 1640, buffers 1611 to 1617, an inverter 1618, an oscillation switch 1630, and a delay adjustment current source 1620. Buffers 1611 to 1617 and inverter 1618 as delay elements are connected alternately with oscillation switch 1630 in series and in a ring shape. Delay adjustment current source 1620 is provided for each of buffers 1611-1617 and inverter 1618, and adjusts the delay time of the corresponding buffer or inverter according to the adjustment voltage.
- FIG. 12 shows changes in the output signals of the buffers 1611 to 1617 and the inverter 1618 and the internal signal of the oscillator at each delay time tbuff corresponding to one buffer stage after reset and after the oscillation switch 1630 is turned on.
- WI11-WI18 outputs are the output signals of buffers 1611-1617 and inverter 1618, respectively.
- the outputs of buffers 1611-1617 are "0" and the output of inverter 1618 is "1".
- the delay time tbuff corresponding to one buffer stage has elapsed since the oscillation switch 1630 was turned on, the outputs of the buffers 1612 to 1617 and the inverter 1618 whose input and output are matched do not change.
- the output of the buffer 1611 whose input/output is not matched changes from "0" to "1" (the signal advances by one stage).
- the output similarly changes with a period of 16 ⁇ t buuf .
- the time resolution of high-resolution TDC 1501 is equal to t buff .
- the time resolution t buff is adjusted to be 2 ⁇ 7 (1/128) of the period of the synchronous clock by the first oscillation adjustment circuit 1541 which will be described later.
- the oscillator output which is the output of the inverter 1618 , is input to the first oscillation counting circuit 1521 .
- the first oscillation count circuit 1521 counts the rising edges of the oscillator output to measure time with a time resolution of 16 ⁇ t buff .
- FIG. 13 is a timing chart from light emission to detection of reflected light by the SPAD element 1401 until the time measurement is completed. It shows changes in the cathode potential Vc of the SPAD element 1401, the pixel output signal, the synchronous clock, the count value of the synchronous clock count circuit, the output of the oscillator start/stop signal generation circuit, the oscillator output, and the count value of the oscillation count circuit.
- the cathode potential Vc of the SPAD element 1401 is an analog voltage, and the upper side of the drawing indicates a higher voltage.
- the synchronous clock, the output of the oscillator start/stop signal generation circuit, and the output of the oscillator are digital signals, and the upper side of the page indicates the ON state, and the lower side of the page indicates the OFF state.
- the count values of the synchronous clock count circuit and the oscillator count circuit are digital values expressed in decimal.
- FIG. 14 is an enlarged view of the oscillator start/stop signal generation circuit output, oscillator output, count value of the oscillator count circuit, and oscillator internal signal from time 1803 to time 1805 in FIG.
- the oscillator internal signals are digital values and are shown in decimal.
- the high-resolution TDC 1501 measures the time from the light emission time 1801 of the light source unit 111 to the time 1803 when a photon is incident on the SPAD element 1401 of the pixel and the pixel output signal changes from 0 to 1. operation is explained.
- the light source controller 113 drives the light source unit 111 so that the light emitting element 211 emits light at time 1801 synchronized with the rise of the synchronization clock supplied via the overall controller 140 .
- the first synchronous clock count circuit 1531 starts counting the rising edges of the synchronous clock when the overall control unit 140 instructs the start of measurement at the time 1801 when the light emitting element 211 emits light.
- the oscillation switch 1630 When the oscillation switch 1630 is turned on, an oscillation operation is started, and a signal loop is started inside the oscillator as shown in FIG. Every time 16 ⁇ t buff has passed since the oscillation switch 1630 was turned on and the signal makes two rounds in the oscillator, a rising edge appears in the oscillator output, and the first oscillation counting circuit 1521 counts the number. At time 1803, the first synchronous clock count circuit 1531 stops counting and holds the count value.
- time 1805 is the timing when the synchronous clock first rises.
- the output of oscillation start/stop signal generation circuit 1640 becomes "0" and oscillation switch 1630 is turned off.
- the oscillation switch 1630 becomes "0"
- the oscillation of the first oscillator 1511 ends, and the oscillation circuit internal signal is held as it is. Also, since the oscillation ends, the counting of the first oscillation counting circuit 1521 also stops.
- the count result D Gclk of the synchronous clock count circuit is a value obtained by measuring the time from time 1801 to time 1802 in units of 2 7 ⁇ t buff .
- the count result D ROclk of the oscillator count circuit is a value obtained by measuring the time from time 1803 to time 1804 in units of 2 4 ⁇ t buff .
- the oscillator internal signal D ROin has a value obtained by measuring the time from time 1804 to time 1805 in units of tbuff .
- the high-resolution TDC 1501 completes one measurement operation by performing the following processing on these values and outputting them to the signal processing unit 123 .
- FIG. 15 is a diagram schematically showing a circuit configuration example of the second oscillator 1512 included in the low-resolution TDC 1502.
- the buffers 2011 to 2013 and the inverter 2014 are connected alternately with the oscillation switch 2030 in series and in a ring shape.
- a delay adjusting current source 2020 is provided for each of buffers 2011 to 2013 and inverter 2014, and adjusts the delay time of the corresponding buffer or inverter according to the adjustment voltage.
- each of buffers 2011 to 2013 and inverter 2014 is adjusted by second oscillation adjustment circuit 1542 so that delay time t buff is twice t buff of high-resolution TDC 1501 .
- the count period of the second oscillation count circuit 1522 becomes equal to the count period of the first oscillation count circuit 1521 . Therefore, the number of output bits of second oscillation counting circuit 1522 is equal to the number of output bits of first oscillation counting circuit 1521 .
- the number of bits of the oscillator internal signal can be one bit less for the second oscillator 1512 than for the first oscillator 1511 .
- the low-sensitivity pixels L are mainly assumed to be used for long-distance ranging.
- the influence of the ToF measurement resolution on the accuracy of the distance measurement results is greater for short distances than for long distances. Therefore, in the low-resolution TDC 1502 that measures the ToF of the low-sensitivity pixel L, priority is given to reducing circuit scale and power consumption, and the ToF measurement resolution is set lower than that of the high-resolution TDC 1501 .
- the delay time t buff varies due to factors resulting from the manufacturing process such as transistor manufacturing errors, variations in the voltage applied to the TDC circuit, and temperature. Therefore, a first oscillation adjustment circuit 1541 and a second oscillation adjustment circuit 1542 are provided for every eight TDCs.
- FIG. 16 is a block diagram showing a functional configuration example of the first oscillation adjustment circuit 1541 and the second oscillation adjustment circuit 1542. As shown in FIG. Since the first oscillation adjustment circuit 1541 and the second oscillation adjustment circuit 1542 have the same configuration, the first oscillation adjustment circuit 1541 will be described below.
- the first oscillation adjustment circuit 1541 has a dummy oscillator 2101 , a 1/2 3 (1/8) frequency divider 2102 and a phase comparator 2103 .
- the dummy oscillator 2101 is an oscillator having the same configuration as that of the connected TDC. Therefore, dummy oscillator 2101 of first oscillation adjustment circuit 1541 has the same configuration as first oscillator 1511 . Dummy oscillator 2101 of second oscillation adjustment circuit 1542 has the same configuration as second oscillator 1512 .
- the output of dummy oscillator 2101 is input to 1/23 frequency divider 2102 .
- a 1/2 3 frequency divider 2102 outputs a clock signal whose frequency is 1/2 3 of the input clock signal.
- a synchronous clock and the output of the 1/23 frequency divider 2102 are input to the phase comparator 2103 .
- the phase comparator 2103 compares the frequency of the synchronous clock with the frequency of the clock signal output from the 1/23 frequency divider 2102 .
- Phase comparator 2103 increases the output voltage when the frequency of the synchronous clock signal is higher, and decreases the output voltage when the frequency of the synchronous clock signal is lower.
- the output of the phase comparator 2103 is input as an adjustment voltage to the delay adjustment current source 1620 of the first oscillator 1511, and the delay is adjusted so that the oscillation frequency of the first oscillator 1511 is 23 times the synchronization clock.
- the oscillation frequency of the oscillator is determined based on the synchronous clock frequency. Therefore, by generating a synchronous clock signal using an external IC capable of outputting a constant frequency regardless of changes in process, voltage, or temperature, fluctuations in the oscillation frequency of the oscillator due to changes in process, voltage, or temperature are suppressed. be able to.
- the oscillation frequency becomes 1.28 GHz, eight times the synchronous clock frequency, in both the high-resolution TDC 1501 and the low-resolution TDC 1502 .
- the delay time t buff for one stage of the buffer which is the time resolution of the TDC, is 48.8 ps for the high-resolution TDC 1501 and 97.7 ps for the low-resolution TDC 1502 .
- FIG. 17 is a flow chart relating to an example of the ranging operation in this embodiment.
- the overall control unit 140 resets the histogram circuit and measurement counter i of the signal processing unit 123.
- the overall control unit 140 changes the connection of the relay buffer (not shown) so that the output of the pixel 511 optically corresponding to the light emitting element 211 that emits light in S2202 is input to the TDC array unit 122 .
- the overall control unit 140 causes some of the light emitting elements 211 that make up the light source array 210 of the light source unit 111 to emit light.
- the general control section 140 instructs the TDC array section 122 to start measurement.
- the signal processing unit 123 adds the measurement result obtained in S2203 to the histogram for each pixel.
- the signal processing unit 123 does not add measurement results to the histogram for pixels for which measurement results have not been obtained.
- the signal processing unit 123 adds 1 to the value of the measurement number counter i.
- the signal processing unit 123 determines whether or not the value of the measurement number counter i is greater than the preset number of times N total .
- the signal processing unit 123 executes S2207 if it is determined that the value of the measurement number counter i is greater than the set number of times N total , and executes S2202 if it is not determined that the value of the measurement number counter i is greater than the set number of times N total .
- the signal processing unit 123 removes the counting result that seems to be noise components based on the histogram of each pixel, and executes S2208.
- the signal processing unit 123 averages the measurement results remaining without being removed in S2207 in the histogram of each pixel, outputs the average value as the measured ToF, and completes one ranging sequence.
- FIG. 18A is a diagram showing an example of a histogram of N total TDC measurement results in the high-sensitivity pixel H.
- the horizontal axis is the TDC measurement result (time), and the vertical axis is the frequency. Note that the bin width of the TDC measurement result is set for convenience.
- the measurement results included in section 2302 form a frequency peak, it is considered to be the correct measurement result of the time from light emission to light reception.
- the distribution of the measurement results included in section 2304 is irregular and sparse, so it is considered that they are noise light such as randomly generated ambient light or noise components due to dark counts. Therefore, the measurement results included in the section 2304 are removed, and the average 2303 of only the measurement results included in the section 2302 is used as the distance measurement result.
- FIG. 18B is a diagram showing an example of a histogram of the TDC measurement results of N total times in the high-sensitivity pixel H.
- the object is the same as in FIG. 18A, but an example of the histogram of the TDC measurement result obtained in a situation where there is more ambient light than at the time of measurement shown in FIG. 18A is shown.
- the noise light included in the section 2304 completes the TDC measurement N total times, and the TDC measurement result for the reflected light from the subject is not obtained.
- FIG. 18C is a diagram showing an example of a histogram of N total TDC measurement results obtained for the low-sensitivity pixel L under the same environment as in FIG. 18B. Since the sensitivity is lower than that of the high-sensitivity pixel H, the number of times TDC measurement is performed for noise light is reduced. As a result, the number of measurement results included in section 2302 increases, and the average value of the measurement results included in section 2302 can be calculated as the distance measurement result, as in FIG. 18A. In this way, the low-sensitivity pixels L are more tolerant than the high-sensitivity pixels H in situations where ambient light noise is large.
- the high-sensitivity pixel H and the low-sensitivity pixel L by using the high-sensitivity pixel H and the low-sensitivity pixel L, even when there is a large amount of noise light or when measuring the distance of a distant object, the effect of noise light is suppressed and a stable image is obtained. distance measurement is possible. Furthermore, the configuration of the light receiving element (SPAD) (light receiving area and thickness of the light receiving portion) and the voltage applied to the light receiving element are common to the high-sensitivity pixel H and the low-sensitivity pixel L. FIG. Therefore, there is little variation between the distance measurement results obtained by the high-sensitivity pixels H and the distance measurement results obtained by the low-sensitivity pixels L, and accurate distance measurement results can be obtained.
- SPAD light receiving area and thickness of the light receiving portion
- FIG. 18D shows an example of a histogram of measurement results of high-sensitivity pixels H
- FIG. 18E shows an example of a histogram of measurement results of low-sensitivity pixels L adjacent to high-sensitivity pixels H in FIG. 18D.
- the light emitting period of the light emitting element 211 corresponding to the high sensitivity pixel H is 2602, and the light emitting period of the light emitting element 211 corresponding to the low sensitivity pixel L is 2702.
- the light emission period 2702 is four times the light emission period 2602 . Therefore, the high-sensitivity pixel H can be measured four times more times than the low-sensitivity pixel L within the same period of time. There is a high probability that the number of distance measurement results to be averaged will be greater than the number of low-sensitivity pixels L, and since the high-resolution TDC 1501 performs measurement for the good-sensitivity pixels H, the spatial distance measurement corresponding to the high-sensitivity pixels H is performed. The precision is higher than the spatial distance measurement precision corresponding to the low-sensitivity pixel L.
- the light-emitting element 211 corresponding to the low-sensitivity pixel L having a large noise light suppression effect does not emit light until the reflected light is detected.
- the light-emitting element 211 corresponding to the high-sensitivity pixel H with less noise light suppression effect emits the next light before detecting the reflected light.
- the time from the start of measurement by TDC to the detection of the reflected light can be shortened, and the possibility of measuring the noise light between the time when the light is emitted and the arrival of the reflected light can be suppressed.
- High-sensitivity pixels H enable accurate time measurement even in a large environment.
- the signal processing unit 123 applies offset correction based on the measurement result obtained for the adjacent low-sensitivity pixel L to the measurement result obtained for the high-sensitivity pixel H.
- the offset correction is based on the measurement result 2611 of the high-sensitivity pixel H, based on the measurement result 2711 of the adjacent low-sensitivity pixel L. be.
- the time until the reflected light of the emitted light arrives in the high-sensitivity pixel H is also a value close to the measurement result 2711.
- the measurement result 2711 for the low-sensitivity pixel L is more than two times and less than three times the emission period 2602 for the high-sensitivity pixel H.
- the signal processing unit 123 adds twice the light emission period 2602 to the measurement result 2611 of the high-sensitivity pixel H in the offset correction.
- the offset correction amount may be determined based on measurement results obtained for two or more low-sensitivity pixels L adjacent to the high-sensitivity pixel H to be corrected.
- the offset correction amount may be determined based on measurement results obtained for four or two low-sensitivity pixels L adjacent in the horizontal direction and/or the vertical direction.
- an imaging unit that captures an image of the light projection range of the light projection unit 110 may be provided, and the captured image may be used to identify the low-sensitivity pixels L used to determine the offset correction amount.
- the signal processing unit 123 identifies one or more adjacent low-sensitivity pixels L that are considered to measure the same subject as the high-sensitivity pixel H to be corrected based on the captured image. Then, the signal processing unit 123 may determine the offset correction amount (or the coefficient by which the light emission cycle of the high-sensitivity pixel H is multiplied) using the measurement result obtained for the specified low-sensitivity pixel L.
- a light receiving device with a wide dynamic range can be realized by using light receiving elements with different sensitivities. Also, the sensitivity of the light receiving element is made different by the optical element added to the light receiving element. Therefore, light-receiving elements having the same configuration can be used, which is advantageous from the viewpoint of ease of manufacture and suppression of variations in characteristics. Further, by making the time measurement resolution lower for the low-sensitivity pixels than for the high-sensitivity pixels, it is possible to efficiently reduce the circuit size and power consumption while suppressing the deterioration of the distance measurement accuracy.
- the distance measuring device described above can be implemented in any electronic device having processing means for executing predetermined processing using distance information.
- electronic devices include imaging devices, computer devices (personal computers, tablet computers, media players, PDAs, etc.), mobile phones, smart phones, game machines, robots, drones, vehicles, and the like. These are examples, and the distance measuring device according to the present invention can also be implemented in other electronic devices.
- the present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.
- a circuit for example, ASIC
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Optics & Photonics (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Measurement Of Optical Distance (AREA)
Abstract
Description
図1は、本発明に係る受光装置を用いた測距装置の機能構成例を示すブロック図である。測距装置100は、投光ユニット110、計測ユニット120、受光レンズ132、全体制御部140を有する。投光ユニット110は、発光素子を2次元アレイ状に配置した光源ユニット111と、光源ユニット駆動部112と、光源制御部113と、投光レンズ131とを有する。計測ユニット120は、受光部121と、TDC(Time-to-Digital Convertor)アレイ部122と、信号処理部123と、計測制御部124とを有する。なお、本明細書では、受光レンズ132と受光部121との組み合わせを受光ユニット133と呼ぶことがある。
L[m] = ToF[sec]*c[m/sec]/2 ・・・(1)
なお、cは光の速度である。このようにして、信号処理部123は画素ごとに距離情報を算出する。
図2A~図2Cを用いて、投光ユニット110の構成例について説明する。図2Aは、光源ユニット111を構成するコリメータレンズアレイ220の構成例を、図2Bは、光源ユニット111を構成する光源アレイ210の構成例をそれぞれ示す側面図である。
次に、計測ユニット120の構成について説明する。図4は、計測ユニット120の実装例を模式的に示した分解斜視図である。図4では、受光部121、TDCアレイ部122、信号処理部123、計測制御部124について示している。受光部121およびTDCアレイ部122は受光装置を構成する。
アバランシェ電流が流れていないとき、SPAD素子1401には、ブレークダウン電圧以上の逆バイアスが印加されるように、アノード電極Vbdの電圧が設定されている。この時、負荷トランジスタ1402に流れる電流は無いため、カソード電位Vcは電源電圧Vddに近い電圧となっており、画素出力信号は「0」である。
その後、負荷トランジスタ1402を介して電源電圧Vddから正孔電流が流れることによりカソード電位Vcは上昇し、インバータ1403の出力(画素出力)が「1」から「0」へと戻り、光子の到来前の状態となる。このようにして画素511から出力された信号は、不図示の中継バッファを介して、TDCアレイ部122に入力される。
TDCアレイ部122は、光源ユニット111が発光した時刻から、画素511の出力信号が「0」から「1」に変化する時刻までの時間をToFとして計測する。
図10は、TDCアレイ部122の構成例を模式的に示す図である。TDCアレイ部122には、第1の計測分解能を有する高分解能TDC1501と、第2の計測分解能を有する低分解能TDC1502とが、それぞれ画素アレイの1画素行を構成する画素数の半数ずつ設けられており、1画素単位で画素ごとにToFを計測する。第2の計測分解能は、第1の計測分解能よりも低い。また、同期クロックは例えば全体制御部140から供給される。
DRO=24×DROclk+DROin・・・(2)
DToF=27×DGclk+(27-DRO)
=27×DGclk+(27-24×DROclk-DROin)・・・(3)
図17は、本実施形態における測距動作の一例に関するフローチャートである。
S2201で全体制御部140は、信号処理部123が有するヒストグラム回路および計測カウンタiをリセットする。また、全体制御部140は、S2202で発光させる発光素子211と光学的に対応する画素511の出力がTDCアレイ部122に入力されるよう、不図示の中継バッファの接続を変更する。
S2206で信号処理部123は、計測回数カウンタiの値が事前に設定された設定回数Ntotalより大きいか否かを判定する。信号処理部123は、計測回数カウンタiの値が設定回数Ntotalより大きいと判定されればS2207を、計測回数カウンタiの値が設定回数Ntotalより大きいと判定されなければ2202を実行する。
S2208で信号処理部123は、個々の画素のヒストグラムにおいて、S2207で除去されずに残った計測結果を平均し、平均値を計測されたToFとして出力し、1回の測距シーケンスを終了する。
ここで、S2207でのノイズ成分除去処理と、S2208での平均化について説明した後、感度の異なる画素Hと画素Lによるノイズ光低減効果について述べる。
次に、図18Dおよび図18Eを用いて、高感度画素Hと低感度画素LのHDR駆動について説明する。図18Dは高感度画素Hの計測結果のヒストグラムの一例を、図18Eは図18Dの高感度画素Hに隣接する低感度画素Lの計測結果のヒストグラムの一例を、それぞれ示している。
上述した測距装置は、距離情報を用いて所定の処理を実行する処理手段を有する任意の電子機器において実施可能である。このような電子機器には、撮像装置、コンピュータ機器(パーソナルコンピュータ、タブレットコンピュータ、メディアプレーヤ、PDAなど)、携帯電話機、スマートフォン、ゲーム機、ロボット、ドローン、車両などが含まれる。これらは例示であり、本発明に係る測距装置は他の電子機器においても実施可能である。
Claims (12)
- 光を照射してから反射光を検出するまでの時間差を計測することにより光を反射した物体までの距離を算出する測距装置に用いられる投光ユニットであって、
複数の発光素子が2次元に配列された光源アレイと、
前記光源アレイから出射される光の投光範囲を調整するための投光レンズと、
前記光源アレイと前記投光レンズとの相対的な位置を変更する駆動手段と、
前記光源アレイの位置が異なる状態で前記光源アレイを点灯させる光源制御手段と、
を有することを特徴とする投光ユニット。 - さらに、コリメータレンズアレイを有することを特徴とする請求項1に記載の投光ユニット。
- 前記コリメータレンズアレイが前記投光レンズの機能を備えることを特徴とする請求項2に記載の投光ユニット。
- 前記駆動手段は、前記光源アレイを前記投光レンズの光軸に垂直な面内で移動させることを特徴とする請求項1から3のいずれか1項に記載の投光ユニット。
- 前記駆動手段は、前記光源アレイを前記投光レンズの光軸に垂直な面内で円状に移動させることを特徴とする請求項4に記載の投光ユニット。
- 前記駆動手段は、前記光源アレイを前記投光レンズの光軸方向に移動させることを特徴とする請求項1から5のいずれか1項に記載の投光ユニット。
- 前記駆動手段は、前記投光レンズを光軸に垂直な面内で移動させることを特徴とする請求項1に記載の投光ユニット。
- 前記光源制御手段は、前記光源アレイを一定周期で点灯させることを特徴とする請求項1から7のいずれか1項に記載の投光ユニット。
- 請求項1から8のいずれか1項に記載の投光ユニットと、
複数の画素が2次元に配列された受光装置と、
前記投光ユニットが投光してから前記受光装置の前記複数の画素のそれぞれで光の入射が検出されるまでの時間を計測する計測手段と、
前記計測された時間に基づいて、前記複数の画素のそれぞれについての距離情報を算出する算出手段と、
を有することを特徴とする測距装置。 - 前記複数の画素が、第1の感度を有する第1の画素と、前記第1の感度よりも低い第2の感度を有する第2の画素を有することを特徴とする請求項9に記載の測距装置。
- 前記第1の画素について計測された前記時間を、前記第1の画素に隣接する前記第2の画素について計測された前記時間に基づいて補正することを特徴とする請求項10に記載の測距装置。
- 請求項9から11のいずれか1項に記載の測距装置と、
前記測距装置で得られる距離情報を用いて所定の処理を実行する処理手段と、
を有することを特徴とする電子機器。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE112022002404.6T DE112022002404T5 (de) | 2021-04-26 | 2022-03-28 | Lichtprojektionseinheit und entfernungsermittlungsvorrichtung unter verwendung einer lichtprojektionseinheit |
KR1020237037847A KR20230167072A (ko) | 2021-04-26 | 2022-03-28 | 투광 유닛 및 그것을 사용한 측거장치 |
GB2317273.7A GB2621063A (en) | 2021-04-26 | 2022-03-28 | Light projection unit and distance measurement device using same |
US18/492,647 US20240053473A1 (en) | 2021-04-26 | 2023-10-23 | Light-projection device and range finding apparatus that uses light-projection unit |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021074413A JP2022168740A (ja) | 2021-04-26 | 2021-04-26 | 投光ユニットおよびそれを用いた測距装置 |
JP2021-074413 | 2021-04-26 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/492,647 Continuation US20240053473A1 (en) | 2021-04-26 | 2023-10-23 | Light-projection device and range finding apparatus that uses light-projection unit |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022230520A1 true WO2022230520A1 (ja) | 2022-11-03 |
Family
ID=83847994
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/014805 WO2022230520A1 (ja) | 2021-04-26 | 2022-03-28 | 投光ユニットおよびそれを用いた測距装置 |
Country Status (6)
Country | Link |
---|---|
US (1) | US20240053473A1 (ja) |
JP (1) | JP2022168740A (ja) |
KR (1) | KR20230167072A (ja) |
DE (1) | DE112022002404T5 (ja) |
GB (1) | GB2621063A (ja) |
WO (1) | WO2022230520A1 (ja) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011074572A1 (ja) * | 2009-12-14 | 2011-06-23 | 日本電気株式会社 | 走査装置、画像表示装置及びその制御方法 |
JP2014002176A (ja) * | 2012-06-15 | 2014-01-09 | Ushio Inc | 光源装置およびプロジェクタ |
WO2017006546A1 (ja) * | 2015-07-03 | 2017-01-12 | パナソニックIpマネジメント株式会社 | 距離測定装置および距離画像合成方法 |
US20190049097A1 (en) * | 2016-01-26 | 2019-02-14 | Heptagon Micro Optics Pte. Ltd. | Multi-Mode Illumination Module and Related Method |
JP2019190892A (ja) * | 2018-04-20 | 2019-10-31 | ソニーセミコンダクタソリューションズ株式会社 | 受光装置及び測距装置 |
WO2020030916A1 (en) * | 2018-08-07 | 2020-02-13 | Cambridge Mechatronics Limited | Improved 3d sensing |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020167338A1 (en) | 2019-02-11 | 2020-08-20 | Apple Inc. | Depth sensing using a sparse array of pulsed beams |
JP7147730B2 (ja) | 2019-11-12 | 2022-10-05 | 株式会社三洋物産 | 遊技機 |
-
2021
- 2021-04-26 JP JP2021074413A patent/JP2022168740A/ja active Pending
-
2022
- 2022-03-28 WO PCT/JP2022/014805 patent/WO2022230520A1/ja active Application Filing
- 2022-03-28 DE DE112022002404.6T patent/DE112022002404T5/de active Pending
- 2022-03-28 GB GB2317273.7A patent/GB2621063A/en active Pending
- 2022-03-28 KR KR1020237037847A patent/KR20230167072A/ko unknown
-
2023
- 2023-10-23 US US18/492,647 patent/US20240053473A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011074572A1 (ja) * | 2009-12-14 | 2011-06-23 | 日本電気株式会社 | 走査装置、画像表示装置及びその制御方法 |
JP2014002176A (ja) * | 2012-06-15 | 2014-01-09 | Ushio Inc | 光源装置およびプロジェクタ |
WO2017006546A1 (ja) * | 2015-07-03 | 2017-01-12 | パナソニックIpマネジメント株式会社 | 距離測定装置および距離画像合成方法 |
US20190049097A1 (en) * | 2016-01-26 | 2019-02-14 | Heptagon Micro Optics Pte. Ltd. | Multi-Mode Illumination Module and Related Method |
JP2019190892A (ja) * | 2018-04-20 | 2019-10-31 | ソニーセミコンダクタソリューションズ株式会社 | 受光装置及び測距装置 |
WO2020030916A1 (en) * | 2018-08-07 | 2020-02-13 | Cambridge Mechatronics Limited | Improved 3d sensing |
Also Published As
Publication number | Publication date |
---|---|
KR20230167072A (ko) | 2023-12-07 |
US20240053473A1 (en) | 2024-02-15 |
GB2621063A (en) | 2024-01-31 |
JP2022168740A (ja) | 2022-11-08 |
DE112022002404T5 (de) | 2024-02-15 |
GB202317273D0 (en) | 2023-12-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102604902B1 (ko) | 펄스형 빔들의 희소 어레이를 사용하는 깊이 감지 | |
JP6633197B2 (ja) | 光検出装置、及び電子機器 | |
US9065254B2 (en) | Multi-wavelength VCSEL array to reduce speckle | |
WO2021128587A1 (zh) | 一种可调的深度测量装置及测量方法 | |
US9297889B2 (en) | Illumination light projection for a depth camera | |
JP2010048606A (ja) | 光学式測距センサおよび電子機器 | |
CN114019478A (zh) | 光学检测装置及电子设备 | |
CN111812663A (zh) | 深度测量模组及系统 | |
JP7423485B2 (ja) | 距離計測装置 | |
CN114019474A (zh) | 发射模组、光学检测装置及电子设备 | |
CN112068148A (zh) | 光检测装置、以及电子设备 | |
WO2022230520A1 (ja) | 投光ユニットおよびそれを用いた測距装置 | |
WO2022230521A1 (ja) | 受光装置および測距装置 | |
WO2022230522A1 (ja) | 測距装置および計測ユニット | |
JP2002131662A (ja) | 光走査装置 | |
WO2022230523A1 (ja) | 測距装置 | |
CN114019475A (zh) | 接收模组、光学检测装置及电子设备 | |
US11592568B2 (en) | Measurement device and method of operating therefor | |
JP6748143B2 (ja) | 光センサおよび電子機器 | |
US20210281049A1 (en) | Low divergence vertical cavity surface emitting lasers, and modules and host devices incorporating the same | |
WO2022257558A1 (zh) | 飞行时间模组、终端及深度检测方法 | |
CN114019477A (zh) | 一种电子设备 | |
US11418006B1 (en) | Integrated device for optical time-of-flight measurement | |
WO2024024744A1 (ja) | 距離計測装置及び距離計測方法 | |
JP2023068209A (ja) | 測距装置および発光装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22795437 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20237037847 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020237037847 Country of ref document: KR |
|
ENP | Entry into the national phase |
Ref document number: 202317273 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20220328 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 112022002404 Country of ref document: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22795437 Country of ref document: EP Kind code of ref document: A1 |