EP3971608A1 - Entfernungsmessvorrichtung - Google Patents

Entfernungsmessvorrichtung Download PDF

Info

Publication number
EP3971608A1
EP3971608A1 EP21161433.4A EP21161433A EP3971608A1 EP 3971608 A1 EP3971608 A1 EP 3971608A1 EP 21161433 A EP21161433 A EP 21161433A EP 3971608 A1 EP3971608 A1 EP 3971608A1
Authority
EP
European Patent Office
Prior art keywords
light
measuring device
distance
distance measuring
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21161433.4A
Other languages
English (en)
French (fr)
Inventor
Hiroshi Kubota
Nobu Matsumoto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Corp
Toshiba Electronic Devices and Storage Corp
Original Assignee
Toshiba Corp
Toshiba Electronic Devices and Storage Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toshiba Corp, Toshiba Electronic Devices and Storage Corp filed Critical Toshiba Corp
Publication of EP3971608A1 publication Critical patent/EP3971608A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/42—Simultaneous measurement of distance and other co-ordinates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
    • G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/4861—Circuits for detection, sampling, integration or read-out
    • G01S7/4863—Detector arrays, e.g. charge-transfer gates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/487—Extracting wanted echo signals, e.g. pulse detection
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles

Definitions

  • Embodiments described herein relate generally to a distance measuring device.
  • LiDAR Light Detection and Ranging
  • a LiDAR irradiates a target object with laser light, and detects the intensity of reflected light reflected from the target object by a sensor (light detector). Then, the LiDAR measures a distance from itself to the target object based on a light intensity signal output from the sensor.
  • sensors There are a number of sensors used in the LiDAR, but a two-dimensional sensor (2D sensor) comprising a plurality of silicon photomultipliers arrayed two-dimensionally is known to be a promising sensor for the future.
  • a distance measuring device includes a light emitter, a first light receiver, a second light receiver, a measurement section, and a controller.
  • the light emitter includes a light source and a mirror.
  • the light source emits an optical signal.
  • the mirror reflects the optical signal.
  • the first light receiver includes a first sensor and a first optical system.
  • the first sensor includes a plurality of first pixels arranged two-dimensionally on a first substrate.
  • the first optical system is configured to guide a reflected light of the optical signal emitted from the light emitter to the first sensor.
  • the second light receiver includes a second sensor and a second optical system.
  • the second sensor includes a plurality of second pixels arranged two-dimensionally on a second substrate different from the first substrate.
  • the second optical system is configured to guide the reflected light to the second sensor.
  • a measurement section is configured to calculate a first distance value and a second distance value.
  • the first distance value is calculated using a first time and a second time.
  • the second distance value is calculated using the first time and a third time.
  • the first time is a time at which the light source emits the optical signal.
  • the second time is a time at which the first sensor detects the reflected light.
  • the third time is a time at which the second sensor detects the reflected light.
  • the controller is configured to cause the light source to emit the optical signal intermittently.
  • the controller is configured to control the mirror to perform scanning using the optical signal.
  • the controller is configured to set a first light-receiving area in which at least one first pixel among the first pixels is selectively turned on in the first sensor.
  • the controller is configured to set a second light-receiving area in which at least one second pixel among the second pixels is selectively turned on in the second sensor, and determine a position of the first light-receiving area and a position of the second light-receiving area according to a state of the mirror when the optical signal is emitted.
  • a distance measuring device 1 according to a first embodiment is, for example, a type of LiDAR (Light Detection and Ranging) capable of measuring a distance between the distance measuring device 1 and a target object TG.
  • LiDAR Light Detection and Ranging
  • FIG. 1 depicts a schematic diagram showing an example of an overall configuration of the distance measuring device 1 according to the first embodiment.
  • a vehicle is located in front of the distance measuring device 1 as a ranging target object TG.
  • the distance measuring device 1 according to the first embodiment includes a controller 10, an emission section 20, a light receiver 30, and a measurement section 40.
  • the controller 10 controls an overall operation of the distance measuring device 1.
  • the controller 10 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and an oscillator, all of which are not shown.
  • the ROM stores a program used for an operation of the distance measuring device 1, etc.
  • the CPU controls the emission section 20, the light receiver 30, and the measurement section 40 according to the program stored in the ROM.
  • the RAM is used as a working area of the CPU.
  • the oscillator is used for generating an intermittent pulse signal.
  • the controller 10 is also capable of executing various data processing and arithmetic processing.
  • the emission section 20 intermittently generates and emits laser light.
  • the generated and emitted laser light is applied to the target object TG, and used for measuring a distance between the distance measuring device 1 and the target object TG.
  • the laser light emitted from the emission section 20 is referred to as "outgoing light L1".
  • the outgoing light L1 reflected by the target object TG is referred to as "reflected light L2".
  • the emission section 20 may be referred to as a light emitter.
  • the light receiver 30 detects light incident on the distance measuring device 1, and transfers a light reception result to the measurement section 40. In other words, the light receiver 30 converts the light incident on the distance measuring device 1 into an electric signal, and transfers the converted electric signal to the measurement section 40.
  • the light receiver 30 is used for detecting the reflected light L2 intermittently incident on the distance measuring device 1.
  • the measurement section 40 measures a time at which the light receiver 30 detects the reflected light L2 based on the light reception result transferred from the light receiver 30. Then, the measurement section 40 measures the distance between the distance measuring device 1 and the target object TG based on a time at which the outgoing light L1 is emitted from the emission section 20 and a time at which the light receiver 30 detects the reflected light L2. The time at which the outgoing light L1 is emitted from the emission section 20 is, for example, reported from the controller 10.
  • FIG. 2 depicts a schematic diagram that outlines a ranging method of the distance measuring device 1 according to the first embodiment.
  • the waveform of an input voltage indicates a temporal change in voltage to be supplied to the light source included in the emission section 20.
  • the waveform of a light reception result indicates a temporal change in intensity of an electric signal based on light detected by the light receiver 30.
  • FIG. 2 when a pulse signal is supplied to the light source of the emission section 20, the outgoing light L1 is generated and emitted based on a rise of the pulse signal. Then, the outgoing light L1 is applied to the target object TG, and the light receiver 30 detects the reflected light L2 reflected from the target object TG.
  • the measurement section 40 calculates a time of flight (ToF) of the outgoing light L1 based on a difference between an emission time T1 at which the outgoing light L1 is emitted from the emission section 20 and a light-receiving time T2 at which the light receiver 30 detects the reflected light L2. Then, the measurement section 40 measures (ranges) the distance between the distance measuring device 1 and the target object TG based on the time of flight of the outgoing light L1 and the velocity of the laser light. Such a ranging method of the distance measuring device 1 may be called a "ToF method". The measurement section 40 outputs a ranging result for each set of the outgoing light L1 and the reflected light L2 that the distance measuring device 1 emits and receives.
  • ToF time of flight
  • the measurement section 40 may decide the emission time T1 based at least on a time relating to emission of the outgoing light L1, and decide the light-receiving time T2 based on a time relating to light reception of the reflected light L2. For example, the measurement section 40 may decide the emission time T1 and the light-receiving time T2 based on a rise time or a peak time of a signal.
  • the controller 10 may be provided for each of the emission section 20, the light receiver 30, and the measurement section 40. Processing of the measurement section 40 may be performed by the controller 10.
  • the distance measuring device 1 may include an image processor that generates an image based on a ranging result of the measurement section 40. Such an image is referred to by a control program of a vehicle, etc. equipped with the distance measuring device 1.
  • FIG. 3 depicts a schematic diagram showing an example of configurations of the emission section 20 and the light receiver 30 included in the distance measuring device 1 according to the first embodiment.
  • the emission section 20 in the first embodiment includes drivers 21 and 22, a light source 23, an optical system 24, and a mirror 25.
  • the driver 21 generates a drive current according to the pulse signal input from the oscillator of the controller 10. Then, the driver 21 supplies the generated drive current to the light source 23. That is, the driver 21 functions as a current supply source of the light source 23.
  • the driver 22 generates a drive current according to control performed by the controller 10. Then, the driver 22 supplies the generated drive current to the mirror 25. That is, the driver 22 functions as a power supply circuit of the mirror 25.
  • the optical system 24 can include a plurality of lenses and optical elements.
  • the optical system 24 is arranged on an optical path of the outgoing light L1 emitted by the light source 23.
  • the optical system 24 collimates the incident outgoing light L1, and guides the collimated outgoing light L1 to the mirror 25.
  • the optical system 24 may include a beam shaper, a beam splitter, etc.
  • the mirror 25 is driven based on the drive current supplied from the driver 22, and reflects the outgoing light L1 incident on the mirror 25.
  • a reflecting surface of the mirror 25 is formed to be rotatable or to swing around two axes intersecting each other.
  • the outgoing light L1 reflected by the mirror 25 is applied to the target object TG outside the distance measuring device 1.
  • the controller 10 changes an emitting direction of the outgoing light L1 by controlling the mirror 25 so as to scan an area to be ranged.
  • the emission section 20 may have a configuration capable of performing scanning using laser light, or may have other configurations.
  • the emission section 20 may further include an optical system arranged on an optical path of laser light reflected by the mirror 25.
  • an area that is ranged by the distance measuring device 1 is referred to as a "scanning area SA".
  • the distance measuring device 1 performs a measurement operation of a plurality of points within the scanning area SA to measure distances from various target objects TG.
  • a set of ranging results of a plurality of points corresponding to single scanning is referred to as a "frame”.
  • the distance measuring device 1 performs scanning continuously so that it can sequentially acquire a distance from a target object TG in front of itself.
  • the light receiver 30 in the first embodiment includes two light detection units PU1 and PU2.
  • Each of the light detection units PU1 and PU2 detects the reflected light L2 incident on the distance measuring device 1.
  • the light detection unit PU1 includes a bandpass filter (BPF) 31A, an optical system 32A, and a light detector 33A.
  • the light detection unit PU2 includes a BPF 31B, an optical system 32B, and a light detector 33B.
  • Each of the BPFs 31A and 31B is a filter through which a particular frequency band of light passing through the BPF passes.
  • the reflected light L2 incident on the distance measuring device 1 passes through the BPF 31A and is incident on the optical system 32A.
  • the reflected light L2 incident on the distance measuring device 1 passes through the BPF 31B and is incident on the optical system 32B.
  • the designs of the BPFs 31A and 31B may be the same or different from each other.
  • the optical system 32A can include a plurality of lenses.
  • the optical system 32A collects the reflected light L2 passing through the BPF 31A in the light detector 33A.
  • the design of the optical system 32A is optimized for a long-distance target object TG.
  • a focal distance of the optical system 32A is designed to be a long distance (infinity).
  • the optical system 32A has a design that is similar to that of a telephoto lens.
  • the light detection unit PU1 is also referred to as a "light detection unit PU on the telephoto side".
  • the optical system 32B can include a plurality of lenses.
  • the optical system 32B collects the reflected light L2 passing through the BPF 31B in the light detector 33B.
  • the design of the optical system 32B is optimized for a short-distance target object TG.
  • a focal distance of the optical system 32B is designed to be a shorter distance than that of the optical system 32A
  • a viewing angle of the optical system 32B is designed to be wider than that of the optical system 32A.
  • the optical system 32B has a design that is similar to that of a wide angle lens.
  • the light detection unit PU2 is also referred to as a "light detection unit PU on the wide-angle side".
  • an optical axis of each of the optical systems 32A and 32B of the light receiver 30 is different from that of the optical system 24 of the emission section 20. That is, the distance measuring device 1 includes a non-coaxial optical system between the emission section 20 and the light receiver 30.
  • the light receiver 30 may include at least two light detection units PU that are optimized for mutually different distances, or may have other configurations.
  • FIG. 4 depicts a plan view showing an example of a planar layout of the light detector 33 in the distance measuring device 1 according to the first embodiment.
  • the light detector 33 according to the first embodiment is a 2D sensor, and includes a light-receiving area DA.
  • the light-receiving area DA is an area used for detecting light incident on the distance measuring device 1.
  • the light-receiving area DA includes a plurality of pixels PX.
  • the pixel PX corresponds to the minimum unit of a light reception result output from the light detector 33.
  • the plurality of pixels PX are, for example, arranged two-dimensionally on a semiconductor substrate; in other words, the pixels PX are arranged in a matrix along an XY plane on the semiconductor substrate.
  • the XY plane is a plane formed by an X direction and a Y direction, and is parallel to a surface of the substrate on which the light-receiving area DA of the light detector 33 is formed.
  • a coordinate corresponding to the X direction and a coordinate corresponding to the Y direction are assigned to each of the pixels PX.
  • Each of the pixels PX includes at least one SPAD unit SU.
  • the SPAD unit SU includes a photomultiplier element.
  • the photomultiplier element for example, a single-photon avalanche diode (SPAD) is used.
  • the pixel PX includes a plurality of SPAD units SU
  • the plurality of SPAD units SU are arranged, for example, in a matrix along the XY plane.
  • the pixel PX including a plurality of SPADs is also referred to as a "silicon photomultiplier (SiPM)".
  • the size (sensor size) of the light-receiving area DA of the light detector 33A and that of the light-receiving area DA of the light detector 33B may be the same or different from each other.
  • Each of the number of pixels PX included in the light detector 33 and the number of the SPAD units SU included in the pixel PX can be freely designed.
  • Each of the shape of the pixel PX and the shape of the SPAD unit SU can be freely designed.
  • Each of the shape of the pixel PX and the shape of the SPAD unit SU may not necessarily be a single shape.
  • the number of SPAD units SU aligned in the X direction and that of SPAD units SU aligned in the Y direction may be different.
  • the shape of the pixel PX can be designed according to the number, arrangement, etc. of SPAD units SU included in the pixel PX.
  • FIG. 5 depicts a circuit diagram showing an example of a circuit configuration of a SPAD unit SU included in the distance measuring device 1 according to the first embodiment.
  • the SPAD unit SU in the first embodiment includes a set of at least one avalanche photodiode APD and a quench resistor Rq, a high voltage node Nhv, a low voltage node Nlv, and a P-type transistor Tout.
  • the number of sets of avalanche photodiode APD and quench resistor Rq corresponds to the number of SPADs included in the SPAD unit SU.
  • the set of avalanche photodiode APD and quench resistor Rq is coupled in series between the high voltage node Nhv and the low voltage node Nlv. Specifically, the anode of the avalanche photodiode APD is coupled to the low voltage node Nlv. The cathode of the avalanche photodiode APD is coupled to one end of the quench resistor Rq. The other end of the quench resistor Rq is coupled to the high voltage node Nhv. In the measurement operation of the distance measuring device 1, a voltage applied to the high voltage node Nhv is higher than a voltage applied to the low voltage node Nlv. That is, a reverse bias is applied to the avalanche photodiode APD.
  • the high voltage node Nhv corresponds to an output node of the SPAD unit SU.
  • the drain of the P-type transistor Tout is coupled to the high voltage node Nhv.
  • a control signal Sout is input to the gate of the P-type transistor Tout.
  • a voltage of the control signal Sout is a level "L”
  • an output signal IOUT based on the voltage of the high voltage node Nhv is output from the source of the P-type transistor Tout.
  • the output signal IOUT corresponds to a light reception result of the SPAD unit SU.
  • the P-type transistor Tout cuts off the output of the light reception result by the SPAD unit SU.
  • the controller 10 can control the control signal Sout per a plurality of pixels PX.
  • the SPAD unit SU may have other circuit configurations.
  • the drain of an N-type transistor may be coupled to the high voltage node Nhv
  • the control signal Sout may be coupled to the gate thereof
  • the source thereof may be coupled to an appropriate low voltage.
  • the current may be discharged through the N-type transistor.
  • the quench resistor Rq may be replaced with a transistor.
  • a transistor used for quenching which is different from the quench resistor Rq may be coupled to the high voltage node Nhv.
  • the arrangement of the high voltage node Nhv may be other arrangements as long as it is capable of outputting a light reception result by the avalanche photodiode APD.
  • the P-type transistor Tout may be formed by a plurality of transistors coupled in series.
  • the transistor Tout may be an N-type transistor.
  • the transistor Tout may be other switch elements as long as it is capable of selectively outputting the output signal IOUT.
  • an output signal of the pixel PX for example, corresponds to a sum of output signals IOUT of the SPAD units SU belonging to the pixel PX.
  • FIG. 6 depicts a schematic diagram showing an example of a structure of an avalanche photodiode APD and an operation principle of a single-photon avalanche diode SPAD in the distance measuring device 1 according to the first embodiment.
  • the avalanche photodiode APD according to the first embodiment includes a substrate 50, P-type semiconductor layers 51 and 52, and an N-type semiconductor layer 53.
  • the substrate 50 is, for example, a P-type semiconductor substrate.
  • the P-type semiconductor layer 51, P-type semiconductor layer 52, and N-type semiconductor layer 53 are stacked in this order.
  • the P-type semiconductor layer 51 is formed thicker than the P-type semiconductor layer 52.
  • the concentration of P-type impurities doped in the P-type semiconductor layer 52 is higher than that of P-type impurities doped in the P-type semiconductor layer 51.
  • a PN junction is formed at a contact portion between the P-type semiconductor layer 52 and the N-type semiconductor layer 53.
  • the P-type semiconductor layer 52 and the N-type semiconductor layer 53 are used as an anode and a cathode of the avalanche photodiode APD, respectively,
  • the avalanche photodiode APD in the first embodiment is used in a Geiger mode. Then, a SPAD using the avalanche photodiode APD detects light in units of photons, and converts the light into an electric signal.
  • a SPAD using the avalanche photodiode APD shown in FIG. 6 will be described.
  • the substrate 50 side corresponds to the low voltage node Nlv of the SPAD unit SU.
  • the N-type semiconductor layer 53 side corresponds to the high voltage node Nhv of the SPAD unit SU.
  • the avalanche photodiode APD When a high reverse bias is applied to the avalanche photodiode APD, a strong electric field is generated between the P-type semiconductor layer 52 and the N-type semiconductor layer 53 ( FIG. 6 (1)). Accordingly, a depletion layer is formed over an area from the PN junction between the P-type semiconductor layer 52 and the N-type semiconductor layer 53 to the P-type semiconductor layer 51 ( FIG. 6 (2)). At this time, the avalanche photodiode APD enters a state (hereinafter, referred to as an active state) capable of detecting light. When the avalanche photodiode APD in the active state is irradiated with light, some energy of the light reaches the depletion layer ( FIG. 6 (3)).
  • a pair of an electron and a positive hole i.e., a carrier
  • the carrier generated in the depletion layer drifts due to a strong electric field in the vicinity of the PN junction ( FIG. 6 (5)).
  • the positive hole of the generated carrier is accelerated toward the substrate 50 side, and the electron of the generated carrier is accelerated toward the N-type semiconductor layer 53 side.
  • the electron accelerated toward the N-type semiconductor layer 53 side collides with an atom under the strong electric field in the vicinity of the PN junction.
  • the electron that collided with the atom ionizes the atom, and generates a new pair of an electron and a positive hole.
  • Such generation of a pair of an electron and a positive hole is repeated if a voltage of a reverse bias applied to the avalanche photodiode APD exceeds a breakdown voltage of the avalanche photodiode APD ( FIG. 6 (6) Avalanche breakdown).
  • the avalanche photodiode APD discharges an electric current ( FIG. 6 (7) Geiger discharge).
  • the electric current output from the avalanche photodiode APD flows in the quench resistor Rq.
  • a voltage drop occurs in the output node of the SPAD unit SU ( FIG. 6 (8) Quenching).
  • the Geiger discharge is stopped.
  • a recovery current flows into the avalanche photodiode APD, and charging of the capacity at the PN junction is performed.
  • the avalanche photodiode APD returns to a state capable of detecting light.
  • the avalanche photodiode APD included in the SPAD unit SU may have other configurations.
  • the P-type semiconductor layer 52 may be omitted.
  • the thickness of each of the P-type semiconductor layer 51, P-type semiconductor layer 52, and N-type semiconductor layer 53 can be changed according to the design of the avalanche photodiode APD.
  • the PN junction of the avalanche photodiode APD may be formed at a contact portion between the substrate 50 and the semiconductor layer on the substrate 50.
  • the avalanche photodiode APD may have a structure in which the P-type semiconductor layer and the N-type semiconductor layer shown in FIG. 6 are switched with each other.
  • the reflected light L2 incident on the distance measuring device 1 is, for example, applied to a part of the light-receiving area DA based on a scanning position of the outgoing light L1 and a design of the optical system 32. Then, the controller 10 sets the SPAD unit SU included in each pixel PX to an active state or an inactive state based on an irradiation position of the reflected light L2.
  • a pixel PX including a SPAD unit SU controlled to be in a state capable of detecting light is referred to as a pixel PX in an ON state.
  • a pixel PX including a SPAD unit SU controlled to be in a state incapable of detecting light is referred to as a pixel PX in an OFF state.
  • An area including at least one pixel PX in an ON state that the controller 10 sets in the light-receiving area DA is referred to as an "active area AA".
  • FIG. 7 depicts a plan view showing an example of an active area AA set in the light-receiving area DA of the light detector 33 in the distance measuring device 1 according to the first embodiment.
  • the controller 10 notifies the light detector 33 of an X coordinate Cx and a Y coordinate Cy of the light-receiving area DA for each beam of outgoing light L1. Then, the light detector 33 sets the active area AA within the light-receiving area DA based on the X coordinate Cx and the Y coordinate Cy designated by the controller 10.
  • the X coordinate Cx and the Y coordinate Cy are, for example, associated with an inclination of the mirror 25 at a timing at which the outgoing light L1 is emitted, and indicate coordinates of an upper-left pixel PX of the active area AA.
  • the active area AA is, for example, set to an area having an expanse of four pixels by three pixels in the X direction and the Y direction, respectively, with the X coordinate Cx and the Y coordinate Cy as a reference. In other words, in this example, the active area AA is set to a rectangular area including 4 x 3 pixels. As described above, when the active area AA is set within the light-receiving area DA, only a pixel PX of an area estimated to be irradiated with the reflected light L2 outputs a light reception result.
  • the position of the active area AA may be set based at least on coordinates designated by the controller 10.
  • the shape of the active area AA may be changed according to the coordinates designated by the controller 10.
  • FIG. 8 depicts a block diagram showing an example of a configuration of an output part of the light detector 33 in the distance measuring device 1 according to the first embodiment.
  • the light detector 33 includes an output part that performs, prior to transferring light reception results (output signals IOUT) acquired from a plurality of pixels PX within the active area AA to the measurement section 40, predetermined signal processing for the output signals IOUT.
  • the output part of the light detector 33 includes a switch part SW and a signal processor SP.
  • the switch part SW includes a plurality of switch circuits.
  • the switch part SW appropriately re-couples a plurality of switch circuits based on the X coordinate Cx and the Y coordinate Cy indicating the position of the active area AA.
  • the number of signal lines used for output of the pixels PX in the light detector 33 can be reduced.
  • the switch part SW aligns the order of a plurality of output signals IOUT output from the light-receiving area DA.
  • the switch part SW aligns the input output signals IOUTa1 to IOUTa12 and outputs the aligned output signals IOUTb1 to IOUTb12 to the signal processor SP.
  • the output order of each pixel PX within the active area AA is changed to, for example, the order shown in the lower portion of FIG. 8 .
  • the signal processor SP performs various signal processing by using the plurality of output signals IOUT that are input from the switch part SW.
  • the signal processor SP can include, for example, an analog circuit like an amplifier circuit, an analog-to-digital converter (ADC), a time-to-digital converter (TDC), and a logic circuit like an adder.
  • ADC analog-to-digital converter
  • TDC time-to-digital converter
  • the signal processor SP performs analog-to-digital conversion to each of the output signals IOUTb1 to IOUTb12 that are input, and generates a digital signal based on a light reception result of the light detector 33. Then, the signal processor SP transfers the digital signal based on the light reception result to the measurement section 40.
  • the output signals IOUTb1 to IOUTb12 aligned by the switch part SW are input so that the signal processor SP can perform the signal processing without changing the order of relative positions within the active area AA.
  • the light-receiving area DA, the switch part SW, and the signal processor SP may be formed on respectively different substrates.
  • the switch part SW and the signal processor SP may be provided integrally.
  • the signal processor SP may include both an ADC and a TDC.
  • a plurality of pixels PX within the active area AA may be classified into a group of pixels PX to be converted into digital signals by the ADC and a group of pixels PX to be converted into digital signals by the TDC.
  • Output signals of the pixels PX within the active area AA may be integrated according to the arrangement of the pixels within the active area AA.
  • FIG. 9 depicts a block diagram showing an example of a configuration of the measurement section 40 in the distance measuring device 1 according to the first embodiment.
  • the measurement section 40 in the first embodiment includes, for example, an acquisition part 41, an integration part 42, and a distance measurement part 43.
  • the acquisition part 41 acquires data relating to ranging from the controller 10 and the light receiver 30, and temporally stores the acquired data. Specifically, the acquisition part 41 acquires data relating to the emission time T1 of the outgoing light L1 from the controller 10, and acquires data relating to a light reception result of each of the light detection units PU1 and PU2 from the light receiver 30. Then, the acquisition part 41 transfers the data relating to the emission time T1 to the distance measurement part 43, and transfers the data relating to the light reception result of each of the light detection units PU1 and PU2 to the integration part 42.
  • the integration part 42 performs integration processing of the data relating to the light reception results. Specifically, the integration part 42 integrates light reception results of a plurality of pixels PX transferred from the light detection unit PU1 so as to generate first integration data, and integrates light reception results of a plurality of pixels PX transferred from the light detection unit PU2 so as to generate second integration data. Then, the integration part 42 transfers each of the first integration data and the second integration data to the distance measurement part 43.
  • the distance measurement part 43 measures a distance based on the data transferred from the acquisition part 41 and the integration part 42. Specifically, the distance measurement part 43 calculates the light-receiving time T2 of the reflected light L2 in each of the light detection units PU1 and PU2 based on the first and second integration data transferred from the integration part 42. Then, the distance measurement part 43 measures a distance based on a ToF method for each light detection unit PU by using the emission time T1 and the light-receiving time T2 of each of the light detection units PU1 and PU2. Measurement results are, for example, transferred to an image processor. The measurement results may be referred to by the controller 10.
  • FIG. 10 depicts a time chart showing an example of a light reception result of the light receiver 30 in the distance measuring device 1 according to the first embodiment.
  • An ordinate axis of the time chart of FIG. 10 represents luminance based on an output signal of a pixel PX.
  • each measurement operation performed by the distance measuring device 1 for each beam of outgoing light L1 includes, for example, a sampling period and a blanking period.
  • the sampling period is a period during which the signal processor SP of the light detector 33 performs signal processing for a light reception result.
  • the signal processor SP converts an electric signal output from the light-receiving area DA into a digital signal at a predetermined sampling interval.
  • times t0 to t32 correspond to the sampling period
  • the signal processor SP converts the electric signal output from the light-receiving area DA into a digital signal at each of times t1 to t32.
  • the sampling period and the length of the sampling interval may be freely set.
  • the blanking period is a period set between a sampling period for current outgoing light L1 and a sampling period for next outgoing light L1.
  • signal processing by the signal processor SP is omitted.
  • a period from time t32 to time t33 corresponds to the blanking period.
  • the blanking period may be omitted as appropriate.
  • sampling periods of consecutive beams of outgoing light L1 may overlap each other.
  • FIG. 11 depicts time charts showing an example of integration processing of the measurement section 40 in the distance measuring device 1 according to the first embodiment.
  • Ordinate axes of the two time charts shown in FIG. 11 represent luminance of a digital signal based on a light reception result.
  • FIG. 11 (1) shows an example of an output (light reception result) of each pixel PX within the active area AA.
  • FIG. 11 (2) shows an example of an integration result of outputs of a plurality of pixels PX within the active area AA.
  • the output of each pixel PX includes a peak portion based on the reflected light L2 and noise.
  • Ambient light such as sunlight scattered by a certain object, may be incident on the distance measuring device 1, and the ambient light would appear as random noise in a light reception result. That is, the location where noise is generated varies from pixel PX to pixel PX.
  • the peak portion based on the reflected light L2 usually has a luminance higher than that of noise. Since the output for each pixel PX has a narrow dynamic range, a difference between the noise and the peak portion based on the reflected light L2 is small.
  • the distance measurement part 43 measures the light-receiving time T2 of the reflected light L2 based on the digital signal with the improved S/N ratio. As a result, the distance measuring device 1 can improve measurement accuracy of the light-receiving time T2.
  • FIG. 12 depicts a table showing an example of a scanning method of the distance measuring device 1 according to the first embodiment.
  • the table shown in FIG. 12 indicates three types of combinations of a name and a specific example of a scanning method.
  • reference sign "L1" indicates the shape and the emission timing of the outgoing light L1 in the associated scanning method.
  • the arrow “scanning position” schematically indicates a path in which a plurality of beams of outgoing light L1 are emitted in sequence, within the scanning area SA.
  • “Leftward direction” and “rightward direction” refer to the leftward direction and the rightward direction on the page, respectively.
  • the outgoing light L1 having a dot-shaped irradiation surface is used.
  • the distance measuring device 1 performs scanning in the rightward and leftward directions repeatedly. Specifically, the distance measuring device 1 scans in the rightward direction and then turns back to scan in the leftward direction, and after scanning in the rightward direction again, turns back again to scan in the leftward direction.
  • raster scanning Such a scanning method is referred to as "raster scanning".
  • a biaxial mirror as the mirror 25.
  • the outgoing light L1 having an irradiation surface elongated in the longitudinal direction is used.
  • the emission section 20 includes, for example, a collimator lens and a cylindrical lens.
  • the distance measuring device 1 irradiates a plurality of pixels PX in a longitudinal line at the same time, and scans in the rightward direction.
  • Such a scanning method is referred to as "multichannel scanning".
  • a means for realizing the multichannel scanning it is conceivable to use a polygon mirror, a revolving mirror, or a single-axis MEMS mirror, as the mirror 25.
  • the multichannel scanning may be realized by rotating the distance measuring device 1 itself without using the mirror 25.
  • the multichannel scanning can irradiate a plurality of pixels PX at the same time in a single laser emission.
  • use of the multichannel scanning enables higher resolution and/or a higher frame rate than the raster scanning.
  • the outgoing light L1 having an irradiation surface elongated in the longitudinal direction is used.
  • the emission section 20 includes, for example, an anisotropic aspherical collimator lens.
  • the distance measuring device 1 irradiates a plurality of pixels PX in a longitudinal line at the same time and scans in the rightward direction, and then repeatedly performs scanning shifted in the perpendicular direction.
  • Such a scanning method is referred to as "multichannel raster scanning".
  • multichannel raster scanning As a means for realizing the multichannel raster scanning, it is conceivable to use a polygon mirror having different tilt angles, a revolving mirror, a biaxial mirror, etc., as the mirror 25.
  • a configuration shown in FIG. 13 is conceivable.
  • FIG. 13 depicts a schematic diagram showing an example of a scanning method of the emission section 20 in the distance measuring device 1 according to the first embodiment.
  • the light source 23 includes a multichannel laser diode MCLD
  • the optical system 24 includes a collimator lens CL and a cylindrical lens SL.
  • the multichannel laser diode MCLD includes laser diodes LD1 to LD4 aligned in one direction (longitudinal direction).
  • the laser diodes LD1 to LD4 can be controlled independently.
  • the laser light emitted from each of the laser diodes LD1 to LD4 passes through the collimator lens CL and the cylindrical lens SL in this order.
  • the controller 10 lights up the laser diodes LD1 to LD4 sequentially at the time of multichannel raster scanning.
  • the controller 10 lights up the multichannel laser diode MCLD while changing the channel in sequence.
  • the controller 10 lights up the laser diodes LD1 to LD4 at times t1 to t4, respectively.
  • the controller repeatedly performs the same control at times t1 to t4 in the multichannel raster scanning.
  • Such multichannel raster scanning can also irradiate a plurality of pixels PX at the same time in a single laser emission, and thus can enable higher resolution and/or a higher frame rate than the raster scanning.
  • the above-described scanning methods are only examples.
  • the scanning methods shown in FIG. 12 (1) to (3) correspond to mechanical methods.
  • the distance measuring device 1 may use an OPA (Optical Phased Array) method as another scanning method.
  • OPA Optical Phased Array
  • the number of straight-line paths and the scanning direction in single scanning may be other settings.
  • the operation and effect provided by the distance measuring device 1 according to the first embodiment do not depend on the scanning method of the outgoing light L1.
  • the distance measuring device 1 according to the first embodiment may perform scanning by using any one of the mechanical methods and the OPA method. In the following, a case of using a multichannel raster using a plurality of channels of laser diodes will be described.
  • FIG. 14 depicts a schematic diagram showing an example of an operation of the light receiver 30 in the distance measuring device 1 according to the first embodiment.
  • the light source 23, the optical system 24, and the mirror 25 included in the emission section 20, and the light detection units PU1 and PU2 included in the light receiver 30 are simplified.
  • the emission section 20 changes the angle of the mirror 25 and emits the outgoing light L1 so as to scan a desired area. That is, in the emission section 20, the outgoing light L1 emitted from the light source 23 passes through the optical system 24 and is applied to the mirror 25. Then, the outgoing light L1 applied to the mirror 25 is reflected in a direction according to the angle of the mirror 25.
  • the controller 10 controls the mirror 25 such that the incident angle changes for each beam of outgoing light L1 emitted intermittently.
  • the reflected light L2 from the target object TG is incident on each of the light detection units PU1 and PU2.
  • the reflected light L2 incident on the light detection unit PU1 on the telephoto side passes through the BPF 31A and the optical system 32A, and is applied to the light-receiving area DA of the light detector 33A.
  • the active area AA set in the light-receiving area DA of the light detector 33A moves (i.e., scans) within the light-receiving area DA in synchronization with the state of the mirror 25.
  • the position of the active area AA of the light detector 33A is set according to the design of the optical system 32A and the scanning position of the emission section 20. Thus, the active area AA of the light detector 33A is appropriately set to a position where the reflected light L2 can be received.
  • the reflected light L2 incident on the light detection unit PU2 on the wide-angle side passes through the BPF 31B and the optical system 32B, and is applied to the light-receiving area DA of the light detector 33B.
  • the active area AA set in the light-receiving area DA of the light detector 33B moves (i.e., scans) within the light-receiving area DA in synchronization with the state of the mirror 25.
  • the position of the active area AA of the light detector 33B is set according to the design of the optical system 32B and the scanning position of the emission section 20. Thus, the active area AA of the light detector 33B is appropriately set to a position where the reflected light L2 can be received.
  • a scan setting of the active area AA in the light detection unit PU1 on the telephoto side and a scan setting of the active area AA in the light detection unit PU2 on the wide-angle side may be the same or different.
  • the scan setting of the active area AA may be at least set in accordance with the associated optical system 32.
  • the shape and position of the reflected light L2 applied to each light-receiving area DA can change according to the position of the target object TG irradiated with the outgoing light L1.
  • variations of the state of the reflected light L2 that the distance measuring device 1 receives from the target object TG and an example of a measurement operation corresponding to the state will be described using FIGS. 15 , 16, and 17 .
  • FIGS. 15 , 16, and 17 depicts a schematic diagram showing an example of the light-receiving area DA and the reflected light L2 applied to the light detector 33 in the distance measuring device 1 according to the first embodiment.
  • FIG. 15 corresponds to a state in which the distance measuring device 1 receives the reflected light L2 from a long-distance target object TG.
  • the reflected light L2 from the long-distance target object TG enters an in-focus state in the light detector 33A on the telephoto side, and enters a state of being out of focus (a defocused state) in the light detector 33B on the wide-angle side.
  • a defocus occurs, an irradiation area of the reflected light L2 with respect to the light-receiving area DA expands.
  • the light intensity per unit area in the defocused state is lower than that in a case of being in focus.
  • the reflected light L2 can be detected in both the light detector 33A on the telephoto side and the light detector 33B on the wide-angle side.
  • detection accuracy of a peak of the light intensity corresponding to the reflected light L2 is reduced.
  • reliability of a ranging result based on a light reception result of the light detector 33A on the telephoto side is higher than that of a ranging result based on a light reception result of the light detector 33B on the wide-angle side.
  • the distance measuring device 1 may prioritize the ranging result corresponding to the light detector 33A on the telephoto side.
  • FIG. 16 corresponds to a state where the distance measuring device 1 receives the reflected light L2 from a short-distance target object TG.
  • the reflected light L2 from the short-distance target object TG enters an in-focus state at the light detector 33B on the wide-angle side, and enters a defocused state at the light detector 33A on the telephoto side.
  • the reflected light L2 can be detected in both the light detector 33A on the telephoto side and the light detector 33B on the wide-angle side.
  • a defocus occurs in the light detector 33A on the telephoto side, detection accuracy of a peak of light intensity corresponding to the reflected light L2 is reduced.
  • reliability of a ranging result based on a light reception result of the light detector 33B on the telephoto side is higher than that of a ranging result based on a light reception result of the light detector 33A on the telephoto side.
  • the distance measuring device 1 may prioritize the ranging result corresponding to the light detector 33B on the wide-angle side.
  • FIG. 17 corresponds to a state where the distance measuring device 1 receives the reflected light L2 from an extremely-short-distance target object TG.
  • the reflected light L2 from the extremely-short-distance target object TG enters an in-focus state at the light detector 33B on the wide-angle side, and enters a defocused state at the light detector 33A on the telephoto side.
  • the light receiver 30 receives the reflected light L2 from the extremely-short-distance target object TG, a parallax generated due to the non-coaxial optical system tends to increase.
  • a parallax is suppressed since the optical system 32B optimized for a short-distance target object TG is used.
  • a parallax is large since the optical system 32A optimized for a long-distance target object TG is used.
  • the reflected light L2 is applied to the active area AA in the light detector 33B on the wide-angle side.
  • the reflected light L2 may deviate from the light-receiving area DA.
  • the distance measuring device 1 cannot detect a peak of light intensity corresponding to the reflected light L2 in the light detector 33A on the telephoto side.
  • the distance measuring device 1 can detect a peak of light intensity corresponding to the reflected light L2.
  • the distance measuring device 1 may add a ranging result corresponding to the light detector 33B on the wide-angle side to a ranging result corresponding to the light detector 33A on the telephoto side.
  • the distance measuring device 1 may handle a ranging result in the other light detector 33 as the ranging result in the one light detector 33.
  • a distance measuring device using a 2D sensor has, for example, the following problems (a) to (d).
  • the light detection unit PU1 includes the optical system 32A optimized for ranging of a long-distance target object TG and the light detector 33A capable of changing the position of the active area AA in accordance with scanning of the emission section 20.
  • a set of the optical system 32A and the light detector 33A is designed to have a narrow FoV and a large effective aperture D on the assumption of ranging of a target object TG on the telephoto side.
  • the light detection unit PU2 includes the optical system 32B optimized for ranging of a short-distance target object TG, and the light detector 33B capable of changing the position of the active area AA in accordance with scanning of the emission section 20.
  • a set of the optical system 32B and the light detector 33B is designed to have a wide FoV on the assumption of ranging of a target object TG on the wide-angle side.
  • long-distance ranging is required for a narrow horizontal field of view angle that is close to a traveling direction, and a necessity of long-distance ranging is relatively low for directions outside thereof.
  • the set of the optical system 32A and the light detector 33A provides a long-distance ranging function for the narrow field of view angle that is close to the traveling direction
  • the set of the optical system 32B and the light detector 33B provides a wide angle ranging function for directions outside thereof. That is, the distance measuring device 1 according to the first embodiment has solved problem (a) in regard to the horizontal direction.
  • an angle resolution of the light detection unit PU1 having a narrow FoV is higher (smaller) than that of the light detection unit PU2 having a wide FoV.
  • the optical system 32A of the light detection unit PU1 on the telephoto side can be designed to have a large focal distance and a small f-number.
  • the light detection unit PU1 can improve measurement accuracy of a long-distance target object TG.
  • the optical system 32B of the light detection unit PU2 on the wide-angle side can be designed to have a wide FoV and a small parallax.
  • the optical system 32B of the light detection unit PU2 can be designed to have a small focal distance and a large f-number.
  • the light detection unit PU2 can reduce a defocus of a short-distance target object TG to reduce erroneous ranging or resolution problems caused by the defocus.
  • the distance measuring device 1 according to the first embodiment has addressed problem (b).
  • the optical system 32A of the light detection unit PU1 on the telephoto side can be designed to have a small f-number, and the optical system 32B of the light detection unit PU2 can be designed to have a large f-number.
  • the distance measuring device 1 according to the first embodiment has addressed problem (c).
  • the distance measuring device 1 can complement a ranging result of the light detection unit PU1 by a ranging result by the light detection unit PU2 on the wide-angle side.
  • the distance measuring device 1 according to the first embodiment can avoid employing an erroneous ranging result by another pixel PX that is caused by the defocus. Then, the distance measuring device 1 can complement the ranging results of the light detection unit PU1 and the light detection unit PU2 with each other according to the distance of the target object TG.
  • the distance measuring device 1 according to the first embodiment can realize both a fine resolution required on the telephoto side and a wide field of view angle required on the wide-angle side, and obtain a highly reliable ranging result over a range from an extremely short distance to a long distance.
  • the distance measuring device 1 according to the first embodiment uses a common emission section 20 for a plurality of light detection units PU1 and PU2, the cost of the distance measuring device 1 can be reduced.
  • the distance measuring device 1 may output the ranging result of the light detection unit PU1 and the ranging result of the light detection unit PU2 together.
  • the distance measuring device 1 may integrate ranging results of the light detection units PU1 and PU2 based on single scanning within the scanning area SA based on a predetermined condition and output it.
  • the distance measuring device 1 can select a ranging result in a measurement operation of the frame from a ranging result of any one of the light detection units PU1 and PU2 based on reliability to be described later.
  • the distance measuring device 1 according to the first embodiment can be modified in various ways. In the following, points different from the first embodiment will be described regarding first and second modifications of the first embodiment.
  • FIG. 18 depicts a schematic diagram showing an example of a scanning method of an emission section 20 in a distance measuring device 1A according to the first modification of the first embodiment.
  • scanning of a multichannel raster in which a plurality of channels of laser diodes are vertically arranged is performed in the same manner as the first embodiment.
  • a plurality of channels at a time may be lit up as indicated at times t1 and t4 shown in FIG. 18 (b) .
  • a controller 10 in the first modification of the first embodiment performs scanning by changing the position in a horizontal direction (a direction intersecting a direction in which laser diodes LD1 to LD4 are aligned) without changing the longitudinal position in a state of each of times t1 to t4.
  • the controller 10 performs scanning from left to right of a scanning area of the distance measuring device 1.
  • the controller 10 changes the position in the horizontal direction and performs scanning in a state of the next time.
  • the controller 10 scans in the horizontal direction in a state of time t1, and after the scanning in the state of time t1 is completed, scans in the horizontal direction in a state of time t2.
  • the controller 10 performs scanning in a state of each of times t3 and t4 in order, and after the scanning of time t4 is completed, returns to the state of time t1 to perform the same scanning.
  • emission of a channel has a vertical emission angle of 4°.
  • Laser emission by the laser diodes LD2 and LD3 indicated by heavy-line hatching in FIG. 18 (b) forms one cycle by a set of times t1 and t2 and a set of times t3 and t4.
  • the laser diode LD3 emits the laser light at times t1 and t3
  • the laser diode LD2 emits the laser light at times t2 and t4.
  • a vertical emission angle by the set of laser diodes LD2 and LD3 is, for example, 8°.
  • This vertical emission angle 8° corresponds to a vertical field of view angle FoVV (VA1) on the telephoto side, and the above-described one cycle (e.g., times t1 to t2) corresponds to a frame rate on the telephoto side.
  • VA1 vertical field of view angle
  • emission of the laser diode LD indicated by thin-line hatching in FIG. 18 (b) forms a different cycle. Specifically, one cycle is formed by times t1 to t4, and the laser diodes LD1 to LD4 emit laser light at times t1 to t4, respectively. That is, emission of laser light of the laser diode LD2 at time t2 is used on both the telephoto side and the wide-angle side.
  • a vertical emission angle by the set of laser diodes LD1 to LD4 is, for example, 16°.
  • This vertical emission angle 16° corresponds to a vertical field of view angle FoVV (VA2) on the wide-angle side
  • FoVV vertical field of view angle
  • the vertical field of view angle on the wide-angle side is double the vertical field of view angle on the telephoto side
  • the frame rate on the telephoto side is double the frame rate on the wide-angle side.
  • the light detection unit PU1 on the telephoto side is adjusted such that its vertical field of view angle matches a corresponding vertical emission angle.
  • the light detection unit PU2 on the wide-angle side is adjusted such that its vertical field of view angle matches a corresponding vertical emission angle.
  • multichannel laser diodes MCLD include at least one first laser diode LD that emits optical signals in order in a first cycle (frame rate on the telephoto side), and at least one second laser diode that emits optical signals in order in a second cycle (frame rate on the wide-angle side) longer than the first cycle.
  • Parts of the first laser diode and the second laser diode may overlap each other.
  • the controller 10 sets a first light-receiving area (active area AA) in the light detector 33A in accordance with a plurality of optical signals emitted in order by at least one first laser diode in the first cycle, and sets a second light-receiving area (active area AA) in the light detector 33B in accordance with a plurality of optical signals emitted in order by at least one second laser diode in the second cycle.
  • a horizontal size of the sensor of the light detection unit PU1 is equal to that of the sensor of the light detection unit PU2.
  • the vertical size of the sensor of the light detection unit PU1 is double that of the sensor of the light detection unit PU2, resulting in an increase in cost of the sensor of the light detection unit PU1.
  • the light detection unit PU1 or PU2 has an anisotropic optical system so that the cost of the sensor can be reduced.
  • the vertical field of view angles FoVV on the telephoto side and the wide-angle side independently.
  • the vertical field of view angle on the wide-angle side is set to be double that on the telephoto side so that even if the optical system of the light detection unit is isotropic, the vertical size of the sensor of the light detection unit PU1 on the telephoto side can be made equal to that of the sensor of the light detection unit PU2 on the wide-angle side, and the cost and the size of the device can be suppressed to be small.
  • the distance measuring device 1A has an advantage that it can acquire the target object in a short time.
  • the number of laser channels is assumed to be four, but is not limited thereto. The number of channels may be more or less than four.
  • the number of channels to scan on the telephoto side is two in FIG. 18 , but the number of channels used for scanning on the telephoto side may be more than two, or one (not scan).
  • the first modification of the first embodiment vertical scanning by a mirror is unnecessary, e.g., a tilt structure of a polygon mirror and a biaxial mirror are unnecessary.
  • the tilt structure raises manufacturing costs of the polygon mirror, and is expensive since the number of suppliers who provide it is also limited.
  • a biaxial MEMS mirror is difficult to manufacture especially for in-vehicle application.
  • the first modification of the first embodiment can solve such cost and sourcing problems. In a non-coaxial optical system, strict scanning accuracy is required for a scanning system such as a mirror as compared to a coaxial optical system; therefore, the lack of necessity of the vertical scanning can greatly mitigate these sourcing problems.
  • FIG. 19 depicts a schematic diagram showing an example of a scanning method of an emission section 20 in a distance measuring device 1B according to a second modification of the first embodiment.
  • scanning of a multichannel raster in which a plurality of channels of laser diodes are vertically arranged is performed in the same manner as in the first embodiment.
  • a plurality of laser diodes corresponding to the telephoto side and the wide-angle side are provided in the light source 23 of the emission section.
  • a laser diode LD2 of a multichannel laser diode MCLD includes a plurality of laser diodes LD2a, LD2b, LD2c, and LD2d aligned in a longitudinal direction.
  • a set of laser diodes LD1 to LD4 is used for the wide-angle side, and a set of the laser diodes LD2a to LD2d is used for the telephoto side.
  • a vertical emission angle of each channel (laser diodes LD2a to LD2d) on the telephoto side is 1 degree
  • a vertical emission angle of each channel (laser diodes LD1 to LD4) on the wide-angle side is 4 degrees
  • an emission angle of the first channel (laser diode LD2) from the bottom on the wide-angle side and all the vertical emission angles (laser diodes LD2a to LD2d) on the telephoto side are designed to be matched.
  • the black LDs in FIG. 19 represent vertical scanning on the telephoto side
  • the shaded LDs represent scanning on the wide-angle side.
  • all the channels (laser diodes LD2a to LD2d) on the telephoto side are lit up to cover a vertical field of view angle on the wide-angle side.
  • the frame rates on the telephoto side and the wide-angle side are the same.
  • the second channel (laser diode LD2b) from the bottom on the wide-angle side may be lit up at all the time bands.
  • the distance measuring device 1B according to the second modification of the first embodiment can make a vertical field of view angle of each channel on the telephoto side smaller than, e.g., a quarter of, that in the first modification of the first embodiment. Accordingly, in the second modification of the first embodiment, optical noise N can be made a quarter and optical SN can be made a half of that in the first modification of the first embodiment.
  • the second channel from the bottom on the wide-angle side is lit up so that a signal S on the telephoto side can be made larger, e.g., by a quarter, and the optical SN can be made two-fifths in conjunction with the previous effect.
  • the overall vertical field of view angle on the telephoto side can be made smaller than, e.g., half of, that in the first modification of the first embodiment.
  • This overall vertical field of view angle on the telephoto side for example, corresponds to a quarter of the vertical field of view angle on the wide-angle side.
  • the second modification of the first embodiment can also make a horizontal field of view angle on the wide-angle side larger than, e.g., quadruple, that on the telephoto side.
  • a scanning system such as a polygon mirror, which is important in terms of size and cost, is common on the telephoto side and the wide-angle side, and thus has an advantage in respect of size and cost.
  • a distance measuring device 2 according to a second embodiment includes a measurement section 40 different from that of the distance measuring device 1 according to the first embodiment.
  • the other configurations of the distance measuring device 2 according to the second embodiment are the same as those of the distance measuring device 1 according to the first embodiment.
  • the distance measuring device 2 according to the second embodiment confirms a ranging result of each of the light detection units PU1 and PU2 based on reliability.
  • the reliability is, when selecting from a plurality of ranging results, a numerical value based on which the selection is decided. For example, when selecting two ranging results, the two with the highest reliability are selected.
  • points different from the distance measuring device 1 according to the first embodiment will be described regarding the distance measuring device 2 according to the second embodiment.
  • luminance of ranging data itself (which is referred to as "R0").
  • the luminance is a peak position of time-series data after AD conversion, and is the height of the peak when ranging an arrival time of reflected light from a target object.
  • this luminance R0 represents the magnitude of the signal S, indicating certainty of the result.
  • the noise N due to ambient light is also added to simple luminance.
  • an average value of ambient light is determined, and luminance from which the average value of the ambient light is subtracted is more accurate as an index of reliability. Accordingly, to be precise, simple luminance minus ambient light average value is the luminance R0.
  • the luminance R0 of a pixel does not correctly represent certainty. This is because luminance data of other pixels are also added due to averaging. Therefore, an easy method for determining reliability that also takes into consideration luminance of other pixels to be added will be described in detail below.
  • FIG. 20 depicts a block diagram showing an example of a configuration of a measurement section 40 in the distance measuring device 2 according to the second embodiment.
  • the measurement section 40 in the second embodiment includes, for example, an acquisition part 41, an integration part 42, a distance measurement part 43, and a reliability generation part 44. That is, the measurement section 40 according to the second embodiment has a configuration in which the reliability generation part 44 is added to the measurement section 40 in the first embodiment.
  • the reliability generation part 44 stores an integration result transferred from the integration part 42. Based on certainty of integration data based on the reflected light L2 of the outgoing light L1 emitted in the first irradiation direction, the reliability generation part 44 generates or acquires a weight value of the integration data. In the present specification, a "weight value" corresponds to reliability.
  • the integration part 42 transfers first integration data and second integration data to the distance measurement part 43.
  • the distance measurement part 43 acquires third integration data by accumulating the weighted second integration data on the first integration data.
  • the distance measurement part 43 measures a distance from a target object TG for each light detection unit PU by using a light-receiving time T2 calculated based on the third integration data, an emission time T1 received from the acquisition part 41, and reliability generated by the reliability generation part 44.
  • the distance measuring device 2 may calculate reliability based on a certain algorithm, and utilize the calculated reliability.
  • FIG. 21 depicts a schematic diagram showing an example of an area used for calculating reliability within a scanning area SA of the distance measuring device 2 according to the second embodiment.
  • the scanning area SA includes regions AR to IR.
  • Each of the regions AR to IR corresponds to a region irradiated with the outgoing light L1.
  • an area in which a single ranging result can be obtained by the outgoing light L1 being applied is also referred to as a "measurement point".
  • target objects TG1 and TG2 in different positions are included in the scanning area SA.
  • the regions AR, BR, CR, ER, FR, and IR mainly include the target object TG1.
  • the regions DR, GR, and HR mainly include the target object TG2.
  • the regions AR to IR are respectively irradiated with different outgoing light L1.
  • a plurality of regions e.g., the regions AR, DR, and GR
  • a plurality of regions aligned longitudinally are irradiated with single outgoing light L1 at the same time.
  • the region ER is associated with the regions AR, BR, CR, DR, FR, GR, HR, and IR, for example, as targets for performing integration.
  • the distance measurement part 43 accumulates integration data of each of the weighted regions AR, BR, CR, DR, FR, GR, HR, and IR on integration data corresponding to the region ER.
  • similarity with the integration data acquired from the region ER is high in the integration data of each of the regions AR, BR, CR, ER, and IR, and low in the integration data acquired from each of the regions DR, GR, and HR.
  • the reliability generation part 44 increases weighting of the integration data acquired from each of the regions AR, BR, CR, ER, and IR, and decreases weighting of the integration data acquired from each of the regions DR, GR, and HR, to the integration data acquired from the region ER. Then, the distance measurement part 43 accumulates integration data acquired from other regions within the area, if its weight exceeds a threshold value, on the integration data acquired from the region ER.
  • An averaging algorithm selectively accumulates integration data by recognizing reflection data of a target by using intensity of a signal and background light information.
  • FIG. 22 depicts a schematic diagram showing an example of averaging and a calculation flow of reliability of the distance measuring device 2 according to the second embodiment.
  • the signal processor SP performs AD conversion (S10). Digital data obtained by the AD conversion is transferred to the measurement section 40, and the integration part 42 outputs integration data for each measurement point. Then, the reliability generation part 44 performs averaging processing based on an averaging algorithm (S11).
  • the integration part 42 extracts a candidate of a peak from integration data of a current frame.
  • the integration part 42 selects two peaks P1 and P2 as output candidates of accumulated results of the current frame.
  • the reliability generation part 44 calculates reliability R2 based on reliability R2 to be described later for integration data through the averaging algorithm (S12).
  • the distance measurement part 43 selects or rejects the peak of the output candidate based on the reliability R2 added to the integration data (S13).
  • Formula (1) is a function for determining whether distance data of two points are the same by using a threshold k.
  • "i" indicates an identifier (ID) of a measurement point of a target to be ranged.
  • "j" indicates an ID of a measurement point other than the target within the area.
  • p(i, j) indicates, for example, "1” if a distance between a distance value Di and a distance value Dj is equal to or less than "k”, and "0" if it is greater than "k”.
  • the distance value Di corresponds to a ranging result of the measurement point of the target.
  • the distance value Dj corresponds to a ranging result of the measurement point other than the target within a cluster.
  • Formula (2) is a function indicating the size of a cluster.
  • Ni indicates the number of measurement points having the distance value Dj, and a difference from the distance value Di of the measurement point of the target is equal to or less than a predetermined "k", among measurement points within a predetermined range A from the measurement point of the target.
  • R 2 i ⁇ j ⁇ A L j 2 ⁇ p i j 1 / 2
  • Formula (3) is a function that gives reliability R2.
  • Reliability R2i is a value based on a square mean of a signal value Lj of a measurement point considered to have a distance equal to that of the measurement point of the target among other measurement points within the predetermined range A from the measurement point of the target.
  • the signal value Lj corresponds to a measurement point having the distance value Dj, and a difference from the distance value Di of the measurement point of the target is equal to or less than the threshold value k.
  • the reliability generation part 44 calculates the reliability R2 at the measurement point of the target.
  • the reliability R2 of the peak P1 is "122", and the reliability R2 of the peak P2 is "101".
  • the distance measurement part 43 adapts the peak P1 with the higher reliability R2 than that of the peak P2 for measurement of the light-receiving time T2.
  • the distance measuring device 2 according to the second embodiment can calculate such a reliability R2 for a light reception result of each of the light detection units PU1 and PU2.
  • An inter-frame averaging algorithm defines a search window according to a distance and movement measured in the previous frame, and selects an additional output candidate from a return value (peak) detected within a window of a current frame. Then, in the inter-frame averaging algorithm, a peak is selected according to reliability R3 expanded to include information from the previous frame.
  • FIG. 23 depicts a schematic diagram showing an example of a calculation flow of reliability based on an inter-frame averaging algorithm of the distance measuring device 2 according to the second embodiment.
  • the signal processor SP performs AD conversion (S20).
  • Digital data obtained by the AD conversion is transferred to the measurement section 40, and the integration part 42 stores integration data for each measurement point for a plurality of frames.
  • the reliability generation part 44 performs averaging processing based on an inter-frame averaging algorithm (S21).
  • the distance measurement part 43 extracts candidates of peaks from integration data of a current frame in the same manner as the previous averaging algorithm.
  • the distance measurement part 43 selects two peaks P1 and P2 as output candidates of accumulated results of the current frame.
  • the distance measurement part 43 defines search windows W1 to W3 based on the peaks detected in the previous frame.
  • the distance measurement part 43 adds peaks P3 and P4 detected within the search windows W1 to W3 in the current frame. Then, the reliability generation part 44 calculates reliability based on R3 to be described later for integration data through the inter-frame averaging algorithm (S22). After that, the distance measurement part 43 selects or rejects distance data based on the reliability added to the integration data and a threshold value (S23).
  • Formula (4) is a function for calculating the reliability R3.
  • "i" indicates an ID of a measurement point of a target.
  • "a” indicates an ID of a peak extracted in a current frame.
  • R2 i,a 2 corresponds to the reliability R2 in a first averaging algorithm. That is, R2 i,a 2 indicates a pure weight value that a ranging result of the current frame gives to the reliability.
  • RP i,a 2 indicates a weight value added based on a ranging result of the previous frame.
  • Formula (5) is a function for determining whether two distance values are the same.
  • "k s (D 1 )" corresponds to a threshold value in the inter-frame averaging algorithm, and is a function of D 1 .
  • P s (D 1 ,D 2 ) indicates, for example, "1” if a distance between the distance value D 1 and the distance value D 2 is equal to or less than "k s (D 1 )", and "0” if greater than "k s (D 1 )”.
  • R 2 i , a ⁇ j ⁇ A , b ⁇ Ss j L j b N 2 ⁇ Ps D i a N , D j b N 1 / 2
  • Formula (6) is a function for calculating the reliability R2 in the inter-frame averaging algorithm.
  • N indicates an ID of a current frame. That is, “N-1” indicates an ID of the previous frame, and “N-2” indicates an ID of a frame before the previous frame.
  • Ss(j) indicates a set of peaks extracted in the current frame.
  • b indicates an ID of a peak extracted in the previous frame.
  • L(j,b,N) indicates luminance of an ID of a peak extracted in the previous frame, in the current frame.
  • D(i,a,N) indicates a distance value corresponding to a measurement point of a target among peaks extracted in the current frame.
  • D(j,b,N) indicates a distance value of a peak with high reliability in the previous frame among the peaks extracted in the current frame.
  • Formula (7) is a function for defining a search window.
  • the search window is determined by a change amount ⁇ D of distance values acquired in two consecutive frames.
  • ⁇ D represents a difference in distance value between the previous frame and a frame before the previous frame. That is, ⁇ D represents movement (speed) of a target object TG. The lower the speed, the narrower the search window, thereby suppressing an influence of ambient light.
  • k p D 1 , ⁇ D 2 k s D 1 + C 1 ⁇ ⁇ D 2
  • Formula (8) is a function indicating a setting condition of a search window.
  • k s (D 1 ) is a threshold value calculated based on a distance value at a measurement point of a target.
  • C1 x ⁇ D 2 is a numerical value obtained by multiplying a distance value at another measurement point within an area by a predetermined constant C1.
  • Formula (9) is a function for calculating a weight value added based on a ranging result of the previous frame.
  • B indicates a plurality of measurement points within an area in the previous frame.
  • b' indicates an ID of a peak with high reliability extracted in a frame before the previous frame. That is, "D(j,b',N-2)" indicates a distance value of a peak with high reliability among peaks extracted in a frame before the previous frame.
  • the reliability generation part 44 calculates the reliability R3 at the measurement point of the target.
  • the reliabilities R3 of the peaks P1 to P4 are "122", “101", “120”, and "156", respectively.
  • the distance measurement part 43 adapts the peak P4 with the higher reliability R2 than that of the other peaks for measurement of the light-receiving time T2.
  • the distance measuring device 2 according to the second embodiment can calculate such reliability R3 for a light reception result of each of the light detection units PU1 and PU2.
  • FIG. 24 depicts a flowchart showing an example of a measurement operation of the distance measuring device 2 according to the second embodiment. As shown in FIG. 24 , the distance measuring device 2 according to the second embodiment performs continuous scanning (measurement operation) (Start).
  • the reliability generation part 44 calculates reliability RA of the light detector 33A at the measurement point of the target and reliability RB of the light detector 33B (S30).
  • the reliability RA is reliability calculated based on a light reception result by the light detector 33A.
  • the reliability RB is reliability calculated based on a light reception result by the light detector 33B.
  • Rx is reliability integrated in the light detection units PU1 and PU2.
  • C2 is a predetermined constant. In other words, the reliability generation part 44 multiplies the reliability RB of the light detection unit PU2 by a constant and adds to the reliability RA of the light detection unit PU1.
  • the distance measurement part 43 confirms a ranging result of the target based on the calculated reliability Rx (S32). For example, the distance measurement part 43 adapts a peak with the highest reliability Rx from a plurality of peaks extracted from integration data of each of the light detection units PU1 and PU2. The distance measurement part 43 measures the light-receiving time T2 based on the adapted peak, and confirms the ranging result.
  • the constant C2 used in this example is set according to a setting of the light detection unit PU1 and a setting of the light detection unit PU2. For example, in a case where the reliability of the light detection unit PU2 is higher than that of the light detection unit PU1, the constant C2 is set to a numerical value exceeding 1. In addition, in a case where detection of a short-distance target object TG is more important than that of a long-distance target object TG, the constant C2 is set to a large numerical value so as to increase weighting by the reliability of the light detection unit PU2 on the wide-angle side.
  • the distance measuring device 2 adds reliability to integration data obtained from a light reception result. Then, the distance measuring device 2 confirms a ranging result based on the reliability.
  • the reliability By the reliability being used, an S/N is correctly considered quantitatively and data is selected and rejected from among a plurality of distance data obtained from the telephoto side and the wide-angle side.
  • the distance measuring device 2 can suppress selecting an erroneous peak for measurement of the light-receiving time T2. Accordingly, the distance measuring device 2 can increase a success rate of ranging and improve ranging accuracy. In addition, ranging of a long-distance target object TG is greatly affected by noise such as ambient light. Therefore, the distance measuring device 2 can extend the distance that can be ranged by ranging based on the reliability.
  • the distance measuring device 2 can also compare the reliability. This enables the distance measuring device 2 to improve the ranging performance, such as increasing the ranging success rate.
  • the distance measuring device 2 according to the second embodiment can integrate a ranging result corresponding to the light detection unit PU1 and a ranging result corresponding to the light detection unit PU2 based on their respective reliabilities.
  • the distance measuring device 2 according to the second embodiment can reduce the amount of data handled as compared to the first embodiment. For example, reducing the amount of data can reduce the capacity of the RAM, etc. included in the distance measuring device 2, and is effective in reducing the cost of the distance measuring device 2.
  • the integration of the ranging results in the light detection units PU1 and PU2 can suppress a load on a device that handles the ranging results of the distance measuring device 2.
  • the distance measuring device 2 according to the second embodiment can be modified in various ways. In the following, points different from the second embodiment will be described regarding first and second modifications of the second embodiment.
  • FIG. 25 depicts a flowchart showing an example of a measurement operation of a distance measuring device 2A according to the first modification of the second embodiment. As shown in FIG. 25 , the distance measuring device 2A according to the first modification of the second embodiment performs a continuous measurement operation (Start).
  • the reliability generation part 44 calculates the reliability RA of the light detector 33A and the reliability RB of the light detector 33B at the measurement point of the target (S30).
  • the distance measurement part 43 calculates a distance at each measurement point (S40).
  • the distance measurement part 43 adds the reliabilities thereof (S41).
  • the distance measurement part 43 confirms a ranging result based on the added reliabilities (S42).
  • the distance measuring device 2A performs the same processes at a subsequent measurement point.
  • the distance measuring device 2A according to the first modification of the second embodiment updates the reliability of the distance data based on tentatively measured ranging data.
  • the distance measuring device 2A according to the first modification of the second embodiment regards data with close distances to be identical and adds reliabilities thereof.
  • the distance measuring device 2A according to the first modification of the second embodiment can improve reliability of a ranging result.
  • the addition of reliabilities may be performed when the averaging algorithm and the inter-frame averaging algorithm are used.
  • FIG. 26 depicts a flowchart showing an example of a measurement operation of a distance measuring device 2B according to the second modification of the second embodiment. As shown in FIG. 26 , the distance measuring device 2B according to the second modification of the second embodiment performs a continuous measurement operation (Start).
  • the reliability generation part 44 calculates the reliability RA of the light detector 33A and the reliability RB of the light detector 33B at the measurement point of the target (S30). Next, the distance measurement part 43 calculates a distance at each measurement point (S50).
  • the distance measurement part 43 confirms whether or not the calculated ranging data corresponds to a short distance (S51). If it corresponds to the short distance (S51, YES), the distance measurement part 43 multiplies the reliability RA of the light detector 33A on the telephoto side by a constant C2 smaller than 1, or subtracts the constant (S52), and proceeds to the process of S53. On the other hand, if it does not correspond to the short distance (S51, NO), the distance measurement part 43 proceeds to the process of S53 without performing the process of S52. In this way, the reliability RA can be updated based on a ranging result. In the process of S53, the distance measurement part 43 confirms the ranging result based on the appropriately updated reliability (S53). When these processes are completed (End), the distance measuring device 2B performs the same processing at a subsequent measurement point.
  • the distance measuring device 2B updates reliability of distance data based on tentatively measured ranging data. For example, the distance measuring device 2B lowers reliability of ranging data by the light detection unit PU1 on the telephoto side when short-distance ranging data is obtained. Then, based on the updated reliability, the distance measuring device 2B performs integration of the ranging data of the light detection unit PU1 on the telephoto side and the ranging data of the light detection unit PU2 on the wide-angle side.
  • the distance measuring device 2B can improve reliability of a ranging result for a short-distance target object TG.
  • update of reliability may be performed when the averaging algorithm is used.
  • a distance measuring device 3 according to a third embodiment has the same configuration as that of the distance measuring device 1 according to the first embodiment.
  • the distance measuring device 3 according to the third embodiment adjusts a position of an active area AA based on a light reception result. In the following, points different from the distance measuring device 1 according to the first embodiment will be described regarding the distance measuring device 3 according to the third embodiment.
  • FIG. 27 depicts a flowchart showing an example of an adjustment operation of the distance measuring device 3 according to the third embodiment.
  • the distance measuring device 3 according to the third embodiment periodically performs an adjustment operation when performing continuous scanning (measurement operation) (Start).
  • the distance measurement part 43 calculates a measurement result of the light detector 33A at each measurement point (S60). In addition, the distance measurement part 43 calculates a ranging result of the light detector 33B, and confirms the ranging result of the light detector 33B in units of pixels PX (S61). Then, the controller 10 confirms whether or not approximately identical distance data is included in the light detectors 33A and 33B (S62). In the confirmation of the distance data in S62, for example, a ranging result within the same frame and based on the same outgoing light L1 is used.
  • the controller 10 adjusts a position of an active area AA of the light detector 33B to be set in subsequent scanning based on coordinates at which the approximately identical distance data is detected.
  • the distance measuring device 3 finishes the adjustment operation (End).
  • a trigger for the adjustment operation to be performed may be other settings.
  • the distance measuring device 3 may perform the adjustment operation at the time of activation or based on an instruction from other devices.
  • FIG. 28 depicts a schematic diagram showing a specific example of the adjustment operation of the distance measuring device 3 according to the third embodiment.
  • a distance value D1 is measured in an active area AA set in the light detector 33A of the light detection unit PU1.
  • distance values D1, D2, and D3 are measured corresponding to pixels PX1, PX2, and PX3 aligned in the X direction, respectively. That is, the distance measured in the pixel PX1 of the light detector 33B coincides with the distance measured by the light detector 33A.
  • the controller 10 slides the active area AA of the light detector 33B toward the pixel PX1 side when scanning the next frame.
  • the controller 10 compares the plurality of distance data calculated based on respective outputs of the plurality of pixels PX included in the active area AA of the light detector 33B and the distance value calculated based on an output of the active area AA of the light detector 33A. Then, the controller 10 adjusts the position of the active area AA of the light detector 33B in the subsequent scanning so that the position of a pixel PX associated with distance data having approximately the same numerical value as the distance value of the light detector 33B among the plurality of distance data corresponding to the light detector 33B becomes closer to the center of the active area AA of the light detector 33B.
  • the light-receiving positions of the light detection units PU1 and PU2 are each subjected to fixed periodic scanning.
  • the periodic scanning is, for example, a constant speed movement when the emission system is a rotation mirror, and a movement based on a sine function when the emission system is a device such as MEMS.
  • a parameter to be adjusted is its time offset. Further, in order to stabilize the operation, sharp adjustment is not desirable. Therefore, the light-receiving positions of the light detection units PU1 and PU2 are corrected based on results of long-term observation. For example, the number of pixels PX1 of the light detection unit PU2 that match and pixels PX2 that do not match is counted by performing confirmation in units of pixels PX for each measurement as described above continuously for one frame.
  • the time offset is set smaller by one pixel.
  • correction is actually performed if a predetermined threshold value is exceeded as a result of long-term observation, but the description thereof will be omitted.
  • the position of the active area AA in the light detector 33B is adjusted so as to increase a correlation with the ranging result detected by the light detector 33A.
  • a correspondence between a pixel PX included in the active area AA of the light detector 33A and a pixel PX included in the active area AA of the light detector 33B is periodically calibrated.
  • the distance measuring device 3 according to the third embodiment can improve the light-receiving accuracy of the reflected light L2 in the light detection unit PU1 and the light-receiving accuracy of the reflected light L2 in the light detection unit PU2, and ranging results based on respective outputs of the light detection units PU1 and PU2 can be brought close to each other.
  • the distance measuring device 3 according to the third embodiment can handle the ranging result in the light detection unit PU1 and the ranging result in the light detection unit PU2 as single data. That is, the distance measuring device 3 can easily integrate the ranging results of the light detection units PU1 and PU2.
  • the distance measuring device 3 can process the results of both the light detection units PU1 and PU2 in real time (e.g., addition, comparison, and time series integration) without storing the results. In addition, the distance measuring device 3 can complement the respective ranging results of the light detection units PU1 and PU2 with each other.
  • the distance measuring device 3 according to the third embodiment can be modified in various ways. In the following, points different from the third embodiment will be described regarding first to fourth modifications of the third embodiment.
  • “right and left” correspond to one side and the other side along the X direction, respectively.
  • “Upper and lower” correspond to one side and the other side along the Y direction, respectively.
  • FIG. 29 depicts a flowchart showing an example of an adjustment operation of a distance measuring device 3A according to the first modification of the third embodiment.
  • the distance measuring device 3A according to the first modification of the third embodiment periodically performs an adjustment operation when, for example, continuous scanning (measurement operation) is performed (Start).
  • the controller 10 confirms measurement results in the respective active areas AA of the light detectors 33A and 33B at each measurement point in units of pixels PX (S70). Then, the controller 10 confirms whether or not a right and left light amount difference is greater than a predetermined threshold value in the respective active areas AA of the light detectors 33A and 33B (S71). In the process of S71, for example, an amount of light in the pixel PX provided on the left side in the active area AA is compared with an amount of light in the pixel PX provided on the right side in the active area AA.
  • the controller 10 finishes the adjustment operation (End).
  • the controller 10 adjusts a scanning position of the emission section 20 to be set in subsequent scanning in either the rightward or leftward direction, whichever has a larger light amount.
  • the distance measuring device 3A finishes the adjustment operation (End).
  • a timing at which the scanning position is changed may be at least after the adjustment operation.
  • FIG. 30 depicts a schematic diagram showing a specific example of the adjustment operation of the distance measuring device 3A according to the first modification of the third embodiment.
  • FIG. 30 (1) shows positions of the reflected light L2 incident on each light-receiving area DA and the active areas AA before an adjustment operation.
  • FIG. 30 (2) shows positions of the reflected light L2 incident on each light-receiving area DA and the active areas AA after the adjustment operation.
  • the reflected light L2 applied to the active area AA of the light detector 33A and the reflected light L2 applied to the active area AA of the light detector 33B are each offset to the right side of the page.
  • the active area AA receives a large amount of light on the right side of the page, and a small amount of light on the left side of the page.
  • an incident position of the reflected light L2 is adjusted by, for example, the angle of the mirror 25 of the emission section 20 being adjusted.
  • the reflected light L2 applied to the active area AA of the light detector 33A and the reflected light L2 applied to the active area AA of the light detector 33B are each shifted to the left side of the page as compared with those before the adjustment operation.
  • the amount of the reflected light L2 on the right and left in the active area AA of the light detector 33A is uniform, and the amount of the reflected light L2 on the right and left in the active area AA of the light detector 33A is uniform.
  • the distance measuring device 3A can receive the reflected light L2 near the center of the active area AA, and can improve the light-receiving accuracy of the reflected light L2. Accordingly, the distance measuring device 3A can improve reliability of a ranging result.
  • an adjustment amount of the scanning position may be changed according to the magnitude of the right and left light amount difference. Further, the scanning position of the emission section 20 may be adjusted based on an upper and lower light amount difference. In this case, the controller 10 of the distance measuring device 3A compares the upper and lower light amount difference with a predetermined threshold value, and adjusts the scanning position of the emission section 20 in either the upper or lower direction, whichever has a larger light amount. The controller 10 may perform the upper-lower position adjustment of the scanning position and the right-left position adjustment of the scanning position collectively or individually.
  • FIG. 31 depicts a flowchart showing an example of an adjustment operation of a distance measuring device 3B according to a second modification of the third embodiment.
  • the distance measuring device 3B according to the second modification of the third embodiment periodically performs the adjustment operation when, for example, continuous scanning (measurement operation) is performed (Start).
  • the adjustment operation in the second modification of the third embodiment has a configuration in which the process of S72 is replaced with that of S73 in the first modification of the third embodiment.
  • the distance measuring device 3B performs the process of S72.
  • the controller 10 adjusts the positions of the active areas AA of the light detectors 33A and 33B in either the rightward or leftward direction, whichever has a larger light amount. If the right and left light amount difference is equal to or less than the predetermined threshold value (S71, NO) or if the process of S73 is completed, the distance measuring device 3B finishes the adjustment operation (End).
  • FIG. 32 depicts a schematic diagram showing a specific example of the adjustment operation of the distance measuring device 3B according to the second modification of the third embodiment.
  • FIG. 32 (1) shows positions of the reflected light L2 incident on each light-receiving area DA and the active areas AA before an adjustment operation.
  • FIG. 32 (2) shows positions of the reflected light L2 incident on each light-receiving area DA and the active areas AA after the adjustment operation.
  • the reflected light L2 applied to the active area AA of the light detector 33A and the reflected light L2 applied to the active area AA of the light detector 33B are each offset to the right side of the page.
  • the active area AA receives a large amount of light on the right side of the page, and a small amount of light on the left side of the page.
  • the positions of the respective active areas AA of the light detectors 33A and 33B are adjusted by the controller 10.
  • the position of the active area AA of the light detector 33A and the position of the active area AA of the light detector 33B are shifted to the right side of the page as compared with those before the adjustment operation.
  • the amount of the reflected light L2 on the right and left in the active area AA of the light detector 33A is uniform, and the amount of the reflected light L2 on the right and left in the active area AA of the light detector 33B is uniform.
  • the distance measuring device 3B can receive the reflected light L2 near the center of the active area AA, and improve the light-receiving accuracy of the reflected light L2. That is, the distance measuring device 3B can improve reliability of a ranging result.
  • an adjustment amount of the position of the active area AA may be changed according to the magnitude of the right and left light amount difference. Further, the positions of the active areas AA of the light detectors 33A and 33B may be adjusted based on an upper and lower light amount difference. In this case, the controller 10 of the distance measuring device 3B compares the upper and lower light amount difference with a predetermined threshold value, and adjusts the positions of the respective active areas AA of the light detectors 33A and 33B in either the upper or lower direction, whichever has a larger light amount. The controller 10 may perform the upper-lower position adjustment of the active area AA and the right-left position adjustment of the active area AA collectively or individually.
  • FIG. 33 depicts a flowchart showing an example of an adjustment operation of a distance measuring device 3C according to a third modification of the third embodiment.
  • the distance measuring device 3C according to the third modification of the third embodiment periodically performs an adjustment operation when, for example, continuous scanning (measurement operation) is performed (Start).
  • the controller 10 calculates distribution of the light amounts of each of the light detectors 33A and 33B at each measurement point (S80). Then, the controller 10 confirms a correlation of the calculated light amount distributions (S81). In the process of S81, for example, distribution of light amounts of pixels PX that pass through the center in the active area AA and are aligned in the X direction is confirmed. Then, the controller 10 confirms a correlation between distribution of light amounts of pixels PX in the light detector 33A and distribution of light amounts of pixels PX in the light detector 33B.
  • the distance measuring device 3C finishes the adjustment operation (End).
  • the controller 10 adjusts a position of an active area AA of the light detector 33B to be set in subsequent scanning so as to increase the correlation of the light amount distributions between the light detectors 33A and 33B (S83). If the process of S83 is completed, the distance measuring device 3C finishes the adjustment operation (End) .
  • FIG. 34 depicts a schematic diagram showing a specific example of the adjustment operation of the distance measuring device 3C according to the third modification of the third embodiment.
  • FIG. 34 shows a schematic diagram of the light detectors 33A and 33B, and an example of a light amount distribution based on a ranging result of each active area AA.
  • the controller 10 calculates a light amount distribution in the active area AA, for example, along the X direction.
  • a light amount distribution in the active area AA of the light detector 33A has a peak in the pixel PX2
  • a light amount distribution in the active area AA of the light detector 33B has a peak in the pixel PX3.
  • the controller 10 slides the active area AA of the light detector 33B toward the pixel PX1 side when scanning the next frame.
  • the distance measuring device 3C can receive the reflected light L2 near the center of the active area AA, and improve the light-receiving accuracy of the reflected light L2. That is, the distance measuring device 3C can improve reliability of a ranging result.
  • various functions can be used to calculate the correlation of the light amount distributions.
  • a correlation of light amount distributions along the Y direction may be confirmed, and the position of the active area AA may be adjusted along the Y direction.
  • FIG. 35 depicts a flowchart showing an example of an adjustment operation of a distance measuring device 3D according to a fourth modification of the third embodiment.
  • the distance measuring device 3D according to the fourth modification of the third embodiment periodically performs an adjustment operation when, for example, continuous scanning (measurement operation) is performed (Start).
  • the controller 10 calculates a distribution of velocities of each of the light detectors 33A and 33B at each measurement point (S90). Then, the controller 10 confirms a correlation of the calculated velocity distributions (S91). In the process of S91, for example, the velocity distribution of an object detected by pixels PX that pass through the center in the active area AA and are aligned in the X direction is confirmed. Then, the controller 10 confirms a correlation between the velocity distribution of pixels PX in the light detector 33A and the velocity distribution of pixels PX in the light detector 33B.
  • the distance measuring device 3D finishes the adjustment operation (End).
  • the controller 10 adjusts a position of an active area AA of the light detector 33B to be set in subsequent scanning so as to increase the correlation of the velocity distributions between the light detectors 33A and 33B (S93). If the process of S93 is completed, the distance measuring device 3D finishes the adjustment operation (End).
  • FIG. 36 depicts a schematic diagram showing a specific example of the adjustment operation of the distance measuring device 3D according to the fourth modification of the third embodiment.
  • FIG. 36 shows a schematic diagram of the light detectors 33A and 33B, and an example of velocity distribution based on a ranging result of each active area AA.
  • the controller 10 calculates the velocity distribution in the active area AA, for example, along the X direction.
  • a velocity distribution in the active area AA of the light detector 33A has a peak in the pixel PX2
  • a velocity distribution in the active area AA of the light detector 33B has a peak in the pixel PX3.
  • the controller 10 slides the active area AA of the light detector 33B toward the pixel PX1 side when scanning the next frame.
  • the distance measuring device 3D can receive the reflected light L2 near the center of the active area AA, and improve the light-receiving accuracy of the reflected light L2. That is, the distance measuring device 3D can improve reliability of a ranging result.
  • various functions can be used to calculate a correlation of the velocity distributions.
  • a correlation of velocity distributions along the Y direction may be confirmed, and the position of the active area AA may be adjusted along the Y direction.
  • a change in position of the active area AA based on scanning of the outgoing light L1 is programmed as a function of time (e.g., linear or sine wave).
  • the adjustment operation described in the third embodiment and each modification of the third embodiment relates to the fine adjustment of the active area AA.
  • the distance measuring device 3 since the FoV differs among a plurality of light detection units PU1 and PU2, the light-receiving position of the reflected light L2 may deviate from the light-receiving area DA. In this case, the distance measuring device 3 may stop the adjustment operation (adjustment function of the active area AA).
  • a distance measuring device 4 according to a fourth embodiment relates to a configuration example of the mirror 25 in the distance measuring device 1 according to the first embodiment. In the following, points different from the distance measuring device 1 according to the first embodiment will be described regarding the distance measuring device 4 according to the fourth embodiment.
  • FIG. 37 depicts a schematic diagram showing an example of a configuration of the mirror 25 in the distance measuring device 4 according to the fourth embodiment.
  • FIGS. 37 ( 1 ) and 37 (2) show states in which incident angles of laser light on the mirror 25 are different from each other.
  • the mirror 25 according to the fourth embodiment has a configuration in which a part of the outgoing light L1 is not reflected according to the incident angle of the laser light (outgoing light LI).
  • FIG. 37 (1) corresponds to a case where the incident angle of the laser light with respect to the mirror 25 is small. As shown in FIG. 37 (1), when the incident angle of the outgoing light L1 with respect to the mirror 25 is small, an entire irradiation portion IP of the outgoing light L1 is included in a reflection range of the mirror 25. In this case, the mirror 25 reflects the outgoing light L1 in a predetermined direction while minimizing a loss of light energy.
  • FIG. 37 (2) corresponds to a case where the incident angle of the laser light with respect to the mirror 25 is larger than that of FIG. 37 (1).
  • the incident angle of the outgoing light L1 with respect to the mirror 25 is large, a part of the irradiation portion IP of the outgoing light L1 is out of the reflection range of the mirror 25.
  • the mirror 25 reflects the outgoing light L1 in a predetermined direction in a state where a part of the light energy is lost.
  • the state in which the incident angle of the outgoing light L1 with respect to the mirror 25 is small is associated with ranging of a target object TG on the telephoto side.
  • the state in which the incident angle of the outgoing light L1 with respect to the mirror 25 is large is associated with ranging of a target object TG on the wide-angle side. That is, in the ranging of the target object TG on the telephoto side, the loss of light energy of the outgoing light L1 is suppressed. In the ranging of the target object TG on the wide-angle side, a part of the light energy of the outgoing light L1 is lost.
  • the other configurations and operations of the distance measuring device 4 according to the fourth embodiment are the same as those of the distance measuring device 1 according to the first embodiment.
  • Light energy of the outgoing light L1 required for ranging of a target object TG changes according to the distance. For example, as the distance from the target object TG increases, the light energy of the outgoing light L1 decreases. Thus, in order to increase the measurable distance, it is preferable that output of the outgoing light L1 by the emission section 20 be designed to be as large as possible.
  • the scanning area SA includes a telephoto side area that requires long-distance ranging and a wide-angle side area that can be sufficiently ranged by short-distance ranging.
  • Scanning corresponding to the telephoto side area uses, for example, a state in which the incident angle of the outgoing light L1 with respect to the mirror 25 is small.
  • Scanning corresponding to the wide-angle side area uses, for example, a state in which the incident angle of the outgoing light L1 with respect to the mirror 25 is large.
  • the distance measuring device 4 includes the mirror 25 having a small area.
  • the size of the mirror 25 in the fourth embodiment is designed in accordance with a range of a reflecting surface of the mirror 25 to which the outgoing light L1 at the time of ranging on the telephoto side is applied.
  • the reflecting surface of the mirror 25 in the fourth embodiment is designed to include the entire irradiation surface of the outgoing light L1 at the time of ranging on the telephoto side.
  • a part of the irradiation surface of the outgoing light L1 may protrude from the reflecting surface of the mirror 25 depending on the incident angle of the outgoing light L1.
  • the distance measuring device 4 In the distance measuring device 4 according to the fourth embodiment, a loss of the outgoing light L1 due to the reflection of the mirror 25 is suppressed during the ranging on the telephoto side, and long-distance ranging becomes possible. On the other hand, at the time of ranging on the wide-angle side, a part of the outgoing light L1 is not applied to the mirror 25, and a loss of light energy of the outgoing light L1 occurs. However, since a distance necessary to be measured on the wide-angle side is shorter than that on the telephoto side, the energy of the outgoing light L1 required for ranging is smaller than that on the telephoto side. Thus, the distance measuring device 4 can measure a short-distance target object TG on the wide-angle side without any problem even if the outgoing light L1 is lost.
  • the distance measuring device 4 according to the fourth embodiment uses the incident angle with respect to the mirror 25 in a wide range.
  • the distance measuring device 4 according to the fourth embodiment can reduce a blanking period accompanied with rotation of the mirror 25.
  • the controller 10 may control the mirror 25 so that the scanning speed at the time of ranging on the telephoto side is slower than that at the time of ranging on the wide-angle side.
  • the distance measuring device 4 can improve an angle resolution at the time of ranging on the telephoto side, and improve reliability of a ranging result in the distance measuring device 4.
  • a distance measuring device 5 according to a fifth embodiment has the same configuration as that of the distance measuring device 1 according to the first embodiment. Then, the distance measuring device 5 according to the fifth embodiment uses a scanning method that is different from that of the first embodiment. In the following, points different from the distance measuring device 1 according to the first embodiment will be described regarding the distance measuring device 5 according to the fifth embodiment.
  • FIG. 38 depicts a time chart showing an example of a scanning method of an emission section 20 in the distance measuring device 5 according to the fifth embodiment.
  • an ordinate axis of the chart indicates output power with respect to the light source 23.
  • a set of a wide angle portion WP1, a telephoto portion TP, and a wide angle portion WP2 is included in a single scanning area from a left end to a right end of a scanning area SA.
  • the FoV of the light detection unit PU1 on the telephoto side is designed according to the telephoto portion TP, and a focal distance of the light detection unit PU1 is optimized for long-distance ranging.
  • the FoV of the light detection unit PU2 on the wide-angle side is designed according to the wide angle portion WP1, the telephoto portion TP, and the wide angle portion WP2, and a focal distance of the light detection unit PU2 is optimized for short-distance ranging.
  • the controller 10 intermittently inputs pulse signals to the light source 23 at wide intervals during two periods respectively corresponding to the wide angle portions WP1 and WP2.
  • the controller 10 intermittently inputs pulse signals to the light source 23 at narrow intervals during a period corresponding to the telephoto portion TP. That is, the emission interval of the outgoing light L1 is coarse in the wide angle portions WP1 and WP2, and dense in the telephoto portion TP.
  • the distance measuring device 5 according to the fifth embodiment changes the emission interval of the outgoing light L1 according to the scanning position (scanning angle).
  • the distance measuring device 5 realizes a required ranging resolution for each scanning position by changing the emission interval of the outgoing light L1.
  • the distance measuring device 1 when the distance measuring device 1 is mounted on a vehicle, it is preferable that a target object TG in front is detected in a narrow range and with a high resolution. On the other hand, in a scanning area SA, a lower resolution than that in front may be sufficient in an area off the road surface. Further, the number of beams of outgoing light L1 per unit time that can be processed by the measurement operation has a constraint on an upper limit value such as a duty of a laser.
  • the distance measuring device 5 sets the number of beams of outgoing light L1 in the telephoto portion TP to be larger than that of the outgoing light L1 in the wide angle portions WP1 and WP2. In this way, by increasing the number of beams of outgoing light L1 in the telephoto portion TP, the distance measuring device 5 can reduce an angle resolution in the telephoto portion TP. In addition, by increasing the pulse interval in the wide angle portions WP1 and WP2, the distance measuring device 5 can improve the angle resolution of the telephoto portion TP while keeping the constraint on the number of beams of outgoing light L1 to be processed.
  • the distance measuring device 5 can improve the distance that can be ranged without reducing the resolution when the averaging algorithm (SAT: Smart Accumulation Technique) described in the second embodiment is used.
  • SAT Smart Accumulation Technique
  • the distance measuring device 5 according to the fifth embodiment can be modified in various ways. In the following, points different from the fifth embodiment will be described regarding a modification of the fifth embodiment.
  • FIG. 39 depicts a schematic diagram showing an example of a scanning method of an emission section 20 in a distance measuring device 5A according to the modification of the fifth embodiment.
  • the distance measuring device 5A according to the modification of the fifth embodiment sets a pulse width in the wide angle portions WP1 and WP2 to be narrower than a pulse width in the telephoto portion TP.
  • a pulse width of the outgoing light L1 becomes larger, energy of the outgoing light L1 increases.
  • the outgoing light L1 based on a large pulse width is preferable for ranging of a long-distance target object TG.
  • the pulse width of the outgoing light L1 is large, a temporal jitter in ranging becomes large.
  • a light reception result of the light detector 33 tends to be saturated.
  • the distance measuring device 5A according to the modification of the fifth embodiment makes light energy of the outgoing light L1 in the wide angle portions WP1 and WP2 smaller than light energy of the outgoing light L1 in the telephoto portion TP.
  • the distance measuring device 5A according to the modification of the fifth embodiment can reduce the jitter in short-distance ranging in ranging of a target object TG on the wide-angle side, and improve short-distance measurement accuracy.
  • the distance measuring device 5A can suppress the saturation of the light reception result, and in that respect as well, can improve the distance accuracy.
  • the configuration of the light detection unit PU described in the first embodiment may be other configurations. In the following, other configuration examples of the light detection unit PU will be described.
  • the BPFs 31A and 31B may have different characteristics in order to optimize the frequency of the reflected light L2 incident on the light detectors 33A and 33B.
  • the respective frequency bands of the BPFs 31A and 31B may be designed to be high or low based on an operating temperature of the distance measuring device 1. Thereby, the distance measuring device 1 can have a strong resistance to temperature change.
  • the respective frequency bands of the BPFs 31A and 31B may be designed to be wide or narrow in order to expand the dynamic range. Thereby, saturation of light reception results of the light detectors 33A and 33B can be suppressed.
  • the size and shape of the light detector 33A and those of the light detector 33B may be different.
  • the size and shape of a sensor used in the light detection unit PU1 and those of a sensor used in the light detection unit PU2 may be different.
  • the distance measuring device 1 can optimize a resolution of a ranging result by the light detection unit PU1 and a resolution of a ranging result by the light detection unit PU2 by using sensors in different sizes between the light detection units PU1 and PU2.
  • FIG. 40 depicts a plan view showing an example of configurations of pixels PX of two light detectors 33A and 33B in a first configuration example of the light detection unit PU.
  • the light detector 33A includes a pixel PXa including four SPAD units SU.
  • the light detector 33B includes a pixel PXa including nine SPAD units SU.
  • the size of one pixel PX included in the light detector 33A and that of one pixel PX included in the light detector 33B may be different.
  • the number of SPAD units SU included in a pixel PX in the light detector 33A and the number of SPAD units SU included in a pixel PX in the light detector 33B may be different.
  • the number of SPAD units SU included in the pixel PXa and the number of SPAD units SU included in a pixel PXb can be appropriately designed according to the designs of the optical systems 32A and 32B, respectively.
  • the distance measuring device 1 when the distance measuring device 1 is mounted on a vehicle, it is preferable that ranging of a short-distance target object TG be more accurate than ranging of a long-distance target object TG.
  • the number of SPAD units SU included in the pixel PXb is designed to be larger than that of SPAD units SU included in the pixel PXa.
  • the dynamic range of the light detector 33B on the wide-angle side becomes wider than the dynamic range of the light detector 33A on the telephoto side.
  • the first configuration example of the light detection unit PU can suppress saturation of a light reception result when receiving the reflected light L2 from a short-distance target object TG, and improve measurement accuracy at a short distance.
  • FIG. 41 depicts a plan view showing an example of configurations of pixels PX of two light detectors 33A and 33B in a second configuration example of the light detection unit PU.
  • a pixel PXa includes four SPAD units SUa
  • a pixel PXb includes nine SPAD units SUb.
  • a total area of a set of four SPAD units SUa is approximately equal to that of a set of four SPAD units SUb. That is, the size of a SPAD unit SUa is larger than that of a SPAD unit SUb.
  • the dynamic range of the light detector 33B is higher than the dynamic range of the light detector 33A.
  • sensitivity (PDE: Photon Detection Efficiency) of the light detector 33A is slightly higher than sensitivity (PDE) of the light detector 33B.
  • the size of one SPAD included in the light detector 33A and the size of one SPAD included in the light detector 33B may be different.
  • the size of the SPAD unit SUa included in the pixel PXa in the light detector 33A and the size of the SPAD unit SUb included in the pixel PXb in the light detector 33B may be different.
  • the pixel PXa of the light detector 33A and the pixel PXb may be the same or different in size.
  • the size of the SPAD unit SUa and the size of the SPAD unit SUb can be appropriately designed according to the designs of the optical systems 32A and 32B, respectively.
  • the second configuration example of the light detection unit PU can optimize the dynamic range for each light detector 33 in the same manner as in the first configuration example. As a result, the second configuration example of the light detection unit PU can suppress saturation of a light reception result when receiving the reflected light L2 from a short-distance target object TG, and improve measurement accuracy at a short distance. On the other hand, the second configuration example of the light detection unit PU has high sensitivity so that ranging at a longer distance also becomes possible at the same time.
  • FIG. 42 depicts a schematic diagram showing an example of configurations of two light detection units PU1 and PU2 in a third configuration example of the light detection unit PU.
  • an optical axis of the light detection unit PU2 on the wide-angle side is provided to be tilted by an angle " ⁇ " in a light emitter system direction with respect to an optical axis of the light detection unit PU1 on the telephoto side.
  • the light emitter system direction corresponds to a direction from the light receiver 30 to the emission section 20.
  • a parallax based on a non-coaxial optical system decreases with an inclination of " ⁇ " for a short-distance target.
  • the inclination of the optical axis of the light detection unit PU1 and the inclination of the optical axis of the light detection unit PU2 may be different.
  • the parallax can be mitigated by the inclination of the optical axis.
  • the third configuration example of the light detection unit PU can improve detection probability and measurement accuracy of a short-distance target object TG.
  • FIG. 43 depicts a schematic diagram showing an example of configurations of two light detection units PU1 and PU2 in a fourth configuration example of the light detection unit PU.
  • the optical system 32A of the light detection unit PU1 on the telephoto side includes four movable lenses.
  • the optical system 32B of the light detection unit PU2 on the wide-angle side includes two movable lenses.
  • each of the light detection units PU1 and PU2 may be provided with an optical zoom.
  • the number of lenses provided in each of the optical systems 32A and 32B may be other numbers.
  • a plurality of types of lenses such as a concave lens and a convex lens may be combined.
  • the light detection unit PU in which the focal distance is set to be long can increase the distance that can be ranged.
  • the light detection unit PU in which the focal distance is set to be short can reduce the parallax.
  • the optical zoom of each of the light detection units PU1 and PU2 can be controlled according to the situation.
  • the controller 10 can improve detection accuracy of a vehicle in front (target object TG) by setting the focal distance to become longer and the FoV to become narrower as the speed of the vehicle increases. Further, the controller 10 can improve detection accuracy of a person, etc. near the vehicle by setting the focal distance to become shorter and the FoV to become wider as the speed of the vehicle decreases. As described above, in the fourth configuration example of the light detection unit PU, an optimum focal distance can be set for each scene so that the reliability of the distance measuring device 1 can be improved.
  • FIG. 44 depicts a schematic diagram showing an example of configurations of two light detection units PU1 and PU2 in a fifth configuration example of the light detection unit PU.
  • the optical system 32A of the light detection unit PU1 includes cylindrical lenses SL1 and SL2.
  • the mirror 25 of the emission section 20 is a polygon mirror with a tilt, where two-dimensional scanning is assumed. In this way, anisotropy of the lens may be changed for each light detection unit PU.
  • the horizontal field of view angle (FoV in the X direction) of the light detection unit PU1 on the telephoto side is 1/6 of the horizontal field of view angle of the light detection unit PU2 on the wide-angle side
  • the light detectors 33A and 33B are the same in size in the X direction.
  • the sensor size on the vertical side (sensor size in the Y direction) of the light detector 33A of the light detection unit PU1 on the telephoto side is 6 times the sensor size on the vertical side of the light detector 33B of the light detection unit PU2 on the wide-angle side.
  • the optical system 32A includes the cylindrical lenses SL1 and SL2 so as to form an image in a vertically narrow size.
  • the cylindrical lenses SL1 and SL2 have a concave shape and a convex shape, respectively.
  • the FoV in the vertical direction (e.g., the Y direction) of the sensor is adjusted to be the same between the light detection units PU1 and PU2.
  • the sensor size of the light detector 33B can be reduced. That is, in the fifth configuration example of the light detection unit PU, the sizes of the light detectors 33A and 33B can be optimized.
  • the problem of the FoV in the vertical direction or the sensor size described here is also dealt with by the scanning method of a multichannel raster in which a plurality of channels of laser diodes are vertically arranged as described in the first modification of the first embodiment.
  • the fifth configuration example is a solution to the above-described problem, which is different from the first modification of the first embodiment.
  • FIGS. 45 and FIG. 46 depicts a schematic diagram showing an example of configurations of two light detection units PU1 and PU2 in a sixth configuration example of the light detection unit PU.
  • the optical systems 32A and 32B include a lens provided integrally between the light detection units PU1 and PU2. Such a lens is made of, for example, plastic.
  • a light-shielding portion is provided between the light detectors 33A and 33B. The light-shielding portion suppresses incidence of light between the light detection units PU1 and PU2.
  • the sixth configuration example of the light detection unit PU can suppress the cost of the light receiver 30.
  • the sixth configuration example and the fifth configuration example of the light detection unit PU may be combined.
  • either one of the light detection units PU1 and PU2 may include an anisotropic optical system.
  • the cylindrical lenses SL1 (e.g., a convex shape) and SL2 (e.g., a concave shape) are added to the optical system 32B of the light detection unit PU2 on the wide-angle side.
  • the combination of the sixth configuration example and the fifth configuration example of the light detection unit PU can optimize the sizes of the light detectors 33A and 33B.
  • the controller 10 notifies the measurement section 40 of the emission time T1 of the outgoing light L1
  • the outgoing light L1 may be dispersed within the emission section 20, and the emission time T1 may be set based on a time at which the dispersed outgoing light L1 is detected by the sensor provided in the light receiver 30. In this case, the emission time T1 is reported from the light receiver 30 to the measurement section 40.
  • the second embodiment can be combined with any one of the third to fifth embodiments.
  • the third embodiment can be combined with any one of the fourth and fifth embodiments.
  • three or more embodiments may be combined together.
  • the distance measuring device 1 in which a plurality of embodiments are combined can obtain the effect of each of the combined embodiments.
  • the light receiver 30 may include three or more light detection units PU that are optimized for distances different from one another.
  • the first light detection unit PU is optimized for a long distance
  • the second light detection unit PU is optimized for a short distance
  • the third light detection unit PU is optimized for an extremely short distance.
  • the distance measuring device 1 can improve measurement accuracy of an extremely short distance to a short distance where a parallax and a defocus are likely to occur.
  • the distance measuring device 1 can be combined with each of the second to fifth embodiments and the configuration examples of the light detection unit PU.
  • the category of each configuration of the distance measuring device 1 may be other categories.
  • the measurement section 40 may be other categories as long as it can realize the operations described in the above-described embodiments.
  • the CPU included in the controller 10 may be other circuits.
  • an MPU Micro Processing Unit
  • each of the processes described in each embodiment may be realized by dedicated hardware. Processes executed by software and processes executed by hardware may be mixed, or either one of them may exist.
  • the order of processes may be interchanged as far as possible, and other processes may be added.
  • the "active area AA" may also be referred to as a light-receiving area.
  • the outgoing light L1 emitted by the light source 23 into which a pulse signal is input based on control of the controller 10 may also be referred to as a pulse signal.
  • a “pulse width” is, for example, calculated by a half-value width of a target pulse signal.
  • the “emission section 20" may also be referred to as a "light emitter”.
  • a "light reception result of the light detector 33" may also be referred to as a digital signal including a light reception result of the reflected light L2.
  • a “bottom portion of a digital signal” indicates floor noise included in the digital signal.
  • a “value of a bottom portion” is, for example, a time average value of luminance at a single measurement time. The “single measurement time” corresponds to a single sampling period.
  • a “value of a portion protruding from a bottom portion” indicates, for example, luminance of a protruding portion corresponding to a light reception result of the reflected light L2 of a digital signal including the light reception result of the reflected light L2.
  • a “peak of a signal” indicates a portion with the highest luminance in a protruding portion from a bottom portion of a digital signal including a light reception result.
  • a level “H” voltage is a voltage at which an N-type transistor enters an ON state when said voltage is applied to its gate, and a P-type transistor enters an OFF state when said voltage is applied to its gate.
  • a level “L” voltage is a voltage at which an N-type transistor enters an OFF state when said voltage is applied to its gate, and a P-type transistor enters an ON state when said voltage is applied to its gate.
  • the term "couple/connect” refers to electrical coupling, and does not exclude intervention of, for example, another element.
  • an "ON state” refers to a state in which the gate of a relevant transistor has a voltage equal to or greater than a threshold voltage of the transistor being applied.
  • An “OFF state” refers to a state in which the gate of a relevant transistor has a voltage below a threshold voltage of the transistor being applied, and does not exclude, for example, a state in which a minute electric current such as a leakage current of the transistor flows.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Measurement Of Optical Distance (AREA)
EP21161433.4A 2020-09-18 2021-03-09 Entfernungsmessvorrichtung Pending EP3971608A1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2020157625A JP7423485B2 (ja) 2020-09-18 2020-09-18 距離計測装置

Publications (1)

Publication Number Publication Date
EP3971608A1 true EP3971608A1 (de) 2022-03-23

Family

ID=74867433

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21161433.4A Pending EP3971608A1 (de) 2020-09-18 2021-03-09 Entfernungsmessvorrichtung

Country Status (3)

Country Link
US (1) US11693114B2 (de)
EP (1) EP3971608A1 (de)
JP (1) JP7423485B2 (de)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4253669A1 (de) * 2022-03-29 2023-10-04 MOBA Mobile Automation AG Vermessungssystem für eine bau- und arbeitsmaschine

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114910888B (zh) * 2022-04-21 2023-04-07 北京一径科技有限公司 扫描器异常检测方法及装置、激光雷达及存储介质
CN117213919B (zh) * 2023-11-07 2024-04-02 山东大学 应用于轨道式双车道扦样机的粮车停放定位方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120242972A1 (en) * 2011-03-25 2012-09-27 Jay Young Wee Vehicular Ranging System and Method of Operation
US20180003803A1 (en) * 2016-06-29 2018-01-04 Apple Inc. Optical systems for remote sensing receivers
US20180231660A1 (en) * 2014-04-07 2018-08-16 Samsung Electronics Co., Ltd. High resolution, high frame rate, low power image sensor

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010107448A (ja) 2008-10-31 2010-05-13 Toyota Motor Corp 距離測定装置
DE102009029372A1 (de) 2009-09-11 2011-03-24 Robert Bosch Gmbh Messvorrichtung zur Messung einer Entfernung zwischen der Messvorrichtung und einem Zielobjekt mit Hilfe optischer Messstrahlung
DE102011107645A1 (de) * 2011-07-12 2013-01-17 Leica Microsystems Cms Gmbh Vorrichtung und Verfahren zum Detektieren von Licht
JP6103179B2 (ja) 2012-09-13 2017-03-29 株式会社リコー 距離測定装置
FR3043797A1 (de) * 2015-11-16 2017-05-19 Stmicroelectronics (Grenoble 2) Sas
WO2017112416A1 (en) 2015-12-20 2017-06-29 Apple Inc. Light detection and ranging sensor
US11040649B2 (en) 2015-12-21 2021-06-22 Koito Manufacturing Co., Ltd. Vehicular sensor and vehicle provided with same
JP2017122673A (ja) 2016-01-08 2017-07-13 富士通株式会社 レーザ距離測定装置、測定方法及び測定プログラム
JP2017208595A (ja) 2016-05-16 2017-11-24 コニカミノルタ株式会社 監視システム
DE102016213348A1 (de) 2016-07-21 2018-01-25 Robert Bosch Gmbh Optische Anordnung für ein LiDAR-System, LiDAR-System und Arbeitsvorrichtung
US20190146067A1 (en) 2017-11-14 2019-05-16 Continental Automotive Systems, Inc. Flash lidar sensor assembly
JP7013926B2 (ja) 2018-02-23 2022-02-01 株式会社デンソー 光学的測距装置およびその方法
JP7111497B2 (ja) 2018-04-17 2022-08-02 株式会社東芝 画像処理装置、画像処理方法、距離計測装置、及び距離計測システム
JP2019191126A (ja) 2018-04-27 2019-10-31 シャープ株式会社 光レーダ装置
JP7039411B2 (ja) 2018-07-20 2022-03-22 株式会社東芝 光検出器、光検出システム、ライダー装置及び車
US11644549B2 (en) * 2019-03-06 2023-05-09 The University Court Of The University Of Edinburgh Extended dynamic range and reduced power imaging for LIDAR detector arrays
JP7273565B2 (ja) 2019-03-19 2023-05-15 株式会社東芝 受光装置及び距離測定装置
JP7434002B2 (ja) 2020-03-17 2024-02-20 株式会社東芝 光検出器及び距離計測装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120242972A1 (en) * 2011-03-25 2012-09-27 Jay Young Wee Vehicular Ranging System and Method of Operation
US20180231660A1 (en) * 2014-04-07 2018-08-16 Samsung Electronics Co., Ltd. High resolution, high frame rate, low power image sensor
US20180003803A1 (en) * 2016-06-29 2018-01-04 Apple Inc. Optical systems for remote sensing receivers

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4253669A1 (de) * 2022-03-29 2023-10-04 MOBA Mobile Automation AG Vermessungssystem für eine bau- und arbeitsmaschine

Also Published As

Publication number Publication date
US11693114B2 (en) 2023-07-04
US20220091261A1 (en) 2022-03-24
JP2022051249A (ja) 2022-03-31
JP7423485B2 (ja) 2024-01-29

Similar Documents

Publication Publication Date Title
EP3971608A1 (de) Entfernungsmessvorrichtung
US20240045038A1 (en) Noise Adaptive Solid-State LIDAR System
US8908157B2 (en) Optical distance measuring device
US11852727B2 (en) Time-of-flight sensing using an addressable array of emitters
KR102409952B1 (ko) 고해상도, 고프레임률, 저전력 이미지 센서
JP2020073901A (ja) 光検出測距センサ
US10928492B2 (en) Management of histogram memory for a single-photon avalanche diode detector
US20140078491A1 (en) Measuring Apparatus and Measuring Device for Measuring a Target Object in a Multidimensional Manner
US10422862B2 (en) LiDAR apparatus
US20180164414A1 (en) LiDAR Apparatus
US20210063575A1 (en) Distance measuring device, distance measuring method, and speed measuring device
US20220091262A1 (en) Distance measuring device
CN115856933A (zh) 高通量光子计数激光雷达成像装置及方法
US20210302551A1 (en) Light detector and distance measuring device
US20210293957A1 (en) Light detector and distance measuring device
Chen et al. Integration time and time-bin width in ranging histograms for a photon-counting LiDAR
JP7433819B2 (ja) 距離計測装置、及び距離計測方法
Jahromi et al. Solid-state block-based pulsed laser illuminator for single-photon avalanche diode detection-based time-of-flight 3D range imaging
EP3964861A1 (de) Lichtdetektor und entfernungsmessvorrichtung
US11659290B2 (en) Light detection system
US20220082671A1 (en) Distance measurement device
US12007479B2 (en) Distance measuring device and distance measuring method
US20220026571A1 (en) Light detection system
US20220113407A1 (en) Dynamic signal control in flash lidar
JP2024015607A (ja) 測距装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210309

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR