EP3848726A1 - Module, appareil et procédé de mesure de distance à laser, et plate-forme mobile - Google Patents

Module, appareil et procédé de mesure de distance à laser, et plate-forme mobile Download PDF

Info

Publication number
EP3848726A1
EP3848726A1 EP18932498.1A EP18932498A EP3848726A1 EP 3848726 A1 EP3848726 A1 EP 3848726A1 EP 18932498 A EP18932498 A EP 18932498A EP 3848726 A1 EP3848726 A1 EP 3848726A1
Authority
EP
European Patent Office
Prior art keywords
circuit
laser
distance measurement
laser pulse
laser distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18932498.1A
Other languages
German (de)
English (en)
Other versions
EP3848726A4 (fr
EP3848726B1 (fr
Inventor
Xiang Liu
Xiaoping HONG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of EP3848726A1 publication Critical patent/EP3848726A1/fr
Publication of EP3848726A4 publication Critical patent/EP3848726A4/fr
Application granted granted Critical
Publication of EP3848726B1 publication Critical patent/EP3848726B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/484—Transmitters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/933—Lidar systems specially adapted for specific applications for anti-collision purposes of aircraft or spacecraft
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4811—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
    • G01S7/4812—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver transmitted and received beams following a coaxial path
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
    • G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/4861—Circuits for detection, sampling, integration or read-out

Definitions

  • the present disclosure relates to the field of laser distance measurement and, more particularly, to a laser distance measurement device, apparatus, and method, and a mobile platform.
  • laser pulse sequences with a plurality of emission paths can be emitted to ensure coverage of a detected object.
  • the present disclosure provides a laser distance measurement device, apparatus, method, and an unmanned aerial vehicle, to reduce the power consumption of the laser distance measurement, reduce the cost of the laser distance measurement, and reduce the size of the distance measurement device and/or apparatus.
  • the laser distance measurement device includes a transmission circuit, a receiving circuit, a sampling circuit, and a processing circuit.
  • the transmission circuit is configured to emit at least two laser pulse sequences, wherein the at least two laser pulse sequences have different emission paths and the at least two laser pulse sequences are emitted at different times.
  • the receiving circuit is configured to receive each laser pulse sequence reflected by an object to be detected and perform photoelectric conversion on each laser pulse sequence to obtain each electrical signal of at least two electrical signals.
  • the sampling circuit is configured to sample each electrical signal to obtain sampling results.
  • the processing circuit is configured to determine a distance to the object to be detected according to the sampling results.
  • Drive signals in the transmission circuit that correspond to the at least two laser pulse sequences share at least one device of the receiving circuit, and/or the at least two electrical signals share at least one of: at least one device of the receiving circuit, at least one device of the sampling circuit, and at least one device of the processing circuit.
  • Another aspect of the present disclosure provides a laser distance measurement apparatus including a distance measurement device provided by the previous aspect of the present disclosure.
  • Another aspect of the present disclosure provides a laser distance measurement method, including using a laser distance measurement apparatus provided by the previous aspect of the present disclosure to measure a distance between the laser distance measurement apparatus and an object to be detected.
  • the method includes: constructing at least two detection channels of a laser distance measurement apparatus, and measuring the distance between the laser distance measurement apparatus and an object to be detected using the at least two detection channels.
  • Each detection channel includes a light source, a photoelectric conversion device, a sampling circuit, and a processing circuit.
  • the light source is used to emit a laser pulse sequence.
  • the photoelectric conversion device is used to receive the laser pulse sequence reflected by the object to be detected, and perform photoelectric conversion on the laser pulse sequence to obtain an electrical signal.
  • the sampling circuit is used to sample the one electrical signal respectively to obtain the sampling result.
  • the processing circuit is used to determine the distance between the laser distance measurement apparatus and the detected object based on the sampling result.
  • the laser pulse sequences emitted by the at least two detection channels have different emission paths, and the at least two detection channels emit laser pulse sequences at different times respectively.
  • One or more devices in the two detection channels except for the light source and the photoelectric conversion device is multiplexed in a time-sharing manner.
  • the mobile platform includes an unmanned aerial vehicle, an automobile, or a robot.
  • the automobile includes a self-driving automobile or a semi-self-driving automobile.
  • each of the at least two channels includes a circuit corresponding to a laser pulse sequence with an emission path
  • at least one device is multiplexed.
  • the power consumption caused by laser distance measurement can be reduced, and the cost and size of the laser distance measurement device or apparatus can be reduced.
  • the complexity of circuits of the laser distance measurement device or apparatus can also be reduced.
  • Laser distance measurement uses a laser pulse to measure a distance between a laser distance measurement apparatus and a detected object. Further, a position of the detected object relative to the laser distance measurement apparatus can also be detected.
  • the laser distance measurement apparatus measures a time of light propagation from the laser distance measurement apparatus to the detected object, that is, the time-of-flight (TOF), to detect the distance between the laser distance measurement apparatus and the detected object.
  • TOF time-of-flight
  • the distance is 150 m.
  • the laser distance measurement apparatus may include a radar such as a laser radar.
  • the laser distance measurement apparatus is a perception system for the outside world, and may acquire the three-dimensional stereo information of the outside world, and may be no longer limited to the plane perception of the outside world such as a camera.
  • the principle is to actively transmit a laser pulse sequence to the outside, detect the reflected pulse sequence, determine the distance to the detected object according to the time difference between the transmission and reception, and combine the transmission angle information of the light pulse to reconstruct and obtain the three-dimensional depth information.
  • the laser distance measurement apparatus 100 in FIG. 1 will be used to illustrate the working flow of laser distance measurement.
  • the laser distance measurement apparatus 100 includes a transmission circuit 110, a receiving circuit 120, a sampling circuit 130, and a processing circuit 140.
  • the transmission circuit 110 may emit a laser pulse sequence.
  • the receiving circuit 120 may receive the laser pulse sequence reflected by the object to be detected, perform photoelectric conversion on the laser pulse sequence to obtain an electrical signal, and then process the electrical signal to output the electrical signal to the sampling circuit 130.
  • the sampling circuit 130 may sample the electrical signal to obtain a sampling result.
  • the processing circuit 140 may determine the distance between the laser distance measuring apparatus 100 and the object to be detected based on the sampling result of the sampling circuit 130.
  • the laser distance measuring apparatus 100 further includes a control circuit 150 configured to control other circuits, for example, to control the working time of each circuit and set parameters of each circuit.
  • the laser distance measurement apparatus includes one transmission circuit, one receiving circuit, one sampling circuit, and one processing circuit, is used as an example to illustrate the present disclosure, and should not limit the scopes of the present disclosure.
  • the laser distance measurement apparatus may include a plurality of transmission circuits, a plurality of receiving circuits, a plurality of sample circuits, and a plurality of processing circuits. It should be noted that plurality mentioned in the present disclosure includes the scenario of two.
  • the laser distance measurement apparatus 100 may further include a scanning device 160.
  • the scanning device 160 may be configured to cause the laser pulse sequence emitted from the transmission circuit to change a propagation direction and then emit. At least a portion of the light beam reflected by the object to be detected may pass through the scanning device 160 to enter the receiving circuit.
  • a device including the transmission circuit 110, the receiving circuit 120, the sampling circuit 130, and the processing circuit 140, or a device including the transmission circuit 110, the receiving circuit 120, the sampling circuit 130, the processing circuit 140, and the control circuit 150 may be referred to as a laser distance measurement device.
  • the laser distance measurement device 150 maybe independent of other devices, such as the scanning device 160.
  • the transmission circuit may only include one emitting light source, and the laser pulse sequence emitted by the emitting light source may be adjusted by an optical path changing element (such as a galvanometer) to change the emission path to form the laser pulse sequence with the plurality of emission paths at different times.
  • the laser pulse sequence with the plurality of emission paths may be non-parallel.
  • the transmission circuit may include a plurality of emitting light sources.
  • the plurality of emitting light sources may emit laser pulse sequences along different emission paths respectively.
  • the different emission paths may be different emission positions and/or different emission directions.
  • the multiple laser pulse sequences respectively emitted by the plurality of emitting light sources may be parallel or non-parallel.
  • a laser distance measurement apparatus (or device) that emits along a single emission path may be called a single-thread or single-channel laser distance measurement apparatus (or device), and a laser distance measurement apparatus (or device) that emits along a plurality of emission paths may be called a multiple-thread or multi-channel laser distance measurement apparatus (or device).
  • the measurement performed by a single-thread or single-channel laser distance measurement apparatus (or device) may be called a single-thread or single-channel measurement
  • the measurement performed by a multi-thread or multi-channel laser distance measurement apparatus (or device) may be called a multi-thread or multi-channel measurement.
  • the circuit corresponding to the laser pulse sequence of an emission path may be called a single channel (the channel may be also be called a measurement channel) or a single thread.
  • the circuit corresponding to the laser pulse sequences with a plurality of emission paths may be called multi-channel or multi-thread.
  • a transmission circuit may emit a laser pulse sequence along an emission path; a receiving circuit may receive the laser pulse sequence with the emission path after the laser pulse sequence is reflected by the object to be detected and perform photoelectric conversion on the laser pulse sequence to obtain an electrical signal, or further process the electrical signal; a sampling circuit may sample the electrical signal; and a processing circuit may calculate the distance between the object to be detected and the laser distance measurement apparatus based on the sampling result.
  • a transmission circuit nay emit a laser pulse sequence (that is, a laser pulse sequence with an emission path), and the result of this measurement may be determined after a sequential process of the receiving circuit, the sampling circuit, and the processing circuit.
  • the time required from emitting the laser pulse sequence to calculating the distance by the calculation circuit may be t.
  • a specific magnitude of t may depend on the distance between the object detected by the laser pulse sequence and the laser distance measuring apparatus. When the distance is farther, t is larger. When the object is farther from the laser distance measuring apparatus, the light signal reflected by the object is weaker.
  • the duty cycle may be greater than t0. In some embodiment, the duty cycle may be at least 5 times greater than t0. In some other embodiments, the duty cycle may be at least 10 times greater than t0. In some other embodiments, the duty cycle may be 15 times greater than t0.
  • the transmission circuit emits a laser pulse sequence at time a1.
  • the calculation result is obtained at time b1, and the duration between time a1 and time b1 is t1.
  • the transmission circuit emits a laser pulse sequence at time a2.
  • the calculation result is obtained at time b2, and the duration between time a2 and time b2 is t2.
  • the transmission circuit emits a laser pulse sequence at time a3.
  • the calculation result is obtained at the time b3, and a duration between the time a3 and the time b3 is t3.
  • the duration of tl, t2, and t3 are respectively less than or equal to the above t0; a2 is later than b1, a3 is later than b2; the duration between a1 and a2 and the duration between a2 and a3 are the same duration P, and the duration P is the duty cycle mentioned above.
  • a point cloud density and a point cloud coverage are sufficiently high.
  • the laser radar with only one emission path may have limited point cloud coverage in a short time period.
  • a scanning trajectory of each laser pulse sequence emitted by the laser radar with a plurality of emission paths may be different, and each path may compensate for each other.
  • the point cloud coverage may be improved effectively in a short time period.
  • the laser pulse sequences may be emitted from different directions or different positions.
  • each measurement may be represented by a point in the three-dimensional space.
  • a plurality of points may be combined to represent an object distribution map in the three-dimensional space, which may be called a point cloud.
  • a point cloud in 0.1 seconds may be used as a picture, and a plurality of pictures may be obtained in a plurality of successive 0.1 s.
  • the plurality of pictures may be combined to form a video to be displayed.
  • the formed video in the three-dimensional space is 10 frames per second.
  • the working mode of each channel of the multi-channel laser distance measurement apparatus may be same as that of the single-channel laser distance measurement apparatus described above. Multiple channels may be independent of each other.
  • a time point at which the transmission circuit of each channel respectively emits the laser pulse sequence may be same.
  • each channel may work in sequence.
  • An emission time interval between two adjacent laser pulses may be called an emission period.
  • the transmitter circuit of the second channel after the transmission circuit of the first channel emits a laser pulse sequence, the transmitter circuit of the second channel emits laser pulses after an interval of T, the transmitter circuit of the third channel emits laser pulses after an interval of T, and then the transmitter circuit of the first channel emits laser pulses after an interval of T.
  • the optical signal reflected by the farthest object that can be detected may be processed by the receiving circuit, the sampling circuit and the processing circuit in the next time period T.
  • the period between the start time of the laser pulse sequence emitted by the transmission circuit and the time when the calculation circuit completes the calculation may be referred to as the duty cycle of the channel.
  • the transmitter circuit of the channel 1 emits a laser pulse sequence at time a1.
  • the sampling circuit, and the processing circuit of the channel 1 the calculation result is obtained at time b1.
  • a duration between and the time a1 and the time b1 is t1.
  • the transmitter circuit of the channel 2 emits a laser pulse sequence at time a2, and the laser pulse sequence is processed by the receiver circuit, the sampling circuit and the processing circuit of channel 2 in turn, and the calculation result is obtained at time b2.
  • a duration between the time a2 and the time b2 is t2.
  • the transmitter circuit of the channel 3 emits a laser pulse sequence at time a3, and the laser pulse sequence is processed by the receiving circuit, the sampling circuit, and the processing circuit of the channel 3 in turn, and the calculation result is obtained at time b3.
  • a duration between the time a3 and the time b3 is t3.
  • the transmitter circuit of channel 1 emits a laser pulse sequence at time a4, and the laser pulse sequence is processed by the receiver circuit, sampling circuit and processing circuit of the channel 1 in turn, and the calculation result is obtained at time b4.
  • a duration between the time a4 and the time b4 is t4.
  • a2 is later than b1, a3 is later than b2, and a4 is later than b3.
  • the duration between a1 and a2, the duration between a2 and a3, and the duration between a3 and a4 are all the same duration T.
  • the duration of a3 and a4 may not be equal to T.
  • the duration may be equal to P-2T.
  • different channels may share at least one element and/or at least one device in at least one of the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit.
  • the transmission circuit may include a laser diode, a switch device, and a driver.
  • the laser diode may be a diode such as a positive-intrinsic-negative (PIN) photodiode.
  • the laser diode may emit a laser pulse sequence with a specific wavelength.
  • the laser diode may be referred to as a light source or an emission light source.
  • the switch device may be a switch device of the laser diode, and may be connected with the laser diode to control on or off of the laser diode.
  • the laser diode When the laser diode is in the on state, it may emit a laser pulse sequence.
  • the laser diode When the laser diode is in the off state, it may not emit a laser pulse sequence.
  • the driver may be connected with the switch device for driving the switch device.
  • the signal for the driver to drive the switch device and the signal for the switch device to control the laser diode are both referred to as drive signal.
  • the signal may also have other names in various embodiments, and the present disclosure has no limits on this.
  • the switch device may be a metal-oxide-semiconductor field-effect (MOS) transistor, and the driver may be a MOS driver.
  • MOS metal-oxide-semiconductor field-effect
  • the transmission circuit includes a MOS driver 210, a MOS transistor 220, and a laser diode 230.
  • the MOS driver 210 may be configured to drive the MOS transistor 220, and the MOS transistor 220 may be configured to control on or off of the laser diode 230.
  • the switch device may be a Gallium Nitride (GaN) transistor and the driver may be a GaN driver.
  • GaN Gallium Nitride
  • the transmission circuit includes at least two laser diodes, and different laser diodes can emit laser pulse sequences with different emission paths, to realize the emission of at least two laser pulse sequences.
  • the drive signals corresponding to the at least two laser pulse sequences may share at least one of devices other than the laser diodes included in the transmission circuit.
  • at least one of a switch device and a driver may be multiplexed.
  • the drive signals corresponding to at least two laser pulse sequences may share at least one of devices other than the laser diodes, may be understood as: the at least two measurement channels may share at least one of devices other than the laser diodes in the transmission circuit.
  • the drive signals corresponding to the at least two laser pulse sequences may share the switch device while not sharing the driver, or share the driver while not sharing the switch device, or share both the switch device and driver.
  • the transmission circuit may include a driver and at least two switch devices.
  • the at least two switch devices may be respectively driven by the one driver, and each switch device of the at least two switch device may control corresponding one of the at least two laser diodes corresponding to the at least two laser pulse sequences respectively (that is, the number of MOS transistors is equal to the number of laser diodes, and there is a one-to-one correspondence between MOS transistors and laser diodes).
  • the one driver is in time-sharing connection with the at least two switch devices via a switch or a multiplexer.
  • the at least two MOS transistors 220 may be driven by a MOS driver 210 in a time-sharing manner.
  • the at least two MOS transistors 220 may be connected to the MOS driver 210 via switches 240, and each MOS transistor of the at least two MOS transistors 220 may control on or off of corresponding one of the laser diodes 230.
  • the switches 240 is disposed between the MOS driver 210 and the MOS transistors 220. In some other embodiments, the switches 240 may be disposed between the MOS transistors 220 and the laser diodes 230. In some other embodiments, a portion of the switches may be disposed between the MOS driver 210 and the MOS transistors 220, and a remaining portion of the switches 240 may be disposed between the MOS transistors 220 and the laser diodes 230. In one embodiment illustrated in FIG. 5 , the at least two switches 240 may be realized by one multiplexer.
  • Cost, power consumption, and size of switches or multiplexers may be smaller than MOS drivers. Therefore, in the measurement with at least two channels, using a MOS driver to drive the MOS transistors in a time-sharing manner via the switches or multiplexers, cost, power consumption, and size of the laser distance measurement apparatus may be reduced.
  • the transmission circuit may include one driver and on switch device.
  • the drive signals in the transmission circuit that correspond to the at least two laser pulse sequences may share the one driver and the one switch device.
  • the one switch device may control at least two laser diodes corresponding to the at least two laser pulse sequences via switches or multiplexers.
  • a MOS driver 210 drives a MOS transistor 220, and the one MOS driver 210 is connected to at least two laser diode 230 in a time-sharing manner via switches 240, to achieve control of on or off of the at least two laser diodes in a time-sharing manner.
  • the at least two switches 240 is realized by one multiplexer.
  • Costs, power consumptions, and sizes of switches or multiplexers may be smaller than MOS drivers. Therefore, the measurements with at least two channels may share one MOS driver and one MOS transistor, to reduce cost, power consumption, and size of the laser distance measurement apparatus.
  • the receiving circuit Before multiplexing the devices in the receiving circuit is described, the receiving circuit will be described first.
  • the receiving circuit may include a photoelectric conversion device, and the photoelectric conversion device may convert the detected laser pulse sequence into an electrical signal.
  • the photoelectric conversion device may include a PIN diode or an avalanche photodiode.
  • the receiving circuit may include a signal processor, and the signal processor may be configured to amplify and/or filter the electrical signal.
  • the signal processor may include an amplification circuit that may amplify the electrical signal.
  • the amplification circuit may perform at least one stage of amplification, and the number of stages of amplification may be determined according to the devices of the sampling circuit.
  • an amplification circuit with one stage or at least two stages may be used for amplification.
  • ADC Analog-to-Digital Converter
  • the devices in the sampling circuit include signal comparators (for example, analog comparators (COMP) for converting electrical signal into digital signal) and time-to-data converters (TDC), an amplification circuit with two or more stages may be used for amplification.
  • the TDC may be a TDC chip, or a TDC circuit based on programmable devices such as Field-Programmable Gate Array (FPGA).
  • FPGA Field-Programmable Gate Array
  • the above-mentioned signal processor may include a first-stage amplification circuit and a second stage amplification circuit.
  • the first-stage amplification circuit may be used to amplify the electrical signal output from the photoelectric conversion device, and the second-stage amplification circuit may be used to further amplify the electrical signal from the first-stage amplification circuit.
  • the first-stage amplification circuit may include a transimpedance amplifier
  • the second-stage amplifying may include other types of signal amplifiers.
  • the signal processor may include other signal processors other than the amplification circuits, such as a filter circuit for filtering the electrical signal.
  • the transmission circuit may include an amplification circuit but no other signal processors, or it may include other signal processors but no the amplification circuit, or it may include other signal processors as well as the amplification circuit.
  • the receiving circuit includes APD 310, a transimpedance amplifier 320, other amplification circuits 330 as the second-stage amplifier, and other signal processors 340.
  • the receiving channel may include at least two photoelectric conversion devices, and each photoelectric conversion device may be used to receive the laser pulse sequence of a corresponding one of the at least two channels and convert the received laser pulse sequence into an electrical signal.
  • the at least two photoelectric conversion devices may work in a time-sharing manner, that is, different laser pulse sequences in the at least two laser pulse sequences may arrive at the photoelectric conversion devices at different times.
  • At least two electrical signals may share at least one device of the receiving circuit other than the photoelectric conversion device
  • At least two electrical signals may share at least one device included in the signal processor used to achieve amplification and/or filtering.
  • the at least two electrical signals may share an amplification circuit and/or a filter circuit.
  • the signal processor may include a first-stage amplification circuit and a second-stage amplification circuit.
  • the at least two electrical signals may share at least one device other than the photoelectric conversion device and the first-stage amplification circuit in the receiving circuit.
  • the first-stage amplification circuit is at the front end of the receiving circuit (for example, the first-stage amplification circuit is directly connected to the photoelectric conversion device) and is very sensitive to parasitic capacitance and wiring length. If the first-stage amplification circuit is multiplexed, a switch may be needed to switch these sensor signal, and capacitance brought by the switch and the long-distance wiring may deteriorate the noise parameters and bandwidth.
  • the receiving circuit may include at least two transimpedance amplifiers, and each of the at least two transimpedance amplifiers may amplify a corresponding one of the at least two electrical signals.
  • the at least two transimpedance amplifiers may be connected with the next-stage device of the transimpedance amplifiers in a time-sharing manner via signal gating, or via a switch, or via a multiplexer.
  • the receiving circuit includes at least two APD 310, at least two transimpedance amplifiers 320, and a signal amplification circuit 330.
  • the at least two transimpedance amplifiers 320 is connected to the signal amplification circuit 330 in a time-sharing manner via the switches 350, and the at least two switches 350 is implemented by a multiplexer.
  • switches 350 are disposed between the transimpedance amplifiers 320 and the signal amplification circuit 330 in FIG. 8 , the switches 350 may also be disposed between the APD 310 and the transimpedance amplifiers 320.
  • switches 350 may be disposed between the transimpedance amplifiers 320 and the signal amplification circuit 330, and a remaining portion of the switches 350 may be disposed between the transimpedance amplifiers 320 and the signal amplification circuit 330.
  • a transimpedance amplifier is connected to other devices via the switches in a time-sharing manner.
  • cost, size, and power consumption of the laser distance measurement apparatus may be reduced.
  • the transimpedance amplifier itself may be triggered by a pulse signal to turn on or off, when there are at least two transimpedance amplifiers that need to be connected with other devices in a time-sharing manner, they may be connect with other devices via a signal gating manner.
  • the transmission circuit includes at least two APD 310, at least two transimpedance amplifiers 320, and a signal amplification circuit 330.
  • the normal output of a transimpedance amplifier 320 may be enabled (as shown in the figure, inputting enable signal (EN)), and the output of an unenabled transimpedance amplifier may be in a high-impedance state, such that the electrical signal is sent to the subsequent stage for amplification at one time to achieve channel gating and reuse subsequent circuit devices.
  • EN enable signal
  • the receiving circuit may include a transimpedance amplifier, and the at least two photoelectric conversion devices corresponding to the at least two electrical signals may be connected to the one transimpedance amplifier in a time-sharing manner via switches or a multiplexers.
  • the transmission circuit includes at least two APD 310, a transimpedance amplifier 320, and a signal amplification circuit 340.
  • the at least two APD 310 are connected to the transimpedance amplifier in a time-sharing manner via the switches 350 (or a multiplexer).
  • FIG. 10 shows one embodiment where the number of subsequent circuits of the transimpedance amplifier is one when the receiving circuit includes a transimpedance amplifier, it should be understood that the embodiments of the present disclosure are not limited thereto and there may also be at least two subsequent circuits of one type for the transimpedance amplifier to process the at least two electrical signals, respectively.
  • the at least two channels of the electrical signal may share at least one of the devices other than the photoelectric conversion device in the receiving circuit and other than device(s) at one or more consecutive stages downstream the photoelectric conversion device.
  • the device(s) at the one or more consecutive stages downstream the photoelectric conversion device may include a next-stage device of the photoelectric conversion device.
  • the multiplexing may be performed in a manner that the at least two electrical signals are first split (that is, corresponding to different devices) and then share. Specifically, in the receiving circuit, after the at least two electrical signals share a device, all subsequent devices of the device may be still shared by the at least two electrical signals.
  • the signal amplification circuits and filter circuits may be multiplexed while the transimpedance amplifiers may not be multiplexed; or, the filter circuits may be multiplexed without multiplexing the transimpedance amplifiers and other signal amplification circuits.
  • sampling circuit Before multiplexing devices in the sampling circuit is described, the sampling circuit will be described first.
  • the sample circuit may be configured to sample the electrical signal from the receiving circuit, and may have two implementations.
  • the sampling circuit may include a signal comparator and a time-to-digital converter. Specifically, after the electrical signal from the receiving circuit passes via the signal comparator, the electrical signal may enter the time-to-digital converter, and then the time-to-data converter may output an analog signal to the processing circuit.
  • the sampling circuit may include an analog-to-digital converter. Specifically, after the analog signal from the receiving circuit to the sampling circuit undergoes analog-to-digital conversion by the ADC, the digital signal may be output to the processing circuit.
  • the sampling circuit may be implemented by a programmable device.
  • the programmable device may be a Field-Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), or a complex programmable logic device (CPLD).
  • the programmable device may include a port, and the signal output by the receiving circuit may be input to a device for sampling via the port, such as an ADC or a signal comparator.
  • the comparator may be disposed on the FPGA or not on the FPGA.
  • the signal comparator is classified as a sampling circuit. However, it should be understood that in other embodiments of the present application, the signal comparator may be classified as a device included in the receiving circuit.
  • the at least two electrical signals arrive at the sampling circuit in a time-sharing manner.
  • the at least two channels of laser pulse sequences are emitted at different times and they may arrive at the sampling circuit at different times. Since the at least two electrical signals arrive at the sampling circuit in a time-sharing manner, multiplexing of at least one device of the sampling circuit may be realized.
  • the at least two electrical signals may share at least one of the signal comparator and the TDC, or share the ADC.
  • signal selection may be implemented inside the programmable device to achieve the purpose of multiplexing the sampling circuit.
  • the signal is collected by the signal comparator and TDC sampling method
  • the signal of each measurement channel may be connected to the FPGA from different ports, and then a signal is selected inside the FPGA. Subsequently, the signal comparator and TDC may be used to sample. This method does not require additional switches or multiplexers.
  • At least two ports may be connected to the signal comparator or ADC via switches or multiplexers respectively in a time-sharing manner.
  • each electrical signal in the at least two electrical signals has a corresponding port 430.
  • the ports 420 are connected to ADC 410 in a time-sharing manner.
  • the electrical signal is processed by the signal processor 450 in the receiving circuit and then may be inputted to the ADC 410 via the corresponding ports.
  • a number of devices in the sampling circuit and connected to ADC directly is two (that is, the devices connected directly are not multiplexed), for example, includes two signal processors 450. Different signal processors 450 may be connected to the same ADC via different ports.
  • a last device in the receiving circuit and connected to the sampling circuit directly may be multiplexed, and correspondingly there may be only one port and the at least two channels of the electrical signal may be outputted to the sampling circuit via the one port.
  • a last device in the receiving circuit and connected to the sampling circuit directly may be multiplexed, and there may be at least two ports that correspond to the at least two channels of the electrical signal in a one-to-one correspondence.
  • At least one or more devices in the sampling circuit in each channel and at least one or more devices in the processing circuit in each channel may be implemented by a same programmable device. That is, at least one or more devices in the sampling circuit in each channel and at least one or more devices in the processing circuit in each channel may be integrated into a same programmable device, and the programmable device may be multiplexed.
  • each channel of the electrical signal in the at least two channels of the electrical signal may be transmitted to the programmable device via a corresponding one of the at least two ports respectively.
  • At least one or more devices in the sampling circuit in each channel and at least one or more devices in the processing circuit in each channel may be integrated into a same FPGA or ASCI.
  • the present disclosure also provides a laser distance measurement device.
  • the laser distance measurement device may include:
  • Drive signals in the transmission circuit that correspond to the at least two laser pulse sequences may share at least one of devices in the receiving circuit, and/or
  • the at least two electrical signals may share at least one of: at least one of devices in the receiving circuit, at least one of devices in the sampling circuit, at least one of devices in the processing circuit, and emission of the laser pulse sequences corresponding to the at least two electrical signals at different time.
  • the at least two laser pulse sequences with different emission paths may mean that: the transmission circuit may include two laser diodes and may be capable of emitting the laser pulse sequences with the at least two emission paths; or the transmission circuit may include one laser diode to emit the laser pulse sequences with one emission path and the laser pulse sequences with the one emission path may be adjusted by optical elements to form the laser pulse sequences with the at least two emission paths.
  • the drive signals or the at least two electrical signals corresponding to the at least two laser pulse sequences may share a first device.
  • the laser detection device may further include a selection device.
  • the selection device may be configured to connect at least two second devices to the first device in a time-sharing manner. Each of the at least two second devices may correspond to a drive signal or an electrical signal corresponding to a corresponding laser pulse sequence.
  • the first device may be multiplexed, and the second devices which are needed to be connected to the first device may not be multiplexed.
  • a number of the first device may be 1, and a number of the second devices may be at least two.
  • the selection device may be configured to connect at least two second devices to the first device in a time-sharing manner.
  • the selection device may include one of switches, multiplexers, or ports.
  • first device and the second devices may be connected directly (that is, there may be no other devices between the first device and the second devices) or indirectly (that is, other devices may be connected between the first device and the second devices).
  • the drive signals or the at least two electrical signals corresponding to the at least two laser pulse sequences may share a third device, and at least two fourth devices may be connected to the third device in a signal gating manner (also referred to as an enabling manner) in a time-sharing manner.
  • Each fourth device may correspond to a laser pulse sequence or an electrical signal.
  • the third device may be multiplexed, and the fourth devices which are needed to be connected to the third device may not be multiplexed.
  • a number of the third device may be 1, and a number of the fourth devices may be at least two.
  • the first device and the second device need to be connected.
  • the one third device may be connected with multiple fourth devices in a time-sharing manner in a signal gating manner.
  • the third device itself can be triggered by a pulse signal to open or close.
  • the third device may be a TransImpedance Amplifier (TIA).
  • TIA TransImpedance Amplifier
  • the laser distance measurement device further includes a control device.
  • the control device may be configured to control the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit.
  • the control device may include multiplexed control logic. Specifically, in the measurement with the at least two channels, switching between each channel may be achieved to ensure that each channel can operate normally and does not interfere with each other.
  • FIG. 12 illustrates a timing diagram of control state of each circuit when the laser distance measurement device switches to one of the channels to start working.
  • the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit in a channel X are selected to turn on, and each circuit starts working. Then, the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit in the channel X are turned off. It should be understood that when devices in one of the circuits are used by at least two channel, the devices or the one of the circuits may not be turned off when one of the channels finishes the measurement such that the devices of the one of the circuits could be used for the measurement of the next channel.
  • FIG. 12 illustrates an embodiment where the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit start working simultaneously as an example only, and should not limit the scopes of the present disclosure.
  • the various embodiments of the present disclosure may use other implementation.
  • the starting time of the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit in a specific channel may be different.
  • the transmission circuit and the receiving circuit may both be turned on sometime before the transmission to reserve a period of time for the transmission circuit and the receiving circuit to enter a stable state.
  • sampling circuit and the processing circuit may both be turned on some time before a time point when the operation is expected to start, rather than turn on when the operation is expected to start.
  • a certain circuit may process signal of other measurement channels before the certain circuit starts for the specific measurement channel, even if the previous circuits of the specific measurement channel has started to work.
  • the transmission circuit emits the laser pulse sequence with an emission path and before the receiving circuit receiving the laser pulse sequence with the emission path, the electrical signal corresponding to the laser pulse sequences with other emission paths.
  • methods that the control device controls other circuits may include the following two implementation manners.
  • control device may send trigger signal to the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit for each laser pulse sequence of the at least two laser pulse sequences, respectively.
  • the transmission circuit, the receiving circuit, the sampling circuit and the processing circuit may perform corresponding processing on a laser pulse sequence based on the trigger signal.
  • control device may send a set of trigger signal (including trigger signal for the transmission circuit, receiving circuit, adopting circuit, and processing circuit) to trigger the measurement of one channel.
  • a set of trigger signal including trigger signal for the transmission circuit, receiving circuit, adopting circuit, and processing circuit
  • multiple sets of trigger signal may be sent.
  • the trigger signal for each of the at least two channels may be sent respectively to trigger the measurement of the one of the at least two channels. That is, each trigger may only achieve the operation of only one channel, and another channel may be switched at a next trigger. Trigger frequency may be allocated to each channel evenly.
  • a trigger signal may be sent to the transmission circuit, the receiving circuit, and the sampling circuit respectively. And after performing processing corresponding to another laser pulse sequence, the transmission circuit, the receiving circuit and the sampling circuit may perform processing corresponding to another laser pulse sequence based on the one-time trigger signal.
  • control device may send a set of trigger signal (including trigger signal for the transmission circuit, receiving circuit, adopting circuit, and processing circuit) to trigger the measurement with the at least two channels.
  • a set of trigger signal including trigger signal for the transmission circuit, receiving circuit, adopting circuit, and processing circuit
  • at least two sets of trigger signal may be sent.
  • each trigger the work of each channel is realized in sequence. After one of the channels is finished, immediately or after a period of time, another channel is switched to start working.
  • the working frequency of each channel is same as the trigger frequency.
  • the multiplexed devices may belong to one or more of the transmission circuit, the receiving circuit, the sampling circuit, and the processing circuit
  • only the devices in the transmission circuit are multiplexed.
  • the devices in the receiving circuit, sampling circuit, and processing circuit are multiplexed, as shown in Figure 15 .
  • the devices of the transmission circuit, the components of the receiving circuit, the components of the sampling circuit, and the components of the processing circuit are all multiplexed.
  • the combination of the devices in the channels corresponding to the at least two laser pulse sequences may be referred to as a first circuit group, which includes the aforementioned transmission circuit, receiving circuit, sampling circuit, and processing circuit.
  • the at least two laser pulse sequences mentioned above may be all or a portion of the laser pulse sequences emitted by the laser distance measurement device.
  • the laser distance measurement device may emit six laser pulse sequences, and the drive signals of the six laser pulse sequences may share at least one device.
  • the laser distance measurement device may emit six laser pulse sequences.
  • the drive signals may share at least one device with each other.
  • the drive signals corresponding to the other three laser pulse sequences may share devices with each other, or may not share devices.
  • the above-mentioned at least two electrical signals may be electrical signal corresponding to all or a portion of the at least two laser pulse sequences emitted by the laser distance measurement device.
  • the laser distance measurement device may emit six laser pulse sequences. After photoelectric conversion, six electrical signal may be obtained. Three of the six electrical signal may share at least one device with each other. And the other three laser pulse sequences may share devices with each other, or may not share devices.
  • the laser distance measurement device may further include a second circuit group.
  • the second circuit group may include:
  • the number of laser pulse sequences emitted by the first circuit group and the number of laser pulse sequences emitted by the second circuit group may be the same or different.
  • the emission paths of the laser pulse sequences corresponding to the first circuit group may be different from the emission paths of the laser pulse sequences corresponding to the second circuit group.
  • the emission directions of the laser pulse sequences corresponding to the first circuit group may be different from the emission directions of the laser pulse sequences corresponding to the second circuit group.
  • the laser pulse sequences have two emission directions, and each emission direction is achieved by one circuit group.
  • device multiplexing may be implemented in both the first circuit group and the second circuit group. Or only one circuit group of the first circuit group and the second circuit group may implement device multiplexing.
  • the types of the devices being multiplexed in the first circuit group may be same as the types of the devices being multiplexed in the second circuit group.
  • the switching devices in the transmission circuits, the secondary amplifiers of the receiving circuits, and the sampling circuits may be multiplexed in the group.
  • both the first circuit group and the second circuit group devices of a same type may be multiplexed in the group.
  • the first circuit group including the transmission circuit 1, the transmission circuit 2, the transmission circuit 3, the receiving circuit 1, the sampling circuit and the processing circuit, and corresponding to the laser pulse sequence with direction 1
  • the second circuit group including the transmission circuit 4, the transmission circuit 5, the transmission circuit 6, the receiving circuit 2, the sampling circuit and the processing circuit, and corresponding to the laser pulse sequence with direction 1)
  • devices in the receiving circuit, the sampling circuit and the processing circuit are multiplexed in the group.
  • the types of the devices being multiplexed in the first circuit group may be different from the types of the devices being multiplexed in the second circuit group.
  • the difference may mean a portion or all are different.
  • the first circuit group may multiplex the switching device in the transmission circuit, the secondary amplifier of the receiving circuit, and the sampling circuit in the group; the first circuit group may multiplex the switching devices in the transmission circuit, the secondary amplifier and other signal processor in the receiving circuit in the group.
  • the first circuit group may multiplex the switching device in the transmission circuit in the group; the first circuit group may multiplex the secondary amplifier of the receiving circuit and other signal processors in the group.
  • device multiplexing may also be implemented between at least two circuit groups.
  • At least one of the receiving circuit, the transmission circuit, the sampling circuit, and the processing circuit may be multiplexed between the at least two circuit groups.
  • the first circuit group and the second circuit group may share one or more devices of the sampling circuit and/or one or more devices of the processing circuit.
  • the sampling circuit and the processing circuit are multiplexed between the first circuit group and the second circuit group.
  • switches, multiplexers or ports may be used to connect the receiving circuit of the first circuit group and the receiving circuit of the second circuit group to the sampling circuit in a time-sharing manner.
  • the present disclosure also provides a laser distance measurement apparatus.
  • the laser distance measurement apparatus 500 includes a laser distance measurement device 510.
  • the laser distance measurement apparatus 500 may further include other devices such as a scanning device 520.
  • the scanning device 520 may be configured to make the laser pulse sequences emitted by the laser distance measurement device 510 change the propagation direction and be emitted. At least a portion of the light beam reflected by the object to be detected may incident on the laser distance measurement device 510 after passing through the scanning device 520.
  • the scanning device 520 may include at least one prism whose thickness changes in the radial direction, and a motor for driving the prism to rotate.
  • the rotating prism may be configured to refract the laser pulse sequences emitted by the laser distance measurement device to different directions to be emitted.
  • the laser tube of the transmission circuit included in the laser distance measurement device 510 in the embodiment of the present disclosure may be one laser tube, and the laser pulse sequences emitted by the laser tube may be changed by the scanning device 520 to change the emission path to obtain the laser pulse sequences with multiple emission paths.
  • a coaxial optical path may be used in the laser distance measurement apparatus, that is, the beam emitted by the laser distance measurement apparatus and the reflected beam may share at least a portion of the optical path in the laser distance measurement apparatus.
  • the laser distance measurement apparatus may also use an off-axis optical path, that is, the light beam emitted by the laser distance measurement apparatus and the reflected light beam may be respectively transmitted along different optical paths in the laser distance measurement apparatus.
  • Fig. 19 shows a schematic diagram of a laser distance measurement apparatus according to an embodiment of the present disclosure.
  • the laser distance measurement apparatus 600 includes an optical transceiver device 610 which includes a transmission circuit 603, a collimator 604, a detector 605 (which may include a receiving circuit, a sampling circuit, and a processing circuit), and an optical path changing element 606.
  • the optical transceiver 610 is used to transmit a light beam, receive the returned light, and convert the returned light into an electrical signal.
  • the transmission circuit 603 is used to emit a light beam.
  • the transmission circuit 603 may emit a laser beam.
  • the laser beam emitted by the transmission circuit 603 may be a narrow-bandwidth beam with a wavelength outside the visible light range.
  • the collimator 104 is arranged on the emission light path of the transmission circuit, and is used to collimate the light beam emitted from the transmission circuit 603 for collimating the light beam emitted from the transmission circuit 603 into parallel light.
  • the collimator is also used to condense at least a part of the return light reflected by the object to be detected.
  • the collimator 604 may be a collimating lens or other elements capable of collimating a light beam.
  • the laser distance measurement apparatus 100 further includes a scanning device 602.
  • the scanning device 602 is disposed on the exit light path of the optical transceiver 610.
  • the scanning device 602 is used to change the transmission direction of the collimated beam 619 emitted by the collimator 604 to project it to the external environment, and project the return light to the collimator 604.
  • the returned light is collected by the detector 605 via the collimator 604.
  • the scanning device 602 may include one or more optical elements, such as a lens, a mirror, a prism, a grating, an optical phased array, or any combination of the foregoing optical elements.
  • the one or more optical elements of the scanning device 602 may be capable to rotate around a common axis 609, and each rotating optical element may be used to continuously change the propagation direction of the incident light beam.
  • the one or more optical elements of the scanning device 602 may rotate at different rotation speeds.
  • the one or more optical elements of the scanning device 602 may rotate at substantially the same rotation speed.
  • the one or more optical elements of the scanning device 602 may also rotate around different axes, or vibrate in the same direction, or vibrate in different direction.
  • the present disclosure has no limit on these.
  • the scanning device 602 may include a first optical element 614 and a driver 616 connected to the first optical element 614.
  • the driver 616 maybe configured to drive the first optical element 614 to rotate around the rotation axis 609 such that the first optical element 614 changes a direction of the collimated light beam 619.
  • the first optical element 614 may project the collimated light beam 619 to different directions.
  • the angle between the direction of the collimated light beam 619 being changed by the first optical element and the rotation axis 609 may change as the first optical element 614 rotates.
  • the first optical element 614 may include a pair of opposed non-parallel surfaces and the collimated light beam 619 may transmit through the surfaces.
  • the first optical element 614 may include a prism whose thickness varies along at least one radial direction. In one embodiment, the first optical element 614 may include a wedge-angle prism configured to refract the collimated light beam 619. In one embodiment, the first optical element 614 may be coated with an anti-reflection coating, and the thickness of the anti-reflection coating may be equal to the wavelength of the light beam emitted by the transmission circuit 603, which can increase the intensity of the transmitted light beam.
  • the scanning device 602 may further include a second optical element 615 and the second optical element 615 may rotate around the rotation axis 609.
  • the rotation speed of the second optical element 615 may be different from the rotation speed of the first optical element 614.
  • the second optical element 615 may be configured to change the direction of the light beam projected by the first optical element 614.
  • the second optical element 615 may be connected to another driver 617, and the driver 617 may drive the second optical element 615 to rotate.
  • the first optical element 614 and the second optical element 615 may be driven by different drivers, such that the rotation speed of the first optical element 614 and the second optical element 615 are different and the collimated light beam 619 is projected to different directions in the external space, which can scan a larger space range.
  • a controller 618 may control the drivers 616 and 617 to drive the first optical element 614 and the second optical element 615, respectively.
  • the rotational speeds of the first optical element 614 and the second optical element 615 may be determined according to the expected scanning area and pattern in actual applications.
  • the drivers 616 and 617 may include motors or other drivers.
  • the second optical element 615 may include a pair of opposite non-parallel surfaces through which the light beam passes. In one embodiment, the second optical element 615 may include a prism whose thickness varies along at least one radial direction. In one embodiment, the second optical element 615 may include a wedge prism. In one embodiment, the second optical element 615 may be coated with an anti-reflection coating to increase the intensity of the transmitted light beam.
  • the rotation of the scanning device 602 may project light to different directions, such as directions 611 and 613, such that the space around the distance measuring apparatus 600 is scanned.
  • directions 611 and 613 such that the space around the distance measuring apparatus 600 is scanned.
  • the scanning device 602 may receive the return light 612 reflected by the object to be detected 601 and project the return light 612 to the collimator 604.
  • the collimator 604 may converge at least a part of the return light 612 reflected by the object to be detected 601.
  • an anti-reflection coating may cover the collimator 604 to increase the intensity of the transmitted light beam.
  • the detector 605 and the transmission circuit 603 may be placed on the same side of the collimator 604, and the detector 605 may be used to convert at least part of the return light passing through the collimator 604 into an electrical signal.
  • the transmission circuit 603 may include a laser diode, by which nanosecond laser light is emitted.
  • the laser pulse emitted by the transmission circuit 603 lasts for 10 ns.
  • the laser pulse receiving time can be determined.
  • the laser pulse receiving time can be determined by detecting the rising edge time and/or the falling edge time of the electrical signal pulse. In this way, the laser distance measurement apparatus 600 can calculate the TOF using the pulse receiving time information and the pulse sending time information, to determine the distance between the object to be detected 601 and the laser distance measurement apparatus 600.
  • the distance and orientation detected by the laser distance measurement apparatus 100 can be used for remote sensing, obstacle avoidance, surveying and mapping, modeling, navigation, and the like.
  • the present disclosure also provides a laser distance measurement method.
  • the laser distance measurement method may use a laser distance measurement apparatus provided by any above embodiments to measure a distance between the laser distance measurement apparatus and the object to be detected.
  • the laser distance measurement method 700 includes at least a portion of following steps.
  • each detection channel includes a light source, a photoelectric conversion device, a sampling circuit, and a processing circuit.
  • the light source is used to emit a laser pulse sequence
  • the photoelectric conversion device is used to receive the laser pulse sequence reflected by the object to be detected, and perform photoelectric conversion on the laser pulse sequence to obtain an electrical signal.
  • the sampling circuit is used to sample the one electrical signal respectively to obtain the sampling result.
  • the processing circuit is used to determine the distance between the laser distance measurement apparatus and the detected object based on the sampling result.
  • the laser pulse sequences emitted by the at least two detection channels have different emission paths, and the at least two detection channels emit laser pulse sequences at different times respectively.
  • One or more devices in the two detection channels except for the light source and the photoelectric conversion device is multiplexed in a time-sharing manner.
  • at least one device of the transmission circuit other than the light source and/or at least one device of the receiving circuit other than the photoelectric converter can be multiplexed
  • at least one device of the sampling circuit and/or at least one device of the processing circuit can be multiplexed.
  • the distance between the laser distance measurement apparatus and the object to be detected is measured using the at least two detection channels.
  • the manner of performing multiplexing in a time-sharing manner on one or more devices in the two detection channels except for the light source and the photoelectric conversion device can refer to the above description. For a brief purpose, this will not be repeated here.
  • the embodiment of the present disclosure also provides a mobile platform including a laser distance measurement apparatus provided by various embodiments described above.
  • the mobile platform may be an unmanned aerial vehicle, a car, or a robot.
  • the car may include an autonomous driving car or a semi-automatic driving car.
  • the unmanned aerial vehicle 800 may include a power system 810, a flight control system 820, and a laser distance measurement apparatus 830.
  • the power system 810 may provide power for the unmanned aerial vehicle 800 under the control of the flight control system 820.
  • the flight control system 820 may control the power system 810 to provide power to the unmanned aerial vehicle 800, and control the laser distance measurement apparatus 830 to perform laser distance measurement.
  • the laser distance measurement apparatus 830 may correspond to the laser distance measurement apparatus mentioned above, and for the sake of brevity, it will not be repeated here.
  • the laser distance measurement apparatus 830 and the flight control system 820 may not be strictly physically separated.
  • the control circuit in the laser distance measurement apparatus 830 may be included in the flight control system 820.
  • unmanned aerial vehicle 800 may also include other parts, such as a gimbal or a sensing system, etc., which are not described here for brevity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
EP18932498.1A 2018-09-07 2018-09-07 Module, appareil et procédé de mesure de distance à laser, et plate-forme mobile Active EP3848726B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/104675 WO2020047857A1 (fr) 2018-09-07 2018-09-07 Module, appareil et procédé de mesure de distance à laser, et plate-forme mobile

Publications (3)

Publication Number Publication Date
EP3848726A1 true EP3848726A1 (fr) 2021-07-14
EP3848726A4 EP3848726A4 (fr) 2022-02-16
EP3848726B1 EP3848726B1 (fr) 2023-08-30

Family

ID=69722112

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18932498.1A Active EP3848726B1 (fr) 2018-09-07 2018-09-07 Module, appareil et procédé de mesure de distance à laser, et plate-forme mobile

Country Status (4)

Country Link
US (1) US20210208249A1 (fr)
EP (1) EP3848726B1 (fr)
CN (1) CN111164457B (fr)
WO (1) WO2020047857A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11867844B2 (en) * 2018-10-05 2024-01-09 GM Global Technology Operations LLC Lidar spectrum analyzer
CN111708004B (zh) * 2020-06-29 2024-09-17 宋一铄 一种新型激光测距方法及激光雷达系统
CN111830532A (zh) * 2020-07-22 2020-10-27 厦门市和奕华光电科技有限公司 一种多模块复用激光雷达及扫地机器人
CN116359885A (zh) * 2021-12-28 2023-06-30 上海禾赛科技有限公司 激光雷达的探测方法以及激光雷达
CN116774235A (zh) * 2022-03-11 2023-09-19 华为技术有限公司 激光雷达及其光发射装置、控制方法和相关装置

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5231405A (en) * 1992-01-27 1993-07-27 General Electric Company Time-multiplexed phased-array antenna beam switching system
JPH0815433A (ja) * 1994-06-27 1996-01-19 Mitsubishi Heavy Ind Ltd レーザ通信兼測距装置
US8355117B2 (en) * 2005-12-21 2013-01-15 Ecole Polytechnique Federale De Lausanne Method and arrangement for measuring the distance to an object
CN101201403A (zh) * 2007-04-27 2008-06-18 北京航空航天大学 三维偏振成像激光雷达遥感器
US10132928B2 (en) * 2013-05-09 2018-11-20 Quanergy Systems, Inc. Solid state optical phased array lidar and method of using same
CN106463565B (zh) * 2013-11-22 2018-06-01 优步技术公司 激光雷达扫描仪校准
CN103760567B (zh) * 2014-01-27 2016-06-15 中国科学院半导体研究所 一种具有测距功能的被动成像系统及其测距方法
CN103901435B (zh) * 2014-03-11 2016-05-18 北京航空航天大学 一种全光纤光路全波形激光雷达系统
CN105181154B (zh) * 2015-10-10 2018-04-10 中国工程物理研究院激光聚变研究中心 一种多光束宽带调频脉冲激光波形集中测量装置
CN105824029B (zh) * 2016-05-10 2018-09-04 深圳市速腾聚创科技有限公司 多线激光雷达
CN106154281A (zh) * 2016-09-08 2016-11-23 齐龙舟 一种光纤激光雷达系统
CN107817497A (zh) * 2016-09-12 2018-03-20 北京万集科技股份有限公司 三维激光的测距装置及方法
CN106371085A (zh) * 2016-10-27 2017-02-01 上海博未传感技术有限公司 一种基于光纤阵列的激光雷达系统
CN106646494A (zh) * 2016-11-03 2017-05-10 上海博未传感技术有限公司 一种采用发射和接收光路复用结构的激光雷达系统
CN106501791A (zh) * 2016-11-18 2017-03-15 深圳市速腾聚创科技有限公司 相控阵激光雷达及相控阵激光雷达控制方法
CN106970391B (zh) * 2017-03-31 2019-10-11 成都微光云科技有限公司 一种基于激光测距的uav地形检测系统
CN106932783B (zh) * 2017-04-21 2018-12-11 深圳市迈测科技股份有限公司 一种大量程高速高精度tof测距方法
CN207408591U (zh) * 2017-10-30 2018-05-25 北京万集科技股份有限公司 一种阵列apd分时复用的三维激光测距装置
CN207623731U (zh) * 2017-12-07 2018-07-17 北京万集科技股份有限公司 一种多路光电转换模块的控制装置

Also Published As

Publication number Publication date
WO2020047857A1 (fr) 2020-03-12
CN111164457B (zh) 2023-04-14
EP3848726A4 (fr) 2022-02-16
EP3848726B1 (fr) 2023-08-30
CN111164457A (zh) 2020-05-15
US20210208249A1 (en) 2021-07-08

Similar Documents

Publication Publication Date Title
US20210208249A1 (en) Laser distance measurement device, apparatus, and method, and mobile platform
US10473768B2 (en) Lidar system
US11940535B2 (en) Multi-pulse LIDAR system for multi-dimensional detection of objects
US11860280B2 (en) Integrated illumination and detection for LIDAR based 3-D imaging
CN110226105B (zh) Lidar扫描系统
US11953600B2 (en) Synchronized image capturing for electronic scanning LIDAR systems comprising an emitter controller and plural sensor controllers
RU2538418C2 (ru) Оптический дальномер
US10838048B2 (en) Apparatus and method for selective disabling of LiDAR detector array elements
WO2019231496A1 (fr) Système de détection de lumière comprenant une pluralité d'unités de réception de lentille
US9041918B2 (en) Measuring apparatus and referencing method for a digital laser distance meter, and laser distance meter
US12032063B2 (en) Application specific integrated circuits for lidar sensor and multi-type sensor systems
WO2020124318A1 (fr) Procédé d'ajustement de la vitesse de déplacement d'élément de balayage, de dispositif de télémétrie et de plateforme mobile
US8547531B2 (en) Imaging device
US20230078063A1 (en) Distance measurement device and distance measurement system
WO2020113360A1 (fr) Circuit d'échantillonnage, procédé d'échantillonnage, appareil de télémétrie et plateforme mobile
US11470261B2 (en) Three-dimensional distance measuring method and device
WO2020142921A1 (fr) Module de détection optique et dispositif de mesure de distance
CN111164379A (zh) 用于激光测距的方法和装置
US12025701B2 (en) Dynamic signal control in flash LiDAR
US20230161040A1 (en) Electromagnetic wave detection apparatus and range finder
US11681028B2 (en) Close-range measurement of time of flight using parallax shift
US20230084560A1 (en) Distributed lidar with shared light emitter
KR20230133458A (ko) 라이다 장치
CN117434549A (zh) 无扫描高分辨率多光谱激光雷达
CN118259298A (zh) 激光雷达及其测距方法

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210105

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220119

RIC1 Information provided on ipc code assigned before grant

Ipc: G01S 17/10 20200101AFI20220113BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20221028

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230522

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018056785

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230830

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1606138

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231230

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231130

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231230

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231201

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240102

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230907

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230907

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018056785

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230907

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230930

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20231130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230907

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231030

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230930

26N No opposition filed

Effective date: 20240603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230930

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240918

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231130