WO2017058367A1 - Lidar system with reflected signal strength measurement - Google Patents

Lidar system with reflected signal strength measurement Download PDF

Info

Publication number
WO2017058367A1
WO2017058367A1 PCT/US2016/046123 US2016046123W WO2017058367A1 WO 2017058367 A1 WO2017058367 A1 WO 2017058367A1 US 2016046123 W US2016046123 W US 2016046123W WO 2017058367 A1 WO2017058367 A1 WO 2017058367A1
Authority
WO
WIPO (PCT)
Prior art keywords
analog signal
time data
lidar system
reflected light
light pulse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2016/046123
Other languages
English (en)
French (fr)
Inventor
Volodimir Slobodyanyuk
Manav Raina
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority to BR112018006392A priority Critical patent/BR112018006392A2/pt
Priority to KR1020187012214A priority patent/KR20180063211A/ko
Priority to CN201680056196.3A priority patent/CN108139481B/zh
Priority to JP2018515811A priority patent/JP2018528437A/ja
Priority to EP16753542.6A priority patent/EP3356853B1/en
Publication of WO2017058367A1 publication Critical patent/WO2017058367A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483Details of pulse systems
    • G01S7/486Receivers
    • G01S7/4861Circuits for detection, sampling, integration or read-out
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/08Systems determining position data of a target for measuring distance only
    • G01S17/10Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/08Systems determining position data of a target for measuring distance only
    • G01S17/10Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • G01S17/14Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves wherein a voltage or current pulse is initiated and terminated in accordance with the pulse transmission and echo reception respectively, e.g. using counters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483Details of pulse systems
    • G01S7/486Receivers
    • G01S7/4865Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483Details of pulse systems
    • G01S7/486Receivers
    • G01S7/4868Controlling received signal intensity or exposure of sensor

Definitions

  • This disclosure relates generally to Light Detection And Ranging (LIDAR) systems.
  • LIDAR and/or LADAR i.e., Laser Detection And Ranging
  • LADAR Laser Detection And Ranging
  • This information may allow enhancement of post processing analysis of the LIDAR/LADAR data by providing information about location of the scatter, and strength of the reflected light.
  • This noise will leak into the receive path of the system, and this noise may impact the accuracy and reliability of the object detection.
  • Correlation of the received signal strength enables the LIDAR system to implement reliability metrics - when detecting objects with stronger reflection signals, the LIDAR system can assign them higher confidence values, and thus enable more efficient post processing of the data.
  • ADC Analog-to-Digital converters
  • TDCs Time-to-Distance (also referred to herein as time-to-digital) Converter (TDC).
  • TDCs are a significantly simpler solution than ADCs, relatively in-expensive, and do not require a lot of power to operate.
  • TDCs can directly measure timing information of the reflected signal, TDCs may be very inaccurate in estimating the power of the reflected light.
  • aspects of the present disclosure include a method, an apparatus, a LIDAR system, and computer-readable medium for assisting or otherwise performing a reflected signal strength measurement in a LIDAR system.
  • an example LIDAR system includes a detector, an amplifier, a time-to-digital converter (TDC), an integrator, an analog-to-digital converter (ADC), and a processor.
  • the detector is configured to receive a reflected light pulse, where the reflected light pulse is reflected off of an object.
  • the amplifier is coupled to the detector to generate an analog signal in response to the reflected light pulse.
  • the TDC is coupled to the amplifier to generate at least a first time data and a second time data in response to the analog signal.
  • the integrator is coupled to the amplifier to integrate the analog signal.
  • the ADC is coupled to the integrator to sample an output of the integrator and to generate a digital sample.
  • the processor is configured to process the first time data, the second time data, and the digital sample to estimate a total reflected energy of the reflected light pulse.
  • an example method for use with a LIDAR system includes receiving a reflected light pulse at a detector of the LIDAR system, where the reflected light pulse is reflected off of an object.
  • the method further includes generating an analog signal in response to the reflected light pulse, where the analog signal is representative of the reflected light pulse, and generating at least a first time data and a second time data with a time-to-digital converter (TDC) in response to the analog signal.
  • TDC time-to-digital converter
  • the method also includes integrating the analog signal with an integrator and sampling an output of the integrator with an analog-to-digital converter (ADC) at one or more sampling times to generate a digital sample representative of the output of the integrator.
  • ADC analog-to-digital converter
  • an example LIDAR system includes memory and a processor coupled to the memory.
  • the memory is adapted to store program code and the processor is configured to access and execute instructions included in the program code to direct the LIDAR system to: (i) receive a reflected light pulse at a detector of the LIDAR system, where the reflected light pulse is reflected off of an object; (ii) generate an analog signal in response to the reflected light pulse, where the analog signal is representative of the reflected light pulse; (iii) generate at least a first time data and a second time data with a time-to-digital converter (TDC) in response to the analog signal; (iv) integrate the analog signal with an integrator; (v) sample an output of the integrator with an analog-to-digital converter (ADC) at one or more sampling times to generate a digital sample representative of the output of the integrator; and (vi) process the first time data, the second time data, and the digital sample to estimate a total reflected energy of the reflected light pulse.
  • TDC time-
  • a LIDAR system includes: (i) means for receiving a reflected light pulse at a detector of the LIDAR system, where the reflected light pulse is reflected off of an object; (ii) means for generating an analog signal in response to the reflected light pulse, wherein the analog signal is representative of the reflected light pulse; (iii) means for generating at least a first time data and a second time data in response to the analog signal; (iv) means for integrating the analog signal; (v) means for sampling an output of the means for integrating at one or more sampling times to generate a digital sample representative of the output of the means for integrating; and (vi) means for processing the first time data, the second time data, and the digital sample to estimate a total reflected energy of the reflected light pulse.
  • FIG. 1 is a block diagram illustrating an example LIDAR system.
  • FIG. 2 is a block diagram illustrating an example LIDAR system.
  • FIG. 3 is a block diagram illustrating an example detector of a LIDAR system.
  • FIGS. 4A-4D is a timing diagram illustrating operation of a multi-channel TDC of a LIDAR system.
  • FIG. 5 is a timing diagram illustrating operation of an integrator of a LIDAR system.
  • FIG. 6 is a flowchart illustrating an example process of performing a reflected signal strength measurement in a LIDAR system.
  • FIG. 7 is a simplified block diagram of several sample aspects of components that may be employed in a LIDAR system and configured to support performing a reflected signal strength measurement as taught herein.
  • FIG. 1 is a block diagram illustrating an example LIDAR system 102 operating in an environment 100.
  • LIDAR system 102 is configured to measure a distance 116 from LIDAR system 102 to object 1 10.
  • LIDAR system 102 utilizes a Time of Flight method (ToF), where the LIDAR system 102 measures a time delay between the time at which a laser pulse 112 is sent into the environment 100, and the time at which the reflected pulse 114 (also referred to herein as an echo) is detected by the LIDAR system 102.
  • ToF Time of Flight method
  • the LIDAR system 102 is also configured to measure a signal strength of the reflected pulse 114 and/or a reflectance value of object 110.
  • LIDAR system 102 may determine its position/location to aide in the scanning of object 110 by way of one or more positioning systems.
  • a satellite positioning system typically includes a system of transmitters positioned to enable entities to determine their location on or above the Earth based, at least in part, on signals received from the transmitters.
  • Such a transmitter typically transmits a signal marked with a repeating pseudo-random noise (PN) code of a set number of chips and may be located on ground based control stations, user equipment and/or space vehicles.
  • PN pseudo-random noise
  • such transmitters may be located on Earth orbiting satellite vehicles (SVs) 106.
  • SVs Earth orbiting satellite vehicles
  • an SV in a constellation of Global Navigation Satellite System such as Global Positioning System (GPS), Galileo, Glonass or Compass may transmit a signal marked with a PN code that is distinguishable from PN codes transmitted by other SVs in the constellation (e.g., using different PN codes for each satellite as in GPS or using the same code on different frequencies as in Glonass).
  • GNSS Global Navigation Satellite System
  • GPS Global Positioning System
  • Glonass or Compass may transmit a signal marked with a PN code that is distinguishable from PN codes transmitted by other SVs in the constellation (e.g., using different PN codes for each satellite as in GPS or using the same code on different frequencies as in Glonass).
  • the techniques presented herein are not restricted to global systems (e.g., GNSS) for SPS.
  • the techniques provided herein may be applied to or otherwise enabled for use in various regional systems, such as, e.g., Quasi-Zenith Satellite System (QZSS) over Japan, Indian Regional Navigational Satellite System (IRNSS) over India, Beidou over China, etc., and/or various augmentation systems (e.g., a Satellite Based Augmentation System (SBAS)) that may be associated with or otherwise enabled for use with one or more global and/or regional navigation satellite systems.
  • QZSS Quasi-Zenith Satellite System
  • IRNSS Indian Regional Navigational Satellite System
  • Beidou Beidou over China
  • SBAS Satellite Based Augmentation System
  • an SBAS may include an augmentation system(s) that provides integrity information, differential corrections, etc., such as, e.g., Wide Area Augmentation System (WAAS), European Geostationary Navigation Overlay Service (EGNOS), Multi-functional Satellite Augmentation System (MSAS), GPS Aided Geo Augmented Navigation or GPS and Geo Augmented Navigation system (GAGAN), and/or the like.
  • WAAS Wide Area Augmentation System
  • GNOS European Geostationary Navigation Overlay Service
  • MSAS Multi-functional Satellite Augmentation System
  • GPS Aided Geo Augmented Navigation or GPS and Geo Augmented Navigation system (GAGAN), and/or the like GPS Aided Geo Augmented Navigation or GPS and Geo Augmented Navigation system (GAGAN), and/or the like.
  • SPS may include any combination of one or more global and/or regional navigation satellite systems and/or augmentation systems
  • SPS signals may include SPS, SPS- like, and/or other signals associated with such one or more SPS.
  • the LIDAR system 102 is not limited to use with an SPS to determine its position/location, where such positioning techniques may also be implemented in conjunction with various wireless communication networks, including cellular towers 104 and from wireless communication access points 108, such as a wireless wide area network (WW AN), a wireless local area network (WLAN), and a wireless personal area network (WPAN).
  • WW AN wireless wide area network
  • WLAN wireless local area network
  • WPAN wireless personal area network
  • a WW AN may be a Code Division Multiple Access (CDMA) network, a Time Division Multiple Access (TDMA) network, a Frequency Division Multiple Access (FDMA) network, an Orthogonal Frequency Division Multiple Access (OFDMA) network, a Single-Carrier Frequency Division Multiple Access (SC-FDMA) network, Long Term Evolution (LTE), and so on.
  • CDMA Code Division Multiple Access
  • TDMA Time Division Multiple Access
  • FDMA Frequency Division Multiple Access
  • OFDMA Orthogonal Frequency Division Multiple Access
  • a CDMA network may implement one or more radio access technologies (RATs) such as cdma2000, Wideband-CDMA (W-CDMA), and so on.
  • Cdma2000 includes IS-95, IS-2000, and IS-856 standards.
  • a TDMA network may implement Global System for Mobile Communications (GSM), Digital Advanced Mobile Phone System (D-AMPS), or some other RAT.
  • GSM and W- CDMA are described in documents from a consortium named "3rd Generation Partnership Project" (3GPP).
  • Cdma2000 is described in documents from a consortium named "3rd Generation Partnership Project 2" (3GPP2).
  • 3GPP and 3GPP2 documents are publicly available.
  • a WLAN may be an IEEE 802. l lx network
  • a WPAN may be a Bluetooth network, an IEEE 802.15x, or some other type of network.
  • the techniques may also be implemented in conjunction with any combination of WW AN, WLAN and/or WPAN.
  • FIG. 2 is a block diagram illustrating an example LIDAR system 202.
  • LIDAR system 202 is one possible implementation of LIDAR system 102 of FIG. 1.
  • LIDAR system 202 may also be a device including wireless communication devices, computers, laptops, etc. which are capable of LIDAR operations.
  • LIDAR system 202 includes a control unit 204 that is connected to and communicates with a laser 206, optics 208, and detector 210.
  • the control unit 204 accepts and processes data received from detector 210.
  • Control unit 204 may be provided by a processor 212, hardware 214, firmware 216, memory 218, and software 220.
  • control unit 204 furthers includes a LIDAR control unit 222 and a position/navigation unit 226.
  • Processor 212 and LIDAR control unit 222 are illustrated separately for clarity, but may be a single unit and/or implemented in the processor 212 based on instructions in the software 220 which is run in the processor 212.
  • Processor 212, as well as the LIDAR control unit 222 can, but need not necessarily include, one or more microprocessors, embedded processors, controllers, application specific integrated circuits (ASICs), digital signal processors (DSPs), and the like.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • memory refers to any type of computer storage medium, including long term, short term, or other memory associated with LIDAR system 202, and is not to be limited to any particular type of memory or number of memories, or type of media upon which memory is stored.
  • the laser 206 is configured to emit (e.g., produce, propagate) electromagnetic radiation at one or more frequencies that can be, for example, a coherent light emission (e.g., monochromatic light emission) or beam.
  • Laser 206 may be configured to emit ultraviolet, visible, or near infrared light.
  • the laser pulse generated by laser 206 is directed through optics 208, where the optics 208 control the angular resolution and range that can be detected by LIDAR system 202.
  • Optics 208 may also be configured to receive the reflected pulse (e.g., reflected pulse 114) by way of a hole mirror or beam splitter. In some examples, optics 208 couple the optical transmit and receive paths together.
  • optics 208 are configured to perform scanning operations to control the direction of the laser pulse generated by laser 206.
  • optics 208 may include hardware to scan the azimuth and elevation, such as dual oscillating plan mirrors, a polygon mirror, or a dual axis scanner.
  • the detector 210 may be coupled to the optics 208 to receive and detect the reflected pulse (e.g., reflected pulse 114).
  • detector 210 includes a solid state photodetector, such as one or more silicon avalanche photodiodes.
  • detector 210 includes a photomultiplier.
  • detector 210 may be also configured to detect a signal strength of the reflected pulse 114 and/or a reflectance value of the object 110.
  • control unit 204 further includes a position/navigation unit 226 which may include one or more GPS receivers configured to perform or otherwise aide in the position determination of LIDAR system 202.
  • LIDAR control unit 222 is configured to trigger the laser 206 at a firing time to generate a laser pulse (e.g., laser pulse 112 of FIG. 1).
  • LIDAR control unit 222 may then determine a Time of Flight (ToF) and/or the signal strength of the reflected signal based on data received from detector 210.
  • ToF Time of Flight
  • the processes described herein may be implemented by various means depending upon the application. For example, these processes may be implemented in hardware 214, firmware 216, a combination of processor 212 and software 220, or any combination thereof.
  • the processing units may be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, or a combination thereof.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • processors controllers, micro-controllers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, or a combination thereof.
  • the processes may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein.
  • modules e.g., procedures, functions, and so on
  • Any non-transitory computer-readable medium tangibly embodying instructions may be used in implementing the processes described herein.
  • program code may be stored in memory 218 and executed by the processor 212.
  • Memory 218 may be implemented within or external to the processor 212.
  • the functions may be stored as one or more instructions or code on a computer-readable medium. Examples include non-transitory computer-readable media encoded with a data structure and computer-readable media encoded with a computer program.
  • Computer-readable media includes physical computer storage media. A storage medium may be any available medium that can be accessed by a computer.
  • such computer- readable media can comprise RAM, ROM, Flash Memory, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer; disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
  • FIG. 3 is a block diagram illustrating an example detector 302 of a LIDAR system.
  • Detector 302 is one possible implementation of detector 210 of FIG. 2.
  • the illustrated example of detector 302 includes a photosensitive element (e.g., avalanche photodiode (APD) 304), an amplifier 306, a time-to-digital converter (TDC) 308, an integrator 310, and an analog-to-digital converter (ADC) 312.
  • the illustrated example of amplifier 306 includes a transimpedance amplifier (TIA) 316 and a variable gain control (VGC) circuit 318.
  • TIA transimpedance amplifier
  • VCC variable gain control
  • processor 314 Also shown in FIG. 3 is a processor 314.
  • processor 314 is included in detector 302. However, in another example, processor 314 may be included in LIDAR control unit 222 and/or may be processor 212 of FIG. 2.
  • a reflected light pulse 320 incident on the APD 304, generates a current pulse which is further amplified and converted into a voltage pulse in the TIA 316.
  • the VGC circuit 318 is optional and may compensate for signal attenuation (e.g., as the distance to the scatter is increasing, received power is decreasing as #2)-
  • VGC circuit 318 is configured to compensate for this effect by increasing the gain of the VGC circuit 318, due to increasing distance (and time delay).
  • an analog signal 322 at the output of the VGC circuit 318 will be the same for a given scatter across a scan range.
  • the analog signal 322 tracks an instantaneous output of the APD 304.
  • the analog signal 322 is provided to both the TDC 308 and an integrator 310.
  • the TDC 308 is a high speed counter that starts counting with the firing of the laser 206 (START) and counts when it receives the reflected beam which essentially generates a STOP.
  • TDC 308 may implement multiple measurement channels where each channel can register multiple STOPs triggered at different thresholds.
  • TDC 308 implements two channels - Channel 1 and Channel 2, where each channel supports two STOPs. Both channels are armed when the LIDAR system 202 fires the pulse (e.g., LASER pulse 112), and they keep running until the reflected signal (represented by analog signal 322) crosses a predefined threshold. At this point the TDC 308 registers a STOP.
  • the pulse e.g., LASER pulse 112
  • information about the stops may be output from the TDC 308 as digital data 324.
  • FIG. 4A illustrates TDC 308 as generating two STOPs per channel, TDC 308 may be configured to generate any number of STOPs per channel, including two or more.
  • TDC 308 will generate two STOPs for Channel 1 (i.e., T 2 2 ).
  • the STOPS may be output by the TDC 308 as digital time data 324.
  • the slope of the signal may be determined by the difference between counter values for T or T T 2 2 .
  • the center of the reflected signal may be measured as the average time between timestamps ⁇ and T x 2 , or between timestamps T 2 i and T 2 2 .
  • the slope of the analog signal 322 may allow an estimate of the maximum (i.e. peak) value of the pulse.
  • FIG. 4B illustrates an example method of estimating the maximum value of analog signal 322.
  • a linear interpolation may be applied, where straight lines 402 and 404 are generated based on the various STOPs generated by TDC 308. That is, straight line 402 may be drawn through points, 406 and 408, where point 406 corresponds to the voltage value at timestamp and point 408 corresponds to the voltage value at timestamp T 2 i. Similarly, straight line 404 is drawn through points 410 and 412, where point 410 corresponds to the voltage value at timestamp T x 2 , and point 412 corresponds to the voltage value at timestamp T 2 2 . Straight lines 402 and 404 may then be extended until they intersect. As shown in FIG. 4B, straight lines 402 and 404 form an intersection 414. The voltage value I at intersection 414 may be representative of an estimate of the maximum value of analog signal 322.
  • the points located on the curve shown in FIG. 4B are representative of an immediate power of the analog signal and may be utilized to estimate the maximum (e.g., peak) value of the reflected light pulse. However, in some examples it may be desirable to provide an estimate of the total reflected energy of the reflected light pulse. In one example, the total reflected energy of the reflected light pulse is represented by the area under the curve, shown as analog signal 322 in FIG. 4B.
  • an estimation of the total reflected energy based solely on the output of TDC 308 may be inaccurate, as the measurements of the analog signal 322 are performed in the presence of strong noise, which may contribute to errors in measuring corresponding time data.
  • the accuracy of the measurement of the total reflected energy based solely on the output of the TDC 308 may be relatively low.
  • embodiments disclosed herein include the addition of integrator 310 in parallel to TDC 308.
  • the integrator 310 is configured to integrate the analog signal 322 over a predefined time interval.
  • the integrator 310 could be implemented using passive, active, or a combination of passive and active components, such as an Op-Amp integrator or a capacitor, or other device with similar functionality.
  • the integrator 310 is configured to accumulate a charge which is generated by one or more pulses of analog signal 322, and ADC 312 is configured to generate digital samples 326 of the charge accumulated at the output of the integrator 310.
  • the digital samples 326, along with the digital time data 324 i.e., TDC STOP data
  • TDC STOP data can then be provided to the processor 314 for post-processing the scan data and to correlate the digital time data 324 with the digital samples 326 to generate an estimate 328 of the total reflected energy and/or the reflectance of the object on which the laser is incident.
  • FIG. 4C illustrates a scan of a reflected light pulse
  • FIG. 4D illustrates a consecutive scan of the reflected light pulse.
  • the reflected light pulse in both scans of FIGS. 4C and 4D is similar, if not identical.
  • the timestamps of the threshold crossings generated by TDC 308 may be measured with some error.
  • Table 1 illustrates example values of the timestamps generated by TDC 308 for the consecutive scans of FIGS. 4C and 4D.
  • the assumed rectangle is defined to have a height equal to the maximum value of analog signal 322 (e.g., voltage value I at intersection 414) and a width equal to the pulse duration of analog signal 322.
  • the pulse duration may be the average between the corresponding timestamps of the channels used by TDC 308. That is, the pulse duration of the analog signal 322 of the scan of FIG. 4C may be determined as
  • the pulse duration of the analog signal 322 of FIG. 4C is calculated to be 15 ns.
  • the signal strength (i.e., the maximum value) of analog signal 322 in FIG. 4C may be estimated as proportional to 45 mV/15 ns, or 3 mV/ns.
  • the pulse duration of the analog signal 322 of the scan of FIG. 4D may be determined as——— 21 22 —— . Again, using the values from TABLE 1, above, the pulse duration of the analog signal 322 of FIG. 4D is calculated to be 14.5 ns. Thus, the signal strength (i.e., the maximum value) of analog signal 322 in FIG. 4D may be estimated as proportional to 45 mV/14.5 ns, or 3.11 mV/ns.
  • FIG. 5 is a timing diagram 500 illustrating operation of integrator 310 and ADC 312 of LIDAR system 202.
  • a laser pulse generated by LIDAR system 202 is reflected by equally spaced identical scatters, which are received by the APD 304, and in turn generates electric pulses at the output of the APD 304. After passing through the amplifier 306, these echoes show up as equidistant pulses 502 of equal amplitude.
  • the integrator 310 accumulates (over a predefined ADC sampling time 506) the charge which is generated by all the reflected pulses received and the noise during a scan interval 508. Simultaneously an ADC 312 digitizes multiple samples of the charge accumulated at the output of the integrator 310 during the scan interval 508.
  • the scan interval 508 corresponds to a range of operation of the LIDAR system 202.
  • the range of operation may correspond to a range of time during which the LIDAR system 202 expects to have received all pulses 502 for a given laser pulse.
  • the digital samples 326, along with the digital time data 324 can then be provided to the processor 314 for post-processing the scan data and to correlate the digital time data 324 with the digital samples 326 to generate an estimate 328 of the total reflected energy and/or the reflectance of the object on which the laser is incident.
  • FIG. 6 is a flowchart illustrating an example process 600 of performing a reflected signal strength measurement in a LIDAR system.
  • Process 600 is one possible process performed by LIDAR system 202 of FIG. 2.
  • detector 302 of FIG. 3 receives a reflected light pulse (e.g., APD 304 receives reflected light pulse 320).
  • amplifier 306 generates an analog signal 322 in response to the reflected light pulse 320.
  • the TDC 308 generates first and second digital time data 324 that are representative of at least two STOPS corresponding to the reflected light pulse 320.
  • the integrator 310 integrates the analog signal 322 over a scan interval 508.
  • ADC 312 samples the output of the integrator 310 to generate one or more digital samples 326 that are representative of the output of the integrator 310.
  • processor 314 processes the first and second digital time data 324 along with the digital sample(s) 326 to provide an estimate 328 of the total reflected energy and/or a reflectance value of object 110.
  • FIG. 7 is a simplified block diagram of several sample aspects of components that may be employed in a LIDAR system and configured to support performing a reflected signal strength measurement as taught herein.
  • LIDAR system 700 is one possible implementation of LIDAR system 102 and/or 202.
  • a module 702 for receiving a reflected light pulse at a detector of the LIDAR system may correspond at least in some aspects to, for example, a detector 210 and/or APD 304, as discussed herein.
  • a module 704 for generating an analog signal in response to the reflected light pulse may correspond at least in some aspects to, for example, an amplifier 306, as discussed herein.
  • a module 706 for generating a first time data and a second time data may correspond at least in some aspects to, for example, TDC 308, as discussed herein.
  • a module 708 for integrating the analog signal with an integrator may correspond at least in some aspects to, for example, integrator 310, as discussed herein.
  • a module 710 for sampling an output of the integrator may correspond at least in some aspects to, for example, ADC 312, as discussed herein.
  • a module 712 for processing the first time data, the second time data, and the digital sample may correspond at least in some aspects to, for example, processor 314, LIDAR control unit 222, and/or processor 212, as discussed herein.
  • the functionality of the modules 702-712 of FIG. 7 may be implemented in various ways consistent with the teachings herein.
  • the functionality of these modules may be implemented as one or more electrical components.
  • the functionality of these modules may be implemented as a processing system including one or more processor components.
  • the functionality of these modules may be implemented using, for example, at least a portion of one or more integrated circuits (e.g., an ASIC).
  • an integrated circuit may include a processor, software, other related components, or some combination thereof.
  • the functionality of different modules may be implemented, for example, as different subsets of an integrated circuit, as different subsets of a set of software modules, or a combination thereof.
  • a given subset e.g., of an integrated circuit and/or of a set of software modules
  • FIG. 7, as well as other components and functions described herein, may be implemented using any suitable means. Such means also may be implemented, at least in part, using corresponding structure as taught herein. For example, the components described above in conjunction with the "module for" components of FIG. 7 also may correspond to similarly designated “means for” functionality. Thus, in some aspects one or more of such means may be implemented using one or more of processor components, integrated circuits, or other suitable structure as taught herein. [0056] Those of skill in the art will appreciate that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.
  • a software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor.
  • an embodiment of the invention can include a computer-readable media embodying a method for performing a reflected signal strength measurement in a LIDAR system. Accordingly, the invention is not limited to illustrated examples and any means for performing the functionality described herein are included in embodiments of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
PCT/US2016/046123 2015-09-29 2016-08-09 Lidar system with reflected signal strength measurement Ceased WO2017058367A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
BR112018006392A BR112018006392A2 (pt) 2015-09-29 2016-08-09 sistema lidar com medição de intensidade de sinal refletido
KR1020187012214A KR20180063211A (ko) 2015-09-29 2016-08-09 반사된 신호 강도 측정을 갖는 lidar 시스템
CN201680056196.3A CN108139481B (zh) 2015-09-29 2016-08-09 具有反射信号强度测量的lidar系统
JP2018515811A JP2018528437A (ja) 2015-09-29 2016-08-09 反射信号強度測定を用いるライダーシステム
EP16753542.6A EP3356853B1 (en) 2015-09-29 2016-08-09 Lidar system with reflected signal strength measurement

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201562234328P 2015-09-29 2015-09-29
US62/234,328 2015-09-29
US15/230,911 2016-08-08
US15/230,911 US11131756B2 (en) 2015-09-29 2016-08-08 LIDAR system with reflected signal strength measurement

Publications (1)

Publication Number Publication Date
WO2017058367A1 true WO2017058367A1 (en) 2017-04-06

Family

ID=58408834

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/046123 Ceased WO2017058367A1 (en) 2015-09-29 2016-08-09 Lidar system with reflected signal strength measurement

Country Status (7)

Country Link
US (1) US11131756B2 (enExample)
EP (1) EP3356853B1 (enExample)
JP (1) JP2018528437A (enExample)
KR (1) KR20180063211A (enExample)
CN (1) CN108139481B (enExample)
BR (1) BR112018006392A2 (enExample)
WO (1) WO2017058367A1 (enExample)

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6791645B2 (ja) * 2016-03-29 2020-11-25 本田技研工業株式会社 光通信装置、光通信システム、および光通信方法
WO2018107298A1 (en) * 2016-12-16 2018-06-21 Cartier Energie Eolienne Inc. System and method for monitoring blade deflection of wind turbines
US10139478B2 (en) 2017-03-28 2018-11-27 Luminar Technologies, Inc. Time varying gain in an optical detector operating in a lidar system
US10641874B2 (en) * 2017-03-29 2020-05-05 Luminar Technologies, Inc. Sizing the field of view of a detector to improve operation of a lidar system
US10509113B2 (en) * 2017-04-07 2019-12-17 ActLight SA Techniques for performing time of flight measurements
CN110809722B (zh) * 2017-07-20 2023-05-26 深圳市大疆创新科技有限公司 用于光学距离测量的系统和方法
KR102019382B1 (ko) 2017-09-29 2019-09-06 현대오트론 주식회사 거리 검출 센서 및 그것의 동작 방법
JP6907886B2 (ja) 2017-10-27 2021-07-21 オムロン株式会社 変位センサ
CN110646806B (zh) * 2018-06-26 2021-11-30 深圳市速腾聚创科技有限公司 激光雷达及激光雷达控制方法
CN108614255A (zh) * 2018-06-28 2018-10-02 中国电子科技集团公司信息科学研究院 一种读出电路
CN108845331B (zh) * 2018-06-28 2021-01-12 中国电子科技集团公司信息科学研究院 一种激光雷达探测系统
CN109245765B (zh) * 2018-06-29 2022-06-07 西安电子科技大学昆山创新研究院 Tdc_adc复用技术
CN109171787B (zh) * 2018-08-27 2021-02-26 苏州瑞派宁科技有限公司 脉冲信号的采样方法、装置和计算机程序介质
CN109581333A (zh) * 2018-11-17 2019-04-05 天津大学 基于脉冲回波超高速采样重构的激光雷达读出电路
US10877134B2 (en) * 2018-11-19 2020-12-29 Baidu Usa Llc LIDAR peak detection using splines for autonomous driving vehicles
DE102018129246B4 (de) * 2018-11-21 2020-10-15 Infineon Technologies Ag Interferenzdetektierung und -minderung für lidarsysteme
DE102018130006A1 (de) * 2018-11-27 2020-05-28 Instrument Systems Optische Messtechnik Gmbh Vorrichtung und Verfahren zur Vermessung von halbleiterbasierten Lichtquellen
JP7407734B2 (ja) * 2018-12-05 2024-01-04 ソニーセミコンダクタソリューションズ株式会社 光検出装置及び光検出装置の制御方法、並びに、測距装置
US11372090B2 (en) * 2018-12-10 2022-06-28 Baidu Usa Llc Light detection and range (LIDAR) device with SPAD and APD sensors for autonomous driving vehicles
WO2020139381A1 (en) * 2018-12-26 2020-07-02 Didi Research America, Llc System and methods for ranging operations using multiple signals
US11486984B2 (en) 2018-12-26 2022-11-01 Beijing Voyager Technology Co., Ltd. Three-dimensional light detection and ranging system using hybrid TDC and ADC receiver
US11506764B2 (en) 2018-12-26 2022-11-22 Beijing Voyager Technology Co., Ltd. System and methods for ranging operations using multiple signals
EP3683599B1 (de) * 2019-01-16 2022-06-22 Ibeo Automotive Systems GmbH Verfahren und vorrichtung zur optischen abstandsmessung
JP2022522832A (ja) * 2019-03-05 2022-04-20 ウェイモ エルエルシー リアルタイムlidar距離校正のためのシステムおよび方法
WO2020199048A1 (zh) * 2019-03-29 2020-10-08 华为技术有限公司 一种基于探测信号的测距方法及装置
DE102019207741B4 (de) * 2019-05-27 2025-10-09 Infineon Technologies Ag Ein LIDAR-System, ein Verfahren für ein LIDAR-System und ein Empfänger für ein LIDAR-System mit ersten und zweiten Umwandlungselementen
KR102266456B1 (ko) 2019-07-24 2021-07-14 현대모비스 주식회사 라이다 시스템 및 이의 신호 처리 방법
CN110308435B (zh) * 2019-08-05 2024-02-20 中国兵器工业集团第二一四研究所苏州研发中心 一种像素级的时间和强度数字转换电路
KR102812707B1 (ko) * 2019-08-30 2025-05-26 엘지전자 주식회사 라이다 시스템과 이를 이용한 자율 주행 시스템
US11486980B2 (en) * 2019-09-04 2022-11-01 Lumentum Operations Llc Lidar receiver with dual analog-to-digital converters
US11635496B2 (en) 2019-09-10 2023-04-25 Analog Devices International Unlimited Company Data reduction for optical detection
WO2021102648A1 (zh) * 2019-11-25 2021-06-03 深圳市大疆创新科技有限公司 反射率的测量方法、装置、可移动平台和计算机可读介质
CN112740067B (zh) 2019-12-23 2022-05-17 华为技术有限公司 用于雷达测距的方法、设备、雷达和车载系统
US11774564B2 (en) 2020-02-06 2023-10-03 Aptiv Technologies Limited Low-cost readout module for a lidar system
JP7068364B2 (ja) * 2020-03-02 2022-05-16 三菱電機株式会社 物体検知装置
JP7383542B2 (ja) * 2020-03-24 2023-11-20 株式会社東芝 光検出器及び距離計測装置
CN113534180A (zh) * 2020-04-14 2021-10-22 华为技术有限公司 一种飞行时间tof测量方法及装置
US11029395B1 (en) * 2020-06-30 2021-06-08 Aurora Innovation, Inc. Systems and methods for pulsed-wave LIDAR
JP7566304B2 (ja) * 2020-08-18 2024-10-15 北陽電機株式会社 光電センサおよび光測距装置
WO2022094373A1 (en) * 2020-10-30 2022-05-05 Nalu Scientific, LLC System and method for high dynamic range waveform digitization
CN112986951B (zh) * 2021-04-29 2023-03-17 上海禾赛科技有限公司 使用激光雷达测量目标物反射率的方法及激光雷达
KR20240004882A (ko) * 2021-05-14 2024-01-11 모셔널 에이디 엘엘씨 실리콘 광전자 증배관 기반 lidar
CN115032877B (zh) * 2022-05-26 2024-03-29 合肥综合性国家科学中心人工智能研究院(安徽省人工智能实验室) 脉冲的采样方法、采样系统、装置及计算机可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4853543A (en) * 1983-09-13 1989-08-01 Phillip Ozdemir Method and apparatus for detecting a tracer gas using a single laser beam
US6310682B1 (en) * 1999-07-06 2001-10-30 Quarton, Inc. System and method for laser range finder
US20120281806A1 (en) * 2011-05-04 2012-11-08 Phase Matrix, Inc. Time interpolator circuit
US20130188766A1 (en) * 2012-01-24 2013-07-25 Voxtel, Inc. Method and device for measuring duration of a time interval
US20140111812A1 (en) * 2012-05-22 2014-04-24 Korea Institute Of Industrial Technology 3d scanning system and method of obtaining 3d image
US20150116695A1 (en) * 2013-10-28 2015-04-30 Texas Instruments Incorporated Light radar signal processing apparatus, systems and methods

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5291262A (en) * 1989-03-27 1994-03-01 Dunne Jeremy G Laser surveying instrument
JP2872716B2 (ja) 1989-12-02 1999-03-24 株式会社リコー 原稿濃度検出装置
JP3044146B2 (ja) 1993-03-10 2000-05-22 三菱電機株式会社 距離測定装置
US5988862A (en) 1996-04-24 1999-11-23 Cyra Technologies, Inc. Integrated system for quickly and accurately imaging and modeling three dimensional objects
US6587573B1 (en) * 2000-03-20 2003-07-01 Gentex Corporation System for controlling exterior vehicle lights
US6906793B2 (en) 2000-12-11 2005-06-14 Canesta, Inc. Methods and devices for charge management for three-dimensional sensing
US20020117340A1 (en) * 2001-01-31 2002-08-29 Roger Stettner Laser radar based collision avoidance system for stationary or moving vehicles, automobiles, boats and aircraft
AUPR301401A0 (en) 2001-02-09 2001-03-08 Commonwealth Scientific And Industrial Research Organisation Lidar system and method
US6448923B1 (en) * 2001-03-29 2002-09-10 Dusan S. Zrnic Efficient estimation of spectral moments and the polarimetric variables on weather radars, sonars, sodars, acoustic flow meters, lidars, and similar active remote sensing instruments
US6678039B2 (en) * 2001-05-23 2004-01-13 Canesta, Inc. Method and system to enhance dynamic range conversion useable with CMOS three-dimensional imaging
US6665063B2 (en) * 2001-09-04 2003-12-16 Rosemount Aerospace Inc. Distributed laser obstacle awareness system
US6975251B2 (en) 2002-06-20 2005-12-13 Dakota Technologies, Inc. System for digitizing transient signals with waveform accumulator
US8242428B2 (en) 2007-12-06 2012-08-14 The United States Of America As Represented By The Secretary Of The Army Method and system for lidar using spatial information from a light source in combination with nonspatial information influenced by the subject to derive an image
US7236235B2 (en) * 2004-07-06 2007-06-26 Dimsdale Engineering, Llc System and method for determining range in 3D imaging systems
US8085388B2 (en) * 2005-02-01 2011-12-27 Laser Projection Technologies, Inc. Laser radar projection with object feature detection and ranging
WO2007146587A2 (en) 2006-06-15 2007-12-21 Koninklijke Philips Electronics, N.V. Integrated multi-channel time-to-digital converter for time-of-flight pet
JP5302244B2 (ja) * 2010-02-26 2013-10-02 浜松ホトニクス株式会社 距離画像センサ
US8619239B2 (en) * 2011-01-28 2013-12-31 Analog Modules Inc. Accuracy of a laser rangefinder receiver
JP2012237625A (ja) 2011-05-11 2012-12-06 Honda Motor Co Ltd 物体距離検出装置
JP6059722B2 (ja) 2011-08-03 2017-01-11 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. デジタルシリコン光電子増倍管アレイに関する位置敏感な読み出しモード
EP2626722B1 (de) 2012-02-07 2016-09-21 Sick AG Optoelektronischer Sensor und Verfahren zur Erfassung und Abstandsbestimmung von Objekten
PL2800212T3 (pl) 2013-05-03 2019-07-31 Fotona D.O.O. Sposób działania układu laserowego
US9476988B2 (en) 2013-05-09 2016-10-25 Samsung Electronics Co., Ltd. Method, apparatus and system for reducing power consumption in GNSS receivers
US9069080B2 (en) * 2013-05-24 2015-06-30 Advanced Scientific Concepts, Inc. Automotive auxiliary ladar sensor
CN103630908B (zh) 2013-12-08 2016-04-13 中国科学技术大学 分子散射测风激光雷达中激光频谱测量校准方法
CN103698305B (zh) 2013-12-30 2016-03-02 中国科学院遥感与数字地球研究所 一种实时观测大气透射率的方法与系统
US9354052B2 (en) * 2014-01-24 2016-05-31 Raytheon Company Shared-aperture electro-optic imaging and ranging sensor
CN103760570B (zh) 2014-02-18 2016-01-20 北京理工大学 一种基于仿人眼视觉机理的激光三维成像系统
EP2955539B1 (en) * 2014-06-12 2018-08-08 Delphi International Operations Luxembourg S.à r.l. Distance measuring device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4853543A (en) * 1983-09-13 1989-08-01 Phillip Ozdemir Method and apparatus for detecting a tracer gas using a single laser beam
US6310682B1 (en) * 1999-07-06 2001-10-30 Quarton, Inc. System and method for laser range finder
US20120281806A1 (en) * 2011-05-04 2012-11-08 Phase Matrix, Inc. Time interpolator circuit
US20130188766A1 (en) * 2012-01-24 2013-07-25 Voxtel, Inc. Method and device for measuring duration of a time interval
US20140111812A1 (en) * 2012-05-22 2014-04-24 Korea Institute Of Industrial Technology 3d scanning system and method of obtaining 3d image
US20150116695A1 (en) * 2013-10-28 2015-04-30 Texas Instruments Incorporated Light radar signal processing apparatus, systems and methods

Also Published As

Publication number Publication date
EP3356853B1 (en) 2020-09-23
JP2018528437A (ja) 2018-09-27
CN108139481A (zh) 2018-06-08
US20170090019A1 (en) 2017-03-30
EP3356853A1 (en) 2018-08-08
CN108139481B (zh) 2022-03-01
BR112018006392A2 (pt) 2018-10-09
KR20180063211A (ko) 2018-06-11
US11131756B2 (en) 2021-09-28

Similar Documents

Publication Publication Date Title
EP3356853B1 (en) Lidar system with reflected signal strength measurement
US11022680B2 (en) Distance measuring device with SPAD array and range walk compensenation
EP2198323B9 (en) Time delay estimation
US11204420B2 (en) Distance measurement apparatus
EP3571520B1 (en) Method and apparatus for variable time pulse sampling
DK2909649T3 (en) LONG-TERM TELEMETRY FOR SMALL GOALS
JP2019516114A (ja) 時間領域波形マッチングによるレーザ測距システム及びその方法
CN107907885B (zh) 一种基于单光子计数方法的水下目标探测装置
CN106054205A (zh) 一种激光测距装置及其激光测距方法
Hintikka et al. Experimental investigation into laser ranging with sub-ns laser pulses
JP2015219120A (ja) 距離測定装置
US10429515B2 (en) Method and apparatus for GNSS signal tracking
US20230288538A1 (en) Laser receiving system and laser ranging system
CN110988901B (zh) 一种tdc结合相位激光测距方法及系统
KR20130116900A (ko) 위성 포지셔닝 신뢰도를 추정하는 방법 및 장치
JP5749262B2 (ja) 不連続衛星測位システム追跡における搬送波位相処理
CN210129035U (zh) 激光雷达回波数据提取装置
CN116917761A (zh) 探测装置及探测方法
WO2020113360A1 (zh) 一种采样电路、采用方法及测距装置、移动平台
CN210072076U (zh) 方位探测装置
CN119575390A (zh) 一种激光雷达探测系统及方法
CN120428195A (zh) 信号处理的装置、方法和系统
CN119044923A (zh) 一种fmcw激光雷达信号处理方法及系统
JP2007212157A (ja) 光学式測距装置
CN121165113A (en) Unmanned aerial vehicle-mounted single-photon laser radar double-pulse door control depth measurement method and system thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16753542

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2018515811

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112018006392

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 20187012214

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2016753542

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 112018006392

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20180328