WO2022161481A1

WO2022161481A1 - Time of flight distance measurement method and system, and device

Info

Publication number: WO2022161481A1
Application number: PCT/CN2022/074832
Authority: WO
Inventors: 刘浏; 闫敏
Original assignee: 深圳奥锐达科技有限公司
Priority date: 2021-01-28
Filing date: 2022-01-28
Publication date: 2022-08-04
Also published as: CN112817001B; CN112817001A

Abstract

A time of flight distance measurement method and system, and a device. The method comprises: acquiring an initial histogram, wherein the initial histogram comprises a continuous time interval, and the time interval includes a count value of photons in a pulse beam that is emitted by a transmitter, reflected by a target and collected by a collector (S51); determining a search section, wherein the search section comprises a plurality of time intervals, and the number of time intervals is determined according to the pulse width of the pulse beam and the size of the time interval (S52); performing a search on the initial histogram on the basis of the search section, and extracting a search section with the maximum total number of photons, and a corresponding histogram index, wherein the histogram index corresponds to the first time interval in the search section (S53); and calculating a second time of flight by means of taking the search section with the maximum total number of photons as a second histogram, and calculating a target time of flight according to the second time of flight, and a first time of flight, in the initial histogram, corresponding to the histogram index of the search section with the maximum total number of photons (S54).

Description

A time-of-flight ranging method, system and device

This application claims the priority of the Chinese patent application filed on January 28, 2020 with the application number 202110120018.5 and the invention title is "a time-of-flight ranging method, system and device", the entire contents of which are incorporated by reference in this application.

technical field

The present invention relates to the technical field of ranging, in particular to a time-of-flight ranging method and related systems and equipment.

Background technique

The time of flight principle (ToF, Time of Flight) can be used to measure the distance of the target to obtain a depth image containing the depth value of the target, and the distance measurement system based on the time of flight principle has been widely used in consumer electronics, unmanned aerial vehicles, AR/VR and other fields. The distance measurement system based on the time-of-flight principle usually includes an emitter and a collector. The emitter is used to emit a pulsed beam to illuminate the target field of view, and the collector is used to collect the reflected beam, and the time-of-flight of the beam from the emission to the reflected reception is calculated to calculate the distance of the object. . Among them, the time-to-digital converter (TDC) is used to record the flight time of photons from emission to collection and generate photon signals, and use the photon signals to find the corresponding time bin (time interval) in the histogram circuit, so that the The photon count value is increased by 1. After a large number of repetitive pulse detections are performed, the histogram of the photon count corresponding to the time signal can be obtained by statistics, the pulse peak position in the histogram can be determined, and the distance of the object can be calculated according to the flight time corresponding to the pulse peak position.

In the ranging system based on the time-of-flight principle, the size of the time interval is related to the resolution of the system. In order to improve the resolution of the system, it is usually necessary to set a smaller time interval, and the number of corresponding time intervals increases and leads to the amount of stored data. As a result, the transmission of data and subsequent computations are complex and time-consuming.

SUMMARY OF THE INVENTION

The purpose of the present invention is to overcome the deficiencies of the above-mentioned prior art, and to propose a time-of-flight ranging method, system and device to solve at least one technical problem in the above-mentioned prior art.

For achieving the above object, the present invention adopts the following technical solutions:

A time-of-flight ranging method, comprising: acquiring an initial histogram, wherein the initial histogram includes continuous time intervals, the time intervals include pulses collected by a collector after a pulse beam emitted by a transmitter is reflected by a target The count value of photons in the light beam; determine a search interval, the search interval includes a plurality of time intervals, and the number of the plurality of time intervals is determined according to the pulse width of the pulse beam and the size of the time interval; based on the search interval pair The initial histogram is searched, and the search interval with the largest total number of photons and the corresponding histogram index are extracted; the histogram index corresponds to the first time interval in the search interval; the search interval with the largest total number of photons is used as the second The histogram calculates the second flight time, and calculates the target flight time according to the second flight time and the first flight time corresponding to the first flight time in the initial histogram of the histogram index of the search interval with the largest total number of photons.

In some embodiments, the determining the search interval includes: in the initial histogram, continuous n time intervals starting from any time interval constitute one of the search intervals; wherein, n=W/Δt, W represents the pulse width of the pulsed beam, and Δt represents the size of the time interval.

In some embodiments, the searching the initial histogram based on the search interval, and extracting the search interval with the largest total number of photons and the corresponding histogram index, includes: calculating a sliding sum method in each search interval. The total number of photons is searched in sequence, where the total number of photons in the first search interval of the initial search is taken as the total number of first photons, and the total number of photons in each search interval of the subsequent search is recorded as the total number of second photons; if the total number of first photons is less than the total number of second photons, update the value of the total number of first photons to the current value of the total number of second photons, and then perform the next search until the last search interval is reached, and extract the search interval with the largest total number of photons and its corresponding The histogram index of .

In some embodiments, the method further includes: calculating the signal-to-noise ratio of the signal corresponding to the search interval with the largest number of extracted photons, and judging whether the extraction result is accurate according to the signal-to-noise ratio.

In some embodiments, the determining whether the extraction result is accurate according to the signal-to-noise ratio includes:

Judging whether the signal-to-noise ratio meets the preset signal-to-noise ratio threshold, if so, the extraction result is accurate; if not, the extraction result is inaccurate, and the measurement of the next frame is performed; wherein, the preset signal-to-noise ratio The ratio threshold is obtained according to the method of pre-calibration or experimental measurement.

In some embodiments, the calculation process of the signal-to-noise ratio includes:

First, calculate the number of noise photons according to the initial histogram;

Then, the signal-to-noise ratio is calculated using the following formula:

Among them, SNR is the signal-to-noise ratio; PluseBinDate represents the total number of photons at the pulse position; DCValue represents the number of noise photons; PluseBinNum represents the number of time intervals corresponding to the pulse, that is, the number of time intervals in the search interval.

In some embodiments, the calculating the number of noise photons according to the initial histogram includes:

Selecting a local area away from the pulse peak position from the initial histogram;

The total value of photon counts in the local area is averaged according to the number of time intervals in the local area, and recorded as the number of noise photons.

A region other than the pulse position in the initial histogram is selected, and the total value of photon counts in this region is averaged according to the number of time intervals in this region, and recorded as the number of noise photons.

The present invention also proposes a time-of-flight ranging system, comprising:

a transmitter for emitting a pulsed beam towards an object;

a collector for collecting photons in the pulsed beam reflected back by the object and forming a photon signal;

A processing circuit, connected with the transmitter and the collector, is used for processing the photon signal to form an initial histogram, and processing the initial histogram according to the aforementioned time-of-flight ranging method to obtain the object's distance information.

The present invention further provides a time-of-flight ranging device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the foregoing when the processor executes the computer program Time-of-flight ranging method.

The beneficial effects of the technical solution of the present invention are as follows: the ranging method of the present invention determines the position of the pulse signal by searching the initial histogram, and extracts the pulse signal for independent calculation, which can greatly save the calculation time, and the setting of the judgment conditions has ensured The extracted pulse signal is an effective signal, which makes the calculated flight time more accurate.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 is a schematic diagram of a time-of-flight ranging system according to an embodiment of the present invention;

2 is a flowchart of a time-of-flight ranging method according to an embodiment of the present invention;

3 is a schematic diagram of an initial histogram in an embodiment of the present invention;

4 is a schematic diagram of a second histogram in an embodiment of the present invention;

FIG. 5 is a flowchart of a time-of-flight ranging method according to another embodiment of the present invention.

Detailed ways

In order to make those skilled in the art better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Embodiments are part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It should be noted that the terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. In addition, unless otherwise expressly specified and limited, the terms "installed", "connected", "connected", "fixed" and other terms should be understood in a broad sense, for example, it may be a fixed connection, a detachable connection, or a fixed connection. It can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be an internal connection between two elements or an interaction relationship between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

It is also to be understood that the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top" ”, “bottom”, “inside” and “outside” and other indicated orientations or positional relationships are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying the indicated A device or element must have a particular orientation, be constructed and operate in a particular orientation, and therefore should not be construed as limiting the invention.

As shown in FIG. 1 , the time-of-flight ranging system 10 according to the embodiment of the present invention includes a transmitter 11 , a collector 12 , and a processing circuit 13 connected to the transmitter and the collector at the same time. The transmitter 11 includes a light source 111 composed of one or more lasers, an emission optical element 112 and a driver 113, etc. The light source 111 is used to transmit a pulsed beam 30 to the target object 20, and at least part of the pulsed beam is reflected by the target object to form a reflected beam 40. to collector 12. The collector 12 includes a pixel array 121 composed of a plurality of pixels for collecting photons in the reflected beam 40 and outputting photon signals, and the processing circuit 13 synchronizes the trigger signals of the transmitter 11 and the collector 12 to calculate the photons in the beam from the emission. flight time required to receive.

In one embodiment, the light source 111 is a VCSEL array light source chip formed by growing multiple VCSEL light sources on a single semiconductor substrate. The light source 111 can emit a pulse beam at a certain frequency (pulse period) under the control of the driver 113, and the pulse beam is projected onto the target scene through the emission optical element 112 to form an illumination spot, wherein the frequency is set according to the measurement distance.

The collector 12 includes the pixel array 121, the filter unit 122, the receiving optical element 123, etc. The receiving optical element 123 images the spot beam reflected by the target onto the pixel array 121, and the pixel array 121 includes a plurality of pixels for collecting photons, the The pixel may be one of the single-photon devices that collect photons, such as APD, SPAD, SiPM, etc. The photon collected by the pixel array 121 is regarded as a photon detection event and a photon signal is output. In one embodiment, the pixel array 121 comprises a plurality of SPADs that can respond to an incident single photon and output a photon signal indicative of the corresponding arrival time of the received photon at each SPAD. Generally, it also includes a readout circuit (not shown in the figure) composed of one or more of a signal amplifier, a time-to-digital converter (TDC), a digital-to-analog converter (ADC) and other devices connected to the pixel array 121 . ), these circuits can be integrated with the pixels as a part of the collector or as a part of the processing circuit 13 , which will be regarded as a part of the processing circuit 13 for the convenience of description later.

The processing circuit 13 is used for receiving the photon signal and processing to calculate the flight time of the photon from emission to reception, and further calculates the distance information of the target. In one embodiment, the processing circuit 13 includes a TDC circuit and a histogram memory, the TDC circuit receives the photon signal for determining the time of flight of the photon from emission to acquisition, and generates a time code representing the time of flight information, and uses the time code to find the histogram The corresponding position in the memory, and the value stored in the corresponding position of the histogram memory is increased by "1", and the initial histogram is constructed according to the position of the histogram memory as the time bin (time interval).

As shown in FIG. 2 , the ranging method in which the processing circuit 13 receives the photon signal and processes it to calculate the time-of-flight of the photon from emission to reception includes the following steps S1 to S4:

S1. Calculate the number of noise photons according to the initial histogram. In the distance measurement system based on time of flight, the processing circuit 13 controls the transmitter 11 to emit a pulse beam toward the target area, and part of the pulse beam reflected by the target is incident on the collector 12, and the collector 12 collects photons in the reflected pulse beam and generates The photon signal containing the time-of-flight of the photon is received by the processing circuit 13 and processed to form an initial histogram. The initial histogram includes consecutive time intervals, each time interval representing the count value of photons collected by the collector during the detection period.

The histogram, which may be referred to as detection data, is used to represent the temporal distribution of photons collected by the collector 12 during the detection period. FIG. 3 shows an exemplary initial histogram of an embodiment of the present invention. Generally, the time interval 301 is in the range of ten to several tens of picoseconds, and the photon signal of a pulsed beam is correspondingly distributed in multiple consecutive time intervals in the histogram, for example, the corresponding pulse of a pulsed beam in the histogram If the position is the interval 304, the time of the time interval where the pulse peak position is located is selected as the flight time of the pulse beam, and the middle amount of the time interval is generally selected as the time of the time interval. In the present invention, it is assumed that the pulse width of the pulse beam is 2ns, and the size of the time interval in the histogram is 100ps, then the photon signal of one pulse is correspondingly distributed in 20 consecutive time intervals in the histogram, that is, in the initial histogram The number of time intervals at the mid-pulse position is 20 (only 5 are exemplarily drawn in the figure). In the following specific description, the numerical value of this embodiment is used as an example for description, but the numerical value cannot be used as a limitation of the present invention.

During the ranging process, when the collector is triggered to start collecting photons, there are a large number of noise photons in the histogram due to the influence of ambient light signals, interfering light signals and noise generated by the collector itself, and the noise photons are distributed in part or During the entire time interval, there is interference with the calculation of the time-of-flight of the pulsed beam.

In view of this, first, the number of noise photons is calculated from the initial histogram. In one embodiment, the number of noise photons is calculated by intercepting a local area from an initial histogram. As shown in the initial histogram shown in FIG. 3 , a local area away from the pulse peak position is selected according to the pulse peak position in the initial histogram for calculating noise. number of photons. For example, taking the time interval at the middle position of the initial histogram as the dividing line, if the pulse peak position is in the second half of the initial histogram, select a local area in the first half of the initial histogram to calculate the number of noise photons, that is, select the local area and calculate the number of noise photons. The average number of photons in all time intervals in this area is recorded as the number of noise photons. Similarly, if the pulse peak position is in the first half of the initial histogram, select a local area from the second half to calculate the number of noise photons.

In one embodiment, the number of noise photons is calculated according to all the time intervals of the initial histogram, that is, the total number of photons in the whole time interval is excluded from the sum of the number of photons at the pulse peak position, and the average value is recorded as the number of noise photons. The specific calculation process as follows:

DCValue=(BinValueSum-PluseBinDate)/(BinNum-PluseBinNum)≈(BinValueSum-PluseBinDate)/BinNum

Among them, DCValue represents the number of noise photons, BinValueSum represents the total number of photons in all time intervals, PluseBinDate represents the total number of photons at the pulse position, BinNum represents the number of all time intervals, and PluseBinNum represents the number of time intervals corresponding to the pulse.

S2. Determine pulse extraction conditions according to the number of noise photons, and search the initial histogram according to the pulse extraction conditions to extract at least one search interval and a corresponding histogram index that meet the pulse extraction conditions; The search interval includes a plurality of time intervals, the number of time intervals in the search interval is determined according to the pulse width of the pulse beam emitted by the transmitter, and the histogram index corresponds to the first time interval in the search interval.

In the embodiment of the present invention, an index is added to the initial histogram to sort all the time intervals, then the corresponding time interval can be quickly located and the flight time corresponding to the time interval can be determined according to the histogram index. After the pulse extraction condition is determined, the histogram is searched, the search interval satisfying the pulse extraction condition is determined, and all the time intervals in the search interval and the histogram index corresponding to the first time interval in the search interval are extracted. Store the search interval and the corresponding histogram index in the preset buffer register. The buffer register is set to use FIFO (first-in, first-out) mode. When multiple search intervals are extracted, each can be distinguished by the histogram index. Search for bins and quickly locate each search bin on the initial histogram.

In one embodiment, the pulse extraction condition is set as the pulse extraction threshold Th, and the pulse extraction threshold is calculated according to the number of noise photons calculated in step S1. When the total number of photons in a certain search interval is greater than the pulse extraction threshold, it is considered that The search interval conforms to the pulse extraction condition, and if the search interval is extracted, it is considered that a pulse has been searched in the initial histogram. The main purpose of the search is to completely extract multiple time intervals reflecting a certain pulse signal in the initial histogram for separate calculation. The search interval includes multiple time intervals, and the number of time intervals depends on the pulse width and the size of the time interval. Sure. When the pulse width is 2ns and the time interval is 100ps, the search interval is set to include 20 time intervals (that is, the photon signal corresponding to one pulse), and the interval 302 shown in FIG. 3 is recorded as a search interval (only 5 time intervals are drawn exemplarily).

Determining the pulse extraction threshold and how to search the initial histogram are described in detail below. Specifically, the total number of noise photons contained in any search interval is determined according to the number of noise photons calculated in step S1 (the number of noise photons calculated in step S1 is multiplied by the number of time intervals in the search interval to obtain the total number of noise photons in the search interval), and set A number of photons slightly higher than the total number of noise photons is used as the pulse extraction threshold. If the total number of photons in a certain search interval is greater than the pulse extraction threshold, the search interval is extracted and stored in the buffer register.

The search of the initial histogram adopts the sliding sum method, that is, select any time interval as the starting point, select the time interval satisfying the preset number to form a search interval, calculate the total number of photons in the search interval, and judge whether the total number of photons is greater than the pulse extraction. threshold. If it is greater than the pulse extraction threshold, the search interval is considered to be a pulsed beam signal, and all the time intervals in the search interval and the corresponding histogram index are extracted and stored in the pre-stored buffer register, and the histogram index corresponds to the search interval. the first time interval.

The sliding sum method is specifically:

Among them, ValueSum(index) represents the total number of photons in the search interval with a certain index index as the starting point, and value(index+i) represents the number of photons in the time interval of index (index+i). The first time interval starts to perform sliding summation, then the index is set to the histogram index index1 of the first time interval, that is, from the first time interval as the starting point, 20 consecutive time intervals are selected for photon count summation. If the total number of photons is less than the pulse extraction threshold, the index is adjusted to index2, and the second time interval is used as the starting point to select 20 time intervals to calculate the total number of photons. If it is greater, the search interval and the corresponding histogram index index2 are extracted and stored in the buffer register. , as shown in the search interval 304 in FIG. 3 . And continue to adjust the index to index3 to search with the third time interval as the starting point, until the index is adjusted to the last histogram index and the search is completed.

In the process of storing multiple extracted search intervals, when the stored search interval exceeds the storage upper limit of the buffer register, write blocking is performed, and the number of extracted search intervals needs to be counted. If the multi-frame count result is greater than or equal to the storage upper limit of the buffer register, indicating that the set pulse extraction threshold is too low, a correction term ΔTh needs to be added to the threshold, and the pulse extraction threshold is set to Th+ΔTh, which is used to reduce the false alarm probability and reduce the false alarm caused by noise. .

When the pulse extraction condition is set as the pulse extraction threshold, since a certain search interval extracted may be a false trigger caused by a noise signal, in order to improve the extraction accuracy, it is necessary to filter the extracted search intervals. also includes:

Step S21 , setting filtering conditions, and filtering the extracted search interval.

In one embodiment, the screening condition is the received pulse signal strength, and specifically, the proposed search interval is screened according to the total number of received pulse signal photons or the pulse signal-to-noise ratio. For example, taking the total number of photons receiving the pulse signal as the screening condition, for the extracted search interval, if the total number of photons in a certain search interval is much lower than the total number of photons in other search intervals, the search interval is considered to be a noise signal, and the corresponding The search range is eliminated. Another example is to select the pulse signal-to-noise ratio to filter the extracted search interval. The calculation formula of the signal-to-noise ratio SNR is:

Among them, PluseBinDate is used to represent the total number of photons at the pulse position, that is, ValueSum in step S1, and PluseBinNum represents the number of time intervals corresponding to the pulse, that is, the size of the search interval. By calculating the signal-to-noise ratio of each extracted search interval, the search interval with too low signal-to-noise ratio is eliminated.

In one embodiment, the filtering condition is the correlation between the received pulse waveform and the transmitted pulse waveform. Each extracted search interval can restore a received waveform. If it is a valid signal, the correlation between the received waveform and the transmitted pulse waveform is high. Based on this, the low correlation can be eliminated by calculating the correlation between the received waveform and the transmitted pulse waveform. The search interval corresponding to the received waveform is the noise signal.

It can be understood that by setting the pulse filter conditions to filter the extracted search interval, the influence of the noise signal can be reduced; on this basis, the pulse extraction threshold in step S2 can be appropriately relaxed to allow the extraction to a certain extent. noise signal, which is conducive to the extraction of weak pulse signals.

After the pulse screening is performed, step S3 can be executed to calculate the flight time. However, due to some system design reasons or special application scenarios, multiple search areas are still retained after screening. For example, 2-3 search areas may still be retained, and multiple search areas need to be sorted to select the target. The time-of-flight calculation is performed on the search interval corresponding to the echo signal, which specifically includes:

Step S22: Sort the filtered search intervals according to the preset multi-echo mode, and select a corresponding search interval.

Among them, the preset multi-echo mode includes the number of echoes and sorting characteristics, and needs to be selected according to the actual application scenario and requirements. The sorting feature includes echo intensity or echo time. The echo intensity can be represented by the total number of photons in each search interval. The strongest echo or the weakest echo can be determined according to the total number of photons; the echo time can be used in each search interval. The corresponding histogram index is represented, and the nearest echo or the farthest echo can be determined according to the order of the indices.

In one embodiment, when the distance measurement system is provided with a protective cover, the material of the protective cover is generally transparent glass. When the transmitter emits a pulsed beam through the protective cover and projects to the target field of view, part of the pulsed beam is reflected by the protective cover. Enter the collector, and finally form an echo signal in the histogram. According to the characteristic that the protective cover is close to the ranging system, the sorting feature of the multi-echo mode combined with the echo time can be preset, and the nearest echo is regarded as the protection For the echo signal reflected back by the cover, it is not necessary to perform time-of-flight calculation on the search interval corresponding to the echo, and the calculation of step S3 is performed from the second echo.

In one embodiment, under conditions such as rain and fog or sticky water on the surface of the ranging system, a false echo signal will be generated before the true echo of the target. In this case, a longer echo needs to be selected to avoid false echoes If the influence of the echo signal is not affected, you can set the dual echo and the farthest echo to sort the echo signals accordingly. You can directly select the farthest echo to calculate the flight time, and avoid the interference of false echoes.

In one embodiment, when there is glass in the acquisition target or a target located behind the glass is acquired, most of the emitted pulse beam will pass through the glass and irradiate on the target due to the reflectivity and transmittance of the glass itself, but there are still some A part of the pulse beam is reflected by the glass to form a reflected beam and incident into the collector, and two echo signals are formed in the histogram. Due to the low reflectivity of the glass, the intensity difference between the two echo signals formed is large, then The search interval corresponding to the strongest echo is selected for time-of-flight calculation by setting the echo intensity sorting.

It can be understood that the preset multi-echo mode and pulse sorting mode can be arbitrarily set according to the actual situation, and finally one or more search intervals are selected to perform the calculation of step S3.

In some embodiments, the pulse extraction condition further includes calculating the correlation between the received pulse waveform and the transmitted pulse waveform, or calculating the pulse signal-to-noise ratio in the search interval. According to the number of noise photons calculated in step S1, the threshold value of waveform correlation degree or signal-to-noise ratio is set, and the search interval higher than the threshold value and the corresponding histogram index are determined and extracted and stored in the buffer register. If the conditions are met, steps S21 and S22 need not be executed again. In one embodiment, the formula for calculating the correlation between the received pulse waveform and the transmitted pulse waveform is:

Among them, weight(i) represents the weight applied to the ith time interval, and the histogram is also searched by the method of sliding summation. The search process is the same as above, and will not be repeated here.

In one embodiment, the calculation formula of the pulse signal-to-noise ratio method is:

The specific search process is the same as that described above, and will not be repeated here.

S3. Calculate the second flight time using the search interval finally extracted in step S2 as the second histogram, and calculate the first flight time corresponding to the first flight time in the initial histogram according to the second flight time and the histogram index Time calculates the time-of-flight of a pulsed beam from launch to reception.

FIG. 4 is a schematic diagram of a second histogram in an embodiment of the present invention. For the extracted at least one search interval, the corresponding flight time is calculated separately as the second histogram, which is recorded as the second flight time. In an embodiment of the present invention, the size of the time interval is 100ps, the number of n is 20, and the ordinate range of the second histogram is 0-2ns. Specifically, the second flight time is calculated by using the centroid method, and the specific calculation formula is:

Among them, t ₂ represents the second flight time, T _j represents the flight time corresponding to each time interval, C _j represents the number of photons contained in each time interval, j represents the sequence number of the time interval, and n represents all the time intervals in the search interval quantity.

At the same time, according to the stored histogram index, the first time of flight t ₁ corresponding to the first time interval 305 in the search interval in the initial histogram can be correspondingly obtained, then the time of flight of the pulse beam from emission to reception is the first flight time Sum with the second flight time.

Wherein, before using the second histogram to calculate the second time of flight, the second histogram can be filtered according to the number of noise photons calculated in step S1, so as to reduce the influence of noise photons and improve the accuracy of the calculation.

S4. Finally, use the time of flight of the pulsed beam calculated in step S3 to calculate the distance of the object from the time of flight to the receiving.

FIG. 5 is a flowchart of a distance measurement method according to another embodiment of the present invention. Referring to FIG. 5 , the distance measurement method includes the following steps:

S51. Acquire an initial histogram, where the initial histogram includes a continuous time interval, and the time interval includes the count value of photons in the pulsed beam collected by the collector after the pulsed beam emitted by the transmitter is reflected by the target .

As shown in FIG. 1 , in the distance measurement system, the processing circuit 13 controls the transmitter 11 to emit a pulse beam toward the target area, and part of the pulse beam reflected by the target is incident on the collector 12 , and the collector 12 collects photons in the reflected pulse beam. and generate a photon signal including the time of flight of the photon, the processing circuit 13 receives the photon signal and processes it to form an initial histogram, the initial histogram includes continuous time intervals, and each time interval is used to represent the photon collected by the collector during the detection period. count value.

S52. Determine a search interval, where the search interval includes a plurality of time intervals, and the number of the time intervals is determined according to the pulse width of the pulse beam.

Specifically, in the initial histogram, the photon signal of a pulse is correspondingly distributed in consecutive n time intervals in the histogram, and the consecutive n time intervals constitute a search interval; wherein, n=W/Δ t, W represent the pulse width of the pulsed beam, Δt represents the size of the time interval. For example, when the pulse width of the pulse beam is 2ns and the size of the time interval in the histogram is 100ps, the search interval is set to include 20 time intervals, as shown in interval 302 in FIG. The time interval, according to this example, should include 20 time intervals) can be recorded as a search interval.

S53. Search the initial histogram based on the search interval, and extract the search interval with the largest total number of photons and the corresponding histogram index; the histogram index corresponds to the first time interval in the search interval.

In this embodiment, an index is added to the initial histogram to sort all the time intervals, then the corresponding time interval can be quickly located and the flight time corresponding to the time interval can be determined according to the histogram index. Then, the initial histogram is searched according to the search interval determined in step S52, and the search interval with the largest total number of photons and the corresponding histogram index are extracted. The total number of photons in each search interval is calculated by the sliding sum method, the total number of photons in the initial search is taken as the total number of first photons, and the total number of photons in subsequent searches is recorded as the total number of second photons. If the total number of first photons is less than the total number of second photons , then update the value of the first total number of photons to the second total number of photons and then perform the next search, where the method for calculating the total number of photons is:

Wherein, index represents the histogram index, index represents the histogram index of the first time interval in the search interval, and PluseBinNum represents the size of the search interval.

In one embodiment, the search for the initial histogram starts from the first time interval in the histogram, and the index is set to the histogram index index1 of the first time interval, that is, from the first time interval as the starting point, select continuous 20 time intervals are used as the first search interval to perform photon count summation, record the summation result as the first total number of photons and pre-store, and then select the second search interval as the starting point to calculate the total number of photons is the total number of second photons. Compare the size of the total number of the first photons and the total number of the second photons: if the total number of the first photons is smaller than the total number of the second photons, the value of the total number of the first photons is updated to the value of the total number of the second photons, otherwise it is not updated. Then select the third search interval at the third time interval to calculate the total number of photons and compare the size with the latest total number of first photons. If the total number of first photons is less than the current total number of second photons (that is, the total number of photons in the third search interval) , the value of the total number of first photons is updated to the current value of the total number of second photons, and then the next search is performed, and this cycle is repeated until the entire histogram is searched, and the search interval with the largest total number of photons and the corresponding histogram are extracted. Figure index. It will be appreciated that, in some embodiments, the search for the initial histogram may start at any time interval selected for the histogram.

S54. Calculate the second flight time by using the search interval with the largest total number of photons as the second histogram, and calculate the second flight time according to the second flight time and the first flight time corresponding to the first flight time in the initial histogram according to the histogram index of the search interval with the largest photon total number. Calculate the flight time of the pulsed beam from launch to reception, that is, the target flight time. Assuming that the second flight time is t ₂ , and the histogram index of the search interval with the largest total number of photons corresponds to the flight time t ₁ in the initial histogram, then the final flight time t=t ₁ +t ₂ , according to t, namely The distance of an object can be measured.

Further, in step S53, the method may further include: calculating the signal-to-noise ratio of the signal corresponding to the search interval with the largest total number of extracted photons, and judging whether the extraction result is accurate according to the signal-to-noise ratio.

During the search and extraction process, due to the extraction condition of the maximum total number of photons, when no echo signal is detected in the original histogram, a search interval can still be extracted for calculating the flight time, which may cause measurement errors. Therefore, the searched interval can also be judged to verify the accuracy of the extraction result.

Specifically, by calculating the signal-to-noise ratio of the signal corresponding to the extracted search interval, if the signal-to-noise ratio meets the preset threshold, it is considered that the extraction result is accurate. The preset threshold may be determined by methods such as pre-calibration, experimental measurement, and the like.

First, the number of noise photons is calculated from the initial histogram. In one embodiment, the number of noise photons is calculated by intercepting a local area from an initial histogram. As shown in the initial histogram shown in FIG. 3 , a local area away from the pulse peak position is selected according to the pulse peak position in the initial histogram for calculating noise. number of photons. For example, taking the time interval at the middle position of the initial histogram as the dividing line, if the pulse peak position is in the second half of the initial histogram, select a local area in the first half of the initial histogram to calculate the number of noise photons, that is, select the local area and calculate the number of noise photons. The average number of photons in all time intervals in this area is recorded as the number of noise photons. Similarly, if it is located in the first half, select a local area from the second half to calculate the number of noise photons.

In one embodiment, the number of noise photons is calculated according to all the time intervals of the initial histogram, that is, the total number of photons in the entire time interval is removed from the sum of the number of photons at the pulse position, and the average value is recorded as the number of noise photons. The specific calculation process is as follows :

Among them, DCValue represents the number of noise photons, BinValueSum represents the total number of photons in all time intervals, PluseBinDate represents the total number of photons at the pulse position, that is, the total number of photons in the search interval, BinNum represents the number of all time intervals, and PluseBinNum represents the corresponding pulses The number of time intervals, that is, the number of time intervals in the search interval (that is, the size of the search interval).

Then calculate the signal-to-noise ratio of the extracted search interval, and the calculation formula of the signal-to-noise ratio is:

If the signal-to-noise ratio meets the preset threshold, it is considered that the extraction result is accurate, and step S54 is performed according to the extracted search interval; if not, the distance measurement of the next frame is performed.

As another embodiment of the present invention, a time-of-flight ranging device is also provided, including: a memory, a processor, and a computer program stored in the memory and executable on the processor; wherein the processor When the computer program is executed, steps S1-S4 of the time-of-flight ranging method described in the foregoing embodiments are implemented; or step S51 of the time-of-flight ranging method described in the foregoing embodiments is realized when the processor executes the computer program -S54.

Embodiments of the present invention may include or utilize a special purpose or general purpose computer including computer hardware, as discussed in more detail below. Embodiments within the scope of the present invention also include physical and other computer-readable media for carrying or storing computer-executable instructions and/or data structures. Such computer-readable media can be any available media that can be accessed by a general purpose or special purpose computer system. Computer-readable media that store computer-executable instructions are physical storage media. Computer-readable media carrying computer-executable instructions are transmission media. Thus, by way of example and not limitation, embodiments of the present invention may include at least two distinct computer-readable media: physical computer-readable storage media and transmission computer-readable media.

An embodiment of the present application further provides a computer device, the computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer During the program, at least steps S1-S4 of the time-of-flight ranging method described in the foregoing embodiments are implemented, or when the processor executes the computer program, steps S51-S51-5 of the time-of-flight ranging method described in the foregoing embodiments are realized. S54.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection of the present invention. within the range.

Claims

A time-of-flight ranging method, comprising:

acquiring an initial histogram, where the initial histogram includes a continuous time interval, the time interval includes the count value of photons in the pulsed beam collected by the collector after the pulsed beam emitted by the transmitter is reflected by the target;

determining a search interval, the search interval includes a plurality of time intervals, and the number of the plurality of time intervals is determined according to the pulse width of the pulsed beam and the size of the time interval;

The initial histogram is searched based on the search interval, and the search interval with the largest total number of photons and the corresponding histogram index are extracted; the histogram index corresponds to the first time interval in the search interval;

Using the search interval with the largest total number of photons as the second histogram to calculate the second flight time, and according to the second flight time and the histogram index of the search interval with the largest total number of photons in the initial histogram corresponding to the first flight time to calculate the target flight time.
The time-of-flight ranging method according to claim 1, wherein the determining the search interval comprises:

In the initial histogram, continuous n time intervals starting from any time interval constitute a search interval; wherein, n=W/Δt, W represents the pulse width of the pulsed beam, and Δt represents the time interval the size of.
The time-of-flight ranging method according to claim 1, wherein the initial histogram is searched based on the search interval, and the search interval with the largest total number of photons and the corresponding histogram index are extracted, including:

The sliding sum method is used to calculate the total number of photons in each search interval, and the search is performed in sequence. The total number of photons in the first search interval of the initial search is taken as the total number of first photons, and the total number of photons in each search interval of the subsequent search is taken as the total number of photons. All are recorded as the total number of second photons; if the total number of first photons is less than the total number of second photons, update the value of the total number of first photons to the current value of the total number of second photons, and then perform the next search until the last search is reached. The search interval with the largest total number of photons and its corresponding histogram index are extracted.
The time-of-flight ranging method according to claim 3, further comprising: calculating the signal-to-noise ratio of the signal corresponding to the search interval with the largest total number of extracted photons, and judging whether the extraction result is accurate according to the signal-to-noise ratio.
The time-of-flight ranging method according to claim 4, wherein the determining whether the extraction result is accurate according to the signal-to-noise ratio comprises:

Judging whether the signal-to-noise ratio meets the preset signal-to-noise ratio threshold, if so, the extraction result is accurate; if not, the extraction result is inaccurate, and the measurement of the next frame is performed; wherein, the preset signal-to-noise ratio The ratio threshold is obtained according to the method of pre-calibration or experimental measurement.
The time-of-flight ranging method according to claim 4, wherein the calculation process of the signal-to-noise ratio comprises:

First, calculate the number of noise photons according to the initial histogram;

Then, the signal-to-noise ratio is calculated using the following formula:

Among them, SNR is the signal-to-noise ratio; PluseBinDate represents the total number of photons at the pulse position; DCValue represents the number of noise photons; PluseBinNum represents the number of time intervals corresponding to the pulse, that is, the number of time intervals in the search interval.
The time-of-flight ranging method according to claim 6, wherein the calculating the number of noise photons according to the initial histogram comprises:

Selecting a local area away from the pulse peak position from the initial histogram;

The total value of photon counts in the local area is averaged according to the number of time intervals in the local area, and recorded as the number of noise photons.
The time-of-flight ranging method according to claim 6, wherein the calculating the number of noise photons according to the initial histogram comprises:

A region other than the pulse position in the initial histogram is selected, and the total value of photon counts in this region is averaged according to the number of time intervals in this region, and recorded as the number of noise photons.
A time-of-flight ranging system, comprising:

a transmitter for emitting a pulsed beam towards an object;

a collector, used to collect photons in the pulsed beam reflected back by the object and form a photon signal;

A processing circuit, connected with the transmitter and the collector, is used for processing the photon signal to form an initial histogram, and processing the data according to the time-of-flight ranging method according to any one of claims 1-8. The initial histogram is described to obtain the distance information of the object.
A time-of-flight ranging device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: the processor implements the claims when executing the computer program The time-of-flight ranging method described in any one of 1-8.