CN110221272B - Time flight depth camera and anti-interference distance measurement method - Google Patents

Time flight depth camera and anti-interference distance measurement method Download PDF

Info

Publication number
CN110221272B
CN110221272B CN201910385768.8A CN201910385768A CN110221272B CN 110221272 B CN110221272 B CN 110221272B CN 201910385768 A CN201910385768 A CN 201910385768A CN 110221272 B CN110221272 B CN 110221272B
Authority
CN
China
Prior art keywords
pulse
signal
taps
time
light beam
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910385768.8A
Other languages
Chinese (zh)
Other versions
CN110221272A (en
Inventor
朱亮
胡小龙
王飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orbbec Inc
Original Assignee
Orbbec Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Orbbec Inc filed Critical Orbbec Inc
Priority to CN201910385768.8A priority Critical patent/CN110221272B/en
Publication of CN110221272A publication Critical patent/CN110221272A/en
Application granted granted Critical
Publication of CN110221272B publication Critical patent/CN110221272B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/08Systems determining position data of a target for measuring distance only
    • G01S17/10Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • G01S17/26Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves wherein the transmitted pulses use a frequency-modulated or phase-modulated carrier wave, e.g. for pulse compression of received signals
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483Details of pulse systems
    • G01S7/486Receivers
    • G01S7/4865Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
    • G01S7/4866Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak by fitting a model or function to the received signal

Abstract

The invention provides a time flight depth camera and an anti-interference distance measuring method, which comprise the following steps: a processing circuit for providing a modulated signal and a demodulated signal; the light source emits a pulse light beam to the object to be detected under the control of the modulation signal provided by the processing circuit, the pulse light beam comprises at least one pulse group, the pulse group comprises at least one pulse, and different time intervals are set between the pulse groups; an image sensor composed of at least one pixel, the pixel including at least 3 taps, the taps collecting charge signals generated by a beam including a reflected pulse beam reflected back by an object under test under control of a demodulation signal provided by a processing circuit; the processing circuit is also used for receiving the charge signal data of at least 3 taps and calculating the flight time of the pulse light beam and/or the distance of the object to be measured according to the charge signal data. The interference problem among the multiple cameras is effectively reduced, so that the single camera can be suitable for more occasions, and the method is easy to implement and effective.

Description

Time flight depth camera and anti-interference distance measurement method
Technical Field
The invention relates to the technical field of optical measurement, in particular to a time flight depth camera and an anti-interference distance measurement method.
Background
ToF is known collectively as Time-of-Flight, and ToF ranging is a technique for achieving accurate ranging by measuring the round-trip Time of Flight of an optical pulse between a transmitting/receiving device and a target object. The technique of directly measuring the optical time of flight in the ToF technique is called dtofs (direct-ToF); the measurement technique of periodically modulating the emitted light signal, measuring the phase delay of the reflected light signal relative to the emitted light signal, and calculating the time of flight from the phase delay is called the iToF (index-TOF) technique. According to the modulation and demodulation type, the modulation and demodulation method can be divided into a Continuous Wave (CW) modulation and demodulation method and a Pulse Modulated (PM) modulation and demodulation method.
The modulation and demodulation method for PM-iToF technology, CW-iToF technology or other iToF technology is to transmit a modulated optical signal through a transmitting unit such as a laser, and receive the optical signal after being reflected by a target to be measured by an image sensor (such as CMOS, complementary metal oxide semiconductor) for optical time of flight (TOF) measurement. An image sensor for measuring the time of flight (TOF) generally includes two or more taps, receives the control of a demodulation signal, collects electrons generated by the sensor excited by signal light at different times, converts the collected electron amount into a digital signal and outputs the digital signal, finally obtains the time delay of a reflected light signal and an emergent light signal received by the sensor through the analysis and calculation of the phase relationship between each tap and an emergent light pulse and the output digital signal, and further calculates the target distance by combining optical parameters of an imaging system.
Since active light emission is required for a measurement device based on the iToF technology, when a plurality of iToF devices are operated at a relatively short distance, the receiving unit of the device receives not only the light signal reflected by the object from the light emitting unit of the device itself, but also the emitted light or reflected light from other devices, and these light signals from other devices interfere with the amount of electrons collected between the taps, and further adversely affect the accuracy and precision of the final target distance measurement.
Disclosure of Invention
The invention provides a time flight depth camera and an anti-interference distance measuring method, aiming at solving the problem of multi-machine interference between the existing iToF cameras.
In order to solve the above problems, the technical solution adopted by the present invention is as follows:
a time-of-flight depth camera, comprising: a processing circuit for providing a modulated signal and a demodulated signal; the light source emits a pulse light beam to the object to be detected under the control of the modulation signal provided by the processing circuit, the pulse light beam comprises at least one pulse group, the pulse group comprises at least one pulse, and different time intervals are set between the pulse groups; an image sensor comprised of at least one pixel, said pixel comprising at least 3 taps, said taps collecting charge signals generated by a beam comprising a reflected pulsed beam reflected back from said test object under control of said demodulated signal provided by said processing circuitry; the processing circuit is further used for receiving the charge signal data of the at least 3 taps and calculating the flight time of the pulse light beam and/or the distance of the object to be measured according to the charge signal data.
In one embodiment of the invention, the set of pulses comprises a different number of pulses. The time intervals between the groups of pulses are randomly or pseudo-randomly set. The demodulation signal is further used for controlling the at least 3 taps to sequentially and respectively acquire charge signals generated in the time interval. The pixel comprises 4 taps, wherein one tap is used for collecting or discharging charge signals generated in each time interval under the control of the demodulation signals.
The invention also provides a distance measuring method, which comprises the following steps: providing a modulation signal and controlling a light source to emit a pulse light beam to an object to be measured, wherein the pulse light beam comprises at least one pulse group, the pulse group comprises at least one pulse, and different time intervals are formed between the pulse groups; providing a demodulation signal and controlling an image sensor comprising at least one pixel to collect a charge signal generated by a beam comprising a reflected pulsed beam reflected back by the test object, the pixel comprising at least 3 taps for collecting the charge signal; and receiving the charge signal data of the at least 3 taps and calculating the flight time of the pulse light beam and/or the distance of the object to be measured according to the charge signal data.
In one embodiment of the invention, the set of pulses comprises a different number of pulses. The time intervals between the groups of pulses are randomly or pseudo-randomly set. The demodulation signal is further used for controlling the at least 3 taps to sequentially and respectively acquire charge signals generated in the time interval. The pixel comprises 4 taps, one of which is used for collecting or draining the charge signal generated in each of the time intervals under the control of the demodulation signal.
The invention has the beneficial effects that: the time flight depth camera and the anti-interference distance measuring method effectively reduce the interference problem among multiple cameras by grouping the emitted light signals and setting different time intervals among groups, thereby ensuring that a single camera can be suitable for more occasions. Compared with the traditional anti-interference methods of setting different frequencies, frequency conversion or frequency sweeping and the like, the method is not only more suitable for implementation but also more effective.
Drawings
FIG. 1 is a schematic diagram of a temporal depth of flight camera according to an embodiment of the present invention.
FIG. 2 is a schematic diagram of a first time-of-flight depth camera optical signal emission and collection method according to an embodiment of the present invention.
FIG. 3 is a schematic diagram of optical signal emission and collection for a second time-of-flight depth camera according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating a third method for transmitting and collecting optical signals of a time-of-flight depth camera according to an embodiment of the present invention.
FIG. 5 is a schematic diagram of optical signal emission and collection for a fourth time-of-flight depth camera in accordance with embodiments of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the embodiments of the present invention more clearly apparent, the present invention is further described in detail below with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element. The connection may be for fixation or for circuit connection.
It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for convenience in describing the embodiments of the present invention and to simplify the description, and are not intended to indicate or imply that the referenced device or element must have a particular orientation, be constructed in a particular orientation, and be in any way limiting of the present invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
FIG. 1 is a schematic view of a temporal depth of flight camera according to one embodiment of the invention. Time flight depth camera 10 includes emission module 11, gather module 12 and processing circuit 13, wherein emission module 11 provides emission beam 30 to object 20 in the space with the illumination space in the target space, at least partial emission beam 30 forms reflected light beam 40 after object 20 reflects, reflected light beam 40 is at least partly gathered by gathering module 12, processing circuit 13 is connected with emission module 11 and gathering module 12 respectively, synchronous emission module 11 and gather module 12's trigger signal is sent out and is gathered the required time of module 12 receipt by gathering by emission module 11 with the calculation beam, namely, the flight time t between emission beam 30 and the reflected light beam 40, furthermore, total light flying distance D of corresponding point on the object can be calculated by the following formula:
D=c·t(1)
where c is the speed of light.
The emitting module 11 includes a light source 111, a light beam modulator 112, a light source driver (not shown), and the like. The light source 111 may be a light source such as a Light Emitting Diode (LED), an Edge Emitting Laser (EEL), a Vertical Cavity Surface Emitting Laser (VCSEL), or a light source array composed of a plurality of light sources, and light beams emitted by the light sources may be visible light, infrared light, ultraviolet light, or the like. The light source 111 emits a light beam outwards under the control of a light source driver (which may be further controlled by the processing circuit 13), for example, in one embodiment, the light source 111 emits a pulsed light beam under the control at a certain frequency, which may be set according to a measurement distance, for example, 1MHz to 100MHz, which may be set in a range of several meters to several hundred meters, and may be used in Direct time of flight (TOF) measurement; in one embodiment, the light source 111 emits light beams whose amplitude is modulated under control to emit pulsed light beams, square wave light beams, sine wave light beams, and the like, which can be used in Indirect time of flight (inductively TOF) measurements. It will be appreciated that the light source 111 may be controlled to emit the associated light beam by means of a part of the processing circuitry 13 or a sub-circuit present independently of the processing circuitry 13, such as a pulse signal generator.
The beam modulator 112 receives the light beam from the light source 111 and emits a spatially modulated light beam, such as a floodlight beam with a uniform intensity distribution or a patterned light beam with a non-uniform intensity distribution, to the outside. It is to be understood that the distribution uniformity is a relative concept and is not absolutely uniform, and generally the light beam intensity at the edge of the field of view is allowed to be slightly lower, and the intensity for the imaging area in the middle can be changed within a certain threshold, for example, the intensity change can be allowed to be not more than 15% or 10%. In some embodiments, the beam modulator 112 is also configured to expand the received beam to expand the field of view.
The collecting module 12 includes an image sensor 121, a lens unit 122, and may further include a filter (not shown in the figure), the lens unit 122 receives and images at least part of the spatially modulated light beam reflected by the object on at least part of the image sensor 121, and the filter needs to select a narrow band filter matched with the wavelength of the light source to suppress background light noise in the rest of the wavelength bands. The image sensor 121 may be a Charge Coupled Device (CCD), Complementary Metal Oxide Semiconductor (CMOS), Avalanche Diode (AD), Single Photon Avalanche Diode (SPAD), etc., with an array size representing the resolution of the depth camera, such as 320x240, etc. Generally, a readout circuit (not shown in the figure) composed of one or more of a signal amplifier, a time-to-digital converter (TDC), an analog-to-digital converter (ADC), and the like is also included in connection with the image sensor 121.
Generally, the image sensor 121 comprises at least one pixel, each pixel then comprising a plurality of taps (for storing and reading or discharging charge signals generated by incident photons under control of the respective electrodes), for example 3 taps, for reading charge signal data.
In some embodiments, the time-of-flight depth camera 10 may further include a driving circuit, a power supply, a color camera, an infrared camera, an IMU, and so on, which are not shown in the drawings, and a combination of these devices may realize more abundant functions, such as 3D texture modeling, infrared face recognition, SLAM, and so on. Time-of-flight depth camera 10 may be embedded in a cell phone, tablet, computer, or other electronic product.
The processing circuit 13 may be a stand-alone dedicated circuit, such as a dedicated SOC chip, an FPGA chip, an ASIC chip, etc. including a CPU, a memory, a bus, etc., or may include a general-purpose processing circuit, such as when the depth camera is integrated into an intelligent terminal, such as a mobile phone, a television, a computer, etc., and the processing circuit in the terminal may be at least a part of the processing circuit 13. In some embodiments, the processing circuit 13 is configured to provide a modulation signal (emission signal) required when the light source 111 emits laser light, and the light source emits a pulse light beam to the object to be measured under the control of the modulation signal; the processing circuit 13 further provides a demodulation signal (acquisition signal) of a tap in each pixel of the image sensor 121, and the tap acquires a charge signal generated by a light beam including a reflected pulse light beam reflected back by the object under the control of the demodulation signal, and generally, there are some light beams such as background light, interference light, and the like in addition to the reflected pulse light beam reflected back by the object; the processing circuit 13 may also provide auxiliary monitoring signals such as temperature sensing, over-current, over-voltage protection, dropout protection, etc.; the processing circuit 13 may also be configured to store and perform corresponding processing on raw data acquired by each tap in the image sensor 121 to obtain specific position information of the object to be measured. The functions of the modulation and demodulation method, control, processing, etc. performed by the processing circuit 13 will be described in detail in the embodiments of fig. 2-5, and for convenience of explanation, the PM-ietf modulation and demodulation method is taken as an example for explanation.
Fig. 2 is a schematic diagram of a time-of-flight depth camera optical signal emission and collection method according to a first embodiment of the present invention. Fig. 2 shows an exemplary timing diagram of a laser emission signal (modulation signal), a reception signal, and a collection signal (demodulation signal) within a single frame period T, where the meaning of each signal is: sp represents a pulsed emission signal of the light source, each pulsed emission signal representing a pulsed light beam; sr represents the reflected light signal of the pulsed light reflected by the object, each reflected light signal represents the corresponding pulsed light beam reflected by the object to be measured, and the reflected light signal has a certain delay on a time line (horizontal axis in the figure) relative to the pulse emission signal, and the delayed time t is the flight time of the pulsed light beam to be calculated; s1 represents a pulse pickup signal of a first tap of the pixel, S2 represents a pulse pickup signal of a second tap of the pixel, and S3 represents a pulse pickup signal of a third tap of the pixel, each pulse pickup signal representing that the tap picks up a charge signal (electrons) generated by the pixel in a period corresponding to the signal; the period of the pulse emission signal, the reflected light signal and the pulse acquisition signal of each tap is Tp, the pulse width is Th, and Tp is N multiplied by Th, wherein N is the number of taps participating in pixel electron collection.
The entire frame period T is divided into two periods Ta and Tb, where Ta denotes a period during which charge collection and storage is performed by each tap of the pixel, and Tb denotes a period during which the charge signal is read out. In the charge collection and storage period Ta, the collected signal pulse of the nth tap has a phase delay time of (n-1) × Th with respect to the laser emission signal pulse, respectively, and when the reflected light signal is reflected back to the pixel by the object, each tap collects electrons generated at the pixel during its pulse period. In the present embodiment, the first tap is triggered in synchronization with the laser emission signal, and when the reflected light signal is reflected back to the pixel by the object, the first tap, the second tap, and the third tap respectively and sequentially perform charge collection and storage to obtain the charge amounts q1, q2, and q3, respectively, so as to complete a pulse period Tp, which is 3Th for the case of 3 taps. A plurality of pulses are transmitted within a single frame period T and divided into a plurality of (X) pulse groups, each having a period Ts of a plurality of (Y) pulses, the period Ts of the pulse group being Y · Tp. In the embodiment shown in fig. 2, 9 pulses are transmitted in a single frame period T, the pulses are divided into 3 pulse groups, and each pulse group has 3 pulse periods Tp, that is, Y is 3, it is understood that, here, only by way of illustration, in practice, hundreds or even tens of thousands of pulses may be transmitted in a single frame period, the specific number of pulses may be set arbitrarily according to actual needs, and in addition, the number of pulses in different frame periods may be different.
The total charge amount collected and read out by each tap in the Tb period is the sum of the charge amounts corresponding to the optical signals collected by each tap for a plurality of times (9 times in fig. 2) in the whole frame period T, and the total charge amount of each tap in a single frame period can be represented as follows:
Qi=∑qi,i=1,2,3 (2)
the total charge amount in a single frame period of the first tap, the second tap and the third tap can be obtained as Q1, Q2 and Q3 according to the formula (2).
If the reflected light signal is collected by the first tap and the second tap (the first tap and the second tap will also collect the ambient light signal), the third tap is used to collect the ambient light signal, so that based on the total charge collected by each tap, the processing circuit can calculate the distance of the object according to the following formula:
Figure BDA0002054781510000071
it is to be understood that the modulation and demodulation method and the distance calculation method described in equation (3) are only examples, and any other modulation and demodulation method and distance calculation method may be used in the present application.
When a plurality of time flight depth cameras work together, when an optical signal emitted from one of the time flight depth cameras is reflected by an object to be measured or directly enters an image sensor in the other depth camera, interference is generated on measurement, and measurement accuracy is influenced. In order to reduce interference, a plurality of different time intervals Tg are provided between the individual pulse groups in the present embodiment. Due to the addition of the time interval Tg, the external interference signal is difficult to continuously generate a continuously fixed influence on the number of electrons collected by each tap, when the group X is large enough, the influence of the external interference signal on each tap can be considered to be almost consistent, and similar to background signals (such as ambient light and the influence of dark current noise on the iToF device), the influence of optical signals in other depth cameras on the measurement accuracy can be effectively eliminated by some background signal elimination means (such as subtraction between tap signals).
In one embodiment, the number of pulses in each pulse group may be the same or may be set different. For different situations, the influence of external optical signals on the acquisition of each tap can be further reduced, so that the interference influence is better reduced.
In one embodiment, the time intervals Tg between groups of pulses are randomly set.
In one embodiment, the time intervals Tg between the groups of pulses are arranged pseudo-randomly, for example, an array of all time intervals Tg may be set in advance, and the values in the array are set to fixed values to form pseudo-random groups.
In one embodiment, the pulse periods in the respective pulse groups may be the same or set different. For different situations, the influence of external optical signals on the acquisition of each tap can be further reduced, so that the interference influence is better reduced.
The external light signal (including interference light, ambient light) and other noise sources may continuously excite the pixel to generate electrons in the intervening time interval Tg, and most of the generated electrons will enter the tap that is turned on first after the intervening time, for example, the first tap in the embodiment shown in fig. 2, which may cause the signal of the first tap to be higher, thereby causing measurement error. To reduce this effect, the present invention provides several solutions, see in detail fig. 3-5.
FIG. 3 is a schematic diagram of a method for transmitting and collecting optical signals of a time-of-flight depth camera according to a second embodiment of the present invention. In order to prevent the charge signal generated in each time interval from entering the first tap, in this embodiment, the demodulation signal is set so that each tap collects the generated charge signal in each time interval Tg, thereby avoiding a large error caused by entering a single tap. To reduce the error, the electrons generated during these time intervals should be split into the various taps as evenly as possible.
In one embodiment, each tap may be turned on in turn to acquire a respective time interval, as shown in FIG. 3. It can be understood that due to the difference of the time intervals, when the number of the pulse intervals is large enough, the sequential turning-on may obtain a better effect, but if the difference of the time intervals is large and/or the number of the pulse intervals is not large, the sequential turning-on effect may not ensure that the number of electrons in each tap is equally divided as much as possible, so that all the time intervals in the frame period may be processed in advance, and the taps to be turned on in each time interval are calculated and allocated in advance to ensure that the acquisition time of each tap is as same as possible.
It is to be understood that, for the first tap, since the time interval is connected to the time of the collected signal in the next pulse period, if the first tap starts the collected signal in the time interval, it can be considered to widen the collected signal time of the first tap in the next pulse period to collect the optical signal in the time interval and the optical signal in one pulse period Th. For the third tap, since the time interval is connected to the time of the acquisition signal in the previous pulse period, if the third tap starts the acquisition signal in the time interval, it can be considered that the acquisition signal time of the third tap in the previous pulse period is widened to acquire the optical signal in one pulse period Th and the time interval.
FIG. 4 is a schematic diagram of a method for transmitting and collecting optical signals of a time-of-flight depth camera according to a third embodiment of the present invention. As can be seen from fig. 4, this embodiment can be regarded as a further improvement of the embodiment shown in fig. 3, except that when each tap collects a signal within a time interval, the width of the collected signal is smaller than the time interval, so that the two collections can be distinguished from each other in terms of time, thereby avoiding the problem of difficulty in modulation of the processing circuit caused by the superposition of the two collected signals.
The sharing idea adopted in the embodiments shown in fig. 3 and 4 is difficult to fundamentally solve the error problem caused by electrons generated in a time interval. The present application will provide another solution.
FIG. 5 is a diagram illustrating a method for transmitting and collecting optical signals of a time-of-flight depth camera according to a fourth embodiment of the present invention. Compared with the previous embodiments, the difference is that the present embodiment further includes a fourth tap, and the fourth tap may be a tap for storing electrons or a tap for discharging (drain) electrons. The fourth tap is turned on for each time interval, for storing electrons generated in each time interval if it is a store electronic tap, and for discharging electrons generated in each time interval if it is a discharge electronic tap. Because the fourth tap collects or discharges electrons generated in the period of time in the time interval, the electrons are prevented from entering the tap in the next frame period, and the measurement accuracy is improved. It will be appreciated that the fourth tap may be turned on for the same time interval or less than the time interval.
2-4, the anti-interference modulation and demodulation method based on 3 taps is described, and fig. 5 is that the optimized anti-interference modulation and demodulation method based on 4 taps is realized by adding 1 tap on the basis of 3 taps. It will be appreciated that in some embodiments, the interference rejection modem approach shown in fig. 2-4 is equally applicable for pixels having 4 or more taps, only one or more of which need not be involved.
In some embodiments, for a modulation and demodulation method based on 4 or more taps (by default, four taps are all involved), the above-mentioned interference rejection method by grouping pulses and setting different time intervals between groups is also applicable in the embodiments. In addition, the optimized anti-interference modulation and demodulation method realized by adding one tap on the basis of the method is also applicable to the method similar to the method shown in fig. 5.
In the above embodiments, an indirect time-of-flight method (PM-ietf) based on a pulsed light signal is described as an example. It will be appreciated that the above method is equally applicable to an indirect time-of-flight method (CW-ietf) based on a continuous wave signal (such as a square wave or a sine wave), or a direct time-of-flight method (PM-dTOF or CW-dTOF) based on a pulsed signal or a continuous wave signal. For the continuous wave signal, a continuous signal of a single period Tp may be equivalent to a single pulse signal in each of the above embodiments, and therefore the pulse signal mentioned in the present application is understood to be a pulse signal in a broad sense, which may be a high-frequency pulse signal with an extremely short pulse width (Tp — 3Th in fig. 2, duty ratio 33%), a square wave continuous signal with a long pulse width (Tp — 2Th, duty ratio 50%), a sine wave signal with the same period as the pulse period Tp, or the like.
The invention has the advantages that the interference problem among multiple cameras is effectively reduced by grouping the emitted light signals and setting different time intervals among groups, thereby ensuring that a single camera can be suitable for more occasions. Compared with the traditional anti-interference methods of setting different frequencies, frequency conversion or frequency sweeping and the like, the method is easier to realize and more effective.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several equivalent substitutions or obvious modifications can be made without departing from the spirit of the invention, and all the properties or uses are considered to be within the scope of the invention.

Claims (10)

1. A time-of-flight depth camera, comprising:
a processing circuit for providing a modulated signal and a demodulated signal;
the light source emits a pulse light beam to an object to be measured under the control of the modulation signal provided by the processing circuit, wherein the pulse light beam comprises at least one pulse group in a single frame period, the pulse group comprises at least one pulse, and different time intervals are set among the pulse groups;
an image sensor comprised of at least one pixel, said pixel including at least 3 taps, said taps being controlled by said demodulation signal provided by said processing circuitry to collect charge signals generated by beams including reflected pulsed beams reflected back from said test object and said taps being further used to collect or reject charge signals generated during each of said time intervals;
the processing circuit is further used for receiving the charge signal data of the at least 3 taps and calculating the flight time of the pulse light beam and/or the distance of the object to be measured according to the charge signal data.
2. The time-of-flight depth camera of claim 1, wherein the pulse groups contain different numbers of pulses.
3. The time-of-flight depth camera of claim 1, in which the time interval between the groups of pulses is randomly or pseudo-randomly set.
4. The time-of-flight depth camera of claim 1, wherein the demodulated signal is further configured to control the at least 3 taps to sequentially and respectively acquire charge signals generated during the time interval.
5. The time-of-flight depth camera of claim 1, wherein the pixel comprises 4 of the taps, one of which is used to acquire or drain a charge signal generated during each of the time intervals under control of the demodulated signal.
6. A distance measuring method, characterized by comprising:
providing a modulation signal and controlling a light source to emit a pulse light beam to an object to be measured, wherein the pulse light beam comprises at least one pulse group in a single frame period, the pulse group comprises at least one pulse, and different time intervals are formed among the pulse groups;
providing a demodulation signal and controlling an image sensor comprising at least one pixel to collect charge signals generated by a light beam comprising a reflected pulse light beam reflected back by the object to be measured, wherein the pixel comprises at least 3 taps, and the taps are also used for collecting or eliminating the charge signals generated in each time interval;
and receiving the charge signal data of the at least 3 taps and calculating the flight time of the pulse light beam and/or the distance of the object to be measured according to the charge signal data.
7. The distance measuring method according to claim 6, wherein said pulse groups contain different numbers of pulses.
8. The distance measurement method of claim 6, wherein the time interval between the groups of pulses is randomly or pseudo-randomly set.
9. The distance measuring method of claim 6 wherein said demodulated signal is further used to control said at least 3 taps to sequentially acquire respective charge signals generated during said time interval.
10. The distance measuring method according to claim 6, wherein said pixel comprises 4 taps, one of said taps being used to collect or drain a charge signal generated in each of said time intervals under control of said demodulation signal.
CN201910385768.8A 2019-05-09 2019-05-09 Time flight depth camera and anti-interference distance measurement method Active CN110221272B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910385768.8A CN110221272B (en) 2019-05-09 2019-05-09 Time flight depth camera and anti-interference distance measurement method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910385768.8A CN110221272B (en) 2019-05-09 2019-05-09 Time flight depth camera and anti-interference distance measurement method

Publications (2)

Publication Number Publication Date
CN110221272A CN110221272A (en) 2019-09-10
CN110221272B true CN110221272B (en) 2021-11-19

Family

ID=67820919

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910385768.8A Active CN110221272B (en) 2019-05-09 2019-05-09 Time flight depth camera and anti-interference distance measurement method

Country Status (1)

Country Link
CN (1) CN110221272B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110687544B (en) * 2019-10-16 2023-03-24 深圳市镭神智能系统有限公司 Laser radar and anti-interference method thereof
CN110749898B (en) * 2019-10-18 2022-05-27 深圳奥锐达科技有限公司 Laser radar ranging system and ranging method thereof
CN110764097B (en) * 2019-11-14 2023-03-21 深圳市镭神智能系统有限公司 Anti-interference method and device for laser radar, laser radar and storage medium
CN110927734B (en) * 2019-11-24 2024-03-08 深圳奥锐达科技有限公司 Laser radar system and anti-interference method thereof
CN111580122B (en) * 2020-05-28 2022-12-06 睿镞科技(北京)有限责任公司 Space measuring apparatus, method, device, and computer-readable storage medium
CN111896971B (en) * 2020-08-05 2023-12-15 上海炬佑智能科技有限公司 TOF sensing device and distance detection method thereof
CN112269169A (en) * 2020-11-09 2021-01-26 Oppo广东移动通信有限公司 Transmission module, time flight device and electronic equipment

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5026156A (en) * 1972-07-24 1991-06-25 Martin Marietta Corporation Method and system for pulse interval modulation
JPS5973784A (en) * 1982-10-20 1984-04-26 Sumitomo Electric Ind Ltd Ultrasonic distance detecting apparatus
JP3185547B2 (en) * 1994-06-28 2001-07-11 三菱電機株式会社 Distance measuring device
EP1659418A1 (en) * 2004-11-23 2006-05-24 IEE INTERNATIONAL ELECTRONICS & ENGINEERING S.A. Method for error compensation in a 3D camera
EP1777546B1 (en) * 2005-10-24 2010-05-26 Mitsubishi Electric Information Technology Centre Europe B.V. Object detection
CN101661106B (en) * 2008-08-28 2011-12-07 阮树成 Millimeter-wave random biphase code phase-modulation and amplitude-modulation automotive collision-proof radar
CN103698770A (en) * 2013-12-11 2014-04-02 中国科学院长春光学精密机械与物理研究所 Multi-channel laser echo time measurement system based on FPGA (Field Programmable Gate Array) chip
CN103728607A (en) * 2014-01-16 2014-04-16 西安电子科技大学 Space time code three-dimensional self-adaptation clutter cancelling method for onboard multiple input multiple output (MIMO) radar
JP6207407B2 (en) * 2014-01-17 2017-10-04 オムロンオートモーティブエレクトロニクス株式会社 Laser radar apparatus, object detection method, and program
CN105137443B (en) * 2015-08-27 2017-09-26 苏州翌森光电科技有限公司 Pulse type laser distance-finding method
CN107852472B (en) * 2016-06-15 2021-07-20 索尼公司 Image forming apparatus, image forming method, and storage medium
CN106383340A (en) * 2016-11-24 2017-02-08 中国人民解放军国防科学技术大学 Speed false target identifying method of random pulse initial phase radar
DE102017113675B4 (en) * 2017-06-21 2021-11-18 Sick Ag Photoelectric sensor and method for measuring the distance to an object
EP3428574A1 (en) * 2017-07-11 2019-01-16 Fondazione Bruno Kessler Device for measuring a distance and method for measuring said distance
CN107728156B (en) * 2017-09-29 2019-11-22 西安知微传感技术有限公司 A kind of method and system enhancing laser radar anti-interference
CN109683171A (en) * 2017-10-19 2019-04-26 上海禾赛光电科技有限公司 Laser radar and its distance measuring method
CN108415028A (en) * 2018-03-16 2018-08-17 深圳市砝石激光雷达有限公司 The encrypted laser ranging system of pulse parameter and method
CN108732551B (en) * 2018-06-01 2021-10-15 航天恒星科技有限公司 System and method for autonomous time synchronization of receiving and transmitting networking radar based on pseudo-random coded signals

Also Published As

Publication number Publication date
CN110221272A (en) 2019-09-10

Similar Documents

Publication Publication Date Title
CN110221272B (en) Time flight depth camera and anti-interference distance measurement method
US20210181317A1 (en) Time-of-flight-based distance measurement system and method
WO2021008209A1 (en) Depth measurement apparatus and distance measurement method
CN110596721B (en) Flight time distance measuring system and method of double-shared TDC circuit
CN110221273B (en) Time flight depth camera and distance measuring method of single-frequency modulation and demodulation
CN110221274B (en) Time flight depth camera and multi-frequency modulation and demodulation distance measuring method
CN111025317B (en) Adjustable depth measuring device and measuring method
CN111465870B (en) Time-of-flight sensing using an array of addressable emitters
CN110320528B (en) Time depth camera and noise reduction distance measurement method for multi-frequency modulation and demodulation
CN110596725B (en) Time-of-flight measurement method and system based on interpolation
CN110361751B (en) Time flight depth camera and distance measuring method for reducing noise of single-frequency modulation and demodulation
CN110596724B (en) Method and system for measuring flight time distance during dynamic histogram drawing
CN110596723B (en) Dynamic histogram drawing flight time distance measuring method and measuring system
US11754686B2 (en) Digital pixel
CN110187355B (en) Distance measurement method and depth camera
US20220043129A1 (en) Time flight depth camera and multi-frequency modulation and demodulation distance measuring method
CN111025321B (en) Variable-focus depth measuring device and measuring method
CN111123289B (en) Depth measuring device and measuring method
CN209894976U (en) Time flight depth camera and electronic equipment
CN111025319A (en) Depth measuring device and measuring method
WO2020223982A1 (en) Time of flight depth camera and anti-interference distance measurement method
WO2020223980A1 (en) Time-of-flight depth camera, and distance measurement method employing single-frequency modulation/demodulation
US20230243928A1 (en) Overlapping sub-ranges with power stepping

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 11-13 / F, joint headquarters building, high tech Zone, 63 Xuefu Road, Yuehai street, Nanshan District, Shenzhen, Guangdong 518000

Applicant after: Obi Zhongguang Technology Group Co., Ltd

Address before: 12 / F, joint headquarters building, high tech Zone, 63 Xuefu Road, Nanshan District, Shenzhen, Guangdong 518000

Applicant before: SHENZHEN ORBBEC Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant