CN110824490B - Dynamic distance measuring system and method - Google Patents

Dynamic distance measuring system and method Download PDF

Info

Publication number
CN110824490B
CN110824490B CN201910927160.3A CN201910927160A CN110824490B CN 110824490 B CN110824490 B CN 110824490B CN 201910927160 A CN201910927160 A CN 201910927160A CN 110824490 B CN110824490 B CN 110824490B
Authority
CN
China
Prior art keywords
light
sub
light source
projection pattern
scanning unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910927160.3A
Other languages
Chinese (zh)
Other versions
CN110824490A (en
Inventor
关健
朱亮
徐松
闫敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Oradar Technology Co Ltd
Original Assignee
Shenzhen Oradar Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Oradar Technology Co Ltd filed Critical Shenzhen Oradar Technology Co Ltd
Priority to CN201910927160.3A priority Critical patent/CN110824490B/en
Priority to PCT/CN2019/113752 priority patent/WO2021056668A1/en
Publication of CN110824490A publication Critical patent/CN110824490A/en
Application granted granted Critical
Publication of CN110824490B publication Critical patent/CN110824490B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/08Systems determining position data of a target for measuring distance only

Landscapes

  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Measurement Of Optical Distance (AREA)

Abstract

The invention discloses a dynamic distance measuring system, comprising: an emitter for emitting a light beam toward a target object, the emitter including a light source unit composed of a plurality of sub light source arrays, which can be independently controlled in groups, a beam splitting unit for splitting the light beam, and a scanning unit for deflecting the light beam; the collector is used for collecting at least part of the emitted light beams reflected by the target object and forming light signals; and the processing circuit is connected with the emitter and the collector. By grouping the array light sources and field-of-view control of the scanning unit, higher resolution measurement can be achieved at lower power consumption.

Description

Dynamic distance measuring system and method
Technical Field
The invention relates to the technical field of computers, in particular to a dynamic distance measuring system and method.
Background
The Time of Flight principle (Time of Flight) and the structured light principle are utilized to measure the distance of the target so as to obtain a depth image containing the depth value of the target, and further, the functions of three-dimensional reconstruction, face recognition, man-machine interaction and the like can be realized based on the depth image, and related distance measuring systems are widely applied to the fields of consumer electronics, unmanned driving, AR/VR and the like.
Distance measuring systems based on the time-of-flight principle and the structured light principle generally include a light beam emitter and a light beam collector. A light source in the emitter emits a beam of light toward the target space to provide illumination, and a collector receives the beam of light reflected back by the target. Wherein the time-of-flight distance measuring system calculates the distance of the target object by calculating the time required for the beam to be received from the transmission to the reflection; and the structured light distance measuring system processes the reflected light beam pattern and calculates the distance of the target object by utilizing a trigonometry method.
No matter which principle scheme is adopted, the distance measurement system faces some problems to be solved urgently at present, and the most central problems are the problem of measurement resolution, the problem of power consumption and the problem of size.
The measurement resolution is often influenced by the light beam emitted by the emitter, and the denser the emitted light beam is, the resolution is often higher, but the dense light beam has higher requirements on the arrangement density of the light sources and the design requirements of related optical devices, and the dense light beam also means higher power consumption. The difficult problem of power consumption is also influenced by the emitter, and the higher the emitter emits light beam power, the higher the light beam density is, the higher the power consumption is, further, the more widely application of the measurement system in more fields is limited. Secondly, the difficulty of volume is often caused by complicated devices in the emitter or collector, for example, the emitter usually includes a light source and some optical elements such as refraction and diffraction, which results in a large volume and is not easy to integrate.
The above background disclosure is only provided to assist understanding of the inventive concept and technical solutions of the present invention, which do not necessarily belong to the prior art of the present patent application, and should not be used to evaluate the novelty and inventive step of the present application in the case that there is no clear evidence that the above content has been disclosed at the filing date of the present patent application.
Disclosure of Invention
The present invention is directed to a dynamic distance measuring system and method to solve at least one of the above problems.
In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows:
a dynamic distance measurement system comprising:
a transmitter for transmitting a light beam to a target object; wherein the transmitter includes a light source unit composed of a plurality of sub light source arrays, which can be independently controlled in groups, a beam splitting unit for splitting a beam, and a scanning unit for deflecting the beam;
the collector is used for collecting at least part of the emitted light beams reflected by the target object and forming light signals;
a processing circuit connected to the transmitter and the collector and configured to perform the steps of:
s1, starting at least one first sub light source array, and forming a first projection pattern with a first view field by using the scanning unit;
s2, obtaining a first depth image with a first resolution ratio, and identifying a region where the target object is located;
and S3, starting at least one second sub light source array, forming a second projection pattern only comprising a second field of view of the target object by using the scanning unit, and calculating a second depth image with a second resolution.
In some embodiments, the first field of view is larger than the second field of view.
In some embodiments, the second resolution is higher than the first resolution.
In some embodiments, the arrangement density of the light beams in the second projection pattern is higher than the arrangement density of the light beams in the first projection pattern.
In some embodiments, the second sub-light source array has a higher arrangement density of sub-light sources relative to the first sub-light source array.
The other technical scheme of the invention is as follows:
a dynamic distance measurement method comprising the steps of:
s10, starting at least one first sub-light source array, and forming a first projection pattern with a first view field by using a scanning unit;
s20, obtaining a first depth image with a first resolution ratio, and identifying a region where the target object is located;
and S30, starting at least one second sub light source array, forming a second projection pattern only comprising a second field of view of the target object by using the scanning unit, and calculating a second depth image with a second resolution.
In some embodiments, the first field of view is larger than the second field of view.
In some embodiments, the second resolution is higher than the first resolution.
In some embodiments, an arrangement density of the light beams in the second projection pattern is higher than an arrangement density of the light beams in the first projection pattern.
In some embodiments, the second sub-light source array has a higher arrangement density of sub-light sources relative to the first sub-light source array.
The technical scheme of the invention has the beneficial effects that:
according to the invention, through the field-of-view regulation and control of the grouped array light sources and the scanning unit, measurement with higher resolution can be realized under lower power consumption, and the problem of high power consumption in the prior art is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic view of a time-of-flight distance measurement system according to one embodiment of the present invention.
Fig. 2 is a schematic diagram of a transmitter according to a first embodiment of the invention.
Fig. 3 is a schematic diagram of a projection pattern according to a first embodiment of the present invention.
Fig. 4 is a schematic diagram of a transmitter according to a second embodiment of the invention.
Fig. 5 is a schematic diagram of a transmitter according to a third embodiment of the invention.
Fig. 6 is a schematic view of a projection pattern according to a second embodiment of the present invention.
FIG. 7 is a schematic diagram of an integrated beam splitting scanning unit, according to one embodiment of the present invention.
FIG. 8 is a schematic diagram of an array light source and its sparse projection pattern according to one embodiment of the present invention.
FIG. 9 is a schematic diagram of an array light source and its dense projection pattern according to one embodiment of the invention.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the embodiments of the present invention more clearly apparent, the present invention is further described in detail below with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element. The connection may be for fixation or for circuit connection.
It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings to facilitate the description of the embodiments of the invention and to simplify the description, and are not intended to indicate or imply that the device or element so referred to must have a particular orientation, be constructed in a particular orientation, and be constructed in a particular manner of operation, and are not to be construed as limiting the invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
The present invention provides a time-of-flight distance measurement system with higher resolution and/or larger field of view.
FIG. 1 is a schematic diagram of a time-of-flight distance measurement system according to one embodiment of the present invention. The distance measuring system 10 comprises a transmitter 11, a collector 12 and a processing circuit 13; emitter 11 provides a transmitted light beam 30 into the target space to illuminate object 20 in the space, wherein at least part of transmitted light beam 30 is reflected by object 20 to form a reflected light beam 40, and at least part of the light signals (photons) of reflected light beam 40 are collected by collector 12. Processing circuit 13 is connected to emitter 11 and collector 12, respectively, and synchronizes the trigger signals of emitter 11 and collector 12 to calculate the time required for the light beam emitted by emitter 11 to be received by collector 12, i.e. the flight time t between emitted light beam 30 and reflected light beam 40, and further, the distance D between corresponding points on the object can be calculated by the following formula:
D=c·t/2 (1)
where c is the speed of light.
The emitter 11 includes a light source 111, an optical element 112. The light source 111 may be a light source such as a Light Emitting Diode (LED), an Edge Emitting Laser (EEL), a Vertical Cavity Surface Emitting Laser (VCSEL), or an array light source composed of a plurality of light sources. Preferably, the array light source 111 is a VCSEL array light source chip formed by generating a plurality of VCSEL light sources on a monolithic semiconductor substrate. The light beam emitted by the light source 111 may be visible light, infrared light, ultraviolet light, or the like. The light source 111 emits light beams outwards under the control of the processing circuit 13, for example, in one embodiment, the light source 111 emits pulsed light beams under the control of the processing circuit 13 at a certain frequency (pulse period), which can be used in Direct time of flight (Direct TOF) measurement, the frequency is set according to a measurement distance, for example, the frequency can be set to 1MHz-100MHz, and the measurement distance is several meters to several hundred meters. It will be appreciated that the light source 111 may be controlled to emit the associated light beam, either as part of the processing circuitry 13 or independently of sub-circuits present in the processing circuitry 13, such as a pulse signal generator.
The optical element 112 receives the pulsed light beam from the light source 111, optically modulates the pulsed light beam, such as by diffraction, refraction, reflection, etc., and then emits the modulated light beam, such as a focused light beam, a flood light beam, a structured light beam, etc., into the space. The optical elements 112 may be in the form of one or more combinations of lenses, diffractive optical elements, super surface (Metasurface) optical elements, masks, mirrors, MEMS mirrors, and the like.
The processing circuit 13 may be a stand-alone dedicated circuit, such as a dedicated SOC chip, an FPGA chip, an ASIC chip, etc., or may comprise a general purpose processing circuit, such as when the depth camera is integrated into a smart terminal, such as a mobile phone, a television, a computer, etc., the processing circuit in the terminal may be at least a part of the processing circuit 13.
Collector 12 includes a pixel unit 121 and an imaging lens unit 122. Wherein the imaging lens unit 122 receives and directs at least part of the modulated light beam reflected back by the object onto the pixel unit 121. In one embodiment, the pixel unit 121 is composed of a single photon avalanche photodiode (SPAD), and may be an array pixel unit composed of a plurality of SPAD pixels, and the array size of the array pixel unit represents the resolution of the depth camera, such as 320 × 240. The SPAD can respond to the incident single photon so as to realize the detection of the single photon, and can realize remote and high-precision measurement due to the advantages of high sensitivity, high response speed and the like. Compared with an image sensor which is composed of a CCD/CMOS and the like and uses light integration as a principle, the SPAD can count single photons, for example, the collection of weak light signals and the calculation of flight time are realized by using a time correlation single photon counting method (TCSPC). Generally, a readout circuit (not shown in the figure) composed of one or more of a signal amplifier, a time-to-digital converter (TDC), an analog-to-digital converter (ADC), and the like is also included in connection with the pixel unit 121. These circuits can be integrated with the pixels, which can also be part of the processing circuit 13, and for convenience of description, they will be collectively referred to as the processing circuit 13.
In some embodiments, the distance measuring system 10 may further include a color camera, an infrared camera, an IMU, etc., and a combination of these devices may implement more various functions, such as 3D texture modeling, infrared face recognition, SLAM, etc.
In some embodiments, emitter 11 and collector 12 may be arranged coaxially, i.e. they are implemented by an optical device with reflection and transmission functions, such as a half-mirror.
In the conventional distance measuring system, the emitter 11 is arranged to emit a flood light beam with a certain field angle, which has the advantages of performing a full-range illumination coverage on a measured object, enabling each pixel in the collector 12 to receive the reflected light beam at the same time, and enabling the resolution of the depth image output by the measuring system to be influenced by the resolution of the pixel unit of the collector 12, and the disadvantage is that the power consumption of the emitter 11 is high, and in addition, the interference between adjacent pixels of the collector 11 during synchronous measurement may be caused. In the present invention, therefore, the emitter 11 is arranged to emit the structured light beam outwards, i.e. only a partial area is illuminated in space, and the advantage of using the structured light beam is that the illumination is more concentrated and thus the signal-to-noise ratio is improved, and the disadvantage is that the resolution is lower, and in some cases the disadvantage of insufficient field angle is also present.
Fig. 2 is a schematic diagram of a transmitter according to a first embodiment of the invention. The emitter comprises a light source unit, a beam splitting unit 204 and a scanning unit 205, the light source unit is used for emitting a first light beam, the beam splitting unit 204 is used for receiving and splitting the first light beam to form a second light beam with a larger number of light beams, the scanning unit 205 is used for receiving and deflecting the second light beam at a certain angle and then emitting a third light beam outwards, a plurality of third light beams are formed after deflection for a plurality of times, and the comprehensive projection pattern light beam formed by the third light beams has higher density and/or larger field angle than the second light beam.
The light source unit includes a substrate 201 and one or more sub light sources 202 disposed on the single substrate 201 (or a multi-substrate), the sub light sources 202 being arranged in a pattern on the substrate. The substrate 201 may be a semiconductor substrate, a metal substrate, etc., and the sub-light sources 202 may be light emitting diodes, edge emitting laser emitters, vertical cavity surface laser emitters (VCSELs), etc., and preferably, the light source unit includes a semiconductor substrate and an array VCSEL chip composed of a plurality of VCSEL sub-light sources disposed on the semiconductor substrate. The sub-light sources are used to emit light beams of any desired wavelength, such as visible light, infrared light, ultraviolet light, and the like. The light source unit emits light under modulation driving of a driving circuit (which may be part of the processing circuit 13), such as amplitude modulation, phase modulation, frequency modulation, pulse modulation, and the like. The sub-light sources 202 may also emit light in groups or in whole under the control of the driving circuit, for example, the sub-light source 202 includes a first sub-light source array 201, a second sub-light source array 202, and the like, the first sub-light source array 201 emits light under the control of the first driving circuit, and the second sub-light source array 202 emits light under the control of the second driving circuit. The arrangement pattern of the sub light sources 202 may be a one-dimensional arrangement pattern, a two-dimensional arrangement pattern, a regular arrangement pattern, an irregular arrangement pattern, or a combination of a regular pattern and an irregular pattern. For ease of analysis, only one example is schematically given in fig. 2, which includes a 3 × 3 regular array of sub-sources.
In one embodiment, the light source unit further includes one or more optical elements such as a lens (or a lens group), a micro-lens array, etc., for example, a lens (or a lens group or a combination of a lens group and a micro-lens array) 203 is disposed between the sub-light source 202 and the beam splitting unit 204, and the lens 203 is used for refracting the light beam emitted by the sub-light source to generate focusing, collimating or diverging effect (forming a focused, collimated or diverging first light beam) so as to meet the modulation requirement of the subsequent optical elements.
The beam splitting unit 204 receives a first light beam emitted from the light source, and performs a replicated beam splitting on the first light beam to form a second light beam with a larger number of light beams. In one embodiment, the beam splitting unit 204 performs replica splitting on the first light beam to form a second light beam with higher arrangement density (for the case of multiple sub-light sources); in one embodiment, the beam splitting unit 204 performs replicated beam splitting on the first light beam to form a second light beam with a larger field angle, such as the embodiment shown in fig. 3; in one embodiment, the beam splitting unit 204 performs replicated beam splitting on the first light beam to form a second light beam with higher arrangement density and larger field angle. The beam splitting unit 204 may be one or a combination of diffractive optical elements, optical gratings, optical masks, super surface (Metasurface) optical elements, and any other optical devices that can achieve beam splitting. For the convenience of analysis, it is assumed that the angle of view of the second light beam is α, and the angular offset of two adjacent sub-light beams in the second light beam is β, and if the second light beam is a spatial light beam, both α and β include two directional components (α and β) xy )、(β xy )。
After receiving the second light beam from the beam splitting unit 204, the scanning unit 205 deflects and scans the second light beam and emits a third light beam outward. Sweeping machineThe scanning unit 205 may perform one-dimensional deflection or two-dimensional deflection on each sub-beam of the incident second light beam by diffraction, refraction, reflection, or the like, for example, the sub-beam is deflected by a certain angle θ (θ) in at least one direction xy ) Thereby forming a third beam. Fig. 2 schematically shows a scanning unit 205 deflecting the second light beam by two angles in sequence along one direction, wherein the first and third light beams 206 can be regarded as being formed by deflecting by 0 degrees; the second and third light beams 207 are formed by the scanning unit 205 deflecting the second light beam by a smaller angle theta, which is smaller than the angle between two adjacent sub-beams in the second light beam, i.e. theta<β, whereby the combined projection pattern beam composed of at least two third beams formed after at least two scans has a higher density than the second beam without the scanning unit 205, thereby making it possible to improve the measurement resolution of the measurement system. See fig. 3 for a detailed description. The scanning unit 205 may be one or a combination of liquid crystal spatial light modulator, acousto-optic modulator, MEMS galvanometer, rotating prism pair, single prism + motor, reflective two-dimensional OPA device, liquid crystal super surface device (LC-Metasurface), and the like. For example, when the scanning unit 205 is a liquid crystal spatial light modulator, the deflection angle of an incident beam can be controlled by adjusting the arrangement grating period of the liquid crystal molecules.
Fig. 3 is a schematic diagram of a projection pattern according to a first embodiment of the present invention. Based on the emitter 11 shown in fig. 2, in one embodiment, the projection pattern formed by the third light beam emitted by the emitter 11 to the target is as shown in fig. 3. In the present embodiment, the beam splitting unit 204 performs replication beam splitting on the first light beam to form a second light beam with a larger field angle, the replication is 3 × 3, that is, 3 × 3 times of the first light beam emitted by the sub light sources regularly arranged in 3 × 3 to form a second light beam pattern 301 with a large field angle formed by 9 first light beam patterns 302, and the second light beam pattern 301 includes 9 × 9=81 sub light beams 303, which are indicated by solid hollow circles in the figure. Assuming that the scanning unit 205 deflects the second light beam, the first deflection is 0 degrees, and the formed first and third light beam patterns are the array spot patterns formed by the solid line hollow circles 303 in fig. 3; subsequently, the scanning unit 205 deflects the second light beam again, for example, in the vertical direction in fig. 3, by an angle smaller than the angle between two adjacent sub-light beams in the second light beam, so that a second third light beam pattern composed of the dashed space circles 304 in fig. 3 can be generated. Since the deflection angle is small, which in this embodiment is exactly half of the two adjacent sub-beams in the second beam, i.e. θ = β/2, the dashed open circle 304 will fall between the two solid open circles 303, and the integrated scanning pattern formed by the plurality of third beams after a plurality of scans will have a higher density. The scanning direction may be in a single direction or in multiple directions.
In fact, in the embodiment shown in fig. 2 and 3, the scanning unit 205 also increases the angle of view by deflecting the beam direction, but the increased angle of view is very small relative to the angle of view of the second beam formed by the beam splitting unit 204. It can be understood that the density and the angle of field of the projection pattern can be effectively adjusted by reasonably setting the deflection angle. In one embodiment, the deflection angles θ may be sequentially set to
Figure BDA0002219227720000091
With n scans, the scan angle is increased successively
Figure BDA0002219227720000092
Thereby increasing the overall projected pattern density by a factor of n. In one embodiment, the deflection angles θ may be sequentially set to
Figure BDA0002219227720000093
Figure BDA0002219227720000094
Thereby, the density of the projection pattern and the angle of view can be increased simultaneously, i.e. the angle of view is increased by N β and the density of the middle portion overlapping area is increased by N times. In one embodiment, the deflection angle is set to exceed the field of view of the second beam by α, which only increases the field of view of the projected pattern, as shown in FIG. 5.
Fig. 5 is a schematic diagram of a transmitter according to a third embodiment of the invention. The main components of the emitter are similar to the embodiment shown in fig. 2, and include a light source unit composed of a substrate 501, a sub-light source 502 and a lens 503, as well as a beam splitting unit 504 and a scanning unit 505. Different from the embodiment shown in fig. 2, the deflection angle of the scanning unit 505 for deflecting the incident second light beam is relatively large, that is, θ ≧ α, for example, the first third light beam pattern formed by deflecting 0 degrees for the first time is 506, the second third light beam pattern 507 is formed after deflecting α in a certain direction for the second time, the field angle of the integrated projection pattern formed by the first and second third light beam patterns is increased by 2 times along the deflection direction, and the density of the projection pattern is not changed.
In some embodiments, the scanning unit 505 can deflect in multiple directions to form a projection pattern with a larger field angle, such as the projection pattern diagram shown in fig. 6 according to the second embodiment of the present invention. In this embodiment, the light source unit includes a regular array composed of 3 × 3 sub-light sources, the beam splitting unit performs 3 × 3 copying beam splitting on the regular array of sub-light sources to form a 9 × 9 arranged second light beam, the scanning unit deflects 3 times along the horizontal and vertical directions, the deflection angle of each time is slightly larger than α (to avoid overlapping of light beams at adjacent boundaries), for example, a deflection sequence shown by an arrow in fig. 6, a plurality of third light beams 602, 603, 604, and 605 can be finally formed, the plurality of third light beams jointly form a projection pattern 601, and the viewing angle is improved by 2 times along two directions after multiple deflections. It is understood that the number of deflections in each direction and the sequence of deflections may be set according to actual needs, and are not limited herein.
Fig. 4 is a schematic diagram of a transmitter according to a second embodiment of the invention. The emitter includes light source unit, scanning unit 404 and beam splitting unit 405, and light source unit is used for launching first light beam, and scanning unit 404 is used for receiving and outwards launching the second light beam after deflecting first light beam, and beam splitting unit 405 is used for receiving and forming the third light beam that the light beam quantity is more after splitting to the second light beam. After being deflected for a plurality of times by the scanning unit 404, a plurality of second light beams are formed, and accordingly, the plurality of second light beams are also formed into a plurality of corresponding third light beams after being split by the beam splitting unit, and the third light beams form a comprehensive projection pattern light beam with higher density and/or larger field angle than the second light beams.
The light source unit includes a substrate 401 and one or more sub-light sources 402 disposed on the single substrate 401 (or a multi-substrate), the sub-light sources 402 being arranged in a pattern on the substrate. The substrate 401 may be a semiconductor substrate, a metal substrate, etc., and the sub-light sources 402 may be light emitting diodes, edge emitting laser emitters, vertical cavity surface laser emitters (VCSELs), etc., and preferably, the light source unit includes a semiconductor substrate and an array VCSEL chip composed of a plurality of VCSEL sub-light sources disposed on the semiconductor substrate. The sub-light sources are used to emit light beams of any desired wavelength, such as visible light, infrared light, ultraviolet light, and the like. The light source unit emits light under modulation driving of a driving circuit (which may be part of the processing circuit 13), such as continuous wave modulation, pulse modulation, or the like. The sub-light sources 402 may also emit light in groups or in whole under the control of the driving circuit, for example, the sub-light source 402 includes a first sub-light source array 401, a second sub-light source array 402, and the like, the first sub-light source array 401 emits light under the control of the first driving circuit, and the second sub-light source array 402 emits light under the control of the second driving circuit. The arrangement of the sub light sources 402 may be a one-dimensional arrangement, a two-dimensional arrangement, a regular arrangement, or an irregular arrangement.
In one embodiment, the light source unit further includes one or more optical elements such as a lens (or a lens group), a micro lens array, and the like, for example, a lens (or a lens group) 403 is disposed between the sub-light source 402 and the scanning unit 404, and the lens 403 is used for refracting the light beam emitted from the light source to generate a converging or focusing effect so as to meet the modulation requirement of the subsequent optical elements.
The scanning unit 404 receives a first light beam emitted from the light source, and deflects and scans the first light beam to form a second light beam. The scanning unit 404 may diffract, refract, reflect, and/or the like, and/or deflect the incident sub-beams in one or two dimensions, for example, in at least one direction by a certain angle, so as to form the second beam.
The beam splitting unit 405 receives the second light beam emitted from the scanning unit 404, and performs a replica beam splitting of the second light beam to form a third light beam having a larger number of light beams. In one embodiment, beam splitting unit 405 performs a replicated splitting of the second beam to form a third beam with a higher packing density; in one embodiment, the beam splitting unit 405 performs replicated beam splitting on the second beam to form a third beam with a larger field angle; in one embodiment, the beam splitting unit 405 performs a replicated beam splitting on the second light beam to form a third light beam with higher arrangement density and larger field angle. The beam splitting unit 405 may be any optical device capable of splitting beams, such as a diffractive optical element, an optical mask, a super surface (Metasurface) optical element, and the like. Similarly to the embodiment shown in fig. 2, by setting the relationship between the deflection angle θ and the angle of view α of the third light beam, and the angular offset between the adjacent sub-light beams as β, it is possible to form a comprehensive projection pattern with a higher density and a larger angle of view.
In the embodiment shown in fig. 4, a schematic diagram is schematically shown in which the scanning unit 404 deflects the first light beam by two angles in one direction, wherein the first and second light beams can be regarded as being formed by deflection by 0 degrees (a solid line between the scanning unit 404 and the beam splitting unit 405 in the figure); the second and second light beams are formed by the scanning unit 404 deflecting the first light beam by a small angle θ (shown as a dotted line between the scanning unit 404 and the beam splitting unit 405). The angle θ is smaller than an included angle θ < β between two adjacent sub-beams in the third beam, so that a comprehensive projection pattern formed by at least two third beams 406 and 407 formed after at least two scans has a higher density than a projection pattern corresponding to the third beam without the scanning unit 404, thereby improving the measurement resolution of the measurement system.
In one embodiment, the deflection angles θ may be sequentially set to
Figure BDA0002219227720000121
With n scans, the scan angle is increased successively
Figure BDA0002219227720000122
Thereby increasing the overall projected pattern density by a factor of n. In one embodiment, the deflection angles θ may be sequentially set to
Figure BDA0002219227720000123
Thereby, the density of the projection pattern and the angle of view can be increased simultaneously, i.e. the angle of view is increased by N β and the density of the middle portion overlapping area is increased by N times. In one embodiment, the deflection angle is set to exceed the field angle of the second beam by α, and only the field angle of the projection pattern is increased, as also shown in fig. 5, and similar to the previous analysis, the scanning unit is shown in fig. 5 at 504, and the beam splitting unit is shown in fig. 505, so that the large field projection pattern as shown in fig. 6 can be formed as well.
It can be understood that, in the embodiments shown in fig. 2 and fig. 4, the beam splitting unit and the scanning unit are respectively provided in opposite arrangement to achieve similar functions, in some embodiments, a first beam splitting unit and a second beam splitting unit may be respectively arranged before and after the scanning unit to achieve more complex functions, or a first scanning unit and a second scanning unit may be respectively arranged before and after the beam splitting unit, and similarly, the number and relative position arrangement relationship of the beam splitting unit and the scanning unit may be reasonably set according to actual needs. All falling within the scope of protection of the present invention.
In the above embodiments, the beam splitting unit and the scanning unit are configured reasonably in function to form high-density and/or large-field projection. However, the need to integrate multiple optics into a single emitter creates undoubted manufacturing challenges. To solve this problem, the present invention also provides an integrated beam splitting scanning unit.
FIG. 7 is a schematic diagram of an integrated beam splitting scanning unit, according to one embodiment of the present invention. The integrated beam splitting scanning unit can be used in the emitters in the embodiments shown in fig. 1-6, and can also be used in any other desired device. The integrated beam splitting and scanning unit is used for receiving the first light beam, splitting and scanning the light beam to form a third light beam. The integrated beam splitting scanning unit includes a first transparent substrate 701, a second transparent substrate 702, a liquid crystal layer 703, and a beam splitting unit 704 disposed on the first transparent substrate and/or the second transparent substrate. The liquid crystal layer 703 is used to deflect an incident light beam for scanning, and the beam splitting unit 704 is used to split the incident light beam. The first transparent substrate 701 and the second transparent substrate 702 may be disposed in parallel and opposite to each other. The liquid crystal layer 703 is interposed between the first transparent substrate 701 and the second transparent substrate 702, and the substrates may function to protect the liquid crystal layer. In addition, other functional layers, such as positive and negative electrode layers, can be added in the liquid crystal layer between the two substrates according to requirements, and the positive and negative electrode layers are arranged on two sides of the liquid crystal layer; polarizing layers and the like may also be added to the outer or inner surface of the substrate.
In one embodiment, the integrated beam splitting scanning unit includes a support 705 disposed between the first transparent substrate 701 and the second transparent substrate 702, the support 705 being disposed around the liquid crystal layer to protect the liquid crystal layer while functioning to support the first transparent substrate 701 and the second transparent substrate 702. The support may be made of any material, such as a semiconductor material, an adhesive, etc.
In one embodiment, the beam splitting unit 704 includes one or a combination of diffractive optical elements such as a diffraction grating and a binary grating, and a super surface (Metasurface) optical element, that is, a diffractive optical microstructure and a super surface structure are formed on the surface of a transparent substrate by means of photolithography, etching, and the like, so that high integration of the beam splitting unit and the scanning unit is achieved. The diffractive optical microstructure, the super surface structure, may be formed on a single surface or both surfaces of the first transparent substrate 701 and/or the second transparent substrate according to actual needs. Preferably, the diffractive optical microstructure is formed on an inner surface of a single transparent substrate, and the diffractive optical microstructure can be effectively protected.
The present invention also provides a method of manufacturing an integrated beam splitting scanning unit, comprising the steps of:
providing a liquid crystal layer for deflecting an incident beam to realize scanning;
providing a first transparent substrate and a second transparent substrate, and generating a beam splitting unit on a single surface or two surfaces of the first transparent substrate and/or the second transparent substrate;
the liquid crystal layer is installed between the first transparent substrate and the second transparent substrate.
For the integrated beam splitting scanning unit comprising a support, the step of mounting the support between the first transparent substrate and the second transparent substrate and at the periphery of the liquid crystal layer is further included.
For the emitter which deflects the light beam through the scanning unit to realize the large field of view projection (as shown in fig. 5, the positions of the beam splitting unit and the scanning unit are not limited, that is, the beam splitting unit can be arranged in front of or behind the scanning unit), the invention also provides a dynamic distance measuring system based on the emitter of the grouped array light source. The light source of the emitter in the system comprises an array light source, the sub light sources in the array light source are divided into a plurality of sub light source arrays, each sub light source array can be independently controlled in a grouping mode, in the aspect of spatial arrangement, the sub light source arrays can be arranged in a partitioning mode, namely each sub light source array has an independent spatial partition, the sub light source arrays can also be arranged in a crossing mode, and namely the sub light sources in different sub light source arrays are staggered in the spatial arrangement. At least one sub-light source should be included in the sub-light source array. It can be understood that when the sub-light source arrays are independently turned on, corresponding projection patterns are formed, the density of the projection patterns is related to the density and the number of the sub-light source arrays, the greater the density of the projection patterns corresponding to the sub-light source arrays with more dense arrangement is, and the greater the density of the projection patterns corresponding to the sub-light source arrays with more number is turned on. Based on the large field of view projection scheme (shown in fig. 5) of the grouped array light source, the processing circuit in the measurement system can implement the following dynamic distance measurement method, which specifically includes the following steps:
s1, starting at least one first sub-light source array, and forming a sparse projection pattern with a first field of view by using a scanning unit;
fig. 8 is a schematic diagram of an array light source and its sparse projection pattern according to an embodiment of the present invention. The light source in the emitter comprises a light source array 801 comprising a plurality of sub-light source arrays, such as a first sub-light source array (shown as open circles in fig. 8) and a second sub-light source array (shown as filled circles in fig. 8). First, the first sub-light source array is turned on, and the beam splitting unit and the scanning unit in the emitter respectively split and scan (or scan first and split) the light beam emitted by the first sub-light source array, and finally the light beam is emitted in the projection pattern 802 shown on the right side in fig. 8 and is incident into the first view field region including the target 804. Here, the beam splitting unit is schematically shown to perform 2 × 2 replicated beam splitting on the incident beam, and the scanning unit sequentially performs 3 × 3 scanning on the incident beam to expand the field of view by 3 times in the horizontal and vertical directions, respectively.
S2, obtaining a first depth image with a first resolution ratio, and identifying an area where a target is located; the collector collects the light signals reflected back by the target from the sparse projection pattern beam and is further computed by the processing circuitry to obtain a first depth image of a first resolution corresponding to the sparse projection pattern, and theoretically the depth value of each blob 803 can be obtained, so the depth values of the blobs will constitute the first depth image. The target in the field of view can be identified based on the depth image, for example, a pixel region where the target is located can be identified by any suitable means such as a threshold segmentation method, an edge detection method, a feature identification method, and the like.
S3, starting at least one second sub light source array, forming a dense projection pattern with a second field of view by using the scanning unit, and calculating a second depth image with a second resolution; because the target is identified and the pixel area where the target is located in the previous step, generally speaking, the movement of the target is not too large, meanwhile, the interval between two adjacent measurements is very short, and the position of the target is considered to be unchanged within the time of the two adjacent measurements, therefore, during the measurement, the scanning unit can only form a projection pattern of a second view field which contains the target area and is smaller than the first view field, and meanwhile, more sub-light source arrays can be started than in the step S1 to form a dense projection pattern with higher relative light beam arrangement density, and based on the dense projection pattern, the collector can obtain effective data of more spots containing the target to calculate a depth image with higher resolution, so as to realize high-resolution measurement of the target area. It is to be understood that the resolution generally refers to the number of pixels of the effective depth values, and the resolution is higher for a larger number of pixels of the effective depth values, so that the second resolution is higher than the first resolution. For example, fig. 9 shows a schematic diagram of an array light source and its dense projection pattern according to an embodiment of the present invention. In the embodiment, the first array light source and the second array light source are turned on simultaneously, that is, the first sub light source array and the second sub light source array are turned on synchronously, the scanning unit forms only the projection pattern of the 2 × 2 field of view composed of the four sub fields 902, 903, 904 and 905 containing the target, and compared with the embodiment shown in fig. 8, the field of view is reduced, but the density of the projection pattern is increased, thereby realizing measurement with higher resolution at lower power consumption. It can be understood that, if the light source unit includes a plurality of sub light source arrays with different arrangement densities, for example, the arrangement density of the first sub light source array is smaller than that of the second sub light source array, in this step, only the second sub light source array may be turned on, and an effect of projecting a dense projection pattern may also be achieved.
It is understood that the above embodiments are described by taking a time-of-flight distance measurement system as an example, but the related transmitter and dynamic distance measurement scheme can be applied to other measurement systems, such as a structured light three-dimensional measurement system.
It is to be understood that when the distance measuring system of the present invention is embedded in a device or hardware, corresponding structural or component changes may be made to adapt to the needs, the nature of which still employs the distance measuring system of the present invention and should be considered as the scope of the present invention. The foregoing is a further detailed description of the invention in connection with specific/preferred embodiments and it is not intended to limit the invention to the specific embodiments described. It will be apparent to those skilled in the art that various substitutions and modifications can be made to the described embodiments without departing from the spirit of the invention, and these substitutions and modifications should be considered to fall within the scope of the invention. In the description herein, references to the description of the term "one embodiment," "some embodiments," "preferred embodiments," "an example," "a specific example," or "some examples" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention.
In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Moreover, various embodiments or examples and features of various embodiments or examples described in this specification can be combined and combined by one skilled in the art without being mutually inconsistent. Although embodiments of the present invention and its advantages have been described in detail, it should be understood that various changes, substitutions and alterations can be made herein without departing from the scope of the invention as defined by the appended claims.
Moreover, the scope of the present application is not intended to be limited to the particular embodiments of the process, machine, manufacture, composition of matter, means, methods and steps described in the specification. As one of ordinary skill in the art will readily appreciate, the above-described disclosures, processes, machines, manufacture, compositions of matter, means, methods, or steps, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding embodiments described herein may be utilized. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or steps.

Claims (8)

1. A dynamic distance measuring system, comprising:
a transmitter for transmitting a light beam to a target object; wherein the transmitter includes a light source unit composed of a plurality of sub light source arrays, which can be independently controlled in groups, a beam splitting unit for splitting a beam, and a scanning unit for deflecting the beam;
the collector is used for collecting at least part of the emitted light beams reflected by the target object and forming light signals;
a processing circuit connected to the transmitter and the collector and configured to perform the following steps:
s1, starting at least one first sub light source array, and forming a sparse first projection pattern with a first field of view by using the scanning unit;
s2, obtaining a first depth image with a first resolution ratio corresponding to the first projection pattern, and identifying the area where the target object is located;
s3, starting at least one second sub light source array, forming a second dense projection pattern only comprising a second field of view of the target object by using the scanning unit, and calculating a second depth image with a second resolution; wherein the second resolution is higher than the first resolution.
2. The dynamic distance measurement system of claim 1, wherein the first field of view is larger than the second field of view.
3. The dynamic distance measuring system of claim 1, wherein an arrangement density of the light beams in the second projection pattern is higher than an arrangement density of the light beams in the first projection pattern.
4. The dynamic distance measurement system of claim 1, wherein the second array of sub-light sources has a higher density of sub-light source arrangements relative to the first array of sub-light sources.
5. A dynamic distance measuring method, characterized by comprising the steps of:
s10, starting at least one first sub-light source array, and forming a sparse first projection pattern with a first field of view by using a scanning unit;
s20, obtaining a first depth image with a first resolution ratio corresponding to the first projection pattern, and identifying the area where the target object is located;
s30, starting at least one second sub-light source array, forming a dense second projection pattern only comprising a second field of view of the target object by using the scanning unit, and calculating a second depth image with a second resolution; wherein the second resolution is higher than the first resolution.
6. The dynamic distance measurement method of claim 5, wherein said first field of view is larger than said second field of view.
7. The dynamic distance measuring method according to claim 5, wherein an arrangement density of the light beams in the second projection pattern is higher than an arrangement density of the light beams in the first projection pattern.
8. The dynamic distance measuring method of claim 5, wherein said second sub light source array has a higher arrangement density of sub light sources relative to said first sub light source array.
CN201910927160.3A 2019-09-27 2019-09-27 Dynamic distance measuring system and method Active CN110824490B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910927160.3A CN110824490B (en) 2019-09-27 2019-09-27 Dynamic distance measuring system and method
PCT/CN2019/113752 WO2021056668A1 (en) 2019-09-27 2019-10-28 Dynamic distance measurement system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910927160.3A CN110824490B (en) 2019-09-27 2019-09-27 Dynamic distance measuring system and method

Publications (2)

Publication Number Publication Date
CN110824490A CN110824490A (en) 2020-02-21
CN110824490B true CN110824490B (en) 2023-01-03

Family

ID=69548359

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910927160.3A Active CN110824490B (en) 2019-09-27 2019-09-27 Dynamic distance measuring system and method

Country Status (2)

Country Link
CN (1) CN110824490B (en)
WO (1) WO2021056668A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110716190A (en) * 2019-09-27 2020-01-21 深圳奥锐达科技有限公司 Transmitter and distance measurement system
CN110716189A (en) * 2019-09-27 2020-01-21 深圳奥锐达科技有限公司 Transmitter and distance measurement system
CN111289990A (en) * 2020-03-06 2020-06-16 浙江博升光电科技有限公司 Distance measurement method based on vertical cavity surface emitting laser array
JP7286573B2 (en) * 2020-03-12 2023-06-05 株式会社日立エルジーデータストレージ Ranging device and ranging method
WO2021208041A1 (en) * 2020-04-16 2021-10-21 华为技术有限公司 Light-emitting assembly, time-of-flight camera module, and mobile terminal
CN111458717A (en) * 2020-04-20 2020-07-28 深圳奥比中光科技有限公司 TOF depth measuring device and method and electronic equipment
CN112633284B (en) * 2020-12-08 2023-08-15 北京信息科技大学 Deep learning handwriting digital recognition method
CN114740625B (en) * 2022-04-28 2023-08-01 珠海莫界科技有限公司 Optical machine, control method of optical machine and AR near-to-eye display device

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7599983B2 (en) * 2002-06-18 2009-10-06 Wireless Ink Corporation Method, apparatus and system for management of information content for enhanced accessibility over wireless communication networks
CN103499818B (en) * 2013-10-10 2015-07-29 中国科学院上海技术物理研究所 A kind of infrared and laser compound detection system
CN103645745B (en) * 2013-11-05 2016-05-25 皖江新兴产业技术发展中心 A kind of twin shaft Laser-ceilometer transmitting-receiving parallel method of adjustment of system optical axis and device
CN105222758B (en) * 2015-10-20 2017-10-20 西安交通大学 Multiple mobile object search and positioner and method based on birds visual signature
CN105676305B (en) * 2015-12-31 2017-05-31 南京华图信息技术有限公司 A kind of many visual field collection of illustrative plates cooperative detection systems of Shared aperture and method
CN107367737A (en) * 2016-05-13 2017-11-21 北醒(北京)光子科技有限公司 A kind of multi-thread rotation sweep detection method
US20180074196A1 (en) * 2016-05-27 2018-03-15 Harvey Weinberg Hybrid flash lidar system
CN107105147B (en) * 2017-06-05 2019-06-21 北京理工大学 A kind of bionical super-resolution imaging sensor and imaging method
EP3460519A1 (en) * 2017-09-25 2019-03-27 Hexagon Technology Center GmbH Laser scanner
KR102532603B1 (en) * 2017-09-25 2023-05-15 삼성전자주식회사 Optical sensing system and optical apparatus including the same
CN108345002A (en) * 2018-02-27 2018-07-31 上海图漾信息科技有限公司 Structure light measurement device and method
CN108828622B (en) * 2018-06-25 2022-03-04 北京理工大学 Resolution-variable beam splitting method for liquid crystal optical phased array
CN109798873A (en) * 2018-12-04 2019-05-24 华南理工大学 A kind of stereoscopic vision optical positioning system
CN209417319U (en) * 2019-03-11 2019-09-20 杭州海康威视数字技术股份有限公司 Detector
CN110196023B (en) * 2019-04-08 2024-03-12 奥比中光科技集团股份有限公司 Dual-zoom structured light depth camera and zooming method

Also Published As

Publication number Publication date
WO2021056668A1 (en) 2021-04-01
CN110824490A (en) 2020-02-21

Similar Documents

Publication Publication Date Title
CN110824490B (en) Dynamic distance measuring system and method
CN111025317B (en) Adjustable depth measuring device and measuring method
TWI719325B (en) Light ranging device with electronically scanned emitter array and synchronized sensor array
CN110716190A (en) Transmitter and distance measurement system
CN110658529A (en) Integrated beam splitting scanning unit and manufacturing method thereof
CN110596721B (en) Flight time distance measuring system and method of double-shared TDC circuit
WO2022021797A1 (en) Distance measurement system and distance measurement method
US11435446B2 (en) LIDAR signal acquisition
WO2021072802A1 (en) Distance measurement system and method
CN110596723B (en) Dynamic histogram drawing flight time distance measuring method and measuring system
CN105143820A (en) Depth scanning with multiple emitters
CN110780312B (en) Adjustable distance measuring system and method
CN111175769B (en) Off-axis scanning distance measuring system
CN110716189A (en) Transmitter and distance measurement system
KR20220006638A (en) Synchronized Image Capture for Electronic Scanning LIDAR Systems
CN111427230A (en) Imaging method based on time flight and 3D imaging device
CN110687542A (en) Off-axis scanning distance measuring system and method
CN212135134U (en) 3D imaging device based on time flight
CN111965658A (en) Distance measuring system, method and computer readable storage medium
WO2021212915A1 (en) Laser distance measuring device and method
CN111175768B (en) Off-axis scanning distance measuring system and method
CN210835244U (en) 3D imaging device and electronic equipment based on synchronous ToF discrete point cloud
CN111965659A (en) Distance measuring system, method and computer readable storage medium
CN211426798U (en) Integrated beam splitting scanning unit
CN211148903U (en) Transmitter and distance measurement system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant