CN109343070A - Time flight depth camera - Google Patents
Time flight depth camera Download PDFInfo
- Publication number
- CN109343070A CN109343070A CN201811393403.1A CN201811393403A CN109343070A CN 109343070 A CN109343070 A CN 109343070A CN 201811393403 A CN201811393403 A CN 201811393403A CN 109343070 A CN109343070 A CN 109343070A
- Authority
- CN
- China
- Prior art keywords
- light beam
- time
- carrier wave
- depth camera
- wave light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 29
- 238000012545 processing Methods 0.000 claims abstract description 15
- 230000001678 irradiating effect Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 10
- 238000004364 calculation method Methods 0.000 description 7
- 238000005259 measurement Methods 0.000 description 7
- 238000000034 method Methods 0.000 description 6
- 239000000203 mixture Substances 0.000 description 4
- 230000008901 benefit Effects 0.000 description 2
- 235000009508 confectionery Nutrition 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 238000006424 Flood reaction Methods 0.000 description 1
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- KBPHJBAIARWVSC-RGZFRNHPSA-N lutein Chemical compound C([C@H](O)CC=1C)C(C)(C)C=1\C=C\C(\C)=C\C=C\C(\C)=C\C=C\C=C(/C)\C=C\C=C(/C)\C=C\[C@H]1C(C)=C[C@H](O)CC1(C)C KBPHJBAIARWVSC-RGZFRNHPSA-N 0.000 description 1
- 229960005375 lutein Drugs 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- KBPHJBAIARWVSC-XQIHNALSSA-N trans-lutein Natural products CC(=C/C=C/C=C(C)/C=C/C=C(C)/C=C/C1=C(C)CC(O)CC1(C)C)C=CC=C(/C)C=CC2C(=CC(O)CC2(C)C)C KBPHJBAIARWVSC-XQIHNALSSA-N 0.000 description 1
- FJHBOVDFOQMZRV-XQIHNALSSA-N xanthophyll Natural products CC(=C/C=C/C=C(C)/C=C/C=C(C)/C=C/C1=C(C)CC(O)CC1(C)C)C=CC=C(/C)C=CC2C=C(C)C(O)CC2(C)C FJHBOVDFOQMZRV-XQIHNALSSA-N 0.000 description 1
- 235000008210 xanthophylls Nutrition 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
The present invention provides a kind of time flight depth camera, connect the processing circuit for calculating the flight time between transmitting light beam and the reflected beams including the emitting mould train for emitting light beam, the acquisition mould group for acquiring the reflected beams and with emitting mould train, acquisition mould group.Wherein emitting mould train includes light source, time optical modulator and spatial light modulator, time optical modulator issues corresponding carrier wave light beam for controlling light source with a time carrier signal, and spatial light modulator is used to carrier wave light beam carrying out spatial modulation to launch outward to form non-floodlight carrier wave light beam；Acquisition mould group includes array pixel cells and lens unit, and lens unit is for receiving and at least partly non-floodlight carrier wave light beam being reflected back by object being imaged at least partly array pixel cells.Non- floodlight carrier wave light beam is formed to the modulation of light source by time optical modulator and spatial light modulator, to promote time flight depth camera to the anti-interference ability of environment light, and reduces power consumption.
Description
Technical field
The invention belongs to field of computer technology, are to be related to a kind of time flight depth camera more specifically.
Background technique
Time fly (Time of flight, TOF) depth camera by measuring beam flight time in space come
The distance for calculating object is widely used in consumer electronics, unmanned frame since it has many advantages, such as that precision is high, measurement range is big
It sails, the fields such as AR/VR.
Traditional time flight depth camera system includes a light source and camera, and light source emits floodlight to object space
To provide illumination, camera is then imaged the flood beam being reflected back light beam, and system passes through again calculates light beam by being emitted to instead
The time required for receiving is penetrated to calculate the distance of object.When carrying out distance sensing using time flight depth camera, environment
Light interference influences whether the precision of measurement, such as when ambient light intensity is higher or even floods the floodlight of light source, it will be difficult to differentiate
The light beam of light source is so that there is biggish measurement error out.
In existing technology can by increase the electronic methods such as the optical means such as optical filter and setting subtraction circuit come
Background Xanthophyll cycle is carried out, is missed however, measurement caused by ambient light interference still inherently cannot be eliminated or be reduced to these methods
Difference.
Summary of the invention
The present invention is in order to solve to lack a kind of asking for time flight depth camera that environment resistant optical property is good in the prior art
Topic, provides a kind of time flight depth camera.
To solve the above-mentioned problems, the technical solution adopted by the present invention is as described below:
A kind of time flight depth camera, including for emitting light beam emitting mould train, for acquiring adopting for the reflected beams
Collect mould group and connect the place for calculating the flight time between transmitting light beam and the reflected beams with emitting mould train, acquisition mould group
Manage circuit.Wherein emitting mould train includes light source, time optical modulator and spatial light modulator, and time optical modulator is for controlling
Light source issues corresponding carrier wave light beam with a time carrier signal, and spatial light modulator is used to carrier wave light beam carrying out space tune
System is launched outward with forming non-floodlight carrier wave light beam；Acquiring mould group includes array pixel cells and lens unit, lens unit
For receiving and at least partly non-floodlight carrier wave light beam being reflected back by object being imaged at least partly array pixel cells.
In one embodiment, the processing circuit is also used to calculate the distance of the object according to the flight time.
In one embodiment, the time carrier signal includes pulse signal, square-wave signal, one in sine wave signal
Kind.
In one embodiment, the spatial light modulator includes diffraction optical element, the non-floodlight carrier wave light beam packet
Include speckle carrier wave light beam or regular array spot carrier wave light beam.In the speckle carrier wave light beam or regular array spot carrier wave light beam
Spot will be imaged at least two pixel unit of the array pixel cells.The speckle carrier wave light beam or regular array
The distance between spot in spot carrier wave light beam is no more than the size of the spot.
In one embodiment, the spatial light modulator includes mask plate, and the non-floodlight carrier wave light beam includes two dimension
Coding pattern carrier wave light beam.
In one embodiment, the spatial light modulator includes MEMS scanner.MEMS scanner surface includes
Balzed grating,.
In one embodiment, the array pixel cells include one of CCD, CMOS, SPAD.
It in one embodiment, include multiple sub-pixel lists being made of at least two pixels in the array pixel cells
Member, each sub-pixel unit is for receiving and at least partly described non-floodlight carrier wave light beam being reflected back by object being imaged.It is described
Each pixel in sub-pixel unit is configured as being activated in different time to acquire the light of non-floodlight carrier wave light beam letter
Number, the processing circuit calculates the distance of the flight time and/or object based on the optical signal.
The invention has the benefit that provide a kind of time flight depth camera, by time optical modulator and
Spatial light modulator forms non-floodlight carrier wave light beam to the modulation of light source, to promote the time flight depth camera to environment light
Anti-interference ability, and reduce power consumption.
Detailed description of the invention
Fig. 1 is the time flight depth camera schematic diagram according to the application one embodiment.
Fig. 2 is the emitting mould train schematic diagram according to the application one embodiment.
Fig. 3 is the emitting mould train schematic diagram according to another embodiment of the application.
Fig. 4 is the array pixel cells schematic diagram according to the application one embodiment.
Fig. 5 is the flight time calculation method step schematic diagram according to the application one embodiment.
Specific embodiment
In order to which technical problem to be solved of the embodiment of the present invention, technical solution and beneficial effect is more clearly understood,
The present invention is further described in detail below with reference to the accompanying drawings and embodiments.It should be appreciated that specific implementation described herein
Example is only used to explain the present invention, is not intended to limit the present invention.
It should be noted that it can be directly another when element is referred to as " being fixed on " or " being set to " another element
On one element or indirectly on another element.When an element is known as " being connected to " another element, it can
To be directly to another element or be indirectly connected on another element.In addition, connection can be for fixing
Effect is also possible to act on for circuit communication.
It is to be appreciated that term " length ", " width ", "upper", "lower", "front", "rear", "left", "right", "vertical",
The orientation or positional relationship of the instructions such as "horizontal", "top", "bottom" "inner", "outside" is that orientation based on the figure or position are closed
System is merely for convenience of the description embodiment of the present invention and simplifies description, rather than the device or element of indication or suggestion meaning must
There must be specific orientation, be constructed and operated in a specific orientation, therefore be not considered as limiting the invention.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include one or more this feature.In the description of the embodiment of the present invention, the meaning of " plurality " is two or two
More than, unless otherwise specifically defined.
The present invention provides a kind of time flight depth cameras, with stronger environment resistant light ability, it is possible to understand that
Being the problem of this programme is in addition to can solve ambient light interference, also can solve other problems, such as the problem etc. that power consumption is high.
Fig. 1 is time flight depth camera schematic diagram according to an embodiment of the invention.Time flight depth camera 10
Including emitting mould train 11, acquisition mould group 12 and processing circuit 13, wherein emitting mould train 11 provides transmitting light beam 30 to target empty
Between in illuminate the object 20 in space, at least partly transmitting light beam 30 through object 20 reflection after formed the reflected beams 40, reflection
At least partly collected mould group 12 of light beam 40 acquires, and processing circuit 13 connects with emitting mould train 11 and acquisition mould group 12 respectively
It connects, synchronized transmissions mould group 11 and the trigger signal for acquiring mould group 12 are issued with to calculate light beam by emitting mould train 11 and be collected mould
Time required for group 12 receives, i.e. flight time t between transmitting light beam 30 and the reflected beams 40, further, on object
The distance D of corresponding points can be calculated by following formula:
D=ct/2 (1)
Wherein, c is the light velocity.
Emitting mould train 11 includes light source 111, time optical modulator 112 and spatial light modulator 113.Light source 111 can be with
It is the light sources such as light emitting diode (LED), edge-emitting laser (EEL), vertical cavity surface emitting laser (VCSEL), is also possible to
The array of source of multiple light sources composition, the light beam that light source is emitted can be visible light, infrared light, ultraviolet light etc..
Time optical modulator 112 provides a time carrier signal to light source 111, is emitted accordingly with controlling light source 111
Carrier wave light beam.For example, in one embodiment, carrier signal is the pulse signal with certain frequency, and light source 111 is with the frequency
Emit pulsed light beam, can be used in direct time flight method (DirectTOF) measurement；In one embodiment, carrier signal
It is the square-wave signal or sinusoidal signal with certain wavelength, the amplitude of light source 111 is emitted accordingly by the carrier signal modulation
Square wave light beam or sine wave light beam, can be used for indirect flight Time Method (Indirect TOF) measurement in.It is understood that
It is that time optical modulator 112 can be independent control circuit and be also possible to processing circuit 13, for example processing circuit 13 passes through tune
The power of light source processed realizes the carrier modulation to light source amplitude.The frequency of carrier signal is set according to measurement distance, such as
1MHz~100MHz can be set into, measure distance at several meters to several hundred rice.
Spatial light modulator 113 receives the carrier wave light beam from light source 111, and carrier wave light beam is carried out spatial modulation, i.e.,
The distribution of carrier wave light beam in space is modulated to form the non-uniform non-floodlight carrier wave light beam of intensity distribution and launch outward.
Compared with traditional flood beam, since the intensity distribution of non-flood beam is uneven, in the identical situation of light source power, by force
Degree, which is distributed higher region, will have to the higher interference free performance of environment light；In addition, in the identical situation of projection field angle,
Due to the inhomogeneities of intensity distribution, base will reach identical environment light interference free performance, and floodlighting needs higher power consumption.
In some embodiments, the carrier wave light beam that spatial light modulator 113 is also used to receive expands, to expand
Field angle.
Processing circuit 13 can be independent special circuit, such as Special SOC chip, fpga chip, asic chip etc.,
Also it may include general processor, such as when the depth camera is integrated into such as mobile phone, TV, in computer intelligent terminal,
Processor in terminal can be used as at least part of the processing circuit 13.
In some embodiments, time flight depth camera 10 can also include the devices such as color camera, infrared camera, IMU
Function more abundant, such as the modeling of 3D texture, infrared face recognition, SLAM etc. may be implemented in part, the combination with these devices
Function.
Fig. 2 is emitting mould train schematic diagram according to an embodiment of the invention.Emitting mould train 11 includes light source 201, driving
Circuit 202, lens 203 and diffraction optical element (DOE) 204, light source 201 is under the Power x Time modulation of driving circuit 202
Emitting the light beam of pulse, square wave or sine wave modulation, light beam is incident on DOE204 after the collimation of lens 203 or focusing,
DOE204 carries out spatial modulation, i.e. diffraction to incident light beam.In one embodiment, DOE204 divides incident light beam
Beam, and launch multiple light beams 301,302 and 303, such as tens of thousands of light beams into object space, every light beam is in object 20
Surface formed a spot.In one embodiment, DOE204 (will be referred to by the diffraction formation rule arrangement to incident beam
The angular variation of each spot is uniformly distributed, regularly arranged to be incident on 3D body surface, and arrangement can be reconstructed) array of spots.?
In one embodiment, DOE204 will form speckle pattern by diffraction to incident beam, i.e., spot arrangement have it is certain with
Machine.
Light source 201 can be single source and be also possible to array of source.In one embodiment, light source 201 is by rule
The array of source of multiple light sources composition, for example be made of the VCSEL light source of semiconductor substrate and multiple arrangements on substrate
VCSEL array chip.The array beams that DOE204 emits light source 201 replicate, the non-flood beam launched outward by
The array beams of multiple duplications form, it is possible thereby to expand the quantity of field angle and light beam.
In some embodiments, the spatial light modulator in emitting mould train 11 also may include mask plate, wrap on mask plate
Containing the two-dimensional pattern that incident beam is modulated into non-flood beam, such as can be by incident beam through spatial modulation by mask plate
Form two-dimensional encoded pattern beam.
In some embodiments, the spatial light modulator in emitting mould train 11 also may include microlens array, lenticule
Array is arranged by multiple lenticule units, and in one embodiment, multiple lenticule units receive the light from light source 201
Array beams corresponding with the arrangement of lenticule unit are generated after beam to launch outward；In one embodiment, light source 201 also comprising with
Corresponding multiple sub-light sources are arranged in microlens array, each lenticule unit receives the light beam of corresponding sub-light source simultaneously
Array beams are launched outward after collimation or focusing.Array beams can be random alignment form and be also possible to regularly arranged form.
Fig. 3 is the emitting mould train schematic diagram of another embodiment according to the present invention.Emitting mould train 11 includes light source 303, drives
Dynamic circuit 304, optical beam scanner 305, can also include lens unit (not shown), and light source 303 issues light beam through light beam
Emit after 305 reflections of scanner/diffraction to object space.Driving circuit 304 carries out timing algorithm for power modulation to light source 201 to emit
The light beam of pulse, square wave or sine wave modulation, optical beam scanner 305 by along the rotation of uniaxial or multiaxis with by beam emissions to mesh
Mark space.Optical beam scanner includes MEMS (MEMS) scanner in one embodiment, due to high scanning
Frequency and lesser volume can make emitting mould train have lesser volume and higher performance.MEMS scanner can
To be scanned with the frequency of 1MHz~20MHz, therefore enough spaces and temporal resolution can be provided.Pass through driving circuit
304 and optical beam scanner 305 configuration, the light beam that can launch light source 303 carries out space and time-modulation to generate
Multiple patterns beam exit, such as regular speckle patterns, candy strip, the space pattern of Sine distribution etc..
In one embodiment, light source 303 is laser light source, its surface of MEMS scanner 305 includes balzed grating, thus
Striped can be generated in a predetermined direction, and more dense candy strip can produce by scanning in MEMS scanner 305, by
The resolution ratio of depth image can be improved in this.
In some embodiments, optical beam scanner 305 is also possible to liquid crystal light modulator, nano chips modulator etc..
Fig. 1 is returned to, acquisition mould group 12 includes array pixel cells 121, lens unit 122, and lens unit 122 receives and will
It is imaged on at least partly described array pixel cells 121 by at least partly non-floodlight carrier wave light beam that object is reflected back.Array
Pixel unit 121 can be charge coupled cell (CCD), complementary metal oxide semiconductor (CMOS), avalanche diode (AD),
The array pixel cells of the compositions such as single-photon avalanche diode (SPAD), array size represent the resolution ratio of the depth camera,
Such as 320x240 etc..Generally, what is connect with array pixel cells 121 further includes by signal amplifier, time to digital converter device
(TDC), the reading circuit (not shown) of one of devices such as analog-digital converter (ADC) or a variety of compositions.
Fig. 4 is array pixel cells schematic diagram according to an embodiment of the invention.Array pixel cells 40 include multiple
Pixel unit 401 is converted into electric signal by reading for receiving the light beam being reflected back by object, and by light energy or photon numbers
Circuit 50 exports.In this embodiment it is assumed that the speckle pattern being made of multiple spots 60 being reflected back by object, by right
Spot can be configured to suitable size to be imaged on array pixel cells by the setting of lens, emitting mould train etc..Such as this
In embodiment, the size of spot about occupies 4 pixel regions.It is understood that the size of spot also can be set into it is single
The pixel region of pixel, two pixels or other quantity, such array pixel cells 40 are divided into more according to incident light beam
A sub- pixel unit region.
In this embodiment it is assumed that individually stigmatic image is on the sub-pixel unit that tetra- pixels of A, B, C, D form, speckle
For spot amplitude in pattern by sine wave or square-wave frequency modulation, the period of modulation is T.A, tetra- pixels of B, C, D are configured to single
Activated on the different time in cycle time, for example, respectively 0~T/2, T/2~T, T/4~3T/4, in 3T/4~5T/4 time
It is activated to acquire light beam, respectively obtains optical signal value I1, I2, I3 and I4.Due to it is corresponding in four pixels be same
Spot, when spot is sufficiently small, the corresponding object of spot may be considered a point, that is, think the depth value phase in four pixels
Together, it is based on this, processing circuit can be according to four-stepped switching policy, and the distance value of spot is (when including flight in tetra- pixels of A, B, C, D
Between) will be calculated by following formula:
D=CTatan2 (I1-I3, I4-I2)/(4 π) (2)
It is understood that the size of spot can carry out designing adjustment accordingly for multistep phase shift.
In some embodiments, spot is configured to the size of 2 pixel units, such as at ellipticity.Spot amplitude quilt
Impulse modulation, pulse period T, one in 2 pixel units is activated with emitting mould train impulsive synchronization, and in 0~T/2
Interior reception light beam, another receives light beam in T/2~T time, generates electric signal I1, I2 respectively.Then 2 pixels are corresponding
The depth value (include flight time) of target object can be calculated by following formula:
In some embodiments, spot is configured to the size of the above pixel unit of at least three.Spot amplitude is by pulse tune
It makes, pulse period T, at least three in multiple pixel units acquires background light signal I0 within 0~T/3 time respectively, in T/
3~2T/3 acquires optical signal I1, acquires optical signal I2 in 2T/3~T.Or 0~T/3 time interior acquisition optical signal I1, T/3~
2T/3 acquires optical signal I2, and 2T/3~T acquires background light signal I0, can calculate the distance value of target object accordingly
The above is only how being carried out apart from calculating using speckle pattern to better illustrate, and that enumerates several possible adjusts
System and be applied equally to apart from depth calculation mode, other possible modulation systems and distance calculation formula it is proposed that it is non-
Flood light pattern.
In order to increase the resolution ratio of depth image, in some embodiments, the distance between adjacent spots be should not be too large, excellent
Selection of land, the distance between adjacent spots along a direction are configured to be no more than 1 times of spot itself size in the direction, such as
Spot lateral dimension is M, adjacent spots transversely between be divided into N, then N < M, preferably, N is configured to the 50% of M.
This scheme by the way that the multiple pixels fallen into same blob are carried out with timing control and approximate calculation depth value,
For the calculating of traditional single pixel, computational efficiency is increased dramatically.And for flood light pattern, due to single
The range of spot is smaller, and the multiple pixels dropped into single spot can be identified that (flood light pattern can not be positioned at phase
Consistent multiple pixels), calculated depth value confidence level is higher.
It is understood that be illustrated so that spot is formed by non-floodlight carrier wave light beam as an example in the embodiment above
, above scheme is equally applicable to other non-floodlight carrier wave light beams, such as striped, two-dimensional encoded pattern etc..
Fig. 5 is the flight time calculation method step schematic diagram according to the application one embodiment.The flight time calculates
Method is to be executed according to above-mentioned time flight depth camera by forms such as processing circuit, software, software and hardware combinings.In 511 steps
In, non-floodlight carrier wave light beam, emitting mould train such as Fig. 2, Fig. 3 and above-mentioned each embodiment institute are launched outward using emitting mould train
Show, the non-floodlight carrier wave light beam emitted includes the carrier light of the non-floodlight forms such as speckle, regular spot, two-dimensional encoded, striped
Beam；In 512 steps, at least partly described non-floodlight carrier wave light beam being reflected back by object, transmitting are acquired using acquisition mould group
Mould group launches the object after light beam in illumination target space, and is reflected by object, and what is be reflected back is at least partly described non-general
Light carrier light beam is received by collected mould group, acquires mould group as shown in Fig. 4 and the various embodiments described above；In step 513, calculate
Flight time between the non-floodlight carrier wave beam emissions and reflection passes through the side such as phase, high-speed shutter by processing circuit
Formula record and calculate the non-floodlight carrier wave light beam of transmitting and the light beam that is reflected back between flight time, specific calculation
It is detailed in the description of front, such as 2 phases, 3 phases and 4 phase calculation modes.
The above content is a further detailed description of the present invention in conjunction with specific preferred embodiments, and it cannot be said that
Specific implementation of the invention is only limited to these instructions.For those skilled in the art to which the present invention belongs, it is not taking off
Under the premise of from present inventive concept, several equivalent substitute or obvious modifications can also be made, and performance or use is identical, all answered
When being considered as belonging to protection scope of the present invention.
Claims (12)
1. a kind of time flight depth camera characterized by comprising
Emitting mould train, for emitting light beam, comprising: light source, time optical modulator and spatial light modulator, the time light tune
Device processed issues corresponding carrier wave light beam for controlling the light source with a time carrier signal, and the spatial light modulator is used for
The carrier wave light beam is carried out spatial modulation to launch outward to form non-floodlight carrier wave light beam；
Mould group is acquired, for acquiring the reflected beams, comprising: array pixel cells and lens unit, the lens unit are used for
It receives and at least partly described non-floodlight carrier wave light beam being reflected back by object is imaged on at least partly described pixelated array list
In member；
Processing circuit is connect with the emitting mould train and the acquisition mould group, for calculating the transmitting light beam and described anti-
Flight time between irradiating light beam.
2. time flight depth camera according to claim 1, which is characterized in that the processing circuit is also used to according to institute
State the distance that the flight time calculates the object.
3. time flight depth camera according to claim 1, which is characterized in that the time carrier signal includes pulse
One of signal, square-wave signal, sine wave signal.
4. time flight depth camera according to claim 1, which is characterized in that the spatial light modulator includes diffraction
Optical element or microlens array, the non-floodlight carrier wave light beam include speckle carrier wave light beam or regular array spot carrier light
Beam.
5. time flight depth camera according to claim 4, which is characterized in that the speckle carrier wave light beam or regular battle array
Spot in column spot carrier wave light beam will be imaged at least two pixel unit of the array pixel cells.
6. time flight depth camera according to claim 4, which is characterized in that the speckle carrier wave light beam or regular battle array
The distance between spot in column spot carrier wave light beam is no more than the size of the spot.
7. time flight depth camera according to claim 1, which is characterized in that the spatial light modulator includes exposure mask
Plate, the non-floodlight carrier wave light beam include two-dimensional encoded pattern carrier wave light beam.
8. time flight depth camera according to claim 1, which is characterized in that the spatial light modulator includes MEMS
Scanner.
9. time flight depth camera according to claim 8, which is characterized in that MEMS scanner surface includes dodging
Credit grating.
10. time flight depth camera according to claim 1, which is characterized in that the array pixel cells include
One of CCD, CMOS, SPAD.
11. time flight depth camera according to claim 1, which is characterized in that include in the array pixel cells
Multiple sub-pixel units being made of at least two pixels, each sub-pixel unit are used to receive and be imaged and be reflected back by object
At least partly described non-floodlight carrier wave light beam.
12. time flight depth camera according to claim 11, which is characterized in that each in the sub-pixel unit
Pixel is configured as being activated in different time to acquire the optical signal of the non-floodlight carrier wave light beam, and the processing circuit is based on
The optical signal calculates the distance of the flight time and/or object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811393403.1A CN109343070A (en) | 2018-11-21 | 2018-11-21 | Time flight depth camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811393403.1A CN109343070A (en) | 2018-11-21 | 2018-11-21 | Time flight depth camera |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109343070A true CN109343070A (en) | 2019-02-15 |
Family
ID=65316896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811393403.1A Pending CN109343070A (en) | 2018-11-21 | 2018-11-21 | Time flight depth camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109343070A (en) |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109991583A (en) * | 2019-03-14 | 2019-07-09 | 深圳奥比中光科技有限公司 | A kind of jamproof distance measurement method and depth camera |
| CN109991584A (en) * | 2019-03-14 | 2019-07-09 | 深圳奥比中光科技有限公司 | A kind of jamproof distance measurement method and depth camera |
| CN110187355A (en) * | 2019-05-21 | 2019-08-30 | 深圳奥比中光科技有限公司 | A kind of distance measurement method and depth camera |
| CN110221274A (en) * | 2019-05-09 | 2019-09-10 | 深圳奥比中光科技有限公司 | Time flight depth camera and the distance measurement method of multifrequency modulation /demodulation |
| CN110221309A (en) * | 2019-04-30 | 2019-09-10 | 深圳市光鉴科技有限公司 | 3D imaging device and electronic equipment based on asynchronous ToF discrete point cloud |
| CN110244318A (en) * | 2019-04-30 | 2019-09-17 | 深圳市光鉴科技有限公司 | 3D imaging method based on asynchronous ToF discrete point cloud |
| CN110320528A (en) * | 2019-06-14 | 2019-10-11 | 深圳奥比中光科技有限公司 | The distance measurement method of time depth camera and the reduction noise of multifrequency modulation /demodulation |
| CN110361751A (en) * | 2019-06-14 | 2019-10-22 | 深圳奥比中光科技有限公司 | The distance measurement method of time flight depth camera and the reduction noise of single-frequency modulation /demodulation |
| CN110441785A (en) * | 2019-08-19 | 2019-11-12 | 深圳奥锐达科技有限公司 | Time flying distance measuring system |
| CN110471081A (en) * | 2019-04-30 | 2019-11-19 | 深圳市光鉴科技有限公司 | 3D imaging device and electronic equipment based on synchronous ToF discrete point cloud |
| CN110596725A (en) * | 2019-09-19 | 2019-12-20 | 深圳奥锐达科技有限公司 | Time-of-flight measurement method and system based on interpolation |
| CN110596720A (en) * | 2019-08-19 | 2019-12-20 | 深圳奥锐达科技有限公司 | Distance measuring system |
| CN110954916A (en) * | 2019-12-18 | 2020-04-03 | 深圳奥比中光科技有限公司 | Depth measuring device and depth measuring method |
| CN111142088A (en) * | 2019-12-26 | 2020-05-12 | 深圳奥比中光科技有限公司 | Light emitting unit, depth measuring device and method |
| CN111366906A (en) * | 2020-02-01 | 2020-07-03 | 上海鲲游光电科技有限公司 | Projection apparatus and segmented TOF apparatus, manufacturing method thereof, and electronic apparatus |
| CN111427230A (en) * | 2020-03-11 | 2020-07-17 | 深圳市安思疆科技有限公司 | Imaging method based on time flight and 3D imaging device |
| CN111427048A (en) * | 2020-02-25 | 2020-07-17 | 深圳奥比中光科技有限公司 | ToF depth measuring device, method for controlling ToF depth measuring device and electronic equipment |
| CN111505832A (en) * | 2019-08-19 | 2020-08-07 | 上海鲲游光电科技有限公司 | Optical assembly |
| CN111510700A (en) * | 2020-06-18 | 2020-08-07 | 深圳市汇顶科技股份有限公司 | Image acquisition device |
| WO2020223981A1 (en) * | 2019-05-09 | 2020-11-12 | 深圳奥比中光科技有限公司 | Time flight depth camera and multi-frequency modulation and demodulation distance measuring method |
| WO2020223980A1 (en) * | 2019-05-09 | 2020-11-12 | 深圳奥比中光科技有限公司 | Time-of-flight depth camera, and distance measurement method employing single-frequency modulation/demodulation |
| WO2020223982A1 (en) * | 2019-05-09 | 2020-11-12 | 深圳奥比中光科技有限公司 | Time of flight depth camera and anti-interference distance measurement method |
| CN111947565A (en) * | 2019-04-30 | 2020-11-17 | 深圳市光鉴科技有限公司 | 3D imaging method based on synchronous ToF discrete point cloud |
| WO2021008209A1 (en) * | 2019-07-12 | 2021-01-21 | 深圳奥比中光科技有限公司 | Depth measurement apparatus and distance measurement method |
| CN112269169A (en) * | 2020-11-09 | 2021-01-26 | Oppo广东移动通信有限公司 | Transmission module, time flight device and electronic equipment |
| WO2021051481A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳奥锐达科技有限公司 | Dynamic histogram drawing time-of-flight distance measurement method and measurement system |
| WO2021051480A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳奥锐达科技有限公司 | Dynamic histogram drawing-based time of flight distance measurement method and measurement system |
| WO2021051477A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳奥锐达科技有限公司 | Time of flight distance measurement system and method with adjustable histogram |
| CN112747691A (en) * | 2020-03-19 | 2021-05-04 | 熵智科技(深圳)有限公司 | Large-view single-texture active projection module and 3D camera |
| CN113075690A (en) * | 2020-01-03 | 2021-07-06 | 华为技术有限公司 | TOF depth sensing module and image generation method |
| CN113126111A (en) * | 2019-12-30 | 2021-07-16 | Oppo广东移动通信有限公司 | Time-of-flight module and electronic equipment |
| CN113156460A (en) * | 2020-01-23 | 2021-07-23 | 华为技术有限公司 | Time of flight TOF sensing module and electronic equipment |
| WO2021212915A1 (en) * | 2020-04-20 | 2021-10-28 | 深圳奥锐达科技有限公司 | Laser distance measuring device and method |
| CN114355384A (en) * | 2020-07-07 | 2022-04-15 | 柳州阜民科技有限公司 | Time-of-flight TOF system and electronic device |
| CN118011408A (en) * | 2024-02-04 | 2024-05-10 | 深圳市三劲科技有限公司 | Depth of field shooting method and device based on flight time |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009006754A1 (en) * | 2007-07-06 | 2009-01-15 | Iview Limited | Multi-purpose projection system |
| CN103472455A (en) * | 2013-09-13 | 2013-12-25 | 中国科学院空间科学与应用研究中心 | Four-dimensional spectral imaging system and method for calculating correlation flight time by means of sparse aperture compression |
| US20150163474A1 (en) * | 2013-12-05 | 2015-06-11 | Samsung Electronics Co., Ltd. | Camera for measuring depth image and method of measuring depth image using the same |
| CN108169981A (en) * | 2018-01-15 | 2018-06-15 | 深圳奥比中光科技有限公司 | Multi-functional lighting module |
| CN108337492A (en) * | 2018-01-15 | 2018-07-27 | 深圳奥比中光科技有限公司 | Dynamic projection imaging device |
| CN108463740A (en) * | 2016-01-15 | 2018-08-28 | 欧库勒斯虚拟现实有限责任公司 | Use the depth map of structured light and flight time |
| CN209167538U (en) * | 2018-11-21 | 2019-07-26 | 深圳奥比中光科技有限公司 | Time flight depth camera |
-
2018
- 2018-11-21 CN CN201811393403.1A patent/CN109343070A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009006754A1 (en) * | 2007-07-06 | 2009-01-15 | Iview Limited | Multi-purpose projection system |
| CN103472455A (en) * | 2013-09-13 | 2013-12-25 | 中国科学院空间科学与应用研究中心 | Four-dimensional spectral imaging system and method for calculating correlation flight time by means of sparse aperture compression |
| US20150163474A1 (en) * | 2013-12-05 | 2015-06-11 | Samsung Electronics Co., Ltd. | Camera for measuring depth image and method of measuring depth image using the same |
| CN108463740A (en) * | 2016-01-15 | 2018-08-28 | 欧库勒斯虚拟现实有限责任公司 | Use the depth map of structured light and flight time |
| CN108169981A (en) * | 2018-01-15 | 2018-06-15 | 深圳奥比中光科技有限公司 | Multi-functional lighting module |
| CN108337492A (en) * | 2018-01-15 | 2018-07-27 | 深圳奥比中光科技有限公司 | Dynamic projection imaging device |
| CN209167538U (en) * | 2018-11-21 | 2019-07-26 | 深圳奥比中光科技有限公司 | Time flight depth camera |
Cited By (45)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109991583A (en) * | 2019-03-14 | 2019-07-09 | 深圳奥比中光科技有限公司 | A kind of jamproof distance measurement method and depth camera |
| CN109991584A (en) * | 2019-03-14 | 2019-07-09 | 深圳奥比中光科技有限公司 | A kind of jamproof distance measurement method and depth camera |
| CN110221309B (en) * | 2019-04-30 | 2021-08-17 | 深圳市光鉴科技有限公司 | 3D imaging device and electronic equipment based on asynchronous ToF discrete point cloud |
| CN111947565A (en) * | 2019-04-30 | 2020-11-17 | 深圳市光鉴科技有限公司 | 3D imaging method based on synchronous ToF discrete point cloud |
| CN110221309A (en) * | 2019-04-30 | 2019-09-10 | 深圳市光鉴科技有限公司 | 3D imaging device and electronic equipment based on asynchronous ToF discrete point cloud |
| CN110244318A (en) * | 2019-04-30 | 2019-09-17 | 深圳市光鉴科技有限公司 | 3D imaging method based on asynchronous ToF discrete point cloud |
| CN110471081A (en) * | 2019-04-30 | 2019-11-19 | 深圳市光鉴科技有限公司 | 3D imaging device and electronic equipment based on synchronous ToF discrete point cloud |
| CN110244318B (en) * | 2019-04-30 | 2021-08-17 | 深圳市光鉴科技有限公司 | 3D imaging method based on asynchronous ToF discrete point cloud |
| CN110221274A (en) * | 2019-05-09 | 2019-09-10 | 深圳奥比中光科技有限公司 | Time flight depth camera and the distance measurement method of multifrequency modulation /demodulation |
| WO2020223980A1 (en) * | 2019-05-09 | 2020-11-12 | 深圳奥比中光科技有限公司 | Time-of-flight depth camera, and distance measurement method employing single-frequency modulation/demodulation |
| WO2020223981A1 (en) * | 2019-05-09 | 2020-11-12 | 深圳奥比中光科技有限公司 | Time flight depth camera and multi-frequency modulation and demodulation distance measuring method |
| WO2020223982A1 (en) * | 2019-05-09 | 2020-11-12 | 深圳奥比中光科技有限公司 | Time of flight depth camera and anti-interference distance measurement method |
| CN110187355A (en) * | 2019-05-21 | 2019-08-30 | 深圳奥比中光科技有限公司 | A kind of distance measurement method and depth camera |
| CN110320528A (en) * | 2019-06-14 | 2019-10-11 | 深圳奥比中光科技有限公司 | The distance measurement method of time depth camera and the reduction noise of multifrequency modulation /demodulation |
| WO2020248334A1 (en) * | 2019-06-14 | 2020-12-17 | 深圳奥比中光科技有限公司 | Time-of-flight depth camera, and distance measurement method employing single-frequency modulation/demodulation and facilitating noise reduction |
| CN110320528B (en) * | 2019-06-14 | 2021-04-30 | 奥比中光科技集团股份有限公司 | Time depth camera and noise reduction distance measurement method for multi-frequency modulation and demodulation |
| CN110361751A (en) * | 2019-06-14 | 2019-10-22 | 深圳奥比中光科技有限公司 | The distance measurement method of time flight depth camera and the reduction noise of single-frequency modulation /demodulation |
| WO2021008209A1 (en) * | 2019-07-12 | 2021-01-21 | 深圳奥比中光科技有限公司 | Depth measurement apparatus and distance measurement method |
| CN110596720A (en) * | 2019-08-19 | 2019-12-20 | 深圳奥锐达科技有限公司 | Distance measuring system |
| CN111505832A (en) * | 2019-08-19 | 2020-08-07 | 上海鲲游光电科技有限公司 | Optical assembly |
| CN110441785A (en) * | 2019-08-19 | 2019-11-12 | 深圳奥锐达科技有限公司 | Time flying distance measuring system |
| CN110596725B (en) * | 2019-09-19 | 2022-03-04 | 深圳奥锐达科技有限公司 | Time-of-flight measurement method and system based on interpolation |
| CN110596725A (en) * | 2019-09-19 | 2019-12-20 | 深圳奥锐达科技有限公司 | Time-of-flight measurement method and system based on interpolation |
| WO2021051481A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳奥锐达科技有限公司 | Dynamic histogram drawing time-of-flight distance measurement method and measurement system |
| WO2021051479A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳奥锐达科技有限公司 | Interpolation-based time of flight measurement method and system |
| WO2021051480A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳奥锐达科技有限公司 | Dynamic histogram drawing-based time of flight distance measurement method and measurement system |
| WO2021051477A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳奥锐达科技有限公司 | Time of flight distance measurement system and method with adjustable histogram |
| CN110954916A (en) * | 2019-12-18 | 2020-04-03 | 深圳奥比中光科技有限公司 | Depth measuring device and depth measuring method |
| CN111142088A (en) * | 2019-12-26 | 2020-05-12 | 深圳奥比中光科技有限公司 | Light emitting unit, depth measuring device and method |
| CN113126111A (en) * | 2019-12-30 | 2021-07-16 | Oppo广东移动通信有限公司 | Time-of-flight module and electronic equipment |
| CN113126111B (en) * | 2019-12-30 | 2024-02-09 | Oppo广东移动通信有限公司 | Time-of-flight module and electronic device |
| CN113075690B (en) * | 2020-01-03 | 2023-04-28 | 华为技术有限公司 | TOF depth sensing module and image generation method |
| CN113075690A (en) * | 2020-01-03 | 2021-07-06 | 华为技术有限公司 | TOF depth sensing module and image generation method |
| WO2021136527A1 (en) * | 2020-01-03 | 2021-07-08 | 华为技术有限公司 | Tof depth sensor module and image generation method |
| CN113156460A (en) * | 2020-01-23 | 2021-07-23 | 华为技术有限公司 | Time of flight TOF sensing module and electronic equipment |
| CN111366906A (en) * | 2020-02-01 | 2020-07-03 | 上海鲲游光电科技有限公司 | Projection apparatus and segmented TOF apparatus, manufacturing method thereof, and electronic apparatus |
| CN111427048A (en) * | 2020-02-25 | 2020-07-17 | 深圳奥比中光科技有限公司 | ToF depth measuring device, method for controlling ToF depth measuring device and electronic equipment |
| CN111427230A (en) * | 2020-03-11 | 2020-07-17 | 深圳市安思疆科技有限公司 | Imaging method based on time flight and 3D imaging device |
| CN112747691A (en) * | 2020-03-19 | 2021-05-04 | 熵智科技(深圳)有限公司 | Large-view single-texture active projection module and 3D camera |
| WO2021212915A1 (en) * | 2020-04-20 | 2021-10-28 | 深圳奥锐达科技有限公司 | Laser distance measuring device and method |
| CN111510700A (en) * | 2020-06-18 | 2020-08-07 | 深圳市汇顶科技股份有限公司 | Image acquisition device |
| CN114355384A (en) * | 2020-07-07 | 2022-04-15 | 柳州阜民科技有限公司 | Time-of-flight TOF system and electronic device |
| CN114355384B (en) * | 2020-07-07 | 2024-01-02 | 柳州阜民科技有限公司 | Time-of-flight TOF system and electronic device |
| CN112269169A (en) * | 2020-11-09 | 2021-01-26 | Oppo广东移动通信有限公司 | Transmission module, time flight device and electronic equipment |
| CN118011408A (en) * | 2024-02-04 | 2024-05-10 | 深圳市三劲科技有限公司 | Depth of field shooting method and device based on flight time |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109343070A (en) | Time flight depth camera | |
| CN209167538U (en) | Time flight depth camera | |
| CN109283508A (en) | Flight time calculation method | |
| CN111025317B (en) | Adjustable depth measuring device and measuring method | |
| CN109798838B (en) | ToF depth sensor based on laser speckle projection and ranging method thereof | |
| CN111123289B (en) | Depth measuring device and measuring method | |
| CN111142088B (en) | Light emitting unit, depth measuring device and method | |
| CN110596722B (en) | System and method for measuring flight time distance with adjustable histogram | |
| CN110333501A (en) | Depth measurement device and distance measurement method | |
| CN110471080A (en) | Depth measurement device based on TOF imaging sensor | |
| CN110596725B (en) | Time-of-flight measurement method and system based on interpolation | |
| WO2021072802A1 (en) | Distance measurement system and method | |
| CN110596723B (en) | Dynamic histogram drawing flight time distance measuring method and measuring system | |
| CN110456379A (en) | The depth measurement device and distance measurement method of fusion | |
| CN110824490B (en) | Dynamic distance measuring system and method | |
| CN110596721A (en) | Flight time distance measuring system and method of double-shared TDC circuit | |
| CN110221272A (en) | Time flight depth camera and jamproof distance measurement method | |
| WO2020221185A1 (en) | Asynchronous tof discrete point cloud-based 3d imaging apparatus, and electronic device | |
| EP3424278B1 (en) | Staggered array of light-emitting elements for sweeping out an angular range | |
| CN110596724A (en) | Method and system for measuring flight time distance during dynamic histogram drawing | |
| CN110488240A (en) | Depth calculation chip architecture | |
| CN110780312B (en) | Adjustable distance measuring system and method | |
| CN111427048B (en) | ToF depth measuring device, control method and electronic equipment | |
| CN110658529A (en) | Integrated beam splitting scanning unit and manufacturing method thereof | |
| CN110596720A (en) | Distance measuring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190215 |