WO2022268625A1 - Dispositif pour l'acquisition d'une carte de profondeur d'une scene - Google Patents
Dispositif pour l'acquisition d'une carte de profondeur d'une scene Download PDFInfo
- Publication number
- WO2022268625A1 WO2022268625A1 PCT/EP2022/066444 EP2022066444W WO2022268625A1 WO 2022268625 A1 WO2022268625 A1 WO 2022268625A1 EP 2022066444 W EP2022066444 W EP 2022066444W WO 2022268625 A1 WO2022268625 A1 WO 2022268625A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- level
- pixel
- pix2
- depth
- frequency
- Prior art date
Links
- 102100022778 POC1 centriolar protein homolog A Human genes 0.000 claims abstract description 149
- 101710125073 POC1 centriolar protein homolog A Proteins 0.000 claims abstract description 149
- 102100022769 POC1 centriolar protein homolog B Human genes 0.000 claims abstract description 48
- 101710125069 POC1 centriolar protein homolog B Proteins 0.000 claims abstract description 48
- 238000005259 measurement Methods 0.000 claims description 22
- 238000001514 detection method Methods 0.000 claims description 16
- 239000011159 matrix material Substances 0.000 claims description 11
- 230000000737 periodic effect Effects 0.000 claims description 9
- 230000001419 dependent effect Effects 0.000 claims 1
- 239000000758 substrate Substances 0.000 description 53
- 238000005070 sampling Methods 0.000 description 37
- 230000010363 phase shift Effects 0.000 description 21
- 230000015654 memory Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 238000003860 storage Methods 0.000 description 8
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 6
- 238000009413 insulation Methods 0.000 description 6
- 229910052814 silicon oxide Inorganic materials 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 239000003989 dielectric material Substances 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 101000582320 Homo sapiens Neurogenic differentiation factor 6 Proteins 0.000 description 3
- 102100030589 Neurogenic differentiation factor 6 Human genes 0.000 description 3
- 239000004020 conductor Substances 0.000 description 3
- 238000002161 passivation Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000010292 electrical insulation Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 229910044991 metal oxide Inorganic materials 0.000 description 2
- 229910021421 monocrystalline silicon Inorganic materials 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 229910021420 polycrystalline silicon Inorganic materials 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 239000011347 resin Substances 0.000 description 2
- 229920005989 resin Polymers 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- PNEYBMLMFCGWSK-UHFFFAOYSA-N aluminium oxide Inorganic materials [O-2].[O-2].[O-2].[Al+3].[Al+3] PNEYBMLMFCGWSK-UHFFFAOYSA-N 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 239000002800 charge carrier Substances 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 229910052593 corundum Inorganic materials 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000002329 infrared spectrum Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012432 intermediate storage Methods 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000000615 nonconductor Substances 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 229910001845 yogo sapphire Inorganic materials 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/32—Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/491—Details of non-pulse systems
- G01S7/4912—Receivers
- G01S7/4913—Circuits for detection, sampling, integration or read-out
- G01S7/4914—Circuits for detection, sampling, integration or read-out of detector arrays, e.g. charge-transfer gates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/491—Details of non-pulse systems
- G01S7/4912—Receivers
- G01S7/4915—Time delay measurement, e.g. operational details for pixel components; Phase measurement
Definitions
- TITLE Device for the acquisition of a depth map of a scene
- This application relates to the field of devices for acquiring a depth map or image of a scene.
- Image acquisition devices capable of acquiring depth information have been proposed.
- indirect time of flight detectors (indirect time of flight" in English - iTOF) act to emit a light signal towards a scene, then to detect the light signal reflected by elements of the scene.
- indirect time of flight By evaluating the phase difference between the emitted light signal and the reflected signal, it is possible to estimate distances between the sensor and elements, for example objects, of the scene, or relative distances (depths) between the elements of the scene. .
- a depth image acquisition device having a same resolution and the same lateral dimensions as a usual depth image acquisition device, but increased precision compared to this usual device.
- One embodiment overcomes all or part of the drawbacks of known depth image acquisition devices.
- One embodiment provides a device for acquiring a depth image of a scene, comprising a sensor of a reflected light signal corresponding to the reflection on the scene of an incident light signal.
- the sensor includes a first detection level stacked on a second detection level.
- Each detection level comprises an array of depth pixels, each depth pixel of said level comprising at least one photodetector and being configured to acquire at least first, second and third samples of charges photogenerated in said pixel during first, second and third respective durations, the first, second and third durations of said level being periodic according to a first frequency of said level.
- Each first level photodetector is superposed on a second level photodetector.
- the first frequency of the second level is equal to k times the first frequency of the first level, with k a number greater than or equal to 1.
- the device further comprises a calculation circuit configured to calculate, for each depth pixel of each of the first and second levels, a distance from the first, second and third samples of said depth pixel, and, from said calculated distances, a depth map of the scene, the depth map of the scene having, of preferably, an increased precision compared to a depth map of the scene reconstituted from the distances calculated for the depth pixels of the first level and to a depth map of the scene reconstituted from the distances calculated for the depth pixels of the second level.
- the device further comprises a depth pixel control circuit.
- the number k is strictly greater than 1.
- the number k is an integer.
- the number k is strictly greater than 7.
- the device comprises a light source configured to supply the incident light signal so that:
- the incident light signal comprises a first light signal at a first wavelength and a second light signal at a second wavelength different from the first wavelength
- the first light signal is amplitude modulated at the first frequency of the first level
- the second light signal is amplitude modulated at the first frequency of the second level.
- the device comprises a filter arranged between the first and second levels of the sensor, configured to block the first light signal and allow the second light signal to pass.
- the device further comprises a light source configured to provide the amplitude-modulated incident light signal simultaneously at the first frequency of the first level and at the first frequency of the second level.
- the number k is determined so that the contribution of the first frequency of the first level to a measurement, by the second level, of the first frequency of the second level in the reflected signal is less than a target value.
- the first frequency of the first level induces an error in the calculation of the distances for the depth pixels of the second level and the number k is determined by a target maximum value of this error.
- the number k is greater than or equal to 20.
- each depth pixel of the first level is associated with a corresponding depth pixel of the second level.
- each depth pixel of the first level is stacked on the depth pixel of the second level with which it is associated.
- the calculation circuit for each stacking of a depth pixel of the first level on a depth pixel of the second level, is configured to eliminate an uncertainty on the distance calculated for the depth pixel of the second level from the distance calculated for the depth pixel of the first level.
- the calculation circuit for each stack of a first level depth pixel on a second level depth pixel, is configured: - to calculate, for each pixel, the distance from a modulo 2P phase shift determined from the first, second and third samples of said pixel, an uncertainty on said calculated distance resulting from the modulo 2P of said phase shift; and
- k is equal to 1
- each depth pixel comprises at least two photodetectors
- each depth pixel of the first level is associated with a corresponding depth pixel of the second level
- the centers of the pixels of depth of the first level are offset from the centers of the corresponding depth pixels of the second level.
- the offset is constant at each capture; or at each two successive captures, the shift is implemented for only one of the two captures; or at each two successive captures the offset is different between the two captures.
- the depth pixel control circuit is configured to implement the shift.
- each depth pixel comprises at least two photodetectors
- each depth pixel of the first level is associated with a corresponding depth pixel of the second level
- the centers of the depth pixels of the first level are shifted with respect to the centers of the pixels of corresponding depths of the second level
- the depth pixel control circuit is configured, at each two successive captures, for:
- the calculation circuit is configured to improve the precision of the depth map in a direction of the offset of the centers of the depth pixels of the first level with respect to the centers of the corresponding depth pixels of the second level .
- the photodetectors of the depth pixels are organized in rows and in columns, the rows are orthogonal to the columns, the rows and the columns are orthogonal to a stacking direction of the first level on the second level , and the offset corresponds to an offset of one row and/or one column.
- the device further comprises a circuit configured to synchronize the first, second and third durations of the first level with, respectively, the first, second and third durations of the second level.
- the device further comprises a light source configured to supply the incident light signal modulated in amplitude at the first frequency only.
- the senor is configured to receive the reflected light signal from the side of the first level.
- at least the first level further comprises 2D image pixels.
- the photodetectors of the depth pixels are organized in rows and in columns, the rows being orthogonal to the columns, the rows and the columns also being orthogonal to a stacking direction of the first level on the second level, and in which the 2D image pixels are arranged between two successive rows and/or between two successive columns.
- FIG. 1 schematically represents an embodiment of a device for acquiring a depth image
- FIG. 2 is a graph illustrating an example of the light intensity of an emitted and returned light signal
- FIG. 3 is a partial, schematic sectional view illustrating an embodiment of a light signal sensor of a device for acquiring a depth image
- FIG. 4 represents an embodiment of a photosite circuit
- FIG. 5 represents another embodiment of a photosite circuit
- FIG. 6 represents yet another embodiment of a photosite circuit
- FIG. 7 shows yet another embodiment of a photosite circuit
- FIG. 8 illustrates, in the frequency domain, details of an embodiment of the sensor of FIG.
- FIG. 9 represents an embodiment of the spatial distribution of the depth pixel photodetectors of the sensor of FIG. 3;
- FIG. 10 represents another embodiment of spatial distribution of the depth pixel photodetectors of the sensor of FIG. 3;
- FIG. 11 represents yet another embodiment of spatial distribution of the depth pixel photodetectors of the sensor of FIG. 3;
- FIG. 12 represents yet another embodiment of spatial distribution of the depth pixel photodetectors of the sensor of FIG. 3;
- FIG. 13 represents yet another embodiment of spatial distribution of the depth pixel photodetectors of the sensor of FIG. 3;
- FIG. 14 represents yet another embodiment of spatial distribution of the depth pixel photodetectors of the sensor of FIG. 3;
- FIG. 15 represents yet another embodiment of spatial distribution of the depth pixel photodetectors of the sensor of FIG. 3;
- Figure 16 illustrates an alternative embodiment of the sensor of Figure 12.
- FIG. 1 schematically represents an embodiment of a device 10 for acquiring a depth image comprising a sensor 12 of a light signal.
- the device 10 comprises, for example, a circuit for emitting a light signal 14 which controls a light source 16, for example a light-emitting diode ("Light Emitting Diode" in English - LED).
- the light emitting diode 16 emits, for example, a light signal at a wavelength in the near infrared spectrum, for example in the range of 700 nm to 1100 nm.
- the light signal emitted by the diode is amplitude modulated periodically.
- the light signal produced by light-emitting diode 16 is, for example, emitted towards the scene to be captured via one or more lenses (not shown in FIG. 1).
- the light signal reflected by the scene is picked up by the sensor 12, for example via an imaging lens 17 and an array of microlenses 18, which focus the reflected light signal on the individual pixels of the sensor 12.
- the sensor 12 comprises, for example, several pixels able to receive the light signal reflected by the image scene and to detect the phase of the signal received to form a depth image. These pixels are referred to below as depth pixels.
- a calculation circuit 20 of the device for example a processor, is for example coupled to the sensor 12 and to the transmission circuit 14 and determines, on the basis of the signals picked up by the depth pixels of the sensor 12, the corresponding distances between these pixels and the scene
- the image or depth map produced by the processor 20 is, for example, stored in a memory 22 of the image acquisition device 10.
- FIG. 2 is a graph representing, by a curve 30, an example of evolution, as a function of time, of the luminous intensity of the light signal emitted by the light-emitting diode 16 towards the scene, and, by a curve 32, an example of evolution, as a function of time, of the light intensity of the light signal received by one of the depth pixels of the sensor 12.
- these signals are represented in FIG. 2 as having substantially the same intensity, in practice the light signal received by each depth pixel is likely to be notably less intense than the signal emitted.
- the amplitude modulation of the light signal corresponds to a sinusoidal amplitude modulation at a single modulation frequency.
- this periodic amplitude modulation corresponds to a different amplitude modulation, for example to a sum of sinusoidal amplitude modulations, to a triangular amplitude modulation, or to an amplitude modulation in slots, for example in all or nothing.
- FIG. 2 illustrates the case where the light signal is amplitude modulated at a single modulation frequency, as will be described in more detail later, in embodiments the light signal is amplitude modulated simultaneously at two different modulation frequencies.
- the depth pixels of the present description are used to detect the phase of the received light signal. More particularly, there is a phase shift Df, modulo 2*P, between the transmitted light signal and the received light signal.
- the phase shift Df modulo 2*P is, for example, estimated on the basis of a sampling of the light signal picked up by a depth pixel during four distinct sampling windows, each corresponding to a different phase shift with respect to the signal emitted light, for example 0°, 90°, 180° and 270° for four sampling windows.
- the four sampling windows are implemented at each period of the light signal.
- a technique based on the detection of four samples per period is described in more detail in the publication by R. Lange and by P. Seitz entitled “Solid-state TOF range camera”, IEE J. on Quantum Electronics, vol. 37, No.3, March 2001. Unless otherwise indicated, the embodiments described in the remainder of the description are based on the detection of four samples per period.
- each sampling window is for example integrated over a large number of modulation periods, for example over approximately 100,000 periods, or, more generally, between 10,000 and 10 million periods.
- Each sampling window has, for example, a duration of up to a quarter of the period of the light signal.
- These sampling windows are named C0, Cl, C2, and C3 in figure 2.
- each sampling window is of the same duration and the four sampling windows have a time of total cycle equal to the period of the light signal. More generally, there may or may not be a time gap between one sampling window and the next, and in some cases there could be an overlap between sampling windows.
- Each sampling window has for example a duration between 15% and 35% of the signal period luminous in the case of a pixel capturing four samples per period.
- the timing of the sampling windows C0 to C3 is controlled so as to be synchronized with the timing of the transmitted light signal.
- the light signal output circuit 14 generates a light signal based on a CLK clock signal (Fig. 1), and the sensor 12 receives the same CLK clock signal to control the start and end times. end of each sampling window, for example by using delay elements to introduce the appropriate phase shifts.
- the same reference denotes a sampling window and the sample of charges photogenerated during this sampling window.
- phase shift Df modulo 2*P can be determined using the following equation:
- c designates the speed of light
- f the amplitude modulation frequency of the light signal
- the phase shift Df obtained with the formula Math 1 is estimated modulo 2*P.
- the amplitude modulation frequency f of the light signal is 25 MHz, or more generally between 10 MHz and 200 MHz.
- photosite is used to refer to a single photodetector, or photosensitive element, and all the components allowing the acquisition of at least one sample of charges generated by absorption, by this photodetector, of the light signal reflected by the scene for which a depth image is desired.
- depth pixel refers to the set of components allowing the acquisition of all the samples necessary to allow the determination of a depth value.
- a depth pixel can comprise several photosites, each corresponding to a distinct photodetector.
- the light signal received is sampled by transferring, successively and at regular intervals, charges photogenerated in the photosensitive element of a photosite of the pixel during the first sampling window C0, charges photogenerated in the photosensitive element of the same photosite or of another photosite of the pixel during the second sampling window C1, charges photogenerated in the photosensitive element of the same photosite or of another photosite of the pixel during the third sampling window C2, and charges photogenerated in the photosensitive element of the same photosite or another photosite of the pixel during the third sampling window C3.
- the embodiments and variants described correspond to techniques based on the acquisition of four samples of photogenerated charges.
- the techniques based on the acquisition of three samples of photogenerated charges are well known to those skilled in the art, who will be able to adapt the description given for the four-sample case to the three-sample case, for example by removing everything related to the acquisition of the fourth sample of photogenerated charges, by adapting the timing of the three remaining time windows and by adapting the formulas [Math 1] and [Math 2].
- the phase shifts between the three sampling windows and the light signal emitted are respectively 0°, 120° and 240°, each sampling window having a duration of the order of one third of the period of the emitted light signal, for example equal to one third of the period of the emitted light signal.
- Figure 3 is a sectional view schematically and partially illustrating an embodiment of a sensor 12.
- the sensor 12 comprises:
- a first detection level W1 also called first circuit W1 formed in and on a first semiconductor substrate 100, for example a monocrystalline silicon substrate
- the thickness of each of the substrates 100 and 130 is for example between 2 ⁇ m and 10 ⁇ m, for example between 3 ⁇ m and 5 ⁇ m.
- sensor 12 is configured so that the reflected light signal that it receives is first received by level W1 before being received by level W2, the light signal received by level W2 having first crossed level W1.
- the stack of levels W1 and W2 is configured to receive the light signal reflected on the level W1 side.
- the person skilled in the art is able to adapt the description given below to the case where the sensor is configured to receive the light signal reflected on the level W2 side.
- the level W1, respectively W2, comprises a matrix of pixels of depth Pix1, respectively Pix2.
- Each pixel Pix1 is associated with a corresponding pixel Pix2, and, reciprocally, each pixel Pix2 is associated with a corresponding pixel Pix1.
- each pixel Pix1 is superimposed on the corresponding pixel Pix2, or, in other words, the centers of the pixels Pix1 are aligned with the centers of the corresponding pixels Pix2.
- each pixel Pixl is offset from the corresponding pixel Pix2, or, in other words, the centers of pixel Pixl are offset from the centers of the pixels Pix2 corresponding.
- the centers of the pixels are called the center of gravity of the pixels.
- each level W1, W2 comprises, for example, a number of depth pixels much greater than two, for example greater than 100.
- the level W1 is configured to estimate the phase difference between an emitted light signal modulated in amplitude at a frequency Fmod1 and a corresponding reflected light signal
- the level W2 is configured to estimate the phase difference between an emitted light signal modulated in amplitude at a frequency Fmod2, equal to k times the frequency Fmod1, with k a number greater than or equal to 1, and a corresponding reflected light signal.
- the samples C0, Cl, C2 and C3 acquired by each pixel Pixl, and the corresponding time windows C0, Cl, C2 and C3 will be designated by the references C0-1, Cl-1, C2-1, C3-1, and, similarly, the samples C0, Cl, C2 and C3 acquired by each pixel Pix2, and the corresponding time windows C0, Cl, C2 and C3 will be designated by the references CO-2, C1-2, C2-2, C3-2.
- C3-1 are periodic at the frequency Fmod1, the time windows CO-2, respectively Cl-2, C2-2 and C3-2 being periodic at the frequency Fmod2.
- the frequency Fmod1 is different from the frequency Fmod2
- the duration of the sampling windows C0-1, Cl-1, C2-1 and C3-1 is different from that of the sampling windows CO-2, Cl- 2, C2-2 and C3-2.
- Each pixel Pixl, respectively Pix2, comprises at least one photosite PI, respectively P2.
- Each photosite PI, respectively P2, comprises a single photodetector 101, respectively 131.
- each pixel Pix1, respectively Pix2, comprises at least one photodetector 101, respectively 131.
- Each photodetector or photosensitive zone 101 for example a photodiode, is formed, or arranged in substrate 100 of level W1, each photodetector or photosensitive zone 131, for example a photodiode, being formed, or arranged, in substrate 130 of level W2.
- each pixel Pixl the photosites PI of the pixel Pixl allow the acquisition of all the samples C0-1, Cl-1, C2-1, C3-1 necessary for determining a depth value, or distance, for this pixel Pixl.
- each pixel Pixl is configured to acquire the charge samples C0-1, Cl-1, C2-1 and C3-1 photogenerated in the pixel Pixl, that is to say in the photodetector(s) of the pixel Pixl .
- each pixel Pix2 the photosite(s) P2 of the pixel Pix2 allow the acquisition of all the samples CO-2, Cl-2, C2-2, C3-2 necessary for the determination of a depth value, or distance, for this pixel Pix2.
- each pixel Pix2 is configured to acquire the charge samples CO-2, Cl-2, C2-2 and C3-2 photogenerated in the pixel Pix2, that is to say in the photodetector(s) of the pixel Pix2 .
- the number of photosites PI, respectively P2, per pixel Pixl, respectively Pix2, is the same for all the pixels Pixl, respectively Pix2.
- the number of photosites PI per pixel Pix1 is equal to the number of photosites P2 per pixel Pix2.
- the spatial distribution of the samples C0-1, Cl-1, C2-1, C3-1 is identical in each pixel Pixl, and the spatial distribution of the samples CO-2, Cl-2, C2-2 , C3-2 is identical in each pixel Pix2.
- the spatial distribution of the samples C0-1, Cl-1, C2-1 and C3-1 in the pixels Pixl is identical to the spatial distribution of the samples respectively CO-2, Cl-2, C2-2 and C3-2 in the pixels Pix2, or, in other words, the spatial distribution of the samples in the pixels Pix1 is identical to that in the pixels Pix2.
- Each photosite PI is stacked, or superimposed, on a photosite P2, and, reciprocally, each photosite P2 is surmounted by a photosite PI.
- a photosite P1 is said to be stacked on a photosite P2 when the photodetector 101 of the photosite P1 is stacked on the photodetector 131 of the photosite P2, and, conversely, a photosite P2 is said to be surmounted by a photosite P2 when the photodetector 131 of the photosite P2 is surmounted by the photodetector 101 of the photosite P1.
- the PI photosites are organized into a matrix of photosites P1 comprising rows and columns of photosites P1, the photosites P2 being organized in a matrix of photosites P2 comprising rows and columns of photosites P2.
- the photosites PI, respectively P2 are said to be organized in a matrix of photosites PI, respectively P2, comprising rows and columns of photosites PI, respectively P2, when the photodetectors 101 of the photosites PI, respectively 131 of the photosites P2, are organized in a matrix of photodetectors 101, respectively 131, comprising rows and columns of photodetectors 101, respectively 131.
- Each row of photosites PI is stacked on a corresponding row of photosites P2, and each column of photosites PI is stacked on a corresponding column of photosites P2.
- a line, respectively a column, of photosites P1 is said to be stacked on a line, respectively a column, of photosites P2 when the line, respectively the column, of corresponding photodetectors 101 is stacked on the line, respectively the column , corresponding photodetectors 131 .
- the level W1 comprises vertical insulating walls 103 passing through the substrate 100 over its entire thickness and delimiting the substrate portions corresponding respectively to the photodetectors 101 of the photosites PI of the level W1.
- the vertical insulation walls 103 notably have an optical insulation function, and may also have an electrical insulation function.
- the vertical insulating walls 103 are made of a dielectric material, for example silicon oxide, or of a conductive material, for example polycrystalline silicon, covered with a dielectric material, for example example of silicon oxide, the electrical insulator of the substrate 100.
- the insulating walls 103 may not be present.
- the level W2 comprises vertical insulating walls 133 passing through the substrate 130 over its entire thickness and delimiting the substrate portions corresponding respectively to the photodetectors 131 of the photosites P2 of the level W2 .
- the vertical insulation walls 133 notably have an optical insulation function, and may also have an electrical insulation function.
- the vertical insulating walls 133 are made of a dielectric material, for example silicon oxide, or of a conductive material, for example polycrystalline silicon, covered with a dielectric material, for example silicon oxide electrically insulates substrate 130.
- insulating walls 133 may not be present.
- the vertical insulation wall 133 surrounding each photosite P2 is for example located substantially directly above the vertical insulation wall 103 surrounding the photosite P1 stacked on this photosite P2.
- front face and rear face of a substrate respectively means the face of the substrate coated with an interconnection stack and the face of the substrate opposite its front face.
- the front and rear faces of the substrate 100 are respectively its lower face and its upper face, the front and rear faces of the substrate 130 being its upper face and its lower face respectively.
- the front face of the substrate 100, which is coated of an interconnection stack 110 is on the side, or opposite, of the front face of the substrate 130, which is coated with an interconnection stack 140.
- the person skilled in the art is however able to adapt this description to the case where the rear faces of the substrates 100 and 130 face each other, or where the rear face of one of the substrates 100 and 130 faces -à-vis the front face of the other of the substrates 100 and 130.
- the interconnection stack 110 comprises alternating dielectric and conductive layers. Conductive tracks 111, respectively 141, and electrical connection pads (not shown in FIG. 3) are formed in these conductive layers.
- the interconnection stack 110 further comprises conductive vias (not shown in FIG. 3) connecting the tracks 111 to one another and/or to components formed in the substrate 100 and/or to the electrical connection pads of the stack 110
- the interconnect stack 140 comprises conductive vias (not shown in FIG. 3) connecting the tracks 141 to one another and/or to components formed in the substrate 140 and/or to the electrical connection pads of the stacking 140.
- each pixel Pix1, respectively Pix2 comprises one or more components, for example MOS transistors ("Metal Oxide Semiconductor" - metal oxide semiconductor), formed from side of the front face of the substrate 100, respectively 130.
- MOS transistors Metal Oxide Semiconductor
- the face of the substrate 100 intended to receive a light signal namely the rear face of the substrate 100 in the example of FIG. 3, is coated a passivation layer 115, for example a layer of silicon oxide, a layer of Hf02, a layer of Al2O3, or a stack of several layers of different materials which may have functions other than the sole passivation function (anti-reflection, filtering, bonding, etc.) / extending over substantially the entire surface of the substrate 100.
- the layer 115 is placed on and in contact with the substrate 100.
- each stack of a photosite P1 and a photosite P2 comprises a filter 118, for example a layer of black resin or an interference filter, placed on the side of the sensor 12 intended to receive a light signal, for example on and in contact with the passivation layer 115, facing the stack of photosensitive elements 101 and 131 of this stack of photosites P1 and P2.
- Each filter 118 is adapted to transmit light in the emission wavelength range of the light source 16 (FIG. 1).
- the filter 118 is adapted to transmit light only in a relatively narrow band of wavelengths centered on the emission wavelength range of the light source 16 of the device 10 (FIG. 1).
- the filter 118 makes it possible to avoid an undesirable generation of charge carriers in the photosensitive elements 101 and 131 of the underlying photosites P1 and P2 under the effect of light radiation not originating from the light source 16 of the device 10.
- each stack of a photosite P1 and of a photosite P2 can also comprise a microlens 122 arranged on the side of the sensor 12 intended to receive light radiation, for example on and in contact with the filter 118 of this stack of PI and P2 photosites, suitable for focusing the incident light on the photosensitive element 101 of the photosite P1 and/or on the photosensitive element 131 of the underlying photosite P2.
- level W1 comprises, for example, a layer 126 entirely covering substrate 100 and being interrupted by first electrical connection elements (not shown in FIG. 3), for example electrical connection pads of stack 110
- level W2 comprises, for example, a layer 132 of the same nature as layer 126 of level W1, layer 132 entirely coating substrate 130 and being interrupted by second electrical connection elements (not shown in FIG. 3), for example electrical connection pads of the stack 140.
- the hybrid bonding is carried out by bringing the layer 130 into contact with the layer 126, over the entire extent of the substrates 100 and 130, so that the first connection elements electrical are in contact with the second electrical connection elements.
- layers 126 and 132 are made of silicon oxide.
- the front faces of the substrates 100 and 130 face each other, and the layers 126 and 132 are arranged respectively on the side of the front face of the substrate 100 and on the side of the front face of the substrate 130
- layer 126 is disposed over and in contact with interconnect stack 110 and layer 132 is disposed on and in contact with the interconnect stack 140.
- the sensor 12 comprises a circuit for controlling the photosites P1 and P2, that is to say a circuit configured to control the photosites P1 and P2.
- This control circuit is more particularly configured to control the sampling, by the photosites P1 and P2, of the reflected light signal received by the sensor 12.
- this control circuit comprises a first circuit configured to control the photosites PI, this first circuit being, for example, arranged in and on the substrate 100, and a second circuit configured to control the photosites P2, this second circuit being, for example, arranged in and on the substrate 130.
- the control circuit of the photosites P1 and P2 is synchronized with the circuit 14, for example via the CLK signal.
- each of the time windows C0-1, Cl-1, C2-1 and C3-1 is periodic according to the frequency Fmod1, corresponding to the amplitude modulation frequency of a light signal detected by the level Wl, so that a distance, or depth, d can be calculated for each pixel Pixl from the charge samples C0-1, Cl-1, C2-1, C3-1 provided by this pixel
- each pixel Pixl samples the photogenerated charges at a frequency Fel equal to N times the frequency Fmodl, with N equal to 4 in this embodiment where the pixel Pixl provides four samples CO-1, Cl-1, C2-1, C3-1 to calculate a distance or depth d for this pixel Pixl.
- each of the time windows CO-2, Cl-2, C2-2 and C3-2 is periodic according to the frequency Fmod2, equal to k times the frequency Fmod1, with k a number greater than or equal to 1.
- the frequency Fmod2 corresponds to the amplitude modulation frequency of a light signal detected by the level W2, so that a distance, or depth, d can be calculated for each pixel Pix2 from the samples of charges CO-2, Cl-2, C2-2 and C3-2 provided by this pixel Pix2.
- each pixel Pix2 samples the photogenerated charges at a frequency Fe2 equal to N times the frequency Fmod2, with N equal to 4 when the pixel Pix2 provides four samples CO-2, Cl-2, C2-2 and C3-2 for calculate a distance or depth d for this pixel Pix2.
- the calculation circuit 20 is then configured to calculate , for each pixel Pixl, respectively Pix2, a distance or depth d, from the samples C0-1, Cl-1, C2-1, C3-1 of the pixel
- the calculation circuit 20 is further configured to calculate, or generate, a depth map from the distances d calculated for the pixels Pix1, and, furthermore, the distances d calculated for the pixels Pix2, so that the depth map depth thus calculated is more precise than a depth map which would have been generated from the distances d calculated for the pixels Pixl only, and than a depth map which would have been generated from the distances d calculated for the pixels Pix2 only.
- the calculation circuit 20 is configured to calculate, from the distances d calculated for the pixels Pix1 and for the pixels Pix2, a depth map of the scene with increased precision compared to a depth map of the reconstituted scene from the distances d calculated for the pixels Pix1 only, and to a depth map of the scene reconstituted from the distances d calculated for the pixels Pix2 only.
- the number k is strictly greater than 1.
- the sensor 12 receives a light signal reflected by a scene, which corresponds to a light signal emitted by the source 16 (figure 1), amplitude modulated at frequency Fmod1 and simultaneously at frequency Fmod2.
- the pixels Pix1 then sample this light signal received at the frequency Fel, while the pixels Pix2 sample this light signal received at the frequency Fe2.
- each association of a pixel Pixl and of a corresponding pixel Pix2 makes it possible to calculate a first distance d for the pixel Pixl and a second distance d for the pixel Pix2.
- the first distance is calculated from a first phase shift, respectively a second phase shift, Df modulo 2*P and from the Math 2 formula
- the maximum scene depth detectable without uncertainty linked to the modulo 2*P is therefore greater at the frequency Fmod1 than at the frequency Fmod2.
- the first distance d calculated at the frequency Fmodl is used, for example by the circuit 20, to remove the uncertainty on the second distance d calculated at the frequency Fmod2.
- the maximum detectable scene depth d without uncertainty linked to the modulo 2*P is the same at the frequency Fmod2 and at the frequency Fmod1.
- the device 10 makes it possible to measure, without uncertainty linked to the knowledge modulo 2*P of the phase shift, distances d over a range going from 0 to c/2*Fmodl at the maximum, with a measurement error corresponding to the measurement error at the frequency Fmod2.
- the depth map calculated by the circuit 20 from the first distances and the second distances is more precise (in terms of measurement error due to the use of the Fmod2 frequency) than a depth map which would be calculated from the first distances alone, and more precise (in terms of maximum measurable distance without uncertainty due to the use of the Fmod2 frequency) than a depth map that would be calculated from only the second distances.
- the circuit 20 is configured to calculate, from the first and second distances d, that is to say at from samples C0-1, CO-2, Cl-1, Cl-2, C2-1, C2-2, C3-1 and C3-2, this more accurate depth map.
- each pixel Pixl is stacked on the corresponding pixel Pix2 with which the pixel Pixl is associated.
- the center of each pixel Pixl is aligned, in the z direction, with the center of the corresponding pixel Pix2 associated with this pixel Pixl.
- the frequency Fmod1 is between 10 MHz and 150 MHz, the frequency Fmod2 possibly being between 20 MHz and 300 MHz.
- the number k is equal to 1.
- the sensor 12 receives a light signal reflected by a scene, which corresponds to a light signal emitted by the source 16 (FIG. 1) which is amplitude modulated only at the frequency Fmodl.
- the pixels Pix1 then sample this light signal received at the frequency Fel and the pixels Pix2 sample this light signal at the frequency Fe2 equal to the frequency Fel.
- each pixel Pix1, respectively Pix2, comprises several photosites PI, respectively P2.
- the centers of the pixels Pix1 are offset, in the x direction and/or in the y direction, with respect to the centers of the pixels Pix2.
- each pixel Pixl has its center which is shifted with respect to the center of the pixel Pix2 with which this pixel Pixl is associated.
- the offset of the center of each pixel Pixl relative to the center of the pixel Pix2 with which it is associated is implemented only one capture of the scene out of two.
- the shift of the center of each pixel Pixl with respect to the center of the pixel Pix2 with which it is associated is implemented by the control circuit of the depth pixels Pixl and Pix2, therefore of the photosites PI and P2, for example thanks to the control signals supplied to the pixels Pix1 and/or to the pixels Pix2.
- the implementation of such a shift is within the reach of those skilled in the art, in particular from the examples of embodiments which are described in relation to FIGS. 12 to 15.
- the frequencies Fmod1 and Fmod2 are between 10 MHz and 300 MHz.
- the circuit 20 is configured to calculate, for each association of a pixel Pixl and a corresponding pixel Pix2, a first distance d between this pixel Pixl and the scene, that is to say between the center of the pixel Pixl and the scene, and a second distance d between the pixel Pix2 and the scene, i.e. between the center of the pixel Pix2 and the scene, and, moreover, that these two pixels Pixl and Pix2 have their centers shifted, the first distance d is shifted with respect to the second distance d. This amounts to doubling the number of distances d available for the calculation of a depth map by the circuit 20.
- the depth map calculated by the circuit 20 from the distances d calculated for the pixels Pixl and the distances d calculated for the pixels Pix2 is more precise, in a plane defined by the directions x and y, than a depth map which would be calculated from the distances calculated only for the pixels Pixl and than a depth map which would be calculated from distances calculated only for pixels Pix2.
- the calculation circuit 20 is configured to improve the precision of the depth map in the direction of offset of the centers of the pixels Pix1 with respect to the centers of the pixels Pix2.
- Figure 4 is a circuit diagram illustrating one embodiment of a circuit 300 of a depth photosite. According to one embodiment, all the photosites P1 and P2 are implemented by circuits 300, each photosite corresponding to a separate circuit 300.
- the circuit 300 is adapted to carry out the acquisition of a single sample of charges C0-1, Cl-1, C2-1, C3-1, CO-2, Cl-2, C2-2 or C3- 2.
- the circuit 300 is capable of carrying out on-load storage.
- Circuit 300 includes a photosensitive element PD coupled between a node 302 and a reference power source, for example ground, the photosensitive element PD being for example a photodiode. More particularly, in the case where the circuit 300 corresponds to a photosite PI, the element PD corresponds to the photosensitive zone 101 of the photosite P1 (FIG. 3), and, in the case where the circuit 300 corresponds to a photosite P2, the element PD corresponds to the photosensitive zone 131 of the photosite P2 (FIG. 3).
- the node 302 is coupled to a read node SN ("sense node" in English) via a sampling circuit 304.
- the sampling circuit 304 comprises a memory memi coupled to the node 302 by a transfer gate 306 which is for example an N-channel MOS transistor.
- the memory memi is also coupled to the detection node SN by an additional transfer gate 308, which is also for example an N-channel MOS transistor.
- transfer 306 is controlled by a signal Vmemi applied to its gate, and transfer gate 308 is controlled by a signal Vsni applied to its gate.
- the memi memory provides a charge storage area in which charges transferred from the photosensitive element PD are temporarily stored.
- the circuit 300 further comprises an output circuit formed by a source follower transistor 310, a selection transistor 312 and a reset transistor 314, these transistors being for example N-channel MOS transistors
- the detection node SN is coupled to the control node of the transistor 310, which has for example its drain coupled to the supply voltage source Vdd, and its source coupled to an output line 316 of the circuit 300 by the transistor 312 which is controlled by a signal Vsel applied to its gate.
- the detection node SN is also coupled to the supply voltage source Vdd through the transistor 314 which is controlled by a signal Vres applied to its gate.
- the output circuit could be shared by several photosites, the detection node SN being for example coupled to the sampling circuit of one or more adjacent photosites.
- the circuit 300 also comprises, for example, a transistor 318 coupling the node 302 to the supply voltage source Vdd and allowing the photodiode PD to be reset.
- the transistor 318 is for example controlled by a signal Vres PD . It therefore makes it possible to control the exposure time by ensuring a draining of the photodiode PD before a synchronous integration start for all the photodiodes PD of the sensor and to ensure an anti-glare function in order to avoid an overflow of the photodiode in the memories memi during the global reading of the matrix.
- Figure 5 is a circuit diagram illustrating another embodiment of a circuit 320 of a depth photosite. According to one embodiment, all the photosites P1 and P2 are implemented by circuits 320, each photosite corresponding to a separate circuit 320.
- circuit similar to circuit 320 is described in more detail in French patent application application number FR 15/63457.
- FR 15/63457 For example, a timing diagram illustrating an example of operation of this circuit is presented in FIG. 3 of FR 15/63457, and the same example of operation applies in the context of the present application.
- the circuit 320 comprises all the elements of the circuit 300 and further comprises another sampling circuit 322 connected between the node 302 and the node SN and comprising circuit elements similar to the sampling circuit 304 , and in particular the circuit 322 comprises a memory menp, a gate of transfer 324 controlled by a signal Vmenp, and a transfer gate 326 controlled by a signal Vsn2.
- the circuit 320 makes it possible to acquire two samples for a depth image.
- the use of circuit 320 advantageously makes it possible to reduce the number of transistors per photosite.
- the reading of the two memories memi and menp is carried out sequentially.
- Figure 6 is a circuit diagram illustrating another embodiment of a circuit 330 of a depth photosite. According to one embodiment, all the P1 and P2 photosites are implemented with circuits 330.
- the circuit 330 comprises all the elements of the circuit 320 represented in FIG. 5, with the difference that the sampling circuit 322 is connected between the node 302 and a node SN', and that it further comprises , an output circuit formed of a source follower transistor 332, a selection transistor 334 and a reset transistor 336, these transistors being for example N-channel MOS transistors.
- the read node SN' is coupled to the control node of transistor 332, which for example has its drain coupled to supply voltage source Vdd, and its source coupled to an output line 338 of circuit 330 by transistor 334 which is controlled by a signal Vsel ' applied to its grid.
- Read node SN' is also coupled to supply voltage source Vdd through transistor 336 which is controlled by a signal Vres' applied to its gate.
- the circuit 330 makes it possible to carry out the acquisition of two samples for a depth image. The reading of the two memories memi and menp can be carried out simultaneously.
- Figure 7 is a circuit diagram illustrating another circuit embodiment 340 of a depth photosite. According to one embodiment, all the photosites P1 and P2 are implemented by circuits 340, each photosite corresponding to a separate circuit 340.
- Circuit 340 comprises all the elements of circuit 300 represented in FIG. 4, except that transistor 308 and memory memi are not present, transistor 306 being connected directly to read node SN.
- circuit 340 the charges are stored directly on the read node SN. There is no intermediate storage. In this case, we speak of voltage storage.
- a capacitor C can be added to the read node SN, connected between the read node SN and ground, to increase the dynamic range.
- the storage capacitance at the read node SN can also be constituted solely by intrinsic capacitances present on the read node, for example by the sum of the gate capacitance of the transistor 310 connected to this node, of the source capacitance of the transistor 314 connected to this node, the drain capacitance of the transistor 306 connected to this node, and the equivalent capacitance between the electrical connections connected to the node SN and neighboring electrical connections.
- the cases of photosites with voltage storage, in parallel or sequential read can easily be derived from the cases of photosites with storage under load previously presented in relation to FIGS. 5 and 6, by removing the transistors 308, 326 and the memories memi, menp. [0141] More generally, the person skilled in the art is able to deduce cases of photosites previously described suitable for carrying out the acquisition of two samples for a depth image, with storage in charge or in voltage, and with parallel or sequential reading , cases of photosites adapted to carry out the acquisition of three or four samples for a depth image, with storage under load or under voltage, and with parallel or sequential reading.
- control signals supplied to the photosites PI for the acquisition of the samples C0-1, respectively Cl-1, C2-1 and C3-1 are preferably identical to those supplied to the P2 photosites for the acquisition of the CO-2 samples, respectively Cl-2, C2-2 and C3-2.
- the senor 12 comprises, for example, a circuit configured to synchronize the durations C0-1, Cl-1, C2-1 and C3-1 with the durations respectively CO-2,
- this circuit comprising, for example, delay lines.
- Figure 8 illustrates, by curves in the frequency domain, a mode of implementation of the choice of the number k strictly greater than 1.
- FIG. 8 illustrates, in the frequency domain, the sampling at the frequency Fel of an amplitude modulated signal at the frequency Fmodl, each sample corresponding to a time window of width 1/(N*Fmodl ), with N equal to four in this embodiment based on taking four samples.
- cardinal sines 400 are observed associated with the frequency Fmod1. More particularly, each cardinal sine 400 is centered on one of the frequencies r*Fel - Fmodl and r*Fel + Fmodl, with r a positive integer.
- r a positive integer.
- the width of the main lobe of each cardinal sinus 400 is equal to 2*Fmodl, and that of its secondary lobes to Fmodl.
- the amplitude of these cardinal sines 400 is multiplied by a cardinal sine 402 centered on the zero frequency, the cardinal sine 402 having a main lobe of width 2*Fel and secondary lobes of width Fel.
- the light signal actually received by level W1 is not only modulated at the frequency Fmodl, but also and simultaneously at the frequency Fmod2.
- the light source 16 (FIG. 1) is configured to supply an amplitude modulated light signal at the frequency Fmod1 and, simultaneously, at the frequency Fmod2.
- the light source 16 is monochromatic and configured to provide a light signal at a given wavelength, this signal being modulated in amplitude simultaneously at the frequencies Fmod1 and Fmod2.
- the light source 16 is polychromatic and configured to provide a light signal comprising several wavelengths, preferably two different wavelengths.
- the light source 16 is configured, for example, so that the emitted signal is amplitude modulated simultaneously at Fmod1 and Fmod2 for all the wavelengths of the emitted light signal, or, for example, so that the light signal emitted either modulated in amplitude at the frequency Fmod1 for a first wavelength or a first range of wavelengths and, simultaneously, at the frequency Fmod2 for a second wavelength different from the first wavelength or a second wavelength range different from the first wavelength range.
- cardinal sines are also observed associated with the frequency Fmod2.
- Each cardinal sine associated with the frequency Fmod2 is centered on one of the frequencies r*Fel - Fmod2 and r*Fel + Fmod2, has a main lobe of width 2*Fmodl and secondary lobes of width Fmodl.
- the amplitude of each cardinal sine associated with the frequency Fmod2 is, like those cardinal sines 400 associated with the frequency Fmodl, multiplied by the cardinal sine 402.
- the number k is chosen integer. In this way, the frequency Fmod1 is found on a zero of each of the cardinal sines associated with the frequency Fmod2.
- an error in the phase shift calculated for the level W1 is tolerated, resulting from the contribution of the frequency Fmod2 to the measurement, by the level W1, of the frequency Fmodl of the reflected signal.
- an error less than a target error threshold is tolerated, or, in other words, a contribution of the frequency Fmod2 to the measurement, by the level W1, of the frequency Fmod1 of the reflected signal, which is less than a target value.
- the number k is then determined by this target value. In other words, the number k is then determined so that the contribution of the frequency Fmod2 on the measurement, by the level W1, of the frequency Fmod1 of the reflected signal is lower than this target value.
- the number k is strictly greater than 7, which corresponds to a contribution of the frequency Fmod2 on the measurement, by the level W1, of the frequency Fmod1 which is less than 2.5%.
- the choice of the number k so that, in the level W1, the frequency Fmod2 does not or only slightly disturb the phase shift measurement made at the frequency Fmod1 has just been described.
- the frequency Fmod2 disturbs the phase shift measurement made at the frequency Fmodl by the level Wl, that is to say when the light signal received is sampled at the frequency Fel
- the frequency Fmodl can disturb the phase shift measurement made at the frequency Fmod2 by the level W2, that is to say when the light signal received is sampled at the frequency Fe2.
- each cardinal sine associated with the frequency Fmodl is centered on a corresponding frequency r*Fe2 - Fmodl or r*Fe2 + Fmod1 and each cardinal sine associated with the frequency Fmod2 is centered on a corresponding frequency r*Fe2 - Fmod2 or r*Fe2 + Fmod2.
- the cardinal sinuses associated with the frequencies Fmod1 and Fmod2 each have a main lobe of width 2*Fmod2 and secondary lobes of width Fmod2.
- the frequency Fmod1 is lower than the frequency Fmod2. It is therefore not possible to find an integer value of k for which the frequency Fmod2 is on a zero of the cardinal sines associated with the frequency Fmod1.
- a filter is provided between the levels W1 and W2, the filter being configured to block the first wavelength and to pass the second length.
- the filter for example an interference filter, therefore allows only the part of the reflected light signal which is modulated at the frequency Fmod2 to pass towards the level W2. This makes it possible to eliminate the contribution of the frequency Fmod1 on the measurement, by the level W2, of the frequency Fmod2 of the reflected signal.
- an error is tolerated on the phase shift calculated for the level W2, resulting from the contribution of the frequency Fmod1 to the measurement, by the level W2, of the frequency Fmod2 of the reflected signal.
- an error lower than a target error threshold is tolerated, or, in other words, a contribution of the frequency Fmod1 on the measurement, by the level W2, of the frequency Fmod2 of the reflected signal, which is lower than a target value.
- the number k is then further determined by this target value, or, in other words, so that the contribution of the frequency Fmod1 to the measurement, by the level W2, of the frequency Fmod2 of the reflected signal is lower than this target value.
- the number k is greater than or equal to 20, which corresponds to a contribution of the frequency Fmod1 on the measurement, by the level W2, of the frequency Fmod2 which is less than or equal to 5%.
- FIGS. 9 to 11 each schematically represent an exemplary embodiment of the spatial distribution of the samples C0-1, Cl-1, C2-1,
- FIGS. 9 to 11 each represent an exemplary embodiment of the spatial distribution of the photosites, and therefore of their photodetectors, in the pixels Pix1 and Pix2, in relation to the samples which they make it possible to acquire.
- Each of these figures represents, in a vertically aligned manner in the figure, the spatial distribution of the samples in the pixels Pixl of level W1 (at the top of the figure) and the spatial distribution of the samples in the pixels Pix2 of level W2 ( bottom of the figure).
- the photosite matrix P1 of the level W1 and a part of the photosite matrix P2 of the level W2 are represented.
- each pixel Pixl is stacked on a pixel Pix2, or, in other words, each center of each pixel Pixl is aligned with the center of the corresponding pixel Pix2.
- the spatial distribution of the samples C0-1, Cl-1, C2-1, C3-1 in the pixels Pixl is identical to the spatial distribution of the samples respectively C0-2 , Cl-2, C2-2, C3-2 in pixels Pix2.
- the photodetector of a pixel Pix1 in which the charges of the sample C0-1 are generated, respectively Cl-1, C2-1 and C3-1 is stacked on the photodetector of the corresponding pixel Pix2 in which the charges of the sample C0-1 are generated the loads of the CO-2 sample, respectively Cl-2, C2-2 and C3-2.
- each photosite PI configured to acquire a sample C0-1, respectively Cl-1, C2-1 or C3-1 is stacked on a photosite P2 configured to acquire a sample CO-2, respectively Cl -2, C2-2 or C3-2.
- the spatial distribution of the samples C0-1, Cl-1, C2-1 and C3-1 in each pixel Pixl may be different from the distribution spatial pattern of the samples CO-2, Cl-2, C2-2 and C3-2 of the pixel Pix2 with which the pixel Pixl is associated, and on which the pixel Pixl is stacked.
- the sensor 12 comprises only photosites P1 and P2 for determining a depth image, and, preferably, the lines of photosites P1, P2 of the sensor are adjacent two by two, the columns of photosites P1, P2 of the sensor being adjacent two by two.
- the pixels Pix1 and Pix2 are delimited by solid lines, and, in each pixel Pix1, Pix2, the photosites of the pixel are delimited by dotted lines.
- each pixel Pix1 comprises four photosites P1 configured to acquire the respective samples C0-1, C1-1, C2-1, and C3-1.
- each Pix2 pixel comprises four P2 photosites configured to acquire the respective samples CO-2, Cl-2, C2-2 and C3-2.
- each pixel Pixl comprises two PI photosites, a first of the two PI photosites being configured to acquire two samples, for example C0-1 and C2-1, and a second of the two PI photosites being configured to acquire two other samples, for example C1-1, C3-1.
- each pixel Pixl comprises two PI photosites, a first of the two PI photosites being configured to acquire two samples, for example C0-1 and C2-1, and a second of the two PI photosites being configured to acquire two other samples, for example C1-1, C3-1.
- each pixel Pixl comprises two PI photosites, a first of the two PI photosites being configured to acquire two samples, for example C0-1 and C2-1, and a second of the two PI photosites being configured to acquire two other samples, for example C1-1, C3-1.
- Pix2 comprises two P2 photosites, a first of the two P2 photosites being configured to acquire two samples, for example CO-2 and C2-2, and a second of the two photosites P2 being configured to acquire two other samples, for example Cl-2, C3-2.
- each pixel Pixl comprises two photosites PI, a first of the two photosites PI being configured to acquire two samples during two successive captures A (on the left in figure 11) and B (on the right in figure 11), for example sample C0-1 during capture A and sample C2-1 during capture B, a second of the two photosites PI being configured to acquire two other samples during the two successive captures A and B, for example sample Cl-1 during capture A and sample C3-1 during capture B.
- each pixel Pix2 comprises two photosites P2, a first of the two photosites P2 being configured to acquire two samples during two successive captures A and B, for example sample CO-2 during capture A and sample C2-2 during capture B, a second of the two photosites P2 being configured to acquire two other samples during the two captures successive A and B, for example l sample Cl-2 during capture A and sample C3-2 during capture B.
- each pixel Pixl then being, for example, stacked and aligned on a corresponding pixel Pix2 and preferably having the same spatial distribution of sample as the corresponding Pix2 pixel.
- the person skilled in the art is able to predict pixels Pix1 and Pix2 has a single photosite configured to provide four samples in four successive captures.
- Figures 12 to 15 illustrate implementation details of embodiments in which the number k is equal to 1.
- FIGS. 12 to 15 each schematically represent an embodiment of the spatial distribution of the samples C0-1, Cl-1, C2-1, C3-1 in the pixels Pixl and of the samples CO-2, Cl -2, C2-2 and C3-2 in pixels
- Each of these figures represents, in a vertically aligned manner in the figure, the spatial distribution of the samples in the pixels Pixl of the level W1 (at the top of the figure) and the spatial distribution of the samples in the pixels Pix2 of the level W2 ( bottom of the figure).
- the photosite matrix P1 of the level W1 and a part of the photosite matrix P2 of the level W2 are represented.
- the spatial distribution of the samples C0-1, Cl-1, C2-1, C3-1 in the pixels Pixl is identical to the spatial distribution of the samples respectively CO-2, Cl-2, C2- 2, C3-2 in the pixels Pix2
- the relative position, with respect to the center O of the pixel Pixl, of a photosite PI which acquires the sample C0-1, respectively Cl-1, C2-1 and C3-1 is identical to the relative position, with respect to the center O of the corresponding pixel Pix2, of a photosite P2 which acquires the sample CO-2, respectively Cl-2, C2-2 and C3-2.
- the senor 12 comprises only photosites P1 and P2 for determining a depth image, and, preferably, the lines of photosites P1, P2 of the sensor are adjacent two by two, the columns of photosites P1, P2 of the sensor being adjacent two by two.
- the rows of photosites PI, P2 are parallel to the y direction and the columns of photosites PI, P2 are parallel to the x direction, the levels W1 and W2 being stacked in the z direction.
- the pixels Pix1 and Pix2 are delimited by solid lines, and, in each pixel Pix1, Pix2, the photosites of the pixel are delimited by dotted lines.
- FIG. 12 a single pixel Pix2 is fully represented, and although four pixels Pixl are fully represented, the only pixel Pixl referenced is that which is associated with the pixel Pix2 fully represented.
- each pixel Pix1 comprises four photosites PI configured to acquire the respective samples C0-1, C1-1, C2-1, and C3-1.
- each Pix2 pixel comprises four P2 photosites configured to acquire the respective samples CO-2, Cl-2, C2-2 and C3-2. The capture of four samples C0-1, Cl-1, C2-1 and C3-1 by each pixel Pixl and of four samples CO-2, Cl-2, C2-2 and C3-2 per each pixel Pix2 is then implemented in a single capture.
- each pixel Pix2 is offset with respect to the center O of the pixel Pixl with which it is associated.
- the center O of each pixel Pix2 is offset by a line of photosites PI, P2 and by a column of photosites PI, P2 with respect to the center O of the pixel Pixl with which it is associated .
- the center O of each pixel Pix2 is offset by one photosite in the x direction and by one photosite in the y direction with respect to the center O of the pixel Pix1 with which it is associated.
- the repetition pitch of the photosites P1, P2 configured to acquire the samples C0-1, CO-2, respectively Cl-1, Cl-2; C2-1, C2-2; and C3-1, C3-2 is equal to 1 in the x direction and in the y direction.
- each pixel Pix2 is shifted by one photosite only in the x direction with respect to the center O of the pixel Pixl with which it is associated, which allows the depth map generated by circuit 20 is more spatially accurate in the x direction.
- the center O of each pixel Pix2 is shifted by one photosite only in the y direction relative to the center O of the pixel Pixl with which it is associated, which allows the depth map generated by the circuit 20 (FIG. 1) is more spatially precise in the y direction.
- the offset of the centers O of the pixels Pix2 with respect to the center O of the pixels Pixl with which they are associated is implemented at each capture, and is the same at each capture.
- the offset of the centers O of the pixels Pix2 with respect to the center O of the pixels Pixl with which they are associated is, for example, implemented by the control circuit of the pixels Pixl and Pix2, by means of control signals that this circuit supplies to the photosites PI and P2.
- FIG. 13 a single pixel Pix1 and a single pixel Pix2 associated with each other are referenced.
- each pixel Pixl comprises four photosites P1 configured to acquire the respective samples C0-1, C1-1, C2-1, and C3-1.
- each Pix2 pixel comprises four P2 photosites configured to acquire the respective samples CO-2, Cl-2, C2-2 and C3-2. The capture of four samples C0-1, Cl-1, C2-1 and C3-1 by each pixel Pixl and of four samples CO-2, Cl-2, C2-2 and C3-2 by each pixel Pix2 is then put implemented in a single capture.
- the center O of each pixel Pix2 is shifted by one photosite, here in the y direction, relative to the center O of the pixel Pixl to which it is is associated.
- the repetition step of the photosites PI, P2 configured to acquire the samples C0-1, CO-2, respectively Cl-1, Cl-2; C2-1, C2-2; and C3-1, C3-2 is 1 in the y direction and 2 in the x direction.
- the center O of each pixel Pix2 is shifted by one photosite, here in the x direction, relative to the center O of the pixel Pix1 with which it is associated.
- the repetition pitch of the photosites P1, P2 configured to acquire the samples CO-1, CO-2, respectively Cl-1, Cl-2; C2-1, C2-2; and C3-1, C3-2 equals 2 in the y direction and 1 in the x direction.
- the repetition pitch of the photosites P1, P2 configured to acquire the samples CO-1 and CO-2, respectively Cl-1 and Cl-2, C2-1 and C2-2, and C3-1 and C3- 2 is equal to 1 in the x direction and in the y direction
- FIG. 13 corresponds to the case where, at each two successive captures C and D, the offset of the center O of each pixel Pix2 with respect to the center O of the pixel Pixl with which it is associated is different for each of the two captures C and D.
- this shift is implemented by the control circuit of the pixels Pix1 and Pix2, by means of the control signals that this circuit supplies to the photosites PI and P2, for example by modifying , between the two captures C and D, the control signals supplied to the photosites P2 and/or PI.
- the center O of each pixel Pix2 is aligned with the center O of the pixel Pixl with which it is associated, and, during capture D, the center O of each pixel Pix2 is offset by one photosite in the x direction and/or by one photosite in the y direction relative to the center O of the pixel Pixl with which it is associated. In other words, it corresponds to the case where, at each two successive captures C and D, the offset of the center O of each pixel Pix2 with respect to the center O of the pixel Pixl with which it is associated is implemented only for one of the two captures.
- this offset is implemented by the control circuit of the pixels Pix1 and Pix2, by means of the control signals that this circuit supplies to the photosites PI and P2, for example by modifying, between the two captures C and D, the control signals supplied to the photosites P2 and/or PI.
- this offset is implemented by the control circuit of the pixels Pix1 and Pix2, by means of the control signals that this circuit supplies to the photosites PI and P2, for example by modifying, between the two captures C and D, the control signals supplied to the photosites P2 and/or PI.
- FIG. 14 a single pixel Pix1 and a single pixel Pix2 associated with each other are referenced.
- each pixel Pixl comprises two PI photosites, one of the two PI photosites being configured to acquire two samples, for example C0-1 and C2-1, and the other of the two other PI photosites being configured to acquire two other samples, for example C1-1 and C3-1.
- each pixel Pix2 comprises two P2 photosites, one of the P2 photosites being configured to acquire two samples, for example CO-2 and C2-2, and the other of the two P2 photosites being configured to acquire two other samples, for example Cl-2 and C3-2.
- the two photosites PI of each pixel Pix1 are arranged side by side in the y direction, and, similarly, the two photosites P2 of each pixel Pix2 are arranged side by side in the y-direction.
- the spatial repetition step of the photosites P1, P2 configured to acquire the samples the samples C0-1, CO-2, respectively Cl-1, Cl-2; C2-1, C2-2; and C3-1, C3-2 is 1 in the x direction.
- the center O of each pixel Pix2 is offset by one photosite, in this example in the y direction, relative to the center O of the pixel Pix1 with which it is associated.
- the spatial repetition step of the photosites P1, P2 configured to acquire the samples C0-1, CO-2, respectively Cl-1, Cl-2; C2-1, C2-2; and C3-1, C3-2 is also 1 in the y direction.
- the two photosites PI of each pixel Pixl are arranged side by side in the x direction
- the two photosites P2 of each pixel Pix2 are arranged side by side in the x direction
- the center O of each pixel Pix2 is shifted by one photosite in the direction x with respect to the center O of the pixel Pixl with which it is associated.
- the spatial repetition pitch of the photosites P1, P2 configured to acquire the samples C0-1, CO-2, respectively Cl-1, Cl-2; C2-1, C2-2; and C3-1, C3-2 is 1 in the x direction and 1 in the y direction
- the offset of the centers O of the pixels Pix2 with respect to the centers O of the pixels Pixl with which they are associated is implemented at each capture, and is identical to each capture.
- the offset of the centers O of the pixels Pix2 with respect to the center O of the pixels Pixl with which they are associated is, for example, implemented by the control circuit of the pixels Pixl and Pix2, by means of control signals that this circuit supplies to the photosites PI and P2.
- each pixel Pixl comprises two photosites PI, one of the two photosites PI being configured to acquire two samples during two successive captures E (on the left in figure 15) and F (on the right in figure 15) , for example the sample C0-1 during the first capture E and the sample C2-1 during the second capture F, the other of the two photosites PI of the pixel Pixl being configured to acquire two other samples during the two captures successive E and F, for example the sample Cl-1 during the first capture E and the sample C3-1 during the second capture F.
- each pixel Pix2 comprises two photosites P2, one of the two photosites P2 of the pixel Pix2 being configured to acquire two samples during the two successive captures E and F, for example the sample CO-2 during the first capture E and the sample C2-2 during the second capture F, the other of the two other photosites P2 of the pixel Pix2 being configured to acquire two other samples during the two successive captures E and F, for example the sample Cl-2 during the first capture E and the sample C3-2 during the second capture F.
- Capturing four samples C0-1, Cl-1, C2-1 and C3-1 per each pixel Pixl and four samples CO-2, Cl-2, C2-2 and C3-2 per each pixel Pix2 is then implemented during the two successive captures E and F.
- the two photosites PI of each pixel Pix1 are arranged side by side in the y direction, and, similarly, the two photosites P2 of each pixel Pix2 are arranged side by side in the y-direction. It follows that, on the set of the two captures E and F, the spatial repetition pitch of the photosites PI, P2 configured to acquire the samples the samples C0-1 and CO-2, respectively Cl-1 and Cl-2, C2-1 and C2-2, and C3-1 and C3-
- each pixel Pix2 is offset by one photosite, in this example in the y direction, relative to the center O of the pixel Pix1 with which it is associated. It follows that, on the set of the two captures E and F, the spatial repetition pitch of the photosites PI, P2 configured to acquire the samples the samples C0-1 and CO-2, respectively Cl-1 and Cl-2, C2-1 and C2-2, and C3-1 and C3-2 also equal 1 in the y direction.
- the two photosites PI of each pixel Pixl are arranged side by side in the x direction
- the two photosites P2 of each pixel Pix2 are arranged side by side in the x direction
- the center O of each pixel Pix2 is shifted by one photosite in the direction x with respect to the center 0 of the pixel Pixl with which it is associated. It follows that, on the set of the two captures E and F, the spatial repetition pitch of the photosites PI, P2 configured to acquire the samples the samples C0-1 and CO-2, respectively Cl-1 and Cl-2, C2-1 and C2-2, and C3-1 and C3-2 is also equal to 1 in the y direction and in the x direction.
- the offset of the centers O of the pixels Pix2 with respect to the center O of the pixels Pixl with which they are associated is implemented at each capture, and is the same at each capture.
- the offset of the centers O of the pixels Pix2 with respect to the center O of the pixels Pixl with which they are associated is, for example, implemented by the control circuit of the pixels Pixl and Pix2, by means of control signals that this circuit supplies to the photosites PI and P2.
- each line of photosites P1 is stacked on a line of photosites P2, the stacking of a line of photosites P1 and of a line of photosites P2 forming a line L depth photosites of the sensor, and each column of photosites P1 is stacked on a column of photosites P2, the stacking of a column of photosites P1 on a column of photosites P2 forming a column R of photosites depth of the sensor 12.
- the sensor 12 is configured to acquire a depth image, but not a 2D image.
- two successive lines L are adjacent, that is to say arranged directly one beside the other, two successive columns R of depth photosites of the sensor 12 being adjacent.
- the senor 12 of the device 10 represented in FIG. 1 can be capable of acquiring a 2D image.
- FIG. 16 is a sectional and perspective view illustrating schematically and partially an embodiment of a sensor 12 of a 2D image and of a depth image of a scene.
- the senor 12 additionally comprises image pixels 2D referenced P3.
- pixels P3 are arranged in and on the substrate 100 and pixels P3 are arranged in and on the substrate 130. In variants not illustrated, the pixels P3 are all arranged in and on the substrate 100.
- each pixel P3 is suitable for measuring a light intensity in a given range of visible wavelengths.
- each pixel P3 comprises a photosensitive element, for example a photodiode, formed in the substrate 100 or 130 of the level W1 or W2 respectively to which this pixel P3 belongs.
- the senor 12 is configured to acquire a 2D image in color.
- the pixels P3 are of different types, each type of pixel P3 being suitable for measuring a light intensity in a given range of visible wavelengths, distinct from those of the other types of pixel P3.
- Each pixel P3 then comprises a color filter, for example made of a colored resin, facing the photodiode of the pixel P3, the filter being configured to transmit only the wavelengths of light belonging to the range of wavelengths for which the pixel P3 measures the light intensity.
- each level W1 and W2 comprises pixels P3
- two pixels P3 stacked on top of each other preferably share the same color filter, and the color filter rests on the substrate 100 which receives the incident light before the substrate 130, and, more particularly on the side of the face of the substrate 100 which receives the incident light
- each pixel P3 can have its own color filter, the latter resting on the substrate 100 or 130 in and on which the pixel P3 is formed, on the side of the face of this substrate 100 or 130 which receives the incident light.
- only level W1 comprises pixels P3.
- the color filter of each pixel P3 rests on the substrate 100, on the side of the face of the substrate 100 which receives the incident light.
- the senor 12 comprises three types of pixels P3, first pixels P3 called blue pixels, comprising a color filter preferentially transmitting blue light, second pixels P3 called red pixels, comprising a color filter preferentially transmitting red light, and third pixels P3 called green pixels, comprising a color filter preferentially transmitting green light.
- first pixels P3 called blue pixels, comprising a color filter preferentially transmitting blue light
- second pixels P3 red pixels
- red pixels P3 called green pixels comprising a color filter preferentially transmitting green light.
- green pixels comprising a color filter preferentially transmitting green light.
- the different types of pixels P3 are not differentiated
- the senor 12 is configured to capture a monochromatic 2D image, in which case the color filters of the pixels P3 can be omitted.
- each two successive lines L are separated from each other by one or more rows of pixels P3, and each two successive columns R are separated from each other by one or more columns of pixels P3.
- the person skilled in the art is able to adapt this description to the case where each row L is separated from a following row L by one or more rows of pixels P3, and each column R is separated from a following column R by one or more columns of pixels P3.
- the pixels and the photosites have been represented in the various figures with shapes, in top view, square or rectangular.
- those skilled in the art may provide other shapes of pixels and/or photosites, for example photosites having, in top view, triangular shapes.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Measurement Of Optical Distance (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/571,201 US20240280672A1 (en) | 2021-06-21 | 2022-06-16 | Device for acquiring a depth map of a scene |
CN202280044151.XA CN117546038A (zh) | 2021-06-21 | 2022-06-16 | 用于获取场景深度图的设备 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR2106575A FR3124275B1 (fr) | 2021-06-21 | 2021-06-21 | Dispositif pour l'acquisition d'une carte de profondeur d'une scène |
FRFR2106575 | 2021-06-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022268625A1 true WO2022268625A1 (fr) | 2022-12-29 |
Family
ID=77180207
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2022/066444 WO2022268625A1 (fr) | 2021-06-21 | 2022-06-16 | Dispositif pour l'acquisition d'une carte de profondeur d'une scene |
Country Status (4)
Country | Link |
---|---|
US (1) | US20240280672A1 (fr) |
CN (1) | CN117546038A (fr) |
FR (1) | FR3124275B1 (fr) |
WO (1) | WO2022268625A1 (fr) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR1563457A (fr) | 1967-05-10 | 1969-04-11 | ||
US20160181226A1 (en) * | 2014-12-22 | 2016-06-23 | Google Inc. | Stacked semiconductor chip rgbz sensor |
US20180084238A1 (en) * | 2016-09-21 | 2018-03-22 | Stmicroelectronics (Grenoble 2) Sas | Device having a 2d image sensor and depth sensor |
FR3098991A1 (fr) * | 2019-07-19 | 2021-01-22 | Isorg | Pixel de capteur d’images |
-
2021
- 2021-06-21 FR FR2106575A patent/FR3124275B1/fr active Active
-
2022
- 2022-06-16 US US18/571,201 patent/US20240280672A1/en active Pending
- 2022-06-16 CN CN202280044151.XA patent/CN117546038A/zh active Pending
- 2022-06-16 WO PCT/EP2022/066444 patent/WO2022268625A1/fr active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR1563457A (fr) | 1967-05-10 | 1969-04-11 | ||
US20160181226A1 (en) * | 2014-12-22 | 2016-06-23 | Google Inc. | Stacked semiconductor chip rgbz sensor |
US20180084238A1 (en) * | 2016-09-21 | 2018-03-22 | Stmicroelectronics (Grenoble 2) Sas | Device having a 2d image sensor and depth sensor |
FR3098991A1 (fr) * | 2019-07-19 | 2021-01-22 | Isorg | Pixel de capteur d’images |
Non-Patent Citations (1)
Title |
---|
R. LANGEP. SEITZ: "Solid-state TOF range camera", IEE J. ON QUANTUM ELECTRONICS, vol. 37, no. 3, March 2001 (2001-03-01) |
Also Published As
Publication number | Publication date |
---|---|
FR3124275A1 (fr) | 2022-12-23 |
FR3124275B1 (fr) | 2023-06-02 |
US20240280672A1 (en) | 2024-08-22 |
CN117546038A (zh) | 2024-02-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
FR3060250B1 (fr) | Capteur d'image pour capter une image en 2d et une profondeur | |
EP3503192B1 (fr) | Dispositif d'acquisition d'une image 2d et d'une image de profondeur d'une scène | |
BE1024389B1 (fr) | Dispositif de detecteur avec courant majoritaire et circuits de commande du courant | |
FR3056332A1 (fr) | Dispositif comportant un capteur d'image 2d et un capteur de profondeur | |
FR2888989A1 (fr) | Capteur d'images | |
FR3052297A1 (fr) | Capteur d'image de type a obturation globale | |
US11588982B2 (en) | Depth image sensor with always-depleted photodiodes | |
FR3027732A1 (fr) | Capteur d'image a electrodes verticales | |
CN110729315B (zh) | 像素架构和图像传感器 | |
FR3108783A1 (fr) | Dispositif d'acquisition d'une image 2D et d'une image de profondeur d'une scène | |
US12055638B2 (en) | Device of acquisition of a depth image of a scene | |
WO2022268625A1 (fr) | Dispositif pour l'acquisition d'une carte de profondeur d'une scene | |
WO2022268626A1 (fr) | Capteur pour l'acquisition d'une carte de profondeur d'une scene | |
Tsutsui et al. | A 3-tap global shutter 5.0 M pixel with background canceling for 165 MHz modulated pulsed indirect time-of-flight image sensor | |
FR3137170A1 (fr) | Systeme de mesure d'un degre de polarisation lineaire estime d'un rayonnement electromagnetique reflechi par une scene | |
FR3115145A1 (fr) | Dispositif d'acquisition d'une image 2d et d'une image de profondeur d'une scene | |
FR3114439A1 (fr) | Circuit microelectronique tridimensionnel a repartition optimisee de ses fonctions numerique et analogique | |
FR3100926A1 (fr) | Capteur d'images réalisé en technologie 3D séquentielle | |
FR3026227A1 (fr) | Dispositif d'acquisition d'images 3d | |
EP4280283A1 (fr) | Capteur d'images | |
FR2751155A1 (fr) | Dispositif de lecture pour une mosaique de detecteurs electromagnetiques, et systeme de detection equipe d'un tel dispositif | |
FR2966678A1 (fr) | Dispositif d'imagerie en particulier du type cmos a report et integration. | |
FR3142856A1 (fr) | Dispositif d’acquisition d’une image 2D et d’une image de profondeur d’une scène | |
FR3140990A1 (fr) | Dispositif d’acquisition d’une image 2D et d’une image de profondeur d’une scène | |
WO2023117703A1 (fr) | Capteur d'images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22737563 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18571201 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280044151.X Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22737563 Country of ref document: EP Kind code of ref document: A1 |