US20170003382A1

US20170003382A1 - Method of preparing histograms of a sensor signal from an array of sensors, in particular proximity sensors, and corresponding device

Info

Publication number: US20170003382A1
Application number: US15/050,561
Authority: US
Inventors: Pascal Mellot
Original assignee: STMicroelectronics Grenoble 2 SAS
Current assignee: STMicroelectronics Grenoble 2 SAS
Priority date: 2015-07-02
Filing date: 2016-02-23
Publication date: 2017-01-05
Also published as: US20180217241A1; FR3038433A1; US10241197B2

Abstract

A method includes preparing a first histogram from the emission of initial optical radiation and including at least one processing iteration performed at a rate of a clock signal having an internal period equal to a sub-multiple of the optical period a sensor signal and a reference signal. Successive iterations of histogram preparation are performed so that in each iteration a time shift of the initial optical radiation is provided by a first fraction of the internal period until at least one portion of the internal period is covered to obtain an additional histogram at the conclusion of each iteration. A numerical combination of the first histogram and additional histograms is performed to obtain a final histogram having a finer time granularity than that of the first histogram.

Description

TECHNICAL FIELD

This disclosure relates to the preparation of histograms of a sensor signal from an array of sensors, such as proximity sensors, for example, for recognizing movement of an object.

BACKGROUND

In general, proximity sensors are sensors configured for detecting and/or measuring the presence of an object close to the sensors without any physical contact. Such sensors are known to those skilled in the art and may be used for detecting the presence of an object or a gesture performed above a tablet, a cellular mobile telephone, or other similar electronic apparatus, with which an action is associated.
Radiation of optical light, e.g., infrared or laser light, is generally emitted towards an object close to the sensors to measure the Time-of-Flight (TOF) of this radiation. In other words, this is the time that elapses between light emission and reception by the sensor after reflection on the object.
However, the optical light detected by the sensors may be too low to generate an analog voltage representing the flow of optical light. In fact, the optical signal may include only a few photons per excitation/emission cycle. The desired time resolution is therefore often difficult to achieve with conventional electronic transient recorders.
One approach for addressing this problem is Time-Correlated Single Photon Counting (TCSPC). With a periodic excitation emanating, for example, from a laser, it is possible to extend a collection of data from the optical signal over several excitation and emission cycles. This approach is based on a precisely timed repetitive recording of each photon of optical light radiation, e.g., laser radiation, taking the optical period of the radiation as a time reference.
To this end, several types of single photon sensitive detectors may be used, such as Single Photon Avalanche Diodes (SPADs). In this regard, the histogram functionality is particularly useful for proximity sensors, e.g., of the SPAD type, for preparing precise timing information on the arrival of each individual photon resulting from optical light radiation.
Histogram use is a helpful feature for proximity sensors because histograms may be configured for complementing a closed circuit system, such as with proximity sensors, to operate as a TOF reading circuit coupled with a modulated light source and to provide additional information. In particular, this may allow detection of the presence of multiple objects.
However, the time resolution of histograms of SPAD proximity sensors is generally limited by the main internal clock having the highest frequency within the sensors. Histograms having a finer resolution may be prepared using specific high-frequency circuits, which are generally complex and costly in terms of silicon surface area.

SUMMARY

One example implementation provides for reusing the existing circuits of a proximity sensor to generate a series of histograms by iteratively performing a time shift of the optical light radiation emitted by the sensor. The obtained series of histograms may be processed to obtain a finer time granularity than that of the histogram series without any implementation of complex high-frequency circuits.
According to one aspect, a method is provided of preparing histograms of a sensor signal from a sensor array illuminated by an optical radiation resulting from the reflection on an object of a periodic initial optical radiation. The method may include a step (a) of preparing a first histogram from the emission of the initial optical radiation and including at least one processing performed at the rate of a clock signal having an internal period equal to a submultiple of the optical period, of the sensor signal and of a reference signal. Successive iterations of step (a) may then be performed with each iteration having a time shift of the initial optical radiation by a first fraction of the internal period, until at least one portion of the internal period is covered, to obtain an additional histogram at the conclusion of each iteration. The method may further include a numerical combination of the first histogram and additional histograms to obtain a final histogram possessing a finer time granularity than that of the first histogram.
Thus, the final histogram is obtained through producing successive histograms by shifting the optical pulse and through reconstruction by post-processing. This makes it possible to obtain finer and more precise additional information as a result of the final histogram, and without implementing complex high-frequency circuits.
According to one implementation, step (a) may further include multiple successive processings, performed at the rate of the clock signal, of the sensor signal and of the reference signal successively time shifted with respect to the initial optical signal until the entire optical period is covered. In one example embodiment, step (a) may further include:

- (a1) preparing a first portion of the first histogram from the emission of the initial optical radiation over an acquisition cycle including multiple optical periods, where the initial optical radiation begins at the same first instant within each optical period of the acquisition cycle, with the preparation including processing, at the rate of the clock signal, the sensor signal and the reference signal located at the same second instant within each optical period of the acquisition cycle;
- a2) repeating step (a1) with a time shift of the reference signal by an initial fraction of the optical period corresponding to a whole number of internal periods to obtain another portion of the first histogram;
- a3) repeating step (a2) until the entire optical period is covered and the first complete histogram is obtained.

The initial fraction of the optical period may correspond to two internal periods, for example. According to one example implementation, the numerical combination may include subtracting two consecutive histograms to obtain one differential histogram. In accordance with another example, the optical period may be equal to n times the internal period, and the first fraction may be equal to the internal period divided by n. By way of example, each sensor may be a proximity sensor.
According to another aspect, an electronic device is provided for recognizing movement of an object. The electronic device may include an emitter for emitting optical radiation based upon an optical period, a sensor array for receiving optical radiation reflected from an object based upon periodic initial optical radiation emitted by the emitter, with the sensor array configured to generate a sensor signal. A processor is configured to prepare a first histogram from the emission of the initial optical radiation and from at least one processing performed at the rate of a clock signal having an internal period equal to a submultiple of the optical period of the sensor signal and of a reference signal. A controller may be configured to iteratively activate the processor such that in each iteration a time shift of the initial optical radiation by a first fraction of the internal period is performed, until at least one portion of the internal period is covered, to thereby obtain an additional histogram at the conclusion of each iteration. Furthermore, a calculator may be configured to perform a numerical combination of the first histogram and additional histograms to obtain a final histogram possessing a finer time granularity than that of the first histogram.
According to one example embodiment, the processor may be configured to prepare the first histogram from the emission of the initial optical radiation and from multiple successive processings performed at the rate of the clock signal, with the sensor signal and of the reference signal successively time shifted with respect to the initial optical signal until the entire optical period is covered.
In accordance with one example, the processor may include a processing module configured to prepare a first portion of the first histogram from the emission of the initial optical radiation over an acquisition cycle including multiple optical periods. The initial optical radiation may begin at the same first instant within each optical period of the acquisition cycle. The preparation may include processing, at the rate of the clock signal, the sensor signal and the reference signal located at the same second instant within each optical period of the acquisition cycle. Moreover, the controller may be configured to reactivate the processing module with a time shift of the reference signal by an initial fraction of the optical period corresponding to a whole number of internal periods to obtain another portion of the first histogram, and then reactivate the processing module for performing repetitions of the time shift of the reference signal until the entire optical period is covered and the first complete histogram is obtained.
According to one embodiment, the initial fraction of the optical period may correspond to two internal periods. In accordance with another example, the numerical combination may include subtracting two consecutive histograms to obtain one differential histogram.
According to an example embodiment, the optical period may be equal to n times the internal period, and the first fraction may be equal to the internal period divided by n. By way of example, each sensor may be a proximity sensor.
According to yet another aspect, an electronic apparatus is provided (e.g., a tablet or cellular mobile telephone) incorporating a device as briefly described above.

BRIEF DESCRIPTION OF THE DRAWINGS

Other advantages and features will be understood with reference to the detailed description of non-limiting example embodiments, and the accompanying drawings, in which:

FIG. 1 is a block diagram of an electronic apparatus in accordance with an example embodiment;

FIG. 2 is a schematic block diagram of an example embodiment of the controller and processor of FIG. 1;

FIG. 3 is a timing diagram illustrating the preparation of a first histogram by the apparatus of FIG. 1 in accordance with an example embodiment;

FIG. 4 is a timing diagram illustrating the preparation of a second histogram by the apparatus of FIG. 1 in accordance with an example embodiment;

FIG. 5 is a timing diagram illustrating the preparation of subsequent histograms by time-shifting optical pulses by the apparatus of FIG. 1 in accordance with an example embodiment; and

FIG. 6 is a schematic diagram illustrating differential histogram calculation by the apparatus of FIG. 1 in accordance with an example embodiment.

DETAILED DESCRIPTION

Referring initially to FIG. 1, an electronic apparatus AE (e.g., a tablet, cellular mobile telephone, etc.) illustratively includes a device DRM for recognizing movement of an object OBJ, for example. The device DRM includes an emitter or emission means ME configured for emitting periodic optical radiation with an optical period PO. In order to obtain a short optical period PO, optical radiation of a high frequency is generally used. By way of non-limiting example, optical radiation may be used from a Vertical-Cavity Surface-Emitting Laser (VCSEL) diode. The frequency and phasing of the optical radiation may be controlled by a controller or control means MCOM of the DRM device, which will be described in more detail below.
When the device DRM is in operation, the emitter ME emits at least one periodic initial optical radiation SOI. If one or more objects OBJ are present in the initial optical radiation, the device DRM may receive reflected light radiation resulting from a reflection of the initial optical radiation on the object(s).
The device DRM further includes a sensor array MCAP that is illuminated by the optical radiation reflected from the object OBJ, or objects of the periodic initial optical radiation. Each sensor of the sensor array MCAP may receive the reflected optical radiation. In order to perform a time-correlated single photon count, the sensor array MCAP is configured for generating a sensor signal SCAP if at least one sensor in the sensor array MCAP receives an excitation of the optical radiation resulting from reflection.
As the sensor signal SCAP corresponds to individual time-correlated photons detected by the sensor array MCAP, multiple acquisition cycles each including numerous optical periods PO (e.g., one hundred thousand optical periods PO) are used. This is so that a histogram may be statistically prepared that is capable of representing the reflected optical radiation related to one optical period PO. The device DRM further illustratively includes a processor or processing means MT receiving the sensor signal SCAP and configured for preparing histograms of the sensor signal on these acquisition cycles.
Reference will now be made to FIG. 2 for illustrating in greater detail the controller and MCOM and the processor MT, additionally including a processing module MODT. The controller MCOM illustratively includes a multi-phase-locked loop (PLL) configured for delivering a first, [0] phase, clock signal CLK1, to a first time generator GEN1, and clock signals of different phases, e.g. phases [7:0], to a multiplexer MUX. The multiplexer MUX receives a phase selection signal SSPF and generates a second clock signal CLK2.
The controller MCOM further includes a second time generator GEN2 which receives the second clock signal CLK2 as an input, and is configured for delivering the successive optical pulses of the initial optical signal SOI within successive optical periods PO. According to the phase selected, the optical pulse may be more or less time shifted within the corresponding optical period.
The optical period PO is equal to n times the period PI of the clock signal CLK1. By way of example, n may be equal to 8.
The processing module MODT includes two flip-flops B1 and B2 respectively receiving the control signals SHC1 and SHC2, and they are timed by the first clock signal CLK1. A reference signal SR and a counting time window signal SFC are obtained respectively at their outputs, which are delivered to two logic gates PL1 and PL2 generate two signals SDFC1 and SDFC2 each corresponding to one counting time half-window.
The processing module MODT further illustratively includes two first counters CPT1 and CPT2 receiving the sensor signal SCAP and the two signals SDFC1 and SDFC2. The two first counters CPT1 and CPT2 are reset after each period of the signal CLK1 by a reset signal SREI, and two second counters CPT10 and CPT20, designated as “odd” and “even”. They are respectively connected in series to the two first counters CPT1 and CPT2 and configured for respectively constructing two counting values or signals termed “odd” and “even”. These “odd” and “even” signals are used for preparing histograms as described in more detail below.
Each counting time window signal SFC covers one portion of an optical period PO, here, for example, a quarter of an optical period or two periods PI. The reference signal SR is configured for beginning in the middle of the counting time window FC.
Consequently, the signals SDFC1 and SDFC2 delivered by the two logic gates PL1 and PL2 correspond respectively to the counting time half-window preceding the occurrence of the reference signal SR, and that following the occurrence of the reference signal SR. If the sensor signal SCAP arrives during the counting time half-window preceding the occurrence of the reference signal SR, the counter CPT1 is incremented and the counter CPT10 accumulates the pulses received during the acquisition cycle for generating an “odd” histogram class or “bin”.
By analogy, if the sensor signal SCAP arrives during the counting time half-window following the occurrence of the reference signal SR, the counter CPT2 is incremented and the counter CPT20 accumulates the pulses received during the acquisition cycle for generating an “even” histogram bin. The preparation of these two “odd” and “even” histogram bins forms a processing step Ei and leads, at the conclusion of an acquisition cycle, to the preparation of one portion Pi of a complete histogram.
Referring now to FIG. 3, preparation of a first histogram Histo1 from the emission of the initial optical radiation over four acquisition cycles is shown. In the first acquisition cycle, the optical pulse begins at the same first instant I1 within each optical period PO, here, for example, at the beginning of the optical period PO. The reference signal SR is located at the same second instant I2 within each optical period PO, here, for example, at the beginning of the second internal period PI, i.e., in the middle of the counting window FC.
At the conclusion of the processing step E1, a first portion P1 of the histogram Histo1 is obtained from the values of the counters CPT10 and CPT20. In the following acquisition cycle the controller MCOM is configured for reactivating the processing module MODT, this time with a time shift of the reference signal SR by an initial fraction FI of the optical period PO, here, for example, two internal periods PI, to obtain a second portion P2 of the first histogram Histo1. During each optical period PO, the instant I1 is not modified.
Then, the controller MCOM reactivates the processing module MODT twice in succession, each time repeating the time shift of the reference signal SR by the initial fraction FI of the optical period PO until the entire optical period PO is covered. Four steps E1 to E4 are therefore obtained corresponding to the four histogram portions P1 to P4. Thus, the first complete histogram Histo1 is obtained.
To obtain a finer time resolution than that of the first histogram Histo1, the controller MCOM is further configured for activating the processor to successively prepare additional histograms using, for each additional histogram, the processing steps E1 to E4 described above, but shifting the optical pulses by a fraction PF of the period PI. As the optical period PO may be equal to n times the period PI, the first fraction PF may be equal to the internal period PI divided by n, e.g. PI/8.
Preparation of a first additional histogram Histo2 during the acquisition cycles 5 to 8 with a first optical signal shifted the first fraction PF is shown in FIG. 4. Here, the beginning instant I10 of the optical pulse is constant during the four new acquisition cycles, but time shifted by one eighth of period PI with respect to the instant I1 is used for obtaining the histogram Histo1. During each of the acquisition cycles 5 to 8, two histogram bins are generated by processing step Ei, which forms one portion Pi of the first additional histogram Histo2.
Referring now to FIG. 5, new additional histograms are prepared by shifting each time for each additional histogram the beginning instant I20, I30, . . . , I70 of the optical pulse in the course of the optical period, by one eighth of period PI with respect to the beginning instant I10, I20, corresponding to the preceding histogram. Although this is optional, these successive shifts may be performed until a complete period PI is covered to obtain the additional histograms Histo2 to Histo8.
In addition, the device DRM illustratively includes a calculator or calculation means MCAL configured for performing a numerical combination of the first histogram Histo1 and additional histograms Histo1 to Histo8. This numerical combination may include a subtraction of two consecutive histograms so as to obtain one differential histogram HistoF (FIG. 6).
By way of example, the calculator MCAL may first perform a subtraction of histograms Histo1 and Histo2, e.g., Histo1-Histo2. The results of this subtraction form de facto a first series of shifted bins of the final histogram HistoF.
More particularly, the result of the subtraction, e.g., of the first bins C1_1 and C2_1 of the histograms Histo1 and Histo2, forms the first bin CF_1 of the final histogram HistoF. The result of the subtraction of the second bins C1_2 and C2_2 of the histograms Histo1 and Histo2 on the other hand forms the ninth bin CF_9 of the final histogram HistoF. The following formula may be used for better illustrating the numerical combination:
CX_Y−C(X+1)_Y=CF_(X+(Y−1)*n),
where X is the histogram order number, Y is the bin order number, and n is the granularity coefficient corresponding to the first fraction PF defined above.
It should be noted that the numerical combination is iterative. More particularly, the eighth bin of the final histogram HistoF may be calculated according to the following formula:
CF_8=C8_1−C1_2.
The sixteenth bin of the final histogram HistoF is calculated as below:
CF_16=C8_2−C1_3.
The sixty-fourth bin of the final histogram HistoF is calculated according to the following formula:
CF_64=C8_8−C1_1.
It may be seen that the final histogram HistoF has 64 histogram bins instead of 8 bins in the case of the first histogram Histo1. Thus, a final differential histogram HistoF is obtained having a finer time granularity than that of the first histogram Histo1 without implementing conventional complex high-frequency circuits.
Variations of the implementations and embodiments described above may be used in different embodiments. Thus, although a preparation of the first histogram H1 from multiple successive processings has been described, a system may also be used that is capable of generating this first histogram in one iteration (a single processing) with an implementation in which there are as many counters as bins.

Claims

1-15. (canceled)

16. A histogram generation method using a sensor array providing a sensor signal based upon optical radiation from an emitter reflected off of an object, the emitter emitting the optical radiation based upon an optical period, the method comprising:

(a) generating a first histogram by processing the sensor signal and a reference signal based upon a clock signal having an internal period equal to a submultiple of the optical period;

(b) iteratively performing step (a) with each iteration having the optical signal time-shifted by a first fraction of the internal period for at least one portion of the internal period to obtain at least one second histogram; and

(c) combining the first histogram and the at least one second histogram to obtain a final histogram having a finer time granularity than the first histogram.

17. The method of claim 16 wherein step (a) further comprises successively processing the sensor signal over the entire optical period using successive time shifts with respect to an initial optical emission.

18. The method of claim 17 wherein step (a) further comprises a step (a1) comprising:

generating a first portion of the first histogram from the initial optical emission over an acquisition cycle comprising multiple optical periods;

wherein the initial optical emission begins at a first instant within each optical period of the acquisition cycle;

wherein generating the first portion comprises processing, based upon the clock signal, the sensor signal and the reference signal at a second instant within each optical period of the acquisition cycle.

19. The method of claim 18 wherein step (a) further comprises a step (a2) comprising repeating step (a1) while time-shifting the reference signal by an initial fraction of the optical period corresponding to a whole number of internal periods to obtain another portion of the first histogram.

20. The method of claim 19 wherein step (a) further comprises a step (a3) comprising repeating step (a2) for the entire optical period until the first histogram is completed.

21. The method of claim 19 wherein the initial fraction of the optical period corresponds to two internal periods.

22. The method of claim 16 wherein step (c) further comprises subtracting consecutive histograms to generate the final histogram.

23. The method of claim 16 wherein the optical period is equal to n times the internal period, and the first fraction is equal to the internal period divided by n.

24. The method of claim 16 wherein the sensor array comprises a proximity sensor array.

25. An electronic device comprising:

an emitter to emit optical radiation based upon an optical period;

a sensor array providing a sensor signal based upon optical radiation from the emitter reflected off of an object;

a processor to generate a first histogram by processing the sensor signal and a reference signal based upon a clock signal having an internal period equal to a submultiple of the optical period;

a controller to control the processor to iteratively perform histogram generation with each iteration having the optical signal time-shifted by a first fraction of the internal period for at least one portion of the internal period to obtain at least one second histogram; and

a calculator to combine the first histogram and the at least one second histogram to obtain a final histogram having a finer time granularity than the first histogram.

26. The electronic device of claim 25 wherein said processor successively processes the sensor signal over the entire optical period using successive time shifts with respect to an initial optical emission.

27. The electronic device of claim 26 wherein said processor generates a first portion of the first histogram from the initial optical emission over an acquisition cycle comprising multiple optical periods;

wherein said processor generates the first portion by processing, based upon the clock signal, the sensor signal and the reference signal at a second instant within each optical period of the acquisition cycle.

28. The electronic device of claim 27 wherein said controller reactivates said processor to repeat generating the first portion while time-shifting the reference signal by an initial fraction of the optical period corresponding to a whole number of internal periods to obtain another portion of the first histogram over the entire optical period until the first histogram is complete.

29. The electronic device of claim 28 wherein the initial fraction of the optical period corresponds to two internal periods.

30. The electronic device of claim 28 wherein said calculator subtracts consecutive histograms to generate the final histogram.

31. The electronic device of claim 28 wherein the optical period is equal to n times the internal period, and the first fraction is equal to the internal period divided by n.

32. The electronic device of claim 28 wherein said sensor array comprises a proximity sensor array.

33. A mobile electronic device comprising:

a housing; and

an electronic device carried by said housing and comprising

an emitter to emit optical radiation based upon an optical period,

a sensor array providing a sensor signal based upon optical radiation from the emitter reflected off of an object,

a processor to generate a first histogram by processing the sensor signal and a reference signal based upon a clock signal having an internal period equal to a submultiple of the optical period,

a controller to control the processor to iteratively perform histogram generation with each iteration having the optical signal time-shifted by a first fraction of the internal period for at least one portion of the internal period to obtain at least one second histogram, and

34. The mobile electronic device of claim 33 wherein said processor successively processes the sensor signal over the entire optical period using successive time shifts with respect to an initial optical emission.

35. The mobile electronic device of claim 34 wherein said processor generates a first portion of the first histogram from the initial optical emission over an acquisition cycle comprising multiple optical periods;

36. The mobile electronic device of claim 35 wherein said controller reactivates said processor to repeat generating the first portion while time-shifting the reference signal by an initial fraction of the optical period corresponding to a whole number of internal periods to obtain another portion of the first histogram over the entire optical period until the first histogram is complete.

37. The mobile electronic device of claim 33 wherein said sensor array comprises a proximity sensor array.