WO2016049189A1 - Background light detection for optical navigation systems - Google Patents

Background light detection for optical navigation systems Download PDF

Info

Publication number
WO2016049189A1
WO2016049189A1 PCT/US2015/051727 US2015051727W WO2016049189A1 WO 2016049189 A1 WO2016049189 A1 WO 2016049189A1 US 2015051727 W US2015051727 W US 2015051727W WO 2016049189 A1 WO2016049189 A1 WO 2016049189A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
light source
signals
ons
signal samples
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2015/051727
Other languages
French (fr)
Inventor
John Frame
Jing MU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cypress Semiconductor Corp
Original Assignee
Cypress Semiconductor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cypress Semiconductor Corp filed Critical Cypress Semiconductor Corp
Priority to DE112015004407.8T priority Critical patent/DE112015004407T5/en
Publication of WO2016049189A1 publication Critical patent/WO2016049189A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231Monitoring the presence, absence or movement of users
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3262Power saving in digitizer or tablet
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547Touch pads, in which fingers can move on a surface
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • G06F3/04186Touch location disambiguation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04106Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • the present disclosure relates generally to the field of optical navigation systems, and more particularly to optical finger navigation systems and methods of operation therefor to distinguish external background light for improved navigation surface detection and motion tracking.
  • OFN optical finger navigation
  • Optical finger navigation (OFN) modules or systems make use of optical physics to measure the degree of the relative motion, in both speed and magnitude, between a navigation device and the navigation/tracking surface.
  • OFN systems find their major application in pointing and finger tracking devices and are becoming increasingly common in data processing systems, such as cellular telephones, tablet computers, electronic readers, control pad/console in automobiles and portable entertainment or game systems for data input and/or cursor movement.
  • OFN systems in general include optical navigation sensors (ONS), which generally include a light source to illuminate a tracking surface, such as a finger or stylus in contact with a surface of the OFN system, and an optical sensor, such as a charge-coupled device (CCD), complementary metal-oxide-semiconductor (CMOS) imaging array, or a photo-diode array, or a photo-detector array, to capture an image or signal in light reflected and/or scattered from the tracking surface.
  • CMOS complementary metal-oxide-semiconductor
  • a tracking program implemented in a single or multiple processor(s) coupled to the sensor analyzes successive images or signals to determine displacement of the OFN system relative to the tracking surface.
  • One of the problems with existing OFN systems is that the ONS, in particular the optical sensors, may not differentiate between light reflected or scattered off a finger or stylus and environmental or ambient light. Strong and variable ambient light can cause spurious detected motions known as auto-movements or light-induced motion. Sunlight is a particular problem especially for OFN systems installed in vehicles, and manufacturers usually require that the OFN systems pass strict sunlight tests with specified range of light intensity conditions, test time, test angle, and orientations relative to sunlight.
  • FIG. 1 is a representative diagram illustrating a schematic view of a portion of an optical finger navigation (OFN) system associated with a method for sensing a tracking surface;
  • OFFN optical finger navigation
  • FIG. 2 is a representative diagram illustrating a schematic view of a portion of an OFN system in the presence of background light
  • FIG. 3 is a representative diagram illustrating a schematic view of a portion of an optical finger navigation (OFN) system in the presence of background light and a moving light blocker;
  • OFFN optical finger navigation
  • FIG. 4 is a representative diagram illustrating a schematic view of a portion of an optical finger navigation (OFN) system associated with a method for sensing a tracking surface in the presence of background light and a moving light blocker;
  • OFN optical finger navigation
  • FIG. 5 is a representative block diagram of an OFN system associated with the embodiments shown in FIGS. 1 to 4;
  • FIGS. 6 to 8 are flowcharts illustrating embodiments of a method for sensing a tracking surface with an OFN system associated with the embodiments shown in FIGS. 1 to 4;
  • FIG. 9 is a representative diagram illustrating a schematic view of a portion of an alternative embodiment of an OFN system associated with a method for sensing a tracking surface.
  • a method of operating an ONS includes the steps of disabling and enabling a light source in an optical navigation sensor (ONS) periodically, sampling, from an optical detector of the ONS, a first plurality of signals during a first time period and a second plurality of signals during a second time period, comparing at least one of the first plurality of signals to a threshold value, and if the at least one of the first plurality of signals is greater than the threshold value, suppressing reporting of the second plurality of signals to avoid false detection and auto-movement in an output of the ONS.
  • FIG. 1 is a representative view of a portion of an optical finger navigation (OFN) system 50 associated with a method for sensing a tracking surface.
  • optical navigation sensor includes light source 102 and detector 108 to detect the presence and/or track motion of a tracking surface 106, typically user's finger 104 or a stylus.
  • an upward-facing light source 102 which may be controlled by processing element(s) such as a microcontroller, a processor or a sensor (not shown), directs light beams 112 upwardly and towards top panel 110.
  • processing element(s) such as a microcontroller, a processor or a sensor (not shown)
  • common light sources include but not limited to light emitting diodes (LED) and lasers such as infrared lasers.
  • top panel 110 is made of durable materials which are optically transparent to the wavelength of electromagnetic radiation from light source 102 and background light source 52, such as but not limited to glass or poly(methyl methacrylate) (PMMA).
  • top panel 110 is the top panel of housing or an enclosure (not shown) for OFN system 50. As shown in FIG. 1, when tracking surface 106 is placed in close contact with and onto top panel 110, a portion of light beams 112 illuminates tracking surface 106.
  • a part of light beams 112 is absorbed, and some of it gets scattered and reflected off as reflected/scattered light 114.
  • the degree or the percentage of light absorption, reflection, and scattering depends on both the wavelength of light beams 112 and the characteristics of tracking surface 106. The portion of light beams 112 that gets absorbed and escapes through top panel 110 is practically lost, while reflected/scattered light 114 can be gathered, captured and processed in order to extract certain amount of useful information, such as presence and movement of tracking surface 106 relative to OFN system 50.
  • optical detector 108 a portion of light scattered or reflected 114 off tracking surfacel06 is incident upon optical detector 108.
  • a photodiode array and/or CMOS imaging array and/or other photosensors that are known in the art is a fundamental part of any optical sensor or detector 108.
  • optical detector 108 is facing upward to receive reflected/scattered light 114.
  • the dimensions, type, arrangement and orientation of optical detector 108 depend on detection and processing technique adopted and usually varies from ONS to ONS.
  • each optical detector 108 consists of several small scaled photodiodes (pixels) which define the resolution and in general, more pixels provide a higher resolution of sensed/captured images.
  • optical detector 108 may be configured based on either the reflection based method, the scattering based method, or a combination thereof, or other detection techniques that are known in the art.
  • optical detector 108 may capture reflected/scattered light 114 in the form of images of tracking surface 106.
  • optical detector 108 may generate electrical signals based on the intensity or irradiance of images captured of reflected/scattered light 114.
  • optical detector 108 may also sample the shape, image, or other properties of reflected/scattered light 114. In one embodiment, additionally or alternatively, depending on the detection and processing technologies, optical detector 108 may generate electrical signals based on other properties, such as wavelength, spatial frequency/phase, shape of captured images based on reflected/scattered light 114. An image captured from reflected/scattered light 114 may contain different spatial frequencies, which are generated based on the microscopic textural of tracking surface 106 or a signature of tracking surface 106. In one embodiment, irrespective of the detection methods, the generated signals are processed using image correlation processing to determine x/y-axis motion of tracking surface 106 relative to optical detector 108.
  • the generated signals are processed using phase/spatial frequency processing wherein any change in the phase/spatial frequency implies that tracking surface 106 may be moving relatively to optical detector 108 or have changed their relative positions.
  • the amount of phase/frequency shift gives information about the direction and magnitude of motion.
  • sampling data may be processed by a microcontroller(s), processor(s) (not shown), and/or output/report to another device via a suitable communication protocol (not shown) to determine presence and motion of tracking surface 106.
  • FIG. 2 is a representative view of a portion of an optical finger navigation (OFN) system 50 showing the effect of background light source 52 when tracking surface 106 is absent.
  • background/external light source 52 provides background/external light 120, such as sunlight and in general light coming from the outside of the OFN system.
  • background light 120 may be incident on optical detector 108 through the transparent top panel 110 with certain intensity and/or image.
  • optical detector 108 since optical detector 108 may not be able to distinguish background light 120 from reflected/scattered light 114 based on images captured, it may generate and report sampling data which falsely indicates presence of tracking surface 106.
  • OFN system 50 may also incorrectly detect and report motion of tracking surface 106. Both of these potential failures - false surface detection and light-induced motion are observed, and limit the usefulness of ONS in environments that have strong background light 120.
  • FIG. 3 is a representative view of a portion of OFN system 50 showing the effect of potentially moving background light source 52.
  • background light source 52 being natural, such as sunlight, or artificial
  • background light 120' may change and/or move over time.
  • the change may manifest in intensity, wavelength, frequency, incident angle, shape, movement, spatial frequency/phase and combinations thereof.
  • One possible cause of such change is when a fixed light source 52 is blocked by moving light blocker 54 that blocks background light 120' at least partially in a dynamic manner between background light source 52 and optical detector 108, as illustrated in FIG. 3.
  • OFN system 50 may be a part of a control console or an input system inside a moving vehicle.
  • the background sunlight 120' that is incident on optical detector 108 is being intermittently or periodically blocked by a row of trees or buildings.
  • optical detector 108 may detect a dynamically changing light pattern both in terms of intensity and image in response to moving background light 120'.
  • the changing light pattern may be interpreted as motion of tracking surface 106 which may be false, or at least not accurate. Consequently, ONS of OFN system 50 may erroneously report presence and/or motion of tracking surface 106 which may not be present.
  • FIG. 4 is a representative view of a portion of OFN system 50 showing the effect of potentially changing/moving background light source 52 when tracking surface 106 is present.
  • dynamic background light 120' is present along with tracking surface 106, which presence and movement is to be sensed and reported.
  • a portion of moving background light 102' may still leak around tracking subject 104 and is incident on optical detector 108, as previously described in FIG. 3.
  • optical detector 108 since light source 102 is switched on/enabled in the presence of tracking surface 106, there is significant amount of reflected/scattered light 114 incident on optical detector 108
  • optical detector 108 light incident on optical detector 108 is a combination of the valid/desired reflected/scattered light 114 responding to presence/movement of tracking surface 106 and the invalid/unde sired moving background light 120'.
  • the detected presence/motion data of tracking surface 106 may be corrupted depending on the sensing technology of optical detector 108 and the relative intensity of moving background light 120'.
  • ONS may properly report presence of tracking surface 106, but may incorrectly or inaccurately report movement of tracking surface 106.
  • the false surface detection and light-induced motion reporting may be mitigated by incorporating light-blocking baffles (not shown) to OFN system 50, in an attempt to block background light 120, so that only light (preferably reflected from a tracking surface) from a particular angle or location would propagate upon optical detector 108.
  • light-blocking baffles not shown
  • baffles may not completely block background light 120 because a portion of background light 120 may still be able to leak around tracking surface 106 or blocking baffles and inevitably transmitted through top panel 110 of OFN system 50. Also, if tracking surface 106 is not present, background light 120 may pass through without being blocked.
  • static and dynamic data about the detected light is collected, and is subsequently compared to signatures that tend to be correlated with captured images of background light 120.
  • only limited data static and dynamic data is available from optical detector 108 or sensor circuit, and the determination of background light 120 vs. desired reflected/scattered light 114 may be only partially effective. Occasionally background light 120 may be treated as desired reflected/scattered light 114, and vice-versa.
  • a capacitive sensing element may be incorporated around or close or adjacent to OFN system 50, and use capacitive sense detector to initiate surface tracking only if the capacitive sense detector has determined presence of a tracking surface 106, such as a finger.
  • the capacitive sensing incorporated embodiment may require additional mechanical structure for capacitive sensing, complicates industrial design and increases cost. It may fail when tracking surface 106 is only in contact of the capacitive sense element but does not cover an effective optical tracking area of OFN system 50.
  • FIG. 5 illustrates a schematic block diagram showing a portion of OFN system 50 according to one embodiment of the subject matter.
  • the static and dynamic characteristics of reflected/scattered light 114 are typically collected and used by OFN system 50 to report two things: (1) The presence or absence of tracking surface 106, and (2) the distance that the tracking surface 106 has moved relative to the OFN system 50.
  • OFN system 50 includes light source 102, such as, but not limited to, an LED or a laser diode such as VCSEL diode, optical detector 108, microcontroller 100 and communication interface 150, such as, but not limited to, a serial peripheral interface (SPI), an inter-integrated circuit (I 2 C), a universal serial bus (USB), may be mounted on a substrate or printed circuit board.
  • OFN system 50 may be an integrated or embedded system such as a System on Chip (SoC) implementation.
  • SoC System on Chip
  • the SoC implementation enables multiple resources on a single chip, some of these resources can be firmware implementations only, while others can be available as application-specific integrated circuits (ASICs) within the chip, or combinations thereof.
  • OFN system 50 is not an embedded system, includes one or more ICs or discrete components packaged within a common multi-chip module (MCM) or package, or can be separately mounted to a printed circuit board.
  • MCM multi-chip module
  • microcontroller 100 may perform tasks of a digital signal processor (DSP) as it receives sampled optical data signal from optical detector 108 in the form of a matrix and performs data analysis.
  • DSP digital signal processor
  • Microcontroller 100 is a processing element or a combination of multiple processing elements that may include multiple processor(s) and storage elements, such as RAM, EEPROM, ROM, etc., with firmware and/or software embodied on for operating OFN system 50 and other related circuits/modules.
  • Different OFN systems may use different processing techniques, such as the above-mentioned image correlation processing or phase/spatial frequency processing, depending upon the system's requirements.
  • OFN system 50 is usually a part of a higher level system, and needs to
  • OFN system 50 requires support for communication interface 150.
  • OFN system 50 may be a part of a control console of a vehicle that needs to communicate with a higher level control system, which in turn controls other functions, such as A/C system, car window control system, etc., of the vehicle.
  • microcontroller 100 may include front-end circuitry for coupling signals out from optical detector 108, signal processing and interface circuitry for translating changes in light pattern of reflected/scattered light 114 and/or background light 120 propagated onto optical detector 108 into motion data, and a programmable controller to control operation of light source 102 and optical detector 108.
  • microcontroller 100 includes a programmable switching function module which disables light source 102 (light-off or reduced period) so that data
  • the switching function may be implemented in hardware, such as switching off or reduce the power to the light source 102 with a transmission gate or a switch, software, such as reprogramming the output level of light source 102, or mechanical, such as a movable physical light barrier blocking the output of light source 102, or combinations thereof.
  • enabling and disabling light source 102 may mean switching it on and off completely.
  • enabling and disabling light source 102 may include maintaining output level of light source 102 at a high and low level, respectively.
  • light source 102 may be either switched off completely, or reduced in intensity to a predetermined level for the aforementioned purposes.
  • light source 102 switching function module is synchronized to the operation timing of optical detector 108 by configuring the sampling frequency of optical data. Consequently, microcontroller 100 may sample data from optical detector 108 while light source 102 is disabled.
  • the synchronization between switching function and sampling function may be implemented by microcontroller 100 with firmware that controls light source 102 and optical detector 108, respectively.
  • light source 102 is briefly disabled according to a synchronized time schedule controlled by microcontroller 100. While light source 102 is disabled, microcontroller 100 may sample data from optical detector 108, also according to the synchronized schedule. The sampled light-off data is further processed, analyzed, and stored in microcontroller 100. At the completion of the light-off data sampling interval, light source 102 is enabled (light-on period), and light-on data may be sampled and subsequently coupled to microcontroller 100. The sampled light-off data is then compared to threshold value(s) to determine if background light is present, or at least reaches a level that it may compromise the light-on data.
  • sampled light-off data exceeds or equals to or is within a close range of the threshold value, then a background light situation is determined, and microcontroller 100 is programmed not to report tracking surface 106 presence regardless of the value of the sampled light-on data.
  • sampled data may correspond to, depending on the detection and processing technologies adopted, image captured of reflected/scattered light 114 and/or background light 120 incident on optical detector 108.
  • threshold value(s) may be predetermined and stored at microcontroller 100, or programmable by a higher level system (not shown), or adaptable to operational sensing parameters.
  • light source 102 is also briefly disabled while light-off data is being sampled according to a same synchronized schedule controlled by microcontroller 100. Similar to the presence detection, light-off data sampling is interspersed with light-on data sampling whereas light source 102 is enabled by microcontroller 100. In one embodiment, if the sampled light-off data exceeds the threshold value, microcontroller 100 does not report either motion or presence of tracking surface 106 irrespective of the value of the sampled light-on data.
  • FIGS. 6 to 8 are flowcharts illustrating embodiments of a method for sensing and reporting tracking surface 106 with OFN system 50 associated with the embodiments shown in FIGS. 1 to 4.
  • OFN system 50 may adopt the method for tracking surface 106 detection only, or for tracking surface 106 motion reporting only, or adopt the method for both.
  • OFN system 50 may be configured to sense and determine only presence of background light 120 without mitigation action. In one embodiment, the presence of background light 120 is reported but no steps may be taken to mitigate the potential effects.
  • light source 102 is first disabled in step 302, hence only background light 120 (if present) incident upon optical detector 108 (light- off data) is sensed, sampled, measured and processed in microcontroller 100 in step 304. Then, light source 102 is enabled and light-on data is sampled in step 306. In step 308, data sampled during the light-off period is compared to a threshold value or values. If the light-off data exceeds the threshold value(s), the subsequently sampled light-on data will not be reported as it is determined, by the microcontroller 100 or outside systems (not shown), that background light is present.
  • microcontroller 100 will report data sampled during light-on period to determine if tracking surface 106 is present and/or moving.
  • OFN system 50 is configured to sample light-off data with the purpose of suppressing false surface detection and false motion reporting due to background light 120.
  • background light 120 is determined absent, there may be missing motion data during the light-off period as optical detector 108 may fail to sense any reflected/scattered light 114, resulting in missing tracking surface 106 motion data.
  • microcontroller 100 may be configured to artificially substitute lost motion data by interpolating between the sampled light-on data occurring before and after the light-off period.
  • microcontroller 100 may adopt other methods of estimating the amount of lost motion, such as considering the duration of light-off period.
  • Other estimation techniques such as interpolation and averaging may be used, along with calculated estimates of tracking surface 106 motion data and acceleration of said motion.
  • light-on and light-off data is sampled in separate time periods, according to the switching schedule of light source 102 and sampling schedule of optical detector 108.
  • OFN system 50 is subjected to changing background light 120'conditions, such as the embodiment illustrated in FIG. 3, there may be occasions that sampled light-off data only dips below the threshold value because background light 120' is blocked coincidentally during at least a portion of the light-off sampling period.
  • the background light 120' may then be unblocked during the light-on period and compromise the sampled light-on data.
  • microcontroller 100 may mistakenly conclude absence of background light 120' and report the compromised light-on data samples that may lead to light-induced motion detection. Referring to FIG.
  • step 408 if background light 120' is concluded absent during the light-off sampling period but returns during light-on sampling period, microcontroller 100 may fail to determine the presence of background light 120'. To prevent this, the microcontroller 100 may be configured to debounce the sampled light-off signal data before making a final determination regarding the presence of background light 120'. In one embodiment, in step 422, microcontroller 100 may sample data from optical detector 108 for a pre-determined number of times, either during a single light-off period or multiple light-off periods.
  • Microcontroller 100 is configured to compare multiple light-off data samples to the threshold value(s) in order to determine that there truly is no background light 120' before reporting the sampled light-on data. Alternatively, microcontroller 100 may generate an average value of multiple sampled light-off data over a predetermined averaging period, compare the average value to a predetermined value and only determine a no background light 120' condition if the average light value is below the predetermined value, such as the threshold value. Regardless of the approach, once the final determination is made, microcontroller 100 will report or not report the sampled light-on data as previously described in FIG. 6. In one embodiment, the average value and debouncing step are reset in step 420 after the final determination is made.
  • background light 120' may move or change periodically, at least for a duration of time.
  • the periodicity of change of background light 120' may be at least temporarily synchronous with the on-off operation schedule of light source 102.
  • background light 120' may be blocked every time when light source 102 is disabled. In those cases, using the debouncing and averaging approach as described in steps 420 and 422 may not mitigate a false final
  • the periodicity of optical detector 108 sampling may be jittered. For example, instead of operating at a fixed timing schedule, the light-off data sampling may occur at random or pseudo-random intervals and/or for random durations. Alternatively or additionally, referring to FIG. 8, a random delay as in step 530 may be incorporated before the light-off data sampling (steps 502 and 504) such that the periodic moving/changing background light 120' may be out of phase with the light- off data sampling timing.
  • background light detector 116 which is dedicated to detecting background light 120 may be incorporated to OFN system 600.
  • optical data from background light detector 116 is only sampled when light source 102 is disabled/switched off.
  • the concept of optical sensing during a switching-off period of light (EM radiation) source may be adapted to infrared proximity detection modules, such as the modules used in cellular phones or tablets. It may also improve performance of infrared proximity sensors by reducing occurrence of false detection.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Photometry And Measurement Of Optical Pulse Characteristics (AREA)

Abstract

A method of operating an optical navigation system which includes disabling a light source to measure the ambient or external light level, comparing the measurement to a threshold level to determine whether the ambient light would cause false detection and light induced motion, and adjusting sensing parameter(s) to mitigate the effect of the ambient light.

Description

BACKGROUND LIGHT DETECTION FOR OPTICAL NAVIGATION SYSTEMS
PRIORITY
[0001] This application is an International Application of U.S. Patent Application No. 14/858,217, filed September 18, 2015, which claims the benefit of U.S. Provisional Application No. 62/055,803, filed on September 26, 2014, both of which are incorporated by reference herein in their entirety.
TECHNICAL FIELD
[0002] The present disclosure relates generally to the field of optical navigation systems, and more particularly to optical finger navigation systems and methods of operation therefor to distinguish external background light for improved navigation surface detection and motion tracking.
BACKGROUND
[0003] Optical finger navigation (OFN) modules or systems make use of optical physics to measure the degree of the relative motion, in both speed and magnitude, between a navigation device and the navigation/tracking surface. These OFN systems find their major application in pointing and finger tracking devices and are becoming increasingly common in data processing systems, such as cellular telephones, tablet computers, electronic readers, control pad/console in automobiles and portable entertainment or game systems for data input and/or cursor movement. OFN systems in general include optical navigation sensors (ONS), which generally include a light source to illuminate a tracking surface, such as a finger or stylus in contact with a surface of the OFN system, and an optical sensor, such as a charge-coupled device (CCD), complementary metal-oxide-semiconductor (CMOS) imaging array, or a photo-diode array, or a photo-detector array, to capture an image or signal in light reflected and/or scattered from the tracking surface. A tracking program implemented in a single or multiple processor(s) coupled to the sensor analyzes successive images or signals to determine displacement of the OFN system relative to the tracking surface.
[0004] One of the problems with existing OFN systems is that the ONS, in particular the optical sensors, may not differentiate between light reflected or scattered off a finger or stylus and environmental or ambient light. Strong and variable ambient light can cause spurious detected motions known as auto-movements or light-induced motion. Sunlight is a particular problem especially for OFN systems installed in vehicles, and manufacturers usually require that the OFN systems pass strict sunlight tests with specified range of light intensity conditions, test time, test angle, and orientations relative to sunlight.
BRIEF DESCRIPTION OF THE DRAWINGS
[0005] The present disclosure is illustrated by way of example, and not by way of limitation, in the FIGS, of the accompanying drawings.
[0006] FIG. 1 is a representative diagram illustrating a schematic view of a portion of an optical finger navigation (OFN) system associated with a method for sensing a tracking surface;
[0007] FIG. 2 is a representative diagram illustrating a schematic view of a portion of an OFN system in the presence of background light;
[0008] FIG. 3 is a representative diagram illustrating a schematic view of a portion of an optical finger navigation (OFN) system in the presence of background light and a moving light blocker;
[0009] FIG. 4 is a representative diagram illustrating a schematic view of a portion of an optical finger navigation (OFN) system associated with a method for sensing a tracking surface in the presence of background light and a moving light blocker;
[0010] FIG. 5 is a representative block diagram of an OFN system associated with the embodiments shown in FIGS. 1 to 4;
[0011] FIGS. 6 to 8 are flowcharts illustrating embodiments of a method for sensing a tracking surface with an OFN system associated with the embodiments shown in FIGS. 1 to 4; and
[0012] FIG. 9 is a representative diagram illustrating a schematic view of a portion of an alternative embodiment of an OFN system associated with a method for sensing a tracking surface.
///
/// DETAILED DESCRIPTION
[0013] The following description sets forth numerous specific details such as examples of specific systems, components, methods, and so forth, in order to provide a good understanding of several embodiments of the subject matter. It will be apparent to one skilled in the art, however, that at least some embodiments may be practiced without these specific details. In other instances, well-known components or methods are not described in detail or are presented in a simple block diagram format in order to avoid unnecessarily obscuring the techniques described herein. Thus, the specific details set forth hereinafter are merely exemplary. Particular implementations may vary from these exemplary details and still be contemplated to be within the spirit and scope of the embodiments.
[0014] Embodiments of the optical finger navigation (OFN) system and optical navigation sensor (ONS), and methods of operating the same to at least mitigate incidents of false surface detection and inaccurate tracking of movement due to the presence of background light will now be described with reference to the accompanying drawings. The drawings described are only schematic and are non-limiting. In the drawings, the size of some of the elements may be exaggerated and not drawn to scale for illustrative purposes. The dimensions and the relative dimensions may not correspond to actual reductions to practice of the embodiments. For purposes of clarity, many details of input devices and methods of operation in general, and optical navigation sensors (ONS) and optical finger navigation (OFN) systems in particular, which are widely known and not relevant to the present apparatus and method have been omitted from the following description.
[0015] Summary: [0016] According to one embodiment, a method of operating an ONS includes the steps of disabling and enabling a light source in an optical navigation sensor (ONS) periodically, sampling, from an optical detector of the ONS, a first plurality of signals during a first time period and a second plurality of signals during a second time period, comparing at least one of the first plurality of signals to a threshold value, and if the at least one of the first plurality of signals is greater than the threshold value, suppressing reporting of the second plurality of signals to avoid false detection and auto-movement in an output of the ONS. Details of the embodiment and other embodiments will be explained in the following paragraphs.
[0017] FIG. 1 is a representative view of a portion of an optical finger navigation (OFN) system 50 associated with a method for sensing a tracking surface. In one embodiment, optical navigation sensor (ONS) includes light source 102 and detector 108 to detect the presence and/or track motion of a tracking surface 106, typically user's finger 104 or a stylus. As shown in FIG. 1, an upward-facing light source 102, which may be controlled by processing element(s) such as a microcontroller, a processor or a sensor (not shown), directs light beams 112 upwardly and towards top panel 110. In one embodiment, common light sources include but not limited to light emitting diodes (LED) and lasers such as infrared lasers. Laser sources have the advantage of high resolution and can be used on a wide variety of surfaces, including ones that are only moderately reflective. Although LEDs may be more susceptible to external vibrations and ambient light noise, they offer an ease of implementation in applications where high resolution may not be essential and also not required to meet any eye safety standards. In one embodiment, top panel 110 is made of durable materials which are optically transparent to the wavelength of electromagnetic radiation from light source 102 and background light source 52, such as but not limited to glass or poly(methyl methacrylate) (PMMA). In some embodiments, top panel 110 is the top panel of housing or an enclosure (not shown) for OFN system 50. As shown in FIG. 1, when tracking surface 106 is placed in close contact with and onto top panel 110, a portion of light beams 112 illuminates tracking surface 106. In one embodiment, a part of light beams 112 is absorbed, and some of it gets scattered and reflected off as reflected/scattered light 114. In one embodiment, the degree or the percentage of light absorption, reflection, and scattering depends on both the wavelength of light beams 112 and the characteristics of tracking surface 106. The portion of light beams 112 that gets absorbed and escapes through top panel 110 is practically lost, while reflected/scattered light 114 can be gathered, captured and processed in order to extract certain amount of useful information, such as presence and movement of tracking surface 106 relative to OFN system 50.
[0018] Referring to FIG. 1, a portion of light scattered or reflected 114 off tracking surfacel06 is incident upon optical detector 108. In one embodiment, irrespective of light source 102 type (lasers such as vertical-cavity surface-emitting lasers (VCSEL), or LED or others) used, a photodiode array and/or CMOS imaging array and/or other photosensors that are known in the art is a fundamental part of any optical sensor or detector 108. As shown in FIG. 1, in one embodiment, optical detector 108 is facing upward to receive reflected/scattered light 114. As practiced by one having ordinary skill in the art, the dimensions, type, arrangement and orientation of optical detector 108 depend on detection and processing technique adopted and usually varies from ONS to ONS. In one embodiment, each optical detector 108 consists of several small scaled photodiodes (pixels) which define the resolution and in general, more pixels provide a higher resolution of sensed/captured images. In one embodiment, optical detector 108 may be configured based on either the reflection based method, the scattering based method, or a combination thereof, or other detection techniques that are known in the art. When reflected/scattered light 114 is incident on optical detector 108, optical detector 108 may capture reflected/scattered light 114 in the form of images of tracking surface 106. In one embodiment, optical detector 108 may generate electrical signals based on the intensity or irradiance of images captured of reflected/scattered light 114. In one embodiment, depending on the technology used, optical detector 108 may also sample the shape, image, or other properties of reflected/scattered light 114. In one embodiment, additionally or alternatively, depending on the detection and processing technologies, optical detector 108 may generate electrical signals based on other properties, such as wavelength, spatial frequency/phase, shape of captured images based on reflected/scattered light 114. An image captured from reflected/scattered light 114 may contain different spatial frequencies, which are generated based on the microscopic textural of tracking surface 106 or a signature of tracking surface 106. In one embodiment, irrespective of the detection methods, the generated signals are processed using image correlation processing to determine x/y-axis motion of tracking surface 106 relative to optical detector 108. In another embodiment, the generated signals are processed using phase/spatial frequency processing wherein any change in the phase/spatial frequency implies that tracking surface 106 may be moving relatively to optical detector 108 or have changed their relative positions. The amount of phase/frequency shift gives information about the direction and magnitude of motion. In one embodiment, irrespective of the detection and processing methods and technologies,
reflected/scattered light 114 incident on optical detector 108 is sampled over a period of time in a predetermined timing sequence. Any change in reflected/scattered light 114 from one sample to the next sample is used to determine presence and/or motion of tracking surface 106. In one embodiment, sampling data may be processed by a microcontroller(s), processor(s) (not shown), and/or output/report to another device via a suitable communication protocol (not shown) to determine presence and motion of tracking surface 106.
[0019] FIG. 2 is a representative view of a portion of an optical finger navigation (OFN) system 50 showing the effect of background light source 52 when tracking surface 106 is absent. As illustrated in FIG. 2, background/external light source 52 provides background/external light 120, such as sunlight and in general light coming from the outside of the OFN system. In one embodiment, irrespective of operation status of light source 102 and presence of tracking surface 106, background light 120 may be incident on optical detector 108 through the transparent top panel 110 with certain intensity and/or image. In one embodiment, since optical detector 108 may not be able to distinguish background light 120 from reflected/scattered light 114 based on images captured, it may generate and report sampling data which falsely indicates presence of tracking surface 106. Moreover, if background light 120' is changing or moving, then OFN system 50 may also incorrectly detect and report motion of tracking surface 106. Both of these potential failures - false surface detection and light-induced motion are observed, and limit the usefulness of ONS in environments that have strong background light 120.
[0020] FIG. 3 is a representative view of a portion of OFN system 50 showing the effect of potentially moving background light source 52. As illustrated in FIG. 3, irrespective of background light source 52 being natural, such as sunlight, or artificial, background light 120' may change and/or move over time. In one embodiment, the change may manifest in intensity, wavelength, frequency, incident angle, shape, movement, spatial frequency/phase and combinations thereof. One possible cause of such change is when a fixed light source 52 is blocked by moving light blocker 54 that blocks background light 120' at least partially in a dynamic manner between background light source 52 and optical detector 108, as illustrated in FIG. 3. In one embodiment, even in the case of light source 102 being on, most light beam 112 may escape OFN system 50 through transparent top panel 110 and there may be insignificant reflected/scattered light 114 incident on optical detector 108. In an embodiment of an application, OFN system 50 may be a part of a control console or an input system inside a moving vehicle. The background sunlight 120' that is incident on optical detector 108 is being intermittently or periodically blocked by a row of trees or buildings. In one embodiment, as a result, optical detector 108 may detect a dynamically changing light pattern both in terms of intensity and image in response to moving background light 120'. Depending on the sensing and/or processing technology of ONS, the changing light pattern may be interpreted as motion of tracking surface 106 which may be false, or at least not accurate. Consequently, ONS of OFN system 50 may erroneously report presence and/or motion of tracking surface 106 which may not be present.
[0021] FIG. 4 is a representative view of a portion of OFN system 50 showing the effect of potentially changing/moving background light source 52 when tracking surface 106 is present. As illustrated in FIG. 4, dynamic background light 120' is present along with tracking surface 106, which presence and movement is to be sensed and reported. In one embodiment, while some moving background light 102' may be blocked by tracking subject such as a finger 104, a portion of moving background light 102' may still leak around tracking subject 104 and is incident on optical detector 108, as previously described in FIG. 3. As illustrated in FIG. 4, since light source 102 is switched on/enabled in the presence of tracking surface 106, there is significant amount of reflected/scattered light 114 incident on optical detector 108
simultaneously. Consequently, light incident on optical detector 108 is a combination of the valid/desired reflected/scattered light 114 responding to presence/movement of tracking surface 106 and the invalid/unde sired moving background light 120'. In one embodiment, depending on the sensing technology of optical detector 108 and the relative intensity of moving background light 120', the detected presence/motion data of tracking surface 106 may be corrupted.
Accordingly, ONS may properly report presence of tracking surface 106, but may incorrectly or inaccurately report movement of tracking surface 106.
[0022] In one embodiment, the false surface detection and light-induced motion reporting may be mitigated by incorporating light-blocking baffles (not shown) to OFN system 50, in an attempt to block background light 120, so that only light (preferably reflected from a tracking surface) from a particular angle or location would propagate upon optical detector 108.
However, baffles may not completely block background light 120 because a portion of background light 120 may still be able to leak around tracking surface 106 or blocking baffles and inevitably transmitted through top panel 110 of OFN system 50. Also, if tracking surface 106 is not present, background light 120 may pass through without being blocked. In one alternative embodiment, static and dynamic data about the detected light is collected, and is subsequently compared to signatures that tend to be correlated with captured images of background light 120. However, in certain embodiments, only limited data static and dynamic data is available from optical detector 108 or sensor circuit, and the determination of background light 120 vs. desired reflected/scattered light 114 may be only partially effective. Occasionally background light 120 may be treated as desired reflected/scattered light 114, and vice-versa. Also the data collection and processing may take too much time and result in latency in reporting data to OFN system's 50 users. In yet another embodiment, a capacitive sensing element may be incorporated around or close or adjacent to OFN system 50, and use capacitive sense detector to initiate surface tracking only if the capacitive sense detector has determined presence of a tracking surface 106, such as a finger. The capacitive sensing incorporated embodiment may require additional mechanical structure for capacitive sensing, complicates industrial design and increases cost. It may fail when tracking surface 106 is only in contact of the capacitive sense element but does not cover an effective optical tracking area of OFN system 50.
[0023] FIG. 5 illustrates a schematic block diagram showing a portion of OFN system 50 according to one embodiment of the subject matter. In one embodiment, the static and dynamic characteristics of reflected/scattered light 114 are typically collected and used by OFN system 50 to report two things: (1) The presence or absence of tracking surface 106, and (2) the distance that the tracking surface 106 has moved relative to the OFN system 50. In one embodiment, OFN system 50 includes light source 102, such as, but not limited to, an LED or a laser diode such as VCSEL diode, optical detector 108, microcontroller 100 and communication interface 150, such as, but not limited to, a serial peripheral interface (SPI), an inter-integrated circuit (I2C), a universal serial bus (USB), may be mounted on a substrate or printed circuit board. In one embodiment, OFN system 50 may be an integrated or embedded system such as a System on Chip (SoC) implementation. The SoC implementation enables multiple resources on a single chip, some of these resources can be firmware implementations only, while others can be available as application-specific integrated circuits (ASICs) within the chip, or combinations thereof. The SoC implementation may reduce the burden of integration and the required board space and hence the manufacturing cost. In another embodiment, OFN system 50 is not an embedded system, includes one or more ICs or discrete components packaged within a common multi-chip module (MCM) or package, or can be separately mounted to a printed circuit board.
[0024] In one embodiment, microcontroller 100 may perform tasks of a digital signal processor (DSP) as it receives sampled optical data signal from optical detector 108 in the form of a matrix and performs data analysis. Microcontroller 100 is a processing element or a combination of multiple processing elements that may include multiple processor(s) and storage elements, such as RAM, EEPROM, ROM, etc., with firmware and/or software embodied on for operating OFN system 50 and other related circuits/modules. Different OFN systems may use different processing techniques, such as the above-mentioned image correlation processing or phase/spatial frequency processing, depending upon the system's requirements. In one embodiment, OFN system 50 is usually a part of a higher level system, and needs to
communicate with other functional blocks of said system. As illustrated in FIG. 5, OFN system 50 requires support for communication interface 150. For instance, OFN system 50 may be a part of a control console of a vehicle that needs to communicate with a higher level control system, which in turn controls other functions, such as A/C system, car window control system, etc., of the vehicle. Referring to FIG. 5, microcontroller 100 may include front-end circuitry for coupling signals out from optical detector 108, signal processing and interface circuitry for translating changes in light pattern of reflected/scattered light 114 and/or background light 120 propagated onto optical detector 108 into motion data, and a programmable controller to control operation of light source 102 and optical detector 108.
[0025] In one embodiment, microcontroller 100 includes a programmable switching function module which disables light source 102 (light-off or reduced period) so that data
sampled/retrieved from optical detector 108 during the light-off period corresponds to background light 120 mainly, if not exclusively. In one embodiment, the switching function may be implemented in hardware, such as switching off or reduce the power to the light source 102 with a transmission gate or a switch, software, such as reprogramming the output level of light source 102, or mechanical, such as a movable physical light barrier blocking the output of light source 102, or combinations thereof. In one embodiment, enabling and disabling light source 102 may mean switching it on and off completely. In another embodiment, enabling and disabling light source 102 may include maintaining output level of light source 102 at a high and low level, respectively. Irrespective of the switching function module type, light source 102 may be either switched off completely, or reduced in intensity to a predetermined level for the aforementioned purposes. In one embodiment, light source 102 switching function module is synchronized to the operation timing of optical detector 108 by configuring the sampling frequency of optical data. Consequently, microcontroller 100 may sample data from optical detector 108 while light source 102 is disabled. In one embodiment, the synchronization between switching function and sampling function may be implemented by microcontroller 100 with firmware that controls light source 102 and optical detector 108, respectively.
[0026] In one embodiment, for tracking surface 106 detection, light source 102 is briefly disabled according to a synchronized time schedule controlled by microcontroller 100. While light source 102 is disabled, microcontroller 100 may sample data from optical detector 108, also according to the synchronized schedule. The sampled light-off data is further processed, analyzed, and stored in microcontroller 100. At the completion of the light-off data sampling interval, light source 102 is enabled (light-on period), and light-on data may be sampled and subsequently coupled to microcontroller 100. The sampled light-off data is then compared to threshold value(s) to determine if background light is present, or at least reaches a level that it may compromise the light-on data. If the sampled light-off data exceeds or equals to or is within a close range of the threshold value, then a background light situation is determined, and microcontroller 100 is programmed not to report tracking surface 106 presence regardless of the value of the sampled light-on data. In one embodiment, sampled data may correspond to, depending on the detection and processing technologies adopted, image captured of reflected/scattered light 114 and/or background light 120 incident on optical detector 108. In one embodiment, threshold value(s) may be predetermined and stored at microcontroller 100, or programmable by a higher level system (not shown), or adaptable to operational sensing parameters.
[0027] In one embodiment, for motion reporting of tracking surface 106, light source 102 is also briefly disabled while light-off data is being sampled according to a same synchronized schedule controlled by microcontroller 100. Similar to the presence detection, light-off data sampling is interspersed with light-on data sampling whereas light source 102 is enabled by microcontroller 100. In one embodiment, if the sampled light-off data exceeds the threshold value, microcontroller 100 does not report either motion or presence of tracking surface 106 irrespective of the value of the sampled light-on data.
[0028] FIGS. 6 to 8 are flowcharts illustrating embodiments of a method for sensing and reporting tracking surface 106 with OFN system 50 associated with the embodiments shown in FIGS. 1 to 4. In one embodiment, OFN system 50 may adopt the method for tracking surface 106 detection only, or for tracking surface 106 motion reporting only, or adopt the method for both. Alternatively, OFN system 50 may be configured to sense and determine only presence of background light 120 without mitigation action. In one embodiment, the presence of background light 120 is reported but no steps may be taken to mitigate the potential effects.
[0029] Referring to FIG. 6 and as previously described, light source 102 is first disabled in step 302, hence only background light 120 (if present) incident upon optical detector 108 (light- off data) is sensed, sampled, measured and processed in microcontroller 100 in step 304. Then, light source 102 is enabled and light-on data is sampled in step 306. In step 308, data sampled during the light-off period is compared to a threshold value or values. If the light-off data exceeds the threshold value(s), the subsequently sampled light-on data will not be reported as it is determined, by the microcontroller 100 or outside systems (not shown), that background light is present. Otherwise, microcontroller 100 will report data sampled during light-on period to determine if tracking surface 106 is present and/or moving. In one embodiment, OFN system 50 is configured to sample light-off data with the purpose of suppressing false surface detection and false motion reporting due to background light 120. However, in the event that background light 120 is determined absent, there may be missing motion data during the light-off period as optical detector 108 may fail to sense any reflected/scattered light 114, resulting in missing tracking surface 106 motion data. In one embodiment, microcontroller 100 may be configured to artificially substitute lost motion data by interpolating between the sampled light-on data occurring before and after the light-off period. In another embodiment, microcontroller 100 may adopt other methods of estimating the amount of lost motion, such as considering the duration of light-off period. Other estimation techniques, such as interpolation and averaging may be used, along with calculated estimates of tracking surface 106 motion data and acceleration of said motion.
[0030] In one embodiment, light-on and light-off data is sampled in separate time periods, according to the switching schedule of light source 102 and sampling schedule of optical detector 108. When OFN system 50 is subjected to changing background light 120'conditions, such as the embodiment illustrated in FIG. 3, there may be occasions that sampled light-off data only dips below the threshold value because background light 120' is blocked coincidentally during at least a portion of the light-off sampling period. The background light 120' may then be unblocked during the light-on period and compromise the sampled light-on data. As a result, microcontroller 100 may mistakenly conclude absence of background light 120' and report the compromised light-on data samples that may lead to light-induced motion detection. Referring to FIG. 7, additional averaging and debouncing steps 420 and 422 are incorporated to mitigate such false reporting of presence/motion data due to moving/changing background light 120'. In step 408, if background light 120' is concluded absent during the light-off sampling period but returns during light-on sampling period, microcontroller 100 may fail to determine the presence of background light 120'. To prevent this, the microcontroller 100 may be configured to debounce the sampled light-off signal data before making a final determination regarding the presence of background light 120'. In one embodiment, in step 422, microcontroller 100 may sample data from optical detector 108 for a pre-determined number of times, either during a single light-off period or multiple light-off periods. Microcontroller 100 is configured to compare multiple light-off data samples to the threshold value(s) in order to determine that there truly is no background light 120' before reporting the sampled light-on data. Alternatively, microcontroller 100 may generate an average value of multiple sampled light-off data over a predetermined averaging period, compare the average value to a predetermined value and only determine a no background light 120' condition if the average light value is below the predetermined value, such as the threshold value. Regardless of the approach, once the final determination is made, microcontroller 100 will report or not report the sampled light-on data as previously described in FIG. 6. In one embodiment, the average value and debouncing step are reset in step 420 after the final determination is made.
[0031] In certain embodiments, background light 120' may move or change periodically, at least for a duration of time. Coincidentally, in one embodiment, the periodicity of change of background light 120' may be at least temporarily synchronous with the on-off operation schedule of light source 102. As a result, for example, background light 120' may be blocked every time when light source 102 is disabled. In those cases, using the debouncing and averaging approach as described in steps 420 and 422 may not mitigate a false final
determination of background light 120' presence because microcontroller 100 may repeatedly sample optical detector 108 when background light 120' is blocked while light source 102 is disabled. As such, debouncing or taking an average of multiple light-off data may not help mitigate the potential sensing errors. In one embodiment, to prevent such false decisions, the periodicity of optical detector 108 sampling may be jittered. For example, instead of operating at a fixed timing schedule, the light-off data sampling may occur at random or pseudo-random intervals and/or for random durations. Alternatively or additionally, referring to FIG. 8, a random delay as in step 530 may be incorporated before the light-off data sampling (steps 502 and 504) such that the periodic moving/changing background light 120' may be out of phase with the light- off data sampling timing.
[0032] Referring to FIG. 9, in one embodiment, instead of having a single optical detector 108 for sensing both reflected/scattered light 114 and background light 120, background light detector 116 which is dedicated to detecting background light 120 may be incorporated to OFN system 600. In one embodiment, optical data from background light detector 116 is only sampled when light source 102 is disabled/switched off.
[0033] In one embodiment, the concept of optical sensing during a switching-off period of light (EM radiation) source may be adapted to infrared proximity detection modules, such as the modules used in cellular phones or tablets. It may also improve performance of infrared proximity sensors by reducing occurrence of false detection. [0034] Although the present disclosure has been described with reference to specific exemplary embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the disclosure. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
[0035] The Abstract of the Disclosure is provided to comply with 37 C.F.R. § 1.72(b), requiring an abstract that will allow the reader to quickly ascertain the nature of one or more embodiments of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.
[0036] Reference in the description to one embodiment or an embodiment means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the circuit or method. The appearances of the phrase one embodiment in various places in the specification do not necessarily all refer to the same embodiment.
[0037] In the foregoing specification, embodiments of the subject matter have been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the embodiments as set forth in the appended claims. The specification and drawings are, accordingly, to be regarded in an illustrative sense rather than a restrictive sense.

Claims

What is claimed is:
1. A method, comprising:
disabling and enabling a light source in an optical navigation sensor (ONS) periodically; sampling, from an optical detector of the ONS, a first plurality of signals during a first time period and a second plurality of signals during a second time period;
comparing at least one of the first plurality of signals to a threshold value; and if the at least one of the first plurality of signals is greater than the threshold value, suppressing reporting of the second plurality of signals to avoid false detection and auto- movement in an output of the ONS.
2. The method of claim 1, wherein the first plurality of signals corresponds to external light to the ONS propagated upon the optical detector.
3. The method of claim 2, wherein the ONS is disposed in a vehicle and the external light includes sunlight.
4. The method of claim 2, wherein the second plurality of signals corresponds to both the external light and light reflected or scattered off a tracking surface, propagated upon the optical detector.
5. The method of claim 4, further comprising:
if the at least one of the first plurality of signals is less than the threshold value, reporting the second plurality of signals to derive motion data of the tracking surface.
6. The method of claim 1, wherein:
the first time period includes a time period when the light source of the ONS is disabled; the second time period includes a time period when the light source is enabled; and the second time period follows the first time period.
7. The method of claim 1, further comprising:
comparing multiple signals of the first plurality of signals to the threshold value; and if at least one of the multiple signals of the first plurality of signals is greater than the threshold value, suppressing reporting of the second plurality of optical signals.
8. The method of claim 1, further comprising:
deriving an average value based on the first plurality of signals;
comparing the average value to the threshold value; and
if the average value is greater than the threshold value, suppressing reporting of the second plurality of optical signals.
9. The method of claim 1, further comprising:
controlling, using at least one processing element, a first time schedule of the disabling and enabling the light source, and a second time schedule of the sampling of the first and the second plurality of signals; and
synchronizing, using the at least one processing element, the first and the second time schedules whereby the first plurality of signals corresponds to a time period when the light source is disabled and the second plurality of signals corresponds to a time period when the light source is enabled.
10. The method of claim 9, further comprising:
incorporating a time delay period preceding the first time period to mitigate effects of a moving external light source on a fixed time schedule, wherein a duration of the time delay period is random.
11. The method of claim 6, further comprising:
sampling, from the optical detector, a third plurality of signals during a third time period, wherein the third time period precedes the first time period and includes a time period when the light source is enabled; and
deriving the motion data of the tracking surface by interpolating between the third and the second plurality of signals to recover lost motion data in the second time period.
12. A method, comprising:
disabling a light source in an optical navigation sensor (ONS) periodically according to a first timing;
collecting, from a photo-diode (PD) array in the ONS, a first plurality of PD signal samples when the light source is disabled and a second plurality of PD signal samples when the light source is enabled;
comparing the first plurality of PD signal samples to at least one threshold value; and in response to an outcome of the comparing the first plurality of PD signal samples to the at least one threshold value, adjusting, using at least one processing elements, at least one sensing parameter of the ONS, to mitigate effects of external light to the ONS on the second plurality of PD signal samples.
13. The method of claim 12, wherein the ONS is disposed within a vehicle as a part of an input system and the external light includes sunlight.
14. The method of claim 12, wherein the sensing parameters include output level of the light source, the first timing, and a size of the second plurality of PD signal samples being reported.
15. The method of claim 12, wherein the second plurality of PD signal samples includes signals induced by both the external light and light reflected or scattered off a tracking surface, incident on the PD array.
16. The method of claim 14, further comprising:
if the first plurality of PD signal samples is less than the at least one threshold value, deriving motion data of the tracking surface from the second plurality of PD signal samples.
17. The method of claim 12, wherein the at least one threshold value is at least one of predetermined and stored in the at least one processing element, programmable, or adaptable according to the sensing parameters of the ONS.
18. An input system disposed within a vehicle, the input system comprising:
an optical navigation sensor (ONS) and a receiving surface, wherein the ONS detects and tracks motion of a tracking surface placed onto the receiving surface, the ONS includes:
a light source configured to illuminate the tracking surface, wherein output level of the light source is switched between a low level and a high level,
a photo-diode (PD) array configured to receive light incident thereon and generate PD signal samples based on the light received, wherein the light received includes light reflected or scattered off the tracking surface and external light to the input system, and a processing element configured to
control a timing schedule of the output level switching of the light source, collect the PD signal samples from the PD array,
compare the PD signal samples, collected during a first period when the output level is at the low level, to a threshold value to determine if the external light exceeds a predetermined level,
if the external light is determined not exceeding the predetermined level, report the PD signal samples collected during at least one subsequent period to the first period when the output level is at the high level, and
derive motion data of the tracking surface from the reported PD signal samples.
19. The input system of claim 18, wherein
the light source, the photo-diode (PD) array and the processing element are formed in a single integrated circuit package; and the PD array includes a first PD array and a second PD array disposed close to one another, wherein the PD signal samples generated by the first PD array are collected only when the light source is at the low level, and the PD signal samples generated by the second PD array are collected only when the light source is at the high level.
20. The input system of claim 18, further comprising:
a capacitive sense element, disposed onto the receiving surface of the input system and coupled to a capacitance sensor, wherein the capacitance sensor is configured to determine presence of the tracking surface on the receiving surface.
PCT/US2015/051727 2014-09-26 2015-09-23 Background light detection for optical navigation systems Ceased WO2016049189A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE112015004407.8T DE112015004407T5 (en) 2014-09-26 2015-09-23 Background light detection for optical navigation systems

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201462055803P 2014-09-26 2014-09-26
US62/055,803 2014-09-26
US14/858,217 2015-09-18
US14/858,217 US9927915B2 (en) 2014-09-26 2015-09-18 Optical navigation systems and methods for background light detection and avoiding false detection and auto-movement

Publications (1)

Publication Number Publication Date
WO2016049189A1 true WO2016049189A1 (en) 2016-03-31

Family

ID=55581951

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/051727 Ceased WO2016049189A1 (en) 2014-09-26 2015-09-23 Background light detection for optical navigation systems

Country Status (3)

Country Link
US (1) US9927915B2 (en)
DE (1) DE112015004407T5 (en)
WO (1) WO2016049189A1 (en)

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11609336B1 (en) 2018-08-21 2023-03-21 Innovusion, Inc. Refraction compensation for use in LiDAR systems
US11300683B2 (en) 2016-12-30 2022-04-12 Innovusion Ireland Limited Multiwavelength LiDAR design
US10942257B2 (en) 2016-12-31 2021-03-09 Innovusion Ireland Limited 2D scanning high precision LiDAR using combination of rotating concave mirror and beam steering devices
US11054508B2 (en) 2017-01-05 2021-07-06 Innovusion Ireland Limited High resolution LiDAR using high frequency pulse firing
US10969475B2 (en) 2017-01-05 2021-04-06 Innovusion Ireland Limited Method and system for encoding and decoding LiDAR
US11009605B2 (en) * 2017-01-05 2021-05-18 Innovusion Ireland Limited MEMS beam steering and fisheye receiving lens for LiDAR system
WO2018175990A1 (en) * 2017-03-23 2018-09-27 Innovusion Ireland Limited High resolution lidar using multi-stage multi-phase signal modulation, integration, sampling, and analysis
WO2019079642A1 (en) 2017-10-19 2019-04-25 Innovusion Ireland Limited Lidar with large dynamic range
AU2017436073B2 (en) 2017-10-20 2023-10-12 Razer (Asia-Pacific) Pte. Ltd. User input devices and methods for identifying a user input in a user input device
US10579193B2 (en) 2017-12-14 2020-03-03 Cypress Semiconductor Corporation Spatial-frequency-based capacitive motion sensor and method of using the same
US11493601B2 (en) 2017-12-22 2022-11-08 Innovusion, Inc. High density LIDAR scanning
US11675050B2 (en) 2018-01-09 2023-06-13 Innovusion, Inc. LiDAR detection systems and methods
WO2019139895A1 (en) 2018-01-09 2019-07-18 Innovusion Ireland Limited Lidar detection systems and methods that use multi-plane mirrors
US11927696B2 (en) 2018-02-21 2024-03-12 Innovusion, Inc. LiDAR systems with fiber optic coupling
WO2019165130A1 (en) 2018-02-21 2019-08-29 Innovusion Ireland Limited Lidar detection systems and methods with high repetition rate to observe far objects
WO2019165289A1 (en) 2018-02-22 2019-08-29 Innovusion Ireland Limited Receive path for lidar system
CN112292608B (en) 2018-02-23 2024-09-20 图达通智能美国有限公司 2D Manipulation Systems for LIDAR Systems
WO2019165095A1 (en) 2018-02-23 2019-08-29 Innovusion Ireland Limited Distributed lidar systems
WO2020013890A2 (en) 2018-02-23 2020-01-16 Innovusion Ireland Limited Multi-wavelength pulse steering in lidar systems
US11567182B2 (en) 2018-03-09 2023-01-31 Innovusion, Inc. LiDAR safety systems and methods
WO2019199796A1 (en) 2018-04-09 2019-10-17 Innovusion Ireland Limited Compensation circuitry for lidar receiver systems and method of use thereof
US11289873B2 (en) 2018-04-09 2022-03-29 Innovusion Ireland Limited LiDAR systems and methods for exercising precise control of a fiber laser
CN112585492B (en) 2018-06-15 2024-10-25 图达通智能美国有限公司 LIDAR system and method for focusing on a range of interest
US11579300B1 (en) 2018-08-21 2023-02-14 Innovusion, Inc. Dual lens receive path for LiDAR system
US11860316B1 (en) 2018-08-21 2024-01-02 Innovusion, Inc. Systems and method for debris and water obfuscation compensation for use in LiDAR systems
US11796645B1 (en) 2018-08-24 2023-10-24 Innovusion, Inc. Systems and methods for tuning filters for use in lidar systems
US11614526B1 (en) 2018-08-24 2023-03-28 Innovusion, Inc. Virtual windows for LIDAR safety systems and methods
US11579258B1 (en) 2018-08-30 2023-02-14 Innovusion, Inc. Solid state pulse steering in lidar systems
US12313788B1 (en) 2018-10-09 2025-05-27 Seyond, Inc. Ultrashort pulses in LiDAR systems
CN114114606B (en) 2018-11-14 2024-09-06 图达通智能美国有限公司 LIDAR systems and methods using polygonal mirrors
DE112020000407B4 (en) 2019-01-10 2024-02-15 Innovusion, Inc. LIDAR SYSTEMS AND METHODS WITH RADIATION DEFLECTION AND WIDE ANGLE SIGNAL DETECTION
US11486970B1 (en) 2019-02-11 2022-11-01 Innovusion, Inc. Multiple beam generation from a single source beam for use with a LiDAR system
US11977185B1 (en) 2019-04-04 2024-05-07 Seyond, Inc. Variable angle polygon for use with a LiDAR system
WO2021102627A1 (en) * 2019-11-25 2021-06-03 深圳市汇顶科技股份有限公司 Biological characteristic detection method, biological characteristic detection device, and electronic device
US12061289B2 (en) 2021-02-16 2024-08-13 Innovusion, Inc. Attaching a glass mirror to a rotating metal motor frame
US11422267B1 (en) 2021-02-18 2022-08-23 Innovusion, Inc. Dual shaft axial flux motor for optical scanners
EP4260086B1 (en) 2021-03-01 2024-11-27 Seyond, Inc. Fiber-based transmitter and receiver channels of light detection and ranging systems
US11555895B2 (en) 2021-04-20 2023-01-17 Innovusion, Inc. Dynamic compensation to polygon and motor tolerance using galvo control profile
US11614521B2 (en) 2021-04-21 2023-03-28 Innovusion, Inc. LiDAR scanner with pivot prism and mirror
US11662439B2 (en) 2021-04-22 2023-05-30 Innovusion, Inc. Compact LiDAR design with high resolution and ultra-wide field of view
WO2022225859A1 (en) 2021-04-22 2022-10-27 Innovusion, Inc. A compact lidar design with high resolution and ultra-wide field of view
EP4314885A1 (en) 2021-05-12 2024-02-07 Innovusion, Inc. Systems and apparatuses for mitigating lidar noise, vibration, and harshness
CN117413199A (en) 2021-05-21 2024-01-16 图达通智能美国有限公司 Mobile profiles for smart scanning using the galvanometer mirror inside the LIDAR scanner
US11768294B2 (en) 2021-07-09 2023-09-26 Innovusion, Inc. Compact lidar systems for vehicle contour fitting
US12300018B2 (en) * 2021-07-19 2025-05-13 Google Llc Biometric detection using photodetector array
US12468017B2 (en) 2021-10-15 2025-11-11 Seyond, Inc. Integrated mirror motor galvanometer
CN216356147U (en) 2021-11-24 2022-04-19 图达通智能科技(苏州)有限公司 Vehicle-mounted laser radar motor, vehicle-mounted laser radar and vehicle
US11871130B2 (en) 2022-03-25 2024-01-09 Innovusion, Inc. Compact perception device
US12204033B2 (en) 2022-03-25 2025-01-21 Seyond, Inc. Multimodal detection with integrated sensors
US20240177518A1 (en) * 2022-11-24 2024-05-30 Pixart Imaging Inc. Signal integration system and capacitive touch control device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050051285A1 (en) * 2003-09-09 2005-03-10 Asmo, Co., Ltd. Sunshade system having blind sheet
US20070279384A1 (en) * 2003-01-14 2007-12-06 Brosnan Michael J Apparatus for controlling a screen pointer that distinguishes between ambient light and light from its light source
US20070296699A1 (en) * 2006-06-23 2007-12-27 Microsoft Corporation Multi-mode optical navigation
US20080240523A1 (en) * 2004-04-16 2008-10-02 Validity Sensors, Inc. Method and Apparatus for Two-Dimensional Finger Motion Tracking and Control
US20130234978A1 (en) * 2012-02-23 2013-09-12 Cypress Semiconductor Corporation False touch filtering for capacitance sensing systems

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5994710A (en) * 1998-04-30 1999-11-30 Hewlett-Packard Company Scanning mouse for a computer system
US7317448B1 (en) * 2001-10-01 2008-01-08 Logitech Europe S.A. Multiple sensor device and method
DE50310881D1 (en) * 2003-03-25 2009-01-15 Thomson Licensing DETECTION OF ELECTROMAGNETIC RADIATION
US7728316B2 (en) 2005-09-30 2010-06-01 Apple Inc. Integrated proximity sensor and light sensor
KR100648517B1 (en) 2005-12-09 2006-11-27 주식회사 애트랩 Optical navigation device and method of operation thereof
US8400409B1 (en) * 2007-07-10 2013-03-19 Cypress Semiconductor Corporation User interface devices, methods, and computer readable media for sensing movement of an actuator across a surface of a window
US8125619B2 (en) 2007-07-25 2012-02-28 Eminent Electronic Technology Corp. Integrated ambient light sensor and distance sensor
US7486386B1 (en) 2007-09-21 2009-02-03 Silison Laboratories Inc. Optical reflectance proximity sensor
US7812947B2 (en) * 2008-01-21 2010-10-12 Honeywell International Inc. Apparatus and method for measuring and/or controlling paper pulp properties
GB0921644D0 (en) 2009-12-10 2010-01-27 St Microelectronics Res & Dev Improvements in or relating to optical navigation devices
GB2476079A (en) 2009-12-10 2011-06-15 St Microelectronics Optical navigation device with a light sensor that detects the device movements and the ambient light level.
WO2013053952A1 (en) * 2011-10-14 2013-04-18 Iee International Electronics & Engineering S.A. Spatially selective detection using a dynamic mask in an image plane
TWI510087B (en) * 2012-09-14 2015-11-21 Pixart Imaging Inc Electronic system
US8987656B2 (en) 2012-10-09 2015-03-24 Sae Magnetics (H.K.) Ltd. Optical finger navigation device having an integrated ambient light sensor and electronic system comprising the same
DE102013000927A1 (en) * 2013-01-19 2014-07-24 Daimler Ag Steering wheel with optical finger navigation module
TW201520832A (en) * 2013-11-28 2015-06-01 Pixart Imaging Inc Optical navigation system and detection method thereof adapted for ambient light and liftoff detection
US9804695B2 (en) * 2014-01-08 2017-10-31 Yun-Shan Chang Cursor control apparatus and method for the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070279384A1 (en) * 2003-01-14 2007-12-06 Brosnan Michael J Apparatus for controlling a screen pointer that distinguishes between ambient light and light from its light source
US20050051285A1 (en) * 2003-09-09 2005-03-10 Asmo, Co., Ltd. Sunshade system having blind sheet
US20080240523A1 (en) * 2004-04-16 2008-10-02 Validity Sensors, Inc. Method and Apparatus for Two-Dimensional Finger Motion Tracking and Control
US20070296699A1 (en) * 2006-06-23 2007-12-27 Microsoft Corporation Multi-mode optical navigation
US20130234978A1 (en) * 2012-02-23 2013-09-12 Cypress Semiconductor Corporation False touch filtering for capacitance sensing systems

Also Published As

Publication number Publication date
US9927915B2 (en) 2018-03-27
US20160117048A1 (en) 2016-04-28
DE112015004407T5 (en) 2017-06-29

Similar Documents

Publication Publication Date Title
US9927915B2 (en) Optical navigation systems and methods for background light detection and avoiding false detection and auto-movement
US11450142B2 (en) Optical biometric sensor with automatic gain and exposure control
US9383200B2 (en) Optoelectronic sensor and method for the detection and determination of distances of objects
US8502153B2 (en) Methods, systems and devices for crosstalk measurement and cancellation in optical proximity sensors
JP2022543389A (en) Processing system for LIDAR measurements
KR101690205B1 (en) Optical Touch Tomography
US9195347B2 (en) Input device and associated method
US20100245289A1 (en) Apparatus and method for optical proximity sensing and touch input control
US10101819B2 (en) Control system for a gesture sensing arrangement and method for controlling a gesture sensing arrangement
JP2014059302A (en) Photoelectric sensor and object detection method
WO2012173640A1 (en) An optical navigation module with capacitive sensor
CN105939427B (en) Control method and device of infrared proximity sensor and mobile terminal
WO2011094366A1 (en) Gesture recognition with principal component anaysis
CN102262458B (en) Improvements in or relating to optical navigation devices
US20120092254A1 (en) Proximity sensor with motion detection
US10037106B2 (en) Optical sensor arrangement and method for gesture detection
CN101901087A (en) Surface positioning device and method based on linear image sensors
US20130334398A1 (en) Motion and simple gesture detection using multiple photodetector segments
EP2790093B1 (en) Method for gesture detection, optical sensor circuit, in particular an optical sensor circuit for gesture detection, and optical sensor arrangement for gesture detection
CN110709853A (en) Image sensor with range and light level detection
GB2485997A (en) Camera using a Single Photon Avalanche Diode (SPAD) array
JP5826232B2 (en) Photoelectric sensor and sensor setting changing method
US8896553B1 (en) Hybrid sensor module
US9098144B1 (en) Adaptive ambient light auto-movement blocking in optical navigation modules
CN119602861A (en) Optical interference detection method, device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15845256

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 112015004407

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15845256

Country of ref document: EP

Kind code of ref document: A1