US20180173927A1 - Always-on sensor device for human touch - Google Patents
Always-on sensor device for human touch Download PDFInfo
- Publication number
- US20180173927A1 US20180173927A1 US15/883,370 US201815883370A US2018173927A1 US 20180173927 A1 US20180173927 A1 US 20180173927A1 US 201815883370 A US201815883370 A US 201815883370A US 2018173927 A1 US2018173927 A1 US 2018173927A1
- Authority
- US
- United States
- Prior art keywords
- circuitry
- touch
- always
- determining
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3231—Monitoring the presence, absence or movement of users
-
- G06K9/00013—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3262—Power saving in digitizer or tablet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3265—Power saving in display device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
- H04W52/0251—Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
- H04W52/0251—Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity
- H04W52/0254—Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity detecting a user operation or a tactile contact or a motion of the device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04105—Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04106—Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
-
- Y02D10/173—
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
-
- Y02D70/00—
-
- Y02D70/26—
Definitions
- CMOS complementary metal-oxide-semiconductor
- CMOS complementary metal-oxide-semiconductor
- finger print sensors typically consume substantial amount of power (e.g., hundreds of ⁇ Watts to several mWatts) and, therefore, cannot be turned on continuously to prevent draining a device's battery too rapidly.
- the disclosure recognizes and addresses, in at least certain embodiments, the issue of power consumption and lack of a power efficient always-on approach to sensing and analyzing human touch at a device.
- the disclosure provides a device that includes always-on circuitry configured to implement a first stage comprising first operations including: detecting touch of a specific area of a touch-screen display device; and predicting that the touch is associated with a human finger based on a touch criterion.
- the always-on circuitry is further configured to implement other first operations including generating a control signal configured to cause a processor to wake-up from a power-off mode or a sleep mode; and sending the control signal to the processor.
- the device also includes system circuitry configured to implement a second stage in response to the control signal, the second stage comprising second operations including: analyzing biometric data of a human body associated with the human finger.
- FIG. 1 illustrates an example of an operational environment in accordance with one or more embodiments of the disclosure.
- FIG. 2 illustrates an example of a device in accordance with one or more embodiments of the disclosure.
- FIG. 3 illustrates an example of always-on circuitry in accordance with one or more embodiments of the disclosure.
- FIG. 4-6 illustrate examples of methods for monitoring human touch at a device in accordance with one or more embodiments of the disclosure.
- the disclosure recognizes and addresses, in at least certain embodiments, the issue of power consumption and lack of a power efficient always-on approach to sensing and analyzing human touch at a device.
- embodiments of the disclosure permit or otherwise facilitate sensing of human touch that can be performed continually or nearly continually by separating a low-power detection stage from a full-power analysis stage.
- the detection stage is implemented continually or nearly continually and causes system circuitry to perform analysis of the human touch after the low-power detection stage has confirmed the human touch.
- Implementation of the low-power detection stage permits removal of physical actuation device (e.g., buttons or the like) while maintaining low power consumption. Absence of a physical actuation device does not hinder low-power consumption and does simplify user-device interaction when sensing human touch.
- a touch-sensitive surface can embody or can constitute, for example, a touch-screen display device.
- Mobile devices can be embodied in or can include consumer electronics devices (e.g., smartphones, portable gaming devices); vehicular devices (such as navigation and/or entertainment system device); medical devices; and the like.
- embodiments of the disclosure are not so limited and can be applied, more generally, to the analysis of human body biometric data, such as blood pressure, pulse, blood pressure variation, blood flow parameters, etc., where a detail analysis of human touch at the device can be performed after a first stage detects that the device is (or, in some embodiments, has been) in contact with a human finger or other body part.
- human body biometric data such as blood pressure, pulse, blood pressure variation, blood flow parameters, etc.
- embodiments of the disclosure can provide numerous improvements. For example, splitting the sensing of human touch into a low-power, always-on detection stage and a triggered, full-power analysis stage permits sensing human touch continuously or nearly continuously, without causing battery drainage or other inefficiencies. Therefore, embodiments of the disclosure permit removal of physical actuation triggers that are present in typical consumer electronics products, thus simplifying user-device interaction while sensing human touch. More specifically, rather than asking an end-user to provide some activation trigger (such as pressing a button) before the fingerprint sensing is turned on, for example, the low-power detection stage of the disclosure is implemented continually and trigger analysis when human touch is detected.
- a touch-screen display device can be implemented with a uniform (and fixed) screen without a button press section.
- the touch-screen display device can provide always-on sensing of human touch while providing larger viewing area and lower manufacturing cost for a product incorporating embodiments of this disclosure.
- conventional sensor technology can operate 100% of the time if a physical trigger is not desired, which would impose prohibitive power consumption demands.
- FIG. 1 illustrates an example of an operational environment for sensing of human touch in accordance with one or more embodiments of the disclosure.
- a device 110 includes a touch-screen display device 115 or other type of surface sensitive to touch.
- a human finger other body part either represented by a hand 120 , can touch a specific area of the touch-screen display device 115 .
- the touch-screen display device 115 can be hard and need not include movable parts, such as a sensor button configured to detect human touch or otherwise cause the device 110 to respond to human touch.
- the device 110 can include circuitry that can operate in response to touch (human or otherwise) of the touch-screen display device 115 (or, in some embodiments, the other type of touch sensitive surface).
- the device 110 can include always-on circuitry 130 and system circuitry 140 .
- Such circuitry can be operatively coupled (e.g., electrically coupled, communicative coupled, etc.) via a bus architecture 135 (or bus 135 ) or conductive conduits configured to permit the exchange of signals between the always-on circuitry 130 and the system circuitry 140 .
- a printed circuit board (PCB) placed behind the touch-screen display device 115 can include the always-on circuitry 130 , the system circuitry 140 , and the bus 135 .
- the always-on circuitry 130 and the system circuitry 140 can be configured or otherwise arranged in a single semiconductor die.
- the always-on circuitry 130 can be configured or otherwise arranged in a first semiconductor die and the system circuitry 140 can be configured or otherwise arranged in a second semiconductor die.
- the bus 135 can be embodied in or can include a dedicated conducting wire or a dedicated data line that connects the always-on circuitry 130 and the system circuitry 140 .
- the always-on circuitry 130 can operate as sensor for human touch and the system circuitry 140 , or a portion thereof, can permit or otherwise facilitate analysis of the human touch.
- the analysis can include fingerprint recognition or other types of biometric evaluations.
- the always-on circuitry 130 can be energized or otherwise power-on continuously or nearly continuously and can be configured to monitor touch of the touch-screen display device 115 .
- the always-on circuitry in response to human touch (e.g., touch by a human finger or other human body part), can be further configured to trigger detection and/or another type of analysis of elements of the human touch or a human body associated therewith.
- the always-on circuitry 130 can be configured to implement a first stage, referred to Stage I 150 , that can sense human touch and can generate trigger signaling in response.
- Stage I 150 can include numerous operations, including detecting touch of a specific area of a touch-screen display device 115 .
- the touch can be detected according to information (e.g., data and/or signaling) received from a sensor (e.g., a capacitive sensor, a pressure sensor, a force sensor, an accelerometer, or the like) included in the device 110 and associated with the touch-screen display device 115 .
- detecting the touch can include utilizing static capacitive sensing of the touch.
- detecting the touch can include utilizing dynamic capacitive sensing of the touch. Further or in yet another example, detecting the touch can include utilizing optical imaging of the touch and/or ultrasonic imaging of the touch. Furthermore on in yet another example, detecting the touch can include utilizing pressure sensing of the touch.
- the operations of the Stage I 150 can include predicting that the touch is associated with a human body part (such as a finger) based on a touch criterion.
- the always-on circuitry 130 can be configured to determine, within a specific accuracy, that the touch is associated with a human touch.
- the specific accuracy can be associated with a technique relied upon to predict that the detected touch is associated with a human touch.
- predicting that the touch can be associated with a human touch can include one or more of: (i) determining that a force greater than a first predetermined threshold (e.g., about 0.005 N, about 0.05 N, or about 0.5 N) was exerted on a surface of the touch-screen display device; (ii) determining that a pressure greater than a second predetermined threshold (e.g., about 50 Pa, about 500 Pa, or about 5000 Pa) was exerted on the surface of the touch-screen display device; (iii) determining that the specific area overlaps with a predetermined number of pixels (e.g., about 1 Gigapixels to about 3 Gigapixels) of the touch-screen display device within a predetermined range; or (iv) determining that the touch caused a defined frequency response.
- a first predetermined threshold e.g., about 0.005 N, about 0.05 N, or about 0.5 N
- a second predetermined threshold e.g., about 50 Pa, about 500 Pa
- predicting that the touch can be associated with a human touch can include determining that a first frequency response of a mass that causes the touch to acoustic sound corresponds to a second frequency response of the human finger to the acoustic sound.
- Stage I 150 also includes operations responsive to a prediction that the touch of the touch-screen display device 115 is associated with a human touch. Specifically, in response to such a prediction, Stage I 150 includes generating trigger signaling (or, in some embodiments, other types of control signal) configured to direct or otherwise cause the system circuitry 140 or a portion thereof to wake up (e.g., to be energized) from a power-off mode or a sleep mode. In addition, Stage I 150 also can include sending the trigger signaling to the system circuitry 140 or the portion thereof (e.g., a processor). As such, the trigger signaling can act as a wake-up event for the system circuitry 140 or the portion thereof.
- trigger signaling can act as a wake-up event for the system circuitry 140 or the portion thereof.
- Stage I 150 by the always-on circuitry 130 can replace the button press operation of conventional technologies, particularly, yet not exclusively, because the always-on circuitry 130 can operate as a low-power consumption element and, thus, can operate continuously or nearly continuously, without significantly impacting power consumption characteristics (e.g., battery life) of the device 110 .
- the always-on circuitry 130 can consume about 10 to about 100 times less power than a conventional button-operated fingerprint sensor. Consumption of power of the always-on circuitry 130 can be lower than conventional systems due to the implementation of the Stage I 150 being directed to establishing that a human has touched the touch-screen display device 115 , without analyzing features of the touch (such as fingerprints).
- implementation of the Stage I 150 can provide with a qualitative assessment of a touch, which assessment can be performed using less information (e.g., data and/or signaling from a sensor) and less power consumption than implementation of quantitative assessments of the touch (e.g., full fingerprint analysis)—such as the assessment implemented by the system circuitry 140 at the second stage.
- implementation of the Stage I 150 can provide a trigger that can switch on the system circuitry 140 and the associated implementation of a second stage described herein. As long as the touch algorithm does not trigger the second stage, the system circuitry 140 can remain operating in a power-save mode or a sleep mode in order to minimize energy consumption of the device 110 .
- the system circuitry 140 can receive the trigger signaling (or other type of control signal) and, in response, can be implement a second stage, referred to as Stage II 160 , including operations for analysis of information (e.g., data and/or signaling) related to the human touch sensed by the always-on circuitry 130 . More specifically, in certain implementations, the Stage II 160 can include operations such as analyzing biometric data of a human body associated with a human finger or other type of body part associated with the sensed human touch. Implementation of the Stage II 160 can permit determining, using an outcome of the analyzing the biometric data, a fingerprint of the human finger.
- the Stage II 160 can include operations such as determining, using an outcome of the analyzing such biometric data, one or more of a blood pressure of the human body, a pulse of the human body, a blood flow parameter of the human body, or a blood glucose level of the human body.
- the Stage I 150 can include receiving the biometric data from a biometric sensor communicatively coupled (via a bus, for example) to the always-on circuitry 130 .
- the device 110 the biometric sensor or another type of medical device can be include in a group of sensor device(s) 220 .
- the Stage I 150 can further include sending the biometric data to the system circuitry 140 or a portion thereof from the always-on circuitry 130 .
- Such data can be sent, for example, in conjunction with the trigger signaling or other type of control information generated by the always-on circuitry 130 in response to ascertaining that human touch has occurred at the device.
- the always-on circuitry 130 and the system circuitry 140 can have different complexity depending on numerous factors, such as type and/or form factor of the device 110 .
- the always-on circuitry 130 can be embodied in or can include an application specific integrated circuit (ASIC) configured to perform or facilitate performance of at least a portion of the Stage I 150 described herein.
- the always-on circuitry 130 can be embodied in or can include a register-transfer level (RTL) processing circuit configured to perform or facilitate performance of the Stage I 150 .
- RTL register-transfer level
- the always-on circuitry 130 can be embodied in or can include a field-programmable gate array (FPGA) configured to perform or facilitate performance of the Stage I 150 .
- the system circuitry 140 can include an application processor and/or a processor of the device 110 or a host device that contains the system circuitry 140 .
- the always-on circuitry 130 and the system circuitry 140 can be configured in a mobile device (e.g., a smartphone, a tablet computer, a laptop computer).
- the always-on circuitry 130 and the system circuitry 140 can be configured within a wearable device (e.g., a heart rate monitor, an insulin pump, or the like).
- wearable devices may rely on or otherwise communicate with a mobile device (e.g., a smartphone, a tablet computer). Accordingly, in one of such scenarios, the always-on circuitry 130 and the system circuitry 140 can be distributed between a wearable device and the mobile device.
- Stage I 150 can be straightforward and low-power, permitting always-on operation. It is noted that in embodiments of this disclosure, it may not be critical to add complexity to the Stage I 150 in order to incorporate false-positive detection, e.g., falsely triggering Stage II 160 . As long as false-positives are relatively few, a false-positive trigger of the Stage II 160 would merely result in a negative fingerprint detection or other type of computational exception, therefore causing the system circuitry 140 to consume, unnecessarily, a small amount of power in such relatively rare occasions. Accordingly, false positives in the Stage I 150 would have minor impact on battery life or other power resources of the device 110 .
- false-positive detection e.g., falsely triggering Stage II 160
- FIG. 2 illustrates an example embodiment of the device 110 in accordance with one or more embodiments of the disclosure.
- the device 110 includes the always-on circuitry 130 operatively coupled to hardware 210 via a bus architecture 205 .
- a power supply 260 can continually or nearly continually energize the always-on circuitry 130 .
- the bus architecture 205 can include the bus 135 and can be embodied in or can include a system bus, an address bus, a control bus, a combination thereof, or the like.
- the hardware 210 can include numerous functional elements (e.g., components, platforms, I/O interfaces, connector, adapters, or the like) that individually or in combination can provide specific functionality to the device 110 .
- the hardware 210 can include a radio unit (not shown) which can include antenna(s) and processing circuitry that can permit or otherwise facilitate wireless communication between the device 110 and other devices (e.g., a base station or a wireless computing device). For the sake of clarity, at least some of such functional elements are not shown.
- the hardware 210 includes the touch-screen display device 115 and the system circuitry 140 .
- the hardware 210 also includes one or more sensors 220 and one or more memory devices 250 (collectively referred to as memory 250 ).
- the power supply 260 can energize at least a portion of the hardware 210 according with trigger signaling (or other type of control signal) provided (e.g., generated and transmitted) by the always-on circuitry 130 in accordance with aspects of this disclosure. More specifically, in the illustrated embodiment, the system circuitry 140 can include a power controller 20 that can receive trigger signaling (e.g., a control instruction) and, in response, can energize at least one processor of the processor(s) 230 from a power-save state to a full-power state.
- trigger signaling e.g., a control instruction
- the at least one processor that transitions from the power-save state to the full-power state can execute one or more analysis module(s) 254 in order to analyze features (e.g., fingerprints) of a human associated with the human touch that triggered the trigger signaling.
- one or more of the sensor device(s) 220 can provide biometric data to the system circuitry 140 in order for the at least one processor that is energized to extract biometric elements from the biometric data.
- the at least one processor can execute one or more of the analysis module(s) 254 and, based on an outcome of the execution, the at least one processor can determine one or more of a blood pressure of the human body, a pulse of the human body, a blood flow parameter of the human body, or a blood glucose level of the human body.
- At least one of the analysis module(s) 254 can include computer-accessible instruction (e.g., computer-readable instructions and/or computer-executable instructions) that in response to execution by a processor can permit or otherwise facilitate the device 110 to implement a defined algorithm (or process) for fingerprint identification or analysis.
- such instructions also can permit or otherwise facilitate the device 110 to perform other type of analysis related to a health condition of a human associated with a detected human touch.
- the memory 250 also can include memory elements including data and/or instructions for analysis of human touch (e.g., fingerprint recognition, voice identification, or the like).
- At least one of the sensor(s) 220 can measure or otherwise collect biometric information in response to (e.g., during) the touch, such as it would be the case in which the device 110 embodies or includes a medical device. Such information can be sent to the always-on circuitry 130 , which can send the biometric information to the system circuitry 140 in conjunction with, before, or after sending the trigger signaling.
- FIG. 3 illustrates an example embodiment of the always-on circuitry 130 described herein.
- the always-on circuitry 130 includes a detection component 310 can figured to detect touch of a specific area of a touch-screen display device or another type of touch-sensitive surface of a device (e.g., device 110 ) in accordance with aspects described herein.
- the detection component 310 can receive sensor data 305 or other type of information indicative or otherwise representative of touch.
- the sensor data 305 or the other information can be received from at least one of the sensor device(s) 220 .
- the always-on circuitry 130 can include an analysis component 320 to determine whether the touch is associated with a human finger or other human body part based at least on a touch criterion.
- the analysis component 320 can process at least a portion of the received sensor data 305 .
- the analysis component 320 can utilize or otherwise leverage imaging techniques (light and/or sound based techniques, for example).
- the analysis component 320 can utilize or otherwise leverage acoustic techniques, such as monitoring a frequency response to an acoustic wave of an object that touches the touch-screen display device and comparing such a response to the typical frequency response of a human body (typical finger mass) to acoustic sound.
- the analysis component 320 can be embodied in firmware, such as a hard-coded RTL or an FPGA.
- the analysis component 320 can direct or otherwise cause a control component 330 to generate a control signal 335 .
- the control signal can be configured to cause a processor (e.g., one of processor(s) 230 ) or other portion of a system circuitry (e.g., system circuitry 140 ) operatively coupled to the always-on circuitry 130 to wake-up from a power-off mode or a sleep mode.
- the control component 330 also is configured to send the control signal 335 to the processor of the other portion of the system circuitry.
- example methods that can be implemented in accordance with this disclosure can be better appreciated with reference to FIGS. 4-6 .
- example methods disclosed herein are presented and described as a series of acts; however, it is to be understood and appreciated that the disclosed subject matter is not limited by the order of acts, as some acts may occur in different orders and/or concurrently with other acts from that shown and described herein.
- one or more example methods disclosed herein can alternatively be represented as a series of interrelated states or events, such as in a state diagram.
- interaction diagram(s) may represent methods in accordance with the disclosed subject matter when disparate entities enact disparate portions of the methodologies.
- Methods disclosed throughout the subject specification and annexed drawings are capable of being stored on an article of manufacture to facilitate transporting and transferring such methodologies to computers or other types of information processing machines for execution, and thus implementation, by a processor or for storage in a memory device or another type of computer-readable storage device.
- one or more processors that enact a method or combination of methods described herein can be utilized to execute programming code instructions retained in a memory device, or any computer- or machine-readable storage device or non-transitory media, in order to implement method(s) described herein.
- the programming code instructions when executed by the one or more processor implement or carry out the various acts in the method(s) described herein.
- the programming code instructions provide a computer- or machine-executable framework to enact the method(s) described herein. More specifically, yet not exclusively, each block of the flowchart illustrations and/or combinations of blocks in the flowchart illustrations can be implemented by the programming code instructions.
- FIG. 4 illustrates an example method 400 for sensing human touch in accordance with one or more embodiments of the disclosure.
- the always-on circuitry 130 can detect touch of a specific area of a touch-screen display device or another type of touch-sensitive surface of a device (mobile or otherwise).
- the always-on circuitry can determine whether a probability that the touch is associated with a human touch is greater than a defined threshold value. In response to ascertaining that such a probability is not greater than the defined threshold value (“No” branch), the always-on circuitry 130 can implement exception handling at block 425 .
- implementing the exception handling can include continuing assessing signals representative of touch of the touch-screen display device.
- the always-on circuitry can generate a control signal configured to wake up or otherwise energize a processor from a power-off mode.
- the processor can be energized from a power-save mode.
- the control signal can be embodied in or can include an interrupt signal.
- the processor can be included in the system circuitry 140 .
- the always-on circuitry 130 can send the control signal to the system circuitry 140 .
- the control signal can be sent via a bus or other type of communication conduit (vias, connectors, a combination thereof, or the like) that operationally couples the always-on circuitry 130 and the system circuitry 140 .
- the system circuitry 140 can receive the control signal and, in some embodiments, associated payload data. In response, the system circuitry 140 can energize the processor for operational power consumption. Specifically, in one example, the system circuitry 140 can supply an amount of power for the processor to provide or otherwise operate at full functionality. At block 460 , the system circuitry 140 can analyze biometric data of a human associated with the human finger.
- FIG. 5 presents an example method 500 for establishing that touch of a surface of a touch-screen device (or other type of touch-sensitive surface of the device) is associated with a human touch in accordance with one or more embodiments of the disclosure.
- the example method 500 can embody or can constitute an implementation of blocks 410 and 420 in the example method 400 .
- the example method 500 can be implemented (e.g., executed) by a device including always-on circuitry in accordance with this disclosure.
- the device can generate images of an object in proximity to the touch-screen device (or the other type of touch-sensitive surface).
- the device can include a camera and related processing circuitry (e.g., a graphical processing unit) configured to generate imaging information indicative or otherwise representative of the images.
- the device can determine that a portion of the touch-screen display device (or the other type of touch-sensitive surface) is touched. In response to such a determination, at block 530 , the device can analyze at least one image of the images. The analysis can include, for example, application of computer-vision techniques to recognize an object that touched the touch-screen display device. Accordingly, the device can implement various image recognition processes in order to identify an object with a defined level of confidence (e.g., a defined probability).
- the device that implements the example method 500 can determine that the object is a human finger—or, in some instances, other human body part, such as a palm, a foot, or the like—based at least on the analyzed at least one image.
- FIG. 6 presents an example method 600 for establishing that touch of a surface of a touch-screen device (or other type of touch-sensitive surface of the device) is associated with a human touch in accordance with one or more embodiments of the disclosure.
- the example method 600 can embody or can constitute an implementation of blocks 410 and 420 in the example method 400 .
- the example method 500 can be implemented (e.g., executed) by a device including always-on circuitry in accordance with this disclosure.
- the device can determine that a portion of a touch-screen display device is touched. In response to such a determination, at block 620 , the device can emit an acoustic wave (audible or otherwise).
- the acoustic wave can be transmitted at low transmit power by a speaker or another type of haptic device configured to produce a pressure wave. It is noted that the disclosure is not so limited, and the device can emit the acoustic wave continuously, nearly continuously, periodically, or at scheduled times, without the emission being responsive to the touch.
- the device can monitor frequency response of a scattered portion of the acoustic wave.
- the scattered portion of the acoustic wave can include reflections of the emitted acoustic wave from a surface of an object that touches the portion of the touch-screen display device.
- the device can determine whether the monitored frequency response is comparable to a defined frequency response of a human body part (e.g., a human finger) to sound. For instance, the device can compare the spectral distribution of power of the scattered acoustic wave to a defined spectral power distribution of acoustic waves reflected from a human body part (e.g., a human finger). Based on the comparison, the device can determine if a difference between such distributions is greater than a defined threshold value or less than the defined threshold value. Differences less than the defined threshold can be deemed to be comparable. The difference can be determined at a certain frequency or piece-wise (e.g., for a metric of the spectral distribution integrated over a range of frequencies).
- the device In response to a determination that the monitored frequency response is not comparable to the defined frequency response (“No” branch), the device can determine, at block 650 , that an object other than a human body part touched the touch-screen display device. In the alternative, in response to a determination that the monitored frequency response is comparable to the defined frequency response (“Yes” branch), the device can determine, at block 660 , that the human body part touched the touch-screen display device.
- a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer.
- a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer.
- an application running on a server or network controller and the server or network controller can be a component.
- One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers. Also, these components can execute from various computer readable media having various data structures stored thereon. The components can communicate via local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems via the signal).
- a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems via the signal).
- a component can be an apparatus with specific functionality provided by mechanical parts operated by electric or electronic circuitry, which is operated by a software, or firmware application executed by a processor, wherein the processor can be internal or external to the apparatus and executes at least a part of the software or firmware application.
- a component can be an apparatus that provides specific functionality through electronic components without mechanical parts, the electronic components can include a processor therein to execute software or firmware that provides at least in part the functionality of the electronic components.
- interface(s) can include I/O components as well as associated processor, application, or Application Programming Interface (API) components. While the foregoing examples are directed to aspects of a component, the exemplified aspects or features also apply to a system, platform, interface, node, coder, decoder, and the like.
- example and “such as” are utilized herein to mean serving as an instance or illustration. Any embodiment or design described herein as an “example” or referred to in connection with a “such as” clause is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the terms “example” or “such as” is intended to present concepts in a concrete fashion.
- the terms “first,” “second,” “third,” and so forth, as used in the claims and description, unless otherwise clear by context, is for clarity only and doesn't necessarily indicate or imply any order in time.
- processor can refer to any computing processing unit or device comprising, but not limited to comprising, single-core processors; single-processors with software multithread execution capability; multi-core processors; multi-core processors with software multithread execution capability; multi-core processors with hardware multithread technology; parallel platforms; and parallel platforms with distributed shared memory.
- a processor can refer to an integrated circuit, an application specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic controller (PLC), a complex programmable logic device (CPLD), a discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein.
- ASIC application specific integrated circuit
- DSP digital signal processor
- FPGA field programmable gate array
- PLC programmable logic controller
- CPLD complex programmable logic device
- processors can exploit nano-scale architectures such as, but not limited to, molecular and quantum-dot based transistors, switches and gates, in order to optimize space usage or enhance performance of user equipment.
- a processor may also be implemented as a combination of computing processing units.
- nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory.
- Volatile memory can include random access memory (RAM), which acts as external cache memory.
- RAM is available in many forms such as synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct Rambus RAM (DRRAM).
- SRAM synchronous RAM
- DRAM dynamic RAM
- SDRAM synchronous DRAM
- DDR SDRAM double data rate SDRAM
- ESDRAM enhanced SDRAM
- SLDRAM Synchlink DRAM
- DRRAM direct Rambus RAM
- Various embodiments described herein can be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques.
- various of the aspects disclosed herein also can be implemented by means of program modules or other types of computer program instructions stored in a memory device and executed by a processor, or other combination of hardware and software, or hardware and firmware.
- Such program modules or computer program instructions can be loaded onto a general purpose computer, a special purpose computer, or another type of programmable data processing apparatus to produce a machine, such that the instructions which execute on the computer or other programmable data processing apparatus create a means for implementing the functionality of disclosed herein.
- computer readable media can include but are not limited to magnetic storage devices (e.g., hard drive disk, floppy disk, magnetic strips . . . ), optical discs (e.g., compact disc (CD), digital versatile disc (DVD), blu-ray disc (BD) . . . ), smart cards, and flash memory devices (e.g., card, stick, key drive . . . ).
- magnetic storage devices e.g., hard drive disk, floppy disk, magnetic strips . . .
- optical discs e.g., compact disc (CD), digital versatile disc (DVD), blu-ray disc (BD) . . .
- BD blu-ray disc
- smart cards e.g., card, stick, key drive . . .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- User Interface Of Digital Computer (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
- This application is a continuation of, and claims priority to, U.S. patent application Ser. No. 14/827,515, filed Aug. 17, 2015, and entitled “ALWAYS-ON SENSOR DEVICE FOR HUMAN TOUCH,” the entirety of which application is hereby incorporated herein by reference.
- Conventional fingerprint sensing solutions are available and deployed in consumer products, such as smartphones and other type of mobile devices. Common fingerprint sensor technologies generally rely on (1) a sensor and (2) a processing element. When the sensor is turned on, the sensor can take or can direct the device to take an image, which is digitized (e.g., level of brightness is encoded into a digital format), and send the image to the processing element. The processing element can compare the image content to an existing database of recorded images in order to find a match to a pre-recorded fingerprint, for example. Yet, finger print sensors typically consume substantial amount of power (e.g., hundreds of μWatts to several mWatts) and, therefore, cannot be turned on continuously to prevent draining a device's battery too rapidly.
- The following presents a simplified summary of one or more of the embodiments in order to provide a basic understanding of one or more of the embodiments. This summary is not an extensive overview of the embodiments described herein. It is intended to neither identify key or critical elements of the embodiments nor delineate any scope of embodiments or the claims. This Summary's sole purpose is to present some concepts of the embodiments in a simplified form as a prelude to the more detailed description that is presented later. It will also be appreciated that the detailed description may include additional or alternative embodiments beyond those described in the Summary section.
- The present disclosure recognizes and addresses, in at least certain embodiments, the issue of power consumption and lack of a power efficient always-on approach to sensing and analyzing human touch at a device. In one embodiment, the disclosure provides a device that includes always-on circuitry configured to implement a first stage comprising first operations including: detecting touch of a specific area of a touch-screen display device; and predicting that the touch is associated with a human finger based on a touch criterion. In response to the predicting, the always-on circuitry is further configured to implement other first operations including generating a control signal configured to cause a processor to wake-up from a power-off mode or a sleep mode; and sending the control signal to the processor. The device also includes system circuitry configured to implement a second stage in response to the control signal, the second stage comprising second operations including: analyzing biometric data of a human body associated with the human finger.
- Other embodiments and various examples, scenarios and implementations are described in more detail below. The following description and the drawings set forth certain illustrative embodiments of the specification. These embodiments are indicative, however, of but a few of the various ways in which the principles of the specification may be employed. Other advantages and novel features of the embodiments described will become apparent from the following detailed description of the specification when considered in conjunction with the drawings.
-
FIG. 1 illustrates an example of an operational environment in accordance with one or more embodiments of the disclosure. -
FIG. 2 illustrates an example of a device in accordance with one or more embodiments of the disclosure. -
FIG. 3 illustrates an example of always-on circuitry in accordance with one or more embodiments of the disclosure. -
FIG. 4-6 illustrate examples of methods for monitoring human touch at a device in accordance with one or more embodiments of the disclosure. - The disclosure recognizes and addresses, in at least certain embodiments, the issue of power consumption and lack of a power efficient always-on approach to sensing and analyzing human touch at a device. To that end, embodiments of the disclosure permit or otherwise facilitate sensing of human touch that can be performed continually or nearly continually by separating a low-power detection stage from a full-power analysis stage. The detection stage is implemented continually or nearly continually and causes system circuitry to perform analysis of the human touch after the low-power detection stage has confirmed the human touch. Implementation of the low-power detection stage permits removal of physical actuation device (e.g., buttons or the like) while maintaining low power consumption. Absence of a physical actuation device does not hinder low-power consumption and does simplify user-device interaction when sensing human touch. While embodiments of the disclosure are illustrated with reference to a tablet computer, the disclosure is not limited in this respect and the embodiments of the disclosure can be applied to any device (mobile or otherwise) having a surface that is sensitive to touch and permits or otherwise facilitates control of the device by an end-user. Such a touch-sensitive surface can embody or can constitute, for example, a touch-screen display device. Mobile devices can be embodied in or can include consumer electronics devices (e.g., smartphones, portable gaming devices); vehicular devices (such as navigation and/or entertainment system device); medical devices; and the like. In addition, while some aspects of the disclosure are described with reference to a human finger and fingerprint analysis, embodiments of the disclosure are not so limited and can be applied, more generally, to the analysis of human body biometric data, such as blood pressure, pulse, blood pressure variation, blood flow parameters, etc., where a detail analysis of human touch at the device can be performed after a first stage detects that the device is (or, in some embodiments, has been) in contact with a human finger or other body part.
- When compared to conventional technologies, embodiments of the disclosure can provide numerous improvements. For example, splitting the sensing of human touch into a low-power, always-on detection stage and a triggered, full-power analysis stage permits sensing human touch continuously or nearly continuously, without causing battery drainage or other inefficiencies. Therefore, embodiments of the disclosure permit removal of physical actuation triggers that are present in typical consumer electronics products, thus simplifying user-device interaction while sensing human touch. More specifically, rather than asking an end-user to provide some activation trigger (such as pressing a button) before the fingerprint sensing is turned on, for example, the low-power detection stage of the disclosure is implemented continually and trigger analysis when human touch is detected. For another example, in view of the removal of physical actuation device for human sensing, embodiments of the disclosure provide greater flexibility of product design. In one embodiment, a touch-screen display device can be implemented with a uniform (and fixed) screen without a button press section. As such, the touch-screen display device can provide always-on sensing of human touch while providing larger viewing area and lower manufacturing cost for a product incorporating embodiments of this disclosure. In contrast, conventional sensor technology can operate 100% of the time if a physical trigger is not desired, which would impose prohibitive power consumption demands.
- With reference to the drawings,
FIG. 1 illustrates an example of an operational environment for sensing of human touch in accordance with one or more embodiments of the disclosure. As illustrated, adevice 110 includes a touch-screen display device 115 or other type of surface sensitive to touch. A human finger other body part, either represented by ahand 120, can touch a specific area of the touch-screen display device 115. The touch-screen display device 115 can be hard and need not include movable parts, such as a sensor button configured to detect human touch or otherwise cause thedevice 110 to respond to human touch. Thedevice 110 can include circuitry that can operate in response to touch (human or otherwise) of the touch-screen display device 115 (or, in some embodiments, the other type of touch sensitive surface). More specifically, in one implementation, thedevice 110 can include always-oncircuitry 130 andsystem circuitry 140. Such circuitry can be operatively coupled (e.g., electrically coupled, communicative coupled, etc.) via a bus architecture 135 (or bus 135) or conductive conduits configured to permit the exchange of signals between the always-oncircuitry 130 and thesystem circuitry 140. In some embodiments, a printed circuit board (PCB) placed behind the touch-screen display device 115 can include the always-oncircuitry 130, thesystem circuitry 140, and thebus 135. In one embodiment, the always-oncircuitry 130 and thesystem circuitry 140 can be configured or otherwise arranged in a single semiconductor die. In another embodiment, the always-oncircuitry 130 can be configured or otherwise arranged in a first semiconductor die and thesystem circuitry 140 can be configured or otherwise arranged in a second semiconductor die. In addition, in some embodiments, thebus 135 can be embodied in or can include a dedicated conducting wire or a dedicated data line that connects the always-oncircuitry 130 and thesystem circuitry 140. - The always-on
circuitry 130 can operate as sensor for human touch and thesystem circuitry 140, or a portion thereof, can permit or otherwise facilitate analysis of the human touch. The analysis can include fingerprint recognition or other types of biometric evaluations. The always-oncircuitry 130 can be energized or otherwise power-on continuously or nearly continuously and can be configured to monitor touch of the touch-screen display device 115. In addition, in response to human touch (e.g., touch by a human finger or other human body part), the always-on circuitry can be further configured to trigger detection and/or another type of analysis of elements of the human touch or a human body associated therewith. To at least that end, the always-oncircuitry 130 can be configured to implement a first stage, referred to Stage I 150, that can sense human touch and can generate trigger signaling in response. Stage I 150 can include numerous operations, including detecting touch of a specific area of a touch-screen display device 115. In some implementations, the touch can be detected according to information (e.g., data and/or signaling) received from a sensor (e.g., a capacitive sensor, a pressure sensor, a force sensor, an accelerometer, or the like) included in thedevice 110 and associated with the touch-screen display device 115. As such, in one example, detecting the touch can include utilizing static capacitive sensing of the touch. In addition or in another example, detecting the touch can include utilizing dynamic capacitive sensing of the touch. Further or in yet another example, detecting the touch can include utilizing optical imaging of the touch and/or ultrasonic imaging of the touch. Furthermore on in yet another example, detecting the touch can include utilizing pressure sensing of the touch. - In response to the detecting the touch, the operations of the Stage I 150 can include predicting that the touch is associated with a human body part (such as a finger) based on a touch criterion. As such, the always-on
circuitry 130 can be configured to determine, within a specific accuracy, that the touch is associated with a human touch. The specific accuracy can be associated with a technique relied upon to predict that the detected touch is associated with a human touch. In some implementations, predicting that the touch can be associated with a human touch can include one or more of: (i) determining that a force greater than a first predetermined threshold (e.g., about 0.005 N, about 0.05 N, or about 0.5 N) was exerted on a surface of the touch-screen display device; (ii) determining that a pressure greater than a second predetermined threshold (e.g., about 50 Pa, about 500 Pa, or about 5000 Pa) was exerted on the surface of the touch-screen display device; (iii) determining that the specific area overlaps with a predetermined number of pixels (e.g., about 1 Gigapixels to about 3 Gigapixels) of the touch-screen display device within a predetermined range; or (iv) determining that the touch caused a defined frequency response. In addition or in other implementations, predicting that the touch can be associated with a human touch (via a finger or other body part, for example) can include determining that a first frequency response of a mass that causes the touch to acoustic sound corresponds to a second frequency response of the human finger to the acoustic sound. - Stage I 150 also includes operations responsive to a prediction that the touch of the touch-
screen display device 115 is associated with a human touch. Specifically, in response to such a prediction,Stage I 150 includes generating trigger signaling (or, in some embodiments, other types of control signal) configured to direct or otherwise cause thesystem circuitry 140 or a portion thereof to wake up (e.g., to be energized) from a power-off mode or a sleep mode. In addition, Stage I 150 also can include sending the trigger signaling to thesystem circuitry 140 or the portion thereof (e.g., a processor). As such, the trigger signaling can act as a wake-up event for thesystem circuitry 140 or the portion thereof. - It is noted that implementation of Stage I 150 by the always-on
circuitry 130 can replace the button press operation of conventional technologies, particularly, yet not exclusively, because the always-oncircuitry 130 can operate as a low-power consumption element and, thus, can operate continuously or nearly continuously, without significantly impacting power consumption characteristics (e.g., battery life) of thedevice 110. For instance, in some examples, the always-oncircuitry 130 can consume about 10 to about 100 times less power than a conventional button-operated fingerprint sensor. Consumption of power of the always-oncircuitry 130 can be lower than conventional systems due to the implementation of theStage I 150 being directed to establishing that a human has touched the touch-screen display device 115, without analyzing features of the touch (such as fingerprints). Therefore, implementation of the Stage I 150 can provide with a qualitative assessment of a touch, which assessment can be performed using less information (e.g., data and/or signaling from a sensor) and less power consumption than implementation of quantitative assessments of the touch (e.g., full fingerprint analysis)—such as the assessment implemented by thesystem circuitry 140 at the second stage. In addition, as described herein, implementation of the Stage I 150 can provide a trigger that can switch on thesystem circuitry 140 and the associated implementation of a second stage described herein. As long as the touch algorithm does not trigger the second stage, thesystem circuitry 140 can remain operating in a power-save mode or a sleep mode in order to minimize energy consumption of thedevice 110. Thesystem circuitry 140 can receive the trigger signaling (or other type of control signal) and, in response, can be implement a second stage, referred to as Stage II 160, including operations for analysis of information (e.g., data and/or signaling) related to the human touch sensed by the always-oncircuitry 130. More specifically, in certain implementations, the Stage II 160 can include operations such as analyzing biometric data of a human body associated with a human finger or other type of body part associated with the sensed human touch. Implementation of the Stage II 160 can permit determining, using an outcome of the analyzing the biometric data, a fingerprint of the human finger. In addition or in other embodiments, the Stage II 160 can include operations such as determining, using an outcome of the analyzing such biometric data, one or more of a blood pressure of the human body, a pulse of the human body, a blood flow parameter of the human body, or a blood glucose level of the human body. Specifically, in one example, the Stage I 150 can include receiving the biometric data from a biometric sensor communicatively coupled (via a bus, for example) to the always-oncircuitry 130. As shown in the example embodiment inFIG. 2 , thedevice 110 the biometric sensor or another type of medical device can be include in a group of sensor device(s) 220. Such data can be received at the always-on-circuitry 130, without energizing thesystem circuitry 140. The Stage I 150 can further include sending the biometric data to thesystem circuitry 140 or a portion thereof from the always-oncircuitry 130. Such data can be sent, for example, in conjunction with the trigger signaling or other type of control information generated by the always-oncircuitry 130 in response to ascertaining that human touch has occurred at the device. - The always-on
circuitry 130 and thesystem circuitry 140 can have different complexity depending on numerous factors, such as type and/or form factor of thedevice 110. In one example, the always-oncircuitry 130 can be embodied in or can include an application specific integrated circuit (ASIC) configured to perform or facilitate performance of at least a portion of theStage I 150 described herein. In addition or in another example, the always-oncircuitry 130 can be embodied in or can include a register-transfer level (RTL) processing circuit configured to perform or facilitate performance of theStage I 150. Further or in yet another embodiment, the always-oncircuitry 130 can be embodied in or can include a field-programmable gate array (FPGA) configured to perform or facilitate performance of theStage I 150. Similarly, as an illustration, thesystem circuitry 140 can include an application processor and/or a processor of thedevice 110 or a host device that contains thesystem circuitry 140. - As described herein, in some embodiments, the always-on
circuitry 130 and thesystem circuitry 140 can be configured in a mobile device (e.g., a smartphone, a tablet computer, a laptop computer). In other embodiments, the always-oncircuitry 130 and thesystem circuitry 140 can be configured within a wearable device (e.g., a heart rate monitor, an insulin pump, or the like). It is noted that, in some scenarios, wearable devices may rely on or otherwise communicate with a mobile device (e.g., a smartphone, a tablet computer). Accordingly, in one of such scenarios, the always-oncircuitry 130 and thesystem circuitry 140 can be distributed between a wearable device and the mobile device. - As described herein, implementation of Stage I 150 can be straightforward and low-power, permitting always-on operation. It is noted that in embodiments of this disclosure, it may not be critical to add complexity to the Stage I 150 in order to incorporate false-positive detection, e.g., falsely triggering
Stage II 160. As long as false-positives are relatively few, a false-positive trigger of theStage II 160 would merely result in a negative fingerprint detection or other type of computational exception, therefore causing thesystem circuitry 140 to consume, unnecessarily, a small amount of power in such relatively rare occasions. Accordingly, false positives in theStage I 150 would have minor impact on battery life or other power resources of thedevice 110. -
FIG. 2 illustrates an example embodiment of thedevice 110 in accordance with one or more embodiments of the disclosure. In the illustrated embodiment, thedevice 110 includes the always-oncircuitry 130 operatively coupled tohardware 210 via abus architecture 205. Apower supply 260 can continually or nearly continually energize the always-oncircuitry 130. Thebus architecture 205 can include thebus 135 and can be embodied in or can include a system bus, an address bus, a control bus, a combination thereof, or the like. Thehardware 210 can include numerous functional elements (e.g., components, platforms, I/O interfaces, connector, adapters, or the like) that individually or in combination can provide specific functionality to thedevice 110. For instance, if thedevice 110 embodies a smartphone, thehardware 210 can include a radio unit (not shown) which can include antenna(s) and processing circuitry that can permit or otherwise facilitate wireless communication between thedevice 110 and other devices (e.g., a base station or a wireless computing device). For the sake of clarity, at least some of such functional elements are not shown. As illustrated, thehardware 210 includes the touch-screen display device 115 and thesystem circuitry 140. Thehardware 210 also includes one ormore sensors 220 and one or more memory devices 250 (collectively referred to as memory 250). - The
power supply 260 can energize at least a portion of thehardware 210 according with trigger signaling (or other type of control signal) provided (e.g., generated and transmitted) by the always-oncircuitry 130 in accordance with aspects of this disclosure. More specifically, in the illustrated embodiment, thesystem circuitry 140 can include a power controller 20 that can receive trigger signaling (e.g., a control instruction) and, in response, can energize at least one processor of the processor(s) 230 from a power-save state to a full-power state. In the illustrated embodiment, the at least one processor that transitions from the power-save state to the full-power state can execute one or more analysis module(s) 254 in order to analyze features (e.g., fingerprints) of a human associated with the human touch that triggered the trigger signaling. In addition, in the illustrated embodiment, one or more of the sensor device(s) 220 can provide biometric data to thesystem circuitry 140 in order for the at least one processor that is energized to extract biometric elements from the biometric data. Specifically, in one example, the at least one processor can execute one or more of the analysis module(s) 254 and, based on an outcome of the execution, the at least one processor can determine one or more of a blood pressure of the human body, a pulse of the human body, a blood flow parameter of the human body, or a blood glucose level of the human body. At least one of the analysis module(s) 254 can include computer-accessible instruction (e.g., computer-readable instructions and/or computer-executable instructions) that in response to execution by a processor can permit or otherwise facilitate thedevice 110 to implement a defined algorithm (or process) for fingerprint identification or analysis. In response to execution, in certain implementations, such instructions also can permit or otherwise facilitate thedevice 110 to perform other type of analysis related to a health condition of a human associated with a detected human touch. Thememory 250 also can include memory elements including data and/or instructions for analysis of human touch (e.g., fingerprint recognition, voice identification, or the like). - It is noted that in certain embodiments, at least one of the sensor(s) 220 can measure or otherwise collect biometric information in response to (e.g., during) the touch, such as it would be the case in which the
device 110 embodies or includes a medical device. Such information can be sent to the always-oncircuitry 130, which can send the biometric information to thesystem circuitry 140 in conjunction with, before, or after sending the trigger signaling. -
FIG. 3 illustrates an example embodiment of the always-oncircuitry 130 described herein. In the illustrated embodiment, the always-oncircuitry 130 includes adetection component 310 can figured to detect touch of a specific area of a touch-screen display device or another type of touch-sensitive surface of a device (e.g., device 110) in accordance with aspects described herein. Thedetection component 310 can receivesensor data 305 or other type of information indicative or otherwise representative of touch. Thesensor data 305 or the other information can be received from at least one of the sensor device(s) 220. In addition, in the illustrated embodiment, the always-oncircuitry 130 can include ananalysis component 320 to determine whether the touch is associated with a human finger or other human body part based at least on a touch criterion. To that end, in one example, theanalysis component 320 can process at least a portion of the receivedsensor data 305. In certain implementations, theanalysis component 320 can utilize or otherwise leverage imaging techniques (light and/or sound based techniques, for example). In addition or in other implementations, theanalysis component 320 can utilize or otherwise leverage acoustic techniques, such as monitoring a frequency response to an acoustic wave of an object that touches the touch-screen display device and comparing such a response to the typical frequency response of a human body (typical finger mass) to acoustic sound. Such a technique does not rely on any pixel level processing and, therefore, can be implemented without having to use full-processor capability, e.g., theanalysis component 320 can be embodied in firmware, such as a hard-coded RTL or an FPGA. - In response to ascertaining that the touch is associated with human touch, in the illustrated embodiment, the
analysis component 320 can direct or otherwise cause acontrol component 330 to generate acontrol signal 335. In one scenario, the control signal can be configured to cause a processor (e.g., one of processor(s) 230) or other portion of a system circuitry (e.g., system circuitry 140) operatively coupled to the always-oncircuitry 130 to wake-up from a power-off mode or a sleep mode. In the illustrated embodiment, thecontrol component 330 also is configured to send thecontrol signal 335 to the processor of the other portion of the system circuitry. - In view of the aspects described herein, example methods that can be implemented in accordance with this disclosure can be better appreciated with reference to
FIGS. 4-6 . For purposes of simplicity of explanation, example methods disclosed herein are presented and described as a series of acts; however, it is to be understood and appreciated that the disclosed subject matter is not limited by the order of acts, as some acts may occur in different orders and/or concurrently with other acts from that shown and described herein. For example, one or more example methods disclosed herein can alternatively be represented as a series of interrelated states or events, such as in a state diagram. Moreover, interaction diagram(s) may represent methods in accordance with the disclosed subject matter when disparate entities enact disparate portions of the methodologies. Furthermore, not all illustrated acts may be required to implement a described example method in accordance with the subject specification. Further yet, two or more of the disclosed example methods can be implemented in combination with each other, to accomplish one or more features or advantages described herein. It should be further appreciated that the example methods disclosed throughout the subject specification are capable of being stored on an article of manufacture to facilitate transporting and transferring such example methods to computers for execution, and thus implementation, by a processor or for storage in a memory. - Methods disclosed throughout the subject specification and annexed drawings are capable of being stored on an article of manufacture to facilitate transporting and transferring such methodologies to computers or other types of information processing machines for execution, and thus implementation, by a processor or for storage in a memory device or another type of computer-readable storage device. In one example, one or more processors that enact a method or combination of methods described herein can be utilized to execute programming code instructions retained in a memory device, or any computer- or machine-readable storage device or non-transitory media, in order to implement method(s) described herein. The programming code instructions, when executed by the one or more processor implement or carry out the various acts in the method(s) described herein. The programming code instructions provide a computer- or machine-executable framework to enact the method(s) described herein. More specifically, yet not exclusively, each block of the flowchart illustrations and/or combinations of blocks in the flowchart illustrations can be implemented by the programming code instructions.
-
FIG. 4 illustrates anexample method 400 for sensing human touch in accordance with one or more embodiments of the disclosure. As illustrated, respective portions of theexample method 400 can be implemented by the always-oncircuitry 130 and thesystem circuitry 140. Atblock 410, the always-oncircuitry 130 can detect touch of a specific area of a touch-screen display device or another type of touch-sensitive surface of a device (mobile or otherwise). Atblock 420, the always-on circuitry can determine whether a probability that the touch is associated with a human touch is greater than a defined threshold value. In response to ascertaining that such a probability is not greater than the defined threshold value (“No” branch), the always-oncircuitry 130 can implement exception handling atblock 425. In one instance, implementing the exception handling can include continuing assessing signals representative of touch of the touch-screen display device. In response to ascertaining that such a probability is greater than the defined threshold value (“Yes” branch), atblock 430, the always-on circuitry can generate a control signal configured to wake up or otherwise energize a processor from a power-off mode. While not illustrated, in some embodiments, the processor can be energized from a power-save mode. In one implementation, the control signal can be embodied in or can include an interrupt signal. In addition or in other implementations, the processor can be included in thesystem circuitry 140. Atblock 440, the always-oncircuitry 130 can send the control signal to thesystem circuitry 140. As described herein, the control signal can be sent via a bus or other type of communication conduit (vias, connectors, a combination thereof, or the like) that operationally couples the always-oncircuitry 130 and thesystem circuitry 140. - The
system circuitry 140 can receive the control signal and, in some embodiments, associated payload data. In response, thesystem circuitry 140 can energize the processor for operational power consumption. Specifically, in one example, thesystem circuitry 140 can supply an amount of power for the processor to provide or otherwise operate at full functionality. Atblock 460, thesystem circuitry 140 can analyze biometric data of a human associated with the human finger. -
FIG. 5 presents anexample method 500 for establishing that touch of a surface of a touch-screen device (or other type of touch-sensitive surface of the device) is associated with a human touch in accordance with one or more embodiments of the disclosure. In some embodiments, theexample method 500 can embody or can constitute an implementation ofblocks example method 400. As such, theexample method 500 can be implemented (e.g., executed) by a device including always-on circuitry in accordance with this disclosure. Atblock 510, the device can generate images of an object in proximity to the touch-screen device (or the other type of touch-sensitive surface). To at least that end, the device can include a camera and related processing circuitry (e.g., a graphical processing unit) configured to generate imaging information indicative or otherwise representative of the images. - At
block 520, the device can determine that a portion of the touch-screen display device (or the other type of touch-sensitive surface) is touched. In response to such a determination, atblock 530, the device can analyze at least one image of the images. The analysis can include, for example, application of computer-vision techniques to recognize an object that touched the touch-screen display device. Accordingly, the device can implement various image recognition processes in order to identify an object with a defined level of confidence (e.g., a defined probability). Atblock 540, the device that implements theexample method 500 can determine that the object is a human finger—or, in some instances, other human body part, such as a palm, a foot, or the like—based at least on the analyzed at least one image. -
FIG. 6 presents anexample method 600 for establishing that touch of a surface of a touch-screen device (or other type of touch-sensitive surface of the device) is associated with a human touch in accordance with one or more embodiments of the disclosure. In some embodiments, theexample method 600 can embody or can constitute an implementation ofblocks example method 400. As such, theexample method 500 can be implemented (e.g., executed) by a device including always-on circuitry in accordance with this disclosure. Atblock 610, the device can determine that a portion of a touch-screen display device is touched. In response to such a determination, atblock 620, the device can emit an acoustic wave (audible or otherwise). In certain implementations, the acoustic wave can be transmitted at low transmit power by a speaker or another type of haptic device configured to produce a pressure wave. It is noted that the disclosure is not so limited, and the device can emit the acoustic wave continuously, nearly continuously, periodically, or at scheduled times, without the emission being responsive to the touch. Atblock 630, the device can monitor frequency response of a scattered portion of the acoustic wave. The scattered portion of the acoustic wave can include reflections of the emitted acoustic wave from a surface of an object that touches the portion of the touch-screen display device. - At
block 640, the device can determine whether the monitored frequency response is comparable to a defined frequency response of a human body part (e.g., a human finger) to sound. For instance, the device can compare the spectral distribution of power of the scattered acoustic wave to a defined spectral power distribution of acoustic waves reflected from a human body part (e.g., a human finger). Based on the comparison, the device can determine if a difference between such distributions is greater than a defined threshold value or less than the defined threshold value. Differences less than the defined threshold can be deemed to be comparable. The difference can be determined at a certain frequency or piece-wise (e.g., for a metric of the spectral distribution integrated over a range of frequencies). - In response to a determination that the monitored frequency response is not comparable to the defined frequency response (“No” branch), the device can determine, at
block 650, that an object other than a human body part touched the touch-screen display device. In the alternative, in response to a determination that the monitored frequency response is comparable to the defined frequency response (“Yes” branch), the device can determine, atblock 660, that the human body part touched the touch-screen display device. - In the present description, for purposes of explanation, numerous specific details have been set forth in order to provide a thorough understanding of the disclosure. It may be evident, however, that the subject disclosure may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing the subject disclosure.
- As used in this disclosure, including the annexed drawings, the terms “component,” “system,” “platform,” “environment,” “unit,” “interface,” and the like are intended to refer to a computer-related entity or an entity related to an operational apparatus with one or more specific functionalities, wherein the entity can be either hardware, a combination of hardware and software, software, or software in execution. One or more of such entities are also referred to as “functional elements.” As an example, a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a server or network controller, and the server or network controller can be a component. One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers. Also, these components can execute from various computer readable media having various data structures stored thereon. The components can communicate via local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems via the signal). As another example, a component can be an apparatus with specific functionality provided by mechanical parts operated by electric or electronic circuitry, which is operated by a software, or firmware application executed by a processor, wherein the processor can be internal or external to the apparatus and executes at least a part of the software or firmware application. As yet another example, a component can be an apparatus that provides specific functionality through electronic components without mechanical parts, the electronic components can include a processor therein to execute software or firmware that provides at least in part the functionality of the electronic components. As further yet another example, interface(s) can include I/O components as well as associated processor, application, or Application Programming Interface (API) components. While the foregoing examples are directed to aspects of a component, the exemplified aspects or features also apply to a system, platform, interface, node, coder, decoder, and the like.
- In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless specified otherwise, or clear from context, “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, if X employs A; X employs B; or X employs both A and B, then “X employs A or B” is satisfied under any of the foregoing instances. Moreover, articles “a” and “an” as used in this specification and annexed drawings should generally be construed to mean “one or more” unless specified otherwise or clear from context to be directed to a singular form.
- In addition, the terms “example” and “such as” are utilized herein to mean serving as an instance or illustration. Any embodiment or design described herein as an “example” or referred to in connection with a “such as” clause is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the terms “example” or “such as” is intended to present concepts in a concrete fashion. The terms “first,” “second,” “third,” and so forth, as used in the claims and description, unless otherwise clear by context, is for clarity only and doesn't necessarily indicate or imply any order in time.
- The term “processor,” as utilized in this disclosure, can refer to any computing processing unit or device comprising, but not limited to comprising, single-core processors; single-processors with software multithread execution capability; multi-core processors; multi-core processors with software multithread execution capability; multi-core processors with hardware multithread technology; parallel platforms; and parallel platforms with distributed shared memory. Additionally, a processor can refer to an integrated circuit, an application specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic controller (PLC), a complex programmable logic device (CPLD), a discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. Processors can exploit nano-scale architectures such as, but not limited to, molecular and quantum-dot based transistors, switches and gates, in order to optimize space usage or enhance performance of user equipment. A processor may also be implemented as a combination of computing processing units.
- In addition, terms such as “store,” “data store,” data storage,” “database,” and substantially any other information storage component relevant to operation and functionality of a component, refer to “memory components,” or entities embodied in a “memory” or components comprising the memory. It will be appreciated that the memory components described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. Moreover, a memory component can be removable or affixed to a functional element (e.g., device, server).
- By way of illustration, and not limitation, nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms such as synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct Rambus RAM (DRRAM). Additionally, the disclosed memory components of systems or methods herein are intended to comprise, without being limited to comprising, these and any other suitable types of memory.
- Various embodiments described herein can be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. In addition, various of the aspects disclosed herein also can be implemented by means of program modules or other types of computer program instructions stored in a memory device and executed by a processor, or other combination of hardware and software, or hardware and firmware. Such program modules or computer program instructions can be loaded onto a general purpose computer, a special purpose computer, or another type of programmable data processing apparatus to produce a machine, such that the instructions which execute on the computer or other programmable data processing apparatus create a means for implementing the functionality of disclosed herein.
- The term “article of manufacture” as used herein is intended to encompass a computer program accessible from any computer-readable device, carrier, or media. For example, computer readable media can include but are not limited to magnetic storage devices (e.g., hard drive disk, floppy disk, magnetic strips . . . ), optical discs (e.g., compact disc (CD), digital versatile disc (DVD), blu-ray disc (BD) . . . ), smart cards, and flash memory devices (e.g., card, stick, key drive . . . ).
- What has been described above includes examples of one or more embodiments of the disclosure. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing these examples, and it can be recognized that many further combinations and permutations of the present embodiments are possible. Accordingly, the embodiments disclosed and/or claimed herein are intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the detailed description and the appended claims. Furthermore, to the extent that one or more of the terms “includes,” “including,” “has,” “have,” or “having” is used in either the detailed description or the claims, such term is intended to be inclusive in a manner similar to the term “comprising” as “comprising” is interpreted when employed as a transitional word in a claim.
Claims (23)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/883,370 US20180173927A1 (en) | 2015-08-17 | 2018-01-30 | Always-on sensor device for human touch |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/827,515 US9928398B2 (en) | 2015-08-17 | 2015-08-17 | Always-on sensor device for human touch |
US15/883,370 US20180173927A1 (en) | 2015-08-17 | 2018-01-30 | Always-on sensor device for human touch |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/827,515 Continuation US9928398B2 (en) | 2015-08-17 | 2015-08-17 | Always-on sensor device for human touch |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180173927A1 true US20180173927A1 (en) | 2018-06-21 |
Family
ID=56851694
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/827,515 Active 2035-12-28 US9928398B2 (en) | 2015-08-17 | 2015-08-17 | Always-on sensor device for human touch |
US15/883,370 Abandoned US20180173927A1 (en) | 2015-08-17 | 2018-01-30 | Always-on sensor device for human touch |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/827,515 Active 2035-12-28 US9928398B2 (en) | 2015-08-17 | 2015-08-17 | Always-on sensor device for human touch |
Country Status (4)
Country | Link |
---|---|
US (2) | US9928398B2 (en) |
EP (1) | EP3338171B1 (en) |
CN (1) | CN108351715B (en) |
WO (1) | WO2017031202A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190266382A1 (en) * | 2018-02-27 | 2019-08-29 | Beijing Xiaomi Mobile Software Co., Ltd. | Fingerprint acquisition method, apparatus and computer-readable storage medium |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101160681B1 (en) | 2011-10-19 | 2012-06-28 | 배경덕 | Method, mobile communication terminal and computer-readable recording medium for operating specific function when activaing of mobile communication terminal |
KR102575844B1 (en) * | 2016-04-05 | 2023-09-08 | 삼성전자주식회사 | Electronic device for displaying screen and method for controlling thereof |
US10880833B2 (en) * | 2016-04-25 | 2020-12-29 | Sensory, Incorporated | Smart listening modes supporting quasi always-on listening |
KR102561736B1 (en) * | 2016-06-01 | 2023-08-02 | 삼성전자주식회사 | Method for activiating a function using a fingerprint and electronic device including a touch display supporting the same |
WO2019007514A1 (en) * | 2017-07-06 | 2019-01-10 | Huawei Technologies Co., Ltd. | Electronic device |
US11983060B2 (en) * | 2021-10-15 | 2024-05-14 | Cypress Semiconductor Corporation | Systems and method for always-on sensing user interface |
Family Cites Families (67)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000172833A (en) * | 1998-12-10 | 2000-06-23 | Omron Corp | Finger print collating device |
US7067962B2 (en) | 2000-03-23 | 2006-06-27 | Cross Match Technologies, Inc. | Multiplexer for a piezo ceramic identification device |
US6720712B2 (en) | 2000-03-23 | 2004-04-13 | Cross Match Technologies, Inc. | Piezoelectric identification device and applications thereof |
US9342829B2 (en) * | 2002-10-01 | 2016-05-17 | Andrew H B Zhou | Systems and methods for mobile application, wearable application, transactional messaging, calling, digital multimedia capture and payment transactions |
KR100964559B1 (en) * | 2003-04-25 | 2010-06-21 | 삼성전자주식회사 | Fingerprinting device |
KR100561851B1 (en) | 2003-11-18 | 2006-03-16 | 삼성전자주식회사 | Fingerprint Sensor and Fabrication Method thereof |
US7109642B2 (en) | 2003-11-29 | 2006-09-19 | Walter Guy Scott | Composite piezoelectric apparatus and method |
WO2006042144A2 (en) | 2004-10-07 | 2006-04-20 | Ultra-Scan Corporation | Ultrasonic fingerprint scanning utilizing a plane wave |
US20070230754A1 (en) | 2006-03-30 | 2007-10-04 | Jain Anil K | Level 3 features for fingerprint matching |
CA2653202A1 (en) | 2006-05-25 | 2008-06-05 | Ultra-Scan Corporation | Biometrical object reader having an ultrasonic wave manipulation device |
WO2008007372A2 (en) * | 2006-07-12 | 2008-01-17 | N-Trig Ltd. | Hover and touch detection for a digitizer |
KR100849322B1 (en) * | 2006-11-20 | 2008-07-29 | 삼성전자주식회사 | Touch screen using image sensor |
JP2008305036A (en) * | 2007-06-06 | 2008-12-18 | Hitachi Displays Ltd | Display device with touch panel |
US20100256498A1 (en) | 2007-11-16 | 2010-10-07 | Hiroki Tanaka | Ultrasonic imaging device |
US9274681B2 (en) * | 2008-03-26 | 2016-03-01 | Lg Electronics Inc. | Terminal and method of controlling the same |
US20090274343A1 (en) | 2008-05-05 | 2009-11-05 | Sonavation, Inc. | Dynamic optimization of a biometric sensor |
US8515135B2 (en) | 2008-05-06 | 2013-08-20 | Sonavation, Inc. | PLL adjustment to find and maintain resonant frequency of piezo electric finger print sensor |
US20090279745A1 (en) | 2008-05-08 | 2009-11-12 | Sonavation, Inc. | Method and System for Image Resolution Improvement of Biometric Digit Imprint Sensors Using Staggered Rows |
US8335356B2 (en) | 2008-05-08 | 2012-12-18 | Sonavation, Inc. | Mechanical resonator optimization using shear wave damping |
US8805031B2 (en) | 2008-05-08 | 2014-08-12 | Sonavation, Inc. | Method and system for acoustic impediography biometric sensing |
GB0810179D0 (en) | 2008-06-04 | 2008-07-09 | Elliptic Laboratories As | Object location |
US9024507B2 (en) | 2008-07-10 | 2015-05-05 | Cornell University | Ultrasound wave generating apparatus |
US8385885B2 (en) * | 2008-10-17 | 2013-02-26 | Sony Ericsson Mobile Communications Ab | Method of unlocking a mobile electronic device |
US8508103B2 (en) | 2009-03-23 | 2013-08-13 | Sonavation, Inc. | Piezoelectric identification device and applications thereof |
WO2010110865A2 (en) | 2009-03-23 | 2010-09-30 | Sonavation, Inc. | Improved multiplexer for a piezo ceramic identification device |
US20100239751A1 (en) | 2009-03-23 | 2010-09-23 | Sonavation, Inc. | Sea of Pillars |
CN101882035B (en) * | 2009-05-04 | 2012-04-11 | 禾瑞亚科技股份有限公司 | Signal driving method of surface acoustic wave touch panel and device thereof |
US8786575B2 (en) * | 2009-05-18 | 2014-07-22 | Empire Technology Development LLP | Touch-sensitive device and method |
JP2012531036A (en) | 2009-06-19 | 2012-12-06 | ソナベーション, インコーポレイテッド | Method for manufacturing a piezoelectric ceramic body |
US8433110B2 (en) | 2009-12-11 | 2013-04-30 | Sonavation, Inc. | Pulse-rate detection using a fingerprint sensor |
JP2011170834A (en) * | 2010-01-19 | 2011-09-01 | Sony Corp | Information processing apparatus, operation prediction method, and operation prediction program |
US20120279865A1 (en) | 2010-11-04 | 2012-11-08 | Sonavation, Inc. | Touch Fingerprint Sensor Using 1-3 Piezo Composites and Acoustic Impediography Principle |
US20120016604A1 (en) | 2010-05-14 | 2012-01-19 | Sonavation, Inc. | Methods and Systems for Pointing Device Using Acoustic Impediography |
US8311514B2 (en) * | 2010-09-16 | 2012-11-13 | Microsoft Corporation | Prevention of accidental device activation |
EP2630507A2 (en) | 2010-10-19 | 2013-08-28 | Sonavation, Inc. | Electrical system, method, and apparatus of fingerprint sensor using acoustic impediography |
US9259961B2 (en) | 2010-12-10 | 2016-02-16 | Palo Alto Research Center Incorporated | Large-area ultrasound contact imaging |
CN102033666A (en) * | 2010-12-21 | 2011-04-27 | 富泰华工业(深圳)有限公司 | Input equipment, electronic device with input equipment and input method |
US9246221B2 (en) * | 2011-03-07 | 2016-01-26 | Apple Inc. | Tunable loop antennas |
TW201306337A (en) | 2011-04-08 | 2013-02-01 | Sonavation Inc | System and method for depositing material on a piezoelectric array |
TWI461988B (en) * | 2011-06-15 | 2014-11-21 | Pixart Imaging Inc | Optical touch device |
US8928635B2 (en) * | 2011-06-22 | 2015-01-06 | Apple Inc. | Active stylus |
US8836472B2 (en) | 2011-11-23 | 2014-09-16 | Blackberry Limited | Combining navigation and fingerprint sensing |
KR101320138B1 (en) | 2011-11-30 | 2013-10-23 | 삼성전기주식회사 | Fingerprint sensor and manufacturing method thereof |
KR101288178B1 (en) | 2011-11-30 | 2013-07-19 | 삼성전기주식회사 | Sensor and method for detecting fingerprint |
US8723399B2 (en) | 2011-12-27 | 2014-05-13 | Massachusetts Institute Of Technology | Tunable ultrasound transducers |
BR112014019107B1 (en) | 2012-02-02 | 2021-05-04 | Qualcomm Incorporated | TOUCH-SCREEN DISPLAY AND METHOD TO COLLECT INFORMATION ON AN OBJECT THAT IS IN CONTACT WITH A TOUCH-SCREEN MONITOR |
TWI464651B (en) * | 2012-07-16 | 2014-12-11 | Wistron Corp | Optical touch system and touch object separating method thereof |
TWI489350B (en) * | 2012-10-01 | 2015-06-21 | 原相科技股份有限公司 | Optical touch apparatus and image capturing apparatus |
TWI464629B (en) * | 2012-10-17 | 2014-12-11 | Pixart Imaging Inc | Coordinate positioning module, optical touch system, method of detecting power of an active stylus, and method of switching modes of the active stylus |
US9218472B2 (en) | 2012-12-20 | 2015-12-22 | Google Technology Holdings LLP | Piezo based fingerprint sensor structure |
US9607206B2 (en) | 2013-02-06 | 2017-03-28 | Sonavation, Inc. | Biometric sensing device for three dimensional imaging of subcutaneous structures embedded within finger tissue |
US9262003B2 (en) | 2013-11-04 | 2016-02-16 | Qualcomm Incorporated | Piezoelectric force sensing array |
US20140355387A1 (en) | 2013-06-03 | 2014-12-04 | Qualcomm Incorporated | Ultrasonic receiver with coated piezoelectric layer |
US9678591B2 (en) * | 2013-06-10 | 2017-06-13 | The Board Of Trustees Of The Leland Stanford Junior University | Method and apparatus for sensing touch |
CN105378756B (en) | 2013-07-16 | 2020-05-08 | 加利福尼亚大学董事会 | MUT fingerprint ID system |
US9984270B2 (en) | 2013-08-05 | 2018-05-29 | Apple Inc. | Fingerprint sensor in an electronic device |
EP4071589A1 (en) | 2013-12-12 | 2022-10-12 | QUALCOMM Incorporated | Micromechanical ultrasonic transducers and display |
US9412002B2 (en) * | 2013-12-26 | 2016-08-09 | Intel Corporation | Wearable electronic device having a fingerprint identification display |
KR101700998B1 (en) | 2014-01-02 | 2017-01-31 | 삼성전기주식회사 | Sensor for detecting fingerprint and electronic device including the same |
WO2015112452A1 (en) | 2014-01-24 | 2015-07-30 | The Regents Of The University Of California | Curved piezoelectric transducers |
KR102171082B1 (en) | 2014-02-06 | 2020-10-28 | 삼성전자주식회사 | Method for processing fingerprint and an electronic device thereof |
EP3103191B1 (en) | 2014-02-07 | 2018-07-11 | The Regents of the University of California | Frequency tuning and/or frequency tracking of a mechanical system with low sensitivity to electrical feedthrough |
WO2015131083A1 (en) | 2014-02-28 | 2015-09-03 | The Regents Of The University Of California | Variable thickness diaphragm for a wideband robust piezoelectric micromachined ultrasonic transducer (pmut) |
WO2015138670A1 (en) | 2014-03-14 | 2015-09-17 | Corning Incorporated | Sensor embedded in glass and process for making same |
KR102283922B1 (en) | 2014-04-02 | 2021-07-30 | 삼성디스플레이 주식회사 | Touch sensor |
KR102257287B1 (en) * | 2014-08-07 | 2021-05-27 | 삼성전자주식회사 | Method and apparatus for authenticating user using fingerprint and ecg signal |
US20160078269A1 (en) * | 2014-09-15 | 2016-03-17 | Fingerprint Cards Ab | Fingerprint sensor with sync signal input |
-
2015
- 2015-08-17 US US14/827,515 patent/US9928398B2/en active Active
-
2016
- 2016-08-17 EP EP16758326.9A patent/EP3338171B1/en active Active
- 2016-08-17 WO PCT/US2016/047334 patent/WO2017031202A1/en active Application Filing
- 2016-08-17 CN CN201680054066.6A patent/CN108351715B/en active Active
-
2018
- 2018-01-30 US US15/883,370 patent/US20180173927A1/en not_active Abandoned
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190266382A1 (en) * | 2018-02-27 | 2019-08-29 | Beijing Xiaomi Mobile Software Co., Ltd. | Fingerprint acquisition method, apparatus and computer-readable storage medium |
US10824844B2 (en) * | 2018-02-27 | 2020-11-03 | Beijing Xiaomi Mobile Software Co., Ltd. | Fingerprint acquisition method, apparatus and computer-readable storage medium |
Also Published As
Publication number | Publication date |
---|---|
WO2017031202A1 (en) | 2017-02-23 |
US9928398B2 (en) | 2018-03-27 |
EP3338171B1 (en) | 2022-03-02 |
CN108351715B (en) | 2022-04-05 |
EP3338171A1 (en) | 2018-06-27 |
US20170053152A1 (en) | 2017-02-23 |
CN108351715A (en) | 2018-07-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3338171B1 (en) | Always-on sensor device for human touch | |
CN110235086B (en) | Electronic equipment and fingerprint identification method thereof | |
CN107209855B (en) | Authenticating a user by fingerprint identification | |
KR102501243B1 (en) | Electronic apparatus and operating method thereof | |
KR102322683B1 (en) | Electronic device and method for identifying falsification of biometric information | |
CN105260105B (en) | Display screen awakening method, device and mobile terminal based on fingerprint sensor | |
US9824200B2 (en) | Wakeup strategy using a biometric sensor | |
CN106066986B (en) | Method and apparatus for sensing a fingerprint | |
US9665762B2 (en) | Tiered wakeup strategy | |
TWI557649B (en) | Electronic device and control method for fingerprint recognition apparatus | |
US8311514B2 (en) | Prevention of accidental device activation | |
EP3358455A1 (en) | Apparatus and method for controlling fingerprint sensor | |
TWI652628B (en) | Method and device for fingerprint recognition | |
US20150149801A1 (en) | Complex wakeup gesture framework | |
KR102652844B1 (en) | Method for detecting missing finger and fingerprint detection device | |
EP3416096B1 (en) | Iris recognition method, electronic device and computer-readable storage medium | |
WO2018227472A1 (en) | Screen wake-up method and apparatus, and terminal device | |
KR20180074983A (en) | Method for obtaining bio data and an electronic device thereof | |
KR102574772B1 (en) | Method for regstering and authenticating bio data and an electronic device thereof | |
KR20170003369A (en) | Terminal for fingerprint identification | |
US20150116288A1 (en) | Method and apparatus for stroke acquisition and ultrasonic electronic stylus | |
US20230280861A1 (en) | System and Method for Detecting Imperfections in a Screen | |
CN111406427B (en) | Method for switching device controllers included in electronic device and electronic device | |
US10467453B2 (en) | Method, apparatus and system for fingerprint identification | |
EP2829947B1 (en) | Apparatus and method pertaining to the use of a plurality of 3D gesture sensors to detect 3D gestures |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INVENSENSE, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MEDINA, EITAN A.;REEL/FRAME:044767/0848 Effective date: 20150814 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |