WO2017204968A1 - Wearable computer apparatus with same hand user authentication - Google Patents

Wearable computer apparatus with same hand user authentication Download PDF

Info

Publication number
WO2017204968A1
WO2017204968A1 PCT/US2017/029394 US2017029394W WO2017204968A1 WO 2017204968 A1 WO2017204968 A1 WO 2017204968A1 US 2017029394 W US2017029394 W US 2017029394W WO 2017204968 A1 WO2017204968 A1 WO 2017204968A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
virtual grid
wrist
access
wearable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2017/029394
Other languages
French (fr)
Inventor
Marcio JULIATO
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intel Corp
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Publication of WO2017204968A1 publication Critical patent/WO2017204968A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06Authentication
    • H04W12/065Continuous authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/30Security of mobile devices; Security of mobile applications
    • H04W12/33Security of mobile devices; Security of mobile applications using wearable devices, e.g. using a smartwatch or smart-glasses
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/08Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/083Network architectures or network communication protocols for network security for authentication of entities using passwords
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/60Context-dependent security
    • H04W12/68Gesture-dependent or behaviour-dependent

Definitions

  • the present disclosure relates to the fields of computing. More
  • the present disclosure is related to same hand user authentication, particularly suitable for wearable computer devices, such as smart watches,
  • touching the screen has to be the other hand opposite to the wrist wearing the computer device.
  • the user's other hand may be busy, and thus require extra effort of the user to authenticate himself/herself before the user is able to gain access to the wearable computer device, and perform the desired function.
  • Figure 1 illustrates a perspective view of a wearable computer device equipped with the same hand user authentication technology of the present disclosure, in accordance with various embodiments.
  • Figures 2 and 3 illustrate two example sensor signal patterns for two example finger movements over a 3x3 virtual grid, in accordance with various embodiments.
  • Figure 4 illustrates possible finger movements across a 3x3 virtual grid, in accordance with alternate embodiments.
  • FIG. 5 illustrates example feedback by the wearable computer device, in accordance with various embodiments.
  • Figure 6 illustrates example architecture of the wearable computer device, in accordance to various embodiments.
  • FIGS 7 and 8 illustrate example operation flow/algorithmic architecture of the user authentication module, in accordance to various embodiments.
  • FIGS 9-11 illustrate an example 4x3 virtual grid suitable for partem, PIN or password authentication, in accordance with various embodiments.
  • an apparatus wearable on a user's wrist, may include a processor with one or more processor cores, and a user authentication module to be operated by the processor to authenticate and grant access to the user.
  • the user authentication module may be configured to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the apparatus based at least in part on a result of the analysis.
  • the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn, i.e. the same hand wearing the wearable computer device.
  • the sensor data may include sensor data collected by sensors configured to measure tendon/muscle positions of the wrist on which the apparatus is worn.
  • phrase “A and/or B” means (A), (B), or (A and B).
  • phrase “A, B, and/or C” means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C).
  • module or “routine” may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
  • ASIC Application Specific Integrated Circuit
  • processor shared, dedicated, or group
  • memory shared, dedicated, or group
  • a user wearing a computer device 102 such as a smart watch or a smartphone, equipped with the same hand user authentication technology of the present disclosure, may authenticate himself/herself and gain access to wearable computer device 102, by moving a finger 106 over a virtual grid 104 forming a pattern that corresponds to or matches an access control reference partem.
  • finger 106 may be a finger of the same hand 108 adjoining wrist 110, on which computer device 102 is worn.
  • virtual gird 104 may be an imaginary grid in free space. Accordingly, the user may authenticate
  • wearable computer device 102 may include a number of sensors 122, sensor driver 123, and a user authentication module 124, configured to cooperate with each other to provide the single-handed or same hand user authentication capabilities. More specifically, sensors 122 may be configured to continuously sense the positions of tendons and muscles around wrist 110, wherein computer device 102 is worn, and continuously output signals representative of the positions sensed. Sensor driver 123 may be configured to process the signals, and continuously output sensor data indicative of successive positions sensed. User authentication module 124 may in turn receive these sensor data, and analyze the sensor data to determine movements of user finger 106 over virtual grid 104 and the partem formed by the movements.
  • finger 106 is of the same hand adjoining wrist 110 where computer device 102 is worn.
  • user authentication module 124 may determine whether the pattern formed corresponds to or matches with an access control reference pattern, and authenticate and grant the user access to computer device 102, or deny access, based at least in part on the a result of the analysis against the access control reference pattern.
  • sensors 122 may comprise of two strips or rows of pressure sensors 142 and 144.
  • Sensors 142 may be configured to continuously sense positions of tendons/muscles at wrist 110 through the upper (or anterior) surface of wrist 110 and output corresponding signals
  • sensors 144 may be configured to sense positions of tendons/muscles at wrist 110 through the under (or posterior) surface of wrist 110 and output corresponding signals.
  • Sensor driver 123 processes and combines both sets of signals to output sensor data indicative of the positions of the tendons/muscles at wrist 110.
  • User authentication module 124 in turn processes the sensor data to determine the position and movement of finger 106 over virtual grid 104.
  • user authentication module 124 may be configured to determine the position and movement of finger 106 over virtual grid 104, using a set of reference sensor data patterns for various movements over virtual grid 104.
  • the sensing of positions of tendons/muscles through the upper (or anterior) and the under (or posterior) surfaces, and usage of such sensed signals to determine finger and/or hand position are described further in U.S. Patent Application 15/087,385, filed March 31, 2016, entitled “Sensor Signal Processing to Determine Finger and/or Hand Position”; and in PCT Patent Application PCT/US2015/067534, filed Dec 22, 2015, entitled “System and Method to Collect Gesture Input Through Wrist Tendon and Muscle Sensing".
  • the Specifications of USPA 15/087,385 and PCT/US2015/067534 are fully incorporated herein by reference.
  • sensors 142 may be disposed at a bottom surface of main body 134 that touches the upper (or anterior) surface of wrist 110, and sensors 144 may be disposed at a portion of band 132 that touches the under (or posterior) surface of wrist 110.
  • sensors 142 may be disposed at a portion of band 132 that touches the upper (or anterior) surface of wrist 110, and sensors 144 may be disposed at a portion of band 132 that touches the posterior (or under) surface of wrist 110.
  • sensors 142 may be disposed at the internal portion of external band 152 (that is not part of computer device 102) that touches the upper (or anterior) surface of wrist 110, and sensors 144 may be disposed at the internal portion of external band 152 that touches the posterior (or under) surface of wrist 110.
  • virtual grid 104 may be a 3x3 virtual grid, which may comprise 9 cells organized into 3 rows and 3 columns.
  • the 9 cells may be referred to as the top left (TL) cell, top center (TC) cell, top right (TR) cell, center left (CL) cell, center (CC) cell, center right (CR) cell, bottom left (BL) cell, bottom center (BC) cell, and bottom right (BR) cell.
  • TL top left
  • TC top center
  • TR center left
  • CL center
  • CC center right
  • CR center right
  • bottom left (BL) cell bottom center (BC) cell
  • BR bottom right
  • Figure 2 illustrates an example signal partem 200 when thumb 106 is first placed at cell CL, traverse along the CL-CC-CR row to cell CC, then cell CR.
  • Each line in Figure 2 depicts the signal level of a corresponding sensor as thumb 106 moves from cell CL, along the CL-CC-CR row to cell CC, then cell CR.
  • Figure 3 illustrates an example signal pattern when thumb 106 is first placed at cell TC, traverse along the TC-CC-BC column to cell CC, then cell BC.
  • each line in Figure 3 depicts the signal level of a corresponding sensor as thumb 106 moves from cell TC, along the TC-CC-BC column to cell CC, then cell BC.
  • Figure 4 illustrates possible finger movements across the 3x3 virtual grid, in accordance with various embodiments.
  • a user may also move finger 106 vertically, up and down any one of the columns of virtual grid 104, or horizontally, back and forth across any one of the rows of virtual grid 104.
  • a user may move finger 106 diagonally in any one of a number of angular manners across the various cells of virtual grid 104.
  • a cell within the 3x3 virtual grid may be selected with a pre-determined finger movement, while the finger is positioned over the cell. For example, in embodiments where the 3x3 virtual grid is traversed using the thumb, selection of a cell may be indicated by moving the thumb towards the palm while the thumb is position over the cell.
  • user authentication module 124 may be configured to support a configuration mode and an operation mode.
  • the configuration mode may have various configuration points or periods, where different aspects of the single handed/same hand authentication technology of the present disclosure may be configured/defined. In embodiments, these
  • configuration points or periods may include a point where finger 106 to be used to perform the pattern traversal may be selected/identified, and a first period where the free space occupied by virtual grid 102 (and its cells) may be defined. Further, these configuration points or periods may include a second period where the signal patterns for various movements of finger 106 over virtual grid 102 may be recorded, and a third period where the reference pattern to be used to control access to computer device 102 may be defined.
  • finger 106 to be used to perform the partem traversal may be selected/identified through movement of one of the fingers. For example, a user may move the finger he/she wants to use to traverse virtual grid 104, in response to a prompt from user authentication module 122.
  • the free space occupied by virtual grid 102 may be defined through movement of the selected/identified finger 106.
  • a user may use the selected/identified finger 106 to trace the perimeter of virtual grid 102, in response to a prompt from user authentication module 122.
  • the number of cells within the virtual grid may be defined. For example, a user may enter (type in, via voice command, or select from pre-selected options) the configuration or the number of cells, or use the selected/identified finger 106 to partition virtual grid 102, in response to a prompt from user authentication module 122.
  • the free space occupied by the cells may be computed from the free space defined for virtual grid 104. For example, for a 3x3 virtual grid, the free space occupied by the cells may be computed by dividing the free space defined for virtual grid 104 into 9 equal portions in a 3x3 configuration.
  • the signal patterns for various movements of finger 106 may be captured.
  • a user may use the selected/identified finger 106 to move vertically, horizontally or diagonally across virtual grid 104, in response to various prompts by user authentication module 124.
  • the reference pattern to be used to control access to computer device 102 may be defined through movement of the selected/identified finger 106 over virtual grid 104. For example, a user may use the
  • the different configuration point/periods to select/identify finger 106, define virtual grid 104, record the signal patterns, or define the reference pattern may be consecutive, with the selection/identification and recording/definitions being performed successive, or may be entered independently to allow any of these selection/identification, recordings and definitions to be performed and/or repeated (e.g., periodic changing the access control reference pattern).
  • the identification of finger 106, the free space definition of virtual grid 104, the movement signal patterns recorded, and the access control reference pattern defined may be stored locally in wearable computer device 102.
  • the identification of finger 106, the free space definition of virtual grid 104, the movement signal patterns recorded, and/or the access control reference pattern defined may be stored in a cloud server (not shown), accessible to wearable computer device 102, e.g., through wireless communication.
  • the main body /housing of smart watch may have other shapes, e.g. a rectangular shape.
  • these illustrative embodiments should not be construed as limiting on the single
  • user authentication module 124 may also be configured to provide feedback to the user, as the user endeavors to use finger 106 to traverse virtual grid 104 with movements to form a pattern that corresponds or matches an access control reference pattern, to authenticate himself/herself to gain access to wearable computer device 102.
  • Figure 5 illustrates example feedback by a
  • wearable computer device 102 in accordance with various embodiments. As shown, in response to a particular predetermined movement of hand 108 or finger 106 that signal the user's desire to authenticate himself/herself to gain access, wearable computer device 102 may wake up from an idle or sleep state, enter the operation mode, and render display 500 that graphically or pictorially represents virtual grid 104. As the user moves finger 106 to form a partem that corresponds or matches the access control reference pattern, the movement path 502, as
  • user authentication module 124 may also be displayed for the user. Accordingly, the user may be aided in his/her endeavor to provide the corresponding/matching partem to gain access. In embodiments, similar visual feedbacks may be provided to the user during the configuration mode, for
  • wearable computer device 600 (which may be wearable computer device 102) may include hardware 602 and software 604.
  • Software 604 may include operating system (OS) 634 and application 632.
  • OS 634 may include user authentication module 644 and sensor driver 643, which may correspond to the earlier described user authentication module 144 and sensor driver 143.
  • OS 634 except for user authentication module 644 and sensor driver 643, may be any one of a number of wearable computer device OS known in art.
  • user authentication module 644 can conceived as a firmware or any other kind of embedded software dedicated to perform dedicated tasks.
  • Applications 632 may likewise be any one of a number of known applications for wearable computer devices, e.g., personal health application, calendar or other personal information management (PIM) applications.
  • PIM personal information management
  • Hardware 602 may include processor(s) 612, memory 6144, persistent storage 616, sensors 618, display 620, and communication interface 622.
  • Processor(s) 612 may be any one of a number of processors known in the art, each having one or more processor cores.
  • Memory 614 may be any known volatile or non-volatile memory in the art, suitable for storing instructions for execution and working data, in particular, instructions and data of applications 632 and OS 634, including user authentication module 644 and sensor driver 643.
  • Memory 614 may include a hierarchy of cache memory and system memory. Both the cache and system memory may be respectively organized into segments and pages.
  • Persistent storage 616 may be any known persistent mass storage suitable for providing persistent storage of instructions and data of applications 632 and OS 634, e.g., solid state storage, magnetic or optical disk drives.
  • Sensors 618 may include the earlier described sensors 142 and 144 for sensing position of tendons/muscles.
  • Display 620 may be any known display device, including e.g., touch sensitive screen.
  • Communication interface 622 may include any number of wireless communication or networking interfaces known, such as WiFi, 3G/4G, Bluetooth®, Near Field Communication, LiFi, and so forth.
  • user authentication module 144/642 may be configured with operating flow/algorithmic structure 700 for configuring various aspects of the single handed/same hand user authentication technology.
  • flow/algorithmic structure 700 may begin at/with block 702.
  • the finger to be used to traverse the virtual grid to provide the access control authentication may be selected/identified.
  • a prompt may be made of the user to move the finger to be used to traverse the virtual grid to provide the access control partem.
  • the virtual grid may be defined.
  • a prompt may be made of the user to move the finger to trace the free space to define the perimeter of the virtual grid. Further, a prompt may be made of the user to identify the configuration or cells of the virtual grid.
  • the sensor signal patterns of the various finger movement patterns over the virtual grid may be recorded.
  • a number of prompts may be made of the user to move the finger horizontally across various rows, vertically up and down various columns, and diagonally/angularly across various cells of the virtual grid.
  • the access control reference pattern may be defined.
  • a prompt may be made of the user to move the finger over the virtual grid to define the access control reference pattern.
  • user authentication module 144/642 may be configured with operating flow/algorithmic structure 800 for authenticating and granting access to the wearable computer device to a user or denying access to the wearable computer device to the user.
  • Operating flow/algorithmic structure 800 may begin at/with block 802.
  • block 802 on entry into an operational mode (from an idle/sleep state), a graphical representation of the virtual grid may be displayed.
  • sensor data indicative of positions of tendons/muscles of the wrist on which the computer device is worn may be received and analyzed to determine the finger position over the virtual grid.
  • visual feedback on the movement path may be provided.
  • a determination may be made on whether the movement path provided thus far corresponds or matches the access control reference pattern. If a result of the determination indicates that the movement path provided thus far corresponds or matches the access control reference pattem, operation/algorithm flow 800 may proceed to block 810. At block 810, the user may be authenticated, and access to the wearable computer device granted.
  • operation/algorithm flow 800 may return to block 804 and continue there from for additional sensor data.
  • operation/algorithm flow 800 may proceed to block 812.
  • visual feedback such as an error message and/or an alarm, may be provided to convey authentication failure, and access to the wearable computer device denied.
  • FIGS 9-11 illustrate an example 4x3 virtual grid suitable for PIN or password authentication, in accordance with various embodiments.
  • 4x3 virtual grid 900 may comprise 4 rows and 3 columns.
  • the cells of the top three rows may be similarly referred to as TL, TC, TR, CL, CC, CR, BL, BC and BR as before.
  • the cells of the 4 th row may be respectively referred to as cell AL, AC and AR.
  • user authentication module 144/644 may interpret the 12 cells as a 12-keys numeric keypad 1000 (Figure 10), with cells TL, TC and TR correspond to the numbers 1, 2 and 3; cells CL, CC and CR correspond to the numbers 4, 5, and 6; cells BL, BC and BR correspond to the numbers 7, 8 and 9, and cell AC corresponds to the number 0. Further, cells AL and AR may respectively correspond to special keys Backspace or asterisk (*), and Enter or #.
  • user authentication module 144/644 may support multi- tap allowing the 12 cells to be interpreted as 12-keys alphanumeric keypad 1100 (Figure 11).
  • a single tap of cell TC may correspond to the letter "A”
  • two taps may correspond to the letter “B”
  • three taps may correspond to the letter “C”
  • cells TC and TR may respectively correspond to letters “ABC” and “DEF”
  • cells CL, CC and CR may respectively correspond to letters “GHI,” “JKL,” and “MNO”
  • cells BL, BC and BR may respectively correspond to letters "PQR,” "STU,” and "WXYZ.”
  • a determination may be made on whether the movement path provided thus far corresponds or matches an access PIN or password. If a result of the determination indicates that the movement path provided thus far corresponds or matches the access PIN or password, the user may be authenticated, and access to the wearable computer device granted. On the other hand, if a result of the determination indicates that the movement path provided thus far does not correspond or match the access PIN or password, and the number of cells touched is below the number of cells needed to provide the corresponding or matching PIN or password, additional sensor data may be collected. However, if a result of the determination indicates that the movement path provided thus far does not
  • alarm may be provided to convey authentication failure, and access to the
  • module 144/644 may provide visual feedback similar to the graphical user interface 144/644
  • 612 may be packaged together with a computer-readable storage medium having sensor driver 643 and/or user authentication module 644 (in lieu of storage in
  • processors 612 may be packaged together with a computer-readable storage medium having sensor driver 643 and/or user authentication module 644 to form a System in
  • processors 612 may be any type of processors 612 .
  • processors 612 may be any type of processors 612 .
  • processors 612 may be packaged together with a computer-readable storage medium having sensor driver 643 and/or user authentication module 644 to form a System on Chip (SoC).
  • SoC System on Chip
  • example embodiments described may include:
  • Example 1 may be an apparatus for computing, comprising: a processor having one or more processor cores; and a user authentication module to be operated by the processor to authenticate and grant access to a user of the apparatus.
  • the apparatus may be wearable on a user's wrist.
  • the user authentication module may be configured to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the apparatus based at least in part on a result of the analysis.
  • the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn.
  • Example 2 may be example 1, wherein the virtual grid may comprise a 3x3 virtual grid, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference partem.
  • Example 3 may be example 1, wherein the virtual grid may comprise a 4x3 virtual keypad, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
  • PIN personal information number
  • Example 4 may be example 1 , wherein the one or more fingers may comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
  • Example 5 may be example 1 , further comprising a sensor driver to be operated by the processor to receive sensor signals representative of tendon or muscle positions of the wrist, and process the sensor signals to output the sensor data for the user authentication module.
  • a sensor driver to be operated by the processor to receive sensor signals representative of tendon or muscle positions of the wrist, and process the sensor signals to output the sensor data for the user authentication module.
  • Example 6 may be example 5, wherein the apparatus may further comprise a plurality of sensors coupled to the processor to sense and output the senor signals representative of the tendon or muscle positions of the wrist.
  • Example 7 may be example 6, wherein the apparatus may be a smart watch having a watch band, and the plurality of sensors may be disposed on the watch band.
  • Example 8 may be example 5, wherein the apparatus may further comprise a communication interface to receive sensor signals from an external wrist band having a plurality of sensors to sense and output the senor signals representative of the tendon or muscle positions of the wrist, and process the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus.
  • Example 9 may be any one of examples 1-8, wherein the user authentication module may be configured to further provide visual feedbacks to the user to assist the user in traversing the virtual grid.
  • Example 10 may be example 9, wherein to provide visual feedbacks may comprise to display a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
  • Example 1 1 may be a method for computing, comprising: receiving, by a wearable computer device, sensor data indicative of movements of one or more fingers of a user of the wearable computer device over a virtual grid; analyzing, by the wearable computer device, the sensor data to determine the movements; and authenticating and granting the user access or denying the user access to the wearable computer device, based at least in part on a result of the analysis.
  • the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the wearable computer device is worn.
  • Example 12 may be example 1 1, wherein the virtual grid may comprise a 3x3 virtual grid, and authenticating and granting access may comprise authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
  • Example 13 may be example 1 1, wherein the virtual grid may comprise a 4x3 virtual keypad, authenticating and granting access may comprise authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
  • PIN personal information number
  • Example 14 may be example 1 1, wherein the one or more fingers may comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
  • Example 15 may be example 11 , wherein receiving may comprise receiving sensor signals representative of tendon or muscle positions of the wrist, and processing the sensor signals to output the sensor data.
  • Example 16 may be example 15, further comprising sensing and outputting the senor signals representative of the tendon or muscle positions of the wrist.
  • Example 17 may be example 16, wherein the wearable computer device may be a smart watch having a watch band, and the plurality of sensors may be disposed on the watch band.
  • Example 18 may be example 15, wherein receiving may comprise receiving sensor signals from an external wrist band having a plurality of sensors to sense and output the sensor signals representative of the tendon or muscle positions of the wrist, and processing the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus.
  • Example 19 may be any one of examples 1 1-18, further comprising providing, by the wearable computer device, visual feedbacks to the user to assist the user in traversing the virtual grid.
  • Example 20 may be example 19, wherein providing visual feedbacks may comprise displaying a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
  • Example 21 may be one or more computer-readable media comprising instructions that cause a computer device, in response to execution of the instructions by one or more processor cores of the computer device, to provide a user authentication module to authenticate and grant access to a user of the apparatus; wherein the apparatus is wearable on a user's wrist; wherein to authenticate the user, the user authentication module may be configured to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the computer device based at least in part on a result of the analysis; and wherein the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn.
  • Example 22 may be example 21, wherein the virtual grid may comprise a 3x3 virtual grid, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
  • Example 23 may be example 21, wherein the virtual grid may comprise a 4x3 virtual keypad, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference partem, a personal information number (PIN) or a password.
  • PIN personal information number
  • Example 24 may be example 21, wherein the one or more fingers may comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
  • Example 25 may be example 21 , further comprising a sensor driver to be operated by the processor to receive sensor signals representative of tendon or muscle positions of the wrist, and process the sensor signals to output the sensor data for the user
  • Example 26 may be example 25, wherein the computer device may further comprise a plurality of sensors coupled to the processor cores to sense and output the senor signals representative of the tendon or muscle positions of the wrist.
  • Example 27 may be example 26, wherein the computer device is a smart watch having a watch band, and the plurality of sensors may be disposed on the watch band.
  • Example 28 may be example 25, wherein the computer device may further comprise a communication interface to receive sensor signals from an external wrist band having a plurality of sensors to sense and output the senor signals representative of the tendon or muscle positions of the wrist, and process the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus.
  • the computer device may further comprise a communication interface to receive sensor signals from an external wrist band having a plurality of sensors to sense and output the senor signals representative of the tendon or muscle positions of the wrist, and process the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus.
  • Example 29 may be any one of examples 21-28, wherein the user authentication module may be configured to further provide visual feedbacks to the user to assist the user in traversing the virtual grid.
  • Example 30 may be example 29, wherein to provide visual feedbacks may comprise to display a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
  • Example 31 may be a wearable apparatus for computing, comprising: means for receiving sensor data indicative of movements of one or more fingers of a user of the wearable apparatus over a virtual grid; means for analyzing the sensor data to determine the movements; and means for authenticating and granting the user access or denying the user access to the wearable apparatus, based at least in part on a result of the analysis; and wherein the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the wearable computer device is worn.
  • Example 32 may be example 31, wherein the virtual grid may comprise a 3x3 virtual grid, and means for authenticating and granting access may comprise means for authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
  • Example 33 may be example 31, wherein the virtual grid may comprise a 4x3 virtual keypad, and means for authenticating and granting access may comprise means for authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
  • PIN personal information number
  • Example 34 may be example 31, wherein the one or more fingers comprise a thumb of the hand of the user that adjoins the wrist on which the wearable apparatus is worn.
  • Example 35 may be example 31, wherein means for receiving may comprise means for receiving sensor signals representative of tendon or muscle positions of the wrist, and means for processing the sensor signals to output the sensor data.
  • Example 36 may be example 35, may further comprise means for sensing and outputting the senor signals representative of the tendon or muscle positions of the wrist.
  • Example 37 may be example 36, wherein the wearable computer device may be a smart watch having a watch band, and the means for sensing may comprise a plurality of sensors disposed on the watch band.
  • Example 38 may be example 35, wherein means for receiving sensor signals may comprise means for receiving sensor signals from an extemal wrist band having a plurality of sensors to sense and output the sensor signals representative of the tendon or muscle positions of the wrist, and processing the sensor signals into the sensor data; wherein the extemal wrist band is not part of the wearable apparatus.
  • Example 39 may be any one of examples 31-38, further comprising means for providing visual feedbacks to the user to assist the user in traversing the virtual grid.
  • Example 40 may be example 39, wherein means for providing visual feedbacks may comprise means for displaying a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
  • such disclosure includes one or more such elements, neither requiring nor excluding two or more such elements.
  • ordinal indicators e.g., first, second or third
  • ordinal indicators are used to distinguish between the elements, and do not indicate or imply a required or limited number of such elements, nor do they indicate a particular position or order of such elements unless otherwise

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)

Abstract

Apparatuses, methods and storage medium associated with same hand user authentication are disclosed herein. In embodiments, an apparatus, wearable on a user's wrist, may include a user authentication module to authenticate and grant access to the user. To authenticate the user, the user authentication module may be configured to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the apparatus based at least in part on a result of the analysis. The one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn. In embodiments, the senor data may include sensor data collected by sensors configured to measure tendon/muscle positions of the wrist. Other embodiments may be disclosed or claimed.

Description

Wearable Computer Apparatus with Same Hand User Authentication
Related Application
This application is claims priority to U.S. Application 15/164,167, entitled "WEARABLE COMPUTER APPARATUS WITH SAME HAND USER
AUTHENTICATION," filed May 25, 2016.
Technical Field
The present disclosure relates to the fields of computing. More
specifically, the present disclosure is related to same hand user authentication, particularly suitable for wearable computer devices, such as smart watches,
smartphones, and so forth.
Background
The background description provided herein is for the purpose of generally presenting the context of the disclosure. Unless otherwise indicated herein, the materials described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.
With advances in integrated circuits and computing technology, wearable computer devices, such as smart watches, are becoming increasingly popular. As with all computer devices, especially with recent increase in interest in privacy and data security, it is desirable or even necessary to authenticate a user before
allowing a user to access a wearable computer device.
Previously, most mobile computer devices, such as smart phones use
passwords, personal identification numbers (PIN) of 4 to 6 digits, or patterns traced on a displayed 3x3 dot matrix. The disadvantage in porting and employing these approaches on computer devices worn on the wrist, such as smart watches, is that these approaches require a hand to touch the screen of the wearable computer device to type in characters/numbers or form patterns. Necessarily, the hand
touching the screen has to be the other hand opposite to the wrist wearing the computer device. Often times, the user's other hand may be busy, and thus require extra effort of the user to authenticate himself/herself before the user is able to gain access to the wearable computer device, and perform the desired function.
Brief Description of the Drawings
Embodiments will be readily understood by the following detailed description in conjunction with the accompanying drawings. To facilitate this description, like reference numerals designate like structural elements.
Embodiments are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.
Figure 1 illustrates a perspective view of a wearable computer device equipped with the same hand user authentication technology of the present disclosure, in accordance with various embodiments.
Figures 2 and 3 illustrate two example sensor signal patterns for two example finger movements over a 3x3 virtual grid, in accordance with various embodiments.
Figure 4 illustrates possible finger movements across a 3x3 virtual grid, in accordance with alternate embodiments.
Figure 5 illustrates example feedback by the wearable computer device, in accordance with various embodiments.
Figure 6 illustrates example architecture of the wearable computer device, in accordance to various embodiments.
Figures 7 and 8 illustrate example operation flow/algorithmic architecture of the user authentication module, in accordance to various embodiments.
Figures 9-11 illustrate an example 4x3 virtual grid suitable for partem, PIN or password authentication, in accordance with various embodiments.
Detailed Description
Apparatuses, methods and storage medium associated with same hand user authentication are disclosed herein. In embodiments, an apparatus, wearable on a user's wrist, may include a processor with one or more processor cores, and a user authentication module to be operated by the processor to authenticate and grant access to the user. To authenticate the user, the user authentication module may be configured to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the apparatus based at least in part on a result of the analysis. The one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn, i.e. the same hand wearing the wearable computer device. In embodiments, the sensor data may include sensor data collected by sensors configured to measure tendon/muscle positions of the wrist on which the apparatus is worn.
In the description to follow, reference is made to the accompanying drawings which form a part hereof wherein like numerals designate like parts throughout, and in which is shown by way of illustration embodiments that may be practiced. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of embodiments is defined by the appended claims and their equivalents.
Operations of various methods may be described as multiple discrete actions or operations in turn, in a manner that is most helpful in understanding the claimed subject matter. However, the order of description should not be construed as to imply that these operations are necessarily order dependent. In particular, these operations may not be performed in the order of presentation. Operations described may be performed in a different order than the described embodiments. Various additional operations may be performed and/or described operations may be omitted, split or combined in additional embodiments.
For the purposes of the present disclosure, the phrase "A and/or B" means (A), (B), or (A and B). For the purposes of the present disclosure, the phrase "A, B, and/or C" means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C).
The description may use the phrases "in an embodiment," or "in embodiments," which may each refer to one or more of the same or different embodiments. Furthermore, the terms "comprising," "including," "having," and the like, as used with respect to embodiments of the present disclosure, are synonymous.
As used hereinafter, including the claims, the term "module" or "routine" may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
Referring now to Figure 1, wherein a perspective view of a wearable computer device having the same hand user authentication technology of the present disclosure, in accordance with various embodiments, is illustrated. As shown, in the illustrated embodiments, a user wearing a computer device 102, such as a smart watch or a smartphone, equipped with the same hand user authentication technology of the present disclosure, may authenticate himself/herself and gain access to wearable computer device 102, by moving a finger 106 over a virtual grid 104 forming a pattern that corresponds to or matches an access control reference partem. As depicted, finger 106 may be a finger of the same hand 108 adjoining wrist 110, on which computer device 102 is worn. And virtual gird 104 may be an imaginary grid in free space. Accordingly, the user may authenticate
himself/herself and gain access to computer device 102 (to perform a function) in a single handed or same hand manner, without the need of using the other hand.
In embodiments, as depicted in the callout on the left side of Figure 1, wearable computer device 102 may include a number of sensors 122, sensor driver 123, and a user authentication module 124, configured to cooperate with each other to provide the single-handed or same hand user authentication capabilities. More specifically, sensors 122 may be configured to continuously sense the positions of tendons and muscles around wrist 110, wherein computer device 102 is worn, and continuously output signals representative of the positions sensed. Sensor driver 123 may be configured to process the signals, and continuously output sensor data indicative of successive positions sensed. User authentication module 124 may in turn receive these sensor data, and analyze the sensor data to determine movements of user finger 106 over virtual grid 104 and the partem formed by the movements. Note that finger 106 is of the same hand adjoining wrist 110 where computer device 102 is worn. Further, user authentication module 124 may determine whether the pattern formed corresponds to or matches with an access control reference pattern, and authenticate and grant the user access to computer device 102, or deny access, based at least in part on the a result of the analysis against the access control reference pattern.
In embodiments, as illustrated by the insert at the lower center portion of
Figure 1, sensors 122 may comprise of two strips or rows of pressure sensors 142 and 144. Sensors 142 may be configured to continuously sense positions of tendons/muscles at wrist 110 through the upper (or anterior) surface of wrist 110 and output corresponding signals, whereas sensors 144 may be configured to sense positions of tendons/muscles at wrist 110 through the under (or posterior) surface of wrist 110 and output corresponding signals. Sensor driver 123 processes and combines both sets of signals to output sensor data indicative of the positions of the tendons/muscles at wrist 110. User authentication module 124 in turn processes the sensor data to determine the position and movement of finger 106 over virtual grid 104. In embodiments, user authentication module 124 may be configured to determine the position and movement of finger 106 over virtual grid 104, using a set of reference sensor data patterns for various movements over virtual grid 104. The sensing of positions of tendons/muscles through the upper (or anterior) and the under (or posterior) surfaces, and usage of such sensed signals to determine finger and/or hand position are described further in U.S. Patent Application 15/087,385, filed March 31, 2016, entitled "Sensor Signal Processing to Determine Finger and/or Hand Position"; and in PCT Patent Application PCT/US2015/067534, filed Dec 22, 2015, entitled "System and Method to Collect Gesture Input Through Wrist Tendon and Muscle Sensing". The Specifications of USPA 15/087,385 and PCT/US2015/067534 are fully incorporated herein by reference.
In embodiments where computer device 102 is a smart watch having main body 134 housing the electronics, and band 132 coupled to main body 134 at two opposite sides/ends of main body 134, sensors 142 may be disposed at a bottom surface of main body 134 that touches the upper (or anterior) surface of wrist 110, and sensors 144 may be disposed at a portion of band 132 that touches the under (or posterior) surface of wrist 110. In alternate embodiments, where computer device 102 is a smart watch having main body 134 housing the electronics, and band 132 coupled to main body 134, passing through and covering (at least partially) the underside of main body 134, sensors 142 may be disposed at a portion of band 132 that touches the upper (or anterior) surface of wrist 110, and sensors 144 may be disposed at a portion of band 132 that touches the posterior (or under) surface of wrist 110. In still other embodiments, regardless whether computer device 102 is a smart watch or other wearable computer devices, sensors 142 may be disposed at the internal portion of external band 152 (that is not part of computer device 102) that touches the upper (or anterior) surface of wrist 110, and sensors 144 may be disposed at the internal portion of external band 152 that touches the posterior (or under) surface of wrist 110.
In embodiments, as depicted by the callout in the upper right corner of Figure 1, virtual grid 104 may be a 3x3 virtual grid, which may comprise 9 cells organized into 3 rows and 3 columns. The 9 cells may be referred to as the top left (TL) cell, top center (TC) cell, top right (TR) cell, center left (CL) cell, center (CC) cell, center right (CR) cell, bottom left (BL) cell, bottom center (BC) cell, and bottom right (BR) cell. In alternate embodiments, other nomenclature may be used instead.
Referring now also to Figures 2 and 3, wherein two example sensor signal patterns for two example movement patterns over the 3x3 virtual grid, in accordance with various embodiments, are shown. More specifically, Figure 2 illustrates an example signal partem 200 when thumb 106 is first placed at cell CL, traverse along the CL-CC-CR row to cell CC, then cell CR. Each line in Figure 2 depicts the signal level of a corresponding sensor as thumb 106 moves from cell CL, along the CL-CC-CR row to cell CC, then cell CR. Figure 3 illustrates an example signal pattern when thumb 106 is first placed at cell TC, traverse along the TC-CC-BC column to cell CC, then cell BC. Similarly, each line in Figure 3 depicts the signal level of a corresponding sensor as thumb 106 moves from cell TC, along the TC-CC-BC column to cell CC, then cell BC.
Figure 4 illustrates possible finger movements across the 3x3 virtual grid, in accordance with various embodiments. As illustrated in the left portion 402 of Figure 4, a user may also move finger 106 vertically, up and down any one of the columns of virtual grid 104, or horizontally, back and forth across any one of the rows of virtual grid 104. As illustrated in the center and right portions 404 and 406 of Figure 4, a user may move finger 106 diagonally in any one of a number of angular manners across the various cells of virtual grid 104. In embodiments, during traversal of the 3x3 virtual grid, a cell within the 3x3 virtual grid may be selected with a pre-determined finger movement, while the finger is positioned over the cell. For example, in embodiments where the 3x3 virtual grid is traversed using the thumb, selection of a cell may be indicated by moving the thumb towards the palm while the thumb is position over the cell.
Referring back to Figure 1, in embodiments, user authentication module 124 may be configured to support a configuration mode and an operation mode. The configuration mode may have various configuration points or periods, where different aspects of the single handed/same hand authentication technology of the present disclosure may be configured/defined. In embodiments, these
configuration points or periods may include a point where finger 106 to be used to perform the pattern traversal may be selected/identified, and a first period where the free space occupied by virtual grid 102 (and its cells) may be defined. Further, these configuration points or periods may include a second period where the signal patterns for various movements of finger 106 over virtual grid 102 may be recorded, and a third period where the reference pattern to be used to control access to computer device 102 may be defined.
In embodiments, at the finger selection/identification point in the configuration process, finger 106 to be used to perform the partem traversal may be selected/identified through movement of one of the fingers. For example, a user may move the finger he/she wants to use to traverse virtual grid 104, in response to a prompt from user authentication module 122. During the virtual grid definition period of the configuration process, the free space occupied by virtual grid 102 may be defined through movement of the selected/identified finger 106. For example, a user may use the selected/identified finger 106 to trace the perimeter of virtual grid 102, in response to a prompt from user authentication module 122.
Further, the number of cells within the virtual grid may be defined. For example, a user may enter (type in, via voice command, or select from pre-selected options) the configuration or the number of cells, or use the selected/identified finger 106 to partition virtual grid 102, in response to a prompt from user authentication module 122. And the free space occupied by the cells may be computed from the free space defined for virtual grid 104. For example, for a 3x3 virtual grid, the free space occupied by the cells may be computed by dividing the free space defined for virtual grid 104 into 9 equal portions in a 3x3 configuration.
Likewise, during the signal pattern recording period of the configuration process, the signal patterns for various movements of finger 106 may be captured. For example, a user may use the selected/identified finger 106 to move vertically, horizontally or diagonally across virtual grid 104, in response to various prompts by user authentication module 124. During the reference pattern definition period of the configuration process, the reference pattern to be used to control access to computer device 102 may be defined through movement of the selected/identified finger 106 over virtual grid 104. For example, a user may use the
selected/identified finger 106 to traverse virtual grid 102, in response to a prompt from user authentication module 122.
In embodiments, the different configuration point/periods to select/identify finger 106, define virtual grid 104, record the signal patterns, or define the reference pattern may be consecutive, with the selection/identification and recording/definitions being performed successive, or may be entered independently to allow any of these selection/identification, recordings and definitions to be performed and/or repeated (e.g., periodic changing the access control reference pattern).
In embodiments, the identification of finger 106, the free space definition of virtual grid 104, the movement signal patterns recorded, and the access control reference pattern defined may be stored locally in wearable computer device 102. Alternatively the identification of finger 106, the free space definition of virtual grid 104, the movement signal patterns recorded, and/or the access control reference pattern defined may be stored in a cloud server (not shown), accessible to wearable computer device 102, e.g., through wireless communication.
In alternate embodiments, other approaches may be employed to select/identify finger 106, define virtual grid 104, capture signal patterns for various finger movements, and/or define the access control reference partem. The particular embodiments described should not be construed as limiting on the single handed/same hand user authentication technology of the present disclosure.
Additionally, it should be noted that while a 3x3 virtual grid and usage of the thumb as the traversing figure are depicted in Figure 1 , in alternate embodiments, virtual grid of other configurations, e.g. , 4x3 virtual grid, and other fingers, such as the index finger, the middle finger, the ring finger, the baby finger, or usage of multiple fingers may be practiced instead. Further, while a smart watch with two stripes/rows of sensors are depicted in Figure 1 , in alternate embodiments, other wearable computer device and/or other configuration of sensor dispositions may be practiced instead. Still further, for smart watch embodiments, while a smart watch with a round main body /housing is illustrated, in alternate embodiments, the main body /housing of smart watch may have other shapes, e.g. a rectangular shape. Again, these illustrative embodiments should not be construed as limiting on the single
handed/same hand user authentication technology of the present disclosure.
In embodiments, user authentication module 124 may also be configured to provide feedback to the user, as the user endeavors to use finger 106 to traverse virtual grid 104 with movements to form a pattern that corresponds or matches an access control reference pattern, to authenticate himself/herself to gain access to wearable computer device 102. Figure 5 illustrates example feedback by a
wearable computer device, in accordance with various embodiments. As shown, in response to a particular predetermined movement of hand 108 or finger 106 that signal the user's desire to authenticate himself/herself to gain access, wearable computer device 102 may wake up from an idle or sleep state, enter the operation mode, and render display 500 that graphically or pictorially represents virtual grid 104. As the user moves finger 106 to form a partem that corresponds or matches the access control reference pattern, the movement path 502, as
interpreted/determined by user authentication module 124 may also be displayed for the user. Accordingly, the user may be aided in his/her endeavor to provide the corresponding/matching partem to gain access. In embodiments, similar visual feedbacks may be provided to the user during the configuration mode, for
recording the signal patterns of various finger movements and/or for inputting the access control reference pattern.
Referring now to Figure 6, wherein example architecture of a wearable computer device having the single handed/same hand technology of the present disclosure, according to various embodiments, is shown. As illustrated, in embodiments, wearable computer device 600 (which may be wearable computer device 102) may include hardware 602 and software 604. Software 604 may include operating system (OS) 634 and application 632. OS 634 may include user authentication module 644 and sensor driver 643, which may correspond to the earlier described user authentication module 144 and sensor driver 143. OS 634, except for user authentication module 644 and sensor driver 643, may be any one of a number of wearable computer device OS known in art. Alternatively to an OS, user authentication module 644 can conceived as a firmware or any other kind of embedded software dedicated to perform dedicated tasks. Applications 632 may likewise be any one of a number of known applications for wearable computer devices, e.g., personal health application, calendar or other personal information management (PIM) applications.
Hardware 602 may include processor(s) 612, memory 6144, persistent storage 616, sensors 618, display 620, and communication interface 622. Processor(s) 612 may be any one of a number of processors known in the art, each having one or more processor cores. Memory 614 may be any known volatile or non-volatile memory in the art, suitable for storing instructions for execution and working data, in particular, instructions and data of applications 632 and OS 634, including user authentication module 644 and sensor driver 643. Memory 614 may include a hierarchy of cache memory and system memory. Both the cache and system memory may be respectively organized into segments and pages. Persistent storage 616 may be any known persistent mass storage suitable for providing persistent storage of instructions and data of applications 632 and OS 634, e.g., solid state storage, magnetic or optical disk drives. Sensors 618 may include the earlier described sensors 142 and 144 for sensing position of tendons/muscles. Display 620 may be any known display device, including e.g., touch sensitive screen. Communication interface 622 may include any number of wireless communication or networking interfaces known, such as WiFi, 3G/4G, Bluetooth®, Near Field Communication, LiFi, and so forth.
Referring now to Figures 7 and 8, wherein example operation flow/algorithmic structure of the user authentication module, according the various embodiments, is shown. As illustrated in Figure 7, in embodiments, user authentication module 144/642 may be configured with operating flow/algorithmic structure 700 for configuring various aspects of the single handed/same hand user authentication technology. Operating
flow/algorithmic structure 700 may begin at/with block 702. At block 702, the finger to be used to traverse the virtual grid to provide the access control authentication may be selected/identified. As described earlier, a prompt may be made of the user to move the finger to be used to traverse the virtual grid to provide the access control partem.
Next at block 704, the virtual grid may be defined. As described earlier, a prompt may be made of the user to move the finger to trace the free space to define the perimeter of the virtual grid. Further, a prompt may be made of the user to identify the configuration or cells of the virtual grid.
Next at block 706, on definition of the virtual grid, the sensor signal patterns of the various finger movement patterns over the virtual grid may be recorded. As described earlier, a number of prompts may be made of the user to move the finger horizontally across various rows, vertically up and down various columns, and diagonally/angularly across various cells of the virtual grid.
Then, at block 708, the access control reference pattern may be defined. As described earlier, a prompt may be made of the user to move the finger over the virtual grid to define the access control reference pattern.
As illustrated in Figure 8, in embodiments, user authentication module 144/642 may be configured with operating flow/algorithmic structure 800 for authenticating and granting access to the wearable computer device to a user or denying access to the wearable computer device to the user. Operating flow/algorithmic structure 800 may begin at/with block 802. At block 802, on entry into an operational mode (from an idle/sleep state), a graphical representation of the virtual grid may be displayed.
Next at block 804, sensor data indicative of positions of tendons/muscles of the wrist on which the computer device is worn, may be received and analyzed to determine the finger position over the virtual grid. At block 806, on determination of the current finger position over the virtual grid, visual feedback on the movement path may be provided.
At block 808, a determination may be made on whether the movement path provided thus far corresponds or matches the access control reference pattern. If a result of the determination indicates that the movement path provided thus far corresponds or matches the access control reference pattem, operation/algorithm flow 800 may proceed to block 810. At block 810, the user may be authenticated, and access to the wearable computer device granted.
If a result of the determination indicates that the movement path provided thus far does not correspond or match the access control reference pattem, and the number of cells touched is below the number of cells needed to provide the corresponding or matching access control pattem, operation/algorithm flow 800 may return to block 804 and continue there from for additional sensor data.
If a result of the determination indicates that the movement path provided thus far does not correspond or match the access control reference pattem, and the number of cells touched has reached the number of cells needed to provide the corresponding or matching access control pattem, operation/algorithm flow 800 may proceed to block 812. At block 812, visual feedback, such as an error message and/or an alarm, may be provided to convey authentication failure, and access to the wearable computer device denied.
As alluded to earlier, while for ease of understanding, the single handed/same hand user authentication technology has been described in the context of a 3x3 virtual grid thus far. In alternate embodiments, different grid configurations and/or personal identification number (PIN) or password (as opposed to patterns) may be practiced to authenticate and grant access to the user. Figures 9-11 illustrate an example 4x3 virtual grid suitable for PIN or password authentication, in accordance with various embodiments. As shown in Figure 9, 4x3 virtual grid 900 may comprise 4 rows and 3 columns. In embodiments, the cells of the top three rows may be similarly referred to as TL, TC, TR, CL, CC, CR, BL, BC and BR as before. The cells of the 4th row may be respectively referred to as cell AL, AC and AR.
In embodiments, user authentication module 144/644 may interpret the 12 cells as a 12-keys numeric keypad 1000 (Figure 10), with cells TL, TC and TR correspond to the numbers 1, 2 and 3; cells CL, CC and CR correspond to the numbers 4, 5, and 6; cells BL, BC and BR correspond to the numbers 7, 8 and 9, and cell AC corresponds to the number 0. Further, cells AL and AR may respectively correspond to special keys Backspace or asterisk (*), and Enter or #.
In embodiments, user authentication module 144/644 may support multi- tap allowing the 12 cells to be interpreted as 12-keys alphanumeric keypad 1100 (Figure 11). For example, a single tap of cell TC may correspond to the letter "A," two taps may correspond to the letter "B," three taps may correspond to the letter "C," and so forth. Accordingly, cells TC and TR may respectively correspond to letters "ABC" and "DEF," cells CL, CC and CR may respectively correspond to letters "GHI," "JKL," and "MNO," cells BL, BC and BR may respectively correspond to letters "PQR," "STU," and "WXYZ."
Thus, for these embodiments, during operation, similar to block 808 of Figure 8, a determination may be made on whether the movement path provided thus far corresponds or matches an access PIN or password. If a result of the determination indicates that the movement path provided thus far corresponds or matches the access PIN or password, the user may be authenticated, and access to the wearable computer device granted. On the other hand, if a result of the determination indicates that the movement path provided thus far does not correspond or match the access PIN or password, and the number of cells touched is below the number of cells needed to provide the corresponding or matching PIN or password, additional sensor data may be collected. However, if a result of the determination indicates that the movement path provided thus far does not
correspond or match the access PIN or password, and the number of cells touched has reached the number of cells needed to provide the corresponding or matching access PIN or password, visual feedback, such as an error message and/or an
alarm, may be provided to convey authentication failure, and access to the
wearable computer device denied.
Further, similar to the access partem embodiments, user authentication
module 144/644 may provide visual feedback similar to the graphical
representation illustrated in Figure 5, as the various keys are touched or tapped to provide the access control PIN or password.
Referring back to Figure 6, in one embodiment, at least one of processors
612 may be packaged together with a computer-readable storage medium having sensor driver 643 and/or user authentication module 644 (in lieu of storage in
memory 614 and/or storage 616). For one embodiment, at least one of processors 612 may be packaged together with a computer-readable storage medium having sensor driver 643 and/or user authentication module 644 to form a System in
Package (SiP). For one embodiment, at least one of processors 612 may be
integrated on the same die with a computer-readable storage medium having sensor driver 643 and/or user authentication module 644. For one embodiment, at least one of processors 612 may be packaged together with a computer-readable storage medium having sensor driver 643 and/or user authentication module 644 to form a System on Chip (SoC).
Thus, example embodiments described may include:
Example 1 may be an apparatus for computing, comprising: a processor having one or more processor cores; and a user authentication module to be operated by the processor to authenticate and grant access to a user of the apparatus. The apparatus may be wearable on a user's wrist. To authenticate the user, the user authentication module may be configured to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the apparatus based at least in part on a result of the analysis. The one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn.
Example 2 may be example 1, wherein the virtual grid may comprise a 3x3 virtual grid, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference partem.
Example 3 may be example 1, wherein the virtual grid may comprise a 4x3 virtual keypad, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
Example 4 may be example 1 , wherein the one or more fingers may comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
Example 5 may be example 1 , further comprising a sensor driver to be operated by the processor to receive sensor signals representative of tendon or muscle positions of the wrist, and process the sensor signals to output the sensor data for the user authentication module.
Example 6 may be example 5, wherein the apparatus may further comprise a plurality of sensors coupled to the processor to sense and output the senor signals representative of the tendon or muscle positions of the wrist.
Example 7 may be example 6, wherein the apparatus may be a smart watch having a watch band, and the plurality of sensors may be disposed on the watch band.
Example 8 may be example 5, wherein the apparatus may further comprise a communication interface to receive sensor signals from an external wrist band having a plurality of sensors to sense and output the senor signals representative of the tendon or muscle positions of the wrist, and process the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus.
Example 9 may be any one of examples 1-8, wherein the user authentication module may be configured to further provide visual feedbacks to the user to assist the user in traversing the virtual grid.
Example 10 may be example 9, wherein to provide visual feedbacks may comprise to display a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed. Example 1 1 may be a method for computing, comprising: receiving, by a wearable computer device, sensor data indicative of movements of one or more fingers of a user of the wearable computer device over a virtual grid; analyzing, by the wearable computer device, the sensor data to determine the movements; and authenticating and granting the user access or denying the user access to the wearable computer device, based at least in part on a result of the analysis. The one or more fingers are fingers of a hand of the user that adjoins the wrist on which the wearable computer device is worn.
Example 12 may be example 1 1, wherein the virtual grid may comprise a 3x3 virtual grid, and authenticating and granting access may comprise authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
Example 13 may be example 1 1, wherein the virtual grid may comprise a 4x3 virtual keypad, authenticating and granting access may comprise authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
Example 14 may be example 1 1, wherein the one or more fingers may comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
Example 15 may be example 11 , wherein receiving may comprise receiving sensor signals representative of tendon or muscle positions of the wrist, and processing the sensor signals to output the sensor data.
Example 16 may be example 15, further comprising sensing and outputting the senor signals representative of the tendon or muscle positions of the wrist.
Example 17 may be example 16, wherein the wearable computer device may be a smart watch having a watch band, and the plurality of sensors may be disposed on the watch band.
Example 18 may be example 15, wherein receiving may comprise receiving sensor signals from an external wrist band having a plurality of sensors to sense and output the sensor signals representative of the tendon or muscle positions of the wrist, and processing the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus. Example 19 may be any one of examples 1 1-18, further comprising providing, by the wearable computer device, visual feedbacks to the user to assist the user in traversing the virtual grid.
Example 20 may be example 19, wherein providing visual feedbacks may comprise displaying a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
Example 21 may be one or more computer-readable media comprising instructions that cause a computer device, in response to execution of the instructions by one or more processor cores of the computer device, to provide a user authentication module to authenticate and grant access to a user of the apparatus; wherein the apparatus is wearable on a user's wrist; wherein to authenticate the user, the user authentication module may be configured to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the computer device based at least in part on a result of the analysis; and wherein the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn.
Example 22 may be example 21, wherein the virtual grid may comprise a 3x3 virtual grid, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
Example 23 may be example 21, wherein the virtual grid may comprise a 4x3 virtual keypad, and the user authentication module may be configured to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference partem, a personal information number (PIN) or a password.
Example 24 may be example 21, wherein the one or more fingers may comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
Example 25 may be example 21 , further comprising a sensor driver to be operated by the processor to receive sensor signals representative of tendon or muscle positions of the wrist, and process the sensor signals to output the sensor data for the user
authentication module.
Example 26 may be example 25, wherein the computer device may further comprise a plurality of sensors coupled to the processor cores to sense and output the senor signals representative of the tendon or muscle positions of the wrist. Example 27 may be example 26, wherein the computer device is a smart watch having a watch band, and the plurality of sensors may be disposed on the watch band.
Example 28 may be example 25, wherein the computer device may further comprise a communication interface to receive sensor signals from an external wrist band having a plurality of sensors to sense and output the senor signals representative of the tendon or muscle positions of the wrist, and process the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus.
Example 29 may be any one of examples 21-28, wherein the user authentication module may be configured to further provide visual feedbacks to the user to assist the user in traversing the virtual grid.
Example 30 may be example 29, wherein to provide visual feedbacks may comprise to display a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
Example 31 may be a wearable apparatus for computing, comprising: means for receiving sensor data indicative of movements of one or more fingers of a user of the wearable apparatus over a virtual grid; means for analyzing the sensor data to determine the movements; and means for authenticating and granting the user access or denying the user access to the wearable apparatus, based at least in part on a result of the analysis; and wherein the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the wearable computer device is worn.
Example 32 may be example 31, wherein the virtual grid may comprise a 3x3 virtual grid, and means for authenticating and granting access may comprise means for authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
Example 33 may be example 31, wherein the virtual grid may comprise a 4x3 virtual keypad, and means for authenticating and granting access may comprise means for authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
Example 34 may be example 31, wherein the one or more fingers comprise a thumb of the hand of the user that adjoins the wrist on which the wearable apparatus is worn. Example 35 may be example 31, wherein means for receiving may comprise means for receiving sensor signals representative of tendon or muscle positions of the wrist, and means for processing the sensor signals to output the sensor data.
Example 36 may be example 35, may further comprise means for sensing and outputting the senor signals representative of the tendon or muscle positions of the wrist.
Example 37 may be example 36, wherein the wearable computer device may be a smart watch having a watch band, and the means for sensing may comprise a plurality of sensors disposed on the watch band.
Example 38 may be example 35, wherein means for receiving sensor signals may comprise means for receiving sensor signals from an extemal wrist band having a plurality of sensors to sense and output the sensor signals representative of the tendon or muscle positions of the wrist, and processing the sensor signals into the sensor data; wherein the extemal wrist band is not part of the wearable apparatus.
Example 39 may be any one of examples 31-38, further comprising means for providing visual feedbacks to the user to assist the user in traversing the virtual grid.
Example 40 may be example 39, wherein means for providing visual feedbacks may comprise means for displaying a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
Although certain embodiments have been illustrated and described herein for purposes of description, a wide variety of alternate and/or equivalent
embodiments or implementations calculated to achieve the same purposes may be substituted for the embodiments shown and described without departing from the scope of the present disclosure. This application is intended to cover any
adaptations or variations of the embodiments discussed herein. Therefore, it is manifestly intended that embodiments described herein be limited only by the
claims.
Where the disclosure recites "a" or "a first" element or the equivalent
thereof, such disclosure includes one or more such elements, neither requiring nor excluding two or more such elements. Further, ordinal indicators (e.g., first, second or third) for identified elements are used to distinguish between the elements, and do not indicate or imply a required or limited number of such elements, nor do they indicate a particular position or order of such elements unless otherwise
specifically stated.

Claims

Claims What is claimed is:
1. An apparatus for computing, comprising:
a processor having one or more processor cores; and
a user authentication module to be operated by the processor to authenticate and grant access to a user of the apparatus;
wherein the apparatus is wearable on a user's wrist;
wherein to authenticate the user, the user authentication module is to receive sensor data indicative of movements of one or more fingers over a virtual grid, analyze the sensor data to determine the movements, and authenticate and grant the user access or deny the user access to the apparatus based at least in part on a result of the analysis; and
wherein the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the apparatus is worn.
2. The apparatus of claim 1, wherein the virtual grid comprises a 3x3 virtual grid, and the user authentication module is to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
3. The apparatus of claim 1, wherein the virtual grid comprises a 4x3 virtual keypad, and the user authentication module is to authenticate and grant access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
4. The apparatus of claim 1, wherein the one or more fingers comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
5. The apparatus of claim 1, further comprising a sensor driver to be operated by the processor to receive sensor signals representative of tendon or muscle positions of the wrist, and process the sensor signals to output the sensor data for the user
authentication module.
6. The apparatus of claim 5, wherein the apparatus further comprises a plurality of sensors coupled to the processor to sense and output the senor signals representative of the tendon or muscle positions of the wrist.
7. The apparatus of claim 6, wherein the apparatus is a smart watch having a watch band, and the plurality of sensors are disposed on the watch band.
8. The apparatus of claim 5, wherein the apparatus further comprises a communication interface to receive sensor signals from an external wrist band having a plurality of sensors to sense and output the senor signals representative of the tendon or muscle positions of the wrist, and process the sensor signals into the sensor data; wherein the external wrist band is not part of the apparatus.
9. The apparatus of any one of claims 1 -8, wherein the user authentication module is to further provide visual feedbacks to the user to assist the user in traversing the virtual grid.
10. The apparatus of claim 9, wherein to provide visual feedbacks comprises to display a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
1 1. A method for computing, comprising:
receiving, by a wearable computer device, sensor data indicative of movements of one or more fingers of a user of the wearable computer device over a virtual grid;
analyzing, by the wearable computer device, the sensor data to determine the movements; and
authenticating and granting the user access or denying the user access to the wearable computer device, based at least in part on a result of the analysis; and wherein the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the wearable computer device is worn.
12. The method of claim 1 1, wherein the virtual grid comprises a 3x3 virtual grid, and authenticating and granting access comprises authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
13. The method of claim 1 1, wherein the virtual grid comprises a 4x3 virtual keypad, authenticating and granting access comprises authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
14. The method of claim 1 1, wherein the one or more fingers comprise a thumb of the hand of the user that adjoins the wrist on which the apparatus is worn.
15. The method of claim 11 , wherein receiving comprises receiving sensor signals representative of tendon or muscle positions of the wrist, and processing the sensor signals to output the sensor data.
16. The method of claim 1 1, further comprising providing, by the wearable computer device, visual feedbacks to the user to assist the user in traversing the virtual grid; wherein providing visual feedbacks comprises displaying a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
17. One or more computer-readable media comprising instructions that cause a computer device, in response to execution of the instructions by one or more processor cores of the computer device, to provide a user authentication module to practice any one of the methods of claims 1 1-16.
18. A wearable apparatus for computing, comprising:
means for receiving sensor data indicative of movements of one or more fingers of a user of the wearable apparatus over a virtual grid;
means for analyzing the sensor data to determine the movements; and means for authenticating and granting the user access or denying the user access to the wearable apparatus, based at least in part on a result of the analysis; and
wherein the one or more fingers are fingers of a hand of the user that adjoins the wrist on which the wearable computer device is worn.
19. The wearable apparatus of claim 18, wherein the virtual grid comprises a 3x3 virtual grid, and means for authenticating and granting access comprises means for authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern.
20. The wearable apparatus of claim 18, wherein the virtual grid comprises a 4x3 virtual keypad, and means for authenticating and granting access comprises means for authenticating and granting access to the user in response to a determination of the movements over the virtual grid matching a reference pattern, a personal information number (PIN) or a password.
21. The wearable apparatus of claim 18, wherein the one or more fingers comprise a thumb of the hand of the user that adj oins the wrist on which the wearable apparatus is worn.
22. The wearable apparatus of claim 18, wherein means for receiving comprises means for receiving sensor signals representative of tendon or muscle positions of the wrist, and means for processing the sensor signals to output the sensor data.
23. The wearable apparatus of claim 22, further comprises means for sensing and outputting the senor signals representative of the tendon or muscle positions of the wrist; wherein the wearable computer device is a smart watch having a watch band, and the means for sensing comprises a plurality of sensors disposed on the watch band.
24. The wearable apparatus of claim 22, wherein means for receiving sensor signals comprises means for receiving sensor signals from an extemal wrist band having a plurality of sensors to sense and output the sensor signals representative of the tendon or muscle positions of the wrist, and processing the sensor signals into the sensor data; wherein the external wrist band is not part of the wearable apparatus.
25. The wearable apparatus of any one of claims 18-24, further comprising means for providing visual feedbacks to the user to assist the user in traversing the virtual grid; wherein means for providing visual feedbacks comprises means for displaying a graphical representation of the virtual grid, including indicators indicating portions of the virtual grid traversed.
PCT/US2017/029394 2016-05-25 2017-04-25 Wearable computer apparatus with same hand user authentication Ceased WO2017204968A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/164,167 2016-05-25
US15/164,167 US10638316B2 (en) 2016-05-25 2016-05-25 Wearable computer apparatus with same hand user authentication

Publications (1)

Publication Number Publication Date
WO2017204968A1 true WO2017204968A1 (en) 2017-11-30

Family

ID=60412536

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/029394 Ceased WO2017204968A1 (en) 2016-05-25 2017-04-25 Wearable computer apparatus with same hand user authentication

Country Status (2)

Country Link
US (1) US10638316B2 (en)
WO (1) WO2017204968A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104050402A (en) * 2014-06-12 2014-09-17 深圳市汇顶科技股份有限公司 Mobile terminal security certification method and system and mobile terminal
US10528780B2 (en) * 2016-12-12 2020-01-07 Symbol Technologies, Llc Wearable mobile electronic devices
USD859412S1 (en) * 2017-08-18 2019-09-10 Practech, Inc. Wearable or handheld hybrid smart barcode scanner
US10921133B2 (en) * 2017-12-07 2021-02-16 International Business Machines Corporation Location calibration based on movement path and map objects

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130346168A1 (en) * 2011-07-18 2013-12-26 Dylan T X Zhou Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
US20140317028A1 (en) * 2010-11-29 2014-10-23 Biocatch Ltd. Device, system, and method of detecting user identity based on motor-control loop model
KR101497829B1 (en) * 2013-09-30 2015-03-04 현대엠엔소프트 주식회사 Watch type device utilizing motion input
US20150301606A1 (en) * 2014-04-18 2015-10-22 Valentin Andrei Techniques for improved wearable computing device gesture based interactions
US20150362999A1 (en) * 2014-06-17 2015-12-17 Lg Electronics Inc. Mobile terminal and controlling method thereof

Family Cites Families (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040001097A1 (en) * 2002-07-01 2004-01-01 Frank Zngf Glove virtual keyboard for baseless typing
KR100486739B1 (en) * 2003-06-27 2005-05-03 삼성전자주식회사 Wearable phone and method using the same
US20070055949A1 (en) * 2005-01-29 2007-03-08 Nicholas Thomas Methods and apparatus for rfid interface control
WO2013142516A1 (en) 2012-03-19 2013-09-26 Lumidigm, Inc. Dermatoglyphic hand sensor
US20090146947A1 (en) * 2007-12-07 2009-06-11 James Ng Universal wearable input and authentication device
US9037530B2 (en) 2008-06-26 2015-05-19 Microsoft Technology Licensing, Llc Wearable electromyography-based human-computer interface
US8624836B1 (en) * 2008-10-24 2014-01-07 Google Inc. Gesture-based small device input
JP5293154B2 (en) * 2008-12-19 2013-09-18 ブラザー工業株式会社 Head mounted display
US9342241B2 (en) * 2010-03-03 2016-05-17 Twitch Technologies Llc Matrix keyboarding system
US20110248914A1 (en) * 2010-04-11 2011-10-13 Sherr Alan B System and Method for Virtual Touch Typing
KR20120106608A (en) 2011-03-17 2012-09-26 한국전자통신연구원 Advanced user interaction interface method and device
US20160171780A1 (en) * 2011-07-03 2016-06-16 Neorai Vardi Computer device in form of wearable glasses and user interface thereof
US9352207B2 (en) 2012-01-19 2016-05-31 Nike, Inc. Action detection and activity classification
US9170674B2 (en) 2012-04-09 2015-10-27 Qualcomm Incorporated Gesture-based device control using pressure-sensitive sensors
KR101947034B1 (en) * 2012-08-21 2019-04-25 삼성전자 주식회사 Apparatus and method for inputting of portable device
CN105027030B (en) * 2012-11-01 2018-10-23 艾卡姆有限公司 Wireless wrist-based computing and control device and method for three-dimensional imaging, mapping, networking and interfacing
US20140160055A1 (en) 2012-12-12 2014-06-12 Jeffrey Margolis Wearable multi-modal input device for augmented reality
US20140240103A1 (en) 2013-02-22 2014-08-28 Thalmic Labs Inc. Methods and devices for combining muscle activity sensor signals and inertial sensor signals for gesture-based control
US9606506B2 (en) * 2013-10-15 2017-03-28 Microsoft Technology Licensing, Llc Holographic interaction device
HK1222733A1 (en) 2013-10-24 2017-07-07 苹果公司 Wristband device input using wrist movement
US20150185838A1 (en) * 2013-12-27 2015-07-02 Jose R. Camacho-Perez Wrist based wearable virtual keyboard
US20150220158A1 (en) * 2014-01-07 2015-08-06 Nod Inc. Methods and Apparatus for Mapping of Arbitrary Human Motion Within an Arbitrary Space Bounded by a User's Range of Motion
CN103793057B (en) * 2014-01-26 2017-02-01 华为终端有限公司 Information processing method, device and equipment
JP2017508229A (en) 2014-02-28 2017-03-23 グプタ ヴィカスGUPTA, Vikas Wrist-mounted camera system operated by gestures
US9213819B2 (en) * 2014-04-10 2015-12-15 Bank Of America Corporation Rhythm-based user authentication
CN103995621B (en) * 2014-04-28 2017-02-15 京东方科技集团股份有限公司 Wearable type touch control device and wearable type touch control method
CN204048340U (en) * 2014-04-28 2014-12-31 京东方科技集团股份有限公司 Wearable projector equipment
US20150323998A1 (en) * 2014-05-06 2015-11-12 Qualcomm Incorporated Enhanced user interface for a wearable electronic device
KR101534282B1 (en) * 2014-05-07 2015-07-03 삼성전자주식회사 User input method of portable device and the portable device enabling the method
US9386401B2 (en) * 2014-08-25 2016-07-05 Steven K. Gold Proximity-based sensing, communicating, and processing of user physiologic information
US9772684B2 (en) * 2014-09-17 2017-09-26 Samsung Electronics Co., Ltd. Electronic system with wearable interface mechanism and method of operation thereof
US20180101277A9 (en) * 2014-09-24 2018-04-12 Evan John Kaye Skin Touchpad
US11112965B2 (en) * 2014-10-28 2021-09-07 Idelan, Inc. Advanced methods and systems for text input error correction
KR101518395B1 (en) * 2014-11-17 2015-05-15 구본훈 Smart lazer phone
US9661499B2 (en) * 2014-12-05 2017-05-23 Sony Corporation Access control authentication based on impedance measurements
KR102345911B1 (en) * 2015-01-16 2022-01-03 삼성전자주식회사 Virtual input apparatus and method for receiving user input using thereof
US10310632B2 (en) * 2015-02-27 2019-06-04 Hewlett-Packard Development Company, L.P. Wearable devices for detecting finger movements and related methods
US9946298B2 (en) * 2015-04-08 2018-04-17 Mediatek Inc. Wearable device interactive system
US10122709B2 (en) * 2015-05-12 2018-11-06 Citrix Systems, Inc. Multifactor contextual authentication and entropy from device or device input or gesture authentication
KR102393508B1 (en) * 2015-06-22 2022-05-03 엘지전자 주식회사 Smart watch and method for contolling the same
US10042438B2 (en) * 2015-06-30 2018-08-07 Sharp Laboratories Of America, Inc. Systems and methods for text entry
US10416776B2 (en) * 2015-09-24 2019-09-17 International Business Machines Corporation Input device interaction
US10444850B2 (en) * 2015-09-28 2019-10-15 Elwha Llc Systems and methods for providing gesture indicative data via a head wearable computing device
GB2549414B (en) * 2015-12-31 2021-12-01 Pismo Labs Technology Ltd Methods and systems to perform at least one action according to a user's gesture and identity
US10019072B2 (en) * 2016-01-01 2018-07-10 International Business Machines Corporation Imagined grid fingertip input editor on wearable device
US10372889B2 (en) * 2016-02-19 2019-08-06 At&T Mobility Ii Llc Event characteristic analysis for event input discrimination

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140317028A1 (en) * 2010-11-29 2014-10-23 Biocatch Ltd. Device, system, and method of detecting user identity based on motor-control loop model
US20130346168A1 (en) * 2011-07-18 2013-12-26 Dylan T X Zhou Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
KR101497829B1 (en) * 2013-09-30 2015-03-04 현대엠엔소프트 주식회사 Watch type device utilizing motion input
US20150301606A1 (en) * 2014-04-18 2015-10-22 Valentin Andrei Techniques for improved wearable computing device gesture based interactions
US20150362999A1 (en) * 2014-06-17 2015-12-17 Lg Electronics Inc. Mobile terminal and controlling method thereof

Also Published As

Publication number Publication date
US10638316B2 (en) 2020-04-28
US20170347262A1 (en) 2017-11-30

Similar Documents

Publication Publication Date Title
US11755137B2 (en) Gesture recognition devices and methods
CN100370405C (en) Input method and apparatus using tactile guidance and bi-directional segmented stroke
US9372970B2 (en) Gesture entry techniques
US9652097B2 (en) Feedback method according to touch level and touch input device performing the same
US10209885B2 (en) Method and device for building virtual keyboard
EP3100152B1 (en) User-authentication gestures
KR102277453B1 (en) Electronic device with touch sensor and driving method thereof
US9354804B2 (en) Touch event anticipation in a computing device
US9778742B2 (en) Glove touch detection for touch devices
US20140109018A1 (en) Gesture entry techniques
CN104281346B (en) Method and system for detecting the presence of a finger near a non-touch screen
CN103914196B (en) Electronic equipment and the method for determining the validity that the touch key-press of electronic equipment inputs
US10638316B2 (en) Wearable computer apparatus with same hand user authentication
JP5728629B2 (en) Information processing apparatus, information processing apparatus control method, program, and information storage medium
CN106814854A (en) A kind of method and device for preventing maloperation
US20180232136A1 (en) Gestural swipe user input
US20150169072A1 (en) Method, apparatus and computer readable medium for polygon gesture detection and interaction
US20180136832A1 (en) Circular user interface
CN107407998A (en) Method of interacting with electronic and/or computer devices implementing capacitively controlled surfaces and peripheral surfaces, interfaces and devices implementing the method
EP3759578B1 (en) Mobile device and method for improving the reliability of touches on touchscreen
Nishida et al. Single-tap latency reduction with single-or double-tap prediction
Zhao et al. Motion gesture delimiters for smartwatch interaction
Lee Analyzing motion of touching screen for inferring user characteristics
CN104423671B (en) Its electronic equipment of a kind of control method of keyboard, device and application
KR101835952B1 (en) Apparatus and method for controlling scroll of screen

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17803232

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17803232

Country of ref document: EP

Kind code of ref document: A1