WO2019112545A1 - Haptic touch buttons with sensors for devices - Google Patents

Haptic touch buttons with sensors for devices Download PDF

Info

Publication number
WO2019112545A1
WO2019112545A1 PCT/US2017/064429 US2017064429W WO2019112545A1 WO 2019112545 A1 WO2019112545 A1 WO 2019112545A1 US 2017064429 W US2017064429 W US 2017064429W WO 2019112545 A1 WO2019112545 A1 WO 2019112545A1
Authority
WO
WIPO (PCT)
Prior art keywords
finger
haptic
sensor
input
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2017/064429
Other languages
French (fr)
Inventor
Xiang Ma
Ricky Thomas BURKS
Mats Anders Krister LUCKMAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hewlett Packard Development Co LP
Original Assignee
Hewlett Packard Development Co LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Development Co LP filed Critical Hewlett Packard Development Co LP
Priority to PCT/US2017/064429 priority Critical patent/WO2019112545A1/en
Priority to US16/481,358 priority patent/US11150735B2/en
Publication of WO2019112545A1 publication Critical patent/WO2019112545A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1662Details related to the integrated keyboard
    • G06F1/1671Special purpose buttons or auxiliary keyboards, e.g. retractable mini keypads, keypads or buttons that remain accessible at closed laptop
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202Constructional details or processes of manufacture of the input device
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04108Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04809Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard

Definitions

  • Mobile devices are used by consumers to consume media, to enhance productivity, and the like.
  • the mobile devices can include a physical button to perform a particular function.
  • the mobile device may include a physical button for powering on the device, a home button, a physical button to turn the volume up and down, a mute switch, and the like.
  • the functions of these physical buttons are typically set by the manufacturer and cannot be reprogrammed.
  • FIG. 1 is a block diagram of an example of an apparatus having a haptic touch button of the present disclosure
  • FIG. 2 is a block diagram of an example of the haptic touch button of the present disclosure
  • FIG. 3 is a flow chart of an example method for executing a function associated with a finger action detected on a haptic touch button
  • FIG. 4 is a block diagram of an example non-transitory computer readable storage medium storing instructions executed by a processor.
  • Examples described herein provide devices having haptic touch buttons with sensors.
  • devices may have physical buttons assigned to perform a particular function.
  • the function performed by the physical button is assigned by the manufacturer and usually cannot be changed.
  • the present disclosure provides a device having a haptic touch button that can be used to perform a variety of different functions that can be customized by a user.
  • the haptic touch button may work with a sensor to detect different finger actions that are associated with different functions.
  • a haptic actuator may be used with the haptic touch button to provide feedback. Different actuations or movements of the haptic actuator may be assigned as feedback to different functions.
  • FIG. 1 illustrates an example apparatus 100 of the present disclosure.
  • the apparatus 100 may be a mobile device such as a laptop computer, a tablet computer, and the like.
  • the apparatus 100 may have a haptic touch button 102.
  • the haptic touch button 102 may be communicatively coupled to a processor 104.
  • the processor 104 may also be communicatively coupled to a sensor 106.
  • the apparatus 100 may have a housing 1 10.
  • the housing 1 10 may enclose the sensor 106 and the processor 104.
  • the housing 1 10 may be fabricated from any type of plastic, metal, metalloid, metalized plastic, anodized metal, and the like.
  • FIG. 1 illustrates a top side 1 12 of the housing 1 10.
  • the housing 1 10 may also have a perimeter that includes a left side 1 14, a front side 1 16, a right side 1 18, and a back side 120.
  • the perimeter may be defined to include a surface that is located around the apparatus 100 and located between the top side 1 12 and a bottom side (not shown) of the apparatus 100.
  • the perimeter may be a surface that has a plane that is perpendicular to a surface plane of the top surface 1 12 and the bottom surface of the apparatus 100.
  • the left side 1 14 and the front side 1 16 are visible in FIG. 1.
  • the haptic touch button 102 may be located along the perimeter of the housing 1 10. For example, in FIG. 1 , the haptic touch button 102 is located along the left side 1 14. The haptic touch button 102 may be positioned such that an outer most surface of the haptic touch button 102 is flush with an outer most surface of the left side 1 14. Thus, the haptic touch button 102 may feel even with the left side 1 14 of the housing 1 10.
  • the haptic touch button 102 may have a rectangular shape. However it should be noted that the haptic touch button 102 may have any type of shape.
  • the outer most surface of the haptic touch button 102 may be smooth or substantially flat. In another example, the outer most surface of the haptic touch button 102 may be textured. For example, the outer most surface of the haptic touch button 102 may have a plurality of protrusions, or an uneven sand paper like topology. The textured surface may allow a user to feel when he or she is touching the haptic touch button 102 without looking. As a result, the user may keep his or her eyes on a display of the apparatus 100 while providing touch inputs to the haptic touch button 102.
  • the processor 104 may receive an input from the haptic touch button 102 and an input from the sensor 106.
  • the haptic touch button 102 may detect when a finger is touching the haptic touch button 102 and the sensor 106 may detect a movement of the finger.
  • the combination of the haptic touch button 102 with the sensor 106 allows the haptic touch button 102 to recognize additional finger actions of movement (e.g., directional swiping, hovering, single finger swiping, multiple finger swiping, and the like) in addition to touch movements (e.g., tapping, double tapping, holding down the button, and the like).
  • the processor 104 may translate the input from the haptic touch button 102 and the input from the sensor 106 into the appropriate finger action. The processor 104 may then determine a function associated with the finger action and execute the appropriate function.
  • the different finger actions may be customized by a user.
  • the user may assign custom functions to different finger actions via a graphical user interface (GUI) of the apparatus 100.
  • GUI graphical user interface
  • the GUI can be displayed to the user via a display of the apparatus 100.
  • the finger actions can be customized for different applications. For example, for a music application or video application, a single finger swipe from front to back may be used to increase volume, a single finger swipe from back to front may be used to decrease volume, a two finger swipe from back to front may be used to advance to the next track, a two finger swipe front to back may be used to go back to the previous track, a long press (e.g., touching the haptic touch button 102 for longer than 2 seconds) may stop the current track, a quick tap (e.g., touching the haptic touch button 102 for less than 2 seconds) may pause/play the current track, and so forth.
  • a long press e.g., touching the haptic touch button 102 for longer than 2 seconds
  • a quick tap e.g., touching the haptic touch button 102 for less than 2 seconds
  • a single finger swipe from front to back may be used to scroll up, a single finger swipe from back to front may scroll down, a two finger swipe from front to back may scroll right, a two finger swipe from back to front may scroll left, a touch and then hover may enable a cell selection, a long press may perform a save function, and the like.
  • different finger movements may be assigned to perform different actions for the video game (e.g., weapon selection, bringing up a heads up display, scrolling through different menus, and the like).
  • different finger movements may be assigned to perform different actions for taking a photograph (e.g., zooming in and out, scrolling through different photograph/video capture modes, turning a flash on/off, scrolling through and adjusting different parameters (e.g., brightness, iso settings, aperture settings, and the like).
  • the apparatus 100 has been simplified for ease of explanation and may include additional components that are not shown.
  • the apparatus 100 may include interfaces (e.g., universal serial bus (USB) interfaces, external memory card slots, graphics processors, a display, a graphical user interface, a network interface card, wireless communication radios, and the like.
  • interfaces e.g., universal serial bus (USB) interfaces, external memory card slots, graphics processors, a display, a graphical user interface, a network interface card, wireless communication radios, and the like.
  • FIG. 2 illustrates a more detailed block diagram of the haptic touch button 102.
  • the haptic touch button 102 may be installed flush to the perimeter of the housing 1 10. As shown in FIG. 2, the haptic touch button 102 is installed on the left side 1 14 and does not protrude beyond the outer most surface of the left side 1 14.
  • the senor 106 may be communicatively coupled to the haptic touch button 102 and the processor 104.
  • the sensor 106 may include a plurality of different sensors or a single sensor. The sensor 106 may provide feedback of a finger presence, finger movement, a force applied by the finger to the haptic touch button 102, and the like, depending on the type of sensor or sensors 106 that are deployed.
  • the senor 106 may be a contact sensor or a contactless sensor.
  • the sensor 106 may be a single contactless sensor such as an ultrasonic sensor that may be located behind the left side 1 14 inside of the housing 1 10.
  • the sensor 106 may be a strain sensor that is located directly against the haptic touch button 102 to detect an amount of force that is applied to the haptic touch button 102. It should be noted that any type of sensors, in any combination, may be deployed inside of the apparatus 100.
  • a haptic actuator 208 may be communicatively coupled to the haptic touch button 102 and the processor 104.
  • the haptic actuator 208 may be customized to provide a different feedback for different functions. The customized feedback may allow a user to know that the correct action was executed in response to the customized finger movements.
  • light feedback or vibration may be actuated in response to a short tap
  • a hard feedback or vibration may be actuated in response to a long tap
  • a vibration that moves from front to back may be actuated in response to a finger swipe from front to back
  • a vibration that moves from back to front may be actuated in response to a finger swipe from back to front
  • a pulsing vibration that moves from front to back may be actuated in response to a two finger swipe from front to back
  • a pulsing vibration that moves from back to front may be actuated in response to a two finger swipe from back to front, and the like.
  • the processor 104 may be communicatively coupled to a memory 210.
  • the memory 210 may be any type of non-transitory computer readable medium or computer readable storage medium.
  • the memory 210 may be a hard disk drive, a read access memory (RAM), a read only memory (ROM), and the like.
  • the memory 210 may include more than one type of memory.
  • the customized finger actions and customized haptic feedback may be stored in a hard disk drive and some fixed finger actions and haptic feedbacks may be stored in ROM.
  • the different finger actions and associated functions may be stored in the memory 210.
  • the processor 104 may translate the input from the haptic button 102 and the sensor 106 into a finger action, as described above.
  • the processor 104 may then access the memory 210 to determine which function is associated with the finger action for a particular application.
  • a look up table or other similar format, may be used to store each finger action with a respective function. After the processor 104 determines the correct function for the finger action for a particular application, the processor 104 may execute the function.
  • the processor 104 may also look up the appropriate feedback associated with the finger action. The processor 104 may then cause the haptic actuator 208 to perform the appropriate feedback that is determined to be associated with the finger action.
  • the design of the haptic button 102 in combination with the sensor 106 provides a smaller design than current physical buttons that may be deployed on devices.
  • the mechanical components of the physical buttons can be removed or replaced with the combination of the haptic button 102 and the sensor 106 of the present disclosure.
  • the overall size (e.g., a thickness or z-direction) of the device may be reduced.
  • a single haptic button 102 in combination with the sensor 106 may be customized to perform many different functions. As a result, some physical buttons may be eliminated from the device, which may also save space, cost, and size of the device.
  • the single haptic button 102 in combination with the sensor 106 may also consume a minimal amount of space allowing the combination to be deployed in narrow display border designs for tablet devices, notebooks, and other hybrid mobile devices.
  • FIG. 3 illustrates a flow diagram of an example method 300 for executing a function associated with a finger action detected on a haptic touch button.
  • the method 300 may be performed by the apparatus 100 illustrated in FIG. 1 or the apparatus 400 illustrated in FIG. 4 below.
  • the method 300 begins.
  • the method 300 receives a first input from a haptic touch button located along a perimeter of a housing of a device. For example, a user may touch the haptic touch button to provide the first input.
  • the method 300 receives a second input from a sensor.
  • the second input may be a touch movement detected by a contactless sensor.
  • the contactless sensor may be an ultrasonic sensor that is located adjacent to the haptic touch button behind a wall of the perimeter of the device.
  • the touch movement may include a single finger swipe, or a multiple finger swipe.
  • the touch movement may be detected by contact sensors.
  • the contact sensor may be a strain sensor or a resistive sensor that can detect and amount of force that is applied by the second input, a number of taps that is provided by the second input, and the like.
  • the senor may be a combination of the contactless sensor and contact sensor or a plurality of different contact sensors.
  • the second input may be a combination of a touch movement and touch force. For example, a single finger may press down for a period of time greater than a threshold, or with greater than a predefined amount of force, and then moved from front to back.
  • the method 300 translates the first input and the second input into a finger action.
  • a plurality of different finger actions may be customized to perform different actions.
  • the different finger actions may be customized to perform different functions for different applications.
  • the method 300 may determine the finger action that is associated with the first input and the second input. The method 300 may then determine a function associated with the finger action. In one example, the function associated with the finger action may also be based on a particular application that is being executed when the first input and the second input were received.
  • the functions associated with each finger action and/or application may be stored in memory.
  • the finger action that is determined may be compared to a table that includes each finger action and associated function to determine which function is associated with the finger action.
  • the haptic feedback may also be stored in memory (e.g., in the same table that stores the finger actions and associated functions).
  • the haptic feedback can be customized for each finger action and associated function, as described above.
  • a respective haptic feedback of a plurality of different haptic feedbacks may be associated with each finger action.
  • the method 300 may determine the correct haptic feedback that is associated with the finger action that is determined.
  • the processor may then cause the haptic actuator to provide the haptic feedback associated with the finger action.
  • the method 300 executes a function associated with the finger action. For example, if the function was to cause a display to scroll up, the screen may scroll up. If the function was to cause an e-book or electronic document to flip to the next page, the page may be flipped. If the function was to cause menu to appear and to scroll through the menu, the display may show the menu and scroll through the menu as commanded by the finger action, and so forth. At block 312, the method 300 ends.
  • FIG. 4 illustrates an example of an apparatus 400.
  • the apparatus 400 may be the apparatus 100.
  • the apparatus 400 may include a processor 402 and a non-transitory computer readable storage medium 404.
  • the non-transitory computer readable storage medium 404 may include instructions 406, 408, 410, and 412 that, when executed by the processor 402, cause the processor 402 to perform various functions.
  • the instructions 406 may include instructions to receive a selection of a respective function for each one of a plurality of different finger actions.
  • the instructions 408 may include instructions to receive a first input from a haptic touch button located along a perimeter of a housing of a device and a second input from a sensor.
  • the instructions 410 may include instructions to translate the first input and the second input into a finger action of the plurality of different finger actions.
  • the instructions 412 may include instructions to execute the respective function that was selected for the finger action.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

In example implementations, an apparatus is provided. The apparatus includes a housing, a haptic touch button, a sensor and a processor. The haptic touch button is coupled to a perimeter of the housing. The sensor is located inside of the housing. The processor is located inside of the housing and communicatively coupled to the haptic touch button and the sensor. The processor translates an input from the haptic touch button and an input from the sensor into a finger action.

Description

HAPTIC TOUCH BUTTONS WITH SENSORS FOR DEVICES
BACKGROUND
[0001] Mobile devices are used by consumers to consume media, to enhance productivity, and the like. The mobile devices can include a physical button to perform a particular function. For example, the mobile device may include a physical button for powering on the device, a home button, a physical button to turn the volume up and down, a mute switch, and the like. The functions of these physical buttons are typically set by the manufacturer and cannot be reprogrammed.
BRIEF DESCRIPTION OF THE DRAWINGS
[0002] FIG. 1 is a block diagram of an example of an apparatus having a haptic touch button of the present disclosure;
[0003] FIG. 2 is a block diagram of an example of the haptic touch button of the present disclosure;
[0004] FIG. 3 is a flow chart of an example method for executing a function associated with a finger action detected on a haptic touch button; and
[0005] FIG. 4 is a block diagram of an example non-transitory computer readable storage medium storing instructions executed by a processor.
DETAILED DESCRIPTION
[0006] Examples described herein provide devices having haptic touch buttons with sensors. As discussed above, devices may have physical buttons assigned to perform a particular function. The function performed by the physical button is assigned by the manufacturer and usually cannot be changed.
[0007] The present disclosure provides a device having a haptic touch button that can be used to perform a variety of different functions that can be customized by a user. The haptic touch button may work with a sensor to detect different finger actions that are associated with different functions. A haptic actuator may be used with the haptic touch button to provide feedback. Different actuations or movements of the haptic actuator may be assigned as feedback to different functions.
[0008] FIG. 1 illustrates an example apparatus 100 of the present disclosure. In one example, the apparatus 100 may be a mobile device such as a laptop computer, a tablet computer, and the like. The apparatus 100 may have a haptic touch button 102. The haptic touch button 102 may be communicatively coupled to a processor 104. The processor 104 may also be communicatively coupled to a sensor 106.
[0009] In one example, the apparatus 100 may have a housing 1 10. The housing 1 10 may enclose the sensor 106 and the processor 104. The housing 1 10 may be fabricated from any type of plastic, metal, metalloid, metalized plastic, anodized metal, and the like.
[0010] FIG. 1 illustrates a top side 1 12 of the housing 1 10. The housing 1 10 may also have a perimeter that includes a left side 1 14, a front side 1 16, a right side 1 18, and a back side 120. In other words, the perimeter may be defined to include a surface that is located around the apparatus 100 and located between the top side 1 12 and a bottom side (not shown) of the apparatus 100. In one example, the perimeter may be a surface that has a plane that is perpendicular to a surface plane of the top surface 1 12 and the bottom surface of the apparatus 100. The left side 1 14 and the front side 1 16 are visible in FIG. 1.
[0011] In one example, the haptic touch button 102 may be located along the perimeter of the housing 1 10. For example, in FIG. 1 , the haptic touch button 102 is located along the left side 1 14. The haptic touch button 102 may be positioned such that an outer most surface of the haptic touch button 102 is flush with an outer most surface of the left side 1 14. Thus, the haptic touch button 102 may feel even with the left side 1 14 of the housing 1 10.
[0012] In one example, the haptic touch button 102 may have a rectangular shape. However it should be noted that the haptic touch button 102 may have any type of shape.
[0013] In one example, the outer most surface of the haptic touch button 102 may be smooth or substantially flat. In another example, the outer most surface of the haptic touch button 102 may be textured. For example, the outer most surface of the haptic touch button 102 may have a plurality of protrusions, or an uneven sand paper like topology. The textured surface may allow a user to feel when he or she is touching the haptic touch button 102 without looking. As a result, the user may keep his or her eyes on a display of the apparatus 100 while providing touch inputs to the haptic touch button 102.
[0014] In one example, the processor 104 may receive an input from the haptic touch button 102 and an input from the sensor 106. For example, the haptic touch button 102 may detect when a finger is touching the haptic touch button 102 and the sensor 106 may detect a movement of the finger. Thus, the combination of the haptic touch button 102 with the sensor 106 allows the haptic touch button 102 to recognize additional finger actions of movement (e.g., directional swiping, hovering, single finger swiping, multiple finger swiping, and the like) in addition to touch movements (e.g., tapping, double tapping, holding down the button, and the like).
[0015] The processor 104 may translate the input from the haptic touch button 102 and the input from the sensor 106 into the appropriate finger action. The processor 104 may then determine a function associated with the finger action and execute the appropriate function.
[0016] In one example, the different finger actions may be customized by a user. For example, the user may assign custom functions to different finger actions via a graphical user interface (GUI) of the apparatus 100. The GUI can be displayed to the user via a display of the apparatus 100.
[0017] The finger actions can be customized for different applications. For example, for a music application or video application, a single finger swipe from front to back may be used to increase volume, a single finger swipe from back to front may be used to decrease volume, a two finger swipe from back to front may be used to advance to the next track, a two finger swipe front to back may be used to go back to the previous track, a long press (e.g., touching the haptic touch button 102 for longer than 2 seconds) may stop the current track, a quick tap (e.g., touching the haptic touch button 102 for less than 2 seconds) may pause/play the current track, and so forth.
[0018] In a spreadsheet application, a single finger swipe from front to back may be used to scroll up, a single finger swipe from back to front may scroll down, a two finger swipe from front to back may scroll right, a two finger swipe from back to front may scroll left, a touch and then hover may enable a cell selection, a long press may perform a save function, and the like.
[0019] In a video application, different finger movements may be assigned to perform different actions for the video game (e.g., weapon selection, bringing up a heads up display, scrolling through different menus, and the like). In a photo application, different finger movements may be assigned to perform different actions for taking a photograph (e.g., zooming in and out, scrolling through different photograph/video capture modes, turning a flash on/off, scrolling through and adjusting different parameters (e.g., brightness, iso settings, aperture settings, and the like).
[0020] It should be noted that the apparatus 100 has been simplified for ease of explanation and may include additional components that are not shown. For example, the apparatus 100 may include interfaces (e.g., universal serial bus (USB) interfaces, external memory card slots, graphics processors, a display, a graphical user interface, a network interface card, wireless communication radios, and the like.
[0021] FIG. 2 illustrates a more detailed block diagram of the haptic touch button 102. In one example, the haptic touch button 102 may be installed flush to the perimeter of the housing 1 10. As shown in FIG. 2, the haptic touch button 102 is installed on the left side 1 14 and does not protrude beyond the outer most surface of the left side 1 14.
[0022] In one example, the sensor 106 may be communicatively coupled to the haptic touch button 102 and the processor 104. In one example, the sensor 106 may include a plurality of different sensors or a single sensor. The sensor 106 may provide feedback of a finger presence, finger movement, a force applied by the finger to the haptic touch button 102, and the like, depending on the type of sensor or sensors 106 that are deployed.
[0023] In one example, the sensor 106 may be a contact sensor or a contactless sensor. For example, the sensor 106 may be a single contactless sensor such as an ultrasonic sensor that may be located behind the left side 1 14 inside of the housing 1 10. In another example, the sensor 106 may be a strain sensor that is located directly against the haptic touch button 102 to detect an amount of force that is applied to the haptic touch button 102. It should be noted that any type of sensors, in any combination, may be deployed inside of the apparatus 100.
[0024] In one example, a haptic actuator 208 may be communicatively coupled to the haptic touch button 102 and the processor 104. In one example, the haptic actuator 208 may be customized to provide a different feedback for different functions. The customized feedback may allow a user to know that the correct action was executed in response to the customized finger movements. For example, light feedback or vibration may be actuated in response to a short tap, a hard feedback or vibration may be actuated in response to a long tap, a vibration that moves from front to back may be actuated in response to a finger swipe from front to back, a vibration that moves from back to front may be actuated in response to a finger swipe from back to front, a pulsing vibration that moves from front to back may be actuated in response to a two finger swipe from front to back, a pulsing vibration that moves from back to front may be actuated in response to a two finger swipe from back to front, and the like.
[0025] In one example, the processor 104 may be communicatively coupled to a memory 210. The memory 210 may be any type of non-transitory computer readable medium or computer readable storage medium. For example, the memory 210 may be a hard disk drive, a read access memory (RAM), a read only memory (ROM), and the like. The memory 210 may include more than one type of memory. For example, the customized finger actions and customized haptic feedback may be stored in a hard disk drive and some fixed finger actions and haptic feedbacks may be stored in ROM.
[0026] In one example, the different finger actions and associated functions may be stored in the memory 210. The processor 104 may translate the input from the haptic button 102 and the sensor 106 into a finger action, as described above. The processor 104 may then access the memory 210 to determine which function is associated with the finger action for a particular application. In one example, a look up table, or other similar format, may be used to store each finger action with a respective function. After the processor 104 determines the correct function for the finger action for a particular application, the processor 104 may execute the function.
[0027] The processor 104 may also look up the appropriate feedback associated with the finger action. The processor 104 may then cause the haptic actuator 208 to perform the appropriate feedback that is determined to be associated with the finger action.
[0028] The design of the haptic button 102 in combination with the sensor 106 provides a smaller design than current physical buttons that may be deployed on devices. For example, the mechanical components of the physical buttons can be removed or replaced with the combination of the haptic button 102 and the sensor 106 of the present disclosure. As a result, the overall size (e.g., a thickness or z-direction) of the device may be reduced.
[0029] In addition, a single haptic button 102 in combination with the sensor 106 may be customized to perform many different functions. As a result, some physical buttons may be eliminated from the device, which may also save space, cost, and size of the device. The single haptic button 102 in combination with the sensor 106 may also consume a minimal amount of space allowing the combination to be deployed in narrow display border designs for tablet devices, notebooks, and other hybrid mobile devices.
[0030] FIG. 3 illustrates a flow diagram of an example method 300 for executing a function associated with a finger action detected on a haptic touch button. In one example, the method 300 may be performed by the apparatus 100 illustrated in FIG. 1 or the apparatus 400 illustrated in FIG. 4 below. [0031] At block 302, the method 300 begins. At block 304, the method 300 receives a first input from a haptic touch button located along a perimeter of a housing of a device. For example, a user may touch the haptic touch button to provide the first input.
[0032] At block 306, the method 300 receives a second input from a sensor. The second input may be a touch movement detected by a contactless sensor. For example, the contactless sensor may be an ultrasonic sensor that is located adjacent to the haptic touch button behind a wall of the perimeter of the device. The touch movement may include a single finger swipe, or a multiple finger swipe.
[0033] In another example, the touch movement may be detected by contact sensors. For example, the contact sensor may be a strain sensor or a resistive sensor that can detect and amount of force that is applied by the second input, a number of taps that is provided by the second input, and the like.
[0034] In one example, the sensor may be a combination of the contactless sensor and contact sensor or a plurality of different contact sensors. In one example, the second input may be a combination of a touch movement and touch force. For example, a single finger may press down for a period of time greater than a threshold, or with greater than a predefined amount of force, and then moved from front to back.
[0035] At block 308, the method 300 translates the first input and the second input into a finger action. For example, a plurality of different finger actions may be customized to perform different actions. In one example, the different finger actions may be customized to perform different functions for different applications.
[0036] After the first input and the second input are received, the method 300 may determine the finger action that is associated with the first input and the second input. The method 300 may then determine a function associated with the finger action. In one example, the function associated with the finger action may also be based on a particular application that is being executed when the first input and the second input were received.
[0037] In one example, the functions associated with each finger action and/or application may be stored in memory. The finger action that is determined may be compared to a table that includes each finger action and associated function to determine which function is associated with the finger action.
[0038] In one example, the haptic feedback may also be stored in memory (e.g., in the same table that stores the finger actions and associated functions). The haptic feedback can be customized for each finger action and associated function, as described above. In other words, a respective haptic feedback of a plurality of different haptic feedbacks may be associated with each finger action. The method 300 may determine the correct haptic feedback that is associated with the finger action that is determined. The processor may then cause the haptic actuator to provide the haptic feedback associated with the finger action.
[0039] At block 310, the method 300 executes a function associated with the finger action. For example, if the function was to cause a display to scroll up, the screen may scroll up. If the function was to cause an e-book or electronic document to flip to the next page, the page may be flipped. If the function was to cause menu to appear and to scroll through the menu, the display may show the menu and scroll through the menu as commanded by the finger action, and so forth. At block 312, the method 300 ends.
[0040] FIG. 4 illustrates an example of an apparatus 400. In one example, the apparatus 400 may be the apparatus 100. In one example, the apparatus 400 may include a processor 402 and a non-transitory computer readable storage medium 404. The non-transitory computer readable storage medium 404 may include instructions 406, 408, 410, and 412 that, when executed by the processor 402, cause the processor 402 to perform various functions.
[0041] The instructions 406 may include instructions to receive a selection of a respective function for each one of a plurality of different finger actions. The instructions 408 may include instructions to receive a first input from a haptic touch button located along a perimeter of a housing of a device and a second input from a sensor. The instructions 410 may include instructions to translate the first input and the second input into a finger action of the plurality of different finger actions. The instructions 412 may include instructions to execute the respective function that was selected for the finger action.
[0042] It will be appreciated that variants of the above-disclosed and other features and functions, or alternatives thereof, may be combined into many other different systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, variations, or improvements therein may be subsequently made by those skilled in the art which are also intended to be encompassed by the following claims.

Claims

1. An apparatus, comprising:
a housing;
a haptic touch button coupled to a perimeter of the housing;
a sensor located inside of the housing; and
a processor located inside of the housing and communicatively coupled to the haptic touch button and the sensor, wherein the processor translates an input from the haptic touch button and an input from the sensor into a finger action.
2. The apparatus of claim 1 , comprising:
a haptic actuator communicatively coupled to the haptic touch button and the processor to provide a haptic feedback based on the finger action.
3. The apparatus of claim 2, wherein the finger action is selected from a plurality of different finger actions and the haptic feedback is selected from a plurality of different haptic feedbacks that is associated with the finger action.
4. The apparatus of claim 1 , wherein the sensor comprises a strain sensor.
5. The apparatus of claim 1 , wherein the sensor comprises a contactless sensor.
6. The apparatus of claim 1 , wherein the processor executes a function associated with the finger action.
7. The apparatus of claim 1 , wherein the finger action comprises a touch movement.
8. A method, comprising:
receiving, by a processor, a first input from a haptic touch button located along a perimeter of a housing of a device;
receiving, by a processor, a second input from a sensor;
translating, by the processor, the first input and the second input into a finger action; and
executing, by the processor, a function associated with the finger action.
9. The method of claim 8, comprising:
determining, by the processor, a haptic feedback selected from a plurality of different haptic feedbacks that is associated with the finger action; and
causing, by the processor, a haptic actuator to provide the haptic feedback associated with the finger action.
10. The method of claim 8, wherein the function associated with the finger action is pre-defined by a user.
1 1. The method of claim 8, wherein the second input comprises a touch movement detected by a contactless sensor.
12. The method of claim 8, wherein the touch movement comprises a single finger swipe or a multiple finger swipe.
13. A non-transitory computer readable storage medium encoded with instructions executable by a processor, the non-transitory computer-readable storage medium comprising:
instructions to receive a selection of a respective function for each one of a plurality of different finger actions;
instructions to receive a first input from a haptic touch button located along a perimeter of a housing of a device and a second input from a sensor; instructions to translate the first input and the second input into a finger action of the plurality of different finger actions; and
instructions to execute the respective function that was selected for the finger action.
14. The non-transitory computer readable storage medium of claim 13, comprising:
instructions to receive a selection of a respective haptic feedback for each one of the plurality of different finger actions.
15. The non-transitory computer readable storage medium 14, comprising: instructions to control a haptic actuator to provide the respective haptic feedback that was selected for the finger action.
PCT/US2017/064429 2017-12-04 2017-12-04 Haptic touch buttons with sensors for devices Ceased WO2019112545A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/US2017/064429 WO2019112545A1 (en) 2017-12-04 2017-12-04 Haptic touch buttons with sensors for devices
US16/481,358 US11150735B2 (en) 2017-12-04 2017-12-04 Haptic touch buttons with sensors for devices

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2017/064429 WO2019112545A1 (en) 2017-12-04 2017-12-04 Haptic touch buttons with sensors for devices

Publications (1)

Publication Number Publication Date
WO2019112545A1 true WO2019112545A1 (en) 2019-06-13

Family

ID=66750287

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/064429 Ceased WO2019112545A1 (en) 2017-12-04 2017-12-04 Haptic touch buttons with sensors for devices

Country Status (2)

Country Link
US (1) US11150735B2 (en)
WO (1) WO2019112545A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12314481B2 (en) 2021-03-12 2025-05-27 Telefonaktiebolaget Lm Ericsson (Publ) Button with mechanical switch, electromagnetic sensor and haptic feedback, and method
CN113238688B (en) * 2021-05-10 2023-06-27 北京字跳网络技术有限公司 Form display method, device, equipment and medium
JP7467391B2 (en) * 2021-06-18 2024-04-15 キヤノン株式会社 Information processing device and method for controlling the information processing device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110087963A1 (en) * 2009-10-09 2011-04-14 At&T Mobility Ii Llc User Interface Control with Edge Finger and Motion Sensing
US20110122085A1 (en) * 2009-11-24 2011-05-26 Mediatek Inc. Apparatus and method for providing side touch panel as part of man-machine interface (mmi)
US20110167391A1 (en) * 2010-01-06 2011-07-07 Brian Momeyer User interface methods and systems for providing force-sensitive input
US20170060320A1 (en) * 2015-08-28 2017-03-02 Xiaomi Inc. Method for controlling a mobile terminal using a side touch panel

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7656393B2 (en) 2005-03-04 2010-02-02 Apple Inc. Electronic device having display and surrounding touch sensitive bezel for user interface and control
US20070132740A1 (en) * 2005-12-09 2007-06-14 Linda Meiby Tactile input device for controlling electronic contents
US20100078343A1 (en) 2008-09-30 2010-04-01 Hoellwarth Quin C Cover for Portable Electronic Device
US20120075173A1 (en) * 2010-09-23 2012-03-29 Nokia Corporation Apparatus and method for user input
US9436281B2 (en) 2011-04-26 2016-09-06 Blackberry Limited Electronic device and method of providing tactile feedback
US8723824B2 (en) 2011-09-27 2014-05-13 Apple Inc. Electronic devices with sidewall displays
US9075448B2 (en) * 2013-03-17 2015-07-07 Janusz Wiktor Rajkowski Symbol encoding apparatus and method
US9471143B2 (en) 2014-01-20 2016-10-18 Lenovo (Singapore) Pte. Ltd Using haptic feedback on a touch device to provide element location indications
WO2015126095A1 (en) * 2014-02-21 2015-08-27 삼성전자 주식회사 Electronic device
US20170010780A1 (en) * 2015-07-06 2017-01-12 Hand Held Products, Inc. Programmable touchscreen zone for mobile devices
KR102710628B1 (en) * 2017-02-03 2024-09-27 엘지전자 주식회사 Mobile terminal and method for controlling of the same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110087963A1 (en) * 2009-10-09 2011-04-14 At&T Mobility Ii Llc User Interface Control with Edge Finger and Motion Sensing
US20110122085A1 (en) * 2009-11-24 2011-05-26 Mediatek Inc. Apparatus and method for providing side touch panel as part of man-machine interface (mmi)
US20110167391A1 (en) * 2010-01-06 2011-07-07 Brian Momeyer User interface methods and systems for providing force-sensitive input
US20170060320A1 (en) * 2015-08-28 2017-03-02 Xiaomi Inc. Method for controlling a mobile terminal using a side touch panel

Also Published As

Publication number Publication date
US20200285321A1 (en) 2020-09-10
US11150735B2 (en) 2021-10-19

Similar Documents

Publication Publication Date Title
US11656711B2 (en) Method and apparatus for configuring a plurality of virtual buttons on a device
CA2667911C (en) Portable electronic device including a touch-sensitive display and method of controlling same
US10140008B2 (en) Mechanical ratchet system for a knob
US8531417B2 (en) Location of a touch-sensitive control method and apparatus
KR101230220B1 (en) Method of providing tactile feedback and electronic device
KR102240088B1 (en) Application switching method, device and graphical user interface
US10037130B2 (en) Display apparatus and method for improving visibility of the same
EP2752737B1 (en) Portable device control method using an electric pen and portable device thereof
KR102395676B1 (en) Fabric laminated touch input device
US20100103128A1 (en) Electronic device and touch control method thereof
EP2784629A2 (en) Method for controlling portable device equipped with flexible display, and portable device using the method
US9939958B2 (en) Touch sensitive surface with recessed surface feature for an electronic device
CN105210023B (en) Device and correlation technique
US9727147B2 (en) Unlocking method and electronic device
CN103299262A (en) Electronic device and method of displaying information in response to a gesture
US11150735B2 (en) Haptic touch buttons with sensors for devices
CN103218149A (en) Remote controller, and system and method using the same
CA2749244C (en) Location of a touch-sensitive control method and apparatus
EP3098796B1 (en) Remote control apparatus, method of providing vibration feedback thereof, and display system
KR20130114413A (en) Smart remote controller using edge sliding ui
JP2016126363A (en) Touch screen input method, mobile electronic device, and computer program
CA2773813A1 (en) Portable electronic device and method of controlling same
KR101236630B1 (en) Method of providing tactile feedback and electronic device
EP3413183B1 (en) Electronic apparatus and method for controlling the same
CN105824566A (en) Method for controlling terminal and terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17934217

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17934217

Country of ref document: EP

Kind code of ref document: A1