EP2327004A1 - Tastrückmeldung zur tastensimulation in berührungsschirmen - Google Patents

Tastrückmeldung zur tastensimulation in berührungsschirmen

Info

Publication number
EP2327004A1
EP2327004A1 EP09799905A EP09799905A EP2327004A1 EP 2327004 A1 EP2327004 A1 EP 2327004A1 EP 09799905 A EP09799905 A EP 09799905A EP 09799905 A EP09799905 A EP 09799905A EP 2327004 A1 EP2327004 A1 EP 2327004A1
Authority
EP
European Patent Office
Prior art keywords
touch
key
tactile feedback
electronic device
portable electronic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP09799905A
Other languages
English (en)
French (fr)
Other versions
EP2327004A4 (de
Inventor
Edward Hui
Zhongming Ma
Perry Faubert
Arnett Weber
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BlackBerry Ltd
Original Assignee
Research in Motion Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/394,951 external-priority patent/US20100220065A1/en
Application filed by Research in Motion Ltd filed Critical Research in Motion Ltd
Publication of EP2327004A1 publication Critical patent/EP2327004A1/de
Publication of EP2327004A4 publication Critical patent/EP2327004A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G02OPTICS
    • G02FOPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/1333Constructional arrangements; Manufacturing methods
    • G02F1/13338Input devices, e.g. touch panels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/02Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
    • G06F15/0225User interface arrangements, e.g. keyboard, display; Interfaces to other computer systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. SMS or e-mail
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Definitions

  • the present disclosure relates to portable electronic devices, including but not limited to portable electronic devices having touch screen displays and their control.
  • Portable electronic devices include, for example, several types of mobile stations such as simple cellular telephones, smart telephones, wireless personal digital assistants (PDAs), and laptop computers with wireless 802.11 or Bluetooth capabilities. These devices run on a wide variety of networks from data-only networks such as Mobitex® and DataTAC® networks to complex voice and data networks such as GSM/GPRS, CDMA, EDGE, UMTS and CDMA2000 networks.
  • data-only networks such as Mobitex® and DataTAC® networks
  • complex voice and data networks such as GSM/GPRS, CDMA, EDGE, UMTS and CDMA2000 networks.
  • Portable electronic devices such as PDAs or smart telephones are generally intended for handheld use and ease of portability. Smaller devices are generally desirable for portability.
  • a touch-sensitive display also known as a touchscreen display, is particularly useful on handheld devices, which are small and have limited space for user input and output. The information displayed on the touch-sensitive displays may be modified depending on the functions and operations being performed. With continued demand for decreased size of portable electronic devices, touch-sensitive displays continue to decrease in size.
  • FIG. 1 is a block diagram of a portable electronic device in a communication network in accordance with the disclosure.
  • FIG. 2 illustrates a side view of the touch-sensitive display in accordance with the disclosure.
  • FIG. 3 illustrates a side view of the touch-sensitive display shown when the actuators are actuated in accordance with the disclosure.
  • FIG. 4 illustrates locations of actuators and pressure sensors located with respect to a touch-sensitive display in accordance with the disclosure.
  • FIG. 5 illustrates four actuators and four pressure sensors located with respect to a touch-sensitive display in accordance with the disclosure.
  • FIG. 6 illustrates a plurality of actuators and force sensors disposed for each key of a displayed keyboard in accordance with the disclosure.
  • FIG. 7 illustrates a keyboard displayed on a touch-sensitive display of a portable electronic device in accordance with the disclosure.
  • FIG. 8 illustrates a pattern related to tactile feedback in relation to keys of a keyboard displayed on the touch-sensitive display in accordance with the disclosure.
  • FIG. 9 illustrates two consecutive touch locations on a keyboard displayed on the touch-sensitive display in accordance with the disclosure.
  • FIG. 10 illustrates a pattern of tactile feedback locations on keys of a keyboard displayed on the touch-sensitive display in accordance with the disclosure.
  • FIG. 11 illustrates a flowchart of a method of providing tactile feedback for a touch-sensitive display in accordance with the disclosure.
  • FIG. 1 A block diagram of a portable electronic device 300 in a communication network is shown in FIG. 1.
  • the electronic device 100 includes a microprocessor 338 that controls the operation of the electronic device 100, such as facilitating communications, providing a graphical user interface, executing programs, and so forth.
  • a communication subsystem 311 performs communication transmission and reception with the wireless network 319.
  • the microprocessor 338 further may be connected with an auxiliary input/output (I/O) subsystem 328 that may be connected to the device 100. Additionally, in at least one embodiment, the microprocessor 338 may be connected to a serial port (for example, a Universal Serial Bus port) 330 that facilitates communication with other devices or systems via the serial port 330.
  • a serial port for example, a Universal Serial Bus port
  • a display 322 is operably connected to microprocessor 338 to facilitate display of information to an operator of the device 100.
  • the electronic device 100 When the electronic device 100 is equipped with a keyboard 332, which may be physical or virtual (i.e., displayed), the keyboard 332 is operably connected to the microprocessor 338.
  • the electronic device 100 may include a speaker 334 and a microphone 336, which may advantageously be operably connected to the microprocessor.
  • a vibrator 132 which may be a vibrator motor, may be operably connected to the microprocessor 338 to generate vibrations in the electronic device 100.
  • Other similar components may be provided on or within the device and are optionally operably connected to the microprocessor 338.
  • a communication subsystem 340 is a short-range communication system such as a BLUETOOTH® communication module or a WI-FI® communication module (a communication module in compliance with IEEE 802.11b) and associated circuits and components.
  • the microprocessor 338 performs operating system functions and executes programs or software applications on the electronic device 100. In some embodiments, not all of the above components are included in the electronic device 100.
  • the auxiliary I/O subsystem 328 may take the form of one or more different navigation tools (multi-directional or single-directional), external display devices such as keyboards, and other subsystems capable of providing input or receiving output from the electronic device 100.
  • the electronic device 100 is equipped with components to enable operation of various programs, as shown in FIG. 1.
  • the memory 324 provides storage for the operating system 357, device programs 358, data, and so forth.
  • the operating system 357 is generally configured to manage other programs 358 that are also stored in memory 324 and executable on the processor 338.
  • the operating system 357 handles requests for services made by programs 358 through predefined program 358 interfaces. More specifically, the operating system 357 typically determines the order in which multiple programs 358 are executed on the processor 338 and the execution time allotted for each program 358, manages the sharing of memory 324 among multiple programs 358, handles input and output to and from other device subsystems 342, and so forth.
  • may interact directly with the operating system 357 through a user interface, typically including the keyboard 332 and display screen 322.
  • the operating system 357, programs 358, data, and other information may be stored in memory 324, RAM 326, read-only memory (ROM), or another suitable storage element (not shown).
  • An address book 352, personal information manager (PIM) 354, and other information 356 may also be stored.
  • the electronic device 100 may be enabled for two-way communication within voice, data, or voice and data communication systems.
  • a Subscriber Identity Module (SIM) or Removable User Identity Module (RUIM) may be utilized to authorize communication with the communication network 319.
  • SIM/RUIM interface 344 within the electronic device 100 interfaces a SIM/RUIM card to the microprocessor 338 and facilitates removal or insertion of a SIM/RUIM card (not shown).
  • the SIM/RUIM card features memory and holds key configurations 351, and other information 353 such as identification and subscriber related information.
  • the electronic device 100 is equipped with an antenna 318 for transmitting signals to the communication network 319 and another antenna 316 for receiving communication from the communication network 319.
  • a communication subsystem 311 includes a transmitter 314 and receiver 312, one or more antennae 316, 318, local oscillators (LOs) 313, and a processing module 320 such as a digital signal processor (DSP) 320.
  • the electronic device 100 includes a touch-sensitive display 118 that includes one or more touch location sensors 110, an overlay 114, and a display 322, such as a liquid crystal display (LCD) or light emitting diode (LED) display, such as shown in FIG. 2 and FIG. 3.
  • LCD liquid crystal display
  • LED light emitting diode
  • the touch location sensor(s) 110 may be a capacitive, resistive, infrared, surface acoustic wave (SAW), or other type of touch-sensitive sensor and may be integrated into the overlay 114.
  • the overlay 114, or cover may be comprised of laminated glass, plastic, or other suitable material(s) and is advantageously translucent or transparent.
  • a touch, or touch contact may be detected by the touch-sensitive display 118 and processed by the processor 338, for example, to determine a location of the touch.
  • Touch location data may include the center of the area of contact or the entire area of contact for further processing.
  • a touch may be detected from a contact member, such as a body part of a user, for example a finger or thumb, or other objects, for example a stylus, pen, or other pointer, depending on the nature of the touch location sensor.
  • the portable electronic device 100 processes contact location information received from the location sensor(s) 110 and determines one location of contact or alternatively two or more simultaneous locations of touch contact on the overlay 114. Two simultaneous locations of contact may occur, for example, when two fingers or thumbs are used to input data into the portable electronic device 100.
  • the pressure sensor(s) 140 may provide data to the portable electronic device 100 to determine which of two detected simultaneous touches has greater contact pressure. This determination may be utilized to select which touch dictates the selection of data, functions, or commands associated with the touch. Time of touch may also be utilized as a factor in determining which touch controls selection.
  • One or more actuators or switches 130 and one or more pressure sensors 140 are also shown disposed in conjunction with the touch-sensitive display 118. Although the touch location sensor 110 is shown located above the display 322, the touch location sensor 110 may be located below the display 322.
  • the actuators 130 may be affixed to a back, support, or base 202, which may include a printed circuit board (PCB). Alternatively, the actuator 130 may be affixed to an intermediary board or mounting structure between the actuator 130 and the base 202.
  • PCB printed circuit board
  • the pressure sensors 140 may be mounted beneath the display 322 and may optionally be affixed to the actuators 130.
  • the pressure sensors 140 may optionally be mounted beneath the overlay 114.
  • the pressure sensors 140 may optionally be placed in a parallel configuration with the actuators 130. For example, the pressure sensors 140 may be placed adjacent to the actuators 130 rather than above them. Other locations that facilitate measurement or detection of the force applied to the surface may be utilized.
  • the pressure sensors 140 facilitate the generation of contact pressure data that is processed by the microprocessor 338.
  • the pressure sensors 140 may be strain gauges, piezoresistive devices, microelectromechanical systems (MEMS) devices, variable capacitance devices, pressure sensitive resistors, inductive based pressure sensors, Hall Effect pressure sensors, and so forth.
  • MEMS microelectromechanical systems
  • the pressure sensors 140 detect and measure pressure or changes in pressure applied to the touch-sensitive display 118 through contact with the overlay 114.
  • Force sensors may optionally be utilized instead of pressure sensors.
  • force sensors include, but are not limited to, force sensitive resistors, strain gauges, and piezoelectric devices.
  • An actuator 130 may be comprised of a plurality of piezoelectric devices.
  • the actuators 130 may be piezoelectric devices that expand and contract depending on applied voltage/current, applied force, or both. Examples of piezoelectric devices are shown in an expanded and in a contracted state, respectively, in FIG. 2 and 3.
  • the actuators 130 may advantageously be utilized to provide tactile feedback, as may be felt through contact with the overlay 114 of the touch-sensitive display, as described below.
  • the actuators 130 are piezoelectric actuators such as piezoelectric (piezo) disks
  • each disk contracts or bends due to build up of charge/voltage.
  • Force applied on each piezo disk through the overlay 114 also bends the piezo disk. Absent an external force applied to the overlay 114, and absent a charge on the piezo disk, the piezo disk is slightly bent due to a mechanical preload.
  • a force applied to the touch-sensitive display 118, prior to actuation of the piezo disk, causes increased bending of the piezo disk, and the piezo disk applies a spring force against the touch-sensitive display 118.
  • the piezo disks may be located between the base 202 and the display 322, such that charging of the piezo disks applies a force in a direction toward the overlay 114, away from the base 202.
  • the charge on the piezo disks may be adjusted to control the force applied by the piezo disks and the resulting movement of and/or force on the overlay 114.
  • the charge is adjusted by varying the applied voltage or current. Increased charge on the piezo disk contracts the piezo disk, resulting in force on the overlay 114 that opposes the externally applied force.
  • the charge on the piezo disk may also be removed by a controlled discharge of current, causing the piezo disk 316 to expand, releasing the force caused by the electric charge and decreasing force on the touch screen display 118 applied by the piezo disks.
  • the touch-sensitive display 118 may provide tactile feedback in a similar fashion to a physical key, thereby simulating depression and release of a physical key.
  • Pressure data due to touch contact provided by the pressure sensor(s) 140 may at least partially facilitate such feedback. For example, if one Newton of force is utilized as the force necessary to select a key, a threshold may be set for selection at one Newton.
  • the actuators 130 and pressure sensors 140 may be located in a variety of different layouts or configurations. For example, four actuators 130 and four pressure sensors 140 are shown disposed near the corners of the overlay 114 in FIG. 4 and FIG. 5. The actuators 130 and pressure sensors 140 are shown located concentrically with respect to each other. The actuators 130 and pressure sensors 140 are not necessarily shown to scale, and some features may be exaggerated or minimized to focus on specific details of various components. One or more actuators 130 and one or more pressure sensors 140 may be utilized. Each actuator 130 need not be paired with a pressure sensor 140. For example, two pressure sensors 140 may be disposed near opposite corners, while two actuators 130 are disposed in the other two corners.
  • actuators 130 may be disposed in locations where keys or buttons are often displayed.
  • an actuator 130 may be disposed with respect to each displayed key of a virtual keyboard 332, such as shown in FIG. 6.
  • Two or more keys may share an actuator 130.
  • two pressure sensors 140 are shown at opposite ends of the lowest row of virtual keys, and two other pressure sensors 140 are located at the opposite part of the overlay 114 where an application interface or other information is displayed.
  • FIG. 7 An example electronic device 100 is shown in FIG. 7.
  • the electronic device 100 comprises a handheld communication device
  • the electronic device 100 may comprise a handheld wireless communication device, a personal digital assistant (PDA), laptop computer, desktop computer, a server, other communication device, or other portable computing device.
  • PDA personal digital assistant
  • keys includes virtual or displayed keys or buttons that are images displayed on a touch-sensitive display. Keys may be associated with characters, such as letters, numbers, spaces, and punctuation marks, and/or functions, such as shift, control, alpha, numeric, symbol, alternate, delete, return, enter, power, and so forth, and/or symbols representing actions or operations, for example, play, stop, and pause for a media player, previous and next for a web browser, and so forth.
  • keys is not limited to keys from a keyboard, although the examples provided herein are provided in the context of keys of a keyboard.
  • the portable electronic device 100 may include programs that utilize text or data entry programs or subroutines, such as a note pad, task book, address book, email, and text message program, to name a few.
  • An email composer segment of an email program is shown in FIG. 7.
  • the email composer facilitates creation of a new email message.
  • the email composer shown includes virtual keys that provide for creation of a new email message, searching previous email messages, and the option to close the email composer. Other options may be provided but are not shown for the sake of simplicity.
  • the displayed keyboard 332 includes a plurality of images of keys 702 that constitute virtual representations of physical keys on a display 322 as shown in FIG. 7.
  • Each key image 702 includes an outer border or frame 704.
  • Each key is associated with at least one action, such as the input of a character, a command, or a function. Characters include, for example, alphabetic letters, symbols, numbers, punctuation, insignias, icons, pictures, and blank spaces.
  • the illustrated keyboard 332 has alphabetic and numeric characters arranged in a reduced QWERTY keyboard layout, in addition to other functions, such as capitalization and symbol keys that bring up alternate keys for display. Delete and enter keys are also shown. In other embodiments, a full QWERTY, QWERTZ, AZERTY, Dvorak, or other layout may be provided.
  • the present disclosure describes a solution whereby tactile sensation is provided on a touch-sensitive display 118 to aid in information entry such as text or data entry.
  • the actuators 130 provide tactile feedback when a touch is detected in predetermined areas of the touch-sensitive display 118.
  • the feedback may include vibration, pulse, or other sensations caused by one or more actuators 130, which feedback may be felt on the outer surface of the touch-sensitive display 118.
  • the vibration may, for example, be generated in the ultrasonic frequency range, such that the user feels a surface characteristic or texture, such as edges, bumps, ridges, ribs, grooves, or friction. When ultrasonic frequency vibrations are utilized, the user may feel the surface characteristic or texture rather than feeling individual vibrations or pulses.
  • This provision of tactile feedback may be described as inducing modulation of the overlay 114 of the touch-sensitive display 118 when a touch is detected.
  • Use of ultrasonic frequency vibration is known. While the term vibration is used herein, other types of modulation that produce similar tactilely distinguishable surfaces are considered within the scope of this disclosure.
  • the tactile feedback as described herein may be applied during a program that displays a virtual keyboard 332, such as shown in the figures.
  • Tactile feedback may be applied in such a way as to simulate the outer edges of physical keys by providing tactile feedback when a touch is detected at or near a border of one or more of the key images 702 of the virtual keyboard 332.
  • a pattern 802 is formed that surrounds the outer edges of the keys and may also include the areas between the keys, such as shown in FIG. 8.
  • a location of the touch is determined, e.g., by the touch location sensor 110 in conjunction with the microprocessor 338.
  • tactile feedback is provided, for example, through microprocessor 338 control of the actuators 130.
  • the pattern 802 may overlap a part of the one or more key images 702, such that tactile feedback may be felt internally to the border 704 of the key being touched.
  • the pattern 802 may be set away from the visible borders 704 of the keys, thus tactile feedback may be felt somewhat outside the borders 704.
  • FIG. 9 An email message during composition is shown in FIG. 9. Presuming the word “meeting” is being entered, and the user has finished entering the second “e” in “meeting," the user's finger moves from the "IER” key to the "2TY” key to enter the "t.” If the portable electronic device 100 detects a touch location in the area of the pattern 802, tactile feedback is provided. Such detection may occur, for example, when a finger that was positioned above the "IER” key image 702 moves to the "2TY” key image 702 while contacting the touch-sensitive display 118. For example, the user may utilize a sliding contact, also known as a swipe, from a first touch contact area 902 in FIG.
  • a sliding contact also known as a swipe
  • the touch may be comprised of multiple contacts from the first contact area 902 to the second contact area 904, one or more of which are located in the area of the pattern 802, and thus cause tactile feedback to be generated.
  • the tactile feedback may be simple, such as a vibration or pulse of force against the finger or other contacting member.
  • the tactile feedback provided by the portable electronic device 100 may cause the user to feel a bump, edge, ridge, or groove between the borders of the two keys, e.g., where the pattern 802 is shown.
  • the tactile feedback may simulate physical edges, ridges, or grooves in the area where the pattern 802 is formed.
  • the user may feel a single bump or ridge between the key images 702, or two distinct bumps or ridges, one for each key border.
  • the user may feel a single groove between the key images 702, or two distinct grooves, one for each key border.
  • the tactile feedback may be based, for example, on a force- displacement curve associated with a physical key.
  • Feedback may be provided locally, i.e., where a touch is detected, or may be provided across most or all of the overlay 114. When multiple simultaneous touches are detected, different feedback may be provided locally at each detected touch location.
  • tactile feedback may be provided when the contacting member is on or near the center or middle of the key image 702, such as the locators found on the "f" and "k” keys on a QWERTY keyboard utilized to assist a user to place index fingers.
  • a pattern 1002 of areas where tactile feedback is provided is located away from the edges, for example, near the centers of each displayed key of the virtual keyboard 332, as shown in FIG. 10.
  • Tactile feedback may be provided to simulate a ridge or bump, but may alternatively be provided in the form of additional friction along the surface of the overlay 114.
  • the pattern 1002 is shown on each of the keys, the pattern 1002 may be provided on fewer than all of the keys of the keyboard 332.
  • the pattern 1002 may also be extended to the "New, "Search,” and “Close” buttons (not shown). Combinations of the two patterns 802, 1002 of feedback locations may also be utilized.
  • the inter-key pattern 802 may be utilized in conjunction with one or more locators that are a subset of the internal pattern 1002 associated with one or more keys.
  • the individual locators of the pattern 1002 may be the "5GH” key or "8BN” key; the “2TY” and “0-SPACE” keys; or the "2TY,” “5GH,” “8BN,” and “OSPACE” keys, to name a few options.
  • This pattern 1002 may be comprised of smaller areas of feedback than shown in FIG.
  • the areas may be located near or along one edge of each displayed key, such as the bottom or top of each displayed key from the perspective of the user.
  • the pattern 1002 may be comprised of vertical areas, instead of or in addition to the horizontal areas shown, as viewed by the user.
  • the individual components of the pattern 1002 may have different shapes, such as one or more bumps, squares, circles, triangles, and so forth.
  • This tactile feedback provision facilitates data entry by a user to enter without looking at the key images 702. For instance, a sweeping, swiping, or sliding contact, known as a swipe or gesture, of a finger of the user starts at the "QW" key image 702 and ends at the "CAPS-OP" key image 702, tactile feedback is provided for each of the four key changes at the borders 704 associated with five keys. Similarly, the user may find the "0-SPACE" key from the "QW” key by detecting feedback twice in the horizontal direction and three times in the vertical direction, where horizontal and vertical refer only to the user's viewpoint of the overlay 114.
  • the pressure sensor(s) 140 and or touch location sensor(s) 110 may be utilized to determine touch location data indicative of a sweeping, swiping, or sliding contact. Such information may be useful to select from among two or more detected simultaneous touch locations. Such a determination may be utilized, for example, to select the touch location for providing tactile feedback. For example, the pressure of touch contact may be used to determine which simultaneous contact location to track when a sliding, swiping, or sweeping contact is detected.
  • FIG. 11 A flowchart illustrating a method of providing tactile feedback for a touch-sensitive display is shown in FIG. 11.
  • the portable electronic device 100 performs the processes of the flowchart and may utilize its processor 338 to run software to perform some or all of the steps, as known in the art.
  • the software may be, for example, part of a touch-sensitive display program 359 shown stored in memory 324 in FIG. 1.
  • the touch-sensitive display program 359 may also display information on the display 322, provide a graphical user interface, determine the location of touches with respect to application information, interact with actuators 130 and pressure sensors 140, and so forth.
  • One or more keys are displayed 1102 on the touch-sensitive display 118.
  • the processor 338 or other device determines whether the location of the touch is within a feedback area such as the external pattern 802 of FIG. 8 or the internal pattern 1002 of FIG. 10.
  • a feedback area such as the external pattern 802 of FIG. 8 or the internal pattern 1002 of FIG. 10.
  • tactile feedback is provided 1108 that simulates a characteristic of a physical key.
  • the characteristic of the physical key may be, as described above, a surface characteristic or texture, such as edges, bumps, ridges, ribs, grooves, or friction.
  • an edge, texture, or a physical locator of a physical key for example, may be simulated as described above.
  • the tactile feedback may be provided in conjunction with other images or items on the display 118.
  • the tactile feedback may simulate the texture displayed in the image of the mountain on the display using the touch location data as described above.
  • the tactile feedback on the overlay 114 may be provided based upon location of the contact in relation to the displayed image of the mountain.
  • Tactile image simulation may be generated based upon other displayed images, such as the texture of a flower, a beach, or a cliff.
  • a portable electronic device comprises a touch-sensitive display arranged and constructed to detect a touch and a microprocessor and memory arranged and constructed to display an image of a key on the touch-sensitive display and, when the touch is located in a predetermined area associated with the key, providing tactile feedback simulating a characteristic of a physical key.
  • the predetermined area may be near or outside a border of the image of the key.
  • the predetermined area may be internal to a border of the image of the key.
  • the characteristic may be an edge of a key.
  • the characteristic may be a locator disposed on a key.
  • a plurality of keys may be displayed on the touch- sensitive display and the predetermined area may be comprised of a plurality of areas associated with each of the plurality of keys.
  • the at least one actuator may be a piezoelectric actuator that provides the tactile feedback.
  • At least one actuator that vibrates in an ultrasonic frequency range may provide tactile feedback.
  • the tactile feedback may simulate at least one of an edge, a bump, a ridge, and a groove.
  • At least one pressure sensor may provide pressure data associated with a detected touch.
  • a method comprises displaying an image of a key on a touch-sensitive display, detecting a touch on the touch-sensitive display at a first location, and, when the first location is located in a predetermined area related the key, providing tactile feedback simulating a characteristic of a physical key.
  • the tactile feedback may simulate an edge of a physical key.
  • the tactile feedback may simulate a locator disposed on a physical key.
  • An actuator may be vibrated in an ultrasonic frequency range to provide tactile feedback.
  • the tactile feedback may simulate at least one of an edge, a bump, a ridge, and a groove.
  • Pressure data may be utilized to select between two simultaneous touch locations to provide tactile feedback.
  • the predetermined area may be near or at a border of the image of the key.
  • the predetermined area may be internal to a border of the image of the key.
  • a plurality of keys may be displayed on the touch-sensitive display and the predetermined area may be comprised of a plurality of areas associated with each of the plurality of keys.
  • a computer-readable medium may have computer-readable code embodied therein, the computer-readable code executable by a processor of the portable electronic device to perform the method.
  • Tactile feedback may be provided at and/or near the borders of images of keys on a touch-sensitive display, which may include the area between the images of keys.
  • tactile feedback may be provided internally to the image of a key, i.e., at or near the center area of the keys.
  • Such tactile feedback may simulate the edges of physical keys, ridges or grooves between keys, or location ridges on keys, rendering retention of contacting members on displayed keys more successful.
  • users may type more quickly and/or accurately on a touch-sensitive display.
  • Tactile feedback may simulate physical structures without providing physical structures.
  • a virtual keyboard may be rendered in different orientations, with different numbers of keys, in different sizes, and in various layouts such as portrait or landscape, without being limited by physical structures, such as ridges or grooves, in fixed locations on the display.
EP09799905A 2008-07-23 2009-07-22 Tastrückmeldung zur tastensimulation in berührungsschirmen Withdrawn EP2327004A4 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US8308708P 2008-07-23 2008-07-23
US12/394,951 US20100220065A1 (en) 2009-02-27 2009-02-27 Touch-sensitive display including a force-sensor and portable electronic device including same
PCT/CA2009/001038 WO2010009552A1 (en) 2008-07-23 2009-07-22 Tactile feedback for key simulation in touch screens

Publications (2)

Publication Number Publication Date
EP2327004A1 true EP2327004A1 (de) 2011-06-01
EP2327004A4 EP2327004A4 (de) 2013-01-23

Family

ID=41569966

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09799905A Withdrawn EP2327004A4 (de) 2008-07-23 2009-07-22 Tastrückmeldung zur tastensimulation in berührungsschirmen

Country Status (6)

Country Link
EP (1) EP2327004A4 (de)
JP (1) JP2011528826A (de)
KR (1) KR20110018429A (de)
CN (1) CN102099768A (de)
CA (1) CA2731042A1 (de)
WO (1) WO2010009552A1 (de)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009015991A1 (de) * 2009-04-02 2010-10-07 Pi Ceramic Gmbh Keramische Technologien Und Bauelemente Vorrichtung zur Erzeugung einer haptischen Rückmeldung einer tastenlosen Eingabeeinheit
CN102498459A (zh) 2009-08-27 2012-06-13 京瓷株式会社 触感提供装置和触感提供装置的控制方法
US8736559B2 (en) 2010-04-23 2014-05-27 Blackberry Limited Portable electronic device and method of controlling same
US8797284B2 (en) 2011-01-05 2014-08-05 Motorola Mobility Llc User interface and method for locating an interactive element associated with a touch sensitive interface
CN103019424A (zh) * 2011-09-28 2013-04-03 宏碁股份有限公司 虚拟输入装置的反馈方法及其电子装置
TWI524218B (zh) * 2011-10-05 2016-03-01 廣達電腦股份有限公司 觸覺回饋式虛擬鍵盤之提供方法及其電子裝置
US9582178B2 (en) 2011-11-07 2017-02-28 Immersion Corporation Systems and methods for multi-pressure interaction on touch-sensitive surfaces
US8922507B2 (en) 2011-11-17 2014-12-30 Google Inc. Providing information through tactile feedback
KR102091597B1 (ko) * 2012-09-24 2020-03-20 엘지전자 주식회사 포터블 디바이스 및 그 제어 방법
CN104685444A (zh) * 2012-09-25 2015-06-03 诺基亚技术有限公司 具有触觉反馈的方法和显示设备
US9196134B2 (en) * 2012-10-31 2015-11-24 Immersion Corporation Method and apparatus for simulating surface features on a user interface with haptic effects
US10078384B2 (en) 2012-11-20 2018-09-18 Immersion Corporation Method and apparatus for providing haptic cues for guidance and alignment with electrostatic friction
JP6125812B2 (ja) * 2012-11-27 2017-05-10 国立大学法人電気通信大学 電気触覚提示装置、電気触覚提示装置の制御方法及びプログラム、並びに電気触覚ディスプレイを有する携帯機器
US9880623B2 (en) * 2013-01-24 2018-01-30 Immersion Corporation Friction modulation for three dimensional relief in a haptic device
KR102214929B1 (ko) 2013-04-15 2021-02-10 삼성전자주식회사 촉각 제공 장치 및 방법
WO2014194192A1 (en) 2013-05-30 2014-12-04 David Andrews Multi-dimensional trackpad
KR101550601B1 (ko) * 2013-09-25 2015-09-07 현대자동차 주식회사 촉감 피드백을 제공하는 곡면 터치 디스플레이 장치 및 그 방법
CN104571472A (zh) * 2013-10-14 2015-04-29 联想(北京)有限公司 一种信息处理方法及电子设备
FR3024251B1 (fr) 2014-07-25 2017-11-24 Thales Sa Securisation d'un dispositif d'entree de donnees
US9971406B2 (en) 2014-12-05 2018-05-15 International Business Machines Corporation Visually enhanced tactile feedback
CN104579289B (zh) * 2015-01-30 2018-08-21 华南师范大学 一种3d触控按钮及其实现方法
CN106155275A (zh) * 2015-03-25 2016-11-23 联想(北京)有限公司 信息处理方法及电子设备
US10642404B2 (en) * 2015-08-24 2020-05-05 Qeexo, Co. Touch sensitive device with multi-sensor stream synchronized data
JP6137714B2 (ja) * 2015-10-21 2017-05-31 Kddi株式会社 押圧の度合いに応じて異なる触覚応答を付与可能なユーザインタフェース装置、触覚応答付与方法及びプログラム
EP3299939B1 (de) 2016-09-27 2019-05-08 Alpine Electronics, Inc. Eingabevorrichtung mit berührungsempfindlichem eingabegerät
CN106371615A (zh) * 2016-11-23 2017-02-01 苏州攀特电陶科技股份有限公司 触觉反馈模块及按钮
US10373452B2 (en) * 2016-11-29 2019-08-06 Immersion Corporation Targeted haptic projection
DE102017218120A1 (de) * 2017-10-11 2019-04-11 Robert Bosch Gmbh Verfahren zur Bereitstellung einer haptischen Rückmeldung an einen Bediener einer berührungssensitiven Anzeigeeinrichtung
CN109326221B (zh) * 2018-09-25 2021-09-28 上海天马微电子有限公司 显示装置和显示装置的触觉反馈显示方法
CN114690887B (zh) * 2020-12-30 2024-04-12 华为技术有限公司 一种反馈方法以及相关设备
CN112905018B (zh) * 2021-04-09 2024-04-16 京东方科技集团股份有限公司 一种显示设备
WO2023097557A1 (en) * 2021-12-01 2023-06-08 Boe Technology Group Co., Ltd. Electronic apparatus and method of operation electronic apparatus

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030197687A1 (en) * 2002-04-18 2003-10-23 Microsoft Corporation Virtual keyboard for touch-typing using audio feedback
US20040108995A1 (en) * 2002-08-28 2004-06-10 Takeshi Hoshino Display unit with touch panel
WO2006042309A1 (en) * 2004-10-08 2006-04-20 Immersion Corporation Haptic feedback for button and scrolling action simulation in touch input devices
EP1748350A2 (de) * 2005-07-28 2007-01-31 Avago Technologies General IP (Singapore) Pte. Ltd Berührungsempfindliche Vorrichtung und Verfahren zur Bereitstellung von taktiler Rückkoppelung
US20070236474A1 (en) * 2006-04-10 2007-10-11 Immersion Corporation Touch Panel with a Haptically Generated Reference Key

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU1573301A (en) * 1999-10-21 2001-04-30 Cirque Corporation Improved kiosk touchpad
US6822635B2 (en) * 2000-01-19 2004-11-23 Immersion Corporation Haptic interface for laptop computers and other portable devices
JP2002140166A (ja) * 2000-11-02 2002-05-17 Kddi Corp タッチパネルディスプレイに触れた指に触感を与えるデバイス
CN1602498A (zh) * 2001-12-12 2005-03-30 皇家飞利浦电子股份有限公司 具有触觉导引的显示系统
US7382357B2 (en) * 2005-04-25 2008-06-03 Avago Technologies Ecbu Ip Pte Ltd User interface incorporating emulated hard keys
WO2007030603A2 (en) * 2005-09-08 2007-03-15 Wms Gaming Inc. Gaming machine having display with sensory feedback
US8068605B2 (en) * 2006-03-07 2011-11-29 Sony Ericsson Mobile Communications Ab Programmable keypad
JP4568310B2 (ja) * 2007-08-29 2010-10-27 株式会社日立製作所 タッチパネルを備えた表示装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030197687A1 (en) * 2002-04-18 2003-10-23 Microsoft Corporation Virtual keyboard for touch-typing using audio feedback
US20040108995A1 (en) * 2002-08-28 2004-06-10 Takeshi Hoshino Display unit with touch panel
WO2006042309A1 (en) * 2004-10-08 2006-04-20 Immersion Corporation Haptic feedback for button and scrolling action simulation in touch input devices
EP1748350A2 (de) * 2005-07-28 2007-01-31 Avago Technologies General IP (Singapore) Pte. Ltd Berührungsempfindliche Vorrichtung und Verfahren zur Bereitstellung von taktiler Rückkoppelung
US20070236474A1 (en) * 2006-04-10 2007-10-11 Immersion Corporation Touch Panel with a Haptically Generated Reference Key

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2010009552A1 *

Also Published As

Publication number Publication date
CN102099768A (zh) 2011-06-15
WO2010009552A1 (en) 2010-01-28
JP2011528826A (ja) 2011-11-24
CA2731042A1 (en) 2010-01-28
EP2327004A4 (de) 2013-01-23
KR20110018429A (ko) 2011-02-23

Similar Documents

Publication Publication Date Title
US20100020036A1 (en) Portable electronic device and method of controlling same
EP2327004A1 (de) Tastrückmeldung zur tastensimulation in berührungsschirmen
US9983676B2 (en) Simulation of tangible user interface interactions and gestures using array of haptic cells
JP6293108B2 (ja) 動的な触覚効果を有するマルチタッチデバイス
KR102104463B1 (ko) 터치 감지 표면들에서의 다중 압력 상호 작용을 위한 시스템들 및 방법들
CN101910977B (zh) 基于视觉环境的音频和触觉反馈
US20150097786A1 (en) Display apparatus
US20150169059A1 (en) Display apparatus with haptic feedback
EP2820503A2 (de) Erfassung von benutzereingaben am rand eines anzeigebereichs
CN105183075A (zh) 具有触摸屏和数字触觉像素的手持装置
EP2241955A1 (de) Elektronische Berührungsbildschirmvorrichtung
KR20120115159A (ko) 택타일 피드백 방법 및 장치
JP2019145146A (ja) 表面特徴を生成するために波形テッセレーションを使用する装置、システム及び方法
JP5591646B2 (ja) 電子情報機器

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110221

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: AL BA RS

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20121221

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 15/02 20060101ALI20121217BHEP

Ipc: H04W 88/02 20090101ALI20121217BHEP

Ipc: G06F 3/048 20130101ALI20121217BHEP

Ipc: G06F 3/01 20060101AFI20121217BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BLACKBERRY LIMITED

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BLACKBERRY LIMITED

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20160202