KR20110018429A - Tactile feedback for key simulation in touch screens - Google Patents

Abstract

The method includes displaying an image of a key on a touch-sensitive display and detecting a touch on the touch-sensitive display at a first location. When the first location is located in a predetermined area associated with the key, tactile feedback is provided that simulates the properties of the physical key. The touch-sensitive display can be part of a portable electronic device.

Description

Tactile feedback for key simulation on touch screens {TACTILE FEEDBACK FOR KEY SIMULATION IN TOUCH SCREENS}

This application claims the priority of US Provisional Application No. 61 / 083,087, filed July 23, 2008 and US Patent Application No. 12 / 394,951, filed February 27, 2009, which are expressly incorporated herein by reference. do.

The present disclosure relates to a portable electronic device, including but not limited to a portable electronic device having a touch screen display and controls thereof.

Electronic devices, including portable electronic devices, have come into widespread use and can provide a variety of functions, including, for example, telephone, electronic messaging, and other personal information manager (PIM) application functionality. Portable electronic devices include many types of mobile stations, such as simple cellular telephones, smart phones, wireless PDAs, and laptop computers with wireless 802.11 or Bluetooth capabilities, for example. These devices run over a wide variety of networks, from data-only networks such as Mobitex® and DataTAC® networks to complex voice and data networks such as GSM / GPRS, CDMA, EDGE, UMTS and CDMA2000 networks.

Portable electronic devices such as PDAs or smart phones are generally for handheld use and easy portability. Smaller devices are generally desirable for portability. Touch-sensitive displays, also known as touchscreen displays, are particularly useful for small handheld devices with limited space for user input and output. The information displayed on the touch-sensitive display can be modified according to the function and operation being performed. With the continuing demand for reduced size of portable electronic devices, touch-sensitive displays continue to shrink in size.

Thus, improvements in touch-sensitive devices are desirable.

The present invention seeks to provide tactile feedback for key simulation in touch screens.

The method includes displaying an image of a key on a touch-sensitive display and detecting a touch on the touch-sensitive display at a first location. When the first location is located in a predetermined area associated with the key, tactile feedback is provided that simulates the properties of the physical key. The touch-sensitive display can be part of a portable electronic device.

According to the present invention, it is possible to provide tactile feedback for key simulation in a touch screen.

1 is a block diagram of a portable electronic device in a communication network in accordance with the present disclosure.
2 shows a cross-sectional view of a touch-sensitive display in accordance with the present disclosure.
3 shows a cross-sectional view of a touch-sensitive display that appears when an actuator is operated in accordance with the present disclosure.
4 illustrates the position of an actuator and a pressure sensor positioned relative to the touch sensitive display in accordance with the present disclosure.
5 shows four actuators and four pressure sensors positioned with respect to the touch-sensitive display in accordance with the present disclosure.
6 illustrates a plurality of actuators and force sensors disposed for each key of a keyboard displayed in accordance with the present disclosure.
7 illustrates a keyboard displayed on a touch sensitive display of a portable electronic device according to the present disclosure.
8 illustrates a pattern related to tactile feedback for keys of a keyboard displayed on a touch-sensitive display in accordance with the present disclosure.
9 illustrates two consecutive touch positions on a keyboard displayed on a touch sensitive display in accordance with the present disclosure.
10 shows a pattern of tactile feedback positions for keys of a keyboard displayed on a touch sensitive display in accordance with the present disclosure.
11 shows a flowchart of a method for providing tactile feedback for a touch-sensitive display in accordance with the present disclosure.

A block diagram of a portable electronic device 300 in a communication network is shown in FIG. The electronic device 100 includes a microprocessor 338 that facilitates communication, provides a graphical user interface, controls the operation of the electronic device 100, such as executing a program, and the like. The communication subsystem 311 performs communication transmission and reception using the wireless network 319. Microprocessor 338 may also be connected to auxiliary input / output (I / O) subsystem 328, which may be connected to device 100. Further, in at least one embodiment, microprocessor 338 may be connected to serial port (eg, USB port) 330 to facilitate communication with other devices or systems through serial port 330. have. Display 322 is operatively connected to microprocessor 338 to facilitate the display of information to the operator of device 100. When the electronic device 100 has a keyboard 332 that may be physical or virtual (ie, displayed), the keyboard 332 is operatively connected to the microprocessor 338. The electronic device 100 can include a speaker 334 and a microphone 336, which can advantageously be operatively connected to the microprocessor. In addition, a vibrator 132, which may be a vibrator motor, may be operatively connected to the microprocessor 338 to generate vibrations in the electronic device 100. Other similar components may be provided on or within the device, and selectively operatively connected to the microprocessor 338. Other communication subsystem 340 and other communication device subsystem 342 are generally shown as being functionally connected with microprocessor 338. Examples of communication subsystem 340 are short range communication systems such as a BLUETOOTH® communication module or a WI-FI® communication module (communication module according to IEEE 802.11b) and associated circuits and components. Microprocessor 338 also performs operating system functions and executes programs or software applications on electronic device 100. In some embodiments, not all of the components are included in the electronic device 100. Auxiliary I / O subsystem 328 may include one or more different navigation tools (multidirectional or unidirectional), an external display device such as a keyboard, and other subsystems that may provide input and receive output to electronic device 100. Can take the form of:

The electronic device 100 has components that enable the operation of various programs as shown in FIG. 1. As shown in the embodiment of FIG. 1, memory 324 provides storage for operating system 357, device program 358, data, and the like. Operating system 357 is generally stored in memory 324 and is configured to manage other programs 358 that are executable on processor 338. Operating system 357 processes requests for services made by program 358 via a predefined program 358 interface. More specifically, operating system 357 typically determines the order in which multiple programs 358 run on processor 338 and the execution time allotted for each program 358, and multiple programs 358. Manages the sharing of memory 324 between the < RTI ID = 0.0 >), < / RTI > In addition, the operator may typically interact directly with the operating system 357 through a user interface including a keyboard 332 and a display screen 322. Operating system 357, program 358, data, and other information may be stored in memory 324, RAM 326, ROM, or another suitable storage element (not shown). The address book 352, personal information manager (PIM) 354, and other information 356 may also be stored.

The electronic device 100 may be capable of two-way communication within voice, data, or voice and data communication systems. A Subscriber Identity Module (SIM) or a Removable User Identity Module (RUIM) may be used to authorize communication with the communication network 319. The SIM / RUIM interface 344 in the electronic device 100 interfaces the SIM / RUIM card to the microprocessor 338 and facilitates the removal or insertion of a SIM / RUIM card (not shown). The SIM / RUIM card features a memory and holds a key configuration 351 and other information 353 such as identification information and subscriber related information. The electronic device 100 has an antenna 318 for transmitting signals to the communication network 319 and another antenna 316 for receiving communication from the communication network 319. Alternatively, a single antenna (not shown) can be used to transmit and receive the signal. The communication subsystem 311 may include processing modules such as a transmitter 314 and a receiver 312, one or more antennas 316, 318, a local oscillator (LO) 313, and a digital signal processor (DSP) 320. 320).

Electronic device 100 includes a touch-sensitive display 118, which includes one or more touch position sensors 110, overlay 114, as shown in FIGS. 2 and 3. And a display 322, such as a liquid crystal display (LCD) or light emitting diode (LED) display. The touch position sensor (s) 110 may be capacitive, resistive, infrared, surface acoustic wave (SAW), or other type of touch sensitive sensor, and may be integrated into the overlay 114. The overlay 114 or cover may be composed of laminated glass, plastic or other suitable material (s), which is advantageously translucent or transparent. Touch or touch contact may be detected by the touch-sensitive display 118 and processed by the processor 338 to determine the location of the touch, for example. The touch position data may include the center or the entire contact area of the contact area for further processing. The touch may be detected from the body part of the user, such as a finger or thumb, or other object, such as a stylus, pen, or other pointer, depending on the nature of the touch position sensor.

The portable electronic device 100 processes the contact location information received from the position sensor (s) 110 and determines one or more simultaneous touch contact locations on the overlay 114 or alternatively. Two simultaneous contact locations may occur, for example, when two fingers or thumbs are used to enter data into the portable electronic device 100.

When electronic device 100 includes one or more pressure sensors 140, pressure sensor (s) 140 may determine which of the two detected simultaneous touches has a greater contact pressure. To provide data. This determination can be used to select which touch indicates the selection of data, function, or command associated with the touch. The time of the touch can also be used as a factor in determining which touch controls the selection.

One or more actuators or switches 130 and one or more pressure sensors 140 are also shown disposed with the touch sensitive display 118. Although touch position sensor 110 is shown positioned above display 322, touch position sensor 110 may be positioned below display 322. Actuator 130 may be attached to a back, support, or base 202, which may include a printed circuit board (PCB). Alternatively, actuator 130 may be attached to an intermediate board or mounting structure between actuator 130 and base 202.

The pressure sensor 140 may be mounted under the display 322 and optionally attached to the actuator 130. The pressure sensor 140 may optionally be mounted under the overlay 114. The pressure sensor 140 may optionally be arranged in parallel configuration with the actuator 130. For example, the pressure sensor 140 may be disposed adjacent to the actuator 130 rather than on the actuator. Other locations may be used that facilitate the measurement or detection of the force applied to the surface.

The pressure sensor 140 facilitates the generation of contact pressure data processed by the microprocessor 338. The pressure sensor 140 may be a strain gauge, a piezoresistive element, a microelectromechanical systems (MEMS) element, a variable capacitance element, a pressure reducing resistor, an inductive-based pressure sensor, a Hall Effect pressure sensor, or the like. The pressure sensor 140 detects and measures the pressure or change in pressure applied to the touch-sensitive display 118 through contact with the overlay 114.

Force sensors may optionally be used in place of pressure sensors. Examples of force sensors include, but are not limited to, force sensing resistors, strain gauges, and piezoelectric elements. The actuator 130 may be composed of a plurality of piezoelectric elements. Actuator 130 may be a piezoelectric element that expands or contracts in response to applied voltage / current, applied force, or both. Examples of piezoelectric elements are shown in the expanded and contracted states, respectively, in FIGS. 2 and 3. Actuator 130 may advantageously be used to provide tactile feedback that may be felt through contact with overlay 114 of a touch-sensitive display as described below.

When the actuator 130 is a piezoelectric actuator such as a piezoelectric (piezo) disk, each disk contracts or flexes due to the accumulation of charge / voltage. The force exerted on each piezo disc through the overlay 114 also deflects the piezo disc. If there is no external force applied to the overlay 114 and there is no charge on the piezo disk, the piezo disk is slightly warped due to the mechanical preload. If a force is applied to the touch sensitive display 118 prior to operation of the piezo disk, the deflection of the piezo disk increases, and the piezo disk exerts a spring force against the touch sensitive display 118. The piezo disc may be located between the base 202 and the display 322 such that the charging of the piezo disc exerts a force away from the base 202 towards the overlay 114. When the piezo disc is charged, it contracts and causes the piezo disc to exert an additional force against the force exerted externally on the touch-sensitive display 118. The charge on the piezo disc can be adjusted to control the force exerted by the piezo disc and the force on the overlay 114 and / or its resulting movement. The charge is adjusted by changing the applied voltage or current. Increasing the charge on the piezo disk causes the piezo disk to shrink, resulting in a force against the overlay 114 that is opposed to an externally applied force. The charge on the piezo disk can also be removed by the discharge of the controlled current, expanding the piezo disk 316 and releasing the forces caused by the electrical charge and reducing the force on the touch screen display 118 applied by the piezo disk. Let's do it.

The touch-sensitive display 118 can provide tactile feedback in the same manner as the physical key, thereby simulating the depression and release of the physical key. Pressure data due to touch contact provided by the pressure sensor (s) 140 may at least partially facilitate this feedback. For example, if one Newton force is used as the force needed to select the key, a threshold for selection at one Newton may be set.

Actuator 130 and pressure sensor 140 may be located in a variety of different layouts or configurations. For example, in FIGS. 4 and 5, four actuators 130 and four pressure sensors 140 are shown disposed near the corners of the overlay 114. The actuator 130 and the pressure sensor 140 are shown to be located concentrically with respect to each other. The actuator 130 and the pressure sensor 140 are not necessarily drawn to scale, and some features may be exaggerated or minimized to focus on specific details of the various components. One or more actuators 130 and one or more pressure sensors 140 may be used. Each actuator 130 need not be paired with the pressure sensor 140. For example, two pressure sensors 140 may be disposed near opposite corners, and two actuators 130 may be disposed at two other corners. Multiple actuators 130 may be placed in locations where keys or buttons are often displayed. For example, actuator 130 may be disposed for each displayed key of virtual keyboard 332 as shown in FIG. 6. Two or more keys may share actuator 130. In the example shown, two pressure sensors 140 are shown at opposite ends of the bottom row of virtual keys, and two other pressure sensors 140 are opposite of overlay 114 on which an application interface or other information is displayed. Located in the part.

An example electronic device 100 is shown in FIG. 7. The embodiments shown in the figures are merely illustrative and those skilled in the art will understand the additional elements and modifications necessary to operate the electronic device 100 in a particular network environment. Although electronic device 100 includes a handheld communication device, electronic device 100 may comprise a handheld wireless communication device, a PDA, a laptop computer, a desktop computer, a server, other communication device, or other portable computing device. .

The term "key" as used herein includes virtual or displayed keys or buttons that are images displayed on a touch-sensitive display. Keys are letters such as spelling, numbers, spaces, and punctuation marks, and / or functions such as shift, control, alpha, digits, symbols, replacement, deletion, reversion, enter, power, etc., and / or symbols representing actions or operations, For example, play, stop, and pause for a media player, forward and back for a web browser, and the like. Thus, the term "key" is not limited to keys from the keyboard, but in the examples provided herein is provided in relation to the keys of the keyboard.

The portable electronic device 100 may include a text or data entry program or a program using subroutines, such as some notepads, task books, address books, emails, and text message programs. 7 shows an email composer segment of an email program. The email composer facilitates the creation of new email messages. The illustrated email composer includes virtual keys that provide the option of creating a new email message, retrieving a previous email message, and terminating the email composer. Other options may be provided but are not shown to help simplify.

To assist with text entry, as shown in FIG. 7, the displayed keyboard 332 includes an image 702 of a plurality of keys that make up a virtual representation of the physical keys on the display 322. One or more physical keys may also be included (not shown) and used with the virtual keys. Each key image 702 includes an outer border or frame 704. Each key is associated with at least one action, such as entering a character, command, or function. Letters include, for example, alphabetic spellings, symbols, numbers, punctuation marks, sentences, icons, photos, and empty spaces. The illustrated keyboard 332 has alphanumeric characters arranged in a reduced QWERTY keyboard layout in addition to other functions such as uppercase and symbolic keys to bring the displayed replacement keys. Delete and Enter keys are also shown. In other embodiments, full QWERTY, QWERTZ, AZERTY, Dvorak, or other layouts may be provided.

When typing through a physical keyboard, the user has the advantage of both seeing and touching keys. The user can learn to type without looking at the keyboard, for example by sensing the edges of the physical keys. When the virtual keyboard is displayed, the key image 702 itself does not provide tactile or feedback.

The present disclosure describes a solution in which a tactile feel is provided on the touch-sensitive display 118 to assist in inputting information such as text or data input. Actuator 130 provides tactile feedback when a touch is detected in a predetermined area of touch-sensitive display 118. Feedback may include vibrations, pulses caused by one or more actuators 130, or other sensations on which feedback may be felt on the outer surface of the touch-sensitive display 118. Vibrations can occur in the ultrasonic frequency range, for example, so that the user can have a surface characteristic or texture such as edges, bumps, ridges, ribs, grooves, or friction. Feels. When ultrasonic frequency vibration is used, the user may feel surface characteristics or textures rather than individual vibrations or pulses. Providing such tactile feedback may be described as inducing modulation of the overlay 114 of the touch-sensitive display 118 when a touch is detected. The use of ultrasonic frequency vibrations is known. Although the term vibration is used herein, other types of modulation are contemplated that produce the same tactilely distinguishable surface within the scope of the present disclosure.

The tactile feedback described herein may be applied during the program displaying the virtual keyboard 332 as shown in the figure. Tactile feedback can be applied in a manner that simulates the outer edges of the physical keys by providing tactile feedback when a touch is detected at or near the boundary of one or more of the key images 702 of the virtual keyboard 332. When tactile feedback is provided for each key of the virtual keyboard 332, a pattern 802 is formed that surrounds the outer edge of the keys and may also include the area between the keys, as shown in FIG. 8. . When a touch on the touch-sensitive display 118 is detected, the position of the touch is determined by the touch position sensor 110 along with the microprocessor 338, for example. When it is determined that the touch is located in the shaded area of the pattern 802, tactile feedback is provided through, for example, control of the microprocessor 338 of the actuator 130. Although the pattern 802 is not visible, the pattern 802 may overlap with a portion of one or more key images 702, such that tactile feedback may be felt inside the boundary 704 of the key being touched. Optionally, the pattern 802 can be set away from the visible boundary 704 of the keys, so that tactile feedback can be felt to some extent outside the boundary 704.

An e-mail message during construction is shown in FIG. 9. Assuming the word "meeting" is being entered, the user has finished typing the second "e" in "meeting" and the user's finger moves from the "1ER" key to the "2TY" key to enter "t". . When the portable electronic device 100 detects a touch position in the area of the pattern 802, tactile feedback is provided. Such detection may occur, for example, when a finger located above the “1ER” key image 702 moves to the “2TY” key image 702 while in contact with the touch-sensitive display 118. For example, a user may use a sliding contact, also known as a swipe, from FIG. 9 to the second touch contact region 904 from the first touch contact region 902 through the pattern 802 region. Alternatively, the touch may consist of multiple contacts from the first contact region 902 to the second contact region 904, one or more of which are located in the pattern 802 region and thus generate tactile feedback.

Tactile feedback can be as simple as a pulse or vibration of force against a finger or other contact member. Alternatively, the tactile feedback provided by the portable electronic device 100 may cause the user to feel a bump, edge, ridge, or groove between the boundaries of the two keys, for example where the pattern 802 is shown. . Thus, haptic feedback can simulate physical edges, ridges, or grooves in the area where the pattern 802 is formed. For example, a user may feel a single bump or ridge between the key images 702, or two separate bumps or ridges, one for each key boundary. In another example, the user may feel a single groove between the key images 702, or two separate grooves, one for each key boundary. By modulating the actuator 130 output, different textures, characteristics, or sensations can be provided as tactile feedback. Tactile feedback can be based, for example, on a force displacement curve associated with the physical key. Feedback may be provided locally, ie where the touch is detected, or may be provided over most or all of the overlay 114. When multiple simultaneous touches are detected, different feedback may be provided locally at each detected touch location.

Alternatively, the contact member may be at or near the center or center of the key image 702, such as a locator found on the “f” and “k” keys on the QWERTY keyboard used to help the user release the index finger. Tactile feedback may be provided when at. The pattern 1002 of the area where tactile feedback is provided is located away from the edge, and is located near the center of each displayed key of the virtual keyboard 332, for example, as shown in FIG. Tactile feedback may be provided to simulate ridges or bumps, but may alternatively be provided in the form of additional friction along the surface of the overlay 114. Although pattern 1002 is shown for each of the keys, pattern 1002 may be provided for fewer keys than all of the keys of keyboard 332. Pattern 1002 may also be expanded to "New", "Search", and "Close" buttons (not shown). Combinations of two patterns 802, 1002 of feedback positions may also be used. For example, an inter-key pattern 802 may be used with one or more locators that are a subset of the inner pattern 1002 associated with one or more keys. For example, the individual locators of pattern 1002 may include the "5GH" or "8BN" key, the "2TY" and "0-SPACE" keys, or the "2TY", "5GH", "8BN" and " 0SPACE "key. This pattern 1002 can be configured with feedback of an area smaller than that shown in FIG. 10, the area being the respective display, such as the bottom or top of each displayed key from the user's point of view. Can be located along or near one edge of the key .. The pattern 1002 can be configured as a vertical area, in addition to or in addition to the horizontal area shown, as seen by the user. Individual components may have different shapes, such as one or more bumps, squares, circles, triangles, and the like.

This tactile feedback provision facilitates data input by the user without viewing the key image 702. For example, a sweeping, swiping, or sliding contact of a user's finger, known as a swipe or gesture, starts at the "QW" key image 702 and starts with the "CAPS- OP "key image 702, tactile feedback is provided for each of the four key changes at the boundary 704 associated with the five keys. Similarly, the user can find the "0-SPACE" key from the "QW" key by detecting feedback twice in the horizontal direction and three times in the vertical direction, where the horizontal and vertical only indicate the user viewpoint of the overlay 114. It is just a reference.

Pressure sensor (s) 140 and / or touch position sensor (s) 110 may be used to determine touch position data indicative of sweeping, swiping, or sliding contact. Such information may be useful for selecting among two or more detected simultaneous touch locations. This determination can be used, for example, to select a touch location for providing tactile feedback. For example, the pressure of the touch contact can be used to determine which simultaneous contact position to track when a sliding, swiping, or sweeping contact is detected.

A flow chart illustrating a method of providing tactile feedback for a touch sensitive display is shown in FIG. 11. The portable electronic device 100 performs the process of the flowchart and executes software to perform some or all of the steps using its processor 338, as is known in the art. The software may be, for example, part of the touch sensitive display program 359 shown as stored in memory 324 in FIG. In addition to performing the flow chart of FIG. 11, the touch-sensitive display program 359 also displays information on the display 322, provides a graphical user interface, determines the location of the touch with respect to application information, Interaction with the actuator 130 and the pressure sensor 140 may be performed.

One or more keys, such as those of a keyboard, are displayed 1102 on the touch-sensitive display 118. When a touch is detected on the touch-sensitive display 118 (1104), the processor 338 or other device may return a feedback area such as the outer pattern 802 of FIG. 8 or the inner pattern 1002 of FIG. 10. Determine if you are inside At 1106, tactile feedback is provided (1108) that simulates the properties of the physical key when its location is within one of the predetermined regions of one or more patterns 802, 1002. The properties of the physical key can be surface properties or textures such as edges, bumps, ridges, ribs, grooves or friction as described above. Thus, for example, the edge, texture, or physical locator of the physical key can be simulated as described above. If the location is not within one of the predetermined areas of the pattern 802, 1102, the process continues to step 1104.

Although the figure shows an email composer program, the present disclosure may be applied to other text or data entry applications and other applications in which selectable items are displayed on the touch-sensitive display 118.

Although the above embodiments are described with reference to the displayed keys, tactile feedback provided by one or more actuator (s) 130 may be provided with other images or items on the display 118. If an image of the mountain is displayed on the display screen 322, tactile feedback may simulate the texture displayed in the image of the mountain on the display using touch position data as described above. To simulate the ridges and valleys of the displayed mountain, tactile feedback on the overlay 114 may be provided based on the location of the contact relative to the displayed image of the mountain. Tactile image simulation can be generated based on other displayed images, such as the texture of flowers, beaches, or cliffs. This tactile feedback may be provided using other programs such as internet browsers, email programs, messaging programs, and other programs where tactile awareness may be useful to the user. Those skilled in the art will readily recognize additional embodiments based on the present disclosure.

The portable electronic device is a touch-sensitive display arranged and configured to detect a touch, and a tactile to display an image of the key on the touch-sensitive display and simulate the characteristics of the physical key when the touch is located within a predetermined area associated with the key. And a microprocessor and memory arranged and configured to provide feedback. The predetermined area may be near or outside the boundary of the image of the key. The predetermined area may be inside the boundary of the image of the key. The characteristic can be the edge of the key. The property can be a locator placed on the key. A plurality of keys may be displayed on the touch-sensitive display, and the predetermined area may consist of a plurality of areas associated with each of the plurality of keys. At least one actuator may be a piezoelectric actuator that provides tactile feedback. At least one actuator vibrating in the ultrasonic frequency range may provide tactile feedback. Tactile feedback can simulate at least one of edge, bump, ridge, and groove. At least one pressure sensor may provide pressure data associated with the detected touch.

The method displays an image of a key on a touch-sensitive display, detects a touch on the touch-sensitive display at a first location, and determines the characteristics of the physical key when the first location is located within a predetermined area associated with the key. Providing tactile feedback to simulate.

Tactile feedback can simulate the edge of the physical key. Tactile feedback can simulate a locator placed on a physical key. The actuator can oscillate in the ultrasonic frequency range to provide tactile feedback. Tactile feedback can simulate at least one of edge, bump, ridge, and groove. Pressure data can be used to select between two simultaneous touch locations to provide tactile feedback. The predetermined area may be at or near the boundary of the image of the key. The predetermined area may be inside the boundary of the image of the key. A plurality of keys can be displayed on the touch-sensitive display, and the predetermined region can be composed of a plurality of regions associated with each of the plurality of keys. The computer readable medium may be embodied therein with computer readable code executable by a processor of a portable electronic device to perform a method.

Tactile feedback may be provided at and / or near the boundary of the image of the key on the touch-sensitive display, which may include the area between the image of the key. Alternatively, tactile feedback may be provided within the image of the key, ie in or near the central area of the keys. This tactile feedback can simulate the edge of the physical key, the ridge or groove between the keys, or the position ridge on the key, making the retention of the contact member for the displayed keys more successful. As a result, a user can type faster and / or more accurately on a touch-sensitive display. Tactile feedback can simulate the physical structure without providing the physical structure. The virtual keyboard is not limited by physical structures, such as ridges or grooves, in fixed positions on the display, in various orientations, with various numbers of keys, in various sizes, and in various layouts such as horizontal or vertical. Can be.

The present disclosure can be embodied in other specific forms without departing from the spirit and essential characteristics of the invention. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the present disclosure is thus indicated by the appended claims rather than the foregoing description. All changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.

100: electronic device
110: touch position sensor
114: overlay
130: actuator
140: pressure sensor
322: display
332: keyboard

Claims (20)

In a portable electronic device,
A touch-sensitive display arranged and configured to detect touch; And
A microprocessor and a memory;
The microprocessor and the memory,
Display an image of a key on the touch-sensitive display;
And when the touch is located in a predetermined area associated with the key, arranged and configured to provide tactile feedback that simulates a property of the physical key. The portable electronic device of claim 1, wherein the predetermined area is near or outside a boundary of an image of the key. The portable electronic device of claim 1, wherein the predetermined area is inside a boundary of an image of the key. The portable electronic device of claim 1, wherein the characteristic is an edge of a key. The portable electronic device of claim 1, wherein the property is a locator disposed on a key. The portable electronic device of claim 1, wherein a plurality of keys are displayed on the touch-sensitive display, and the predetermined area consists of a plurality of areas associated with each of the plurality of keys. The portable electronic device of claim 6, wherein the at least one actuator is a piezoelectric actuator that provides tactile feedback. The portable electronic device of claim 1, further comprising at least one actuator vibrating in an ultrasonic frequency range to provide tactile feedback. 8. The portable electronic device of claim 7, wherein the tactile feedback simulates at least one of an edge, bump, ridge, and groove. The portable electronic device of claim 1, further comprising at least one pressure sensor providing pressure data associated with the detected touch. Display an image of a key on a touch-sensitive display;
Detect a touch on the touch-sensitive display at a first location;
Providing tactile feedback that simulates a property of a physical key when the first location is located in a predetermined area associated with a key. The method of claim 11, wherein the haptic feedback simulates an edge of a physical key. The method of claim 11, wherein the haptic feedback simulates a locator placed on a physical key. The method of claim 11, further comprising oscillating the actuator in the ultrasonic frequency range to provide tactile feedback. The method of claim 11, wherein the tactile feedback simulates at least one of edge, bump, ridge, and groove. The method of claim 11, further comprising using pressure data to select between two simultaneous touch locations to provide tactile feedback. The method of claim 11, wherein the predetermined area is at or near the boundary of the image of the key. The method of claim 11, wherein the predetermined area is inside a boundary of an image of the key. The method of claim 11, wherein a plurality of keys are displayed on the touch-sensitive display, and wherein the predetermined area consists of a plurality of areas associated with each of the plurality of keys. A computer readable medium,
A computer readable medium having computer readable code executable by at least one processor of a portable electronic device to perform the method of claim 11.

Images