US9520037B2 - Tactile feedback in an electronic device - Google Patents

Tactile feedback in an electronic device Download PDF

Info

Publication number
US9520037B2
US9520037B2 US14752987 US201514752987A US9520037B2 US 9520037 B2 US9520037 B2 US 9520037B2 US 14752987 US14752987 US 14752987 US 201514752987 A US201514752987 A US 201514752987A US 9520037 B2 US9520037 B2 US 9520037B2
Authority
US
Grant status
Grant
Patent type
Prior art keywords
electronic device
tactile feedback
path
user
provide
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US14752987
Other versions
US20150302709A1 (en )
Inventor
Anthony Fadell
Andrew Bart Hodge
Stephen P. Zadesky
Aram Lindahl
Anthony Guetta
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATIONS NETWORKS
    • H04W68/00Notification of users, e.g. alerting for incoming communication or change of service
    • H04W68/005Transmission of information for alerting of incoming communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412Integrated displays and digitisers
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B6/00Tactile signalling systems, e.g. personal calling systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/014Force feedback applied to GUI
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 -G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04808Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • G06F3/04855Interaction with scrollbars
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An electronic device for providing tactile feedback is provided. The electronic device may provide tactile feedback using any suitable approach, including for example vibration, heat, electrical, visual, or any other type of feedback. The electronic device may provide tactile feedback in response to detecting any particular status of the electronic device, receiving any particular input, or detecting any suitable communication received by the electronic device. For example, the electronic device may provide tactile feedback in response to identifying the current network of the device, the status of a particular electronic device component, or any other electronic device status. As another example, the electronic device may provide tactile feedback in response to receiving a particular type of communication, or in response to receiving a communication from a particular contact. As still another example, the electronic device may provide tactile feedback in response to receiving a particular user input, or to detecting a user's finger on a particular portion of the electronic device.

Description

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No. 14/252,536, filed Apr. 14, 2014, which is a continuation of U.S. patent application Ser. No. 13/784,898, filed Mar. 5, 2013 (now U.S. Pat. No. 8,754,759), which is a continuation of U.S. patent application Ser. No. 12/139,018, filed Jun. 13, 2008 (now U.S. Pat. No. 8,138,896), which claims the benefit of U.S. Provisional Patent Application No. 61/009,625, filed Dec. 31, 2007, each of which is incorporated by reference herein in its entirety.

BACKGROUND

This invention is directed to providing tactile feedback to a user of an electronic device.

Portable electronic devices have shrunk while providing ever more functionality. Because the devices are smaller, users can more easily carry them, and use them in a variety of situations where larger, less portable electronic devices could be more difficult to use. An effect of the decrease in size of electronic devices has been a decrease in the size of input mechanisms for providing instructions to the electronic device, and a decrease in the size of displays or screens used to navigate the electronic devices and to access the electronic device functions.

For some users, including for example users with poor vision, or users in dark environments (e.g., at night with little or no electronic device backlight), the reduction in size of the input mechanism and display inconveniences the users and may prevent the users from properly using the electronic device, thus leading to frustration. To remedy these limitations, electronic device manufacturers have spent much effort in creating electronic device interfaces with an emphasis on ease of use and intuitiveness.

Some electronic devices provide tactile feedback to users in limited circumstances. For example, some electronic devices vibrate when a telephone call or text message is received. As another example, some electronic devices may vibrate in response to receiving a user selection of a vibration instruction (e.g., a vibrate button).

SUMMARY

An electronic device for providing tactile feedback to a user in response to detecting a particular state of the device, or in response to detecting a particular user input is provided. Using tactile feedback, the electronic device may supplement one or more menus, selectable options, or other user interface features to facilitate the use of the electronic device.

The electronic device may be operative to provide any suitable tactile feedback. For example, the electronic device may provide vibration feedback. The electronic device may vibrate using any suitable approach. For example, one or more vibrating components integrated in the electronic device may vibrate at particular times. The vibrating components may be operative to cause the entire electronic device to vibrate, or only portions of the electronic device (e.g., the portion of the screen under the user's finger) to vibrate. As another example, the electronic device may provide temperature or heat-based tactile feedback (e.g., change the temperature of one or more portions of the electronic device), electrical tactile feedback (e.g., small, localized or general electrical discharges). In some embodiments, the electronic device may simultaneously provide different types of tactile feedback, visual feedback, audio feedback, olfactory feedback, or any other suitable combination of feedback.

The electronic device may provide tactile feedback at any suitable time. In some embodiments, the electronic device may provide tactile feedback based on communications operations available to the device. For example, the electronic device may provide tactile feedback in response to detecting a particular type of communications network, or receiving a particular communication (e.g., a particular type of communication, or a communication from a particular source). As another example, the electronic device may provide tactile feedback in response to determining the current status of an ongoing communications operation (e.g., the duration of the communications operation, or the amount of data received or sent). As still another example, the electronic device may provide tactile feedback in response to determining the current amount of communications credit remaining in a user's account.

In some embodiments, the electronic device may provide tactile feedback in response to detecting the user's hands on the electronic device. For example, the electronic device may provide tactile feedback in response to detecting a user's finger over a particular displayed option (e.g., a key of a keyboard or keypad, or a particular selectable option of an application). As another example, the electronic device may provide tactile feedback to guide the user in entering text on the electronic device (e.g., provide tactile feedback to identify the position of a displayed line, word, character or cursor). As still another example, the electronic device may provide tactile feedback to assist the user in navigating displayed menu options.

In some embodiments, the electronic device may be operative to provide tactile feedback based on the status of the electronic device. For example, the electronic device may provide tactile feedback in response to determining the amount of memory available, the battery life, the processor or bus speed, or any other resource of the electronic device. As another example, the electronic device may provide tactile feedback based on the location of the user (e.g., provide tactile feedback to guide a user along a path, or to a particular destination). As still another example, the electronic device may provide tactile feedback in response to detecting the environment in which the device is found (e.g., based on a proximity sensor or an accelerometer).

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features of the present invention, its nature and various advantages will be more apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings, in which like reference characters refer to like parts throughout, and in which:

FIGS. 1 and 2 are simplified diagrams of computer systems in accordance with one embodiment of the invention;

FIG. 3 illustrates a simplified schematic diagram of an illustrative electronic device or devices in accordance with one embodiment of the present invention;

FIG. 4 is a schematic view of an illustrative display for receiving an incoming telephone call in accordance with one embodiment of the invention;

FIG. 5 is a schematic view of illustrative displays for associating a particular tactile feedback with a received communication in accordance with one embodiment of the invention;

FIG. 6 is a schematic view of a display for selecting a particular tactile response in accordance with one embodiment of the invention;

FIG. 7 is a schematic view of a display screen for defining a contact's settings in accordance with one embodiment of the invention;

FIG. 8 is a flowchart of an illustrative process for providing tactile feedback in response to detecting a particular state of the electronic device in accordance with one embodiment of the invention;

FIGS. 9A and 9B are illustrative display screens for providing inputs to an electronic device in accordance with one embodiment of the invention;

FIG. 10 is a schematic view of an illustrative display screen of a page in accordance with one embodiment of the invention;

FIG. 11 is a schematic view of illustrative display 1000 of FIG. 10 when the display is scrolled in accordance with one embodiment of the invention;

FIG. 12 is a schematic view of illustrative display 1000 of FIG. 10 when the display is zoomed in accordance with one embodiment of the invention;

FIG. 13 is a schematic view of an illustrative display screen of a mapping application in accordance with one embodiment;

FIG. 14 is a schematic view of an illustrative display screen of a mapping application as a user follows a determined path in accordance with one embodiment of the invention; and

FIG. 15 is a flowchart of an illustrative process for providing tactile feedback in response to receiving a user input in accordance with one embodiment of the invention.

DETAILED DESCRIPTION

FIG. 1 is a simplified diagram of computer system 100, which can be operated in accordance with the principles of the present invention. In some embodiments, computer system 100 may include electronic device 102 and accessory device 104. Electronic device 102 may include display component 106 and user input component 108.

Display component 106 is illustrated in FIG. 1 as a display screen that is integrated into electronic device 102. In some embodiments, display component 106 may instead be external to electronic device 102. For example, display component 106 may be a computer monitor, television screen, and/or any other graphical user interface, textual user interface, or combination thereof. Using display component 106, electronic device 102 may display the video portion of video content, one or more images, a user interface for controlling electronic device 102, combinations thereof, or any other suitable display.

User input component 108 is illustrated in FIG. 1 as a click wheel. One skilled in the art will appreciate that user input component 108 could be any type of user input device that is integrated into or located external to electronic device 102. For example, user input component 108 could also include a mouse, keyboard, trackball, slider bar, one or more buttons, electronic device pad, dial, or any combination thereof. User input component 108 may also include a multi-touch screen such as that shown in FIG. 2 and described in commonly owned Westerman et al., U.S. Pat. No. 6,323,846, issued Nov. 27, 2001, entitled “Method and Apparatus for Integrating Manual Input,” which is incorporated by reference herein in its entirety. User input component 108 may emulate a rotary phone or a multi-button electronic device pad, which may be implemented on a touch screen or the combination of a click wheel or other user input device and a screen. A more detailed discussion of such a rotary phone interface may be found, for example, in commonly owned McKillop et al., U.S. patent application Ser. No. 11/591,752, filed Nov. 1, 2006, entitled “Touch Pad with Symbols based on Mode,” which is incorporated by reference herein in its entirety.

Accessory device 104 can include microphones 110, input buttons 112 and eject button 114. Microphones 110 may be operative to receive audio signals. Circuitry (not shown), which can be included in electronic device 102, accessory device 104, or both can convert the audio signals into one or more audio data files. Buttons 112 can be used to interact with (e.g., edit, save, export, delete, etc.) the audio data files. Eject button 114 can be used to decouple accessory device 104 from electronic device 102.

Accessory device 104 is shown in FIG. 1 as being physically and electrically coupled to electronic device 102 via a connector component (not shown). In other embodiments, accessory device 104 can be wirelessly coupled to electronic device 102. When accessory device 104 is coupled to electronic device 102, either or both devices may have enhanced functionality. This enhanced functionality may automatically occur in response to the devices being coupled together or in response to a user input. For example, accessory device 104 may not have its own power supply or display screen and only function when it is coupled to electronic device 102. Similarly, electronic device 102 may not have its own microphone(s) or only have a lower fidelity microphone, but when electronic device 102 is coupled to accessory device 104, the circuitry in electronic device 102 can make high fidelity recordings. As another example, specialized circuitry or applications (e.g., for recording and converting audio signals) may only be included in accessory device 104 and not in electronic device 102. Accessory device 104 may also have, for example, limited storage capacity and may need to utilize the storage component(s) of electronic device 102 to store audio data files.

FIG. 2 shows computer system 200 which can also be used in accordance with the present invention. Computer system 200 includes electronic device 202, which can include, for example, a portable media player, cellular telephone, personal organizer, hybrid of such devices, or any other electronic device. Electronic device 202 may include user interface component 204. User interface component 204 is shown in FIG. 2 as a multi-touch screen that can function as both an integrated display screen and user input device. Electronic device 202 can also include one or more other user interface components, such as button 206, which can be used to supplement user interface component 204.

Electronic device 202 may include any suitable input and output components. For example, electronic device 202 may include microphone 208 and audio output 210. Microphone 208 may include some or all of the features of microphones 110 discussed above. As such, the audio recording functionality, circuitry and components of accessory device 104 of FIG. 1 can be integrated into electronic device 202. Audio output 210 is shown as being a speaker integrated into electronic device 202, but one skilled in the art would appreciate that audio output 210 may also include an external device (such as headphones) or connector used to facilitate the playing back of audio content and/or the audio portion of video content.

FIG. 3 illustrates a simplified schematic diagram of an illustrative electronic device or devices in accordance with one embodiment of the present invention. Electronic device 300 can be implemented in or as any type of electronic device or devices, such as, for example, electronic devices 102 and 202 discussed above.

Electronic device 300 may include processor 302, storage 304, memory 306, communications circuitry 308, input/output circuitry 310, display circuitry 312, power supply circuitry 314, tactile feedback component 320, or any other suitable component. In some embodiments, electronic device 300 can include more than one of each component or circuitry, but for sake of simplicity, only one of each is shown in FIG. 3. In addition, one skilled in the art would appreciate that the functionality of certain components and circuitry can be combined or omitted and that additional components and circuitry, which are not shown in FIGS. 1-3, can be included in electronic devices 102, 202 and 300, and in accessory device 104.

Processor 302 may include any processing circuitry operative to control the operations and performance of electronic device 300. For example, processor 302 may be used to run operating system applications, firmware applications, media playback applications, media editing applications, and/or any other application. In some embodiments, a processor may drive the display and process inputs received from the user interface.

Storage 304 can be, for example, one or more storage mediums, including a hard-drive, flash memory, permanent memory such as ROM, any other suitable type of storage component, or any combination thereof. Storage 304 may store, for example, media data (e.g., music and video files), application data (e.g., for implementing functions on device 200), firmware, user preference information data (e.g., media playback preferences), lifestyle information data (e.g., food preferences), exercise information data (e.g., information obtained by exercise monitoring equipment), transaction information data (e.g., information such as credit card information), wireless connection information data (e.g., information that may enable electronic device 300 to establish a wireless connection), subscription information data (e.g., information that keeps track of podcasts or television shows or other media a user subscribes to), contact information data (e.g., telephone numbers and email addresses), calendar information data, and any other suitable data or any combination thereof.

Memory 306 can include cache memory, semi-permanent memory such as RAM, and/or one or more different types of memory used for temporarily storing data. In some embodiments, memory 306 can also be used for storing data used to operate electronic device applications, or any other type of data that may be stored in storage 304. In some embodiments, memory 306 and storage 304 may be combined as a single storage medium.

Communications circuitry 308 can permit device 300 to communicate with one or more servers or other devices using any suitable communications protocol. For example, communications circuitry 308 may support Wi Fi (e.g., a 802.11 protocol), Ethernet, Bluetooth™ (which is a trademark owned by Bluetooth Sig, Inc.), high frequency systems (e.g., 900 MHz, 2.4 GHz, and 5.6 GHz communication systems), infrared, TCP/IP (e.g., any of the protocols used in each of the TCP/IP layers), HTTP, BitTorrent, FTP, RTP, RTSP, SSH, any other communications protocol, or any combination thereof.

Communications circuitry 308 may include any suitable communications circuitry operative to connect to a communications network and to transmit communications (e.g., voice or data) from electronic device 300 to other devices within the communications network (e.g., other electronic devices or servers). Communications circuitry 308 may be operative to interface with the communications network using any suitable communications protocol such as, for example, Wi-Fi (e.g., a 802.11 protocol), Bluetooth (registered trademark), high frequency systems (e.g., 900 MHz, 2.4 GHz, and 5.6 GHz communication systems), infrared, GSM, GSM plus EDGE, CDMA, quadband, and other cellular protocols, VOIP, or any other suitable protocol (e.g., TCP/IP, HTTP, BitTorrent, FTP, RTP, RTSP, SSH, or Telnet).

In some embodiments, communications circuitry 308 may be operative to create a communications network using any suitable communications protocol. For example, communications circuitry 308 may create a short-range communications network using a short-range communications protocol to connect to other devices. For example, communications circuitry 308 may be operative to create a local communications network using the Bluetooth® protocol to couple electronic device 300 with a Bluetooth® headset.

Electronic device 300 may include one more instances of communications circuitry 308 for simultaneously performing several communications operations using different communications networks, although only one is shown in FIG. 3 to avoid overcomplicating the drawing. For example, electronic device 300 may include a first instance of communications circuitry 308 for communicating over a cellular network, and a second instance of communications circuitry 308 for communicating over Wi-Fi or using Bluetooth. In some embodiments, the same instance of communications circuitry 308 may be operative to provide for communications over several communications networks.

Input/output circuitry 310 may be operative to convert (and encode/decode, if necessary) analog signals and other signals into digital data. In some embodiments, input/output circuitry can also convert digital data into any other type of signal, and vice-versa. For example, input/output circuitry 310 may receive and convert physical contact inputs (e.g., from a multi-touch screen), physical movements (e.g., from a mouse), analog audio signals (e.g., from a microphone), or any other input. The digital data can be provided to and received from processor 302, storage 304, memory 306, or any other component of electronic device 300. Although input/output circuitry 310 is illustrated in FIG. 3 as a single component of electronic device 300, a plurality of input/output circuitry can be included in electronic device 300.

Electronic device 300 may include any suitable mechanism or component for allowing a user to provide inputs to input/output circuitry 310. For example, electronic device 300 may include any suitable input mechanism, such as for example, a button, keypad, dial, a click wheel, or a touch screen. In some embodiments, electronic device 300 may include a capacitive sensing mechanism, or a multi-touch capacitive sensing mechanism. Some sensing mechanisms are described in commonly owned U.S. patent application Ser. No. 10/903,964, filed Jul. 30, 2004, entitled “Gestures for Touch Sensitive Input Device,” and U.S. patent application Ser. No. 11/038,590, filed Jan. 18, 2005, entitled “Mode-Based Graphical User Interfaces for Touch Sensitive Input Device,” both of which are incorporated herein in their entirety. The capacitive sensing mechanism may use any suitable approach for detecting an input, including for example centroid detection. The implementation of a mechanism using centroid detection is described in commonly owned U.S. patent application Ser. No. 11/619,464, filed Jan. 3, 2007, entitled “Multi-Touch Input Discrimination,” which is incorporated by reference herein in its entirety. The input mechanism may include any of the features of the input mechanisms described above in connection with electronic devices 102 (FIG. 1) and 202 (FIG. 2).

In some embodiments, electronic device 300 can include specialized output circuitry associated with output devices such as, for example, one or more audio outputs. The audio output may include one or more speakers (e.g., mono or stereo speakers) built into electronic device 300, or an audio component that is remotely coupled to electronic device 300 (e.g., a headset, headphones or earbuds that may be coupled to communications device with a wire or wirelessly).

Display circuitry 312 may include any suitable screen or projection system for providing a display visible to the user. For example, display circuitry 312 may include a screen (e.g., an LCD screen) that is incorporated in electronics device 300. As another example, display circuitry 312 may include a movable display or a projecting system for providing a display of content on a surface remote from electronic device 300 (e.g., a video projector). In some embodiments, display circuitry 312 can include a coder/decoder (CODEC) to convert digital media data into analog signals. Display circuitry 312 also can include display driver circuitry, circuitry for driving display drivers, or both. Display circuitry 312 may be operative to display content (e.g., media playback information, application screens for applications implemented on the electronic device, information regarding ongoing communications operations, information regarding incoming communications requests, or device operation screens) under the direction of processor 302.

Power supply 314 can provide power to the components of device 300. In some embodiments, power supply 314 can be coupled to a power grid (e.g., a wall outlet or automobile cigarette lighter). In some embodiments, power supply 314 can include one or more batteries for providing power to a portable electronic device. As another example, power supply 314 can be configured to generate power in a portable electronic device from a natural source (e.g., solar power using solar cells).

Bus 316 may be operative to provide a data transfer path for transferring data to, from, or between control processor 302, storage 304, memory 306, communications circuitry 308, and any other component included in the electronic device.

In some embodiments, electronic device 300 may include tactile feedback component 320. Tactile feedback component 320 may include any suitable component for providing a tactile or haptic feedback to the user of electronic device 300. In some embodiments, electronic device 300 may enable, disable, or modify tactile feedback based on the state or mode of the electronic device, the particular user (e.g., low amplitude vibrations for a frail user, and high amplitude vibrations for a visually impaired user), or any other suitable criteria. The tactile feedback provided may be localized (e.g., specific to the location of a user's finger or hand on electronic device 300) or general (e.g., the entire device provides tactile feedback). In some embodiments, electronic device 300 may include several tactile feedback components 320 distributed throughout the device, wherein one or more of tactile feedback components 320 are operative to provide tactile feedback at a particular time.

Tactile feedback component 320 may use any suitable approach for providing tactile feedback. For example, tactile feedback component 320 may vibrate to provide tactile feedback. Any suitable component operative to vibrate may be used. For example, tactile feedback component 320 may include one or more of an unbalanced rotating mass (e.g. that resonates upon rotation), a linear vibrator, an oscillator, an undulating coil wire, a piezo-electric grid, or any other suitable vibrating component. The vibration provided may be any suitable type of vibration. For example, tactile feedback component 320 may be operative to provide a sine sweep vibration, a random vibration, a synthesized shock, or any other suitable type of vibration. Tactile feedback component 320 may define any suitable parameter or characteristic for a vibration. For example, tactile feedback component 320 may define the one or more frequencies, the change in frequency, the amplitude (or intensity), the change in amplitude, the duration, the delay between vibrations, the period of the vibration (e.g. the duration of a vibration and pause before the vibration repeats) or any other suitable characteristic of the vibration. In some embodiments, tactile feedback component 320 may provide vibrations with different characteristics based on the mode or state of electronic device 300. In some embodiments, tactile feedback component 320 may include some or all of the features of the vibrating tactile feedback component described in commonly assigned U.S. Patent Application Publication No. 2009/0167704, published Jul. 2, 2009, which is incorporated herein in its entirety. For example, the tactile feedback may include a localized vibration under or adjacent a user's finger, or a general vibration of the electronic device.

As another example, tactile feedback component 320 may change the temperature of electronic device 300 to provide tactile or haptic feedback. Tactile feedback component 320 may include any suitable component operative to change temperatures to provide the tactile feedback. For example, tactile feedback component 320 may include a resistor, a thermistor, a radiator, a cooling system, or any other component for changing the temperature of some or all of the electronic device. Tactile feedback component 320 may be operative to set any suitable characteristic of the change in temperature, including for example the final temperature, the rate of change in temperature, the heat generated or removed, or any other suitable characteristic of the change in temperature. In some embodiments, tactile feedback component 320 may include one or more insulators to prevent the change in temperature from affecting other components of electronic device 300.

As still another example, tactile feedback component 320 may change the electrical charge received by the user holding electronic device 300 to provide tactile or haptic feedback. Tactile feedback component 320 may include any suitable component for providing an electrical charge to the user. For example, tactile feedback component 320 may include a circuit that is closed by the user's hand (e.g., closed inside electronic device 300) to provide tactile feedback. Tactile feedback component 320 may be operative to set any suitable characteristic of the electrical charge received by the user, including for example the intensity, change in intensity, frequency, change in frequency, or any other suitable characteristic of the received electrical charge.

Although the following discussion will describe tactile feedback in terms of vibrations, it will be understood that any other suitable type of tactile feedback may be used, including for example those described above or combinations of those described above (e.g., vibration with electrical feedback). In addition, it will be understood that visual feedback (e.g., changing the illumination or colors of the display of electronic device 300), audio feedback, olfactory feedback, or any other suitable type of feedback may be used instead of or in addition to tactile feedback.

FIGS. 4-7 and 9-14 are depictions of representative interactive user interface displays according to embodiments of the invention. More specifically, a processor (and/or other circuitry) can be configured to present the interactive user interface displays of FIGS. 4-7 and 9-14 on a display screen or other user interface component. It is important to note that the displays shown in FIGS. 4-7 and 9-14 are unique in that they are optimized to provide advanced interactive functionality, despite the limitations of relatively simple user input devices, such as a click wheel or six button remote control or other limited interface. Designing interactive displays that are used in conjunction with these types of simple user input devices is generally a more complicated process than designing displays that are used with other user input devices (such as a mouse, keyboard, cellular telephone keypad, standard remote control that has more than 6 buttons, etc.). Simple user input devices, though easy for users to use, limit how a user can navigate within a display and among multiple displays.

In some embodiment, the electronic device may provide tactile feedback to the user based on communications or data received by the device. For example, the electronic device may provide tactile feedback in response to receiving an email, telephone call, voicemail, text message, media message, chat request, fax, or any other type of data or voice communication. FIG. 4 is a schematic view of an illustrative display for receiving an incoming telephone call in accordance with one embodiment of the invention. The electronic device may provide display 400 to the user in response to receiving a telephone call from another device. Display 400 may include contact information 410, image 420, and options 430 and 432 for responding to the telephone call. The electronic device may display any suitable contact information 410. For example, contact information 410 may include a contact name and type of device from which the communication is received (e.g., if the received call is from a known contact, for example stored in the user's contacts). As another example, contact information 410 may include a number, address, or other information that the electronic device may use to identify the device from which the call was received.

Display 400 may include image 420 associated with the contact from which the communication was received. For example, image 420 may include a photograph of the contact, an image associated with the contact, or any other suitable image. The image may be retrieved from any suitable location, including for example a v-card or other contact information associated with the contact. In some embodiments, the electronic device may retrieve an image tagged for the contact (e.g., an image taken by the electronic device, an image downloaded over the Internet, or an image loaded from a host device). If no image is associated with the particular contact, the electronic device may instead display an icon or text (e.g., indicating that no image is available).

Display 400 may include any suitable selectable options for responding to the incoming telephone call. For example, display 400 may include answer option 430 and decline option 432. In response to receiving a user selection of answer option 430, the electronic device may connect the telephone call and initiate the telephone communication. In response to receiving a user selection of decline option 432, the electronic device may direct the communications request to a messaging system.

In response to receiving the telephone call or other communications request, the electronic device may provide an indication to the user. For example, the electronic device may provide an audio output (e.g., a telephone ring). As another example, the electronic device may change the display of the electronic device (e.g., provide display 400, or change the illumination or color of the display). As still another example, the electronic device may provide tactile feedback. For example, the electronic device may direct a tactile feedback component (e.g., tactile feedback component 320) to provide a tactile response (e.g., to vibrate).

The electronic device may be operative to notify the user of certain events when the user accepts an incoming communications request and performs a communications operation (e.g., accepts the telephone call). In some embodiments, the electronic device may provide tactile feedback at particular intervals of the communications operations. For example, the electronic device may provide tactile feedback to indicate the progress of a file download or upload (e.g., vibrate when complete), or when the user accesses a particular type of data (e.g., accesses or leaves a secure website). As another example, the electronic device may vibrate every 5 minutes to indicate to the user how long the communications operation has lasted. The electronic device may use different tactile feedback to indicate different durations (e.g., one feedback every 5 minutes, another every 15 minutes, and still another every 30 minutes).

In some embodiments, the tactile feedback may become more pronounced as the communications operation lasts to emphasize the duration for the user. This may be useful, for example, when the user has limited time left on his communications plan (e.g., on a cellular telephone plan). The electronic device may be operative to reduce or eliminate the tactile feedback if the communications operation is free (e.g., data communication over WiFi instead of a cellular network, or a telephone call during free nights and weekends).

In some embodiments, the electronic device may provide tactile feedback based on the amount of communications credit (e.g., time) remaining on the user's account. For example, the electronic device may provide tactile feedback when the user has used 2 hours, 3 hours, 4 hours, or has 1 hour remaining, 30 minutes remaining, or 5 minutes remaining. As another example, the electronic device may provide tactile feedback when the user's additional communications credit exceeds the user's allotted amount (e.g., based on a cellular telephone plan).

In some embodiments, the electronic device may provide tactile feedback based on the communications network being used. For example, the electronic device may provide tactile feedback as the device moves to or from a WiFi or cellular network. As another example, the electronic device may provide tactile feedback as the device, while remaining on the cellular network, moves to or from a roaming mode. As still another example, the electronic device may provide tactile feedback based on the source of the communications network used (e.g., private or public WiFi).

In some embodiments, the electronic device may provide different tactile feedback based on any suitable aspect of a received communication. For example, the electronic device may provide different tactile feedback based on the type of communication received. For example, the electronic device may provide a first tactile feedback for received telephone calls, and a second tactile feedback for received emails. In some embodiments, the electronic device may group several types of received communications for a particular tactile feedback based on a particular characteristic of the communications (e.g., data or voice communications). The electronic device may associate different types of tactile feedback with different types of communication using any suitable approach. In some embodiments, the electronic device may automatically assign a particular tactile feedback to a type of communication. As another example, the user may select a particular tactile feedback for a type of communication. FIG. 5 is a schematic view of illustrative displays for associating a particular tactile feedback with a received communication in accordance with one embodiment of the invention.

Display 500 may include settings that the user may set for the electronic device. For example, display 500 may include selectable options 510 associated with different settings that the user may modify. For example, display 500 may include options 510 for WiFi, Edge, or other communications network settings. As another example, display 500 may include options for general, mail and other application settings accessible to the user of the electronic device. As still another example, display 500 may include options for user interaction and feedback settings. Display 500 may indicate that further options for defining the settings associated with an option 510 are available by displaying arrow 512.

In response to receiving a selection of an option 510, the electronic device may display several options for different selectable tactile response. FIG. 6 is a schematic view of a display for selecting a particular tactile response in accordance with one embodiment of the invention. Display 600 may include several options of tactile responses. In some embodiments, the different tactile responses may be grouped based on a particular characteristic (e.g., the type of tactile response). For example, display 600 may include heat tactile feedback options 610 and vibration tactile feedback options 620. In some embodiments, the user may scroll display 600 to view additional options 610 and 620 for types of tactile feedback.

Display 600 may indicate that the user selected a particular tactile feedback option using marker 620. Marker 620 may include any suitable type of marker, including for example a check-mark, an icon, an image, or any other suitable object that can be displayed on an option 610 or 620. In some embodiments, display 600 may indicate that a particular option has been selected by changing the appearance of the selected option (e.g., changing the border, the background color, the text color, the text font or size, or any other attribute of the displayed option).

Once the user has selected a particular tactile feedback option, or after determining that the currently selected tactile feedback option is correct, the user may return to the previous screen displayed (e.g., display 500) by selecting back option 630. In some embodiments, the user may instead or in addition to providing an input using an input mechanism external to display 600 (e.g., press a home button) to exit display 600.

In some embodiments, the electronic device may provide the user with an option for defining a particular tactile feedback. For example, the electronic device may display one or more options for defining particular characteristics of tactile feedback. In some embodiments, the electronic device may include one or more options for defining the frequency or amplitude of a vibration, the change in frequency or amplitude of a vibration, the particular motion detection component providing the vibration (e.g., if the electronic device includes several motion detection components), or any other suitable attribute of a vibration feedback. The electronic device may provide any suitable interface for defining the attributes of the tactile feedback, including one or more fields for entering values (e.g., numerical values), scroll bars with sliders defining a value, listings of selectable values or options, options for toggling particular attributes (e.g., variable frequency), or any other suitable interface or option for defining a particular tactile feedback.

In some embodiments, the electronic device may display a tactile feedback option (e.g., an option 510, FIG. 5) for one or more particular types of communications operations. For example, in response to receiving a user selection of a mail option (e.g., an option 510 of FIG. 5), the electronic device may display an intermediate screen allowing the user to define different settings for a mail application, where one of the settings is a tactile feedback setting. In response to a selection of the tactile feedback option, the electronic device may provide a display such as display 600 (FIG. 6) for receiving a user selection of a particular tactile feedback option for the mail application. In some embodiments, the user may define different tactile feedback settings for different aspects of each communications application (e.g., a different tactile feedback setting for new mail received by different email accounts).

In some embodiments, the electronic device may provide different tactile feedback based on the user from which a communication is received. For example, the electronic device may automatically assign different tactile feedback settings to different users or group of users (e.g., favorite contacts, other contacts, and unknown users are all associated with different tactile feedback). As another example, the user may define a particular tactile feedback setting for particular users or contacts. FIG. 7 is a schematic view of a display screen for defining a contact's settings in accordance with one embodiment of the invention. Display 700 may include contact name 710 and image 712. Display 700 may include options for the user to provide any suitable information for identifying the user and for contacting the user, as well options for defining settings to control electronic device operations when a communication from the user is received. For example, display 700 may include telephone options 720 and email options 730. Display 700 may indicate that the user may set particular options 720 and 730 by displaying an indicator 714 (e.g., an arrow) in each option. Telephone options 720 may include telephone number options 721 and 722, and notification options 724 and 725. In response to receiving a user selection of tactile feedback notification option 725, the electronic device may display a tactile feedback option display (e.g., display 600, FIG. 6) from which the user may select a particular tactile feedback to associate with received communications from the telephone number associated with the contact identified by contact name 710 (e.g., and store in the electronic device).

Mail options 730 may include email address options 731 and 732, and notification option 734. In response to receiving a user selection of tactile feedback notification option 734, the electronic device may similarly display a tactile feedback option display (e.g., display 600, FIG. 6) from which the user may select a particular tactile feedback. Once the user has set the desired options for the contact, the user may select done option 740 to exit display 700.

In some embodiments, the electronic device may provide tactile feedback to the user based on the current status of the device. For example, the electronic device may provide tactile feedback to indicate the state of the battery. The electronic device may provide tactile feedback when the battery reaches a particular level (e.g., 20% or 10%), and subsequently provide different tactile feedback as the battery level decreases or increases. As another example, the electronic device may provide tactile feedback when electronic device resources (e.g., processor power, free memory, or available bus size) reach particular levels. As still another example, the electronic device may provide tactile feedback in response to detecting a particular output from a proximity sensor, motion detection component (e.g., an accelerometer), or other sensor detecting the status or environment in which the electronic device is found. The electronic device may provide tactile feedback in response to any suitable determination of the status of the electronic device (e.g., provide tactile feedback when an environmental sensor detects that the electronic device is being used in the dark, or in response to the accelerometer detecting that the user is fumbling with the device).

FIG. 8 is a flowchart of an illustrative process for providing tactile feedback in response to detecting a particular state of the electronic device in accordance with one embodiment of the invention. Process 800 may begin at step 802. At step 804, the electronic device may detect the current status of electronic device resources. For example, the electronic device may determine the current status of the battery, the processor, memory, or any other component of the electronic device. As another example, the electronic device may determine the current communications network used for a communications operation, the duration of a communications operation, the amount of credit remaining for the user to perform the communication operation, or any other suitable status of a communications operation. In some embodiments, process 800 may instead or in addition review the status of an ongoing communications operation at step 812, described below.

At step 806, the electronic device may determine whether a detected status is associated with tactile feedback. For example, the electronic device may compare the detected status of each electronic device resource or component with a known level (e.g., a floor or ceiling amount for the battery level), and determine whether the detected status matches, exceeds, or fails to reach the known level. If the electronic device determines that the detected status is not associated with tactile feedback, process 800 may move to step 810.

If, at step 806, the electronic device instead determines that the detected status is associated with tactile feedback, process 800 may move to step 808. At step 808, the electronic device may provide tactile feedback associated with the detected status. For example, the electronic device may identify the particular tactile feedback associated with the detected status of electronic device resources or components (e.g., from a database of status/tactile feedback associations) and provide the identified tactile feedback. Process 800 may then move to step 810.

At step 810, the electronic device may determine whether a communications operation is received. For example, the electronic device may determine whether a request to perform a communications operation was received (e.g., whether a telephone call was received). As another example, the electronic device may determine whether a communications request is ongoing (e.g., whether the user is conducting a chat with a contact). If the electronic device determines that no communications operation is received, process 800 may return to step 804 and continue to detect the status of the electronic device resources.

If, at step 810, the electronic device instead determines that a communications operation is received, process 800 may move to step 812. At step 812, the electronic device may determine whether the received communications operation is associated with tactile feedback. For example, the electronic device may determine whether the type of communications operation received is associated with tactile feedback. As another example, the electronic device may determine whether the contact from whom the communications operation was received is associated with tactile feedback. As still another example, the electronic device may determine whether the current status of the communications operation (e.g., the duration of the communications operation) is associated with tactile feedback.

If the electronic device determines that the communications operation is associated with tactile feedback, process 800 may move to step 814. At step 814, the electronic device may provide tactile feedback associated with the received communications operation. For example, the electronic device may identify the particular tactile feedback associated with the contact from whom a communications operation is received (e.g., from the contact's profile information) and provide the identified tactile feedback. Process 800 may then move back to step 804 and continue to detect the status of the electronic device resources. If, at step 812, the electronic device instead determines that the communications operation is not associated with tactile feedback, process 800 may move to step 816 and end.

In some embodiments, the electronic device may provide tactile feedback to guide the user in providing inputs to the electronic device. The user may provide inputs using any suitable approach. For example, the user may provide inputs by touching a touch screen or touch pad of the electronic device. As another example, the user may control the position of one or more cursors or highlight regions on the display of the electronic device. As still another example, the electronic device may provide an input using an input mechanism coupled to the electronic device (e.g., a keyboard and a mouse). Although the following (and previous) discussion sometimes describes the inputs as being provided by a user touching a display (e.g., a capacitive touch screen), it will be understood that any other suitable approach may be used to provide inputs to the electronic device.

The electronic device may provide different types of feedback in different contexts based on the application accessed by the user, the current mode or status of that application, the position of the user's hand on the electronic device, the user's particular input, or any other suitable criteria. For example, the electronic device may provide tactile feedback for a user providing inputs using a keyboard or keypad. FIGS. 9A and 9B are illustrative display screens for providing inputs to an electronic device in accordance with one embodiment of the invention. Display screen 900 may include keypad 910 having selectable keys associated with numbers for providing number inputs to the electronic device. The numbers or characters associated with selected keys may be displayed in number portion 920. Similarly, display screen 950 may include keyboard 960 having selectable keys associated with characters for providing textual inputs to the electronic device. The characters associated with selected keys may be displayed in preview window 970, and subsequently transferred to communications window 972 (e.g., in response to receiving a user selection of send option 986 for sending the textual message provided by the user).

To provide guidance to a user of keypad 910 or keyboard 960 (e.g., for visually impaired users), the electronic device may provide tactile feedback as the user's finger is placed over particular keys. For example, the electronic device may be operative to provide tactile feedback (e.g., vibration) as the user's finger is placed over “5” key 912 (e.g., akin to a knob in the “5” key of a physical keypad). As another example, the electronic device may be operative to provide tactile feedback (e.g., vibration) as the user's finger is placed over “F” key 962 or “J” key 964 (e.g., akin to a knob in the “F” and “J” keys of a physical keyboard).

In some embodiments, the electronic device may further provide tactile feedback when the user approaches other keys of keypad 910 or keyboard 960. For example, the electronic device may provide tactile feedback when the user's finger is placed over special keys. Suitable special keys may include any key operative to perform an application function (e.g., other than providing text entry). For example, the electronic device may provide tactile feedback in response to a user selection of call option 930 or back option 932 of keypad 910. As another example, the electronic device may provide tactile feedback in response to a user selection of a key or option that would cause the electronic device to remove the display of keypad 910 (e.g., one of telephone application options 934). As still another example, the electronic device may provide tactile feedback in response to a user selection of back option 980, return option 982, character option 984, or send option 986 of keyboard 960.

The electronic device may provide the same or different tactile feedback for each of the keys of keypad 910 and keyboard 960. For example, the electronic device may provide different tactile feedback for each special key. In some embodiments, the tactile feedback for special keys performing similar functions in different keyboards may be the same to increase the user's familiarity with the electronic device (e.g., back option 932 and back option 980 may have the same tactile feedback, or call option 930 and send option 986 may have the same tactile feedback). As another example, the electronic device may provide different tactile feedback to differentiate “F” key 962 and “J” key 964. As still another example, the electronic device may provide simultaneous localized tactile feedback to several keys to identify a particular key over which the user places his finger (e.g., provide tactile feedback under a special key and the nearest of the “F” and “J” keys to indicate to the user the relative position of the special key on the keyboard).

In some embodiments, the electronic device may provide tactile feedback to the user in response to detecting the user's finger over preview window 970. For example, the electronic device may provide tactile feedback to indicate the placement of a cursor or marker in preview window 970. As another example, the electronic device may provide tactile feedback for each line of text, word, or character entered in preview window 970. By providing tactile feedback (e.g., the same or varying) for each line, word or character, the electronic device may provide sensitivity and guidance for the user to provide accurate text entry at a desired location in preview window 970.

The electronic device may provide tactile feedback to the user using any suitable approach. For example, the electronic device may provide tactile feedback when the user removes his finger from the particular key (e.g., to provide feedback that the key was selected). As another example, the electronic device may progressively modify the tactile feedback as the user approaches the key. For example, as the user moves a finger across keypad 910 towards “5” key 912, the electronic device may progressively increase (or decrease) the amplitude or frequency of the tactile feedback. If the user instead moves a finger away from “5” key 912, the electronic device may progressively decrease (or increase) the amplitude or frequency of the tactile feedback. When the tactile feedback is vibration, the user may then feel softer vibration as the user's finger approaches or is placed on the edge of a key, and stronger vibration as the user's finger nears the center of the key. In some embodiments, the electronic device may remove the tactile feedback (e.g., the vibration) when the user's finger is located at the very center of the displayed key (e.g., like the eye of a storm) to avoid numbing the user's finger.

In some embodiments, the electronic device may provide particular feedback based on the status or mode of an application used. For example, the electronic device may provide tactile feedback when the user selects a link or text input window of a display. As another example, the electronic device may be operative to provide tactile feedback as the user scrolls a page or a display. As still another example, the electronic device may provide tactile feedback as the user zooms the display. FIG. 10 is a schematic view of an illustrative display screen of a page in accordance with one embodiment of the invention. Display 1000 may be any suitable application screen with which the user may interact to control application features. For example, display 1000 may include a web browser page. Display 1000 may include several selectable options 1010, which may be operative to provide access to other displays, other applications, initialize or end communications operations, or any other suitable operation. In the example of display 1000, options 1010 may include hyperlinks or options from a menu (e.g., a drop-down menu).

In some embodiments, the electronic device may be operative to provide tactile feedback as the user passes over or selects an option 1010. For example, the electronic device may be operative to provide tactile feedback in response to receiving a user selection of a hyperlink. The electronic device may provide tactile feedback for some or all of selectable options 1010 of display 1000. For example, the electronic device may only provide feedback for more prominent options 1010 (e.g., options that take up a larger portion of the display, such as a button instead of text). As another example, the electronic device may provide feedback for options that cause information provided by the user to be sent to another device or server (e.g., a purchase option displayed after entering credit card information). As still another example, the selectable options of the application may include tags or flags (e.g., meta data) defined by the user or the programmer for identifying the particular selectable options 1010 for which to provide tactile feedback.

In some embodiments, the electronic device may provide tactile feedback in response to detecting the user's finger over text box 1020 or receiving a user selection of text box 1020 to demarcate the location of text box 1020 on the screen. Text box 1020 may include any suitable option or box in display 1000 in which the user may provide text. For example, text box 1020 may include search fields, internet web address fields (e.g., in a web browser), comments fields, username and password fields, shipping information fields, payment information fields, or any other suitable field in which the user may provide text. If the display includes several successive text boxes 1020 (e.g., successive fields for providing a shipping address), the electronic device may initially only provide tactile feedback for the first box, and then provide tactile feedback for each successive box in turn as the user provides text to the previous box. In response to receiving a user selection of a text box 1020, the electronic device may display a keyboard or keypad for providing text (e.g., keypad 910 of FIG. 9A or keyboard 960 of FIG. 9B).

In some embodiments, the electronic device may provide tactile feedback to assist the user in performing scrolling operations. For example, the electronic device may provide tactile feedback to mimic detents as the user scrolls through entries in a list. As another example, tactile feedback may be used to mimic a mechanical stop of illustrative display 1000 of FIG. 10 when the display is scrolled in accordance with one embodiment of the invention. Display 1100 may include some or all of selectable options 1010 and text boxes 1020 of display 1000. As the user scrolls down display 1000, the electronic device may display portions of the page provided by the application (e.g., portions of the web page) that were not initially displayed in display 1000. To indicate to the user that the end of the page has been reached, the electronic device may scroll the page beyond lower limit 1110 of the page and display background 1112. In some embodiments, the electronic device may display scroll bar 1120 to provide an indication of the amount of the page provided in display 1100 and the relative portion of the page that is displayed. For example, the user may compare scroll bar 1120 with scroll bar region 1122 to determine the relative amount of scroll bar region 1122 taken by scroll bar 1120, and to determine the position of scroll bar 1120 in scroll bar region 1122. The electronic device may provide any suitable tactile feedback as the user reaches limit 1110 of the page. For example, the electronic device may provide tactile feedback (e.g., in increasing intensity or frequency) as the user approaches limit 1110. As another example, the electronic device may provide tactile feedback (e.g., in increasing intensity or frequency) as the user moves beyond limit 1110 (e.g., the more background 1112 is displayed, the stronger the tactile feedback).

In some embodiments, the electronic device may provide tactile feedback when the user zooms a display. FIG. 12 is a schematic view of illustrative display 1000 of FIG. 10 when the display is zoomed in accordance with one embodiment of the invention. Display 1200 may be a zoomed in display of the page in display 1000. For example, display 1200 may include a more detailed view of a particular aspect of display 1000 (e.g., a more detailed view of one or more images). The electronic device may provide any suitable tactile feedback as the user zooms the display. For example, the electronic device may provide tactile feedback (e.g., in increasing amounts) as the user approaches a zoom-in or zoom-out limit of the electronic device (e.g., the limit after which the electronic device can no longer render the display). As another example, the electronic device may provide tactile feedback to identify the particular amount of zoom used by the user (e.g., different tactile feedback for 50%, 75%, 100% and 200% zoom).

In some embodiments, the electronic device may provide tactile feedback based on the physical location of the electronic device. For example, the electronic device may provide tactile feedback based on the user's distance relative to a particular location. As another example, the electronic device may provide tactile feedback to guide the user along a particular path between two locations (e.g., provide tactile feedback when the user follows or leaves the particular path).

The electronic device may determine the current position of the electronic device using any suitable approach. In some embodiments, the electronic device may include a location module. Although the location module may be implemented in software, in some embodiments, the location module may also be implemented in hardware, firmware, or any combination of software, hardware, and firmware. For example, the location module may include an application process, thread, or subroutine configured to compute the position, orientation, movement, or location of the electronic device. The location of the electronic device may be derived from any suitable trilateration or triangulation technique, in which case the location module may include a Global Position System (GPS) receiver, RF triangulation detector or sensor, or any other location circuitry configured to determine the geographic or physical location of the electronic device. The location module may also include the associated applications to support the location circuitry. The location module may also include one or more sensors or circuitry for detecting the position, orientation, or movement of the electronic device. Such sensors and circuitry may include, for example, single-axis or multi-axis accelerometers, angular rate or inertial sensors (e.g., optical gyroscopes, vibrating gyroscopes, gas rate gyroscopes, or ring gyroscopes), magnetometers (e.g., scalar or vector magnetometers), and linear velocity sensors. For example, the processor may be configured to read data from one or more of the sensors or circuitry in the location module in order to determine the orientation of the electronic device and its velocity. The derivation of the location of a communications device is described in more detail in pending U.S. Patent Application Publication No. 2009/0170532, published Jul. 2, 2009, which is incorporated by reference herein in its entirety.

FIG. 13 is a schematic view of an illustrative display screen of a mapping application in accordance with one embodiment. Display 1300 may include map 1302 displayed by any suitable application. Map 1302 may include streets, roads, traffic information, topography, symbols, or any other suitable symbol, object or feature. In some embodiments, map 1302 may include a schematic view, a satellite view, or a combination of the displayed geographic area. The user may direct map 1302 to display any suitable information. For example, in response to a search for a particular store or address, the electronic device may direct the map to display a marker or indicator for the particular store or address identified as a result of the search. The user may also provide the electronic device with an initial location from which the map may identify a path for reaching the displayed marker or indicator representing the search result. In the example of FIG. 13, map 1302 may include initial pin 1322 (e.g., the user's current location) and ending pin 1324 (e.g., the location of a search result), and path 1320 connecting initial pin 1322 to ending pin 1324. Path 1320 may include any suitable path, including a straight line path, a path that avoids particular geographic obstacles (e.g., avoids bodies of water, mountains, or particular changes in altitude), or a path that follows roads.

In some embodiments, the user may direct the map to display the current location of the electronic device on the map. For example, the electronic device may display marker 1330 indicating the user's current position on the map. Marker 1330 may include any suitable type of marker, including for example a marker that identifies the uncertainty or variance of the user's position. For example, marker 1330 may include a circle or disc, where the radius of the circle or disc is selected based on the accuracy of the identified location (e.g., smaller circle for GPS tracking, but larger circle for cellular tower triangulation).

FIG. 14 is a schematic view of an illustrative display screen of a mapping application as a user follows a determined path in accordance with one embodiment of the invention. Display 1400 may include map 1402, which may include some or all of the features of map 1302. In some embodiments, map 1402 may be zoomed with respect to map 1302. Map 1402 may include initial pin 1422 (which may be the same as pin 1322), ending pin 1424 (which may be the same as pin 1324), and path 1420 connecting pins 1422 and 1424 (which may be the same path as path 1320). As the user moves (with the electronic device), the position of marker 1430 may change in map 1402 to reflect the current position of the electronic device.

To guide the user to a particular destination (e.g., ending pin 1424), the electronic device may provide tactile feedback based on the user's location. In some embodiments, the electronic device may provide tactile feedback to guide the user along a particular path. For example, if path 1420 is displayed, the electronic device may provide tactile feedback when the user moves away from path 1420. The type of tactile feedback provided (e.g., the strength of the feedback) may be selected based on one or more of the distance from the path and the direction from the path of the electronic device (e.g., stronger feedback if the user is far from the recommended path, or leaves the path in a direction leading farther away from the destination). Alternatively, or in addition, the electronic device may provide tactile feedback when the user moves along path 1420 (e.g., increasing the level or type of feedback as the user approaches the destination). For example, the electronic device may provide heat-based feedback by which the temperature of the feedback increases as the user approaches the destination.

In some embodiments, the electronic device may provide tactile feedback based on a user's distance from one or more destinations (e.g., different search results). For example, the electronic device may provide different tactile feedback associated with each search result. As the user approaches a destination associated with a particular search result, the electronic device may provide the tactile feedback associated with the particular search result (e.g., vibrate with a particular frequency). The strength or amplitude of the feedback may be related to the distance from the search result (e.g., stronger particular tactile feedback as the user approaches the location of the particular search result).

The electronic device may be operative to provide tactile feedback in any other suitable context. In some embodiments, the user may define situations or contexts in which the electronic device may provide tactile feedback. For example, the electronic device may provide the user with the opportunity to tag or flag situations or contexts for which tactile feedback should be provided. The user may also be given the opportunity to select which particular tactile feedback to provide for each tagged situation (e.g., using a display such as display 600, FIG. 6).

FIG. 15 is a flowchart of an illustrative process for providing tactile feedback in response to receiving a user input in accordance with one embodiment of the invention. Process 1500 may begin at step 1502. At step 1504, the electronic device may display selectable options. For example, the electronic device may display a plurality of selectable keys. As another example, the electronic device may display a menu with selectable items. As still another example, the electronic device may display hyperlinks or other selectable options available from a web page. At step 1506, the electronic device may detect a user's finger on the screen. For example, a touch screen of the electronic device may detect the user's finger on the display. In some embodiments, other approaches may be used to provide inputs to the electronic device.

At step 1508, the electronic device may determine whether the location of the finger is associated with a particular selectable option. For example, the electronic device may determine whether the user's finger is placed abutting a selectable option (e.g., on the edge of a displayed button). As another example, the electronic device may determine whether the user's finger is placed directly on an option or field (e.g., a text-entry field). If the electronic device determines that the location of the user's finger is associated with a particular option, process 1500 may move to step 1510. At step 1510, the electronic device may provide tactile feedback associated with the particular displayed option. For example, the electronic device may identify the characteristics of the tactile feedback associated with the particular option, and provide tactile feedback using the identified characteristics. If no tactile feedback is associated with the particular displayed option, process 1500 may skip step 1510 and move to the following step. Process 1500 may then return to step 1506 and detect the current position of the user's finger on the screen.

If, at step 1508, the electronic device instead determines that the location of the user's finger is not associated with a particular option, process 1500 may move to step 1512. At step 1512, the electronic device may determine whether the location of the finger is associated with tactile feedback. For example, the electronic device may determine whether the user's finger is located in a region adjacent a selectable option (e.g., a small distance away from a selectable option). As another example, the electronic device may determine whether the user's finger is located in a region associated with zooming or scrolling the display. If the electronic device determines that the location of the finger is not associated with tactile feedback, process 1500 may move to step 1514 and end.

If, at step 1512, the electronic device instead determines that the location of the finger is associated with tactile feedback, process 1500 may move to step 1516. At step 1516, the electronic device may provide tactile feedback associated with the particular location. For example, the electronic device may provide tactile feedback of increasing intensity to guide the user to a selectable option. As another example, the electronic device may provide tactile feedback indicating the amount the display was scrolled, or a limit to scrolling or zooming the display. Process 1500 may then return to step 1506 and detect the current position of the user's finger on the screen.

The above described embodiments of the present invention are presented for purposes of illustration and not of limitation, and the present invention is limited only by the claims which follow.

Claims (20)

We claim:
1. An electronic device, comprising:
a location sensor;
a tactile output device; and
a processing unit configured to:
determine a path between a location and a destination;
compare the path to a current location obtained using the location sensor; and
provide haptic output via the tactile output device as the electronic device moves along the path.
2. The electronic device of claim 1, wherein the path includes at least one direction change.
3. The electronic device of claim 1, wherein the processing unit is configured to vary the haptic output based on a distance along the path between the electronic device and the destination.
4. The electronic device of claim 3, wherein the processing unit is configured to increase an intensity as the distance along the path increases and decrease the intensity as the distance along the path increases.
5. The electronic device of claim 3, wherein the processing unit is configured to decrease an intensity as the distance along the path increases and increase the intensity as the distance along the path increases.
6. The electronic device of claim 3, wherein the processing unit is configured to change a type of the haptic output based on the distance along the path.
7. The electronic device of claim 1, wherein the processing unit is configured to provide a different haptic output when the electronic device leaves the path.
8. An electronic device, comprising:
a location sensor;
a tactile output device; and
a processing unit configured to:
compare a path between a location and a destination to a current location obtained using the location sensor; and
provide haptic output via the tactile output device when the electronic device leaves the path.
9. The electronic device of claim 8, wherein the processing unit is configured to provide a first type of haptic output if the electronic device leaves the path in a first direction and a second type of haptic output if the electronic device leaves the path in a second direction.
10. The electronic device of claim 9, wherein the second direction leads further away from the destination than the first direction.
11. The electronic device of claim 9, wherein the second type of haptic output is stronger than the first type of haptic output.
12. The electronic device of claim 8, wherein the processing unit is configured to increase an intensity of the haptic output as the electronic device moves further from the path.
13. The electronic device of claim 12, wherein the processing unit is configured to decrease the intensity of the haptic output as the electronic device moves toward the path.
14. The electronic device of claim 8, wherein the path is not a shortest path between the location and the destination.
15. An electronic device, comprising:
a location module;
a haptic device;
a memory storing instructions; and
a processing unit that executes the instructions stored in the memory to:
determine a current location using the location module;
compare the current location to a path; and
provide haptic output via the haptic device to guide a user along the path.
16. The electronic device of claim 15, wherein the processing unit provides the haptic output to guide the user along the path by at least one of:
providing the haptic output when the electronic device moves away from the path; or
providing the haptic output while the electronic device moves along the path.
17. The electronic device of claim 15, wherein the haptic output comprises a vibration.
18. The electronic device of claim 15, wherein the haptic output comprises a temperature.
19. The electronic device of claim 15, wherein the path avoids geographic obstacles.
20. The electronic device of claim 15, wherein the path follows roads.
US14752987 2007-12-31 2015-06-28 Tactile feedback in an electronic device Active US9520037B2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US962507 true 2007-12-31 2007-12-31
US12139018 US8138896B2 (en) 2007-12-31 2008-06-13 Tactile feedback in an electronic device
US13411716 US8400283B2 (en) 2007-12-31 2012-03-05 Tactile feedback in an electronic device
US13784898 US8754759B2 (en) 2007-12-31 2013-03-05 Tactile feedback in an electronic device
US14252536 US9070262B2 (en) 2007-12-31 2014-04-14 Tactile feedback in an electronic device
US14752987 US9520037B2 (en) 2007-12-31 2015-06-28 Tactile feedback in an electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14752987 US9520037B2 (en) 2007-12-31 2015-06-28 Tactile feedback in an electronic device
US15376002 US10123300B2 (en) 2007-12-31 2016-12-12 Tactile feedback in an electronic device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14252536 Continuation US9070262B2 (en) 2007-12-31 2014-04-14 Tactile feedback in an electronic device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15376002 Continuation US10123300B2 (en) 2007-12-31 2016-12-12 Tactile feedback in an electronic device

Publications (2)

Publication Number Publication Date
US20150302709A1 true US20150302709A1 (en) 2015-10-22
US9520037B2 true US9520037B2 (en) 2016-12-13

Family

ID=40797519

Family Applications (7)

Application Number Title Priority Date Filing Date
US12139009 Active 2030-04-23 US8373549B2 (en) 2007-12-31 2008-06-13 Tactile feedback in an electronic device
US12139018 Active 2030-03-11 US8138896B2 (en) 2007-12-31 2008-06-13 Tactile feedback in an electronic device
US13411716 Active US8400283B2 (en) 2007-12-31 2012-03-05 Tactile feedback in an electronic device
US13784898 Active US8754759B2 (en) 2007-12-31 2013-03-05 Tactile feedback in an electronic device
US14252536 Active US9070262B2 (en) 2007-12-31 2014-04-14 Tactile feedback in an electronic device
US14752987 Active US9520037B2 (en) 2007-12-31 2015-06-28 Tactile feedback in an electronic device
US15376002 Active US10123300B2 (en) 2007-12-31 2016-12-12 Tactile feedback in an electronic device

Family Applications Before (5)

Application Number Title Priority Date Filing Date
US12139009 Active 2030-04-23 US8373549B2 (en) 2007-12-31 2008-06-13 Tactile feedback in an electronic device
US12139018 Active 2030-03-11 US8138896B2 (en) 2007-12-31 2008-06-13 Tactile feedback in an electronic device
US13411716 Active US8400283B2 (en) 2007-12-31 2012-03-05 Tactile feedback in an electronic device
US13784898 Active US8754759B2 (en) 2007-12-31 2013-03-05 Tactile feedback in an electronic device
US14252536 Active US9070262B2 (en) 2007-12-31 2014-04-14 Tactile feedback in an electronic device

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15376002 Active US10123300B2 (en) 2007-12-31 2016-12-12 Tactile feedback in an electronic device

Country Status (5)

Country Link
US (7) US8373549B2 (en)
EP (1) EP2227731A1 (en)
CN (2) CN104102388A (en)
DE (1) DE112008003578T5 (en)
WO (1) WO2009085378A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10123300B2 (en) * 2007-12-31 2018-11-06 Apple Inc. Tactile feedback in an electronic device

Families Citing this family (251)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US7312785B2 (en) 2001-10-22 2007-12-25 Apple Inc. Method and apparatus for accelerated scrolling
US7614008B2 (en) 2004-07-30 2009-11-03 Apple Inc. Operation of a computer with touch screen interface
KR101397659B1 (en) * 2007-07-13 2014-05-22 엘지전자 주식회사 Mobile communication device and operation control method thereof
US8683378B2 (en) 2007-09-04 2014-03-25 Apple Inc. Scrolling techniques for user interfaces
KR20090046137A (en) * 2007-11-05 2009-05-11 삼성전자주식회사 Apparatus and method for searching media data
US20090166098A1 (en) * 2007-12-31 2009-07-02 Apple Inc. Non-visual control of multi-touch device
US9857872B2 (en) * 2007-12-31 2018-01-02 Apple Inc. Multi-touch display screen with localized tactile feedback
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US9128525B2 (en) 2008-01-04 2015-09-08 Tactus Technology, Inc. Dynamic tactile interface
US8928621B2 (en) 2008-01-04 2015-01-06 Tactus Technology, Inc. User interface system and method
US8922510B2 (en) 2008-01-04 2014-12-30 Tactus Technology, Inc. User interface system
US9423875B2 (en) 2008-01-04 2016-08-23 Tactus Technology, Inc. Dynamic tactile interface with exhibiting optical dispersion characteristics
US8547339B2 (en) 2008-01-04 2013-10-01 Tactus Technology, Inc. System and methods for raised touch screens
US8947383B2 (en) 2008-01-04 2015-02-03 Tactus Technology, Inc. User interface system and method
US9588684B2 (en) 2009-01-05 2017-03-07 Tactus Technology, Inc. Tactile interface for a computing device
US9760172B2 (en) 2008-01-04 2017-09-12 Tactus Technology, Inc. Dynamic tactile interface
US9430074B2 (en) 2008-01-04 2016-08-30 Tactus Technology, Inc. Dynamic tactile interface
US9612659B2 (en) 2008-01-04 2017-04-04 Tactus Technology, Inc. User interface system
US9720501B2 (en) 2008-01-04 2017-08-01 Tactus Technology, Inc. Dynamic tactile interface
WO2010078596A8 (en) 2009-01-05 2011-03-03 Tactus Technology, Inc. User interface system
US9557915B2 (en) 2008-01-04 2017-01-31 Tactus Technology, Inc. Dynamic tactile interface
US9552065B2 (en) 2008-01-04 2017-01-24 Tactus Technology, Inc. Dynamic tactile interface
US8154527B2 (en) 2008-01-04 2012-04-10 Tactus Technology User interface system
US9588683B2 (en) 2008-01-04 2017-03-07 Tactus Technology, Inc. Dynamic tactile interface
US8456438B2 (en) 2008-01-04 2013-06-04 Tactus Technology, Inc. User interface system
US8179375B2 (en) 2008-01-04 2012-05-15 Tactus Technology User interface system and method
US9274612B2 (en) 2008-01-04 2016-03-01 Tactus Technology, Inc. User interface system
WO2010078597A1 (en) * 2009-01-05 2010-07-08 Tactus Technology, Inc. User interface system
US8553005B2 (en) 2008-01-04 2013-10-08 Tactus Technology, Inc. User interface system
US9063627B2 (en) 2008-01-04 2015-06-23 Tactus Technology, Inc. User interface and methods
US8570295B2 (en) 2008-01-04 2013-10-29 Tactus Technology, Inc. User interface system
US9052790B2 (en) 2008-01-04 2015-06-09 Tactus Technology, Inc. User interface and methods
US9298262B2 (en) 2010-01-05 2016-03-29 Tactus Technology, Inc. Dynamic tactile interface
US9298261B2 (en) 2008-01-04 2016-03-29 Tactus Technology, Inc. Method for actuating a tactile interface layer
US8922502B2 (en) 2008-01-04 2014-12-30 Tactus Technology, Inc. User interface system
KR101526965B1 (en) 2008-02-29 2015-06-11 엘지전자 주식회사 Terminal and method for controlling the same
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US20090307633A1 (en) * 2008-06-06 2009-12-10 Apple Inc. Acceleration navigation of media device displays
US9513705B2 (en) * 2008-06-19 2016-12-06 Tactile Displays, Llc Interactive display with tactile feedback
KR101498622B1 (en) * 2008-06-25 2015-03-04 엘지전자 주식회사 A wireless terminal and a control method for providing a haptic effect
KR101443341B1 (en) * 2008-06-30 2014-11-03 엘지전자 주식회사 Mobile terminal and operation control method thereof
US20100214243A1 (en) * 2008-07-15 2010-08-26 Immersion Corporation Systems and Methods For Interpreting Physical Interactions With A Graphical User Interface
CN102099766B (en) 2008-07-15 2015-01-14 意美森公司 Systems and methods for shifting haptic feedback function between passive and active modes
US20100020022A1 (en) * 2008-07-24 2010-01-28 Dell Products L.P. Visual Feedback System For Touch Input Devices
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8213914B2 (en) * 2008-08-04 2012-07-03 Lg Electronics Inc. Mobile terminal capable of providing web browsing function and method of controlling the mobile terminal
US7969287B2 (en) * 2008-08-18 2011-06-28 Visteon Global Technologies, Inc. Haptic effect control system
US8749495B2 (en) * 2008-09-24 2014-06-10 Immersion Corporation Multiple actuation handheld device
KR101559772B1 (en) * 2008-10-16 2015-10-13 엘지전자 주식회사 Terminal and a control method
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
EP2209308B1 (en) * 2009-01-19 2016-01-13 Sony Europe Limited Television apparatus
KR101553842B1 (en) * 2009-04-21 2015-09-17 엘지전자 주식회사 A wireless terminal and a control method for providing a multi-haptic effect
JP5343198B2 (en) * 2009-04-22 2013-11-13 株式会社プロテックデザイン Rotary input device and electronic apparatus
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
CN105260110A (en) 2009-07-03 2016-01-20 泰克图斯科技公司 Enhanced user interface system
US8243038B2 (en) 2009-07-03 2012-08-14 Tactus Technologies Method for adjusting the user interface of a device
US9300969B2 (en) 2009-09-09 2016-03-29 Apple Inc. Video storage
WO2011087817A1 (en) 2009-12-21 2011-07-21 Tactus Technology User interface system
KR101642149B1 (en) * 2010-01-05 2016-07-25 삼성전자주식회사 Method and apparatus for controlling haptic feedback in portable terminal having touch-screen
EP2354905A3 (en) * 2010-01-07 2014-07-16 KraussMaffei Technologies GmbH Control device for a machine for processing plastics
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8682460B2 (en) * 2010-02-06 2014-03-25 Apple Inc. System and method for performing audio processing operations by storing information within multiple memories
US8619035B2 (en) 2010-02-10 2013-12-31 Tactus Technology, Inc. Method for assisting user input to a device
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
WO2011112984A1 (en) 2010-03-11 2011-09-15 Tactus Technology User interface system
US9298260B2 (en) * 2010-03-12 2016-03-29 Broadcom Corporation Tactile communication system with communications based on capabilities of a remote system
KR20130136905A (en) 2010-04-19 2013-12-13 택투스 테크놀로지, 아이엔씨. User interface system
KR20130141344A (en) 2010-04-19 2013-12-26 택투스 테크놀로지, 아이엔씨. Method of actuating a tactile interface layer
US9733705B2 (en) 2010-04-26 2017-08-15 Nokia Technologies Oy Apparatus, method, computer program and user interface
US9791928B2 (en) 2010-04-26 2017-10-17 Nokia Technologies Oy Apparatus, method, computer program and user interface
US9715275B2 (en) 2010-04-26 2017-07-25 Nokia Technologies Oy Apparatus, method, computer program and user interface
US8878655B2 (en) * 2010-05-04 2014-11-04 Nokia Corporation Vibration mechanism for user interface module
US8639516B2 (en) 2010-06-04 2014-01-28 Apple Inc. User-specific noise suppression for voice quality improvements
FR2961610B1 (en) * 2010-06-18 2013-01-18 Thales Sa Slave device haptic interaction effort
WO2012026095A1 (en) * 2010-08-26 2012-03-01 京セラ株式会社 Character string retrieval device
WO2012037726A1 (en) * 2010-09-21 2012-03-29 Google Inc. Generating search query suggestions
JP5642474B2 (en) * 2010-09-24 2014-12-17 ミネベア株式会社 Input device, a vibrating device and an input detection method
EP2618734A4 (en) * 2010-09-24 2017-12-27 Sonomedical Pty Ltd Electronic monitoring system and apparatus for data collection, presentation and analysis
CN102445212A (en) * 2010-10-05 2012-05-09 卡西欧计算机株式会社 Information display apparatus and information display method
KR20140037011A (en) 2010-10-20 2014-03-26 택투스 테크놀로지, 아이엔씨. User interface system
US20120117129A1 (en) * 2010-11-04 2012-05-10 Wang Chia-Chin Data distribution system and method thereof
CA2818410A1 (en) * 2010-11-18 2012-05-24 Google Inc. Surfacing off-screen visible objects
US20120139844A1 (en) * 2010-12-02 2012-06-07 Immersion Corporation Haptic feedback assisted text manipulation
CN102609078B (en) * 2011-01-20 2014-12-31 宏达国际电子股份有限公司 Electronic device with tactile feedback and method for providing tactile feedback
JP5809079B2 (en) * 2011-02-10 2015-11-10 京セラ株式会社 Method of controlling an electronic equipment and electronic equipment
US8710966B2 (en) * 2011-02-28 2014-04-29 Blackberry Limited Methods and apparatus to provide haptic feedback
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US20120242584A1 (en) * 2011-03-22 2012-09-27 Nokia Corporation Method and apparatus for providing sight independent activity reports responsive to a touch gesture
US9177452B1 (en) * 2011-04-01 2015-11-03 The Mathworks, Inc. User interface for a modeling environment
US8913086B2 (en) * 2011-04-07 2014-12-16 International Business Machines Corporation Systems and methods for managing errors utilizing augmented reality
US8738754B2 (en) 2011-04-07 2014-05-27 International Business Machines Corporation Systems and methods for managing computing systems utilizing augmented reality
US9046577B2 (en) * 2011-04-13 2015-06-02 GM Global Technology Operations LLC Corona and partial discharge diagnostic device and method for using the same
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US9710061B2 (en) 2011-06-17 2017-07-18 Apple Inc. Haptic feedback device
CN102843334A (en) * 2011-06-20 2012-12-26 华为技术有限公司 Interactive method of online application, server, client device and system
KR101838633B1 (en) * 2011-07-22 2018-03-14 엘지전자 주식회사 Mobile terminal and vibration power control method thereof
FR2978616B1 (en) 2011-07-26 2014-03-21 Soitec Silicon On Insulator Active cooling for photovoltaic cell concentration
US20130033366A1 (en) * 2011-08-01 2013-02-07 Mcdonough Colin Albright Method and system for providing haptic feedback of variable intensity
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US8528012B2 (en) 2011-09-06 2013-09-03 Motorola Mobility Llc Interactive remote control system and method
EP2581807A1 (en) * 2011-10-14 2013-04-17 Research In Motion Limited Tactile indicator for a portable electronic device
US8878854B2 (en) * 2011-12-13 2014-11-04 Lennox Industries Inc. Heating, ventilation and air conditioning system user interface having adjustable fonts and method of operation thereof
US10013857B2 (en) 2011-12-21 2018-07-03 Qualcomm Incorporated Using haptic technologies to provide enhanced media experiences
US9116598B1 (en) 2012-01-10 2015-08-25 Koji Yoden User interface for use in computing device with sensitive display
KR20130092195A (en) * 2012-02-10 2013-08-20 삼성전자주식회사 Apparatus and method for controlling vibration flow between vibration devices
US8711118B2 (en) 2012-02-15 2014-04-29 Immersion Corporation Interactivity model for shared feedback on mobile devices
US9702723B2 (en) * 2012-03-01 2017-07-11 Nokia Technologies Oy Method and apparatus for receiving user estimation of navigational instructions
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
EP2839366A4 (en) * 2012-04-18 2016-05-11 Nokia Technologies Oy A display apparatus with haptic feedback
DE102012206891A1 (en) * 2012-04-26 2013-10-31 Zumtobel Lighting Gmbh Apparatus and method for evaluating the condition of an electronic unit used for illumination purposes
US20150254448A1 (en) * 2012-04-30 2015-09-10 Google Inc. Verifying Human Use of Electronic Systems
WO2013169853A1 (en) * 2012-05-09 2013-11-14 Industries Llc Yknots Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface
EP3264252A1 (en) 2012-05-09 2018-01-03 Apple Inc. Device, method, and graphical user interface for performing an operation in accordance with a selected mode of operation
WO2013169849A3 (en) 2012-05-09 2014-03-20 Industries Llc Yknots Device, method, and graphical user interface for displaying user interface objects corresponding to an application
WO2013169865A3 (en) 2012-05-09 2014-04-17 Yknots Industries Llc Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
WO2013169875A3 (en) 2012-05-09 2014-03-27 Yknots Industries Llc Device, method, and graphical user interface for displaying content associated with a corresponding affordance
WO2013169845A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for scrolling nested regions
DE112013002412T5 (en) 2012-05-09 2015-02-19 Apple Inc. Device, Method, and Graphical User Interface for providing feedback for changing activation states of a user interface object
DE202013012233U1 (en) 2012-05-09 2016-01-18 Apple Inc. Device and graphical user interface to display additional information in response to a user Contact
WO2013169843A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for manipulating framed graphical objects
CN104487927B (en) 2012-05-09 2018-04-20 苹果公司 Used to select the user interface objects device, method, and graphical user interface
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US8570296B2 (en) 2012-05-16 2013-10-29 Immersion Corporation System and method for display of multiple data channels on a single haptic display
EP2850610A4 (en) * 2012-05-18 2016-01-13 Blackberry Ltd Systems and methods to manage zooming
US20130318437A1 (en) * 2012-05-22 2013-11-28 Samsung Electronics Co., Ltd. Method for providing ui and portable apparatus applying the same
CN103455190B (en) * 2012-06-04 2017-04-19 联想(北京)有限公司 An electric discharge control method and an electronic device
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9037277B1 (en) * 2012-06-13 2015-05-19 Audible, Inc. Systems and methods for initiating action based on audio output device
US20130337420A1 (en) * 2012-06-19 2013-12-19 International Business Machines Corporation Recognition and Feedback of Facial and Vocal Emotions
US9063570B2 (en) 2012-06-27 2015-06-23 Immersion Corporation Haptic feedback control system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
JP2014021703A (en) * 2012-07-18 2014-02-03 Sony Corp Pointing device and imaging device
US8696357B2 (en) 2012-08-01 2014-04-15 Thieab AlDossary Tactile communication apparatus, method, and computer program product
US9280206B2 (en) * 2012-08-20 2016-03-08 Samsung Electronics Co., Ltd. System and method for perceiving images with multimodal feedback
US8493354B1 (en) * 2012-08-23 2013-07-23 Immersion Corporation Interactivity model for shared feedback on mobile devices
US8896524B2 (en) * 2012-08-24 2014-11-25 Immersion Corporation Context-dependent haptic confirmation system
KR20140029609A (en) * 2012-08-28 2014-03-11 엘지전자 주식회사 Mobile terminal and controlling method therof, and recording medium thereof
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
JP6071372B2 (en) * 2012-09-21 2017-02-01 キヤノン株式会社 Method of controlling an electronic equipment and electronic equipment
CN104662497A (en) 2012-09-24 2015-05-27 泰克图斯科技公司 Dynamic tactile interface and methods
US9405417B2 (en) 2012-09-24 2016-08-02 Tactus Technology, Inc. Dynamic tactile interface and methods
CN103677242A (en) * 2012-09-24 2014-03-26 联想(北京)有限公司 Method for determining feedback modes and electronic equipment
KR20140042279A (en) * 2012-09-28 2014-04-07 엘지전자 주식회사 Display device and controlling method thereof
US8743072B2 (en) 2012-09-28 2014-06-03 Lg Electronics Inc. Display device and control method thereof
US20140106326A1 (en) 2012-10-11 2014-04-17 Dental Equipment, Llc (D/B/A Pelton & Crane) Dental mannequin simulation device and system
CN103838414B (en) * 2012-11-27 2018-10-12 联想(北京)有限公司 A method of identifying an electronic device, and
KR20140071566A (en) * 2012-11-27 2014-06-12 삼성디스플레이 주식회사 Display apparatus sensing touch and providing electro-tactile feeling and driving method thereof
CN103869937A (en) * 2012-12-12 2014-06-18 联想(北京)有限公司 Touch feedback method and electronic device
CN103869960B (en) * 2012-12-18 2018-02-23 富泰华工业(深圳)有限公司 Haptic feedback system and method for providing tactile feedback
US8978111B2 (en) 2012-12-21 2015-03-10 Ebay, Inc. Method and apparatus for using sensors on a portable electronic device to verify transactions
CN103902200A (en) * 2012-12-24 2014-07-02 联想(北京)有限公司 Information processing method and electronic device
CN103902215B (en) * 2012-12-28 2017-09-26 联想(北京)有限公司 An information processing method for an electronic device, and
EP2939098B1 (en) 2012-12-29 2018-10-10 Apple Inc. Device, method, and graphical user interface for transitioning between touch input to display output relationships
EP2939096A1 (en) 2012-12-29 2015-11-04 Apple Inc. Device, method, and graphical user interface for determining whether to scroll or select contents
WO2014105279A1 (en) 2012-12-29 2014-07-03 Yknots Industries Llc Device, method, and graphical user interface for switching between user interfaces
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
US20140292668A1 (en) * 2013-04-01 2014-10-02 Lenovo (Singapore) Pte. Ltd. Touch input device haptic feedback
US10027606B2 (en) 2013-04-17 2018-07-17 Nokia Technologies Oy Method and apparatus for determining a notification representation indicative of a cognitive load
US9507481B2 (en) 2013-04-17 2016-11-29 Nokia Technologies Oy Method and apparatus for determining an invocation input based on cognitive load
US20140317200A1 (en) * 2013-04-17 2014-10-23 Nokia Corporation Method and Apparatus for a Textural Representation of a Notification
JP5884090B2 (en) * 2013-04-18 2016-03-15 パナソニックIpマネジメント株式会社 Methods and electronic devices to present the information
CN104122980B (en) * 2013-04-25 2017-01-18 宏碁股份有限公司 Electronic device and method of tactile feedback
JP5697113B2 (en) * 2013-04-26 2015-04-08 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America Electronics
US9304588B2 (en) 2013-05-14 2016-04-05 Thieab AlDossary Tactile communication apparatus
WO2014197334A3 (en) 2013-06-07 2015-01-29 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
JP2016521948A (en) 2013-06-13 2016-07-25 アップル インコーポレイテッド System and method for emergency call initiated by voice command
US9557813B2 (en) 2013-06-28 2017-01-31 Tactus Technology, Inc. Method for reducing perceived optical distortion
CN104331195B (en) * 2013-07-22 2017-12-29 联想(北京)有限公司 A method and an electronic device in response to the touch
CN104423421A (en) * 2013-08-19 2015-03-18 联想(北京)有限公司 Information processing method and electronic equipment
KR20150026185A (en) 2013-09-02 2015-03-11 엘지전자 주식회사 Apparatus and Method for Display Device with Tactile feedback
US9665206B1 (en) 2013-09-18 2017-05-30 Apple Inc. Dynamic user interface adaptable to multiple input tools
KR20150034428A (en) 2013-09-26 2015-04-03 엘지전자 주식회사 Apparatus and Method for Display Device generating Tactile feedback
US9621265B2 (en) 2013-11-21 2017-04-11 General Electric Company Street lighting control, monitoring, and data transportation system and method
US9622324B2 (en) 2013-11-21 2017-04-11 General Electric Company Geolocation aid and system
US9646495B2 (en) 2013-11-21 2017-05-09 General Electric Company Method and system for traffic flow reporting, forecasting, and planning
CN103699221B (en) * 2013-12-11 2016-08-24 浙江理工大学 Fingertip force feedback device
JP6289100B2 (en) * 2014-01-06 2018-03-07 キヤノン株式会社 The information processing apparatus, information processing method, and program
US9665198B2 (en) * 2014-05-06 2017-05-30 Qualcomm Incorporated System and method for optimizing haptic feedback
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
EP3149728A1 (en) 2014-05-30 2017-04-05 Apple Inc. Multi-command single utterance input method
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9886090B2 (en) 2014-07-08 2018-02-06 Apple Inc. Haptic notifications utilizing haptic input devices
KR20170037664A (en) 2014-09-02 2017-04-04 애플 인크. Semantic framework for variable haptic output
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9971406B2 (en) * 2014-12-05 2018-05-15 International Business Machines Corporation Visually enhanced tactile feedback
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
CN104598106A (en) * 2014-12-31 2015-05-06 深圳市金立通信设备有限公司 Terminal
CN104598105A (en) * 2014-12-31 2015-05-06 深圳市金立通信设备有限公司 Operation feedback method
US10091468B2 (en) 2015-01-21 2018-10-02 Northwestern University System and method for tracking content in a medicine container
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9990107B2 (en) 2015-03-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10048757B2 (en) 2015-03-08 2018-08-14 Apple Inc. Devices and methods for controlling media presentation
US9645732B2 (en) 2015-03-08 2017-05-09 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US10095396B2 (en) 2015-03-08 2018-10-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9785305B2 (en) 2015-03-19 2017-10-10 Apple Inc. Touch input cursor manipulation
US9639184B2 (en) 2015-03-19 2017-05-02 Apple Inc. Touch input cursor manipulation
US20160291771A1 (en) 2015-04-01 2016-10-06 Apple Inc. Devices and Methods for Processing Touch Inputs Based on Their Intensities
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
US9830048B2 (en) 2015-06-07 2017-11-28 Apple Inc. Devices and methods for processing touch inputs with instructions in a web page
US9860451B2 (en) 2015-06-07 2018-01-02 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9674426B2 (en) 2015-06-07 2017-06-06 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9912364B2 (en) 2015-06-25 2018-03-06 International Business Machines Corporation Mobile application interaction guide via tactile feedback
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9659468B2 (en) * 2015-09-16 2017-05-23 Immersion Corporation Haptic feedback in a haptically noisy environment
US9711015B2 (en) * 2015-09-16 2017-07-18 Immersion Corporation Customizing haptic feedback in live events
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US20170090571A1 (en) * 2015-09-29 2017-03-30 General Electric Company System and method for displaying and interacting with ultrasound images via a touchscreen
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US9947187B2 (en) 2016-01-07 2018-04-17 International Business Machines Corporation Haptic notification system with rules for notification that can be altered to increase effectiveness
US9881467B2 (en) 2016-02-22 2018-01-30 Immersion Corporation Haptic effects conflict avoidance
US9829981B1 (en) 2016-05-26 2017-11-28 Apple Inc. Haptic output device
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK201770369A1 (en) 2016-06-12 2018-02-05 Apple Inc Devices, methods, and graphical user interfaces for providing haptic feedback
DK201670729A1 (en) 2016-06-12 2018-01-22 Apple Inc Devices, Methods, and Graphical User Interfaces for Providing Haptic Feedback
CN106095100A (en) * 2016-06-14 2016-11-09 瑞声科技(新加坡)有限公司 Tactile feedback generating system, control method thereof and electronic device with tactile feedback generating system
DK179278B1 (en) * 2016-09-06 2018-03-26 Apple Inc Devices, methods and graphical user interfaces for haptic mixture
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
CN106775130A (en) * 2017-02-10 2017-05-31 业成科技(成都)有限公司 Vibrotactile control system and method

Citations (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5248929A (en) 1992-04-30 1993-09-28 Murata Machinery, Ltd. Battery time monitor for cellular telephone
US5379057A (en) 1988-11-14 1995-01-03 Microslate, Inc. Portable computer with touch screen and computer system employing same
US5510584A (en) 1995-03-07 1996-04-23 Itt Corporation Sequentially operated snap action membrane switches
US5689253A (en) 1991-04-10 1997-11-18 Kinesis Corporation Ergonomic keyboard apparatus
US5717423A (en) 1994-12-30 1998-02-10 Merltec Innovative Research Three-dimensional display
US5953541A (en) 1997-01-24 1999-09-14 Tegic Communications, Inc. Disambiguating system for disambiguating ambiguous input sequences by displaying objects associated with the generated input sequences in the order of decreasing frequency of use
US5977867A (en) 1998-05-29 1999-11-02 Nortel Networks Corporation Touch pad panel with tactile feedback
US6047071A (en) 1997-04-15 2000-04-04 Nokia Mobile Phones Network-initiated change of mobile phone parameters
WO2001041636A1 (en) 1999-12-12 2001-06-14 Ralph Lander Open loop tactile feedback
US6323846B1 (en) * 1998-01-26 2001-11-27 University Of Delaware Method and apparatus for integrating manual input
US6342836B2 (en) 2000-02-25 2002-01-29 Harry I. Zimmerman Proximity and sensing system for baggage
US20020084721A1 (en) 2001-01-03 2002-07-04 Walczak Thomas J. Piezo electric keypad assembly with tactile feedback
US6429846B2 (en) 1998-06-23 2002-08-06 Immersion Corporation Haptic feedback for touchpads and other touch controls
US6473069B1 (en) 1995-11-13 2002-10-29 Cirque Corporation Apparatus and method for tactile feedback from input device
EP1310860A1 (en) 2000-08-08 2003-05-14 NTT DoCoMo, Inc. Electronic apparatus, vibration generator, vibratory informing method and method for controlling information
WO2003054849A1 (en) 2001-10-23 2003-07-03 Immersion Corporation Method of using tactile feedback to deliver silent status information to a user of an electronic device
US20030134626A1 (en) 2002-01-16 2003-07-17 International Business Machines Corporation Apparatus and method for managing a mobile phone answering mode and outgoing message based on a location of the mobile phone
US20030174121A1 (en) 2002-01-28 2003-09-18 Sony Corporation Mobile apparatus having tactile feedback function
US20030184574A1 (en) 2002-02-12 2003-10-02 Phillips James V. Touch screen interface with haptic feedback device
US20040046744A1 (en) 1999-11-04 2004-03-11 Canesta, Inc. Method and apparatus for entering data using a virtual input device
US20040056876A1 (en) 2002-09-25 2004-03-25 Satoshi Nakajima Tactilely enhanced visual image display
US20040137935A1 (en) 2001-05-10 2004-07-15 Rony Zarom Modular personal device system
TW200414014A
US6801939B1 (en) 1999-10-08 2004-10-05 Board Of Trustees Of The Leland Stanford Junior University Method for evaluating quality of service of a digital network connection
US20040223599A1 (en) 2003-05-05 2004-11-11 Bear Eric Gould Computer system with do not disturb system and method
EP1505484A1 (en) 2002-05-16 2005-02-09 Sony Corporation Inputting method and inputting apparatus
US6879244B1 (en) 1997-05-21 2005-04-12 E.S.P. Networks, Inc. Call receiving system apparatus and method having a dedicated switch
US20050109841A1 (en) 2003-11-17 2005-05-26 Ryan Dennis J. Multi-interface compact personal token apparatus and methods of use
US6940490B1 (en) 2001-08-27 2005-09-06 Palmone, Inc. Raised keys on a miniature keyboard
US20050197767A1 (en) * 2004-02-05 2005-09-08 Nortrup Edward H. Smart answering machine
US6954657B2 (en) 2000-06-30 2005-10-11 Texas Instruments Incorporated Wireless communication device having intelligent alerting system
US20050233707A1 (en) 2004-04-16 2005-10-20 Hon Hai Precision Industry Co., Ltd Mobile phone with health care functionality
US20060026535A1 (en) 2004-07-30 2006-02-02 Apple Computer Inc. Mode-based graphical user interfaces for touch sensitive input devices
US7019622B2 (en) 2004-05-27 2006-03-28 Research In Motion Limited Handheld electronic device including vibrator having different vibration intensities and method for vibrating a handheld electronic device
WO2006042309A1 (en) 2004-10-08 2006-04-20 Immersion Corporation Haptic feedback for button and scrolling action simulation in touch input devices
US20060136630A1 (en) 2002-12-08 2006-06-22 Immersion Corporation, A Delaware Corporation Methods and systems for providing haptic messaging to handheld communication devices
US7123948B2 (en) 2002-07-16 2006-10-17 Nokia Corporation Microphone aided vibrator tuning
US20060240821A1 (en) 2005-04-25 2006-10-26 Huan-Wen Chien Identifying and automatically messaging system for a wireless communication server and operating method for the same
US7170428B2 (en) 2002-06-14 2007-01-30 Nokia Corporation Electronic device and method of managing its keyboard
US20070024593A1 (en) 2005-07-28 2007-02-01 Schroeder Dale W Touch device and method for providing tactile feedback
US7212802B2 (en) 1995-01-05 2007-05-01 Ronald R. Kelly Method and system for providing a portable communication service
TW200721741A
TW200724864A
US20070152983A1 (en) 2005-12-30 2007-07-05 Apple Computer, Inc. Touch pad with symbols based on mode
US20070236450A1 (en) 2006-03-24 2007-10-11 Northwestern University Haptic device with indirect haptic feedback
US7298833B2 (en) 2004-09-29 2007-11-20 Avaya Integrated Cabinet Solutions, Inc. Wireless device to manage cross-network telecommunication services
US7324091B2 (en) 2004-02-24 2008-01-29 Research In Motion Limited Handheld electronic device and keyboard having multiple-function keys
US20080074084A1 (en) 2006-09-26 2008-03-27 Motorola, Inc. Electronic device and method for controlling charging current
US20080143496A1 (en) 2006-12-15 2008-06-19 Nokia Corporation Apparatus, method, and computer program product providing sound-produced tactile feedback
US20080150899A1 (en) 2002-11-06 2008-06-26 Julius Lin Virtual workstation
US20080158145A1 (en) 2007-01-03 2008-07-03 Apple Computer, Inc. Multi-touch input discrimination
US20080188268A1 (en) 2007-02-03 2008-08-07 Lg Electronics Inc. Mobile communication terminal and method of operating the same
US20080227463A1 (en) 2007-03-14 2008-09-18 Motorola, Inc. Determining location information
WO2008120049A2 (en) 2007-03-29 2008-10-09 Sony Ericsson Mobile Communications Ab Method for providing tactile feedback for touch-based input device
US20080280640A1 (en) 2007-05-11 2008-11-13 Sony Ericsson Mobile Communications Ab Inductive joystick
US20090116691A1 (en) 2004-08-24 2009-05-07 Koninklijke Philips Electronics, N.V. Method for locating an object associated with a device to be controlled and a method for controlling the device
US20090167704A1 (en) 2007-12-31 2009-07-02 Apple Inc. Multi-touch display screen with localized tactile feedback
US20090170532A1 (en) 2007-12-28 2009-07-02 Apple Inc. Event-based modes for electronic devices
US20100171756A1 (en) 2005-03-31 2010-07-08 Serkan Tosun Dynamic location-based mapping system and method
US7765333B2 (en) 2004-07-15 2010-07-27 Immersion Corporation System and method for ordering haptic effects
US8138896B2 (en) * 2007-12-31 2012-03-20 Apple Inc. Tactile feedback in an electronic device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5973670A (en) * 1996-12-31 1999-10-26 International Business Machines Corporation Tactile feedback controller for computer cursor control device
JP4514808B2 (en) 2003-07-02 2010-07-28 日世株式会社 Edible container
US7571213B2 (en) * 2004-03-26 2009-08-04 Microsoft Corporation Interactive electronic bubble messaging
CN100372411C (en) 2004-05-19 2008-02-27 朱绍纲 Method for realizing voice prompting of speech time length for mobile phone
US20050272408A1 (en) * 2004-06-04 2005-12-08 Deanna Wilkes-Gibbs Method for personal notification indication
US20060092177A1 (en) * 2004-10-30 2006-05-04 Gabor Blasko Input method and apparatus using tactile guidance and bi-directional segmented stroke

Patent Citations (70)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200414014A
TW200724864A
TW200721741A
US5675362A (en) 1988-11-14 1997-10-07 Microslate, Inc. Portable computer with touch screen and computing system employing same
US5379057A (en) 1988-11-14 1995-01-03 Microslate, Inc. Portable computer with touch screen and computer system employing same
US5689253A (en) 1991-04-10 1997-11-18 Kinesis Corporation Ergonomic keyboard apparatus
US5248929A (en) 1992-04-30 1993-09-28 Murata Machinery, Ltd. Battery time monitor for cellular telephone
US5717423A (en) 1994-12-30 1998-02-10 Merltec Innovative Research Three-dimensional display
US7212802B2 (en) 1995-01-05 2007-05-01 Ronald R. Kelly Method and system for providing a portable communication service
US5510584A (en) 1995-03-07 1996-04-23 Itt Corporation Sequentially operated snap action membrane switches
US6473069B1 (en) 1995-11-13 2002-10-29 Cirque Corporation Apparatus and method for tactile feedback from input device
US5953541A (en) 1997-01-24 1999-09-14 Tegic Communications, Inc. Disambiguating system for disambiguating ambiguous input sequences by displaying objects associated with the generated input sequences in the order of decreasing frequency of use
US6047071A (en) 1997-04-15 2000-04-04 Nokia Mobile Phones Network-initiated change of mobile phone parameters
US6879244B1 (en) 1997-05-21 2005-04-12 E.S.P. Networks, Inc. Call receiving system apparatus and method having a dedicated switch
US6323846B1 (en) * 1998-01-26 2001-11-27 University Of Delaware Method and apparatus for integrating manual input
US5977867A (en) 1998-05-29 1999-11-02 Nortel Networks Corporation Touch pad panel with tactile feedback
US6429846B2 (en) 1998-06-23 2002-08-06 Immersion Corporation Haptic feedback for touchpads and other touch controls
US6801939B1 (en) 1999-10-08 2004-10-05 Board Of Trustees Of The Leland Stanford Junior University Method for evaluating quality of service of a digital network connection
US20040046744A1 (en) 1999-11-04 2004-03-11 Canesta, Inc. Method and apparatus for entering data using a virtual input device
WO2001041636A1 (en) 1999-12-12 2001-06-14 Ralph Lander Open loop tactile feedback
US6342836B2 (en) 2000-02-25 2002-01-29 Harry I. Zimmerman Proximity and sensing system for baggage
US6954657B2 (en) 2000-06-30 2005-10-11 Texas Instruments Incorporated Wireless communication device having intelligent alerting system
EP1310860A1 (en) 2000-08-08 2003-05-14 NTT DoCoMo, Inc. Electronic apparatus, vibration generator, vibratory informing method and method for controlling information
US20020084721A1 (en) 2001-01-03 2002-07-04 Walczak Thomas J. Piezo electric keypad assembly with tactile feedback
US20100325931A1 (en) * 2001-03-09 2010-12-30 Immersion Corporation Handheld weapons using tactile feedback to deliver silent status information
US20040137935A1 (en) 2001-05-10 2004-07-15 Rony Zarom Modular personal device system
US6940490B1 (en) 2001-08-27 2005-09-06 Palmone, Inc. Raised keys on a miniature keyboard
CN1571989A (en) 2001-10-23 2005-01-26 伊梅森公司 Method of using tactile feedback to deliver silent status information to a user of an electronic device
US8739033B2 (en) 2001-10-23 2014-05-27 Immersion Corporation Devices using tactile feedback to deliver silent status information
WO2003054849A1 (en) 2001-10-23 2003-07-03 Immersion Corporation Method of using tactile feedback to deliver silent status information to a user of an electronic device
US20030134626A1 (en) 2002-01-16 2003-07-17 International Business Machines Corporation Apparatus and method for managing a mobile phone answering mode and outgoing message based on a location of the mobile phone
US20030174121A1 (en) 2002-01-28 2003-09-18 Sony Corporation Mobile apparatus having tactile feedback function
US20030184574A1 (en) 2002-02-12 2003-10-02 Phillips James V. Touch screen interface with haptic feedback device
EP1505484A1 (en) 2002-05-16 2005-02-09 Sony Corporation Inputting method and inputting apparatus
US7170428B2 (en) 2002-06-14 2007-01-30 Nokia Corporation Electronic device and method of managing its keyboard
US7123948B2 (en) 2002-07-16 2006-10-17 Nokia Corporation Microphone aided vibrator tuning
US20040056876A1 (en) 2002-09-25 2004-03-25 Satoshi Nakajima Tactilely enhanced visual image display
US20080150899A1 (en) 2002-11-06 2008-06-26 Julius Lin Virtual workstation
US20060136630A1 (en) 2002-12-08 2006-06-22 Immersion Corporation, A Delaware Corporation Methods and systems for providing haptic messaging to handheld communication devices
US20040223599A1 (en) 2003-05-05 2004-11-11 Bear Eric Gould Computer system with do not disturb system and method
US20050109841A1 (en) 2003-11-17 2005-05-26 Ryan Dennis J. Multi-interface compact personal token apparatus and methods of use
US20050197767A1 (en) * 2004-02-05 2005-09-08 Nortrup Edward H. Smart answering machine
US7324091B2 (en) 2004-02-24 2008-01-29 Research In Motion Limited Handheld electronic device and keyboard having multiple-function keys
US20050233707A1 (en) 2004-04-16 2005-10-20 Hon Hai Precision Industry Co., Ltd Mobile phone with health care functionality
US7019622B2 (en) 2004-05-27 2006-03-28 Research In Motion Limited Handheld electronic device including vibrator having different vibration intensities and method for vibrating a handheld electronic device
US7765333B2 (en) 2004-07-15 2010-07-27 Immersion Corporation System and method for ordering haptic effects
US20060026521A1 (en) 2004-07-30 2006-02-02 Apple Computer, Inc. Gestures for touch sensitive input devices
US20060026535A1 (en) 2004-07-30 2006-02-02 Apple Computer Inc. Mode-based graphical user interfaces for touch sensitive input devices
US20090116691A1 (en) 2004-08-24 2009-05-07 Koninklijke Philips Electronics, N.V. Method for locating an object associated with a device to be controlled and a method for controlling the device
US7298833B2 (en) 2004-09-29 2007-11-20 Avaya Integrated Cabinet Solutions, Inc. Wireless device to manage cross-network telecommunication services
WO2006042309A1 (en) 2004-10-08 2006-04-20 Immersion Corporation Haptic feedback for button and scrolling action simulation in touch input devices
US20100171756A1 (en) 2005-03-31 2010-07-08 Serkan Tosun Dynamic location-based mapping system and method
US20060240821A1 (en) 2005-04-25 2006-10-26 Huan-Wen Chien Identifying and automatically messaging system for a wireless communication server and operating method for the same
US20070024593A1 (en) 2005-07-28 2007-02-01 Schroeder Dale W Touch device and method for providing tactile feedback
US20070152983A1 (en) 2005-12-30 2007-07-05 Apple Computer, Inc. Touch pad with symbols based on mode
US20070236450A1 (en) 2006-03-24 2007-10-11 Northwestern University Haptic device with indirect haptic feedback
US20080074084A1 (en) 2006-09-26 2008-03-27 Motorola, Inc. Electronic device and method for controlling charging current
US20080143496A1 (en) 2006-12-15 2008-06-19 Nokia Corporation Apparatus, method, and computer program product providing sound-produced tactile feedback
US20080158145A1 (en) 2007-01-03 2008-07-03 Apple Computer, Inc. Multi-touch input discrimination
US20080188268A1 (en) 2007-02-03 2008-08-07 Lg Electronics Inc. Mobile communication terminal and method of operating the same
US20080227463A1 (en) 2007-03-14 2008-09-18 Motorola, Inc. Determining location information
WO2008120049A2 (en) 2007-03-29 2008-10-09 Sony Ericsson Mobile Communications Ab Method for providing tactile feedback for touch-based input device
US20080280640A1 (en) 2007-05-11 2008-11-13 Sony Ericsson Mobile Communications Ab Inductive joystick
US20090170532A1 (en) 2007-12-28 2009-07-02 Apple Inc. Event-based modes for electronic devices
US8138896B2 (en) * 2007-12-31 2012-03-20 Apple Inc. Tactile feedback in an electronic device
US8373549B2 (en) 2007-12-31 2013-02-12 Apple Inc. Tactile feedback in an electronic device
US8400283B2 (en) * 2007-12-31 2013-03-19 Apple Inc. Tactile feedback in an electronic device
US9070262B2 (en) * 2007-12-31 2015-06-30 Apple Inc. Tactile feedback in an electronic device
US8754759B2 (en) * 2007-12-31 2014-06-17 Apple Inc. Tactile feedback in an electronic device
US20090167704A1 (en) 2007-12-31 2009-07-02 Apple Inc. Multi-touch display screen with localized tactile feedback

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
U.S. Appl. No. 14/252,536, filed Apr. 14, 2014, Fadell et al.

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10123300B2 (en) * 2007-12-31 2018-11-06 Apple Inc. Tactile feedback in an electronic device

Also Published As

Publication number Publication date Type
US8754759B2 (en) 2014-06-17 grant
US20140225718A1 (en) 2014-08-14 application
US9070262B2 (en) 2015-06-30 grant
US10123300B2 (en) 2018-11-06 grant
US20090167509A1 (en) 2009-07-02 application
DE112008003578T5 (en) 2010-12-30 application
US20090167508A1 (en) 2009-07-02 application
US20170094636A1 (en) 2017-03-30 application
US8373549B2 (en) 2013-02-12 grant
US20120249312A1 (en) 2012-10-04 application
EP2227731A1 (en) 2010-09-15 application
US20130201010A1 (en) 2013-08-08 application
WO2009085378A1 (en) 2009-07-09 application
US8138896B2 (en) 2012-03-20 grant
CN104102388A (en) 2014-10-15 application
US20150302709A1 (en) 2015-10-22 application
CN101910978A (en) 2010-12-08 application
US8400283B2 (en) 2013-03-19 grant

Similar Documents

Publication Publication Date Title
US7176886B2 (en) Spatial signatures
US7365736B2 (en) Customizable gesture mappings for motion controlled handheld devices
US7176888B2 (en) Selective engagement of motion detection
US7301526B2 (en) Dynamic adaptation of gestures for motion controlled handheld devices
US7301528B2 (en) Distinguishing tilt and translation motion components in handheld devices
US7301529B2 (en) Context dependent gesture response
US7180502B2 (en) Handheld device with preferred motion selection
US7301527B2 (en) Feedback based user interface for motion controlled handheld devices
US7176887B2 (en) Environmental modeling for motion controlled handheld devices
US7365737B2 (en) Non-uniform gesture precision
US7365735B2 (en) Translation controlled cursor
US7173604B2 (en) Gesture identification of controlled devices
US7180501B2 (en) Gesture based navigation of a handheld user interface
US8341557B2 (en) Portable touch screen device, method, and graphical user interface for providing workout support
US7280096B2 (en) Motion sensor engagement for a handheld device
US20100069123A1 (en) Systems and Methods for Voice Based Search
US20130254714A1 (en) Method and apparatus for providing floating user interface
US20140298248A1 (en) Method and device for executing application
US8683378B2 (en) Scrolling techniques for user interfaces
US20110273575A1 (en) Mobile terminal and operating method thereof
US20090007188A1 (en) Selective data downloading and presentation based on user interaction
US20050212760A1 (en) Gesture based user interface supporting preexisting symbols
US20140365895A1 (en) Device and method for generating user interfaces from a template
US20110050569A1 (en) Motion Controlled Remote Controller
US20050210417A1 (en) User definable gestures for motion controlled handheld devices