WO2014201151A1 - Systems and methods for pressure-based haptic effects - Google Patents
Systems and methods for pressure-based haptic effects Download PDFInfo
- Publication number
- WO2014201151A1 WO2014201151A1 PCT/US2014/041964 US2014041964W WO2014201151A1 WO 2014201151 A1 WO2014201151 A1 WO 2014201151A1 US 2014041964 W US2014041964 W US 2014041964W WO 2014201151 A1 WO2014201151 A1 WO 2014201151A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- haptic
- pressure
- haptic effect
- user interface
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03547—Touch pads, in which fingers can move on a surface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/014—Force feedback applied to GUI
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04105—Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
Definitions
- the present invention relates to the field of user interface devices. More specifically, the present invention relates to pressure-based haptic effects.
- One interface that is of growing popularity due to its intuitive and interactive nature is the touchscreen display.
- a user can perform a variety of tasks by contacting a region of the touchscreen with the user's finger.
- designers often leverage user experience with physical interactions. This is generally done by reproducing some aspects of interactions with the physical world through visual, audio, and/or haptic feedback.
- Haptic feedback often takes the form of a mechanical vibration. There is a need for additional systems and methods to generate haptic feedback.
- Embodiments of the present disclosure comprise computing devices featuring pressure-based haptic effects.
- a system of the present disclosure may comprise a sensor configured to detect a user interaction with a touch surface and transmit a sensor signal comprising data associated with a pressure of the user interaction.
- the system may also comprise a processor in communication with the sensor, the processor configured to: receive the sensor signal; determine, based on the sensor signal, a pressure level; and determine a user interface level based at least in part on the pressure level.
- the processor may also be configured to perform a function associated with the user interface level and the user interaction; determine a haptic effect based at least in part on the user interface level and the user interaction; generate a haptic signal based at least in part on the haptic effect; and transmit the haptic signal.
- the system may further comprise a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.
- a method of the present disclosure may comprise: receiving a sensor signal from a sensor, wherein the sensor signal comprises data associated with a pressure of a user interaction with a touch surface.
- the method may also comprise determining, based on the sensor signal, a pressure level; and determining a user interface level based at least in part on the pressure level.
- the method may further comprise performing a function associated with the user interface level and the user interaction;
- Yet another embodiment comprises a computer-readable medium for implementing such a method.
- Figure 1 is a block diagram showing a system for pressure-based haptic effects according to one embodiment
- Figure 2 is another block diagram showing a system for pressure-based haptic effects
- Figure 3 shows an embodiment of a system for pressure-based haptic effects
- Figure 4 shows another embodiment of a system for pressure-based haptic effects
- Figure 5 shows still another embodiment of a system for pressure-based haptic effects
- Figure 6 shows yet another embodiment of a system for pressure-based haptic effects
- Figure 7 shows another embodiment of a system for pressure-based haptic effects
- Figure 8 is a flow chart of steps for performing a method for providing pressure-based haptic effects according to one embodiment.
- One illustrative embodiment of the present disclosure comprises a computing device, such as a smart phone, tablet, or e-reader.
- the computing device comprises a touch-screen display, a memory, a camera, and a processor in communication with each of these elements.
- the touch-screen display is configured to output a user interface.
- the touch-screen display may output a user interface associated with a camera application.
- a user may interact with the camera application, for example, to take photographs or videos.
- the user interface comprises multiple user interface levels with which a user may interact.
- Each user interface level may be configured to cause the computing device to perform one or more functions.
- a first user interface level may be configured to allow a user to focus on an object (e.g., a person, animal, tree, automobile, or building) within view of the camera.
- a second user interface level may be configured to take a photograph of the object.
- the user may interact with (or activate) the different user interface levels by applying an amount of pressure associated with that level to the touch-screen display.
- the computing device is configured to detect and categorize the amount of pressure into one of a plurality of pressure levels (i.e., a range of pressures falling between two pressure thresholds).
- Each pressure level may be associated with a user interface level. For example, no pressure (e.g., the user is exerting a small amount of pressure or no pressure on the touch surface) may not be associated with a user interface level.
- Soft pressure e.g., the user is contacting the touch surface with low pressure
- the first user interface level e.g., the user is contacting the touch surface with low pressure
- the user may be able to focus the camera on the object by applying soft pressure to the touch-screen display.
- Firm pressure e.g., the user is contacting the touch surface with more pressure than the soft pressure level
- the user may be able to take a photo of the object by applying firm pressure to the touch-screen display.
- the computing device is also in communication with a haptic output device.
- the haptic output device is configured to receive a signal from the computing device and output a haptic effect perceivable by a user.
- the computing device is configured to determine, based at least in part on the user interface level, a haptic effect to output. For example, in the illustrative embodiment, if the computing device determines that the user is exerting a small amount of pressure or no pressure on the touch-screen display, the computing device may determine no haptic effect.
- the computing device determines that the user is exerting a soft pressure on the touch-screen display
- the computing device outputs a haptic effect (e.g., a haptic effect configured to simulate the movement of a camera lens).
- the computing device determines that the user is exerting a firm pressure on the touch-screen display
- the computing device outputs another haptic effect (e.g., a haptic effect configured to simulate the shutter of a camera taking a photo and film advancing to the next frame).
- the user may be able to focus the camera on an object and take a photo of the object without having to move the user's finger from a single location on the touch-screen display. This may make interactions with the camera application easier for the user.
- the haptic effects associated with two or more user interface levels may be the same.
- the haptic effects associated with the first user interface level and the second user interface level may be the same (e.g., a vibration).
- the haptic effects associated with two or more user interface levels may be different.
- the haptic effect associated with the first user interface level may comprise a vibration and the haptic effect associated with the second user interface level may comprise a second vibration that is clearly distinguishable from the first vibration, or a change in a perceivable coefficient of friction.
- FIG. 1 is a block diagram showing a system 100 for pressure-based haptic effects according to one embodiment.
- system 100 comprises a computing device 101.
- Computing device 101 may comprise, for example, a mobile phone, tablet, e- reader, laptop computer, desktop computer, car computer system, medical device, game console, game controller, or portable gaming device.
- the computing device 101 may comprise a multifunction controller, for example, a controller for use in a kiosk, automobile, alarm system, thermostat, or other type of computing device.
- system 100 is shown as a single device in Figure 1, in other embodiments, the system 100 may comprise multiple devices, such as a game console and one or more game controllers.
- the computing device 101 comprises a processor 102 in communication with other hardware via bus 106.
- a memory 104 which can comprise any suitable tangible (and non- transitory) computer-readable medium such as RAM, ROM, EEPROM, or the like, embodies program components that configure operation of the computing device 101.
- computing device 101 further includes one or more network interface devices 1 10, input/output (I/O) components 1 12, and storage 1 14.
- Network interface device 1 10 can represent one or more of any components that facilitate a network connection. Examples include, but are not limited to, wired interfaces such as Ethernet, USB, IEEE 1394, and/or wireless interfaces such as IEEE 802.1 1, Bluetooth, or radio interfaces for accessing cellular telephone networks (e.g.,
- transceiver/antenna for accessing a CDMA, GSM, UMTS, or other mobile communications network.
- I O components 1 12 may be used to facilitate wired or wireless connection to devices such as one or more displays 134, game controllers, keyboards, mice, joysticks, cameras, buttons, speakers, microphones, and/or other hardware used to input data or output data.
- Storage 114 represents nonvolatile storage such as magnetic, optical, or other storage media included in computing device 101 or coupled to processor 102.
- System 100 further includes a touch sensitive surface 116 which, in this example, is integrated into computing device 101.
- Touch sensitive surface 1 16 represents any surface that is configured to sense tactile input of a user.
- One or more touch sensors 108 are configured to detect a touch in a touch area when an object contacts a touch sensitive surface 116 and provide appropriate data for use by processor 102. Any suitable number, type, or arrangement of sensors can be used.
- resistive and/or capacitive sensors may be embedded in touch sensitive surface 1 16 and used to determine the location of a touch and other information, such as pressure, speed, and/or direction.
- optical sensors with a view of the touch sensitive surface 116 may be used to determine the touch position.
- the touch sensor 108 may comprise a LED detector.
- touch sensitive surface 1 16 may comprise a LED finger detector mounted on the side of a display 134.
- the processor 102 is in communication with a single touch sensor 108, in other embodiments, the processor 102 is in communication with a plurality of touch sensors 108, for example, a first touch screen and a second touch screen.
- the touch sensor 108 is configured to detect user interaction, and based on the user interaction, transmit signals to processor 102.
- touch sensor 108 may be configured to detect multiple aspects of the user interaction. For example, touch sensor 108 may detect the speed and pressure of a user interaction, and incorporate this information into the interface signal.
- Touch sensitive surface 1 16 may or may not comprise (or otherwise correspond to) the display 134, depending on the particular configuration of the system 100. Some embodiments include a touch enabled display that combines a touch sensitive surface 116 and a display 134 of the device. The touch sensitive surface 1 16 may correspond to the display 134 exterior or one or more layers of material above components shown on the display 134.
- the computing device 101 comprises a touch sensitive surface 116 that may be mapped to a graphical user interface provided in a display 134 included in system 100 and interfaced to computing device 101.
- computing device 201 comprises a touch sensitive surface 216, which may be mapped to a graphical user interface provided in a display 222 included in computing system 220.
- Computing system 220 is communicatively coupled to computing device 201.
- the computing device 201 may comprise, for example, a mouse, trackpad, or other device.
- the computing system 220 may comprise, for example, a laptop computer, desktop computer, set- top box (e.g., DVD player, DVR, cable television box), or another computing system.
- planar touch sensitive surfaces 216 in the examples herein is not meant to be limiting. Other embodiments may comprise curved or irregular touch sensitive surfaces 216.
- the system 100 further includes a pressure sensor 132.
- the pressure sensor 132 is configured to detect an amount of pressure exerted by a user against a surface associated with the computing device 101 (e.g., touch sensitive surface 116).
- the pressure sensor 132 is further configured to transmit sensor signals to the processor 102.
- the pressure sensor 132 may comprise, for example, a capacitive sensor, a strain gauge, a frustrated total internal reflection sensor, or a FSR.
- the pressure sensor 132 may be configured to determine the surface area of a contact between a user and a surface associated with the computing device 101.
- the touch sensitive surface 116 or the touch sensor 108 may comprise the pressure sensor 132.
- the system 100 comprises one or more additional sensors 130. In some
- the senor 130 may comprise, for example, a camera, a gyroscope, an accelerometer, a global positioning system (GPS) unit, a temperature sensor, a strain gauge, a force sensor, a range sensor, or a depth sensor.
- the gyroscope, accelerometer, and GPS unit may detect an orientation, acceleration, and location of the computing device 101, respectively.
- the camera, range sensor, and/or depth sensor may detect a distance between computing device 101 and an external object (e.g., a user's hand, head, arm, foot, or leg; another person; an automobile; a tree; a building; or a piece of furniture).
- an external object e.g., a user's hand, head, arm, foot, or leg; another person; an automobile; a tree; a building; or a piece of furniture.
- sensor 130 may be external to computing device 101.
- the one or more sensors 130 may be associated with a wearable device (e.g., a ring, bracelet, sleeve, collar, hat, shirt, glove, article of clothing, or glasses) and/or coupled to a user's body.
- the processor 102 may be in communication with a single sensor 130 and, in other embodiments, the processor 102 may be in communication with a plurality of sensors 130, for example, a gyroscope and an accelerometer.
- the sensor 130 is configured to transmit a sensor signal to the processor 102.
- System 100 further includes haptic output device 118 in communication with processor 102.
- Haptic output device 118 is configured to output a haptic effect in response to a haptic signal.
- the haptic effect may comprise, for example, one or more of a vibration, a change in a perceived coefficient of friction, a simulated texture, a change in temperature, a stroking sensation, an electro-tactile effect, or a surface deformation.
- the haptic output device 1 18 is in
- haptic output device 118 may be remote from computing device 101, but communicatively coupled to processor 102.
- haptic output device 1 18 may be external to and in communication with computing device 101 via wired interfaces such as Ethernet, USB, IEEE 1394, and/or wireless interfaces such as IEEE 802.1 1, Bluetooth, or radio interfaces.
- the haptic output device 118 may be coupled to a wearable device that may be remote from the computing device 101.
- the wearable device may comprise a shoe, a sleeve, a jacket, glasses, a glove, a ring, a watch, a wristband, a bracelet, an article of clothing, a hat, a headband, and/or jewelry.
- the wearable device may be associated with a part of a user's body, for example, a user's finger, arm, hand, foot, leg, head, or other body part.
- the haptic output device 1 18 may be configured to output a haptic effect comprising a vibration.
- the haptic output device 118 may comprise, for example, one or more of a piezoelectric actuator, an electric motor, an electro-magnetic actuator, a voice coil, a shape memory alloy, an electro-active polymer, a solenoid, an eccentric rotating mass motor (ERM), or a linear resonant actuator (LRA).
- haptic output device 1 18 may be configured to output a haptic effect comprising a change in a perceived coefficient of friction on a surface associated with computing device 101 (e.g., the touch sensitive surface 116).
- the haptic output device 118 comprises an ultrasonic actuator.
- the ultrasonic actuator may vibrate at an ultrasonic frequency, for example 20 kHz, increasing or reducing the perceived coefficient on a surface associated with the computing device 101 (e.g., touch sensitive surface 1 16).
- the ultrasonic actuator may comprise a piezoelectric material.
- haptic output device 1 18 may use electrostatic attraction, for example by use of an electrostatic actuator, to output a haptic effect.
- the haptic effect may comprise a simulated texture, a simulated vibration, a stroking sensation, or a perceived change in a coefficient of friction on a surface associated with computing device 101 (e.g., touch sensitive surface 116).
- the electrostatic actuator may comprise a conducting layer and an insulating layer.
- the conducting layer may be any semiconductor or other conductive material, such as copper, aluminum, gold, or silver.
- the insulating layer may be glass, plastic, polymer, or any other insulating material.
- the processor 102 may operate the electrostatic actuator by applying an electric signal, for example an AC signal, to the conducting layer.
- an electric signal for example an AC signal
- a high-voltage amplifier may generate the AC signal.
- the electric signal may generate a capacitive coupling between the conducting layer and an object (e.g., a user's finger, head, foot, arm, shoulder, leg, or other body part, or a stylus) near or touching the haptic output device 1 18.
- an object e.g., a user's finger, head, foot, arm, shoulder, leg, or other body part, or a stylus
- varying the levels of attraction between the object and the conducting layer can vary the haptic effect perceived by a user interacting with the computing device 101.
- the haptic output device 1 18 may comprise a deformation device.
- the deformation device may be configured to output a haptic effect by deforming a surface associated with the haptic output device 1 18 (e.g., a housing of the computing device 101 or the touch sensitive surface 1 16).
- the haptic output device 118 may comprise a smart gel that responds to a stimulus or stimuli by changing in stiffness, volume, transparency, and/or color.
- stiffness may comprise the resistance of a surface associated with the haptic output device 1 18 against deformation.
- one or more wires are embedded in or coupled to the smart gel. As current runs through the wires, heat is emitted, causing the smart gel to expand or contract, deforming the surface associated with the haptic output device 118.
- the haptic output device 1 18 may comprise an actuator coupled to an arm that rotates a deformation component.
- the actuator may comprise a piezoelectric actuator, rotating/linear actuator, solenoid, an electroactive polymer actuator, macro fiber composite (MFC) actuator, shape memory alloy (SMA) actuator, and/or other actuator.
- MFC macro fiber composite
- SMA shape memory alloy
- the haptic output device 1 18 may comprise a portion of the housing of the computing device 101 or a component of the computing device 101.
- the haptic output device 118 may be housed inside a flexible housing overlaying the computing device 101 or a component of the computing device 101.
- the haptic output device 1 18 may be configured to output a thermal or electro-tactile haptic effect.
- the haptic output device 118 may be configured to output a haptic effect comprising a change in a temperature of a surface associated with the haptic output device 1 18.
- the haptic output device 118 may comprise a conductor (e.g., a wire or electrode) for outputting a thermal or electro- tactile effect.
- the haptic output device 118 may comprise a conductor embedded in a surface associated with the haptic output device 1 18.
- the computing device 101 may output a haptic effect by transmitting current to the conductor.
- the conductor may receive the current and, for example generate heat, thereby outputting the haptic effect.
- haptic output device 1 18 may use multiple haptic output devices of the same or different type to provide haptic feedback.
- Some haptic effects may utilize an actuator coupled to a housing of the device, and some haptic effects may use multiple actuators in sequence and/or in concert.
- multiple vibrating actuators and electrostatic actuators can be used alone or in concert to provide different haptic effects.
- the haptic output device 118 may comprise a solenoid or other force or displacement actuator, which may be coupled to the touch sensitive surface 116. Further, the haptic output device 118 may be either rigid or flexible.
- a detection module 124 configures the processor 102 to monitor the touch sensitive surface 116 via the touch sensor 108 to determine a position of a touch.
- detection module 124 may sample touch sensor 108 in order to track the presence or absence of a touch and, if a touch is present, to track one or more of the location, path, velocity, acceleration, pressure and/or other characteristics of the touch.
- Haptic effect determination module 126 represents a program component that analyzes data to determine a haptic effect to generate.
- Haptic effect determination module 126 may comprise code that determines, for example, based on an interaction with touch sensitive surface 1 16, a haptic effect to output and code that selects one or more haptic effects to provide in order to output the effect. For example, in some embodiments, some or all of the area of touch sensitive surface 1 16 may be mapped to a graphical user interface.
- Haptic effect determination module 126 may select different haptic effects based on the location of a touch in order to simulate the presence of a feature (e.g., a virtual avatar, automobile, animal, cartoon character, button, lever, slider, list, menu, logo, or person) on the surface of touch sensitive surface 1 16.
- a feature e.g., a virtual avatar, automobile, animal, cartoon character, button, lever, slider, list, menu, logo, or person
- these features may correspond to a visible representation of the feature on the interface.
- haptic effects may be output even if a corresponding element is not displayed in the interface (e.g., a haptic effect may be provided if a boundary in the interface is crossed, even if the boundary is not displayed).
- the haptic effect determination module 126 may select a haptic effect based at least in part a characteristic (e.g., a virtual size, width, length, color, texture, material, trajectory, type, movement, pattern, or location) associated with a virtual object. For example, in one embodiment, the haptic effect determination module 126 may determine a haptic effect comprising a vibration if a color associated with the virtual object is blue. In such an embodiment, the haptic effect determination module 126 may determine a haptic effect comprising a change in temperature if a color associated with the virtual object is red. As another example, the haptic effect determination module 126 may determine a haptic effect configured to simulate the texture of sand if the virtual object comprises an associated virtual texture that is sandy or coarse.
- a characteristic e.g., a virtual size, width, length, color, texture, material, trajectory, type, movement, pattern, or location
- the haptic effect determination module 126 may select a haptic effect based at least in part on a signal from the pressure sensor 132. That is, the haptic effect determination module 126 may determine a haptic effect based on the amount of pressure a user exerts against a surface (e.g., touch sensitive surface 1 16) associated with the computing device 101. For example, in some embodiments, the haptic effect determination module 126 may output a first haptic effect or no haptic effect if the user exerts little or no pressure against the surface. In some embodiments, the haptic effect determination module 126 may output a second haptic effect or no haptic effect if the user exerts low pressure against the surface.
- a surface e.g., touch sensitive surface 1 16
- the haptic effect determination module 126 may output a third haptic effect or no haptic effect if the user exerts a firm pressure against the surface. In some embodiments, the haptic effect determination module 126 may associate different haptic effects with no pressure, soft pressure, and/or firm pressure. In other embodiments, the haptic effect determination module 126 may associate the same haptic effect with no pressure, soft pressure, and/or firm pressure.
- the haptic effect determination module 126 may comprise a finite state machine.
- a finite state machine may comprise a mathematical model of computation. Upon applying an input to the mathematical model, the finite state machine may transition from a current state to a new state. In such an embodiment, the finite state machine may select haptic effects based on the transition between states. In some embodiments, these state transitions may be driven based in part on a sensor signal from the pressure sensor 132.
- haptic effect determination module 126 may comprise code that determines a haptic effect based at least in part on signals from sensor 130 (e.g., a temperature, an amount of ambient light, an accelerometer measurement, or a gyroscope measurement). For example, in some embodiments, haptic effect determination module 126 may determine a haptic effect based on the amount of ambient light. In such embodiments, as the ambient light decreases, the haptic effect determination module 126 may determine a haptic effect configured to deform a surface of the computing device 101 or vary the perceived coefficient of friction on a surface associated with the haptic output device 1 18. In some embodiments, haptic effect determination module 126 may determine haptic effects based on the temperature. For example, as the temperature decreases, the haptic effect determination module 126 may determine a haptic effect in which the user perceives a decreasing coefficient of friction on a surface associated with the haptic output device 118.
- signals from sensor 130 e.g., a temperature, an amount
- Haptic effect generation module 128 represents programming that causes processor
- haptic effect generation module 128 may access stored waveforms or commands to send to haptic output device 118.
- haptic effect generation module 128 may comprise algorithms to determine the haptic signal.
- Haptic effect generation module 128 may comprise algorithms to determine target coordinates for the haptic effect. These target coordinates may comprise, for example, a location on the touch sensitive surface 1 16.
- FIG. 3 shows an embodiment of a system for pressure-based haptic effects.
- the system 300 comprises a computing device 302.
- the computing device 302 may comprise a tablet, an e-reader, a car computer (e.g., a computer for controlling one or more automobile systems or devices such as stereo, HVAC, lighting, navigation, or other vehicle functions), a medical device, a laptop computer, a desktop computer, a game system, a portable gaming device, a gamepad, or another electronic device.
- the computing device 302 may comprise a multifunction controller, for example, a controller for use in a kiosk, automobile, alarm system, thermostat, or other type of computing device.
- the computing device 302 comprises a mobile phone, such as a smart phone.
- the computing device 302 also comprises a touch-screen display 304, which combines a touch sensitive surface and a display.
- the touch-screen display 304 is outputting a user interface (e.g., a game).
- the user interface may comprise one or more virtual objects 306.
- the virtual object 306 comprises a virtual gun.
- a user 308 may interact with the user interface, for example, by tapping, touching, or gesturing (e.g., a two-finger pinch or a swipe) on the touch-screen display 304.
- the user 308 may interact with the user interface to play a video game, for example, to shoot the virtual gun at a virtual target.
- the user interface may comprise multiple levels with which a user 308 may interact.
- the user 308 may interact with the different interface levels by applying a level of pressure associated with that user interface level.
- the user 308 may feel textures associated with objects in the user interface by applying soft pressure.
- the user 308 may select objects by applying a harder pressure.
- the computing device 302 may provide multiple layers of interaction with a virtual object 306, which may enhance the user experience.
- the user may interact with the virtual object(s)
- the user 308 may interact with the virtual object 306 by applying different amounts of pressure to the touch-screen display 304, for example, to perform game functions.
- the user may interact with a first level of the user interface by applying a soft pressure to the virtual object 306 (e.g., the virtual gun).
- the computing device 302 may perform a game function (e.g., load an ammunition magazine into the virtual gun or aim the virtual gun) associated with the first user interface level.
- the user may interact with a second level of the user interface by applying a firm pressure to the virtual object 306.
- the computing device 302 may perform a game function (e.g., fire the virtual gun) associated with the second user interface level.
- a game function e.g., fire the virtual gun
- the computing device 306 may perform another game function (e.g., ejecting the spent casing from the virtual gun) associated with the first user interface level.
- the user 306 may be able to perform a plurality of game functions without having to move a finger off of the virtual object 306. This may provide a more intuitive and simplified experience for the user.
- the computing device 302 is configured to determine a haptic effect based at least in part on the user interface level. For example, in some embodiments, if the user 308 exerts no pressure on the virtual object 306, the computing device 302 may determine no haptic effect. If the user 308 applies a soft pressure to the virtual object 306, the computing device 302 may output a haptic effect associated with the first user interface level. For example, a haptic effect configured to simulate the texture of the gun handle or grip (e.g., a wood or rubber texture). Further, in some embodiments, if the user 308 applies a firm pressure to the virtual object 306, the computing device 302 may output a haptic effect associated with the second user interface level.
- a haptic effect configured to simulate the texture of the gun handle or grip (e.g., a wood or rubber texture).
- a haptic effect configured to simulate the firing of the gun (e.g., a high-magnitude vibration with a shorter duration).
- the computing device 302 may output a sound (e.g., a gunshot sound) associated with a user interface level in addition to a haptic effect.
- the user may receive haptic and/or audio feedback associated with one or more user interface levels. This may provide an enhanced gaming experience to the user.
- the user 308 may be able to apply soft pressure to a virtual weapon to determine what type of weapon it is without having to look at the touch-screen display 304. Further, the user 308 may be able apply firm pressure to the virtual weapon to manipulate or fire the weapon without having to look at the touch-screen display 304.
- the user may be free to concentrate the user's attention on other game activities.
- a user interface level may be associated with a plurality of functions. For example, in some embodiments, if the user 308 releases the firm pressure, the computing device 302 may perform another function associated with the first user interface level. For example, the computing device 302 may virtually eject a spent ammunition round from the virtual gun. Further, a plurality of haptic effects may be associated with a user interface level. For example, upon the user releasing the firm pressure, the computing device 302 may output another haptic effect associated with the first user interface level. For instance, the computing device 302 may output a haptic effect configured to simulate ejecting a used ammunition round from the virtual gun (e.g., a low-magnitude vibration with a shorter duration).
- a haptic effect configured to simulate ejecting a used ammunition round from the virtual gun (e.g., a low-magnitude vibration with a shorter duration).
- the computing device 302 may perform another function and/or output a haptic effect.
- the computing device 302 may output a haptic effect configured to simulate unloading the magazine from the weapon (e.g., a low-magnitude vibration with a longer duration).
- the user 308 may perform different functions by applying different levels of pressure one or more virtual objects displayed in a user interface.
- the computing device 302 may determine and output different haptic effects associated with function and/or the level of pressure.
- the computing device 302 may comprise a simulator.
- the simulator may be configured to output a virtual object 306 and simulate physical interactions with the object.
- the simulator may output a virtual carbonated beverage can (e.g., a soda or beer can) and be configured to simulate interactions with a real carbonated beverage can.
- the computing device 302 may output a haptic effect associated with the first user interface level.
- a haptic effect configured to simulate the release of carbonation (e.g., a low-magnitude vibration with a longer duration).
- the computing device 302 may output a haptic effect associated with the second user interface level.
- a haptic effect configured to simulate opening the tab of a can (e.g., a high-magnitude vibration with a shorter duration).
- the computing device 302 may output another haptic effect associated with the first user interface level.
- a haptic effect configured to simulate pouring of the beverage (e.g., a flow sensation).
- Still another example may comprise a virtual object 306 comprising a virtual car.
- a user 306 may be able to drive the virtual car in a video game.
- the computing device 302 may, for example, start the virtual car's engine.
- the computing device 302 may also output a haptic effect, for example, configured to simulate the rumble of an engine starting (e.g., a long, low frequency vibration).
- the computing device 302 may, for example, accelerate the virtual car.
- the computing device 302 may output a haptic effect, for example, configured to simulate pressing the accelerator of a car.
- the computing device 302 may, for example, stop the car and/or turn off the car's ignition.
- the computing device 302 may also output another haptic effect, for example, configured to simulate turning off the ignition of a car (e.g., the computing device 302 may stop outputting a haptic effect).
- the user may be able to play a video game without having to move a finger off of a virtual object, which may make the video game easier to play.
- the virtual object 306 may comprise a virtual guitar.
- a user 306 may be able to play the virtual guitar in a video game.
- the computing device 302 may, for example, lightly strum the virtual guitar.
- the computing device 302 may also output a haptic effect, for example, configured to simulate the vibration of a guitar string (e.g., a vibration with a magnitude that decays over time).
- the computing device 302 may, for example, intensely strum of the virtual guitar.
- the computing device 302 may output a haptic effect, for example, configured to simulate intensely strumming a guitar string.
- the user may be able to play the virtual modulate the intensity of the user's strumming without having to move a finger. This may make the video game easier to play.
- the user 308 may be able to interact with multiple parts of a virtual object 306 using an amount of pressure associated with a user interface level. Each part of the virtual object 306 may be associated with a different function.
- a virtual object 306 may comprise a water bowl.
- a user 308 may be able to interact with the rim of the virtual water bowl to perform a function (e.g., select the virtual water bowl) associated with a user interface level.
- the user 308 may also be able to interact with the virtual water in the water bowl to perform another function (e.g., splash the water as part of a video game) associated with the user interface level.
- the computing device 302 may output a haptic effect based at least in part on the virtual object 306 with which the user is interacting. For example, in the embodiment described above, if the user 308 applies light pressure to the water in the virtual water bowl, the computing device 302 may output a haptic effect associated with the first user interface level and the water. For example, a haptic effect configured to simulate the feeling of water (e.g., a simulated water texture or a reduction in the perceived coefficient of friction on the surface of the touch-screen display 304). Further, if the user 308 applies light pressure to the rim of the virtual water bowl, the computing device 302 may output another haptic effect associated with the first user interface level and the rim.
- a haptic effect configured to simulate the feeling of water (e.g., a simulated water texture or a reduction in the perceived coefficient of friction on the surface of the touch-screen display 304).
- a haptic effect configured to simulate the feeling of the rim of a bowl (e.g., a simulated ceramic or glass texture).
- the computing device 302 may output a haptic effect associated with the second user interface level and the water.
- a haptic effect configured to simulate splashing the water (e.g., a plurality of high frequency vibrations with short durations).
- the computing device 302 may output another haptic effect associated with the second user interface level and the rim.
- a haptic effect configured to simulate glass breaking (e.g., a plurality of short vibrations).
- FIG. 4 shows another embodiment of a system for pressure-based haptic effects.
- the system 400 comprises a computing device 402, e.g., a smartphone or tablet.
- the computing device 402 also comprises a touch-screen display 404.
- the computing device 402 may output a virtual object 406 on the touch-screen display 404.
- the virtual object 406 may comprise any type or number of objects, for example, buttons, sliders, knobs, lists, menus.
- the virtual object 406 may comprise a phone number input screen.
- the phone number input screen may comprise a plurality of buttons, for example, with the digits 0-9, a star symbol, and a pound symbol.
- the virtual object 406 comprises a virtual keyboard.
- a user 408 may interact with the virtual object 406 via the touch-screen display 404.
- the computing device 402 is configured to categorize a pressure exerted by the user 408 on the computing device 402 into one of a plurality of pressure levels (e.g., no pressure, soft pressure, or firm pressure). Any number or configuration of pressure levels may be possible. Pressure levels may be discrete (i.e., separate and distinct). In some embodiments, each pressure level may be associated with a user interface level.
- a user interface level may be associated with haptic effects configured to provide guidance information to the user.
- the user 408 may explore the virtual object 406 with a finger using an amount of pressure associated with a user interface level.
- the user 408 may explore the virtual keyboard using soft pressure, e.g., by pressing on the screen lightly with a finger.
- the computing device 402 may output a haptic effect.
- the computing device 402 may output a haptic effect upon the user 408 interacting with an edge of a virtual keyboard key.
- the haptic effect may be configured to simulate the edge of the virtual object.
- the computing device 402 may output a haptic effect configured to simulate the edge of a keyboard key by deforming the surface of the touch-screen display 404 to generate a bump or ridge perceivable by the user 408. This may allow the user 408 to determine the position of the user's finger. For example, the user 408 may be able to determine if the user's finger is transitioning between virtual keyboard keys as the user 408 explores the virtual keyboard.
- the user may press the key to enter the letter associated with that key.
- the user may use a different user interface level, e.g., a level associated with firm pressure, in order to press the key.
- a different user interface level e.g., a level associated with firm pressure
- one user interface level may be used for guidance (e.g., to alert the user to locations on the display) and another user interface level may be associated with selecting a particular virtual item for further interaction.
- the computing device 302 may output a haptic effect associated with the user interface level.
- a haptic effect may be configured to provide the user with confirmation that the key press has been received (e.g., a short vibration).
- a user may be able to determine if the computing device 402 has registered the key press without having to look at the touch-screen display 404.
- the computing device 402 may output a different haptic effect. For example, upon the user interacting with the center of a virtual keyboard key, the computing device 402 may output a haptic effect.
- the haptic effect may be configured to simulate the texture of a keyboard key, for example, a plastic texture. This may allow the user 408 to determine that the user's finger is over the center of a virtual keyboard key.
- the computing device 402 may output a haptic effect. For example, the computing device 402 may output a low-magnitude vibration with a short duration. This may allow a user 408 to determine the position of the user's finger on the virtual keyboard.
- orientation keys on the virtual keyboard e.g., a key on a keyboard configured to orient the user 408 to the position of their finger on the keyboard
- the computing device 402 may output a haptic effect.
- the computing device 402 may output a low-magnitude vibration with a short duration. This may allow a user 408 to determine the position of the user's finger on the virtual keyboard.
- the user interface may be configured to simulate physical interactions with real-world objects.
- the virtual object 406 may comprise a virtual brick.
- the user 408 may "grab" (e.g., select) the virtual object 406 by interacting with the virtual object 406 while applying a soft pressure.
- the computing device 402 may output a haptic effect.
- a haptic effect configured to simulate a brick (e.g., a simulated brick texture).
- the user 408 may drag the virtual object 406 to a new location, for example, by moving a finger along the touch-screen display 404 while applying firm pressure.
- the computing device 402 may output a haptic effect.
- a haptic effect configured to simulate moving a brick (e.g., a perceivable increase in a coefficient of friction on the surface of the touch-screen display 404).
- the user 408 may drop the virtual object 406 in a new location, for example, by releasing the firm pressure.
- the computing device 402 may output a haptic effect, for example, configured to simulate dropping a brick (e.g., a high- magnitude, short duration vibration).
- the computing device 402 may comprise a game.
- the game may comprise a virtual object 406 comprising bubble wrap.
- the computing device 402 may output a haptic effect.
- a haptic effect configured to simulate the feeling of bubble wrap (e.g., a simulated a plastic texture).
- the computing device 402 may output a haptic effect configured to simulate the bubbles popping (e.g., a high-magnitude, short duration vibration).
- the computing device 402 may also output one or more images of the bubble wrap popping and/or play a popping sound.
- FIG. 5 shows still another embodiment of a system for pressure-based haptic effects.
- the system 500 comprises a computing device 502.
- the computing device 502 comprises a smartphone, e-reader, or tablet.
- the computing device 502 also comprises a touch-screen display 504.
- the computing device 502 may output via the touch-screen display 504 a user interface comprising a plurality of virtual objects.
- a user 510 may interact with the touch-screen display 504 and/or the virtual objects.
- the computing device 502 is configured to categorize the pressure exerted by the user 510 on the computing device 502 into one of a plurality of pressure levels (e.g., no pressure, soft pressure, or firm pressure). In some embodiments, each pressure level may be associated with a user interface level.
- the user interface may be configured to provide information to a user.
- a user 510 may interact with (e.g., touch) a hyperlink associated with a virtual object 506.
- the user 510 may interact with the hyperlink using an amount of pressure associated with a user interface level, for instance, to perform a function.
- the user may interact with the hyperlink using soft pressure to view a preview of the associated webpage (e.g., in a popup bubble).
- the user may interact with the hyperlink using soft pressure to view other data (e.g., HTML or other code, website statistics or trends, or metadata encoded within the webpage content) associated with the webpage.
- the computing device 502 may output a haptic effect associated with the user interface level (e.g., a medium magnitude, medium duration vibration).
- the user 510 may interact with the hyperlink using another amount of pressure associated with another user interface level, for example, to perform another function.
- the user 510 may interact with the hyperlink using firm pressure.
- the firm pressure may cause the computing device 502 to open a browser window directed to the webpage associated with the hyperlink.
- the computing device 502 may output a haptic effect.
- a haptic effect configured to simulate a button press.
- the computing device 502 may output one or more haptic effects configured to simplify user interactions with the user interface. For example, in some embodiments, a user 510 may swipe a finger along the touch-screen display 504 using soft pressure to scroll through text. In some embodiments, the computing device 502 may output a haptic effect configured to decrease the coefficient of friction on the surface of the touchscreen display 504. Decreasing the coefficient of friction on the surface of the touch-screen display 504 may make it easier for a user to move a finger along the surface of the touchscreen display 504 to scroll through text.
- the user 510 may interact with a virtual object 506 using an amount of pressure (e.g., a firm pressure) associated with another user interface level to perform another function.
- a firm pressure e.g., a firm pressure
- the user 510 may interact with the virtual object 506 using firm pressure to select text.
- a haptic effect configured to notify the user 510 that the text has been selected (e.g., a medium magnitude, short duration vibration). This may prevent the user 510 from erroneously selecting or modifying text.
- the computing device 502 may display one or more new virtual objects 512 (or update the virtual object 508). For example, in some embodiments, the computing device 502 may output a tool tip (e.g., a popup configured to provide information to a user) upon the user interacting with a virtual object. The computing device 502 may also output a haptic effect. In some embodiments, if the user 510 applies additional pressure, the computing device 502 may change or update a virtual object 508 on the touch-screen display 504. For example, the computing device 502 may change the month output on the virtual calendar from December to January. In some embodiments, the computing device 502 may also output a haptic effect.
- a tool tip e.g., a popup configured to provide information to a user
- the user 510 may be able to interact with the new virtual object
- the computing device 502 may output additional textual information.
- the computing device 502 may also output a haptic effect.
- the computing device may play a sound or video (e.g., to provide additional non-textual information to a user).
- the user 510 may be able to interact with any number of virtual objects using an amount of pressure associated with one of any number of user interface levels.
- FIG. 6 shows yet another embodiment of a system for pressure-based haptic effects.
- the system 600 comprises a computing device 602.
- the computing device 602 comprises a desktop computer.
- the computing device 602 is in communication with a user input device 606 (e.g., a keyboard).
- the computing device 602 is also in communication with a touch sensitive surface 608.
- a user may interact with the computing device 602 via the user input device 606. Further, a user may interact with the computing device 602 by touching, gesturing on, or otherwise interacting with the touch sensitive surface 608.
- the computing device 602 further comprises a display 604.
- the computing device 602 may output a user interface comprising a virtual object 610 on the display 604.
- the computing device 602 is outputting a virtual object 610 comprising a peach.
- the computing device 602 may be configured to simulate interacting with the virtual object 610 at different depths or interacting with different surfaces of the virtual object 610. For instance, the user may interact with the virtual peach using soft pressure. In response, the computing device 602 may output a haptic effect associated the soft pressure. For example, the computing device 602 may output a haptic effect configured to simulate the fuzz or skin of the peach. Further, in some embodiments, the user may interact with the virtual object 610 using firm pressure. In response, the computing device 602 may output a haptic effect associated firm pressure.
- the computing device 602 may output a haptic effect configured to simulate the squishy or soft texture of the inside of a peach as the user presses into the peach.
- a haptic effect configured to simulate the squishy or soft texture of the inside of a peach as the user presses into the peach.
- a user may perceive different surfaces or depths of a virtual object 610 by interacting with a user interface using different pressures.
- the virtual object 610 may comprise a cardboard box filled with nails.
- a user may interact with the virtual cardboard box with soft pressure.
- the computing device 602 may output a haptic effect configured to simulate cardboard (e.g., a cardboard texture).
- the user may interact with the virtual cardboard box of nails using firm pressure.
- the computing device 602 may output a haptic effect configured to simulate the nails inside the cardboard box (e.g., a metal texture).
- the user may perceive both the outside and interior of the virtual cardboard box by interacting with the cardboard box using different amounts of pressure.
- the virtual object 610 may comprise one or more icons.
- a user may interact with an icon using soft pressure.
- the computing device 602 may perform a function, for example, the computing device 602 may highlight the icon.
- Highlighting the icon may alert the user that the icon can be activated (e.g., is clickable).
- the computing device 602 may also output a haptic effect, for example, configured to alert the user that the icon can be activated.
- the user may interact with the icon using firm pressure.
- the computing device 602 may perform a function, for example, the computing device 602 may open the program associated with the icon.
- the computing device 602 may output a haptic effect associated with the program or otherwise execute a command associated with activating the icon.
- the computing device 602 may output a haptic effect configured associated with the brand or manufacturer of the program.
- a user may be able to locate icons that can be activated without having to view the display 604. Further, the user may be able to open programs or execute other commands associated with the icons without having to view the display 604. Thus, the user may be free to concentrate on other activities while interacting with the user interface.
- FIG. 7 shows another embodiment of a system for pressure-based haptic effects.
- the system 700 comprises a computing device.
- the computing device comprises a car computer (e.g., a computer for controlling one or more automobile systems or devices).
- the system 700 comprises a touch-screen display 702.
- the computing device may output a user interface comprising one or more virtual objects via the touch-screen display 702.
- a user may provide input to the computing device by interacting with the touch- screen display 702.
- the system 700 may also comprise one or more touch sensitive buttons 704, joysticks, gear shifters, or other user interface devices.
- the computing device may output a user interface configured to allow a user to interact with the user interface without having to visually focus on the user interface.
- the computing device may output a user interface comprising a map (e.g., for navigation).
- a user may interact with the map using soft pressure.
- the computing device may detect the soft pressure and associate the soft pressure with a user interface level configured to, for example, turn on GPS navigation.
- the computing device may output an associated haptic effect.
- a haptic effect configured to confirm that the computing device has turned on navigation (e.g., a small-magnitude, short duration vibration).
- the user may interact with a point on the virtual map using firm pressure.
- the computing device may detect the firm pressure and associate the firm pressure with a user interface level configured to output information associated with the point.
- the information may comprise, for example, nearby gas stations, restaurants, movie theaters, police stations, or hospitals, or other information such as traffic conditions, speed limits, or town history.
- the computing device may output a haptic effect based at least in part on the content of the information. For example, if the information comprises a nearby gas station, the computing device may output a haptic effect configured to simulate the rumbling of a car engine (e.g., a low-magnitude, long duration vibration).
- the computing device may output a haptic effect configured to simulate "stop-and-go" traffic conditions (e.g., four medium-magnitude vibrations with short durations, spaced apart by equal time intervals).
- "stop-and-go" traffic conditions e.g., four medium-magnitude vibrations with short durations, spaced apart by equal time intervals.
- FIG. 8 is a flow chart of steps for performing a method for providing pressure-based haptic effects according to one embodiment.
- the steps in Figure 8 may be implemented in program code that is executed by a processor, for example, the processor in a general purpose computer, a mobile device, or a server. In some embodiments, these steps may be implemented by a group of processors. In some embodiments one or more steps shown in Figure 8 may be omitted or performed in a different order. Similarly, in some embodiments, additional steps not shown in Figure 8 may also be performed. The steps below are described with reference to components described above with regard to system 100 shown in Figure 1.
- a user may interact with the drawing application to draw a virtual picture.
- the user may interact with the drawing application, for example, by swiping a finger along the surface of the touch sensitive surface 1 16.
- the method 800 begins at step 802 when the processor 102 receives a sensor signal from the pressure sensor 132.
- the sensor signal may be associated with the amount of pressure with which a user may be interacting with a touch sensitive surface 116. For example, the user may swipe a finger along the touch sensitive surface 1 16 to perform a function associated with the drawing application, such as to draw a line.
- the pressure sensor 132 may detect an amount of pressure associated with the swipe and transmit the sensor signal to the processor 102.
- a pressure level comprises a range of pressures falling between two pressure thresholds.
- the processor 102 may determine if the detected pressure falls within a range of pressures associated with a pressure level (e.g., a soft pressure level or a firm pressure level). If so, the processor 102 may determine the pressure level. For example, if the detected pressure falls within the range of the soft pressure level, the processor 102 may determine the soft pressure level.
- the method 800 continues at step 806 when the processor 102 determines a user interface level based at least in part on the pressure level.
- the processor 102 may rely on programming contained in memory 104 to determine the user interface level.
- memory 104 may comprise a lookup table.
- the processor 102 may use the lookup table to associate pressure levels with particular user interface levels. For example, the processor 102 may consult the lookup table and associate the soft pressure level with a first user interface level.
- the processor 102 may associate a single pressure level with a user interface level. For example, the processor 102 may associate a soft pressure with a first user interface level and a firm pressure with a second user interface level. In other embodiments, the processor 102 may associate a plurality of pressure levels with a user interface level. For example, in some embodiments, the processor 102 may associate a soft pressure and a firm pressure with a single user interface level.
- the method continues at step 808 when the processor 102 performs a function associated with the user interface level and/or the user interaction. In some embodiments, the function may comprise outputting, removing, changing, updating, or deleting a virtual object in a user interface.
- the processor 102 may perform a function associated with the first user interface level and the user interaction.
- the function may comprise, for example, drawing a black line in the drawing application with a shape that mimics the path of the user's finger moving along the touch sensitive surface 1 16.
- the processor 102 may perform a function associated with the second user interface level and the user interaction.
- the function may comprise, for example, erasing a portion of the virtual picture associated with the user interaction.
- the function may comprise outputting audio data, video data, or information (e.g., a nearby gas station, restaurant, movie theater, police station, or hospital, or a traffic condition or a speed limit).
- the processor 102 may output audio data comprising instructions on how to use the drawing application.
- the function may comprise placing a telephone call; sending a text message, SMS message, or e-mail; opening a web browser or accessing a website; opening an application; performing background processing; performing foreground processing; saving a file; opening a file; performing a game function; receiving data; sending data; or any other number or configuration of computer functions.
- the processor 102 may save the virtual picture.
- the method continues at step 810 when the processor 102 changes a characteristic (e.g., visibility, type, size, shape, width, length, color, pattern, location, movement, or content) of a virtual object output on a display based at least in part on a user interaction. For instance, upon the user applying soft pressure to the touch sensitive surface 1 16, the processor 102 may change a cursor image associated with the user interaction from a default image to a paint brush. This may signify to the user that the user can draw a line using soft pressure. Further, upon the user applying firm pressure to the touch sensitive surface 1 16, the processor 102 may change a cursor image to an eraser. This may signify to the user that the user can erase a portion of the virtual image using firm pressure.
- a characteristic e.g., visibility, type, size, shape, width, length, color, pattern, location, movement, or content
- the method 800 continues at step 812 when the processor 102 determines a haptic effect based at least in part on the user interface level and the user interaction.
- the processor 102 may rely on programming contained in haptic effect determination module 126 to determine the haptic effect.
- the processor 102 may associate a plurality of haptic effects with each user interface level or user interaction.
- the processor 102 may associate a different haptic effect for each user interface level or user interaction.
- the processor 102 may associate the first user interface level with a haptic effect comprising a decrease in a perceivable coefficient of friction on the surface of touch sensitive surface 1 16. This may make drawing easier for the user, because the user may be able to more easily move a finger along the surface of touch sensitive surface 1 16.
- the processor 102 may associate a second user interface level with a haptic effect comprising a vibration. This may alert the user that a setting has change, which may be appropriate if the function associated with the second user interface level comprises, for example, changing a paint setting (e.g., changing the color of the paint tool).
- the processor 102 may determine the haptic effect based on the amount of pressure associated with a user interaction. For example, in some embodiments, the processor 102 may determine a haptic effect if the user interacts with the touch sensitive surface 1 16 below a pressure threshold. For instance, the processor 102 may determine a haptic effect comprising an electrostatic haptic effect (e.g., a change in a perceivable coefficient of friction) if the user interacts with the touch sensitive surface 1 16 with soft pressure. Further, in some embodiments, the processor 102 may determine a different haptic effect if the user interacts with the touch sensitive surface 1 16 above the pressure threshold.
- an electrostatic haptic effect e.g., a change in a perceivable coefficient of friction
- the processor 102 may determine a haptic effect comprising a vibration if the user interacts with the touch sensitive surface 116 with firm pressure.
- the processor 102 may output different haptic effects based on the amount of pressure because the quality of a haptic effect as perceived by the user may change with pressure. For example, the quality of an electrostatic haptic effect may be perceived as worse by a user if the user applies more pressure to the touch sensitive surface 1 16.
- the processor 102 may determine the haptic effect based in part on a signal from the touch sensor 108, the sensor 130, an event, or an algorithm.
- An event as used herein, is any interaction, action, collision, or other event which occurs during operation of the device which can potentially comprise an associated haptic effect.
- an event may comprise user input (e.g., a button press, manipulating a joystick, interacting with a touch-sensitive surface, tilting or orienting the user interface device), a system status (e.g., low battery, low memory, or a system notification, such as a notification generated based on the system receiving an incoming call), sending data, receiving data, or a program event (e.g., if the program is a game, a program event may comprise explosions, gunshots, collisions, interactions between game characters, advancing to a new level, or driving over bumpy terrain).
- the processor 102 may associate an incoming call with a haptic effect comprising a vibration.
- the processor 102 may determine a haptic effect comprising a low-magnitude vibration. If the user is contacting the phone during the incoming call with an amount of pressure associated with another user interface level, the processor 102 may determine a different haptic effect, for example, a haptic effect comprising a high-magnitude vibration.
- haptic effect determination module 126 may comprise a lookup table.
- processor 102 may use the lookup table to associate events, user interactions, or user interface levels with particular haptic effects (e.g., textures).
- the lookup table may comprise data associated with features of a user interface or user interface levels and a plurality of available haptic effects.
- the lookup table may comprise data associated with user interactions with a user interface, such as sliding a user's finger over a virtual button, and a plurality of available haptic effects.
- the processor 102 may consult the lookup table.
- the processor 102 may determine a haptic effect to be output by the haptic output device 118 wherein the perceived coefficient of friction on the touch sensitive surface 116 is increased.
- the amount of the increase may be based on the user interface level.
- the plurality of available haptic effects may comprise a plurality of textures.
- the plurality of textures may comprise one or more of the textures of: sand, glass, ice, rubber, water, or any other available texture.
- users may have "haptic profiles" in which a user can determine and save in memory 104 a "profile" of the haptic effects the user would like associated with particular events, user interactions, and/or user interface levels.
- a user can select from a list of available haptic effects and associate one or more of these haptic effects with a user interaction.
- the list may comprise, for example, haptic effects such as a fast flow sensation, slow flow sensation, intense vibration, light vibration, or textures such as bumpy, rubbery, or smooth.
- the user may associate multiple haptic effects with a particular virtual object and, in some embodiments, each haptic effect may be associated with a different user interaction.
- the processor 102 may consult with the user's haptic profile to determine which haptic effect to generate. For example, if the user's haptic profile associates a swipe along a virtual slider with a vibration, in response to the user swiping along the virtual slider, the processor 102 may determine a haptic effect in which the user perceives a vibration.
- the processor 102 determines a characteristic of a virtual object.
- the characteristic may comprise the visibility, type, size, shape, width, length, color, pattern, location, movement, or content of the virtual object.
- the processor 102 may determine a characteristic of a virtual object with which a user has interacted, for example, via touch sensitive surface 1 16. For example, the processor 102 may determine one or more colors associated with virtual picture drawn by the user. For instance, the processor 102 may determine that the colors associated with the virtual picture are orange and blue.
- the method continues at step 816 when the processor 102 determines a haptic effect based at least in part on the characteristic of the virtual object.
- the processor 102 may determine a haptic effect based at least in part on the visibility, type, size, shape, width, length, color, pattern, location, movement, or content of the virtual object.
- the processor 102 may use any of the methods (e.g., an algorithm, haptic profile, or lookup table) described with respect to step 812 to determine the haptic effect based at least in part on the characteristic of the virtual object.
- the processor 102 may consult a lookup table and associate the mix of orange and blue colors with a haptic effect comprising a vibration. This may signify to the user that orange and blue may not be aesthetically pleasing together.
- the method 800 continues at step 818 when the processor 102 generates a haptic signal associated with the haptic effect.
- the haptic signal is based at least in part on the haptic effect.
- the processor 102 may access drive signals stored in memory 104 and associated with particular haptic effects.
- a signal is generated by accessing a stored algorithm and inputting parameters associated with a haptic effect.
- an algorithm may output data for use in generating a drive signal based on amplitude and frequency parameters.
- a haptic signal may comprise data to be decoded by the actuator.
- the actuator may itself respond to commands specifying parameters such as amplitude and frequency.
- the haptic signal may be analog or digital.
- the method 800 continues at step 820 when the processor 102 transmits the haptic signal to a haptic output device 118.
- the haptic output device 118 is configured to receive the haptic signal and output the haptic effect.
- the haptic output device 1 18 may receive a haptic signal and output a haptic effect comprising, for example, a decrease in a perceivable coefficient of friction on the touch sensitive surface 1 16 and/or a vibration.
- haptic effects may, for example, make drawing easier for the user, or alert the user to colors in the user's virtual picture that may not be aesthetically pleasing together.
- Such systems may allow the user to make a state determination (e.g., determine the mode a device is in) without looking at the device.
- a state determination e.g., determine the mode a device is in
- the user may be able to maintain focus on other tasks.
- a user may be able to make determinations with regard to available operations in a program or on a user interface, without having to visually focus on the display.
- a haptic effect may serve as a confirmation that an operation is available, has been completed, or is of a certain level of importance.
- pressure-based haptic effects may allow for more unique, interactive, and effective user interfaces.
- a user may be able to perform a broader range of functions while interacting with a single user interface component by applying varying amounts of pressure to the user interface component.
- a user may be able to locate the position of a user interface component using one amount of pressure (e.g., soft pressure) and activate the user interface component by using another amount of pressure (e.g., firm pressure).
- one amount of pressure e.g., soft pressure
- another amount of pressure e.g., firm pressure
- the user may be able to locate user interface components and execute associated functions without having to remove the user's finger from the user interface.
- This is unlike a traditional user interface, in which a user may have to remove their finger from the user interface and to perform a tap to activate a user interface component.
- Such tapping can be challenging, for example, in a moving vehicle, in which ambient motion, cognitive load, and visual distractions may make it difficult to precisely tap on a user interface component.
- pressure-based haptic effects may enable non-visual interfaces.
- a user may be able explore a non-visual user interface with the user's finger using an amount of pressure associated with a user interface level.
- the computing device may output haptic feedback. This may allow the user to identify the location of the invisible interface component.
- the user may be able to interact with (e.g., press on) the interface component with an amount of pressure associated with another user interface level, for example, to perform a function associated with the invisible interface component (e.g., increasing a volume).
- the system may perform the function and/or provide the user with haptic feedback, for example, to confirm receipt of the user input.
- pressure-based haptic effects may provide a more realistic or immersive user experience.
- a user may interact with a virtual object using an amount of pressure associated with a pressure level.
- the user may receive haptic feedback configured to simulate a surface (e.g., the outside of a piece of fruit) associated with the virtual object.
- the user may further interact with the virtual object using an amount of pressure associated with another pressure level.
- the user may receive haptic feedback configured to simulate a different surface (e.g., the inside of a piece of fruit) associated with the virtual object. In some embodiments, this may make the virtual object feel more realistic and/or three-dimensional.
- haptic effects by associating different haptic effects with different pressure levels, a user may be able to perceive a plurality of haptic effects while interacting with a single virtual object. This may allow for a greater range of haptic experiences.
- pressure-based haptic effects may provide a safer user experience. For example, with traditional touch sensitive interfaces, it may be difficult for a user to determine how much pressure to exert (or how much pressure the user is exerting) when interacting with a touch sensitive surface so that the computing device registers the user input. This may cause a user to interact with the touch sensitive surface with a high amount of pressure, which may damage the touch sensitive surface, injure the user, or cause fatigue or strain. In some embodiments, however, pressure-based haptic effects may notify a user that the computing device has received the user input or that the user has interacted with a virtual object with the correct amount of pressure. Thus, the user may interact with the touch sensitive surface using less overall pressure, thereby preventing injury to the user or damage to the computing device.
- pressure-based haptic effects may allow computing devices to replace conventional switches. This may allow computing devices to operate as multifunction controllers and/or to be used in previously unused places.
- using computing devices as multifunction controllers or in previously unused places may reduce costs and increase overall user satisfaction.
- configurations may be described as a process that is depicted as a flow diagram or block diagram. Although each may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be rearranged. A process may have additional steps not included in the figure.
- examples of the methods may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments to perform the necessary tasks may be stored in a non-transitory computer-readable medium such as a storage medium. Processors may perform the described tasks.
- a computer may comprise a processor or processors.
- the processor comprises or has access to a computer-readable medium, such as a random access memory (RAM) coupled to the processor.
- RAM random access memory
- the processor executes computer- executable program instructions stored in memory, such as executing one or more computer programs including a sensor sampling routine, selection routines, and other routines to perform the methods described above.
- Such processors may comprise a microprocessor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), field programmable gate arrays (FPGAs), and state machines.
- Such processors may further comprise programmable electronic devices such as PLCs, programmable interrupt controllers (PICs), programmable logic devices (PLDs), programmable read-only memories (PROMs), electronically programmable read-only memories (EPROMs or EEPROMs), or other similar devices.
- Such processors may comprise, or may be in communication with, media, for example tangible computer-readable media, that may store instructions that, when executed by the processor, can cause the processor to perform the steps described herein as carried out, or assisted, by a processor.
- Embodiments of computer-readable media may comprise, but are not limited to, all electronic, optical, magnetic, or other storage devices capable of providing a processor, such as the processor in a web server, with computer-readable instructions.
- Other examples of media comprise, but are not limited to, a floppy disk, CD-ROM, magnetic disk, memory chip, ROM, RAM, ASIC, configured processor, all optical media, all magnetic tape or other magnetic media, or any other medium from which a computer processor can read.
- various other devices may comprise computer-readable media, such as a router, private or public network, or other transmission device.
- the processor, and the processing, described may be in one or more structures, and may be dispersed through one or more structures.
- the processor may comprise code for carrying out one or more of the methods (or parts of methods) described herein.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201480033405.3A CN105556423B (en) | 2013-06-11 | 2014-06-11 | System and method for the haptic effect based on pressure |
EP14737403.7A EP3008550A1 (en) | 2013-06-11 | 2014-06-11 | Systems and methods for pressure-based haptic effects |
JP2016519620A JP6538657B2 (en) | 2013-06-11 | 2014-06-11 | System and method for pressure based haptic effects |
KR1020157036716A KR20160019468A (en) | 2013-06-11 | 2014-06-11 | Systems and methods for pressure-based haptic effects |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361833626P | 2013-06-11 | 2013-06-11 | |
US61/833,626 | 2013-06-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014201151A1 true WO2014201151A1 (en) | 2014-12-18 |
Family
ID=51168386
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2014/041964 WO2014201151A1 (en) | 2013-06-11 | 2014-06-11 | Systems and methods for pressure-based haptic effects |
Country Status (6)
Country | Link |
---|---|
US (4) | US9632581B2 (en) |
EP (2) | EP3008550A1 (en) |
JP (2) | JP6538657B2 (en) |
KR (1) | KR20160019468A (en) |
CN (2) | CN105556423B (en) |
WO (1) | WO2014201151A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016126785A (en) * | 2014-12-31 | 2016-07-11 | ハーマン インターナショナル インダストリーズ インコーポレイテッド | Feedback by modifying stiffness |
EP3270262A1 (en) | 2016-07-12 | 2018-01-17 | Vestel Elektronik Sanayi ve Ticaret A.S. | Touch-screen control device with haptic feedback |
US10198073B2 (en) | 2016-09-06 | 2019-02-05 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
Families Citing this family (74)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9939900B2 (en) | 2013-04-26 | 2018-04-10 | Immersion Corporation | System and method for a haptically-enabled deformable surface |
JP6335613B2 (en) * | 2013-04-26 | 2018-05-30 | イマージョン コーポレーションImmersion Corporation | System and method for tactile enabled adaptive and multi-faceted display |
US9632581B2 (en) | 2013-06-11 | 2017-04-25 | Immersion Corporation | Systems and methods for pressure-based haptic effects |
US9443401B2 (en) | 2013-09-06 | 2016-09-13 | Immersion Corporation | Automatic remote sensing and haptic conversion system |
JP6351964B2 (en) * | 2013-12-11 | 2018-07-04 | 株式会社東海理化電機製作所 | Input device |
JP2015114836A (en) * | 2013-12-11 | 2015-06-22 | キヤノン株式会社 | Image processing device, tactile control method, and program |
JP6062573B2 (en) * | 2014-01-30 | 2017-01-18 | 京セラドキュメントソリューションズ株式会社 | Touch panel device and touch panel control method |
WO2015121970A1 (en) * | 2014-02-14 | 2015-08-20 | 富士通株式会社 | Educational tactile device and system |
WO2015143121A1 (en) | 2014-03-21 | 2015-09-24 | Immersion Corporation | System, method and computer-readable medium for force-based object manipulation and haptic sensations |
US9432498B2 (en) | 2014-07-02 | 2016-08-30 | Sony Corporation | Gesture detection to pair two wearable devices and perform an action between them and a wearable device, a method and a system using heat as a means for communication |
US9690381B2 (en) | 2014-08-21 | 2017-06-27 | Immersion Corporation | Systems and methods for shape input and output for a haptically-enabled deformable surface |
US10146308B2 (en) | 2014-10-14 | 2018-12-04 | Immersion Corporation | Systems and methods for impedance coupling for haptic devices |
WO2016081425A1 (en) * | 2014-11-17 | 2016-05-26 | Thika Holdings Llc | Device for intuitive dexterous touch and feel interaction in virtual worlds |
US9535550B2 (en) | 2014-11-25 | 2017-01-03 | Immersion Corporation | Systems and methods for deformation-based haptic effects |
US9658693B2 (en) * | 2014-12-19 | 2017-05-23 | Immersion Corporation | Systems and methods for haptically-enabled interactions with objects |
US9763628B2 (en) | 2014-12-31 | 2017-09-19 | Immersion Corporation | Systems and methods for providing enhanced haptic feedback |
KR101681893B1 (en) * | 2015-07-03 | 2016-12-05 | (주)이미지스테크놀로지 | Touch screen device realigning touch pressure by user's standard |
US20170060241A1 (en) * | 2015-08-26 | 2017-03-02 | Fujitsu Ten Limited | Input device, display device, method of controlling input device, and program |
EP3320415A4 (en) * | 2015-09-22 | 2019-03-06 | Immersion Corporation | Pressure-based haptics |
KR102468314B1 (en) * | 2015-10-21 | 2022-11-17 | 삼성전자주식회사 | Method and eletronic device for providing user interface |
US9990078B2 (en) | 2015-12-11 | 2018-06-05 | Immersion Corporation | Systems and methods for position-based haptic effects |
KR102462941B1 (en) * | 2016-01-26 | 2022-11-03 | 삼성디스플레이 주식회사 | Display device |
CN108604157A (en) * | 2016-02-04 | 2018-09-28 | 华为技术有限公司 | A kind of method and electronic equipment of information processing |
JP2017149225A (en) | 2016-02-23 | 2017-08-31 | 京セラ株式会社 | Control unit for vehicle |
US9898903B2 (en) | 2016-03-07 | 2018-02-20 | Immersion Corporation | Systems and methods for haptic surface elements |
US11460926B2 (en) | 2016-03-31 | 2022-10-04 | Sensel, Inc. | Human-computer interface system |
US10564839B2 (en) | 2016-03-31 | 2020-02-18 | Sensel Inc. | Method for detecting and characterizing inputs on a touch sensor surface |
US11422631B2 (en) | 2016-03-31 | 2022-08-23 | Sensel, Inc. | Human-computer interface system |
WO2017173386A1 (en) | 2016-03-31 | 2017-10-05 | Sensel Inc. | Human-computer interface system |
US10866642B2 (en) | 2016-03-31 | 2020-12-15 | Sensel Inc. | System and method for detecting and responding to touch inputs with haptic feedback |
KR101886209B1 (en) * | 2016-04-19 | 2018-08-08 | (주)휴맥스 | Apparatus and method of providing media service |
CN107305467A (en) * | 2016-04-20 | 2017-10-31 | 富泰华工业(深圳)有限公司 | Haptic interaction system, method and electronic installation |
US9983675B2 (en) * | 2016-06-10 | 2018-05-29 | Immersion Corporation | Systems and methods for monitoring insulation integrity for electrostatic friction |
US10401962B2 (en) | 2016-06-21 | 2019-09-03 | Immersion Corporation | Haptically enabled overlay for a pressure sensitive surface |
US20170371415A1 (en) * | 2016-06-28 | 2017-12-28 | Intel Corporation | Tactile user interface |
JP2018018205A (en) * | 2016-07-26 | 2018-02-01 | 株式会社デンソーテン | Input system for determining position on screen of display means, detection device, control device, program, and method |
KR102573234B1 (en) * | 2016-08-02 | 2023-08-31 | 삼성전자주식회사 | Electronic Device for Employing Full Front Screen |
CN109564497A (en) * | 2016-08-05 | 2019-04-02 | 索尼公司 | Information processing equipment, information processing method and program |
US10296091B2 (en) | 2016-10-13 | 2019-05-21 | Immersion Corporation | Contextual pressure sensing haptic responses |
US11175738B2 (en) * | 2016-12-13 | 2021-11-16 | Immersion Corporation | Systems and methods for proximity-based haptic feedback |
WO2018112466A1 (en) * | 2016-12-16 | 2018-06-21 | Sensel Inc. | System for human-computer interfacing |
DE102016225534B4 (en) * | 2016-12-20 | 2018-08-02 | Audi Ag | Operating device for a motor vehicle with a force sensor and an actuator device, and method for operating the operating device, control device, and motor vehicle |
US10055949B2 (en) * | 2017-01-05 | 2018-08-21 | Immersion Corporation | Adjustable haptic wearables |
CN106919282A (en) * | 2017-02-10 | 2017-07-04 | 南昌欧菲显示科技有限公司 | Tactile feedback display screen |
EP3385831A1 (en) | 2017-04-04 | 2018-10-10 | Lg Electronics Inc. | Mobile terminal |
TWI670639B (en) | 2017-05-18 | 2019-09-01 | 美商愛特梅爾公司 | Techniques for identifying user interface elements and systems and devices using the same |
JP6802760B2 (en) * | 2017-06-12 | 2020-12-16 | アルプスアルパイン株式会社 | User interface device, display control method and program |
KR102406072B1 (en) * | 2017-06-13 | 2022-06-10 | 삼성전자주식회사 | Electronic apparatus and method for controlling operations the electronic apparatus based on pressure inputs |
US10969870B2 (en) * | 2017-07-10 | 2021-04-06 | Sharp Kabushiki Kaisha | Input device |
CN111133404B (en) * | 2017-07-31 | 2024-02-20 | Keba工业自动化有限责任公司 | Industrial operation panel |
WO2019023726A1 (en) * | 2017-07-31 | 2019-02-07 | Keba Ag | Industrial operating panel |
EP3447613A3 (en) * | 2017-08-22 | 2019-03-13 | InterDigital CE Patent Holdings | Haptic immersive device with touch surfaces for virtual object creation |
US11061556B2 (en) * | 2018-01-12 | 2021-07-13 | Microsoft Technology Licensing, Llc | Computer device having variable display output based on user input with variable time and/or pressure patterns |
US10684689B2 (en) * | 2018-04-20 | 2020-06-16 | Immersion Corporation | Cross-platform dynamic haptic effect design tool for augmented or virtual reality environments |
US10613645B2 (en) * | 2018-04-27 | 2020-04-07 | Microsoft Technology Licensing, Llc | Mechanism for pen interoperability with pressure sensor design |
US10649532B2 (en) * | 2018-06-15 | 2020-05-12 | Immersion Corporation | Systems and methods for multi-rate control of haptic effects with sensor fusion |
KR20200023932A (en) * | 2018-08-27 | 2020-03-06 | 삼성전자주식회사 | Electronic apparatus and controlling method thereof |
US10775894B2 (en) * | 2018-11-02 | 2020-09-15 | Immersion Corporation | Systems and methods for providing customizable haptic playback |
JP7141927B2 (en) * | 2018-11-26 | 2022-09-26 | ホシデン株式会社 | Vibration imparting device and vibration control method |
CN109669612A (en) * | 2018-11-29 | 2019-04-23 | 惠州Tcl移动通信有限公司 | Method for controlling mobile terminal, device, mobile terminal and storage medium |
CN113168229A (en) * | 2018-12-07 | 2021-07-23 | 索尼集团公司 | Tactile sensing and temperature feedback system |
CN109621410A (en) * | 2018-12-29 | 2019-04-16 | 努比亚技术有限公司 | A kind of game control method, terminal and computer readable storage medium |
WO2020153116A1 (en) * | 2019-01-21 | 2020-07-30 | ソニー株式会社 | Information processing device, information processing method, and program |
JP7309466B2 (en) * | 2019-06-11 | 2023-07-18 | キヤノン株式会社 | Electronic equipment and its control method |
US11820215B2 (en) * | 2019-11-04 | 2023-11-21 | Hyundai Mobis Co., Ltd. | System and method for controlling display of vehicle |
WO2021091567A1 (en) * | 2019-11-08 | 2021-05-14 | Hewlett-Packard Development Company, L.P. | Keyboards with haptic outputs |
CN111158474B (en) * | 2019-12-19 | 2021-10-22 | 维沃移动通信有限公司 | Interaction method and electronic equipment |
CN111796709B (en) * | 2020-06-02 | 2023-05-26 | 南京信息工程大学 | Method for reproducing image texture features on touch screen |
US11880506B2 (en) | 2020-10-06 | 2024-01-23 | Sensel, Inc. | Haptic keyboard system |
TWI796891B (en) * | 2021-05-05 | 2023-03-21 | 寶德科技股份有限公司 | Joystick assembly and game controller |
US11745101B2 (en) | 2021-09-11 | 2023-09-05 | Sony Interactive Entertainment Inc. | Touch magnitude identification as input to game |
WO2023126660A1 (en) * | 2021-12-29 | 2023-07-06 | Bosch Car Multimedia Portugal S.A | Haptic and thermal feedback touchpad device, system and method thereof for an automotive setting |
WO2023126664A1 (en) * | 2021-12-29 | 2023-07-06 | Bosch Car Multimedia Portugal S.A | System and method for providing a web browser online user interface with haptic feedback for an automotive setting |
WO2023126665A1 (en) * | 2021-12-29 | 2023-07-06 | Bosch Car Multimedia Portugal S.A | Device and method for providing an e-reader interactive surface with haptic feedback for an automotive setting |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1965291A2 (en) * | 2001-11-01 | 2008-09-03 | Immersion Corporation | Method and apparatus for haptic feedback with a rocker switch |
US20090140989A1 (en) * | 2007-12-04 | 2009-06-04 | Nokia Corporation | User interface |
EP2590067A2 (en) * | 2011-11-07 | 2013-05-08 | Immersion Corporation | Systems and methods for multi-pressure interaction on touch-sensitive surfaces |
Family Cites Families (67)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030040361A1 (en) * | 1994-09-21 | 2003-02-27 | Craig Thorner | Method and apparatus for generating tactile feedback via relatively low-burden and/or zero burden telemetry |
DE69622101T2 (en) | 1995-03-13 | 2003-02-13 | Koninkl Philips Electronics Nv | 3-D INPUT BY VERTICAL SHIFTING OF MOUSE OR ROLLER BALL |
US6147684A (en) | 1998-02-06 | 2000-11-14 | Sun Microysytems, Inc. | Techniques for navigating layers of a user interface |
US7084869B2 (en) * | 2000-03-31 | 2006-08-01 | Massachusetts Institute Of Technology | Methods and apparatus for detecting and correcting penetration between objects |
US7535454B2 (en) * | 2001-11-01 | 2009-05-19 | Immersion Corporation | Method and apparatus for providing haptic feedback |
US6904823B2 (en) * | 2002-04-03 | 2005-06-14 | Immersion Corporation | Haptic shifting devices |
US6812833B2 (en) | 2002-04-12 | 2004-11-02 | Lear Corporation | Turn signal assembly with tactile feedback |
DE50307577D1 (en) | 2002-09-03 | 2007-08-09 | Daimler Chrysler Ag | DEVICE AND METHOD FOR RADIO-BASED HAZARD WARNING |
US8164573B2 (en) * | 2003-11-26 | 2012-04-24 | Immersion Corporation | Systems and methods for adaptive interpretation of input from a touch-sensitive input device |
US7205981B2 (en) * | 2004-03-18 | 2007-04-17 | Immersion Corporation | Method and apparatus for providing resistive haptic feedback using a vacuum source |
JP2005332063A (en) * | 2004-05-18 | 2005-12-02 | Sony Corp | Input device with tactile function, information inputting method, and electronic device |
US7385308B2 (en) * | 2005-09-26 | 2008-06-10 | Visteon Global Technologies, Inc. | Advanced automotive control switches |
US7714701B2 (en) | 2005-11-16 | 2010-05-11 | Gm Global Technology Operations, Inc. | Active material based haptic alert system |
US20070244641A1 (en) | 2006-04-17 | 2007-10-18 | Gm Global Technology Operations, Inc. | Active material based haptic communication systems |
US7603228B2 (en) * | 2006-05-25 | 2009-10-13 | Ford Global Technologies, Llc | Haptic apparatus and coaching method for improving vehicle fuel economy |
JP2008033739A (en) * | 2006-07-31 | 2008-02-14 | Sony Corp | Touch screen interaction method and apparatus based on tactile force feedback and pressure measurement |
CN101675410A (en) * | 2007-02-23 | 2010-03-17 | Tp-I股份有限公司 | Virtual keyboard input system using pointing apparatus in digial device |
KR20090019161A (en) | 2007-08-20 | 2009-02-25 | 삼성전자주식회사 | Electronic device and method for operating the same |
US20090259359A1 (en) * | 2008-04-09 | 2009-10-15 | David Michael Whitton | Variable intensity haptic level control based on vehicle conditions |
JP2010015551A (en) * | 2008-06-03 | 2010-01-21 | Univ Of Electro-Communications | Tactile information presentation device and tactile information presenting system |
EP3258361B1 (en) * | 2008-07-01 | 2020-08-12 | LG Electronics Inc. -1- | Mobile terminal using pressure sensor and method of controlling the mobile terminal |
KR101495559B1 (en) | 2008-07-21 | 2015-02-27 | 삼성전자주식회사 | The method for inputing user commond and the electronic apparatus thereof |
KR101569176B1 (en) * | 2008-10-30 | 2015-11-20 | 삼성전자주식회사 | Method and Apparatus for executing an object |
US8547244B2 (en) | 2008-12-22 | 2013-10-01 | Palm, Inc. | Enhanced visual feedback for touch-sensitive input device |
US9696803B2 (en) * | 2009-03-12 | 2017-07-04 | Immersion Corporation | Systems and methods for friction displays and additional haptic effects |
CN102349038B (en) * | 2009-03-12 | 2016-08-24 | 意美森公司 | System and method for grain engine |
US9927873B2 (en) | 2009-03-12 | 2018-03-27 | Immersion Corporation | Systems and methods for using textures in graphical user interface widgets |
US9746923B2 (en) | 2009-03-12 | 2017-08-29 | Immersion Corporation | Systems and methods for providing features in a friction display wherein a haptic effect is configured to vary the coefficient of friction |
US8248270B2 (en) * | 2009-04-09 | 2012-08-21 | Verne Nieves | Tactile warning system for a vehicle |
CA2761700C (en) * | 2009-07-24 | 2014-12-02 | Research In Motion Limited | Method and apparatus for a touch-sensitive display |
EP2461236B1 (en) * | 2009-07-29 | 2015-12-16 | Kyocera Corporation | Input apparatus and control method of input apparatus |
JP2011048686A (en) * | 2009-08-27 | 2011-03-10 | Kyocera Corp | Input apparatus |
JP2011053974A (en) | 2009-09-02 | 2011-03-17 | Sony Corp | Device and method for controlling operation, and computer program |
US10068728B2 (en) * | 2009-10-15 | 2018-09-04 | Synaptics Incorporated | Touchpad with capacitive force sensing |
US8633916B2 (en) * | 2009-12-10 | 2014-01-21 | Apple, Inc. | Touch pad with force sensors and actuator feedback |
JP5766398B2 (en) * | 2009-12-21 | 2015-08-19 | 京セラ株式会社 | Tactile presentation device |
JP5635274B2 (en) * | 2010-01-27 | 2014-12-03 | 京セラ株式会社 | Tactile sensation presentation apparatus and tactile sensation presentation method |
US20110248930A1 (en) | 2010-04-08 | 2011-10-13 | Research In Motion Limited | Portable electronic device and method of controlling same to provide tactile feedback |
JP2011242386A (en) * | 2010-04-23 | 2011-12-01 | Immersion Corp | Transparent compound piezoelectric material aggregate of contact sensor and tactile sense actuator |
US20110267294A1 (en) | 2010-04-29 | 2011-11-03 | Nokia Corporation | Apparatus and method for providing tactile feedback for user |
US20120327006A1 (en) * | 2010-05-21 | 2012-12-27 | Disney Enterprises, Inc. | Using tactile feedback to provide spatial awareness |
US8576171B2 (en) * | 2010-08-13 | 2013-11-05 | Immersion Corporation | Systems and methods for providing haptic feedback to touch-sensitive input devices |
US8754854B1 (en) | 2010-09-28 | 2014-06-17 | Google Inc. | Keyboard integrated with trackpad |
US20120146955A1 (en) | 2010-12-10 | 2012-06-14 | Research In Motion Limited | Systems and methods for input into a portable electronic device |
WO2012108203A1 (en) | 2011-02-10 | 2012-08-16 | 京セラ株式会社 | Electronic device and method of controlling same |
JP2012221074A (en) * | 2011-04-06 | 2012-11-12 | Sony Corp | Operation device |
US20140185834A1 (en) * | 2011-04-11 | 2014-07-03 | Nokia Corporation | Volume control apparatus |
KR101349278B1 (en) | 2011-06-07 | 2014-01-15 | 엘지전자 주식회사 | Mobile communication terminal and operation method thereof |
WO2013015070A1 (en) * | 2011-07-22 | 2013-01-31 | Kddi株式会社 | User interface device capable of image scrolling not accompanying finger movement, image scrolling method, and program |
US9417754B2 (en) * | 2011-08-05 | 2016-08-16 | P4tents1, LLC | User interface system, method, and computer program product |
JP5613126B2 (en) * | 2011-09-09 | 2014-10-22 | Kddi株式会社 | User interface device, target operation method and program capable of operating target in screen by pressing |
JP2013070303A (en) | 2011-09-26 | 2013-04-18 | Kddi Corp | Photographing device for enabling photographing by pressing force to screen, photographing method and program |
US9383000B2 (en) * | 2011-11-11 | 2016-07-05 | Volkswagen Ag | Gearshift knob and method for operating a vehicle |
US8922507B2 (en) | 2011-11-17 | 2014-12-30 | Google Inc. | Providing information through tactile feedback |
US8600450B2 (en) | 2011-12-28 | 2013-12-03 | Sony Corporation | Receiving user input on a graphical user interface |
GB201200587D0 (en) | 2012-01-13 | 2012-02-29 | Hiwave Technologies Uk Ltd | Haptic feedback and pressure sensing |
WO2013169305A1 (en) * | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Haptic feedback with improved ouput response |
US20140002374A1 (en) * | 2012-06-29 | 2014-01-02 | Lenovo (Singapore) Pte. Ltd. | Text selection utilizing pressure-sensitive touch |
KR101946365B1 (en) | 2012-08-20 | 2019-02-11 | 엘지전자 주식회사 | Display device and Method for controlling the same |
KR20140029834A (en) * | 2012-08-30 | 2014-03-11 | 한국전자통신연구원 | Haptic feedback apparatus for vehicle and method using the same |
US9046925B2 (en) * | 2012-09-11 | 2015-06-02 | Dell Products L.P. | Method for using the GPU to create haptic friction maps |
US9330544B2 (en) | 2012-11-20 | 2016-05-03 | Immersion Corporation | System and method for simulated physical interactions with haptic effects |
US20140277614A1 (en) * | 2013-03-15 | 2014-09-18 | Caterpillar Inc. | Programmable user interface for a machine |
US9163718B2 (en) * | 2013-04-24 | 2015-10-20 | Ford Global Technologies, Llc | Haptic feedback shift knob |
US9632581B2 (en) | 2013-06-11 | 2017-04-25 | Immersion Corporation | Systems and methods for pressure-based haptic effects |
US9729730B2 (en) | 2013-07-02 | 2017-08-08 | Immersion Corporation | Systems and methods for perceptual normalization of haptic effects |
US9251630B2 (en) | 2013-12-17 | 2016-02-02 | At&T Intellectual Property I, L.P. | Method, computer-readable storage device and apparatus for exchanging vehicle information |
-
2014
- 2014-06-11 US US14/302,147 patent/US9632581B2/en not_active Expired - Fee Related
- 2014-06-11 CN CN201480033405.3A patent/CN105556423B/en not_active Expired - Fee Related
- 2014-06-11 JP JP2016519620A patent/JP6538657B2/en not_active Expired - Fee Related
- 2014-06-11 EP EP14737403.7A patent/EP3008550A1/en not_active Withdrawn
- 2014-06-11 EP EP16191529.3A patent/EP3144780A1/en not_active Withdrawn
- 2014-06-11 CN CN201811569314.8A patent/CN110109534A/en active Pending
- 2014-06-11 KR KR1020157036716A patent/KR20160019468A/en not_active Application Discontinuation
- 2014-06-11 WO PCT/US2014/041964 patent/WO2014201151A1/en active Application Filing
-
2017
- 2017-03-17 US US15/462,248 patent/US9939904B2/en not_active Expired - Fee Related
-
2018
- 2018-02-27 US US15/905,903 patent/US10488931B2/en not_active Expired - Fee Related
- 2018-08-23 US US16/110,527 patent/US20190018490A1/en not_active Abandoned
-
2019
- 2019-06-06 JP JP2019106318A patent/JP2019194872A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1965291A2 (en) * | 2001-11-01 | 2008-09-03 | Immersion Corporation | Method and apparatus for haptic feedback with a rocker switch |
US20090140989A1 (en) * | 2007-12-04 | 2009-06-04 | Nokia Corporation | User interface |
EP2590067A2 (en) * | 2011-11-07 | 2013-05-08 | Immersion Corporation | Systems and methods for multi-pressure interaction on touch-sensitive surfaces |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016126785A (en) * | 2014-12-31 | 2016-07-11 | ハーマン インターナショナル インダストリーズ インコーポレイテッド | Feedback by modifying stiffness |
EP3270262A1 (en) | 2016-07-12 | 2018-01-17 | Vestel Elektronik Sanayi ve Ticaret A.S. | Touch-screen control device with haptic feedback |
US10198073B2 (en) | 2016-09-06 | 2019-02-05 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
US10228765B2 (en) | 2016-09-06 | 2019-03-12 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
US10303252B2 (en) | 2016-09-06 | 2019-05-28 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
US10712826B2 (en) | 2016-09-06 | 2020-07-14 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
US11009960B2 (en) | 2016-09-06 | 2021-05-18 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
US11320910B2 (en) | 2016-09-06 | 2022-05-03 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
US11635818B2 (en) | 2016-09-06 | 2023-04-25 | Apple Inc. | Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button |
Also Published As
Publication number | Publication date |
---|---|
KR20160019468A (en) | 2016-02-19 |
US20140362014A1 (en) | 2014-12-11 |
EP3008550A1 (en) | 2016-04-20 |
US20170192510A1 (en) | 2017-07-06 |
JP2019194872A (en) | 2019-11-07 |
US10488931B2 (en) | 2019-11-26 |
CN105556423A (en) | 2016-05-04 |
EP3144780A1 (en) | 2017-03-22 |
JP2016521891A (en) | 2016-07-25 |
US9939904B2 (en) | 2018-04-10 |
US9632581B2 (en) | 2017-04-25 |
CN105556423B (en) | 2019-01-15 |
US20190018490A1 (en) | 2019-01-17 |
JP6538657B2 (en) | 2019-07-03 |
CN110109534A (en) | 2019-08-09 |
US20180188811A1 (en) | 2018-07-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10488931B2 (en) | Systems and methods for pressure-based haptic effects | |
US10518170B2 (en) | Systems and methods for deformation-based haptic effects | |
US10496174B2 (en) | Systems and methods for surface elements that provide electrostatic haptic effects | |
US10656715B2 (en) | Systems and methods for a haptically-enabled projected user interface | |
US10248210B2 (en) | Systems and methods for haptically-enabled conformed and multifaceted displays | |
US10606356B2 (en) | Systems and methods for haptically-enabled curved devices | |
US10474238B2 (en) | Systems and methods for virtual affective touch | |
KR20180044877A (en) | Pressure-based haptics | |
US20160246375A1 (en) | Systems And Methods For User Interaction With A Curved Display |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201480033405.3 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14737403 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014737403 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2016519620 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20157036716 Country of ref document: KR Kind code of ref document: A |