US20110285666A1 - Electrovibration for touch surfaces - Google Patents
Electrovibration for touch surfaces Download PDFInfo
- Publication number
- US20110285666A1 US20110285666A1 US13/092,564 US201113092564A US2011285666A1 US 20110285666 A1 US20110285666 A1 US 20110285666A1 US 201113092564 A US201113092564 A US 201113092564A US 2011285666 A1 US2011285666 A1 US 2011285666A1
- Authority
- US
- United States
- Prior art keywords
- signal
- digit
- user
- conductive
- tactile
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/045—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
Definitions
- Embodiments of the invention relate to touch surfaces, and, in particular, to electrovibration for touch surfaces.
- Touch provides humans with a wide variety of sensations that allow us to feel the world. We can enjoy the feeling of textures, as well as objects and materials. Beyond experience, tactile sensations also guide us with everyday tasks and help us to explore object properties that we normally are not able to see.
- the touch surface itself can be actuated with various electromechanical actuators, such as piezoelectric bending motors, voice coils, and solenoids.
- the actuation can be designed to create surface motion either in the normal or lateral directions.
- Such an approach has been used in the design of tactile feedback for touch interfaces on small handheld devices by mechanically vibrating the entire touch surface. With low frequency vibrations, a simple “click” sensation can be simulated.
- a major challenge in using mechanical actuation with mobile touch surfaces is the difficulty of creating actuators that fit into mobile devices and produce sufficient force to displace the touch surface.
- Creating tactile interfaces for large touch screens, such as interactive kiosks and desktop computers allows for larger actuators. Larger actuated surfaces, however, begin to behave as a flexible membrane instead of a rigid plate. Complex mechanical deformations occur when larger plates are actuated, making it difficult to predictably control tactile sensation or even provide enough power for actuation.
- Embodiments of the invention provide an interface that allows users to feel a broad range of tactile sensations on touch surfaces.
- a touch panel includes a transparent electrode covered by a thin insulation layer.
- An electrical signal is coupled to the electrode or the back side of the device.
- a digit such as a finger
- slides along the insulation layer of the touch panel a sensation of tactile texture is perceived.
- Another embodiment provides a method for generating a signal.
- the method includes detecting an impedance value of a user in contact with a device relative to a ground; generating a signal based on the impedance value; and causing the signal to be coupled to the user such that a tactile sensation is perceived in at least one digit that slides on an insulation surface of the device.
- FIG. 1 is a block diagram of a system configured to implement one or more aspects of the invention.
- FIGS. 4B-4C illustrate an attractive force induced between a finger and a touch surface and a friction force between the sliding finger and the touch surface, according to embodiments of the invention.
- FIG. 6 is a graph of absolute detection thresholds for different frequencies of an input signal, according to some embodiments of the invention.
- FIG. 7 illustrates frequency just-noticeable-differences (JNDs) based on a user survey, according to one embodiment of the invention.
- FIG. 8 illustrates amplitude JNDs based on a user survey, according to one embodiment of the invention.
- FIG. 9 illustrates the results of a user survey of four textures produced by four frequency-amplitude combinations, according to one embodiment of the invention.
- FIG. 10B is a conceptual diagram that illustrates controlling multiple electrodes with switches, according to one embodiment of the invention.
- FIG. 11A is a conceptual diagram illustrating implementing an impedance profile, according to embodiments of the invention.
- Embodiments of the invention provide an interface that allows users to feel a broad range of tactile sensations on touch screens. Unlike other tactile technologies, embodiments of the invention do not use any mechanical motion.
- a touch panel includes a transparent electrode covered by a thin insulation layer.
- An electrical signal is coupled to the electrode.
- a signal can be applied directly to the user via the back side of the device.
- the signal may be a time-varying signal. In some embodiments, the time-varying signal is periodic.
- Embodiments of the invention can be easily combined with different display and input technologies and can be used in many applications.
- a touch screen can simulate the feeling of various textures.
- Another example application includes enhancing drawing applications with the feeling of paint on a virtual canvas.
- Embodiments of the invention can also simulate friction between objects. For example, dragging a virtual car could feel different depending on the type of virtual pavement on which the car is being dragged. In another example, dragging large files using the touch screen could create more friction than compared to dragging smaller files.
- embodiments of the invention allow the user feel constraints, such as snapping to a grid in a manipulation task. There are many more applications of embodiments of the invention. Combined with other input modalities such as video, embodiments of the invention create many new applications and exciting user experiences.
- Embodiments may be implemented as a system, method, apparatus or computer program product. Accordingly, various embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects. Furthermore, embodiments may take the form of a computer program product embodied in one or more computer-readable medium(s) having computer-readable program code embodied therewith.
- Computer program code for carrying out operations of various embodiments may be written in any combination of one or more programming languages (including an object oriented programming language such as JavaTM, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages).
- the program code may execute entirely on the user's computer (device), partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer.
- LAN local area network
- WAN wide area network
- These computer program instructions may also be stored in a computer-readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instructions which implement the function/act specified.
- the computer program instructions may also be loaded onto a computer, other programmable data processing apparatus or the like to produce a computer implemented process such that the instructions that execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified.
- FIG. 1 is a block diagram of a system configured to implement one or more aspects of the invention.
- An example device that may be used in connection with one or more embodiments includes a computing device in the form of a computer 110 .
- Components of computer 110 may include, but are not limited to, a processing unit 120 , a system memory 130 , and a system bus 122 that couples various system components including the system memory 130 to the processing unit 120 .
- Computer 110 may include or have access to a variety of computer-readable media.
- the system memory 130 may include computer-readable storage media, for example in the form of volatile and/or nonvolatile memory such as read only memory (ROM) and/or random access memory (RAM).
- ROM read only memory
- RAM random access memory
- system memory 130 may also include an operating system, application programs, other program modules, and program data.
- a user can interface with (for example, enter commands and information) the computer 110 through input devices 140 .
- a monitor or other type of display surface can also be connected to the system bus 122 via an interface, such as an output interface 150 .
- computers may also include other peripheral output devices.
- the computer 110 may operate in a networked or distributed environment using logical connections to one or more other remote device(s) 170 such as other computers.
- the logical connections may include network interface(s) 160 to a network, such as a local area network (LAN), a wide area network (WAN), and/or a global computer network, but may also include other networks/buses.
- Certain embodiments are directed to systems and associated methods for creating tactile interfaces for touch surfaces that do not use any form of mechanical actuation. Instead, certain embodiments exploit the principle of “electrovibration,” which allows creation of a broad range of tactile sensations by controlling electrostatic friction between an instrumented touch surface and a user's fingers. When combined with an input-capable interactive display, embodiments enable the creation of a wide variety of interactions augmented with tactile feedback.
- Various example embodiments are described in further detail below. The details regarding the example embodiments provided below are not intended to be limiting, but are merely illustrative of example embodiments.
- Embodiments of the invention provide mechanisms for creating tactile interfaces for touch surfaces that does not use any form of mechanical actuation. Instead, the proposed technique exploits the principle of electrovibration, which allows embodiments to create a broad range of tactile sensations by controlling electrostatic friction between an instrumented touch surface and the user's finger or fingers. When combined with an input-capable interactive display, embodiments of the invention enable a wide variety of interactions augmented with tactile feedback.
- FIG. 2A is a conceptual diagram of a touch surface 200 configured for providing electrovibration, according one embodiment of the invention.
- the touch surface 200 includes a transparent electrode sheet 202 applied onto a glass plate 204 coated with an insulator layer 206 .
- a controller causes the transparent electrode 202 to be excited with a periodic electrical signal V(t) coupled to connectors.
- the connectors could normally be used by a position sensing driver (not shown) of the touch surface 200 .
- an electrically induced attractive force f e develops between a sliding finger 208 and the underlying electrode 202 , increasing the dynamic friction f r between the finger 208 and the touch surface 200 .
- the electrical signal V(t) comprises a sinusoidal waveform. In other embodiments, the electrical signal V(t) comprises other waveforms, including square or triangular waveforms. In some embodiments, the signal can be mono-phasic or bi-phasic. In some embodiments, the signal is rectified. In some embodiments, the signal includes a DC (direct current) offset. In some embodiments, coupling the electrical signal V(t) to the electrode 202 comprises providing the signal directly to the electrode 202 . In other embodiment, coupling the electrical signal V(t) to the electrode 202 comprises inductively coupling the electrical signal V(t) to the electrode 202 via capacitive, resistive, and/or inductive elements.
- the user's finger can be connected to a ground 210 .
- the user can be placed at a potential difference from the electrode.
- our bodies provide a natural link to the ground, creating a direct ground connection can increase the intensity of the tactile sensation. Without such grounding, the voltage could be increased to provide the same intensity of sensation.
- Grounding can be achieved by wearing a simple ground electrode.
- the user can wear an anti-static wristband. Users can also sit or stand on a grounded pad.
- the backside of the enclosure which contacts the user when the mobile device is grasped, could be used as the ground.
- the ground electrode comprises a grounded pad on which a user is standing, sitting, holding, resting on lap, wearing, touching, or otherwise coupled to the user including via intermediate objects and materials.
- a ground plane (not shown) can be included in the touch surface 200 .
- the ground plane can comprise a mesh or include a pattern of holes. When the user touches a finger to the touch surface, the user is effectively grounded by the ground plane.
- the signal in this embodiment, is applied to the user.
- the electrode layer itself can include both grounding and signal elements. Accordingly, part of the touching finger would be connected to the ground and part to the signal, hence the ground connection is occurring on the finger.
- FIG. 2B is a conceptual diagram of a touch surface 200 configured for providing electrovibration, according one embodiment of the invention.
- the electrical signal V(t) can be applied to the finger 208 and a path to ground 210 is provided to the electrode 202 .
- the electrical signal can be applied to the back side of the apparatus and pass through the user's body to the finger 208 .
- a tactile sensation is also perceived in the finger when the finger 208 slides on the insulation layer in the configuration shown in FIG. 2B .
- the insulator layer 206 can be made of different materials and can have different textures, i.e. a different finish.
- the electrode 202 can also be made of different materials, including ITO (Indium tin oxide), silver, conductive rubber, copper, aluminum, conductive ink, conductive glue, conductive paint or any other conductive material.
- the critical factor for safe operation of electrical devices is current, rather than voltage.
- induced charge in the finger causes a force on the finger, and the amount of induced current flowing through the user's hand is negligible.
- the current supplied to the touch surface 200 can be limited to 0.5 mA, which is typically considered safe for humans.
- current limitation is defined by the power rating of an operational amplifier used in the driving circuit. In fact, users experience the same amount of current while using conventional capacitive touch panels. To further protect the user, some embodiments can implement a current limiting circuit.
- Electrocutaneous displays stimulate tactile receptors in human fingers with electric charge passing through the skin. In contrast, there is no passing charge in electrovibration: the charge in the finger is induced by a charge moving on a conductive surface. Furthermore, unlike electrocutaneous tactile feedback, where current is directly stimulating the nerve endings, stimulation with electrovibration is mechanical, created by a periodic electrostatic force deforming the skin of the sliding finger.
- a user is manipulating an intermediate object, such as a piece of aluminum foil, over an electrode pattern.
- a periodic signal applied to this pattern creates weak electrostatic attraction between an object and an electrode, which is perceived as vibration when the object is moved by the user's finger.
- the tactile sensation therefore, is created indirectly: the vibration induced by electrostatic force on an object is transferred to the touching human finger.
- no intermediate elements are required; the tactile sensation is created by directly actuating the fingers.
- Embodiments of the invention provide a mechanism that is fast, low-powered, dynamic, and can be used in a wide range of interaction scenarios and applications, including multi-touch interfaces.
- Embodiments of the invention demonstrate a broad bandwidth and uniformity of response across a wide range of frequencies and amplitudes.
- the technology is highly scalable and can be used efficiently on touch surfaces of any size, shape, and/or configuration, including large interactive tables, hand-held mobile devices, as well as curved, flexible, and/or irregular touch surfaces.
- embodiments of the invention do not have any moving parts, they can be easily implemented in existing devices with minimal physical modification to the devices.
- an electrovibration touch surface includes implementing a multi-touch interactive tabletop, a wall mounted surface, or any other technically feasible configuration.
- a touch panel in accordance with FIGS. 2A-2B can be used as a projection and input surface.
- An additional diffuser plane can be installed behind the panel.
- a projector can be used to render graphical content.
- the panel can be illuminated from behind with infrared illuminators.
- An infrared camera captures reflections of user fingers touching the surface.
- the multi-touch tracking can be performed at 60 frames per second. Finger positions are transmitted to a hardware mechanism and/or software application responsible for controlling interactive features, visual display, and tactile output.
- This implementation is scalable and can be adapted to other input techniques, including frustrated internal reflection and surface acoustic tracking, among others. It can be easily extended, modified and applied to any surface or device. Indeed, since there is no mechanical motion, almost any object can be instrumented with electrovibration-based tactile feedback.
- the electrodes can be transparent or opaque, be painted on curved and irregular surfaces, and added to any display, hand tool, or appliance.
- other sensing technologies can be used in combination with the electrovibration techniques described herein, such as distance tracking, pressure input, contact area tracking, among others.
- FIGS. 3A-3C illustrate electrical charges corresponding to electrovibration actuation, according to embodiments of the invention.
- a touch surface comprises a glass plate 304 , an electrode 306 , and an insulation layer 308 .
- An input signal V(t) is applied to the electrode 306 .
- the input signal V(t) can oscillate and cause positive and negative charges to alternate within the electrode.
- the charges in the electrode are negative.
- Negative charges in the electrode 306 cause positive charges to accumulate along the bottom portion of the insulation layer 308 and negative charges to accumulate along the top portion of the insulation layer 308 . This causes positive charges to be induced in the user's finger 302 when placed in contact with the insulation layer 308 .
- a input signal V(t) applied to the electrode 306 displaces charges within the insulation layer 308 , creating an oscillating electric field.
- a periodic motion of electrical charges is induced in the tip of the finger 302 .
- the electrical signal V(t) can be applied to the finger 302 and a path to ground is provided to the electrode 306 .
- FIGS. 4B-4C illustrate an attractive force f e induced between a finger 402 and a touch surface and a friction force f r between the sliding finger 402 and the touch surface as the finger 402 slides in the direction of the finger motion, according to embodiments of the invention. Because the amplitude of f e varies with the signal amplitude, changes in friction f r are also periodic, resulting in periodic skin deformations as the finger 208 slides on the touch surface 200 . These deformations are perceived as vibration or friction and can be controlled by modulating the amplitude and frequency of the applied signal.
- FIGS. 4B-4C illustrate the finger 402 sliding along the touch surface.
- the magnitude of the attractive force f e and the friction force f r shown in FIG. 4B i.e., at one finger position
- the magnitude of the attractive force f e and the friction force f r shown in FIG. 4C i.e., at another finger position.
- these changes in the magnitude of the friction force f r are periodic as the user slides the finger 402 along the touch surface, resulting in periodic skin deformations that are perceived as texture.
- FIG. 5A is a flow diagram of method steps for providing electrovibration actuation, according to one embodiment of the invention.
- Persons skilled in the art would understand that, even though the method 500 is described in conjunction with the systems of FIGS. 1-4C , any system configured to perform the method steps, in any order, is within the scope of embodiments of the invention.
- the method 500 begins at step 502 , where a signal is provided to an electrode placed between a substrate and an insulation layer.
- the substrate is a glass plate.
- the electrode and/or the insulation surface is transparent and forms part of a touch screen surface.
- the signal provided to the electrode comprises a periodic, modulated, and/or complex waveform.
- the insulation layer can be made of different materials and can have different textures, i.e. a different finish.
- the electrode and/or the insulation surface can be made of different materials, including ITO (Indium tin oxide), conductive rubber, copper, silver, aluminum, conductive ink, conductive glue, or any other conductive material.
- FIG. 5B is a flow diagram of method steps for providing electrovibration actuation, according to one embodiment of the invention.
- Persons skilled in the art would understand that, even though the method 550 is described in conjunction with the systems of FIGS. 1-4C , any system configured to perform the method steps, in any order, is within the scope of embodiments of the invention.
- the method 550 begins at step 552 , where a signal is provided to a user of a device that includes a touch surface.
- the signal can be generated by a controller included within the device.
- the signal is coupled to the back side of the device, which includes a metal surface. Coupling the signal to the back side of the device can include providing the signal directly to the back surface, inductively coupling the signal to the back surface, or any other technique for coupling a signal to a surface.
- the user that is holding the device can receive the signal through the user's hand.
- the device can includes an electrode placed between a substrate and an insulation layer.
- the substrate is a glass plate.
- the electrode and/or the insulation surface are transparent and form part of a touch screen surface.
- the digit comprises a finger.
- varying the frequency, amplitude, DC offset, and/or any other properties of the input signal to the electrode causes the user to feel different tactile feedback.
- the tactile feedback perceived by a particular individual may be different than the sensation perceived by another individual.
- the absolute detection threshold is the minimum voltage amplitude that creates a barely detectable sensation at a specific frequency. Voltages below the detection threshold are not usable in creating haptic sensations.
- the frequency of the input signal affects the absolute detection threshold.
- the amplitude and frequency discrimination thresholds are typically referred to as just-noticeable-differences (JNDs), which are the smallest detectable differences between two stimuli.
- JNDs just-noticeable-differences
- the detection and discrimination thresholds together form a set of fundamental measures that describe the dynamic range and processing capabilities of electrovibration sensations. These measures can be used to design interfaces and applications using embodiments of the invention.
- the detection threshold levels for electrovibrations closely coincide with the force detection threshold levels for sinusoidal stimulus.
- sensations created with embodiments of the invention are closely related to perception of forces lateral to the skin.
- the relation between electrovibration voltages and perceived forces may not be linear.
- the detection threshold levels provide guidelines for designing tactile interfaces using electrovibration. For example, the detection threshold levels inform the designer that at each frequency the applied voltage must be above the corresponding detection threshold level in order to provide a tactile sensation that a user can perceive. They also allow optimizing power requirements. For example, at 400 Hz the tactile signal could create an easily discernable tactile sensation at 18 dB re 1 V level or 16 Vpp. On the other hand, at 180 Hz the voltage threshold level is half of that, requiring significantly less power (12 dB re 1 V peak or 8 Vpp). Therefore, tactile feedback can be optimized to require less power, which can be especially important for mobile devices.
- the frequency and amplitude discrimination thresholds describe the resolution of human perception: they determine the granularity of tactile sensations that can be used in designing interfaces. For example, if designers want to create two distinct tactile sensations, then they would make sure that the amplitude of voltages for each sensation are at least a certain voltage different apart from one another for the user to be able to differentiate them. Similar considerations also apply for frequency of stimuli.
- FIG. 7 illustrates frequency just-noticeable-differences (JNDs) based on a user survey, according to one embodiment of the invention.
- JNDs frequency just-noticeable-differences
- FIG. 8 illustrates amplitude just-noticeable-differences (JNDs) based on a user survey, according to one embodiment of the invention.
- JNDs just-noticeable-differences
- FIG. 9 illustrates the results of a user survey of four textures produced by four frequency-amplitude combinations, according to one embodiment of the invention. As shown, users were subjected to four combinations of frequency and amplitude, including 80 Hz-80 Vpp (voltage peak-to-peak), 80 Hz-115 Vpp, 400 Hz-80 Vpp, and 400 Hz-115 Vpp.
- embodiments of the invention can be implemented in a wide variety of use cases and applications. Some of these use cases and applications are outlined below. The examples provided below are merely exemplary and are not meant to limit the scope of embodiments of the invention.
- One implementation of the electrovibration techniques described herein includes simulation applications.
- This class of applications includes such tactile effects as textures for virtual objects, simulation of friction between objects or objects and a virtual surface, and/or activities like painting and drawing, where tools are manipulated on top of a canvas.
- tactile feedback on touch screens allows for non-visual information layers.
- a visual image of a star field could be supplemented with a “tactile image” of radiation intensity felt by fingers running over the areas of interest.
- the tactile channel can be dynamic in both amplitude and frequency, potentially offering two additional channels of information.
- GUI graphical user interface
- direct manipulation is ripe for tactile augmentation, especially in touch interfaces where occlusion can be problematic.
- Files, icons, and other “dragable” items could be augmented with variable levels of friction to not only confirm that the target was successfully captured, but also convey properties like file size and drag-and-drop applicability. For example, larger files may be associated with greater friction than smaller files.
- Object alignment, snapping, and grid-based layouts could be also supplemented with tactile feedback. Such tactile augmentation could enable eyes-free interaction with sufficient practice.
- embodiments of the invention allow for multi-touch tactile feedback so long as at each moment only one finger is moving on the surface.
- One implementation includes gestures where one finger defines a reference point, while another finger is used for manipulation.
- a selection from a pie menu is one example, where one finger is static while another moves rotationally to select an item.
- shape transformations can be implemented, where one finger defines a static reference point while a moving finger specifies the amount of transformation, e.g. stretching, rotation, or zooming. In all such operations, a moving fmger can be easily supplemented with tactile feedback using embodiments of the invention.
- gestures that employ asymmetric separation of labor between the two hands.
- a non-dominant hand could perform a gross manipulation, such as orienting a sheet of paper, while the dominant hand performs a fine-grained interaction, such as writing.
- Another implementation could use one or more modal buttons to define operation of a common slider.
- one or more fingers are static, while one or more are engaged in movement and provided with tactile feedback using embodiments of the invention.
- embodiments of the invention can be implemented in a multi-touch surface having multiple electrodes addressed individually.
- the tactile display could include one or more individually addressable and individually controlled transparent electrode plates, each of which is covered with the thin insulating layer.
- the electrodes can provide independent tactile feedback when a finger slides on them. Each electrode can be addressed independently from other surrounding electrodes. Accordingly, different sensations can be created for different fingers.
- each of the multiple electrodes is controlled by an independent wire.
- FIG. 10A is a conceptual diagram illustrating multiple electrodes 1000 each controlled by a separate wire, according to one embodiment of the invention.
- a controller 1002 is coupled by a separate wire to each electrode.
- Each of the multiple electrodes 1000 receives a separate input signal.
- the advantage of using independent wires for each electrode is that implementing multiple wires is relatively easy, but a disadvantage is that using many wires may not scalable as the number of electrodes increases.
- a driver can sweep over all connections to create a dynamic high frequency AC signal.
- the driver turns each of the electrodes on for a very short time, then turns it off, goes to the next electrode, turns on and off and so on.
- the resulted signal on each pattern can be a Pulse-Amplitude-Modulated (PAM) wave, or a derivative of a PAM.
- PAM Pulse-Amplitude-Modulated
- embodiments can create an equivalent number of signal sources as electrodes and then connect each signal source to one electrode. This embodiment may be particularly advantageous in embodiments that include a relatively small number of electrodes.
- FIG. 10B is a conceptual diagram that illustrates controlling multiple electrodes with switches, according to one embodiment of the invention.
- an underlying electrode 1004 is provided with an input signal 1006 .
- Small electronically-controlled switches 1010 can be used to bridge top patches 1008 that are touched by the users and the underlying electrode 1004 .
- Control paths 1014 can be used to connect and disconnect the top patches 1008 from the signal electrode 1004 with a driver 1012 .
- the multiple electrodes can be controlled with a switching circuit coupled to each of the electrodes.
- the electronically-controlled switches 1010 can comprise transistors, diodes, relays, or other components, such as flexible electronics materials and/or organic electronics.
- the switches 1010 can be controlled by a grid of wires for addressing.
- a single wire may be provided per row of patches 1008 , and single wire per column of the array of patches.
- the driving electrodes and electrodes that are touched are separated and connected via capacitive coupling.
- Each electrode is driven through capacitive coupling from one patterned layer to another patterned layer.
- the top layer has only patterns and that is all.
- An advantage of this approach is that we can use simple techniques to design control pads and the electrodes no not have to be transparent.
- some embodiments would not require wires on the conductive top-most layer.
- an LED (light emitting diode) screen can be placed between the driving electrodes and the electrodes that are touched.
- a display, a wall, clothes, or other materials can be placed in between the two layers of the electrode.
- a conductive layer such as conductive layer 1004 shown in FIG. 10B
- a conductive layer can be powered with a high frequency AC (e.g., 1 MHz) signal, that is switched on and off by the electronically-controlled switches to modulate a lower frequency signal (e.g., 100 Hz) for tactile response for a particular tile 1008 . Doing so creates a train of bursts where each burst includes high frequency pulses. These stimuli are perceived as low frequency tactile sensations.
- a high frequency AC e.g. 1 MHz
- embodiments of the invention can modulate the amplitude of the high frequency signal as well, thereby creating a low frequency tactile wave represented as Pulse-Amplitude-Modulated (PAM) signal. Humans would perceive only the low frequency signal and would not feel the high frequency component.
- the carrier frequency can be chosen so that the impedance path to ground for the tactile signal frequency is minimal. This could allow for the effect to be perceived without explicit return electrode for the ground.
- FIG. 11A is a conceptual diagram illustrating implementing an impedance profile, according to embodiments of the invention.
- a sensor 1104 can be connected to an electrode 1102 , and measure the overall impedance profile Z m for the finger touching the touch panel.
- the impedance can be dependent on a variety of factors, including the resistance of the circuit, both through the user's body and through electronic components, the moisture of the digit in contact with the surface, the amount of contact surface between the digit and the device, among others.
- Various techniques can be used the measure the impedance profile. In one embodiment, a sweep of the frequencies is performed and then the response is measured.
- the tactile perception felt by the user is based on the impedance value.
- the potential difference between the user and ground can cause the actuation to be perceived differently.
- the sensation that a user feels could be different when standing on a metal bridge and interacting with the device versus standing on a wooden floor and interacting with the device.
- the impedance can vary in time during the interaction with the touch surface. For example, a user can walk up a flight of stairs while interacting with the device, which would change the user's potential difference to ground.
- the signal that is output from the controller is adjusted so that the perceived tactile feedback remains similar during the entire interaction.
- the strength of feedback would change as the user's potential difference to ground changes, which could be jarring to the user.
- the tactile signal can be modulated using the PAM modulation techniques described herein, and then a high frequency (i.e., carrier) signal can be used to encode information that is used for other purposes. Examples include creating a sound, watermarking tactile sensations, sending information to objects touching the surface, e.g. device placed on the surface, sending information to a device worn by the user, and/or sending power to the devices placed on the table.
- a high frequency (i.e., carrier) signal can be used to encode information that is used for other purposes. Examples include creating a sound, watermarking tactile sensations, sending information to objects touching the surface, e.g. device placed on the surface, sending information to a device worn by the user, and/or sending power to the devices placed on the table.
- FIG. 11B is flow diagram for providing electrovibration actuation based on an impedance profile, according to one embodiment of the invention.
- Persons skilled in the art would understand that, even though the method 1150 is described in conjunction with the systems of FIGS. 1-11A , any system configured to perform the method steps, in any order, is within the scope of embodiments of the invention.
- the controller transmits the signal to the electrode or to the finger in contact with the device.
- the signal can be transmitted to the electrode.
- the signal can be transmitted to the finger via coupling the signal to the back side of the device and having the signal pass through the user's body to the finger in contact with the device. Additionally, in some embodiments, the signal passes through a transistor-based amplifier before arriving at the electrode or the finger in contact with the device.
- FIG. 12 is a conceptual diagram that illustrates combining a low frequency signal and high frequency signal, according to one embodiment of the invention. As shown, a low frequency signal 1202 is combined with a high frequency signal 1204 to produce a combined signal 1206 . A human could perceive both the low frequency and the high frequency components of the combined signal 1206 independently, in certain embodiments. The control techniques could control both signal frequencies independently, and different information can be represented using different frequencies embedded into the same combined signal 1206 .
- the electrodes can be arranged in a pattern.
- the electrode patterns can have various shapes, sizes and arrangements.
- the electrode pattern can includes electrodes shaped as squares, triangles, hexagons, circles, or any other shape.
- the electrode patterns may allow the user to feel the edge of a bush putton.
- the electrode is transparent. In other embodiments, the electrode is opaque or translucent.
- Conventional surface capacitive input sensing includes interpreting the voltage and/or current drops on corners of the touch panel when a user is touching the surface.
- This conventional voltage and/or current drop is interpreted relatively to a reference signal that is a low voltage, AC signal of constant amplitude and frequency injected into the electrode of the capacitive touch panel.
- a high voltage, arbitrarily-shaped signal is injected in the electrode of the capacitive touch panel to provide tactile sensation. The signal can then be used as a reference voltage for capacitive sensing.
- the voltage and/or current drop on the corners of the panel are interpreted relative to the arbitrary, high voltage signal injected into the electrode in order to compute touch coordinates.
- the reference signal and the signal according to embodiments of the invention can be injected alternatively using a high frequency switching mechanism.
- the switching frequency can be beyond the sensitivity threshold.
- rapidly alternating input sensing and haptic feedback signal can be perceived as parallel mechanisms from the user's perspective.
- the conductive surface can be a wire, on which fingers slide up and down.
- the wire can be created as a combination of resistive and conductive threads.
- actuation can be done through a graphite or lead pencil on paper.
- an electrode can be placed underneath the paper provides voltage and the pen would feel differently in the user's hands, e.g. this is tactile sensation between pen and user.
- the conductive layer can be conductive paint, and the insulation layer can be non-conductive paint.
- electrovibration tactile feedback can be used to supplement the display of real-world objects.
- Embodiments of the invention can be overlaid on top of an image of an object or an actual 3D object.
- the user can “feel” the image of the object or an actual 3D physical object.
- embodiments of the invention receive a digital representation of the image, that can be either 2D or 3D, convert the digital representation into a tactile representation, and then overlay the tactile representation over the digital representation.
- at least one camera or other sensor can be used to track user viewpoint direction and cirrelate it with finger position on top of the touch sensitive surface.
- the user can feel the image of the object where the picture is stored a computing device, and in other embodiments, the user can feel the image of the object where the picture is received over a network, such as the Internet.
- the object comprises a key on a keypad or a text entry interface.
- the signal coupled to the electrode is based on a controller detecting that a first digit is placed in contact with the insulation surface and that a second digit is placed in contact with the insulation surface, where the first digit is stationary and the second digit is sliding along the insulation surface.
- the system recognizes multiple touch points and different tactile feedback is provided when different touch points are moved asynchronously. For example, left and right hands could be placed on the touch panel. When the left hand is moving (while right hand is kept static) signal A is provided. When right hand is moving (while left hand is kept static) signal B is provide. When both hands are moving, no signal or signal C is provided.
- a camera can be used in conjunction with the electrovibration techniques described herein.
- a user holds a camera, e.g., a camera included in a mobile device, and points the camera at an object.
- Software associated with the camera can detect the object that is being captured and cause a corresponding tactile feedback to be sensed when the user touches the screen.
- an object can be placed inside a protective case that covers the object.
- a protective case that covers the object.
- articles in the museum can be placed behind a glass case, e.g., artifacts, paintings, animals.
- the protective case can be implemented with embodiments of the invention.
- electrovibration actuation can correspond to the feel of the object within the protective case.
- additional tracking techniques could be used to understand which part of the tactile map should be presented to the user.
- the tracking techniques could utilize gaze or face tracking techniques, as well as other techniques.
- input keys can be displayed on a display screen, such that when a user touches the keys, the user feels a tactile feedback, e.g., while touch-typing or during a “swype”-style text or password input.
- Embodiments of the invention offer several significant advantages over conventional mechanical vibrotactile actuation on touch screens.
- the absence of mechanical motion in electrovibration actuation techniques is the most immediate difference between embodiments of the invention and conventional mechanical actuation. This feature has several notable implications.
- any plane of material will flex when actuated. This problem is exacerbated when the plate is large and actuation forces are applied on its periphery, which is common when designing tactile feedback for touch surfaces. Consequently, not only are vibrotactile solutions not feasible for large interactive surfaces, but even for small screen sizes, different parts of the screens would have different magnitudes of physical displacement and, therefore, different tactile sensations. Electrovibration, on the other hand, does not suffer from this effect as electrical potential is evenly and instantaneously distributed over the entire plate.
- the tactile feedback in embodiments of the invention is uniform across surfaces of any size.
- vibrotactile actuation delivers tactile feedback by displacing the entire surface.
- all fingers resting on the surface will be stimulated and any physical object located on the surface is likely to chatter and move around, which is less favorable.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
An apparatus that includes a conductive surface and an insulation surface disposed on the conductive surface. The apparatus further includes a controller configured to cause a signal to be coupled to the conductive surface such that a tactile sensation is perceived in a digit that slides on the insulation surface.
Description
- This application claims benefit of U.S. provisional patent application Ser. No. 61/347,068, filed on May 21, 2010, and U.S. provisional patent application Ser. No. 61/430,125, filed on Jan. 5, 2011, both of which are hereby incorporated by reference herein.
- 1. Field of the Invention
- Embodiments of the invention relate to touch surfaces, and, in particular, to electrovibration for touch surfaces.
- 2. Description of the Related Art
- Touch provides humans with a wide variety of sensations that allow us to feel the world. We can enjoy the feeling of textures, as well as objects and materials. Beyond experience, tactile sensations also guide us with everyday tasks and help us to explore object properties that we normally are not able to see.
- Interest in designing and investigating haptic interfaces for touch-based interactive systems has been rapidly growing in recent years. Haptics refers to the sense of touch. This interest in haptic interfaces is fueled by the popularity of touch-based interfaces, both in research and end-user communities. However, one major problem with touch interfaces is the lack of dynamic tactile feedback. A lack of haptic feedback decreases the realism of visual environments, breaks the metaphor of direct interaction, and reduces interface efficiency because the user can not rely on familiar haptic cues for accomplishing even the most basic interaction tasks.
- In general, adding tactile feedback to touch interfaces has been challenging. In one conventional approach, the touch surface itself can be actuated with various electromechanical actuators, such as piezoelectric bending motors, voice coils, and solenoids. The actuation can be designed to create surface motion either in the normal or lateral directions. Such an approach has been used in the design of tactile feedback for touch interfaces on small handheld devices by mechanically vibrating the entire touch surface. With low frequency vibrations, a simple “click” sensation can be simulated. A major challenge in using mechanical actuation with mobile touch surfaces is the difficulty of creating actuators that fit into mobile devices and produce sufficient force to displace the touch surface. Creating tactile interfaces for large touch screens, such as interactive kiosks and desktop computers, allows for larger actuators. Larger actuated surfaces, however, begin to behave as a flexible membrane instead of a rigid plate. Complex mechanical deformations occur when larger plates are actuated, making it difficult to predictably control tactile sensation or even provide enough power for actuation.
- An alternative approach to actuation of the touch surface is to decouple the tactile and visual displays. In the case of mobile devices, tactile feedback can be provided by vibrating the backside of the device, stimulating the holding hand. Alternatively, it is possible to embed localized tactile actuators into the body of a mobile device or into tools used in conjunction with touch interfaces. This approach, however, breaks the metaphor of direct interaction, requires external devices, and still does not solve the problem of developing tactile feedback for large surfaces.
- Accordingly, there remains a need in the art for a user interface for a haptic interface that addresses the drawbacks and limitations discussed above.
- Embodiments of the invention provide an interface that allows users to feel a broad range of tactile sensations on touch surfaces. In one embodiment, a touch panel includes a transparent electrode covered by a thin insulation layer. An electrical signal is coupled to the electrode or the back side of the device. When a digit, such as a finger, slides along the insulation layer of the touch panel, a sensation of tactile texture is perceived.
- One embodiment provides an apparatus, including: a conductive surface; an insulation surface disposed on the conductive surface; and a controller configured to cause a signal to be coupled to a user in contact with the apparatus such that a tactile sensation is perceived in at least one digit of the user that slides on the insulation surface.
- Another embodiment provides a method for generating a signal. The method includes detecting an impedance value of a user in contact with a device relative to a ground; generating a signal based on the impedance value; and causing the signal to be coupled to the user such that a tactile sensation is perceived in at least one digit that slides on an insulation surface of the device.
-
FIG. 1 is a block diagram of a system configured to implement one or more aspects of the invention. -
FIGS. 2A-2B are conceptual diagrams of touch surfaces configured for providing electrovibration, according embodiments of the invention. -
FIGS. 3A-3C illustrate electrical charges corresponding to electrovibration actuation, according to embodiments of the invention. -
FIG. 4A illustrates an attractive force induced between a finger and a touch surface, according to one embodiment of the invention. -
FIGS. 4B-4C illustrate an attractive force induced between a finger and a touch surface and a friction force between the sliding finger and the touch surface, according to embodiments of the invention. -
FIGS. 5A-5B are flow diagrams of method steps for providing electrovibration actuation, according embodiments of the invention. -
FIG. 6 is a graph of absolute detection thresholds for different frequencies of an input signal, according to some embodiments of the invention. -
FIG. 7 illustrates frequency just-noticeable-differences (JNDs) based on a user survey, according to one embodiment of the invention. -
FIG. 8 illustrates amplitude JNDs based on a user survey, according to one embodiment of the invention. -
FIG. 9 illustrates the results of a user survey of four textures produced by four frequency-amplitude combinations, according to one embodiment of the invention. -
FIG. 10A is a conceptual diagram illustrating multiple electrodes each controlled by a separate wire, according to one embodiment of the invention. -
FIG. 10B is a conceptual diagram that illustrates controlling multiple electrodes with switches, according to one embodiment of the invention. -
FIG. 11A is a conceptual diagram illustrating implementing an impedance profile, according to embodiments of the invention. -
FIG. 11B is flow diagram for providing electrovibration actuation based on an impedance profile, according to one embodiment of the invention. -
FIG. 12 is a conceptual diagram that illustrates combining a low frequency signal and high frequency signal, according to one embodiment of the invention. - Embodiments of the invention provide an interface that allows users to feel a broad range of tactile sensations on touch screens. Unlike other tactile technologies, embodiments of the invention do not use any mechanical motion. In one embodiment, a touch panel includes a transparent electrode covered by a thin insulation layer. An electrical signal is coupled to the electrode. As described in greater detail below, in another embodiment, a signal can be applied directly to the user via the back side of the device. The signal may be a time-varying signal. In some embodiments, the time-varying signal is periodic. When a finger, or other conductive object such as a pen, slides along the insulation layer of the touch panel, a sensation of tactile texture is perceived.
- Embodiments of the invention can be easily combined with different display and input technologies and can be used in many applications. For example, a touch screen can simulate the feeling of various textures. Another example application includes enhancing drawing applications with the feeling of paint on a virtual canvas. Embodiments of the invention can also simulate friction between objects. For example, dragging a virtual car could feel different depending on the type of virtual pavement on which the car is being dragged. In another example, dragging large files using the touch screen could create more friction than compared to dragging smaller files. Similarly, embodiments of the invention allow the user feel constraints, such as snapping to a grid in a manipulation task. There are many more applications of embodiments of the invention. Combined with other input modalities such as video, embodiments of the invention create many new applications and exciting user experiences.
- Embodiments may be implemented as a system, method, apparatus or computer program product. Accordingly, various embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects. Furthermore, embodiments may take the form of a computer program product embodied in one or more computer-readable medium(s) having computer-readable program code embodied therewith.
- Any combination of one or more computer-readable medium(s) may be utilized. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. A computer-readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A computer-readable signal medium may include a propagated data signal with computer-readable program code embodied therein. Computer program code for carrying out operations of various embodiments may be written in any combination of one or more programming languages (including an object oriented programming language such as Java™, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages). The program code may execute entirely on the user's computer (device), partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. The remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer.
- It will be understood that certain embodiments can be implemented by a device such as a computer executing a program of instructions. These computer program instructions may be provided to a processor of a special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the functions/acts specified.
- These computer program instructions may also be stored in a computer-readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instructions which implement the function/act specified.
- The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus or the like to produce a computer implemented process such that the instructions that execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified.
-
FIG. 1 is a block diagram of a system configured to implement one or more aspects of the invention. An example device that may be used in connection with one or more embodiments includes a computing device in the form of acomputer 110. Components ofcomputer 110 may include, but are not limited to, aprocessing unit 120, asystem memory 130, and asystem bus 122 that couples various system components including thesystem memory 130 to theprocessing unit 120.Computer 110 may include or have access to a variety of computer-readable media. Thesystem memory 130 may include computer-readable storage media, for example in the form of volatile and/or nonvolatile memory such as read only memory (ROM) and/or random access memory (RAM). By way of example, and not limitation,system memory 130 may also include an operating system, application programs, other program modules, and program data. - A user can interface with (for example, enter commands and information) the
computer 110 through input devices 140. A monitor or other type of display surface can also be connected to thesystem bus 122 via an interface, such as anoutput interface 150. In addition to a monitor, computers may also include other peripheral output devices. Thecomputer 110 may operate in a networked or distributed environment using logical connections to one or more other remote device(s) 170 such as other computers. The logical connections may include network interface(s) 160 to a network, such as a local area network (LAN), a wide area network (WAN), and/or a global computer network, but may also include other networks/buses. - Certain embodiments are directed to systems and associated methods for creating tactile interfaces for touch surfaces that do not use any form of mechanical actuation. Instead, certain embodiments exploit the principle of “electrovibration,” which allows creation of a broad range of tactile sensations by controlling electrostatic friction between an instrumented touch surface and a user's fingers. When combined with an input-capable interactive display, embodiments enable the creation of a wide variety of interactions augmented with tactile feedback. Various example embodiments are described in further detail below. The details regarding the example embodiments provided below are not intended to be limiting, but are merely illustrative of example embodiments.
- Embodiments of the invention provide mechanisms for creating tactile interfaces for touch surfaces that does not use any form of mechanical actuation. Instead, the proposed technique exploits the principle of electrovibration, which allows embodiments to create a broad range of tactile sensations by controlling electrostatic friction between an instrumented touch surface and the user's finger or fingers. When combined with an input-capable interactive display, embodiments of the invention enable a wide variety of interactions augmented with tactile feedback.
-
FIG. 2A is a conceptual diagram of atouch surface 200 configured for providing electrovibration, according one embodiment of the invention. Thetouch surface 200 includes atransparent electrode sheet 202 applied onto aglass plate 204 coated with aninsulator layer 206. A controller causes thetransparent electrode 202 to be excited with a periodic electrical signal V(t) coupled to connectors. For example, the connectors could normally be used by a position sensing driver (not shown) of thetouch surface 200. When an input signal of sufficient amplitude is provided, an electrically induced attractive force fe develops between a slidingfinger 208 and theunderlying electrode 202, increasing the dynamic friction fr between thefinger 208 and thetouch surface 200. Because the amplitude of fe varies with the signal amplitude, changes in friction fr are also periodic, resulting in periodic skin deformations as thefinger 208 slides on thetouch surface 200. These deformations are perceived as vibration or friction and can be controlled by modulating the amplitude and frequency of the applied signal. Also, the input signal V(t) is uniformly propagated across thetransparent electrode 202; therefore, the resulting tactile sensation is spatially uniform. - In one embodiment, the electrical signal V(t) comprises a sinusoidal waveform. In other embodiments, the electrical signal V(t) comprises other waveforms, including square or triangular waveforms. In some embodiments, the signal can be mono-phasic or bi-phasic. In some embodiments, the signal is rectified. In some embodiments, the signal includes a DC (direct current) offset. In some embodiments, coupling the electrical signal V(t) to the
electrode 202 comprises providing the signal directly to theelectrode 202. In other embodiment, coupling the electrical signal V(t) to theelectrode 202 comprises inductively coupling the electrical signal V(t) to theelectrode 202 via capacitive, resistive, and/or inductive elements. - As shown, the user's finger can be connected to a
ground 210. In one embodiment, the user can be placed at a potential difference from the electrode. Although our bodies provide a natural link to the ground, creating a direct ground connection can increase the intensity of the tactile sensation. Without such grounding, the voltage could be increased to provide the same intensity of sensation. Grounding can be achieved by wearing a simple ground electrode. For example, the user can wear an anti-static wristband. Users can also sit or stand on a grounded pad. In the case of mobile devices, the backside of the enclosure, which contacts the user when the mobile device is grasped, could be used as the ground. In other embodiments, the ground electrode comprises a grounded pad on which a user is standing, sitting, holding, resting on lap, wearing, touching, or otherwise coupled to the user including via intermediate objects and materials. - In yet another embodiment, a ground plane (not shown) can be included in the
touch surface 200. The ground plane can comprise a mesh or include a pattern of holes. When the user touches a finger to the touch surface, the user is effectively grounded by the ground plane. The signal, in this embodiment, is applied to the user. - In yet another embodiment, the electrode layer itself can include both grounding and signal elements. Accordingly, part of the touching finger would be connected to the ground and part to the signal, hence the ground connection is occurring on the finger.
-
FIG. 2B is a conceptual diagram of atouch surface 200 configured for providing electrovibration, according one embodiment of the invention. As shown, the electrical signal V(t) can be applied to thefinger 208 and a path to ground 210 is provided to theelectrode 202. In some embodiments, the electrical signal can be applied to the back side of the apparatus and pass through the user's body to thefinger 208. A tactile sensation is also perceived in the finger when thefinger 208 slides on the insulation layer in the configuration shown inFIG. 2B . - According to various embodiments, the
insulator layer 206 can be made of different materials and can have different textures, i.e. a different finish. Theelectrode 202 can also be made of different materials, including ITO (Indium tin oxide), silver, conductive rubber, copper, aluminum, conductive ink, conductive glue, conductive paint or any other conductive material. - In some cases, the critical factor for safe operation of electrical devices is current, rather than voltage. According to embodiments of the invention, induced charge in the finger causes a force on the finger, and the amount of induced current flowing through the user's hand is negligible. For example, the current supplied to the
touch surface 200 can be limited to 0.5 mA, which is typically considered safe for humans. In some embodiment, current limitation is defined by the power rating of an operational amplifier used in the driving circuit. In fact, users experience the same amount of current while using conventional capacitive touch panels. To further protect the user, some embodiments can implement a current limiting circuit. - “Electrovibration” tactile actuation differs from “electrocutaneous” and “electrostatic” tactile actuation. Electrocutaneous displays stimulate tactile receptors in human fingers with electric charge passing through the skin. In contrast, there is no passing charge in electrovibration: the charge in the finger is induced by a charge moving on a conductive surface. Furthermore, unlike electrocutaneous tactile feedback, where current is directly stimulating the nerve endings, stimulation with electrovibration is mechanical, created by a periodic electrostatic force deforming the skin of the sliding finger.
- In the electrostatic approach, a user is manipulating an intermediate object, such as a piece of aluminum foil, over an electrode pattern. A periodic signal applied to this pattern creates weak electrostatic attraction between an object and an electrode, which is perceived as vibration when the object is moved by the user's finger. The tactile sensation, therefore, is created indirectly: the vibration induced by electrostatic force on an object is transferred to the touching human finger. In case of electrovibration, no intermediate elements are required; the tactile sensation is created by directly actuating the fingers.
- Tactile feedback based on electrovibration has several compelling advantages. Embodiments of the invention provide a mechanism that is fast, low-powered, dynamic, and can be used in a wide range of interaction scenarios and applications, including multi-touch interfaces. Embodiments of the invention demonstrate a broad bandwidth and uniformity of response across a wide range of frequencies and amplitudes. Furthermore, the technology is highly scalable and can be used efficiently on touch surfaces of any size, shape, and/or configuration, including large interactive tables, hand-held mobile devices, as well as curved, flexible, and/or irregular touch surfaces. Lastly, because embodiments of the invention do not have any moving parts, they can be easily implemented in existing devices with minimal physical modification to the devices.
- One implementation of an electrovibration touch surface includes implementing a multi-touch interactive tabletop, a wall mounted surface, or any other technically feasible configuration. A touch panel in accordance with
FIGS. 2A-2B can be used as a projection and input surface. An additional diffuser plane can be installed behind the panel. A projector can be used to render graphical content. To capture the user input, the panel can be illuminated from behind with infrared illuminators. An infrared camera captures reflections of user fingers touching the surface. For example, the multi-touch tracking can be performed at 60 frames per second. Finger positions are transmitted to a hardware mechanism and/or software application responsible for controlling interactive features, visual display, and tactile output. This implementation is scalable and can be adapted to other input techniques, including frustrated internal reflection and surface acoustic tracking, among others. It can be easily extended, modified and applied to any surface or device. Indeed, since there is no mechanical motion, almost any object can be instrumented with electrovibration-based tactile feedback. The electrodes can be transparent or opaque, be painted on curved and irregular surfaces, and added to any display, hand tool, or appliance. In other embodiments, other sensing technologies can be used in combination with the electrovibration techniques described herein, such as distance tracking, pressure input, contact area tracking, among others. -
FIGS. 3A-3C illustrate electrical charges corresponding to electrovibration actuation, according to embodiments of the invention. As shown inFIG. 3A , a touch surface comprises aglass plate 304, anelectrode 306, and aninsulation layer 308. An input signal V(t) is applied to theelectrode 306. The input signal V(t) can oscillate and cause positive and negative charges to alternate within the electrode. At the time shown inFIG. 3A , the charges in the electrode are negative. Negative charges in theelectrode 306 cause positive charges to accumulate along the bottom portion of theinsulation layer 308 and negative charges to accumulate along the top portion of theinsulation layer 308. This causes positive charges to be induced in the user'sfinger 302 when placed in contact with theinsulation layer 308. - As described, as the input signal V(t) oscillates, so do the charges in
electrode 306. This causes the charges in theinsulation layer 308 to “flip-flop” within theinsulation layer 308. As shown inFIG. 3B , the positive charges within theinsulation layer 308 are moving upwards (i.e., towards the user's finger 302), and the negative charges within theinsulation layer 308 are moving downwards (i.e., towards the electrode 306).FIG. 3B also illustrates that some of the charges in theelectrode 306 are now positive. The positive charges within theinsulation layer 308 continue moving upwards, and the negative charges within theinsulation layer 308 continue moving downwards. Negative charges have also started to accumulate within the user's finger tip. -
FIG. 3C illustrates the changes within the touch surface at yet another point in time. As shown, the charges in theelectrode 306 are now positive. Positive charges in theelectrode 306 cause negative charges to accumulate along the bottom portion of theinsulation layer 308 and positive charges to accumulate along the top portion of theinsulation layer 308. This causes negative charges to accumulate in the user'sfinger 302 when placed in contact with theinsulation layer 308. - As described, a input signal V(t) applied to the
electrode 306 displaces charges within theinsulation layer 308, creating an oscillating electric field. When thefinger 302 is placed on the surface of the touch panel, a periodic motion of electrical charges is induced in the tip of thefinger 302. As described above, in other embodiments, the electrical signal V(t) can be applied to thefinger 302 and a path to ground is provided to theelectrode 306. -
FIG. 4A illustrates an attractive force fe induced between afinger 402 and a touch surface, according to one embodiment of the invention. The touch surface comprises aglass plate 404, anelectrode 406, and aninsulation layer 408. An input signal V(t) is applied to theelectrode 406. When an input signal V(t) of sufficient amplitude is provided, the electrically induced attractive force fe develops between thefinger 402 and theunderlying electrode 406. The induced attractive force fe oscillates between a stronger force and a weaker force as the charges oscillate within thefinger 402. The oscillation of the magnitude of the induced attractive force fe is illustrated in theFIG. 4A with the dotted arrow representing the induced attractive force fe. -
FIGS. 4B-4C illustrate an attractive force fe induced between afinger 402 and a touch surface and a friction force fr between the slidingfinger 402 and the touch surface as thefinger 402 slides in the direction of the finger motion, according to embodiments of the invention. Because the amplitude of fe varies with the signal amplitude, changes in friction fr are also periodic, resulting in periodic skin deformations as thefinger 208 slides on thetouch surface 200. These deformations are perceived as vibration or friction and can be controlled by modulating the amplitude and frequency of the applied signal. -
FIGS. 4B-4C illustrate thefinger 402 sliding along the touch surface. As shown, the magnitude of the attractive force fe and the friction force fr shown inFIG. 4B (i.e., at one finger position) is greater than the magnitude of the attractive force fe and the friction force fr shown inFIG. 4C (i.e., at another finger position). In some embodiments, these changes in the magnitude of the friction force fr are periodic as the user slides thefinger 402 along the touch surface, resulting in periodic skin deformations that are perceived as texture. -
FIG. 5A is a flow diagram of method steps for providing electrovibration actuation, according to one embodiment of the invention. Persons skilled in the art would understand that, even though themethod 500 is described in conjunction with the systems ofFIGS. 1-4C , any system configured to perform the method steps, in any order, is within the scope of embodiments of the invention. - As shown, the
method 500 begins atstep 502, where a signal is provided to an electrode placed between a substrate and an insulation layer. In one embodiment, the substrate is a glass plate. In some embodiments, the electrode and/or the insulation surface is transparent and forms part of a touch screen surface. The signal provided to the electrode comprises a periodic, modulated, and/or complex waveform. According to various embodiments, the insulation layer can be made of different materials and can have different textures, i.e. a different finish. The electrode and/or the insulation surface can be made of different materials, including ITO (Indium tin oxide), conductive rubber, copper, silver, aluminum, conductive ink, conductive glue, or any other conductive material. - At step 504, responsive to a digit sliding along the insulation layer, a tactile sensation is perceived by the digit. In some embodiments, the digit comprises a finger. As described, changes in the magnitude of a friction force fr between the digit and the insulation layer can be periodic as the user slides the digit along the touch surface, resulting in periodic skin deformations that are perceived as texture.
-
FIG. 5B is a flow diagram of method steps for providing electrovibration actuation, according to one embodiment of the invention. Persons skilled in the art would understand that, even though themethod 550 is described in conjunction with the systems ofFIGS. 1-4C , any system configured to perform the method steps, in any order, is within the scope of embodiments of the invention. - As shown, the
method 550 begins atstep 552, where a signal is provided to a user of a device that includes a touch surface. The signal can be generated by a controller included within the device. In one example, the signal is coupled to the back side of the device, which includes a metal surface. Coupling the signal to the back side of the device can include providing the signal directly to the back surface, inductively coupling the signal to the back surface, or any other technique for coupling a signal to a surface. For example, the user that is holding the device can receive the signal through the user's hand. - At step 554, responsive to a digit sliding along an insulation layer of the device, a tactile sensation is perceived by the digit. As described herein, the device can includes an electrode placed between a substrate and an insulation layer. In one embodiment, the substrate is a glass plate. In some embodiments, the electrode and/or the insulation surface are transparent and form part of a touch screen surface. In some embodiments, the digit comprises a finger.
- In some embodiments, the
method 550 described inFIG. 5B corresponds to the arrangement shown inFIG. 2B , where the signal is applied to the user and the electrode is connected to a path to ground. As described, changes in the magnitude of a friction force fr between the digit and the insulation layer can be periodic as the user slides the digit along the touch surface, resulting in periodic skin deformations that are perceived as texture. - As described above, varying the frequency, amplitude, DC offset, and/or any other properties of the input signal to the electrode causes the user to feel different tactile feedback. The tactile feedback perceived by a particular individual may be different than the sensation perceived by another individual.
- In some embodiments, there is a baseline of human sensitivity that defines an absolute detection threshold and frequency and amplitude discrimination thresholds. In the case of electrovibration, the absolute detection threshold is the minimum voltage amplitude that creates a barely detectable sensation at a specific frequency. Voltages below the detection threshold are not usable in creating haptic sensations. In some embodiments, the frequency of the input signal affects the absolute detection threshold.
-
FIG. 6 is a graph of absolute detection thresholds for different frequencies of an input signal, according to some embodiments of the invention. The data shown inFIG. 6 is based on a user survey and is not meant to be limiting. The data shown inFIG. 6 merely shows one example of absolute detection thresholds for different frequencies. - The absolute detection thresholds for five reference frequencies are shown in
FIG. 6 . The mean detection thresholds of electrovibrations with standard error bars are shown on the left axis and a force detection threshold curve is shown with units along the right axis. The thresholds are defined in “dB re 1 V peak” units computed as 20log10(A) where A is the signal amplitude in Volts. Using this unit is a standard practice in psychophysical experiments due to linearity of human perception in logarithmic scale. For comparison, a force detection threshold curve is also plotted inFIG. 6 . In this example, there was a statistically significant effect of frequency on the threshold levels (F(4,36)=12.8; p<0.001), indicating that the threshold levels depend on the stimulus frequency. - The amplitude and frequency discrimination thresholds are typically referred to as just-noticeable-differences (JNDs), which are the smallest detectable differences between two stimuli. The detection and discrimination thresholds together form a set of fundamental measures that describe the dynamic range and processing capabilities of electrovibration sensations. These measures can be used to design interfaces and applications using embodiments of the invention.
- In some embodiments, the detection threshold levels for electrovibrations closely coincide with the force detection threshold levels for sinusoidal stimulus. Experiments have shown that sensations created with embodiments of the invention are closely related to perception of forces lateral to the skin. The relation between electrovibration voltages and perceived forces may not be linear.
- In some embodiments, the detection threshold levels provide guidelines for designing tactile interfaces using electrovibration. For example, the detection threshold levels inform the designer that at each frequency the applied voltage must be above the corresponding detection threshold level in order to provide a tactile sensation that a user can perceive. They also allow optimizing power requirements. For example, at 400 Hz the tactile signal could create an easily discernable tactile sensation at 18 dB re 1 V level or 16 Vpp. On the other hand, at 180 Hz the voltage threshold level is half of that, requiring significantly less power (12 dB re 1 V peak or 8 Vpp). Therefore, tactile feedback can be optimized to require less power, which can be especially important for mobile devices.
- The frequency and amplitude discrimination thresholds describe the resolution of human perception: they determine the granularity of tactile sensations that can be used in designing interfaces. For example, if designers want to create two distinct tactile sensations, then they would make sure that the amplitude of voltages for each sensation are at least a certain voltage different apart from one another for the user to be able to differentiate them. Similar considerations also apply for frequency of stimuli.
-
FIG. 7 illustrates frequency just-noticeable-differences (JNDs) based on a user survey, according to one embodiment of the invention. Five subjects were subjected to a test at five different frequency levels. The results for each subject are shown inFIG. 7 with a different symbol corresponding to each subject. Also shown are the average values with standard error bars. It should be understood that the results shown inFIG. 7 are not meant to be limiting, but rather show one example of frequency discrimination thresholds. -
FIG. 8 illustrates amplitude just-noticeable-differences (JNDs) based on a user survey, according to one embodiment of the invention. Five subjects were subjected to a test at five different frequency levels. The results for each subject are shown inFIG. 8 with a different symbol corresponding to each subject. Also shown are the average values with standard error bars. It should be understood that the results shown inFIG. 8 are not meant to be limiting, but rather show one example of amplitude discrimination thresholds. - As described, the sensations felt by individual users can vary from person to person.
FIG. 9 illustrates the results of a user survey of four textures produced by four frequency-amplitude combinations, according to one embodiment of the invention. As shown, users were subjected to four combinations of frequency and amplitude, including 80 Hz-80 Vpp (voltage peak-to-peak), 80 Hz-115 Vpp, 400 Hz-80 Vpp, and 400 Hz-115 Vpp. - Low frequency stimuli were perceived as rougher compared to high frequencies. They were often likened to “wood” and “bumpy leather,” versus “paper” and “a painted wall” for higher frequency stimuli.
- The effect of amplitude depends on stimuli frequency. For high frequency textures (e.g,. 400 Hz) an increase of amplitude increased perceived smoothness of tactile sensations. Similarly, at 80 Vpp textures were mostly compared to “cement surface” and “cheap paper,” and at 115 Vpp they were compared to “paper” or “a painted wall.” Some participants explicitly pointed out this increase in perceived smoothness.
- At low frequencies (e.g., 80 Hz), an increase in stimuli amplitude heightens the perception of stickiness. While some participants referred explicitly to a “sticky” sensation, others compared the sensation to that of touching a “motorcycle handle” or “rubber.” Other participants associated viscosity with this type of texture. One participant compared his experience to “running fingers through viscous liquid.”
- Again, it should be understood that the results shown in
FIG. 9 are not meant to be limiting, but rather show one example of amplitude discrimination thresholds. - As described above, embodiments of the invention can be implemented in a wide variety of use cases and applications. Some of these use cases and applications are outlined below. The examples provided below are merely exemplary and are not meant to limit the scope of embodiments of the invention.
- One implementation of the electrovibration techniques described herein includes simulation applications. This class of applications includes such tactile effects as textures for virtual objects, simulation of friction between objects or objects and a virtual surface, and/or activities like painting and drawing, where tools are manipulated on top of a canvas.
- In addition, tactile feedback on touch screens allows for non-visual information layers. For example, a visual image of a star field could be supplemented with a “tactile image” of radiation intensity felt by fingers running over the areas of interest. The tactile channel can be dynamic in both amplitude and frequency, potentially offering two additional channels of information.
- Another example includes incorporating tactile feedback with conventional GUI (graphical user interface) elements. For example, a slider in GUI window can report their drag extent by changing the tactile feedback frequency. Similarly, a user could run his or her fingers over a list of emails to sense those that are new or with the highest priority. There are numerous other interaction design ideas that can be implemented using embodiments of the invention.
- According to various embodiments, changing the frequency of the input signal can be modified by modulating the input signal with a different Pulse-Amplitude-Modulated waveform.
- In yet another example, direct manipulation is ripe for tactile augmentation, especially in touch interfaces where occlusion can be problematic. Files, icons, and other “dragable” items could be augmented with variable levels of friction to not only confirm that the target was successfully captured, but also convey properties like file size and drag-and-drop applicability. For example, larger files may be associated with greater friction than smaller files. Object alignment, snapping, and grid-based layouts could be also supplemented with tactile feedback. Such tactile augmentation could enable eyes-free interaction with sufficient practice.
- Repeated cursor motion over a region, i.e. rubbing, has been used in image editing applications for erasing, smoothing, desaturating, and other procedures that incrementally increase or decrease some attribute of the image. Rubbing interaction offers an interesting application of dynamic tactile feedback. For example, as a user progressively wipes out pixels in an area of an image, the tactile sensation could decrease.
- In some embodiments, fingers in motion could be stimulated, while static fingers would not receive any tactile stimulation. Therefore, embodiments of the invention allow for multi-touch tactile feedback so long as at each moment only one finger is moving on the surface. There are at least two examples where this can be employed in a unique and useful manner. One implementation includes gestures where one finger defines a reference point, while another finger is used for manipulation. A selection from a pie menu is one example, where one finger is static while another moves rotationally to select an item. Similarly, shape transformations can be implemented, where one finger defines a static reference point while a moving finger specifies the amount of transformation, e.g. stretching, rotation, or zooming. In all such operations, a moving fmger can be easily supplemented with tactile feedback using embodiments of the invention.
- Still further examples include gestures that employ asymmetric separation of labor between the two hands. For example, a non-dominant hand could perform a gross manipulation, such as orienting a sheet of paper, while the dominant hand performs a fine-grained interaction, such as writing. Another implementation could use one or more modal buttons to define operation of a common slider. As in the previous example, one or more fingers are static, while one or more are engaged in movement and provided with tactile feedback using embodiments of the invention.
- In yet another embodiment, embodiments of the invention can be implemented in a multi-touch surface having multiple electrodes addressed individually. The tactile display could include one or more individually addressable and individually controlled transparent electrode plates, each of which is covered with the thin insulating layer. The electrodes can provide independent tactile feedback when a finger slides on them. Each electrode can be addressed independently from other surrounding electrodes. Accordingly, different sensations can be created for different fingers.
- In one embodiment, each of the multiple electrodes is controlled by an independent wire.
FIG. 10A is a conceptual diagram illustratingmultiple electrodes 1000 each controlled by a separate wire, according to one embodiment of the invention. Acontroller 1002 is coupled by a separate wire to each electrode. Each of themultiple electrodes 1000 receives a separate input signal. The advantage of using independent wires for each electrode is that implementing multiple wires is relatively easy, but a disadvantage is that using many wires may not scalable as the number of electrodes increases. - In one embodiment, a driver can sweep over all connections to create a dynamic high frequency AC signal. In other words the driver turns each of the electrodes on for a very short time, then turns it off, goes to the next electrode, turns on and off and so on. If driver is switching very fast, the resulted signal on each pattern can be a Pulse-Amplitude-Modulated (PAM) wave, or a derivative of a PAM. In another embodiment, embodiments can create an equivalent number of signal sources as electrodes and then connect each signal source to one electrode. This embodiment may be particularly advantageous in embodiments that include a relatively small number of electrodes.
- In yet another embodiment, one or more conductive pathways or layers of conductive material can be used to control the independent electrodes.
FIG. 10B is a conceptual diagram that illustrates controlling multiple electrodes with switches, according to one embodiment of the invention. As shown, anunderlying electrode 1004 is provided with aninput signal 1006. Small electronically-controlledswitches 1010 can be used to bridgetop patches 1008 that are touched by the users and theunderlying electrode 1004.Control paths 1014 can be used to connect and disconnect thetop patches 1008 from thesignal electrode 1004 with adriver 1012. In other embodiments, the multiple electrodes can be controlled with a switching circuit coupled to each of the electrodes. - The electronically-controlled
switches 1010 can comprise transistors, diodes, relays, or other components, such as flexible electronics materials and/or organic electronics. Theswitches 1010 can be controlled by a grid of wires for addressing. In one implementation, a single wire may be provided per row ofpatches 1008, and single wire per column of the array of patches. - In yet another embodiment (not shown), the driving electrodes and electrodes that are touched are separated and connected via capacitive coupling. Each electrode is driven through capacitive coupling from one patterned layer to another patterned layer. In other words, the top layer has only patterns and that is all. An advantage of this approach is that we can use simple techniques to design control pads and the electrodes no not have to be transparent. In addition, some embodiments would not require wires on the conductive top-most layer. In some embodiments, an LED (light emitting diode) screen can be placed between the driving electrodes and the electrodes that are touched. In other embodiments, a display, a wall, clothes, or other materials can be placed in between the two layers of the electrode.
- Various implementations can be used to drive the signal for the electrovibration surface. A conductive layer, such as
conductive layer 1004 shown inFIG. 10B , can be powered with a high frequency AC (e.g., 1 MHz) signal, that is switched on and off by the electronically-controlled switches to modulate a lower frequency signal (e.g., 100 Hz) for tactile response for aparticular tile 1008. Doing so creates a train of bursts where each burst includes high frequency pulses. These stimuli are perceived as low frequency tactile sensations. - Alternatively, embodiments of the invention can modulate the amplitude of the high frequency signal as well, thereby creating a low frequency tactile wave represented as Pulse-Amplitude-Modulated (PAM) signal. Humans would perceive only the low frequency signal and would not feel the high frequency component. Furthermore, in some embodiments, the carrier frequency can be chosen so that the impedance path to ground for the tactile signal frequency is minimal. This could allow for the effect to be perceived without explicit return electrode for the ground.
- The properties of the actuating signal, such as signal amplitude, signal frequency, signal carrier frequency, DC offset, among others, can be dynamically adjusted depending on the total impedance profile of the system.
FIG. 11A is a conceptual diagram illustrating implementing an impedance profile, according to embodiments of the invention. Asensor 1104 can be connected to anelectrode 1102, and measure the overall impedance profile Zm for the finger touching the touch panel. According to some embodiments, the impedance can be dependent on a variety of factors, including the resistance of the circuit, both through the user's body and through electronic components, the moisture of the digit in contact with the surface, the amount of contact surface between the digit and the device, among others. Various techniques can be used the measure the impedance profile. In one embodiment, a sweep of the frequencies is performed and then the response is measured. - In some embodiments, the tactile perception felt by the user is based on the impedance value. In one embodiment, the potential difference between the user and ground can cause the actuation to be perceived differently. For example, the sensation that a user feels could be different when standing on a metal bridge and interacting with the device versus standing on a wooden floor and interacting with the device. Also, in some embodiments, the impedance can vary in time during the interaction with the touch surface. For example, a user can walk up a flight of stairs while interacting with the device, which would change the user's potential difference to ground.
- The measured impedance profile measured by the
sensor 1104 is transmitted to acontroller 1106 that provides anactuation signal 1108 to theelectrode 1102. According to some embodiments, the parameters of thesignal 1108 are based on the measured impedance Zm so that tactile perception of the electrovibration is maintained. In some embodiments, the signal amplitude and/or DC offset can be adjusted so that the potential difference of the user to ground is maintained the tactile feedback is perceived similarly. In some embodiments, the impedance value is used to control a carrier frequency of a PAM modulation or other modulation of the signal and/or adjust a value of a DC component of the signal. Thus, for example, as a user interacting with the device walks over a metal bridge and up a flight of wooden stairs, the signal that is output from the controller is adjusted so that the perceived tactile feedback remains similar during the entire interaction. Without dynamically controlling the signal, as described herein, the strength of feedback would change as the user's potential difference to ground changes, which could be jarring to the user. - Although
FIG. 11A shows the signal output from the controller being applied to theelectrode 1102, another embodiment of the invention provides for a grounded electrode and the signal being applied to the user (i.e., through the back side of the device). Also, thecontroller 1106 can be implemented as hardware, software, or a combination of hardware and software. - In addition, an
amplifier 1110 is included in the path from thecontroller 1106 to theelectrode 1102 or finger. In one embodiment, the amplifier is a transistor-based amplifier. According to some embodiments, theamplifier 1110 can be included within thecontroller 1106 or separately from the controller. In some embodiments, gain of the amplifier can be adjusted to dynamically control the signal that is output from the controller. Also, using a transistor-based amplifier allows for a DC offset to be included in the output signal. In prior art techniques, a transformer amplifier was used. However, a transformer-based amplifier can only drive an AC (alternating current) signal and cannot pass a DC offset. Additionally, with smaller device such as hand-held devices, transformer amplifiers may be too large. Accordingly, a transistor-based amplifier is smaller and can easily fit within the housing of a hand-held device. - In some embodiments, the tactile signal can be modulated using the PAM modulation techniques described herein, and then a high frequency (i.e., carrier) signal can be used to encode information that is used for other purposes. Examples include creating a sound, watermarking tactile sensations, sending information to objects touching the surface, e.g. device placed on the surface, sending information to a device worn by the user, and/or sending power to the devices placed on the table.
- In some embodiments, a DC (direct current) offset is added to the periodic signal. Adding a DC offset to a signal can increase the perceived strength of the signal and allows for stronger sensations. In some embodiments, the control electronics that control the DC offset are independent of the control electronics that control the variability of tactile signal, allowing embodiments to optimize the tactile perception.
- In other embodiment, only positive or only negative periodic signal is provided.
-
FIG. 11B is flow diagram for providing electrovibration actuation based on an impedance profile, according to one embodiment of the invention. Persons skilled in the art would understand that, even though themethod 1150 is described in conjunction with the systems ofFIGS. 1-11A , any system configured to perform the method steps, in any order, is within the scope of embodiments of the invention. - As shown, the
method 1150 begins atstep 1152, where a sensor determines an impedance profile of user touching a device. According to some embodiments, the impedance can be dependent on a variety of factors, including the resistance of the circuit, both through the user's body and through electronic components, the moisture of the digit in contact with the surface, the amount of contact surface between the digit and the device, among others. Various techniques can be used the measure the impedance profile. In one embodiment, a sweep of the frequencies is performed and then the response is measured. - At
step 1154, a controller generates a signal based on the impedance profile. As described, the parameters of the signal can be modified so that the perceived haptic feedback remains similar throughout the user interaction with the device. In some embodiments, the signal amplitude and/or DC offset can be adjusted so that the potential difference of the user to ground is maintained so that the tactile feedback is perceived similarly. - At
step 1156, the controller transmits the signal to the electrode or to the finger in contact with the device. In one embodiment, as shown in theFIG. 2A , the signal can be transmitted to the electrode. In another embodiment, as shown in theFIG. 2B , the signal can be transmitted to the finger via coupling the signal to the back side of the device and having the signal pass through the user's body to the finger in contact with the device. Additionally, in some embodiments, the signal passes through a transistor-based amplifier before arriving at the electrode or the finger in contact with the device. - In other embodiments, a low frequency signal is combined with higher frequency signal creating a combined signal that is perceived as a single sensation.
FIG. 12 is a conceptual diagram that illustrates combining a low frequency signal and high frequency signal, according to one embodiment of the invention. As shown, alow frequency signal 1202 is combined with ahigh frequency signal 1204 to produce a combinedsignal 1206. A human could perceive both the low frequency and the high frequency components of the combinedsignal 1206 independently, in certain embodiments. The control techniques could control both signal frequencies independently, and different information can be represented using different frequencies embedded into the same combinedsignal 1206. - In embodiments that include multiple individually controlled electrodes, the electrodes can be arranged in a pattern. The electrode patterns can have various shapes, sizes and arrangements. For example, the electrode pattern can includes electrodes shaped as squares, triangles, hexagons, circles, or any other shape. For example, in some embodiments, the electrode patterns may allow the user to feel the edge of a bush putton.
- In some embodiments the electrode is transparent. In other embodiments, the electrode is opaque or translucent.
- Further, embodiments of the invention can be combined with other actuation technologies. In one embodiment, electrovibration actuation can be combined with mechanical vibrotactile actuation to provide a wider range of sensations. In another embodiment, electrovibration actuation can be combined with an ultrasonic horizontal actuator. Ultrasonic motion can be provided below the perception level, i.e., the ultrasonic motion moves the plate instead of the finger. Accordingly, the surface would be sliding finger in relation to the finger while the user is sensing the electrovibration. Such an implementation would allow the user to feel tactile feedback when the finger is not moving, i.e., to feel button presses. In yet another embodiment, electrovibration actuation can be combined with capabilities in temperature changes. In one example, a marble surface could feel cold and a wood surface could feel warm.
- Conventional surface capacitive input sensing includes interpreting the voltage and/or current drops on corners of the touch panel when a user is touching the surface. This conventional voltage and/or current drop is interpreted relatively to a reference signal that is a low voltage, AC signal of constant amplitude and frequency injected into the electrode of the capacitive touch panel. In some embodiments of the invention, a high voltage, arbitrarily-shaped signal is injected in the electrode of the capacitive touch panel to provide tactile sensation. The signal can then be used as a reference voltage for capacitive sensing. The voltage and/or current drop on the corners of the panel are interpreted relative to the arbitrary, high voltage signal injected into the electrode in order to compute touch coordinates.
- In some embodiments, the reference signal and the signal according to embodiments of the invention can be injected alternatively using a high frequency switching mechanism. The switching frequency can be beyond the sensitivity threshold. Thus, rapidly alternating input sensing and haptic feedback signal can be perceived as parallel mechanisms from the user's perspective.
- In yet another embodiment, other objects placed on or near the electrovibration surface can provide electrovibration tactile feedback. In one embodiment, the objects are capacitively coupled to the electrovibration surface and, therefore, can provide tactile feedback. For example, a toy placed on the electrovibration surface can be coated with an insulating film. The electrovibration haptic effect can be sensed by a user that touches the object.
- In some embodiments, the conductive surface can be a wire, on which fingers slide up and down. For example, the wire can be created as a combination of resistive and conductive threads. In other embodiments, actuation can be done through a graphite or lead pencil on paper. For example, an electrode can be placed underneath the paper provides voltage and the pen would feel differently in the user's hands, e.g. this is tactile sensation between pen and user. In yet another embodiment, the conductive layer can be conductive paint, and the insulation layer can be non-conductive paint.
- In some embodiments, electrovibration tactile feedback can be used to supplement the display of real-world objects. Embodiments of the invention can be overlaid on top of an image of an object or an actual 3D object. When the user touches the screen, the user can “feel” the image of the object or an actual 3D physical object. To accomplish this sensation, embodiments of the invention receive a digital representation of the image, that can be either 2D or 3D, convert the digital representation into a tactile representation, and then overlay the tactile representation over the digital representation. To correctly determine which part of the object the user intends to touch, at least one camera or other sensor can be used to track user viewpoint direction and cirrelate it with finger position on top of the touch sensitive surface. In one embodiment, the user can feel the image of the object where the picture is stored a computing device, and in other embodiments, the user can feel the image of the object where the picture is received over a network, such as the Internet. In some embodiments, the object comprises a key on a keypad or a text entry interface.
- In some embodiment, the signal coupled to the electrode is based on a controller detecting that a first digit is placed in contact with the insulation surface and that a second digit is placed in contact with the insulation surface, where the first digit is stationary and the second digit is sliding along the insulation surface. In some embodiments, the system recognizes multiple touch points and different tactile feedback is provided when different touch points are moved asynchronously. For example, left and right hands could be placed on the touch panel. When the left hand is moving (while right hand is kept static) signal A is provided. When right hand is moving (while left hand is kept static) signal B is provide. When both hands are moving, no signal or signal C is provided.
- In another embodiment, a camera can be used in conjunction with the electrovibration techniques described herein. A user holds a camera, e.g., a camera included in a mobile device, and points the camera at an object. Software associated with the camera can detect the object that is being captured and cause a corresponding tactile feedback to be sensed when the user touches the screen.
- In yet another embodiment, an object can be placed inside a protective case that covers the object. For example, in a museum setting, articles in the museum can be placed behind a glass case, e.g., artifacts, paintings, animals. The protective case can be implemented with embodiments of the invention. Thus, when a user touches the protective case, the user can feel electrovibration actuation that can correspond to the feel of the object within the protective case. In some embodiments, additional tracking techniques could be used to understand which part of the tactile map should be presented to the user. The tracking techniques could utilize gaze or face tracking techniques, as well as other techniques.
- Some embodiments of the invention could allow for collaboration applications, where different sensations are provided to different users. Other embodiments may provide an application where erasing and/or sketching can be done using a finger with variable friction. Similarly, embodiments allow for tactile feedback for rubbing-based interaction. Other embodiments include tactile scroll wheels, GUI items are augmented with tactile feedback provided by the scroll wheel of a mouse.
- Yet another example of application of embodiments of the invention is augmenting a text entry technique with tactile sensations. For example, input keys can be displayed on a display screen, such that when a user touches the keys, the user feels a tactile feedback, e.g., while touch-typing or during a “swype”-style text or password input.
- In yet another embodiment, amusement park rides can be augmented with electrovibration technology according to embodiments of the invention. For example, a slide that a person slides down can provide electrovibration feedback.
- Embodiments of the invention offer several significant advantages over conventional mechanical vibrotactile actuation on touch screens. The absence of mechanical motion in electrovibration actuation techniques is the most immediate difference between embodiments of the invention and conventional mechanical actuation. This feature has several notable implications.
- Regardless of the type of material, any plane of material will flex when actuated. This problem is exacerbated when the plate is large and actuation forces are applied on its periphery, which is common when designing tactile feedback for touch surfaces. Consequently, not only are vibrotactile solutions not feasible for large interactive surfaces, but even for small screen sizes, different parts of the screens would have different magnitudes of physical displacement and, therefore, different tactile sensations. Electrovibration, on the other hand, does not suffer from this effect as electrical potential is evenly and instantaneously distributed over the entire plate. The tactile feedback in embodiments of the invention is uniform across surfaces of any size.
- When a periodic force vibrates a plate of material, as is the case for vibrotactile displays, the plate spring properties are combined with dampening, which is inherent due to attachment of the plate to an enclosure or chassis, and together they result in a highly attenuated frequency response of the plate. As a result, for a signal of the same amplitude, the mechanical displacement of the plate will be different at different frequencies, peaking close to its resonant mechanical frequency and then dramatically decreasing. These complex signal attenuations make it essentially impossible to engineer a flat response—even software amplitude correction cannot hope to counter these laws of physics. Because electrovibration requires no moving parts, it suffers from neither of these effects.
- Byproduct noise is a serious consideration when designing end-user interactive systems. For example, most people accept that their kitchen blenders are noisy, but people use them rarely and then only briefly, so the noise level is tolerated. This level of noise would not be acceptable in a computing device we hope to use for extended period of time. Unfortunately, physical vibrations are often noisy, e.g., consider a mobile phone vibrating on a table. Compounding this problem is the fact that interactive surfaces tend to have large surface areas, which displace a considerable volume of air, essentially turning their screens into speakers. Because there is no physical motion in embodiments of the invention, the electrovibration surface is silent.
- Moving parts naturally wear over time, which alters their performance characteristics and may eventually lead to failure. In addition, the vibrating screen must be separated from the enclosure with a small seam to accommodate movement, which allows dust, liquid and other debris inside the device. Sealing this seam, however, dampens vibrations, which decreases the intensity of tactile feedback. None of these issues are relevant in embodiments of the invention. In addition, embodiments of the invention can be practiced without requiring a high-voltage signal. In some examples, tactile sensations can be perceived with as little as 8 Volts peak-to-peak.
- As described, vibrotactile actuation delivers tactile feedback by displacing the entire surface. As a result, all fingers resting on the surface will be stimulated and any physical object located on the surface is likely to chatter and move around, which is less favorable. In general, there is no way to localize tactile feedback to particular digits when vibrotactile feedback is used with interactive surfaces.
- This disclosure has been presented for purposes of illustration and description but is not intended to be exhaustive or limiting. Many modifications and variations will be apparent to those of ordinary skill in the art. The embodiments were chosen and described in order to explain principles and practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated.
- Although illustrative embodiments have been described herein, it is to be understood that the embodiments are not limited to those precise embodiments, and that various other changes and modifications may be affected therein by one skilled in the art without departing from the scope or spirit of the disclosure.
Claims (31)
1. An apparatus, comprising:
a conductive surface;
an insulation surface disposed on the conductive surface; and
a controller configured to cause a signal to be coupled to a user in contact with the apparatus such that a tactile sensation is perceived in at least one digit of the user that slides on the insulation surface.
2. The apparatus of claim 1 , wherein coupling the signal to the user comprises providing the signal directly to a back surface of the apparatus or coupling the signal to the back surface via capacitive, resistive, and/or inductive elements.
3. The apparatus of claim 1 , wherein the controller is configured to modify an amplitude and/or a frequency and/or a DC (direct current) offset of the signal based on a position of the at least one digit on the insulation surface.
4. The apparatus of claim 3 , wherein modifying the amplitude, the frequency, and/or the DC offset of the signal causes the tactile sensation to change.
5. The apparatus of claim 1 , wherein the tactile sensation that is perceived is based on a measured position of the at least one digit on the insulation surface.
6. The apparatus of claim 1 , wherein coupling the signal to the back surface causes a periodic friction force between the at least one digit and the insulation surface.
7. The apparatus of claim 1 , wherein the conductive surface and/or the insulation surface is transparent.
8. The apparatus of claim 1 , wherein the conductive surface and/or the insulation surface comprises ITO (Indium tin oxide), silver, conductive rubber, copper, aluminum, conductive ink, conductive glue, conductive paint, or other conductive material.
9. The apparatus of claim 1 , wherein the at least one digit comprises a finger or a conductive object.
10. The apparatus of claim 1 , wherein the signal is time-varied and/or periodic.
11. The apparatus of claim 10 , wherein the signal is modulated.
12. The apparatus of claim 11 , wherein the signal is modulated using Pulse Amplitude Modulation (PAM) or a derivative of PAM.
13. The apparatus of claim 10 , wherein the signal comprises a sinusoidal waveform, a square waveform, or a triangular waveform.
14. The apparatus of claim 10 , wherein the signal comprises an alternating current (AC) signal.
15. The apparatus of claim 10 , wherein the signal includes a direct current (DC) offset.
16. The apparatus of claim 10 , wherein the signal is generated by combining a low frequency signal and a high frequency signal.
17. The apparatus of claim 1 , further comprising:
a sensor coupled to the conductive surface and configured to measure an impedance value associated with the at least one digit sliding on the insulation surface, wherein the controller is configured to receive the impedance value from the sensor and transmit an actuation signal to the conductive surface based on the impedance value.
18. The apparatus of claim 17 , where the impedance value is used to control a carrier frequency of a PAM modulation or other modulation of the signal.
19. The apparatus of claim 17 , where the impedance value is used to adjust a value of a DC component of the signal or an amplitude of the signal.
20. The apparatus of claim 1 , wherein the conductive surface is coupled to a path to ground.
21. The apparatus of claim 1 , wherein the apparatus comprises an interactive table or a hand-held mobile device.
22. The apparatus of claim 1 , a frequency of the signal is within a range of human tactile perception.
23. The apparatus of claim 1 , further comprising a display screen that displays a graphical user interface, wherein the tactile sensation that is perceived in the at least one digit is associated with an object displayed in the graphical user interface.
24. The apparatus of claim 23 , wherein the object comprises a key on a keypad or a text entry interface.
25. The apparatus of claim 1 , further comprising a display screen that displays an image associated with a painted surface, so that as a user slides the at least one digit on the insulation surface, the painted surface changes and the tactile sensation is modified.
26. The apparatus of claim 1 , wherein the signal is based on the controller detecting that a first digit is placed in contact with the insulation surface and that a second digit is placed in contact with the insulation surface, wherein the first digit is stationary and the second digit is sliding along the insulation surface.
27. The apparatus of claim 1 , further comprising a display screen and a camera configured to capture a digital representation of an object, wherein the digital representation of the object is displayed on the display screen and a tactile sensation associated with sliding the at least one digit over the digital representation is different than a tactile sensation associated with sliding the at least one digit over a different part of the display screen.
28. The apparatus of claim 1 , wherein the apparatus overlays a physical object, and further comprising a sensor configured to determine which portions of the physical object a user is intending the touch while sliding the at least one digit on the insulation surface, wherein the tactile sensation that is perceived simulates a sensation of touching the physical object.
29. The apparatus of claim 1 , wherein the conductive surface includes both grounding elements and signal carrying elements.
30. A method for providing tactile feedback, the method comprising:
causing a signal to be coupled to a user in contact with a device that includes an insulation surface; and
responsive to at least one digit of the user sliding along the insulation surface, causing a tactile sensation to be perceived in the at least one digit based on the signal.
31. The method of claim 30 , wherein causing the signal to be coupled to the user comprises providing the signal directly to a back surface of the device or coupling the signal to the back surface of the device via capacitive, resistive, and/or inductive elements.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/092,564 US20110285666A1 (en) | 2010-05-21 | 2011-04-22 | Electrovibration for touch surfaces |
JP2011113888A JP5948021B2 (en) | 2010-05-21 | 2011-05-20 | Electric vibration for touch surface |
US13/603,833 US20120327006A1 (en) | 2010-05-21 | 2012-09-05 | Using tactile feedback to provide spatial awareness |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US34706810P | 2010-05-21 | 2010-05-21 | |
US201161430125P | 2011-01-05 | 2011-01-05 | |
US13/092,564 US20110285666A1 (en) | 2010-05-21 | 2011-04-22 | Electrovibration for touch surfaces |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/092,572 Continuation-In-Part US9501145B2 (en) | 2010-05-21 | 2011-04-22 | Electrovibration for touch surfaces |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/603,833 Continuation-In-Part US20120327006A1 (en) | 2010-05-21 | 2012-09-05 | Using tactile feedback to provide spatial awareness |
Publications (1)
Publication Number | Publication Date |
---|---|
US20110285666A1 true US20110285666A1 (en) | 2011-11-24 |
Family
ID=44972126
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/092,572 Active 2035-01-08 US9501145B2 (en) | 2010-05-21 | 2011-04-22 | Electrovibration for touch surfaces |
US13/092,564 Abandoned US20110285666A1 (en) | 2010-05-21 | 2011-04-22 | Electrovibration for touch surfaces |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/092,572 Active 2035-01-08 US9501145B2 (en) | 2010-05-21 | 2011-04-22 | Electrovibration for touch surfaces |
Country Status (2)
Country | Link |
---|---|
US (2) | US9501145B2 (en) |
JP (1) | JP5948021B2 (en) |
Cited By (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110285667A1 (en) * | 2010-05-21 | 2011-11-24 | Ivan Poupyrev | Electrovibration for touch surfaces |
US20120326999A1 (en) * | 2011-06-21 | 2012-12-27 | Northwestern University | Touch interface device and method for applying lateral forces on a human appendage |
US20130248344A1 (en) * | 2012-03-23 | 2013-09-26 | Touchsensor Technologies, Llc | Touch responsive user interface with backlit graphics |
WO2013151897A1 (en) * | 2012-04-02 | 2013-10-10 | Synaptics Incorporated | Systems and methods for dynamically modulating a user interface parameter using an input device |
US20130321299A1 (en) * | 2012-05-31 | 2013-12-05 | Korea Institute Of Science And Technology | Electronic device having tactile display using squeeze film effect |
US20140059427A1 (en) * | 2012-08-27 | 2014-02-27 | Siemens Aktiengesellschaft | Operator Control Device for a Technical System |
WO2014046390A1 (en) | 2012-09-24 | 2014-03-27 | Lg Electronics Inc. | Portable device and control method thereof |
US20140118127A1 (en) * | 2012-10-31 | 2014-05-01 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
EP2733575A1 (en) * | 2012-11-20 | 2014-05-21 | Immersion Corporation | System and method for feedforward and feedback with haptic effects |
EP2733576A1 (en) * | 2012-11-20 | 2014-05-21 | Immersion Corporation | System and method for simulated physical interactions with haptic effects |
KR101416720B1 (en) | 2013-06-13 | 2014-07-14 | 한국표준과학연구원 | Haptic feedback generating apparatus using frictional force generated by electrostatic force and vibration using resonant frequency, method for controlling using the same and recording medium thereof |
CN104049748A (en) * | 2013-03-15 | 2014-09-17 | 英默森公司 | User interface device provided with surface haptic sensations |
US20140347322A1 (en) * | 2013-09-26 | 2014-11-27 | Fujitsu Limited | Drive controlling apparatus, electronic device and drive controlling method |
CN104345962A (en) * | 2014-02-24 | 2015-02-11 | 东莞市骏达触控科技有限公司 | Portable electronic product, touch screen and touch screen preparation method |
CN104635984A (en) * | 2015-01-21 | 2015-05-20 | 北京大学 | Single-surface position sensor and positioning method thereof |
US20150185848A1 (en) * | 2013-12-31 | 2015-07-02 | Immersion Corporation | Friction augmented controls and method to convert buttons of touch control panels to friction augmented controls |
US9122330B2 (en) | 2012-11-19 | 2015-09-01 | Disney Enterprises, Inc. | Controlling a user's tactile perception in a dynamic physical environment |
EP2885690A4 (en) * | 2012-08-20 | 2016-01-27 | Samsung Electronics Co Ltd | System and method for perceiving images with multimodal feedback |
WO2016053271A1 (en) * | 2014-09-30 | 2016-04-07 | Hewlett-Packard Development Company L. P. | Identification of an object on a touch-sensitive surface |
EP2901256A4 (en) * | 2012-09-25 | 2016-05-25 | Nokia Technologies Oy | Method and display device with tactile feedback |
US9547430B2 (en) | 2012-10-10 | 2017-01-17 | Microsoft Technology Licensing, Llc | Provision of haptic feedback for localization and data input |
CN106601080A (en) * | 2016-12-28 | 2017-04-26 | 北京握奇智能科技有限公司 | Device displaying Braille and safe transaction system containing same |
US9652069B1 (en) | 2015-10-22 | 2017-05-16 | Synaptics Incorporated | Press hard and move gesture |
US20170295393A1 (en) * | 2016-04-06 | 2017-10-12 | Humax Co., Ltd. | Media system for providing a user profile using force input and method for providing a personalized service in the same |
US20180143691A1 (en) * | 2016-11-21 | 2018-05-24 | Tianma Japan, Ltd. | Tactile presentation device and electronic equipment |
CN108345379A (en) * | 2017-01-25 | 2018-07-31 | 意美森公司 | The method and apparatus that electrostatic friction effect for controlling multiple electrodes generates |
CN108459763A (en) * | 2017-02-20 | 2018-08-28 | 罗伯特·博世有限公司 | Input interface |
US10082875B1 (en) | 2017-06-05 | 2018-09-25 | Korea Institute Of Science And Technology | Vibrating apparatus, system and method for generating tactile stimulation |
US10108267B2 (en) * | 2014-07-02 | 2018-10-23 | Immersion Corporation | Systems and methods for surface elements that provide electrostatic haptic effects |
US10216338B2 (en) * | 2015-04-21 | 2019-02-26 | Fujitsu Limited | Electronic device |
US10345594B2 (en) | 2015-12-18 | 2019-07-09 | Ostendo Technologies, Inc. | Systems and methods for augmented near-eye wearable displays |
US10353203B2 (en) | 2016-04-05 | 2019-07-16 | Ostendo Technologies, Inc. | Augmented/virtual reality near-eye displays with edge imaging lens comprising a plurality of display devices |
EP3521980A1 (en) * | 2013-12-31 | 2019-08-07 | Immersion Corporation | Systems and methods for providing haptic notifications |
WO2019152200A1 (en) * | 2018-02-01 | 2019-08-08 | Microsoft Technology Licensing, Llc | Haptic effect on a touch input surface |
US10453431B2 (en) | 2016-04-28 | 2019-10-22 | Ostendo Technologies, Inc. | Integrated near-far light field display systems |
US10522106B2 (en) | 2016-05-05 | 2019-12-31 | Ostendo Technologies, Inc. | Methods and apparatus for active transparency modulation |
US10578882B2 (en) | 2015-12-28 | 2020-03-03 | Ostendo Technologies, Inc. | Non-telecentric emissive micro-pixel array light modulators and methods of fabrication thereof |
US10598388B2 (en) | 2016-04-07 | 2020-03-24 | Electrolux Home Products, Inc. | Appliance with electrovibration user feedback in a touch panel interface |
WO2020211305A1 (en) * | 2019-04-17 | 2020-10-22 | 北京航空航天大学 | Active texture presentation apparatus based on high-density flexible electromagnetic coil array driving |
US10838504B2 (en) | 2016-06-08 | 2020-11-17 | Stephen H. Lewis | Glass mouse |
WO2020243236A1 (en) * | 2019-05-28 | 2020-12-03 | Tanvas, Inc. | Bipolar projected haptics with balanced loading |
EP3770728A1 (en) * | 2019-07-26 | 2021-01-27 | SABIC Global Technologies B.V. | Thin-film-based triboelectric actuator |
US10908688B2 (en) | 2016-10-21 | 2021-02-02 | Tianma Microelectronics Co., Ltd. | Tactile presentation device and control method |
CN112504957A (en) * | 2020-11-03 | 2021-03-16 | 北京信息科技大学 | Method for testing surface friction characteristic of deterministic texture by fingers |
US20210255726A1 (en) * | 2006-03-24 | 2021-08-19 | Northwestern University | Haptic Device With Indirect Haptic Feedback |
US11106273B2 (en) | 2015-10-30 | 2021-08-31 | Ostendo Technologies, Inc. | System and methods for on-body gestural interfaces and projection displays |
US11132095B2 (en) | 2017-08-07 | 2021-09-28 | Mitsubishi Electric Corporation | Tactile presentation panel, tactile presentation touch panel, and tactile presentation touch display |
US11340710B2 (en) | 2016-06-08 | 2022-05-24 | Architectronics Inc. | Virtual mouse |
US11609427B2 (en) | 2015-10-16 | 2023-03-21 | Ostendo Technologies, Inc. | Dual-mode augmented/virtual reality (AR/VR) near-eye wearable displays |
US11797094B2 (en) | 2019-09-19 | 2023-10-24 | Mitsubishi Electric Corporation | Haptic presentation touch panel and display apparatus |
Families Citing this family (71)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10108288B2 (en) | 2011-05-10 | 2018-10-23 | Northwestern University | Touch interface device and method for applying controllable shear forces to a human appendage |
US9122325B2 (en) * | 2011-05-10 | 2015-09-01 | Northwestern University | Touch interface device and method for applying controllable shear forces to a human appendage |
US20130016059A1 (en) * | 2011-07-12 | 2013-01-17 | Research In Motion Limited | Electronic device and method of controlling a touch-sensitive display |
US20130021234A1 (en) * | 2011-07-21 | 2013-01-24 | Frederick Umminger | Apparatus, system, and method for providing feedback sensations of temperature and texture to a controller |
US20130021235A1 (en) * | 2011-07-21 | 2013-01-24 | Frederick Umminger | Apparatus, system, and method for providing feedback sensations of texture and hardness-softness to a controller |
US20130021232A1 (en) * | 2011-07-21 | 2013-01-24 | Frederick Umminger | Apparatus, system, and method for providing feedback sensations of temperature, texture, and hardness-softness to a controller |
US9323326B2 (en) * | 2011-09-06 | 2016-04-26 | Immersion Corporation | Haptic output device and method of generating a haptic effect in a haptic output device |
US9542068B2 (en) * | 2011-10-27 | 2017-01-10 | The Hong Kong University Of Science And Technology | System and method for constrained manipulations of 3D objects by multitouch inputs |
WO2013132997A1 (en) * | 2012-03-08 | 2013-09-12 | アルプス電気株式会社 | Tactile-stimulus generation device |
KR101871714B1 (en) * | 2012-04-02 | 2018-06-27 | 엘지전자 주식회사 | Mobile terminal and method for controlling thereof |
WO2015127257A1 (en) | 2014-02-21 | 2015-08-27 | Northwestern University | Haptic display with simultaneous sensing and actuation |
JP5993242B2 (en) * | 2012-08-02 | 2016-09-14 | 日本写真印刷株式会社 | Touch sensor with vibration function, electronic device, determination method of pressing point coordinates of touch sensor with vibration function |
CN103870060B (en) * | 2012-12-13 | 2017-09-12 | 意美森公司 | Haptic system with increase LRA bandwidth |
US9223403B2 (en) * | 2012-12-19 | 2015-12-29 | Panasonic Intellectual Property Management Co., Ltd. | Tactile input and output device |
US9285880B2 (en) * | 2012-12-26 | 2016-03-15 | Panasonic Intellectual Property Management Co., Ltd. | Touch panel device and method of controlling a touch panel device |
US9195382B2 (en) | 2013-01-29 | 2015-11-24 | Google Inc. | Intelligent window sizing and control |
KR102214929B1 (en) * | 2013-04-15 | 2021-02-10 | 삼성전자주식회사 | Apparatus and method for providing tactile |
US10466787B2 (en) * | 2013-04-17 | 2019-11-05 | Provenance Asset Group Llc | Haptic device for pedestrian navigation |
US9729730B2 (en) * | 2013-07-02 | 2017-08-08 | Immersion Corporation | Systems and methods for perceptual normalization of haptic effects |
CN104345949B (en) * | 2013-08-07 | 2017-11-28 | 联想(北京)有限公司 | A kind of method of toch control, system and electronic equipment |
US10042446B2 (en) | 2013-08-13 | 2018-08-07 | Samsung Electronics Company, Ltd. | Interaction modes for object-device interactions |
US10108305B2 (en) | 2013-08-13 | 2018-10-23 | Samsung Electronics Company, Ltd. | Interaction sensing |
US9261963B2 (en) * | 2013-08-22 | 2016-02-16 | Qualcomm Incorporated | Feedback for grounding independent haptic electrovibration |
JP6327466B2 (en) * | 2013-10-10 | 2018-05-23 | Tianma Japan株式会社 | Tactile presentation device, electronic device, and tactile presentation method |
JP2015114836A (en) * | 2013-12-11 | 2015-06-22 | キヤノン株式会社 | Image processing device, tactile control method, and program |
CN103793062B (en) * | 2014-03-05 | 2016-09-28 | 吉林大学 | The self adaptation multiple spot electrostatic force tactile representation device of application impedance detection and method |
US10031582B2 (en) * | 2014-06-05 | 2018-07-24 | Immersion Corporation | Systems and methods for induced electrostatic haptic effects |
US9696806B2 (en) | 2014-07-02 | 2017-07-04 | Immersion Corporation | Systems and methods for multi-output electrostatic haptic effects |
US10441500B2 (en) * | 2014-07-28 | 2019-10-15 | National Ict Australia Limited | Determination of parameter values for sensory substitution devices |
CN104238821B (en) * | 2014-09-21 | 2017-09-12 | 长春吉大博硕科技有限责任公司 | A kind of tactile representation device and method applied to Braille reading |
US10146308B2 (en) | 2014-10-14 | 2018-12-04 | Immersion Corporation | Systems and methods for impedance coupling for haptic devices |
CN104331155B (en) * | 2014-10-27 | 2017-02-15 | 北京理工大学 | Device using electric stimulation to realize touch reappearing |
CN105589594B (en) | 2014-11-06 | 2019-12-31 | 天马微电子股份有限公司 | Electronic device and operation control method of electronic device |
JP6076320B2 (en) * | 2014-11-28 | 2017-02-08 | 京セラドキュメントソリューションズ株式会社 | Image forming apparatus and input method |
JP6555608B2 (en) | 2014-12-01 | 2019-08-07 | Tianma Japan株式会社 | Display device and electronic apparatus |
WO2016088246A1 (en) * | 2014-12-05 | 2016-06-09 | 富士通株式会社 | Tactile sensation provision system and tactile sensation provision device |
IL236364B (en) * | 2014-12-21 | 2019-01-31 | Elta Systems Ltd | Methods and systems for flash detection |
US10627905B2 (en) | 2015-03-26 | 2020-04-21 | Tianma Microelectronics Co., Ltd. | Tactile sense presentation device, electronic apparatus, and method of driving tactile sense presentation device |
JP6693641B2 (en) * | 2015-03-26 | 2020-05-13 | 天馬微電子有限公司 | Tactile presentation device, electronic device, and driving method of tactile presentation device |
CN104717449B (en) * | 2015-03-29 | 2017-07-21 | 吉林大学 | The Video chat method and terminal of a kind of fusion tactile perceptional function |
CN104793746B (en) * | 2015-04-25 | 2017-07-21 | 吉林大学 | A kind of multiple spot electrostatic force tactile representation device and method based on switch arrays |
KR102274908B1 (en) * | 2015-04-30 | 2021-07-08 | 엘지디스플레이 주식회사 | Apparatus for driving haptic and electronic device having haptic function |
CN104898842B (en) * | 2015-06-01 | 2017-11-07 | 东南大学 | The wearable fingerstall type force haptic interaction device and implementation method of facing moving terminal |
CN105138223B (en) * | 2015-08-27 | 2018-06-22 | 东南大学 | A kind of object pliability reproducting method based on fingerstall type force haptic interaction device |
CN105607787A (en) * | 2015-10-16 | 2016-05-25 | 宇龙计算机通信科技(深圳)有限公司 | Terminal as well as control method and control device thereof |
CN105630238B (en) * | 2015-12-22 | 2018-03-06 | 武汉华星光电技术有限公司 | Touch control display apparatus and its driving method with tactile feedback function |
US9928696B2 (en) | 2015-12-30 | 2018-03-27 | Immersion Corporation | Externally-activated haptic devices and systems |
EP3270262A1 (en) * | 2016-07-12 | 2018-01-17 | Vestel Elektronik Sanayi ve Ticaret A.S. | Touch-screen control device with haptic feedback |
US10261586B2 (en) | 2016-10-11 | 2019-04-16 | Immersion Corporation | Systems and methods for providing electrostatic haptic effects via a wearable or handheld device |
JP6797406B2 (en) * | 2016-11-04 | 2020-12-09 | 高知県公立大学法人 | Contact type input device |
US10534435B2 (en) * | 2016-11-18 | 2020-01-14 | Immersion Corporation | Handheld interface device having a plurality of electrostatic friction (ESF) electrodes |
JP7083236B2 (en) * | 2016-11-21 | 2022-06-10 | 天馬微電子有限公司 | Electric vibration type tactile presentation device and electronic equipment |
JP2018132929A (en) * | 2017-02-15 | 2018-08-23 | 株式会社デンソーテン | Control device and control method |
US11435829B2 (en) | 2017-10-26 | 2022-09-06 | Weft Co. | Communication device and method using haptic actuator |
US11537242B2 (en) | 2018-03-29 | 2022-12-27 | Cirrus Logic, Inc. | Q-factor enhancement in resonant phase sensing of resistive-inductive-capacitive sensors |
JPWO2019244716A1 (en) * | 2018-06-19 | 2021-06-24 | ソニーグループ株式会社 | Information processing equipment, information processing methods, and programs |
TWI698781B (en) | 2018-12-10 | 2020-07-11 | 財團法人工業技術研究院 | Measurement system and measurement method using the same |
US10948313B2 (en) * | 2019-02-26 | 2021-03-16 | Cirrus Logic, Inc. | Spread spectrum sensor scanning using resistive-inductive-capacitive sensors |
US11402946B2 (en) | 2019-02-26 | 2022-08-02 | Cirrus Logic, Inc. | Multi-chip synchronization in sensor applications |
US11536758B2 (en) | 2019-02-26 | 2022-12-27 | Cirrus Logic, Inc. | Single-capacitor inductive sense systems |
US11579030B2 (en) | 2020-06-18 | 2023-02-14 | Cirrus Logic, Inc. | Baseline estimation for sensor system |
US11835410B2 (en) | 2020-06-25 | 2023-12-05 | Cirrus Logic Inc. | Determination of resonant frequency and quality factor for a sensor system |
US11868540B2 (en) | 2020-06-25 | 2024-01-09 | Cirrus Logic Inc. | Determination of resonant frequency and quality factor for a sensor system |
US11619519B2 (en) | 2021-02-08 | 2023-04-04 | Cirrus Logic, Inc. | Predictive sensor tracking optimization in multi-sensor sensing applications |
US11644907B2 (en) * | 2021-02-26 | 2023-05-09 | Logitech Europe S.A. | Systems, devices, and methods for physical surface tracking with a stylus device in an AR/VR environment |
US11808669B2 (en) | 2021-03-29 | 2023-11-07 | Cirrus Logic Inc. | Gain and mismatch calibration for a phase detector used in an inductive sensor |
US11821761B2 (en) | 2021-03-29 | 2023-11-21 | Cirrus Logic Inc. | Maximizing dynamic range in resonant sensing |
US11507199B2 (en) | 2021-03-30 | 2022-11-22 | Cirrus Logic, Inc. | Pseudo-differential phase measurement and quality factor compensation |
US11979115B2 (en) | 2021-11-30 | 2024-05-07 | Cirrus Logic Inc. | Modulator feedforward compensation |
US11854738B2 (en) | 2021-12-02 | 2023-12-26 | Cirrus Logic Inc. | Slew control for variable load pulse-width modulation driver and load sensing |
EP4202606A1 (en) * | 2021-12-21 | 2023-06-28 | Nokia Technologies Oy | User-device interaction |
Citations (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5386219A (en) * | 1991-10-16 | 1995-01-31 | International Business Machines Corp. | Touch overlay for improved touch sensitivity |
US5709219A (en) * | 1994-01-27 | 1998-01-20 | Microsoft Corporation | Method and apparatus to create a complex tactile sensation |
US5942970A (en) * | 1998-10-08 | 1999-08-24 | Norman; Jim | Image optical-to-tactile converter |
US20020082710A1 (en) * | 1997-04-29 | 2002-06-27 | Goran Lundborg | Artificial sensibility |
US20020191011A1 (en) * | 2001-06-04 | 2002-12-19 | Firooz Rasouli | Virtual remote touch system |
US6793619B1 (en) * | 1999-06-09 | 2004-09-21 | Yaacov Blumental | Computer-implemented method and system for giving a user an impression of tactile feedback |
US20050014560A1 (en) * | 2003-05-19 | 2005-01-20 | Yacob Blumenthal | Method and system for simulating interaction with a pictorial representation of a model |
US20050245302A1 (en) * | 2004-04-29 | 2005-11-03 | Microsoft Corporation | Interaction between objects and a virtual environment display |
US20060024647A1 (en) * | 2004-07-30 | 2006-02-02 | France Telecom | Method and apparatus for communicating graphical information to a visually impaired person using haptic feedback |
US20060026536A1 (en) * | 2004-07-30 | 2006-02-02 | Apple Computer, Inc. | Gestures for touch sensitive input devices |
US20080024459A1 (en) * | 2006-07-31 | 2008-01-31 | Sony Corporation | Apparatus and method for touch screen interaction based on tactile feedback and pressure measurement |
US20080303795A1 (en) * | 2007-06-08 | 2008-12-11 | Lowles Robert J | Haptic display for a handheld electronic device |
US20090079550A1 (en) * | 2007-09-18 | 2009-03-26 | Senseg Oy | Method and apparatus for sensory stimulation |
US20090153365A1 (en) * | 2004-11-18 | 2009-06-18 | Fabio Salsedo | Portable haptic interface |
US20090251421A1 (en) * | 2008-04-08 | 2009-10-08 | Sony Ericsson Mobile Communications Ab | Method and apparatus for tactile perception of digital images |
US20100085169A1 (en) * | 2008-10-02 | 2010-04-08 | Ivan Poupyrev | User Interface Feedback Apparatus, User Interface Feedback Method, and Program |
US20100151426A1 (en) * | 2005-12-08 | 2010-06-17 | Eye Plus Plus, Inc. | Electric tactile display |
US7755744B1 (en) * | 2007-08-15 | 2010-07-13 | Thomas Leberer | Environment sensor that conveys information about objects in the vicinity of the visually impaired user |
US20100231550A1 (en) * | 2009-03-12 | 2010-09-16 | Immersion Corporation | Systems and Methods for Friction Displays and Additional Haptic Effects |
US20110037707A1 (en) * | 2009-08-17 | 2011-02-17 | Nokia Corporation | Apparatus comprising an optically transparent sheet and related methods |
US20110079449A1 (en) * | 2009-10-05 | 2011-04-07 | Nokia Corporation | Generating perceptible touch stimulus |
US20110109584A1 (en) * | 2009-11-12 | 2011-05-12 | Jukka Linjama | Tactile stimulation apparatus having a composite section comprising a semiconducting material |
US20110181547A1 (en) * | 2004-02-23 | 2011-07-28 | Stantum | Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen |
US20110248962A1 (en) * | 2010-04-07 | 2011-10-13 | Sony Corporation | Information presenting device, tactile sense presenting method, and program |
US20110261002A1 (en) * | 2010-04-27 | 2011-10-27 | Microsoft Corporation | Displaying images on solid surfaces |
US20110276891A1 (en) * | 2010-05-06 | 2011-11-10 | Marc Ecko | Virtual art environment |
US20110279250A1 (en) * | 2010-05-12 | 2011-11-17 | Nokia Corporation | Detecting Touch Input and Generating Perceptible Touch Stimulus |
US20110286156A1 (en) * | 2010-05-20 | 2011-11-24 | Nokia Corporation | Generating Perceptible Touch Stimulus |
US20110285667A1 (en) * | 2010-05-21 | 2011-11-24 | Ivan Poupyrev | Electrovibration for touch surfaces |
US20120038559A1 (en) * | 2010-08-13 | 2012-02-16 | Nokia Corporation | Generating Perceptible Touch Stimulus |
US20120268412A1 (en) * | 2011-04-22 | 2012-10-25 | Immersion Corporation | Electro-vibrotactile display |
US8330729B2 (en) * | 2005-03-09 | 2012-12-11 | The University Of Tokyo | Electric tactile sense presenting device and electric tactile sense presenting method |
US20120327006A1 (en) * | 2010-05-21 | 2012-12-27 | Disney Enterprises, Inc. | Using tactile feedback to provide spatial awareness |
US20130093501A1 (en) * | 2010-06-07 | 2013-04-18 | The University Of Electro-Communications | Electrical stimulation device and electrical stimulation method |
US20140139327A1 (en) * | 2012-11-19 | 2014-05-22 | Disney Enterprises, Inc. | Controlling a user's tactile perception in a dynamic physical environment |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3929881B2 (en) * | 2001-12-04 | 2007-06-13 | 独立行政法人科学技術振興機構 | Skin sensation presentation device |
JP2004319255A (en) * | 2003-04-16 | 2004-11-11 | Equos Research Co Ltd | Pseudo tactile presentation device |
TWI271923B (en) * | 2005-03-01 | 2007-01-21 | Realtek Semiconductor Corp | Variable gain amplifier maintaining constant DC offset at output end |
FI20085475A0 (en) * | 2008-05-19 | 2008-05-19 | Senseg Oy | Touch Device Interface |
US8805517B2 (en) | 2008-12-11 | 2014-08-12 | Nokia Corporation | Apparatus for providing nerve stimulation and related methods |
-
2011
- 2011-04-22 US US13/092,572 patent/US9501145B2/en active Active
- 2011-04-22 US US13/092,564 patent/US20110285666A1/en not_active Abandoned
- 2011-05-20 JP JP2011113888A patent/JP5948021B2/en active Active
Patent Citations (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5386219A (en) * | 1991-10-16 | 1995-01-31 | International Business Machines Corp. | Touch overlay for improved touch sensitivity |
US5709219A (en) * | 1994-01-27 | 1998-01-20 | Microsoft Corporation | Method and apparatus to create a complex tactile sensation |
US20020082710A1 (en) * | 1997-04-29 | 2002-06-27 | Goran Lundborg | Artificial sensibility |
US5942970A (en) * | 1998-10-08 | 1999-08-24 | Norman; Jim | Image optical-to-tactile converter |
US6793619B1 (en) * | 1999-06-09 | 2004-09-21 | Yaacov Blumental | Computer-implemented method and system for giving a user an impression of tactile feedback |
US20020191011A1 (en) * | 2001-06-04 | 2002-12-19 | Firooz Rasouli | Virtual remote touch system |
US20050014560A1 (en) * | 2003-05-19 | 2005-01-20 | Yacob Blumenthal | Method and system for simulating interaction with a pictorial representation of a model |
US20110181547A1 (en) * | 2004-02-23 | 2011-07-28 | Stantum | Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen |
US20050245302A1 (en) * | 2004-04-29 | 2005-11-03 | Microsoft Corporation | Interaction between objects and a virtual environment display |
US20060024647A1 (en) * | 2004-07-30 | 2006-02-02 | France Telecom | Method and apparatus for communicating graphical information to a visually impaired person using haptic feedback |
US20060026536A1 (en) * | 2004-07-30 | 2006-02-02 | Apple Computer, Inc. | Gestures for touch sensitive input devices |
US20090153365A1 (en) * | 2004-11-18 | 2009-06-18 | Fabio Salsedo | Portable haptic interface |
US8330729B2 (en) * | 2005-03-09 | 2012-12-11 | The University Of Tokyo | Electric tactile sense presenting device and electric tactile sense presenting method |
US20100151426A1 (en) * | 2005-12-08 | 2010-06-17 | Eye Plus Plus, Inc. | Electric tactile display |
US20080024459A1 (en) * | 2006-07-31 | 2008-01-31 | Sony Corporation | Apparatus and method for touch screen interaction based on tactile feedback and pressure measurement |
US20080303795A1 (en) * | 2007-06-08 | 2008-12-11 | Lowles Robert J | Haptic display for a handheld electronic device |
US7755744B1 (en) * | 2007-08-15 | 2010-07-13 | Thomas Leberer | Environment sensor that conveys information about objects in the vicinity of the visually impaired user |
US20090079550A1 (en) * | 2007-09-18 | 2009-03-26 | Senseg Oy | Method and apparatus for sensory stimulation |
US20090251421A1 (en) * | 2008-04-08 | 2009-10-08 | Sony Ericsson Mobile Communications Ab | Method and apparatus for tactile perception of digital images |
US20100085169A1 (en) * | 2008-10-02 | 2010-04-08 | Ivan Poupyrev | User Interface Feedback Apparatus, User Interface Feedback Method, and Program |
US8330590B2 (en) * | 2008-10-02 | 2012-12-11 | Sony Corporation | User interface feedback apparatus, user interface feedback method, and program |
US20100231550A1 (en) * | 2009-03-12 | 2010-09-16 | Immersion Corporation | Systems and Methods for Friction Displays and Additional Haptic Effects |
US20110037707A1 (en) * | 2009-08-17 | 2011-02-17 | Nokia Corporation | Apparatus comprising an optically transparent sheet and related methods |
US20130215065A1 (en) * | 2009-08-17 | 2013-08-22 | Nokia Corporation | Apparatus Comprising An Optically Transparent Sheet And Related Methods |
US8441465B2 (en) * | 2009-08-17 | 2013-05-14 | Nokia Corporation | Apparatus comprising an optically transparent sheet and related methods |
US20110079449A1 (en) * | 2009-10-05 | 2011-04-07 | Nokia Corporation | Generating perceptible touch stimulus |
US8779307B2 (en) * | 2009-10-05 | 2014-07-15 | Nokia Corporation | Generating perceptible touch stimulus |
US20110109584A1 (en) * | 2009-11-12 | 2011-05-12 | Jukka Linjama | Tactile stimulation apparatus having a composite section comprising a semiconducting material |
US20110248962A1 (en) * | 2010-04-07 | 2011-10-13 | Sony Corporation | Information presenting device, tactile sense presenting method, and program |
US20110261002A1 (en) * | 2010-04-27 | 2011-10-27 | Microsoft Corporation | Displaying images on solid surfaces |
US20110276891A1 (en) * | 2010-05-06 | 2011-11-10 | Marc Ecko | Virtual art environment |
US20110279250A1 (en) * | 2010-05-12 | 2011-11-17 | Nokia Corporation | Detecting Touch Input and Generating Perceptible Touch Stimulus |
US8791800B2 (en) * | 2010-05-12 | 2014-07-29 | Nokia Corporation | Detecting touch input and generating perceptible touch stimulus |
US20110286156A1 (en) * | 2010-05-20 | 2011-11-24 | Nokia Corporation | Generating Perceptible Touch Stimulus |
US20120327006A1 (en) * | 2010-05-21 | 2012-12-27 | Disney Enterprises, Inc. | Using tactile feedback to provide spatial awareness |
US20110285667A1 (en) * | 2010-05-21 | 2011-11-24 | Ivan Poupyrev | Electrovibration for touch surfaces |
US20130093501A1 (en) * | 2010-06-07 | 2013-04-18 | The University Of Electro-Communications | Electrical stimulation device and electrical stimulation method |
US20120038559A1 (en) * | 2010-08-13 | 2012-02-16 | Nokia Corporation | Generating Perceptible Touch Stimulus |
US20120268412A1 (en) * | 2011-04-22 | 2012-10-25 | Immersion Corporation | Electro-vibrotactile display |
US20140139327A1 (en) * | 2012-11-19 | 2014-05-22 | Disney Enterprises, Inc. | Controlling a user's tactile perception in a dynamic physical environment |
Non-Patent Citations (13)
Title |
---|
Beebe et al, "A Polyimide-on-silicon Electrostatic Fingertip Tactile Display", 1995, IEEE-EMBC and CMBEC, Theme: Instrumentation, pages 1545-1546 * |
Butler et al, (2008). Object appreciation through haptic interaction. In Hello! Where are you in the landscape of educational technology? Proceedings ascilite Melbourne 2008 downloaded from http://www.ascilite.org.au/conferences/melbourne08/procs/butler-m.pdf, pages 133-141 * |
Campbell et al, "What you feel must be what you see: adding tactile feedback to the trackpoint." In IFIP Interact'99, (Edinburgh, UK), IOS Press, 383-390 * |
Fish et al, "Conduction of Electrical Current to and Through the Human Body: A Review", Oct. 12, 2009, Eplasty 2009: e44, pages 1-11 * |
Grimnes, "Electrovibration, cutaneous sensaion of microampere current", 1983, Acta Physiol Scand 1983, 118, pages 19-25 * |
Kaczmarek et al, "Electrotactile and Vibrotactile Displays for Sensory Substitution Systems", 1991, IEEE Transactions on Biomedical Engineering, Vol 38, No. 1 pages 1-16 * |
Kaczmarek et al, "Electrotactile Haptic Display on the Fingertips: Preliminary Results", 1994, IEEE, pages 940-941 * |
Kaczmarek et al, "Polarity Effect in Electrovibration for Tactile Display", IEEE Transactions on Biomedical Engineering, Vol. 53, No. 10, pages 2047-2054, October 2006. * |
Kuphaldt, "Lessons in Electric Circuits - Volumn I, Chapter 3, Electrical Safety" 2000-2014, pages 1-40, downloaded September 10, 2014 at http://www.ibiblio.org/kuphaldt/electricCircuits/DC/DC_3.html * |
Mallinckrodt et al, "Perception by the Skin of Electrically Induced Vibrations" 1953, Science, Vol 118, pages 277-278 * |
Mallinckrodt et al, "Perception by the Skin of Electrically Induced Vibrations", 1953, Science, Vol 118, pages 277-278 * |
Strong et al, "An Electrotactile Display", 1970, IEEE Transactions on Man-Machine Systems, Vol. MMS-11, No. 1, pages 72-79 * |
Tang et al, "A Microfabricated Electrostatic Haptic Display for Persons with Visual Impairments", 1998, IEEE Transactions on Rehabilitation Engineering, Vol 6, No 3, pages 214-248 * |
Cited By (101)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11500487B2 (en) * | 2006-03-24 | 2022-11-15 | Northwestern University | Haptic device with indirect haptic feedback |
US20210255726A1 (en) * | 2006-03-24 | 2021-08-19 | Northwestern University | Haptic Device With Indirect Haptic Feedback |
US20110285667A1 (en) * | 2010-05-21 | 2011-11-24 | Ivan Poupyrev | Electrovibration for touch surfaces |
US9501145B2 (en) * | 2010-05-21 | 2016-11-22 | Disney Enterprises, Inc. | Electrovibration for touch surfaces |
US20120326999A1 (en) * | 2011-06-21 | 2012-12-27 | Northwestern University | Touch interface device and method for applying lateral forces on a human appendage |
US10007341B2 (en) * | 2011-06-21 | 2018-06-26 | Northwestern University | Touch interface device and method for applying lateral forces on a human appendage |
US20130248344A1 (en) * | 2012-03-23 | 2013-09-26 | Touchsensor Technologies, Llc | Touch responsive user interface with backlit graphics |
US9100022B2 (en) * | 2012-03-23 | 2015-08-04 | Touchsensor Technologies, Llc | Touch responsive user interface with backlit graphics |
WO2013151897A1 (en) * | 2012-04-02 | 2013-10-10 | Synaptics Incorporated | Systems and methods for dynamically modulating a user interface parameter using an input device |
US9442650B2 (en) | 2012-04-02 | 2016-09-13 | Synaptics Incorporated | Systems and methods for dynamically modulating a user interface parameter using an input device |
US20130321299A1 (en) * | 2012-05-31 | 2013-12-05 | Korea Institute Of Science And Technology | Electronic device having tactile display using squeeze film effect |
EP2885690A4 (en) * | 2012-08-20 | 2016-01-27 | Samsung Electronics Co Ltd | System and method for perceiving images with multimodal feedback |
US9280206B2 (en) | 2012-08-20 | 2016-03-08 | Samsung Electronics Co., Ltd. | System and method for perceiving images with multimodal feedback |
CN103631377A (en) * | 2012-08-27 | 2014-03-12 | 西门子公司 | Operating device for a technical system |
CN103631377B (en) * | 2012-08-27 | 2018-04-13 | 西门子公司 | Operation device for technological system |
US9904364B2 (en) * | 2012-08-27 | 2018-02-27 | Siemens Aktiengesellschaft | Operator control device for a technical system |
US20140059427A1 (en) * | 2012-08-27 | 2014-02-27 | Siemens Aktiengesellschaft | Operator Control Device for a Technical System |
KR102091597B1 (en) * | 2012-09-24 | 2020-03-20 | 엘지전자 주식회사 | Portable device and controlling method thereof |
KR20140039537A (en) * | 2012-09-24 | 2014-04-02 | 엘지전자 주식회사 | Portable device and controlling method thereof |
WO2014046390A1 (en) | 2012-09-24 | 2014-03-27 | Lg Electronics Inc. | Portable device and control method thereof |
EP2898394A4 (en) * | 2012-09-24 | 2016-04-20 | Lg Electronics Inc | Portable device and control method thereof |
CN110658921A (en) * | 2012-09-25 | 2020-01-07 | 诺基亚技术有限公司 | Method and display device with haptic feedback |
US10671165B2 (en) | 2012-09-25 | 2020-06-02 | Nokia Technologies Oy | Method and display device with tactile feedback |
EP2901256A4 (en) * | 2012-09-25 | 2016-05-25 | Nokia Technologies Oy | Method and display device with tactile feedback |
US9547430B2 (en) | 2012-10-10 | 2017-01-17 | Microsoft Technology Licensing, Llc | Provision of haptic feedback for localization and data input |
JP2020074103A (en) * | 2012-10-31 | 2020-05-14 | イマージョン コーポレーションImmersion Corporation | Method and device for simulating surface feature on user interface by using haptic effect |
US9727142B2 (en) * | 2012-10-31 | 2017-08-08 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
US20160085307A1 (en) * | 2012-10-31 | 2016-03-24 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
EP2728445A3 (en) * | 2012-10-31 | 2014-06-18 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
US9196134B2 (en) * | 2012-10-31 | 2015-11-24 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
US20190121437A1 (en) * | 2012-10-31 | 2019-04-25 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
US10591994B2 (en) * | 2012-10-31 | 2020-03-17 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
US10139912B2 (en) | 2012-10-31 | 2018-11-27 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
CN103793051A (en) * | 2012-10-31 | 2014-05-14 | 英默森公司 | Method and apparatus for simulating surface features on user interface with haptic effect |
US20140118127A1 (en) * | 2012-10-31 | 2014-05-01 | Immersion Corporation | Method and apparatus for simulating surface features on a user interface with haptic effects |
US9122330B2 (en) | 2012-11-19 | 2015-09-01 | Disney Enterprises, Inc. | Controlling a user's tactile perception in a dynamic physical environment |
CN103838424A (en) * | 2012-11-20 | 2014-06-04 | 伊梅森公司 | System and method for feedforward and feedback with haptic effects |
EP3258345A1 (en) * | 2012-11-20 | 2017-12-20 | Immersion Corporation | System and method for feedforward and feedback with haptic effects |
US9330544B2 (en) | 2012-11-20 | 2016-05-03 | Immersion Corporation | System and method for simulated physical interactions with haptic effects |
EP2733576A1 (en) * | 2012-11-20 | 2014-05-21 | Immersion Corporation | System and method for simulated physical interactions with haptic effects |
EP3217261A1 (en) * | 2012-11-20 | 2017-09-13 | Immersion Corporation | System and method for simulated physical interactions with haptic effects |
EP2733575A1 (en) * | 2012-11-20 | 2014-05-21 | Immersion Corporation | System and method for feedforward and feedback with haptic effects |
US9836150B2 (en) | 2012-11-20 | 2017-12-05 | Immersion Corporation | System and method for feedforward and feedback with haptic effects |
CN104049748A (en) * | 2013-03-15 | 2014-09-17 | 英默森公司 | User interface device provided with surface haptic sensations |
KR101416720B1 (en) | 2013-06-13 | 2014-07-14 | 한국표준과학연구원 | Haptic feedback generating apparatus using frictional force generated by electrostatic force and vibration using resonant frequency, method for controlling using the same and recording medium thereof |
CN104662495A (en) * | 2013-09-26 | 2015-05-27 | 富士通株式会社 | Drive control apparatus, electronic device, and drive control method |
US9400571B2 (en) * | 2013-09-26 | 2016-07-26 | Fujitsu Limited | Drive controlling apparatus, electronic device and drive controlling method |
US20140347322A1 (en) * | 2013-09-26 | 2014-11-27 | Fujitsu Limited | Drive controlling apparatus, electronic device and drive controlling method |
EP3521980A1 (en) * | 2013-12-31 | 2019-08-07 | Immersion Corporation | Systems and methods for providing haptic notifications |
US20150185848A1 (en) * | 2013-12-31 | 2015-07-02 | Immersion Corporation | Friction augmented controls and method to convert buttons of touch control panels to friction augmented controls |
CN104345962A (en) * | 2014-02-24 | 2015-02-11 | 东莞市骏达触控科技有限公司 | Portable electronic product, touch screen and touch screen preparation method |
US10496174B2 (en) * | 2014-07-02 | 2019-12-03 | Immersion Corporation | Systems and methods for surface elements that provide electrostatic haptic effects |
US10108267B2 (en) * | 2014-07-02 | 2018-10-23 | Immersion Corporation | Systems and methods for surface elements that provide electrostatic haptic effects |
US20190129503A1 (en) * | 2014-07-02 | 2019-05-02 | Immersion Corporation | Systems and methods for surface elements that provide electrostatic haptic effects |
US10281997B2 (en) | 2014-09-30 | 2019-05-07 | Hewlett-Packard Development Company, L.P. | Identification of an object on a touch-sensitive surface |
WO2016053271A1 (en) * | 2014-09-30 | 2016-04-07 | Hewlett-Packard Development Company L. P. | Identification of an object on a touch-sensitive surface |
CN104635984A (en) * | 2015-01-21 | 2015-05-20 | 北京大学 | Single-surface position sensor and positioning method thereof |
US10712893B2 (en) | 2015-01-21 | 2020-07-14 | Peking University | Single-surface position sensor and positioning method thereof |
WO2016115648A1 (en) * | 2015-01-21 | 2016-07-28 | 北京大学 | Single-surface position sensor and positioning method thereof |
US10216338B2 (en) * | 2015-04-21 | 2019-02-26 | Fujitsu Limited | Electronic device |
US11609427B2 (en) | 2015-10-16 | 2023-03-21 | Ostendo Technologies, Inc. | Dual-mode augmented/virtual reality (AR/VR) near-eye wearable displays |
US9652069B1 (en) | 2015-10-22 | 2017-05-16 | Synaptics Incorporated | Press hard and move gesture |
US9823767B2 (en) | 2015-10-22 | 2017-11-21 | Synaptics Incorporated | Press and move gesture |
US11106273B2 (en) | 2015-10-30 | 2021-08-31 | Ostendo Technologies, Inc. | System and methods for on-body gestural interfaces and projection displays |
US10345594B2 (en) | 2015-12-18 | 2019-07-09 | Ostendo Technologies, Inc. | Systems and methods for augmented near-eye wearable displays |
US10585290B2 (en) | 2015-12-18 | 2020-03-10 | Ostendo Technologies, Inc | Systems and methods for augmented near-eye wearable displays |
US11598954B2 (en) | 2015-12-28 | 2023-03-07 | Ostendo Technologies, Inc. | Non-telecentric emissive micro-pixel array light modulators and methods for making the same |
US10578882B2 (en) | 2015-12-28 | 2020-03-03 | Ostendo Technologies, Inc. | Non-telecentric emissive micro-pixel array light modulators and methods of fabrication thereof |
US11048089B2 (en) | 2016-04-05 | 2021-06-29 | Ostendo Technologies, Inc. | Augmented/virtual reality near-eye displays with edge imaging lens comprising a plurality of display devices |
US10983350B2 (en) | 2016-04-05 | 2021-04-20 | Ostendo Technologies, Inc. | Augmented/virtual reality near-eye displays with edge imaging lens comprising a plurality of display devices |
US10353203B2 (en) | 2016-04-05 | 2019-07-16 | Ostendo Technologies, Inc. | Augmented/virtual reality near-eye displays with edge imaging lens comprising a plurality of display devices |
US20170295393A1 (en) * | 2016-04-06 | 2017-10-12 | Humax Co., Ltd. | Media system for providing a user profile using force input and method for providing a personalized service in the same |
US10598388B2 (en) | 2016-04-07 | 2020-03-24 | Electrolux Home Products, Inc. | Appliance with electrovibration user feedback in a touch panel interface |
US11145276B2 (en) | 2016-04-28 | 2021-10-12 | Ostendo Technologies, Inc. | Integrated near-far light field display systems |
US10453431B2 (en) | 2016-04-28 | 2019-10-22 | Ostendo Technologies, Inc. | Integrated near-far light field display systems |
US10522106B2 (en) | 2016-05-05 | 2019-12-31 | Ostendo Technologies, Inc. | Methods and apparatus for active transparency modulation |
US11340710B2 (en) | 2016-06-08 | 2022-05-24 | Architectronics Inc. | Virtual mouse |
US10838504B2 (en) | 2016-06-08 | 2020-11-17 | Stephen H. Lewis | Glass mouse |
US10908688B2 (en) | 2016-10-21 | 2021-02-02 | Tianma Microelectronics Co., Ltd. | Tactile presentation device and control method |
US11822725B2 (en) | 2016-10-21 | 2023-11-21 | Tianma Microelectronics Co., Ltd. | Tactile presentation device and control method |
US11353961B2 (en) | 2016-10-21 | 2022-06-07 | Tianma Microelectronics Co., Ltd. | Tactile presentation device and control method |
US10747320B2 (en) * | 2016-11-21 | 2020-08-18 | Tianma Microelectronics Co., Ltd. | Tactile presentation device and electronic equipment |
CN108089698A (en) * | 2016-11-21 | 2018-05-29 | 天马日本株式会社 | Tactile prompt device and electronic equipment |
US20180143691A1 (en) * | 2016-11-21 | 2018-05-24 | Tianma Japan, Ltd. | Tactile presentation device and electronic equipment |
CN106601080A (en) * | 2016-12-28 | 2017-04-26 | 北京握奇智能科技有限公司 | Device displaying Braille and safe transaction system containing same |
CN108345379A (en) * | 2017-01-25 | 2018-07-31 | 意美森公司 | The method and apparatus that electrostatic friction effect for controlling multiple electrodes generates |
US10249157B2 (en) | 2017-01-25 | 2019-04-02 | Immersion Corporation | Method and apparatus for controlling generation of electrostatic friction effects for a plurality of electrodes |
EP3355166A1 (en) * | 2017-01-25 | 2018-08-01 | Immersion Corporation | Method and apparatus for controlling generation of electrostatic friction effects for a plurality of electrodes |
CN108459763A (en) * | 2017-02-20 | 2018-08-28 | 罗伯特·博世有限公司 | Input interface |
US10082875B1 (en) | 2017-06-05 | 2018-09-25 | Korea Institute Of Science And Technology | Vibrating apparatus, system and method for generating tactile stimulation |
US11132095B2 (en) | 2017-08-07 | 2021-09-28 | Mitsubishi Electric Corporation | Tactile presentation panel, tactile presentation touch panel, and tactile presentation touch display |
US10649531B2 (en) | 2018-02-01 | 2020-05-12 | Microsoft Technology Licensing, Llc | Haptic effect on a touch input surface |
WO2019152200A1 (en) * | 2018-02-01 | 2019-08-08 | Microsoft Technology Licensing, Llc | Haptic effect on a touch input surface |
US11144127B1 (en) * | 2019-04-17 | 2021-10-12 | Beihang University | Active texture presentation apparatus driven by high-density flexible electromagnetic coil array |
WO2020211305A1 (en) * | 2019-04-17 | 2020-10-22 | 北京航空航天大学 | Active texture presentation apparatus based on high-density flexible electromagnetic coil array driving |
US11520406B2 (en) | 2019-05-28 | 2022-12-06 | Tanvas, Inc. | Bipolar projected haptics with balanced loading |
WO2020243236A1 (en) * | 2019-05-28 | 2020-12-03 | Tanvas, Inc. | Bipolar projected haptics with balanced loading |
US11899843B2 (en) | 2019-05-28 | 2024-02-13 | Tanvas Magic Inc. | Bipolar projected haptics with balanced loading |
EP3770728A1 (en) * | 2019-07-26 | 2021-01-27 | SABIC Global Technologies B.V. | Thin-film-based triboelectric actuator |
US11797094B2 (en) | 2019-09-19 | 2023-10-24 | Mitsubishi Electric Corporation | Haptic presentation touch panel and display apparatus |
CN112504957A (en) * | 2020-11-03 | 2021-03-16 | 北京信息科技大学 | Method for testing surface friction characteristic of deterministic texture by fingers |
Also Published As
Publication number | Publication date |
---|---|
US9501145B2 (en) | 2016-11-22 |
JP5948021B2 (en) | 2016-07-06 |
JP2011248884A (en) | 2011-12-08 |
US20110285667A1 (en) | 2011-11-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9501145B2 (en) | Electrovibration for touch surfaces | |
US20120327006A1 (en) | Using tactile feedback to provide spatial awareness | |
Bau et al. | TeslaTouch: electrovibration for touch surfaces | |
US9639158B2 (en) | Systems and methods for generating friction and vibrotactile effects | |
US9122330B2 (en) | Controlling a user's tactile perception in a dynamic physical environment | |
US10175761B2 (en) | Haptic output device and method of generating a haptic effect in a haptic output device | |
EP2304524B1 (en) | Interface apparatus for touch input and tactile output communication | |
CN104750309B (en) | The button of touch panel is converted into rubbing the method and system of enhanced control | |
CN103838421B (en) | For providing the tactile cue for being used for guidance and the method and apparatus with electrostatic friction calibration | |
JP6234364B2 (en) | Electric vibration type tactile display | |
CN105353877B (en) | System and method for rub display and additional tactile effect | |
US20120127088A1 (en) | Haptic input device | |
KR20090082714A (en) | Display device and method for sensing input point using magnetic fluid | |
Wang et al. | Enhancing pen-based interaction using electrovibration and vibration haptic feedback |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: DISNEY ENTERPRISES, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:POUPYREV, IVAN;BAU, OLIVIER;ISRAR, ALI;AND OTHERS;SIGNING DATES FROM 20110420 TO 20110503;REEL/FRAME:026259/0939 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |