Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
  • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
  • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
  • G06F3/03547—Touch pads, in which fingers can move on a surface
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
  • G06F2203/01—Indexing scheme relating to G06F3/01
  • G06F2203/013—Force feedback applied to a game
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
  • G06F2203/01—Indexing scheme relating to G06F3/01
  • G06F2203/014—Force feedback applied to GUI
• • H—ELECTRICITY
  • H01—ELECTRIC ELEMENTS
  • H01H—ELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
  • H01H2203/00—Form of contacts
  • H01H2203/008—Wires
  • H01H2203/0085—Layered switches integrated into garment, clothes or textile

Definitions

• the present disclosure relates to an interface device and method for providing haptic and thermal feedback.
• Document US9827811B1 discloses a vehicular haptic feedback system including a haptic feedback controller configured to communicate with a vehicle.
• the haptic feedback controller including a plurality of haptic feedback actuators and processing circuitry configured to detect quality of operation information of the vehicle, a direction and an intensity of threat information corresponding to the vehicle, and a mode of operation of the vehicle.
• the haptic feedback controller is also configured to determine a desired direction of travel of the vehicle based on the quality of operation information, the direction and the intensity of threat information, and the mode of operation.
• the haptic feedback controller is further configured to provide haptic feedback corresponding to the quality of operation information, the direction and the intensity of threat information, the mode of operation and the desired direction of travel of the vehicle, via the plurality of haptic feedback actuators.
• Document US2016238040 discloses a multimodal haptic device operating as a closed-loop system, the device including a pipeline configured to allow a closed-loop flow of a fluid medium, a manifold operatively connected to the pipeline, the manifold having a pump and a valve to control and regulate a flow of the fluid medium along the pipeline, and a display unit operatively connected to the pipeline, the display unit having a tactile display and a valve operatively connected to the tactile display for regulating an efflux of the fluid medium from the tactile display into the pipeline.
• Document US20200264772A1 discloses a method for providing haptic feedback to an operator of a touch-sensitive display device.
• the method includes providing an operator interface to be represented in the display device as image data; the operator interface having at least one button assigned to a function to be controlled, graphically displayed in the operator interface, and graphically delimited from the rest of the operator interface; analysing the image data for a presence and a position of shapes for representing a button; determining an intended display region of a shape, which is to be represented and is identified as a button; representing the image data of the operator interface in the touch-sensitive display device; outputting haptic feedback in response to detection of contact with the touch-sensitive display device in the region of a surface of the touch-sensitive display device which is assigned to a display region of a shape identified as a button.
• the present disclosure relates to an interface device and method for providing capacitive, haptic and thermal feedback, herein called smart surface.
• Haptic feedback in devices and surfaces has commonly been achieved through vibrotactile stimuli, generated from mechanical actuators (e.g., EP3582074A1). More recently, new haptic technologies have emerged that make use of other actuation types, such as electro vibration, to generate other types of tactile feedback beyond just vibrations (e.g., US10768749B2).
• Thermal sensations play a big role in tactile perception, and, therefore, thermal display functions must be developed to increase the perception of realism on displays, making the interactions with them more satisfactory for users.
• the present disclosure is employable either inside a level 5 autonomous vehicle, or in passenger compartments that have seats with armrests, with the goal of increasing the user's experience while going about their commutes on these vehicles.
• the smart surface comprises, at least, 5 layers.
• a first layer is an insulative layer, fitted atop a transparent and conductive electrode sheet layer, which is in turn fitted atop a capacitive-based touch sensitive layer, which, when charged with an electric current and when in contact with the human skin, produces a frictional stimulus by controlling the electric current.
• This structure is fitted atop of a layer composed of either liquid metal (e.g., Galinstan, composed by gallium, indium, and tin, as seen in Hirai & Miki, 2019)), in contact with a titanium plate, with the amount of liquid which is in contact with this plate determining the thermal conductivity (the thermal conductivity of the device's surface layer can be determined by the amount of liquid metal which is in contact with this layer) of the device's surface layer, or a layer of solid- state Peltier elements (cold side facing the layer on top, hot side and heat sink facing the layer below), which can vary the temperature of the top surface layer.
• This layer is, in turn, fitted atop a layer of vibrotactile actuators.
• the insulative layer should be electrically insulative, so that electro adhesion can occur between the finger and the conductive electrode sheet, but thermally conductive, so that thermal changes can be perceived by the finger.
• This smart surface is to be employed as the interactive surface interface of a device to which it is not physically connected (e.g., touch surface interface communicating wirelessly with a display device in close proximity).
• the smart surface can generate both frictional and vibrotactile haptic sensations, as well as different thermal feedback sensations.
• Frictional haptic sensations are generated thanks to the insulative and conductive layers, which allow for friction between the smart surface and the user's skin to be modulated through electrostatic actuation, while the skin is in motion.
• Vibrotactile haptic sensations are generated thanks to the vibrotactile actuators, which can generate vibrations strong enough (e.g., 65Hz to 500Hz) to be felt through the user's skin, either stationary or in motion, when in direct contact with the smart surface.
• vibrations strong enough e.g., 65Hz to 500Hz
• Different thermal feedback stimuli sensations are generated by regulating the temperate of the top-most surface of the structure. Temperature regulation is controlled via software, which determines eitherthe amount of liquid metal that should be in contact with the surface layer to obtain the intended temperature, or controls how much power should be applied to the layer of Peltier element, so that the surface layer reaches the intended temperature.
• the smart surface When the smart surface is used as the interactive interface for an external device, capacitive, haptic, and thermal feedback sensations, programmed/controlled by the external device's software, can be generated on it, as long as the haptic and thermal actuation technology that is present on the smart surface is both capable of interpreting the software's information and of generating such sensations.
• the external device's software sends a command to the smart surface, requesting that it generates haptic and/or thermal feedback sensations on the surface layer, the hardware and/or software found on the smart layer must be capable of differentiating between those types of sensations, delegating actuation to the elements that control the actuators capable of generating the sensations requested.
• the capacitive, haptic and/or thermal feedback sensations of the smart surface are controlled by an external device which can be the same device that the smart surface is controlling (e.g., central stack) or other.
• the in-vehicle centre stack display and armrest surface has both haptic and thermal feedback capabilities. Both the centre stack display and the armrest surface are connected to any of the vehicle's power supplies supplies or one provided by the user (e.g., batteries), deriving power from it.
• An armrest equipped with this smart surface is attached to both the right and left side of the seat, with users being able to indicate, through a setting found on the vehicle's centre stack display's software, if they wish to receive haptic and thermal feedback sensations to be actuated on either armrest, on both armrests, or neither armrest.
• This setting is configurable for each seat found on the vehicle, as long as they have at least one armrest equipped with a smart surface as presented on this document.
• the armrest would be found on the right side of the seat, it is possible to have an armrest on both sides of each seat, has it been more natural, and leads to a more inclusive solution for the application.
• Haptic feedback sensations are generated though electrovibration and/or vibrotactile actuation, while thermal feedback sensations are generated through a layer that can manipulate the temperature of the outer most layer (the electrically insulative but thermally conductive layer) of the structure.
• Haptic feedback sensations include the sensation of different textures and edges (generated through electrovibration) or vibrations with different frequencies and intensities (generated through vibrotactile actuation).
• Thermal sensations include the increase or decrease of the temperature of the outer most layer of the structure, which can be achieved by either increasing or decreasing the amount of liquid metal which is in contact with the titanium plate, or the amount of power applied to the layer of Peltier element.
• These temperature variations can be implemented as part of the vehicle's User Interface elements, providing users with information regarding the state of different functions during interactions with interface elements (for example, when changing the temperature of the vehicle, the smart surface's temperature can increase or decrease according to the applied changes, confirming to users that their inputs are being registered), or to transmit information regarding warnings or information (for example, during a trip to a pre-determined location, the temperature of the armrest's smart surface can go from cold to warm as the vehicle gets closer to its destination).
• the in-vehicle centre stack display and armrest surface have both haptic and thermal feedback capabilities.
• Haptic feedback sensations are generated though electro vibration and/or vibrotactile actuation, while thermal feedback sensations are generated through a layer that can manipulate the temperature of the outer most layer of the structure.
• haptic sensations such as hitting different "bumps” with increasing intensities (that is, size and/or vibration amplitude) on the surface while dragging the finger along the slider area towards otter or colder values, with each bump signifying a new milestone, such as "20°C", “25°C” and "30°C”.
• the surface of the armrest's smart surface will also increase or decrease its temperature, at the point of contact, depending on the changes that are being made by the user.
• areas of the armrest's smart surface different User Interface elements are located and can be interacted with their location can be visually adjusted on the settings menu of the vehicle's centre stack display. Additionally, areas of the smart surface in which different User Interface control elements are found can be differentiated from each other by providing different and distinct texture sensations where the skin slides over them, informing users that they have moved from one area to another, or, when users have memorized which texture corresponds to which interface element, that they have come into contact with the intended area. However, it is expected that the perception of these sensations might be affected by conditions related to the user's hands.
• the use of gloves can completely negate electrovibration actuation, as the skin of the finger is required to complete the circuit with the insulating layer and the conductive layer of the structure, as well as severely attenuate or even completely mask the vibrations generated by the electrovibration actuators.
• High finger humidity in turn, can also negatively impair or outright negate the sensations generated by both electrovibration and vibrotactile actuators.
• a device could be a 7" display, 7 mm thick, powered through a socket provided by the vehicle specifically for the device, communication with the vehicle via ethernet, and with user devices via Wi-Fi.
• a touchpad device comprising an interface with haptic and thermal feedback for a user in an automotive setting, comprising: a haptic-feedback layer; a capacitive touch sensitive layer; a thermal-feedback layer assembly; and an electronic data processor configured to: drive the haptic-feedback layer and the thermal-feedback layer assembly to provide a haptic and thermal feedback as the user touches the touchpad device interface.
• the touchpad device can comprise a frictional haptic- feedback layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations.
• the touchpad device can comprise a vibrotactile haptic layer for providing vibrotactile haptic sensations.
• the thermal-feedback layer assembly comprises a liquid metal layer and a titanium plate for providing a predetermined thermal conductivity of the thermal feedback layer assembly.
• the electronic data processor is further configured to drive the haptic-feedback layer to exhibit a tactile texture when the user touches the touchpad device interface.
• the thermal-feedback layer assembly comprises a Peltier element for providing a predetermined heat flux to the thermal-feedback layer assembly.
• the electronic data processor is further configured to select a frictional or vibrotactile haptic feedback and to select a thermal conductivity or a heat flux, as a function of an image of a pattern or of an object to be displayed.
• the electronic data processor is further configured to display of an image of a pattern or of an object and select a frictional or vibrotactile haptic feedback and to select a thermal conductivity or a heat flux, as a function of the image of the pattern or the object displayed.
• Figure 1 Schematic representation of an embodiment of an interface with a capacitive, haptic, and thermal feedback on armrest and central display.
• Figure 2A shows a scheme of the layers, including when a liquid metal layer, in contact with a titanium plate, is used.
• Figure 2B shows a scheme of the layers, including when a layer of Peltier element, is used.
• Figure 3 shows a schematic representation of an embodiment of a touchpad device.
• the present disclosure relates to a touchpad device comprising an interface with haptic and thermal feedback for a user in an automotive setting, comprising: a haptic- feedback layer; a capacitive touch sensitive layer; a thermal-feedback layer assembly; and an electronic data processor configured to: drive the haptic-feedback layer and the thermal-feedback layer assembly to provide a haptic and thermal feedback as the user touches the touchpad device interface.
• the present disclosure also relates to a method of operation thereof comprising driving the haptic-feedback layer and the thermalfeedback layer assembly to provide a haptic and thermal feedback as the user touches the touchpad device interface and to a system thereof further comprising a display.
• Figure 1 shows a schematic representation of an embodiment of a touchpad device comprising an interface with haptic and thermal feedback for a user in an automotive setting, where 12 represents the seat and 14 represents the center stack display that the capacitive, haptic surface of the armrest is in contact with.
• a touchpad device can comprise an interface with haptic and thermal feedback for a user in an automotive setting, comprising: a haptic- feedback layer; a capacitive touch sensitive layer; a thermal-feedback layer assembly; and an electronic data processor configured to: drive the haptic-feedback layer and the thermal-feedback layer assembly to provide a haptic and thermal feedback as the user touches the touchpad device interface.
• Figure 2A shows a scheme of the layer's superposition, wherein A represents an insulative layer; B represents a capacitive-based touch sensitive layer; C represents a vibrotactile actuators layer; D represents a transparent electrode sheet layer and F represents a titanium plate and G represents a liquid metal layer.
• Figure 2B shows a scheme of the layer's superposition, wherein A represents an insulative layer; B represents a capacitive-based touch sensitive layer; C represents a vibrotactile actuators layer; D represents a transparent electrode sheet layer and E represents a Peltier element layer.
• a touchpad device comprising an interface with haptic and thermal feedback for a user 11 in an automotive setting, where 12 represents the seat, 13 represents the armrest with the capacitive, haptic surface, and 14 represents the centre stack display that the capacitive, haptic surface of the armrest is in contact with.
• the touchpad device can comprise a frictional haptic- feedback layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations and also the touchpad device can comprise a vibrotactile haptic layer for providing vibrotactile haptic sensations.

Landscapes

• Engineering & Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• User Interface Of Digital Computer (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=80787263

Family Applications (1)

Country Status (2)

Family Cites Families (7)

• 2021
  • 2021-12-30 WO PCT/IB2021/062472 patent/WO2023126660A1/en not_active Ceased
  • 2021-12-30 EP EP21856982.0A patent/EP4457588A1/de active Pending

Also Published As

Similar Documents

Legal Events