WO2023126645A1 - Dispositif d'interface et d'alerte à rétroaction haptique et thermique pour véhicule autonome - Google Patents

Dispositif d'interface et d'alerte à rétroaction haptique et thermique pour véhicule autonome Download PDF

Info

Publication number
WO2023126645A1
WO2023126645A1 PCT/IB2021/062384 IB2021062384W WO2023126645A1 WO 2023126645 A1 WO2023126645 A1 WO 2023126645A1 IB 2021062384 W IB2021062384 W IB 2021062384W WO 2023126645 A1 WO2023126645 A1 WO 2023126645A1
Authority
WO
WIPO (PCT)
Prior art keywords
haptic
layer
display
previous
frictional
Prior art date
Application number
PCT/IB2021/062384
Other languages
English (en)
Inventor
Pedro Miguel DE SOUSA BERNARDO
Vera Patricia CASTRO VILAS BOAS
Nélson Bruno MARTINS MARQUES COSTA
Manuel Sebastião MARQUES COUTINHO
Adriano Dídimo MACHADO CARVALHO
Rosane SCHONBLUM SAMPAIO
Marina MACHADO
Lisandra Maria ARAÚJO TEIXEIRA
Emanuel TEIXEIRA SILVA
José Pedro CORREIA DIAS
Original Assignee
Bosch Car Multimedia Portugal S.A
Universidade Do Minho
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bosch Car Multimedia Portugal S.A, Universidade Do Minho filed Critical Bosch Car Multimedia Portugal S.A
Publication of WO2023126645A1 publication Critical patent/WO2023126645A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • B60K35/10—
    • B60K35/22—
    • B60K35/25—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • B60K2360/1438—
    • B60K2360/682—
    • B60K2360/96—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/014—Force feedback applied to GUI

Definitions

  • the present disclosure relates to an interface and alert device with haptic and thermal feedback for autonomous vehicle.
  • Document US10899258 discloses an armrest arm having an upper support surface forming a support for the forearm of an occupant of the vehicle seat, and a user interface having at least one display portion of flattened shape, having a front face comprising a screen and a rear face formed by a shell.
  • the user interface is mounted on the armrest arm so as to be movable between a retracted position where the screen is inaccessible and an extended position where the screen is accessible.
  • the shell In the retracted position of the user interface, the shell is integrated with the upper support surface of the armrest arm, and in the extended position of the user interface, the screen is at least partially projecting above the upper support surface of the armrest arm.
  • Document US20170308224 discloses a touch control armrest sleeve which includes a body and a connecting portion.
  • the body includes a flexible pad, a flexible touch panel and a protective cover.
  • the connecting portion is connected to a first end and a second end of the body.
  • the flexible touch panel includes a flexible substrate and a carbon nanotube touch function layer.
  • a touch control seat incorporating such touch control armrest sleeve is also provided.
  • Document US8659554 discloses a moveable touch pad that opens out of a centre console armrest and is operable to control a navigation unit or other vehicle functions.
  • locating a control touch pad unit in the centre console armrest provides an ergonomically desirable solution for the vehicle's driver.
  • the touch pad can be stored in the vehicle's centre console armrest, and the touch pad is configured to move fore and aft for comfortable driver access.
  • Document US20200264772 discloses a method for providing haptic feedback to an operator of a touch-sensitive display device.
  • the method includes providing an operator interface to be represented in the display device as image data; the operator interface having at least one button assigned to a function to be controlled, graphically displayed in the operator interface, and graphically delimited from the rest of the operator interface; analysing the image data for a presence and a position of shapes for representing a button; determining an intended display region of a shape, which is to be represented and is identified as a button; representing the image data of the operator interface in the touch-sensitive display device; outputting haptic feedback in response to detection of contact with the touch-sensitive display device in the region of a surface of the touch-sensitive display device which is assigned to a display region of a shape identified as a button.
  • the present disclosure relates to an interface and alert device with haptic feedback for autonomous vehicle, comprising a smart surface positioned on the seat's armrest.
  • haptic feedback is only being used in touchscreens such as mobile phones, tablets, and other electronics. According to the literature (Basdogan et al., 2020), it is extremely challenging to design this type of technology and to implement it successfully on a surface that it is not a touchscreen whilst maintaining protection against dust or water. [0011] On the current applications of haptic feedback (mobile phones, etc.) there is still a long way to improve and to get the attention to the topic as visual and auditory feedback are still prominent in the market although it is also known that tactile feedback improves task performance and its realism.
  • Electromagnetic actuators which generate force which is proportional to a current
  • Vibration motors e.g., a DC motor with a rotor with eccentric mass distribution which creates rotational movement perceived as vibration by user
  • Piezoelectric actuators which are suitable for actuation of touch surface at high frequencies and generates high forces with a low displacement
  • Electroactive polymers which can change their shape in volume when electrically stimulated
  • Electrostatic actuators which produce a force that is proportional to the square of the voltage and can be generated on the finger's skin.
  • the smart surface comprises an insulative layer, fitted atop a transparent and conductive electrode sheet layer, which, when charged with an electric current and when in contact with the human skin, produces a frictional stimulus by controlling the electric current.
  • This layer is fitted atop a capacitive-based touch sensitive layer, fitted atop a layer of LED lights, which in turn are fitted atop a layer of vibrotactile actuators.
  • the layer of LEDs is optional and when not present the touch-sensitive layer is fitted atop a layer of vibrotactile actuators.
  • the vehicle seat's armrest possesses a portion of its surface functions as a capacitive touchpad surface, which can provide users, using their fingers or hands, with haptic feedback sensations, through electrovibration and/or vibrotactile actuation.
  • This smart surface is connected to the vehicle's infotainment system, and receives commands from it regarding when to engage and disengage the different actuation layers and LED lights of the LED layer.
  • the perception of haptic sensations generated by the haptic actuators might be affected by conditions related to the user's hands.
  • the use of gloves can completely negate electrovibration actuation, as the skin of the finger is required to complete the circuit with the insulating layer and the conductive layer of the structure, as well as severely attenuate or even completely mask the vibrations generated by the electrovibration actuators.
  • High finger humidity in turn, can also negatively impair or outright negate the sensations generated by both electrovibration and vibrotactile actuators.
  • This armrest smart surface is in communication (wired or wireless) with the vehicle's infotainment system that is visually displayed on the centre stack display's user interface, functioning as an extension of it, allowing users to interact with the display interface through this surface portion.
  • This armrest smart surface is also connected with the vehicle's own electronic system, by wire (e.g., ethernet) or wireless (e.g., Wi-Fi), allowing users to control several of the vehicle's functions, such as window, door, and media volume control through it. [0018] In an embodiment, it is capable of delivering warning information to the users while they are in direct contact with the surface, e.g., grabbing the user's attention through vibration warnings of alerts/messages/events.
  • wire e.g., ethernet
  • Wi-Fi wireless
  • warnings can also be accompanied by visual and/or auditory cues, to increase the probability that users that have access to either or both of these cues will receive the intended information, as one cannot ensure that users will always have their hands placed on top of the smart surface area of the armrest.
  • users can also select an option to enable the media content being played in the vehicle to be accompanied alongside vibrations, e.g., vibrotactile stimuli delivered in tune with the music currently being played (for example, tune's spectrogram is acquired through a software included on the vehicle's infotainment system, and vibrations are generated based on the said spectrogram data); or delivered during certain pre-selected moments during a movie clip.
  • vibrations e.g., vibrotactile stimuli delivered in tune with the music currently being played (for example, tune's spectrogram is acquired through a software included on the vehicle's infotainment system, and vibrations are generated based on the said spectrogram data); or delivered during certain pre-selected moments during a movie clip.
  • the smart surface is to be employed as the interactive surface interface of a device to which it is not physically connected (e.g., touch surface interface communicating wirelessly with a display device in close proximity, namely, the vehicle's centre stack display).
  • This smart surface is embedded on a portion of the armrest's upper side and is connected through the internal wiring of the vehicle, deriving power from it, while also being connected to the vehicle's infotainment system.
  • the capacitive-based touch sensitive layer can be made of a variety of materials, depending on the intended use case and aesthetic appeal.
  • the display device's capacitive-based touch sensitive layer is made of a transparent material, such as transparent glass.
  • the interactive surface interface is made of translucent plastic with illumination provided by LED lights placed on the LED lights layer, located between the capacitive-based touch sensitive layer and the vibrotactile actuators layer.
  • the smart surface can generate both frictional and vibrotactile haptic sensations.
  • buttons/switch can be different depending on its state, such as transmitting a rougher texture feeling when toggled off, and a smoother texture feeling when toggled on), or to transmit information to users regarding certain warnings and information (for example, the user has their hand resting on the armrest's smart surface, and vibrations generated by vibrotactile actuators are transmitted to the hand to let them know they have arrived at their destination).
  • Both these haptic sensations can also be used in tandem to provide the same information to users regarding certain warnings and interactions, such as, for example, increasing the amount of vibration provided, and the roughness of the texture feel that users perceive, as they slide a slider of the user interface.
  • Frictional haptic sensations are generated thanks to the insulative and conductive layers, which allow for friction between the smart surface and the user's skin to be modulated through electrostatic actuation, while the skin is in motion.
  • Vibrotactile haptic sensations are generated thanks to the vibrotactile actuators, which can generate vibrations strong enough to be felt through the user's skin, either stationary or in motion, when in direct contact with the smart surface.
  • haptic feedback sensations caused by the external device's software, can be generated on it.
  • the haptic actuation technology that is present on the smart surface is both capable of interpreting the software's information and of generating such sensations.
  • the external device's software for example, the in-vehicle's infotainment system software
  • sends a command to the smart surface requesting that it generates haptic and/or thermal feedback sensations on the surface layer
  • the command technology/software found on the smart layer must be capable of differentiating between these types of actuations, delegating the request to the actuation technology that controls the actuators capable of generating said feedback.
  • the smart surface is equipped on a portion of the surface of the vehicle seat's armrest, where it acts as an external interactive surface interface for the centre stack display device, as well as to control several of the vehicle functions, such as window, door, and media volume control.
  • a specific example includes a 7" display, 7 mm thick, powered through a socket provided by the vehicle specifically for the device, in communication with the vehicle via ethernet, and with user devices via Wi-Fi.
  • a device for providing a touchpad surface with haptic feedback for a user in an automotive setting comprising: a haptic surface comprising actuators for exhibiting tactile textures, comprising: a capacitive-based touch sensitive layer, a frictional haptic layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations, and a vibrotactile haptic layer for providing vibrotactile haptic sensations; an electronic data processor configured to: drive the frictional haptic layer and vibrotactile haptic layer to provide haptic feedback as the user touches the touchpad surface.
  • the device further comprises a display for displaying images of patterns or objects, wherein the haptic surface is superimposed on the display.
  • the automotive setting is an autonomous vehicle and the display is a centre stack display of the autonomous vehicle.
  • the electronic data processor is further configured to drive the frictional haptic layer and vibrotactile haptic layer to provide haptic feedback of a vehicular warning.
  • the device comprises a display for displaying images of patterns or objects wherein the electronic data processor is further configured to show in said display a visual alert to provide visual feedback of a vehicular warning.
  • a system for providing a touchpad surface with haptic feedback for a user in an automotive setting comprising a vehicular armrest and a device according to any of the previous claims, wherein the device is arranged in said armrest.
  • the touchpad surface is configured to act as an external input device of a centre stack display of an autonomous vehicle.
  • the touchpad surface is configured to act as both an external input device and output device of the centre stack display of an autonomous vehicle.
  • the method comprises driving the frictional haptic layer and vibrotactile haptic layer to provide haptic feedback as the user touches the touchpad surface.
  • Figure 1 Schematic representation of an embodiment of a capacitive touch and haptic surface on armrest.
  • Figure 2 Schematic representation of layers superposition an embodiment of a capacitive haptic surface on armrest.
  • Figure 3 Schematic representation of an embodiment of a capacitive touch and haptic surface on armrest.
  • Figure 1 shows a schematic representation of an embodiment of a capacitive haptic surface on armrest passenger
  • 12 represents the seat
  • 13 represents the armrest with the capacitive, haptic surface
  • 14 represents the centre stack display that the capacitive, haptic surface of the armrest is in contact with.
  • Figure 2 shows a scheme of the layer's superposition, wherein A represents an insulative layer; B represents a capacitive-based touch sensitive layer; C represents a vibrotactile actuators layer; D represents a transparent electrode sheet layer and E represents a LED lights layer.
  • a device for providing a touchpad surface with haptic feedback for a user in an automotive setting where 12 represents the seat, 13 represents the armrest with the capacitive, haptic surface, and 14 represents the centre stack display that the capacitive, haptic surface of the armrest is in contact with, comprising according to an embodiment: a haptic surface comprising actuators for exhibiting tactile textures, comprising: a capacitive-based touch sensitive layer, a frictional haptic layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations, and a vibrotactile haptic layer for providing vibrotactile haptic sensations; an electronic data processor configured to: drive the frictional haptic layer and vibrotactile haptic layer to provide haptic feedback as the user touches the touchpad surface.

Abstract

L'invention concerne un dispositif pour fournir une surface de pavé tactile avec une rétroaction haptique pour un utilisateur dans un réglage automobile, comprenant : une surface haptique comprenant des actionneurs pour présenter des textures tactiles, comprenant : une couche tactile à base capacitive, une couche haptique de frottement comprenant une feuille isolante pour un toucher d'utilisateur et un film d'électrode conducteur transparent pour fournir des sensations haptiques de frottement, et une couche haptique vibrotactile pour fournir des sensations haptiques vibrotactiles ; un processeur de données électronique configuré pour : entraîner la couche haptique de frottement et la couche haptique vibrotactile pour fournir une rétroaction haptique lorsque l'utilisateur touche la surface de pavé tactile. L'invention concerne également un système associé comprenant en outre un accoudoir et son procédé de fonctionnement.
PCT/IB2021/062384 2021-12-27 2021-12-28 Dispositif d'interface et d'alerte à rétroaction haptique et thermique pour véhicule autonome WO2023126645A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PT117688 2021-12-27
PT11768821 2021-12-27

Publications (1)

Publication Number Publication Date
WO2023126645A1 true WO2023126645A1 (fr) 2023-07-06

Family

ID=80225557

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2021/062384 WO2023126645A1 (fr) 2021-12-27 2021-12-28 Dispositif d'interface et d'alerte à rétroaction haptique et thermique pour véhicule autonome

Country Status (1)

Country Link
WO (1) WO2023126645A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120268412A1 (en) * 2011-04-22 2012-10-25 Immersion Corporation Electro-vibrotactile display
US8659554B2 (en) 2007-04-27 2014-02-25 Chrysler Group Llc Touch pad control panel located in the center console of a vehicle
US20150185848A1 (en) * 2013-12-31 2015-07-02 Immersion Corporation Friction augmented controls and method to convert buttons of touch control panels to friction augmented controls
US20150185849A1 (en) * 2013-12-31 2015-07-02 Immersion Corporation Systems and methods for providing haptic notifications
US20170308224A1 (en) 2016-04-25 2017-10-26 Tsinghua University Touch control armrest sleeve and touch control seat
US20200264772A1 (en) 2017-10-11 2020-08-20 Robert Bosch Gmbh Method for providing haptic feedback to an operator of a touch-sensitive display device
US10899258B2 (en) 2018-03-12 2021-01-26 Faurecia Sièges d'Automobile Armrest for vehicle seat and vehicle seat comprising such an armrest

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8659554B2 (en) 2007-04-27 2014-02-25 Chrysler Group Llc Touch pad control panel located in the center console of a vehicle
US20120268412A1 (en) * 2011-04-22 2012-10-25 Immersion Corporation Electro-vibrotactile display
US20150185848A1 (en) * 2013-12-31 2015-07-02 Immersion Corporation Friction augmented controls and method to convert buttons of touch control panels to friction augmented controls
US20150185849A1 (en) * 2013-12-31 2015-07-02 Immersion Corporation Systems and methods for providing haptic notifications
US20170308224A1 (en) 2016-04-25 2017-10-26 Tsinghua University Touch control armrest sleeve and touch control seat
US20200264772A1 (en) 2017-10-11 2020-08-20 Robert Bosch Gmbh Method for providing haptic feedback to an operator of a touch-sensitive display device
US10899258B2 (en) 2018-03-12 2021-01-26 Faurecia Sièges d'Automobile Armrest for vehicle seat and vehicle seat comprising such an armrest

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BASDOGAN, C.GIRAUD, F.LEVESQUE, V.CHOI, S.: "A Review of Surface Haptics: Enabling Tactile Effects on Touch Surfaces", IEEE TRANSACTIONS ON HAPTICS, vol. 13, no. 3, 2020, pages 450 - 470
BAU, OLIVIERIVAN POUPYREV: "REVEL: tactile feedback technology for augmented reality", ACM TRANSACTIONS ON GRAPHICS (TOG, vol. 31, no. 4, 2012, pages 1 - 11

Similar Documents

Publication Publication Date Title
US9983672B2 (en) Electrostatic haptic actuator and user interface with an electrostatic haptic actuator
US10579252B2 (en) Automotive touchscreen with simulated texture for the visually impaired
EP2889727B1 (fr) Commandes augmentées par friction et procédé pour convertir des boutons de panneaux de commande tactile en commandes augmentées par friction
Jang et al. Haptic edge display for mobile tactile interaction
US7336266B2 (en) Haptic pads for use with user-interface devices
EP2889726B1 (fr) Systèmes et procédés pour commander des affichages multiples avec un seul contrôleur et une interface utilisateur avec retour haptique
EP3009914A1 (fr) Dispositif déformable à activation haptique avec composant rigide
Banter Touch screens and touch surfaces are enriched by haptic force‐feedback
US20100250071A1 (en) Dual function touch switch with haptic feedback
EP2754013A1 (fr) Dispositif de sortie haptique et procédé de génération d'effet haptique dans un dispositif de sortie haptique
US11625145B2 (en) Automotive touchscreen with simulated texture for the visually impaired
WO2009052028A2 (fr) Simulation d'objet tridimensionnel au moyen du retour audio, visuel et tactile
KR101524906B1 (ko) 촉각 생성장치, 고분자 유전체 기반 구동기, 이를 이용한 촉각 액추에이터, 촉감 액추에이터, 인터페이스 장치, 촉각 피드백 제공장치
US11276377B2 (en) Electronic apparatus
CN106415452B (zh) 用于机动车辆的控制装置和控制方法
JP2005293512A (ja) 指装着型データ入力装置
JP6749909B2 (ja) 自動車の制御装置および制御方法
WO2023126645A1 (fr) Dispositif d'interface et d'alerte à rétroaction haptique et thermique pour véhicule autonome
US20220100276A1 (en) Method for generating a haptic feedback for an interface, and associated interface
WO2023126662A1 (fr) Clavier d'accoudoir à rétroaction haptique et thermique
JP6941798B2 (ja) 入力装置
Jung et al. A Novel Shape Deforming Large-scale Flexible Sensor for Tactile Display
WO2023118956A1 (fr) Dispositif et procédé pour fournir des stimuli induisant une méditation pour un utilisateur dans un réglage automobile
Farooq et al. Haptic user interface enhancement system for touchscreen based interaction
CN107783647A (zh) 柔性屏输入设备及信息娱乐系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21854691

Country of ref document: EP

Kind code of ref document: A1