EP4453690A1

EP4453690A1 - Device and method for providing meditation-inducing stimuli for a user in an automotive setting

Info

Publication number: EP4453690A1
Application number: EP21859341.6A
Authority: EP
Inventors: Pedro Miguel DE SOUSA BERNARDO; Vera Patricia CASTRO VILAS BOAS; Nélson Bruno MARTINS MARQUES COSTA; Manuel Sebastião MARQUES COUTINHO; Adriano Dídimo MACHADO CARVALHO; Rosane SCHONBLUM SAMPAIO; Marina MACHADO; Lisandra Maria ARAÚJO TEIXEIRA; Emanuel TEIXEIRA SILVA; José Pedro CORREIA DIAS
Original assignee: Universidade do Minho; Bosch Car Multimedia Portugal SA
Current assignee: Universidade do Minho; Bosch Car Multimedia Portugal SA
Priority date: 2021-12-23
Filing date: 2021-12-27
Publication date: 2024-10-30
Also published as: WO2023118956A1

Abstract

A device and method for providing meditation-inducing stimuli for a user in an automotive setting, comprising: a haptic surface comprising actuators for exhibiting tactile textures; a display for displaying images of patterns or objects; and an electronic data processor configured to: display an image comprising a pattern or object on said display; and drive the actuators of the haptic surface to exhibit a tactile texture when the user touches the image of the pattern or object, wherein the texture mimics tactile sensations of the pattern or object for providing the meditation-inducing stimuli.

Description

D E S C R I P T I O N

DEVICE AND METHOD FOR PROVIDING MEDITATION-INDUCING STIMULI FOR A USER IN AN AUTOMOTIVE SETTING

TECH NICAL FI ELD

[0001] The present disclosure relates to a device and method for providing meditationinducing stimuli for a user in an automotive setting.

BACKGROU ND

[0002] Document US2015145657 discloses a system including a sensor configured to sense an input received from a user at a surface; a first haptic output device configured to generate a first haptic effect at the surface based on the input received from the user, the first haptic effect comprising a friction effect at the surface; a second haptic output device configured to generate a second haptic effect, the second haptic effect comprising vibrotactile feedback; and a processor configured to receive an input signal from the sensor and output a first drive signal to the first haptic output device to generate the first haptic effect and to output a second drive signal to the second haptic output device to generate the second haptic effect.

[0003] Document W020044079 discloses a computer-implemented method for operating a haptic device, the haptic device comprising a plurality of tactile displays configured to provide haptic stimuli to a user, the method including the steps of (a) processing an audio signal derived from an audio file, thereby obtaining at least one profile of frequencies and amplitudes of the audio signal, (b) converting the frequencies and amplitudes profiles into a haptic profile, and (c) operating the haptic device according to the haptic profile.

[0004] Document EP2972718 discloses a graphical user interface is provided that can be used on a diagnostic tool. The graphical user interface allows a technician to operate various functions of the diagnostic tool including searching for additional information on the Internet, receiving weather information that is relevant to certain diagnostic tests, and displaying in certain formats the retrieved vehicle data and when certain vehicles were last scanned or diagnosed.

[0005] These facts are disclosed in order to illustrate the technical problem addressed by the present disclosure.

GENERAL DESCRIPTION

[0006] The present disclosure relates to a device for providing meditation-inducing stimuli for a user in an automotive setting.

[0007] Currently available mobile applications (apps) that focus on helping users relax and meditate, such as Calm (https://www.calm.com), Insight Timer (https://insighttimer.com), and Headspace (https://www.headspace.com) are available to users through the main app store services. By providing exercises and tasks that can be performed while users have free time, be it during commutes on a bus or train, or before going to sleep, these apps aim to help users obtain the benefits that come from meditating and relaxing, such as reduced stress levels and improved feelings of general well-being (Anderson et al., 2019; Brown et al., 2007). With the predicted rise of availability and adoption of autonomous vehicles by customers at large in the near future, as well as improvements made to vehicle's artificial intelligence systems, users will gain access to another venue of free time during their commute since they will no longer be required to fully devote their attention to the main task of driving the vehicle. Due to this, users may choose to use this time to relax and unwind from everyday stress. Additionally, most of the touchscreen displays and surfaces currently used for in-vehicle infotainment systems are not equipped with technologies that allow them to have haptic feedback capabilities, resulting in interactions with users being very basic.

[0008] Haptic feedback in devices and surfaces has commonly been achieved through vibrotactile stimuli generated from mechanical actuators (e.g., KHOSHKAVA et al., 2019). Recently, technologies have emerged that make use of other actuation types, such as electrovibration, to generate other forms of tactile feedback beyond just vibrations (e.g., Olley et al., 2020). While the technology for creating richer display and surface interactions is available, specialised apps still need to be developed in order to make use of said abilities.

[0009] Additionally, as display surface technology develops, more focus is being given to display devices and surfaces that can provide new and innovative ways of enriching the interactions users have with them, creating more immersive and engaging sensations through the use of richer haptic feedback sensations. It is therefore currently possible to design a meditation and relaxation app aimed at being primarily used in conjunction with an autonomous vehicle's haptic feedback displays and smart surfaces with haptic technologies which takes advantage of the richer interaction opportunities that haptic feedback technologies currently provide for in order for it to deliver a richer and more engaging experience to users.

[0010] An aspect of the present disclosure relates to the use of a haptic surface comprising an insulative layer fitted atop a transparent and conductive electrode sheet layer, which, when charged with an electric current and when in contact with the human skin, produces a frictional stimulus by controlling the electric current. The conductive electrode sheet layer is in turn fitted atop a capacitive-based touch sensitive layer fitted atop a layer of LED light, which, in turn, is fitted on top of a layer of vibrotactile actuators. The layer of LEDs is optional and when not present the touch-sensitive layer is fitted atop a layer of vibrotactile actuators.

[0011] In an embodiment, the haptic surface of the present disclosure is employed either as: a) the interactive surface interface of a display device to which it is physically connected to (e.g., the smart surface is part of the device's display); or b) as the interactive surface interface of a display device to which it is not physically connected to (e.g., touch surface interface communicating wirelessly with a display device in close proximity).

[0012] In an embodiment, the capacitive-based touch sensitive layer can be made of a variety of materials depending on the intended use case and aesthetic appeal (e.g., transparent glass - display device; translucent plastic - interactive surface interface for an external device with LED lights underneath it).

[0013] In an embodiment, the haptic smart surface of the present disclosure is able to generate both frictional and vibrotactile haptic sensations. Frictional haptic sensations are generated due to the insulative and conductive layers which allow for friction between the smart surface and the user's skin to be modulated through electrostatic actuation while the skin is in motion. Vibrotactile haptic sensations, in turn, are generated due to the vibrotactile actuators which can generate vibrations strong enough to be felt through the user's skin either stationary or in motion when in direct contact with the smart surface.

[0014] In an embodiment, when the haptic smart surface of the present disclosure is used as the interactive interface for an external device, haptic feedback sensations caused by the external device's software can be generated as long as the haptic actuation technology that is present on the smart surface is both capable of interpreting the software's information and of generating such sensations.

[0015] In an embodiment, the haptic smart surface of the present disclosure is fitted on at least two regions inside the vehicle: the display surface of the central stack display where it will serve as said device's interactive surface interface, and on a portion of the surface of the seat's armrest where it will act as an external interactive surface interface for the centre stack display device.

[0016] It is disclosed a device for providing meditation-inducing stimuli for a user in an automotive setting, comprising: a haptic surface comprising actuators for exhibiting tactile textures; a display for displaying images of patterns or objects; and an electronic data processor configured to: display an image comprising a pattern or object on said display; and drive the actuators of the haptic surface to exhibit a tactile texture when the user touches the image of the pattern or object, wherein the texture mimics tactile sensations of the pattern or object for providing the meditation-inducing stimuli.

[0017] In an embodiment, the haptic surface is integrated in the display.

[0018] In an embodiment, the haptic surface actuators comprise frictional and vibrotactile haptic actuators.

[0019] In an embodiment, the frictional haptic actuators comprise insulative and conductive layers arranged to modulate friction through electrostatic actuation upon said layers.

[0020] In an embodiment, the haptic surface is partitioned in two parts, a first part for placing on a display surface of a central stack display of a vehicle, and a second part for placing on a surface of a seat's armrest of the vehicle.

[0021] In an embodiment, the second part is arranged to provide an external interactive surface interface for the centre stack display device.

[0022] In an embodiment, the haptic surface actuators comprise vibrotactile haptic actuators and the electronic data processor is configured for driving the vibrotactile haptic actuators to vibrate with increasingly more perceptible vibrations, followed by driving the vibrotactile haptic actuators for no vibration and followed by driving the vibrotactile haptic actuators to vibrate with increasingly less perceptible vibrations; wherein the electronic data processor is further configured for displaying images of patterns or objects growing in size when driving the vibrotactile haptic actuators to vibrate with increasingly more perceptible vibrations and configured for displaying images of patterns or objects reducing in size when driving the vibrotactile haptic actuators to vibrate with increasingly less perceptible vibrations.

[0023] In an embodiment, the electronic data processor is configured for cycling along a predetermined list of images of patterns or objects and corresponding tactile textures, in a predetermined order or randomly. [0024] In an embodiment, the electronic data processor is configured for switching between individual images and textures automatically after a predetermined time interval.

[0025] In an embodiment, the electronic data processor is configured for switching between individual images and textures automatically upon a manual user trigger.

[0026] It is also disclosed a method of operating the device according to any of the previous embodiments, comprising using said electronic data processor for: displaying an image comprising a pattern or object on said display; and driving the actuators of the haptic surface to exhibit a tactile texture when the user touches the image of the pattern or object, wherein the texture mimics tactile sensations of the pattern or object for providing the meditation-inducing stimuli.

BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The following figures provide preferred embodiments for illustrating the disclosure and should not be seen as limiting the scope of invention.

[0028] Figure 1 is a flowchart illustrating the haptic feedback mediation and relaxation application of the present disclosure.

[0029] Figure 2 shows the home screen of the haptic feedback surface and application of the present disclosure (different waveform indicate different texture sensations).

[0030] Figure 3 illustrates an example of the haptic feedback surface and application in use for relaxing breathing (different waveform indicate different texture sensations).

[0031] Figure 4 illustrates an example of the main menu of the haptic feedback surface and application for relaxing touch (different waveform indicate different texture sensations).

[0032] Figure 5 illustrates an example of the haptic feedback surface and application for relaxing touch with silk texture sensation (different waveform indicate different texture sensations). [0033] Figure 6 illustrates an example of the haptic feedback surface and application for relaxing garden theme sensation (different waveform indicate different texture sensations).

[0034] Figure 7 illustrates an example of the haptic feedback surface and application for drawing a new line on the sand of a garden sensation (different waveform indicate different texture sensations).

DETAILED DESCRI PTION

[0035] The present disclosure relates to a device for providing meditation-inducing stimuli for a user in an automotive setting.

[0036] Another aspect of the present disclosure relates to the use of a haptic feedback meditation and relaxation app which can be installed and accessed through several different devices, such as the vehicle's infotainment system or the user's personal smartphone. However, the full benefits of the haptic feedback sensations described below can only be felt when the interaction between user and app is done through a device or surface which possesses actuators capable of generating the intended sensations.

[0037] In an embodiment, the interaction between user and the application of the present disclosure is preferably done, during the user's commute, through the haptic smart surface of the present disclosure, wherein the surface is mounted inside the vehicle.

[0038] In an embodiment, the haptic feedback sensations are frictional and/or vibrotactile stimuli which can be generated through electrostatic and vibrotactile actuation, respectively.

[0039] When the App is accessed through a device without a surface that can produce one or both of the intended haptic feedback stimulus types, an adequate external interactive surface interface can be used to generate said stimuli. Although the disclosed app employs haptic feedback sensations during the interactions between it and the user, there are no impediments regarding installing and using this app on devices without actuators that can produce the stimulus types from which this disclosure benefits, as long as users keep in mind that the full intended experience cannot be achieved in said devices. There is also no impediment in the user choosing to use an external interactive surface interface to interact with the app when displayed on a device which also possesses a screen surface with haptic feedback capabilities. For example, users might choose to interact with the app through the armrest's smart surface, while leaning back on their seat with their eyes closed, for extra comfort, while others might prefer to interact with it through the centre stack display itself, interacting "directly" with the visual content displayed on the screen. The visual content of the app is preferably displayed on the main interface screen, but the user can choose to ignore said visual components to mainly focus on the tactile sensations.

[0040] As illustrated in Figure 1, a flowchart illustrating the haptic feedback mediation and relaxation application of the present disclosure, wherein 1 discloses in home screen and when a user intends to select a mediation or relaxation exercise from those shown on the display; A discloses a user taps the icon of the intended exercise on the display vibrotactile and audio feedback is generated to confirm selection and:

2 - if a breathing exercise is selected, a vibrational stimulus is transmitted to users through the haptic feedback surface portion of the armrest to provide guidance during the exercise;

3 - if a relaxing touch is selected, a soft and smooth texture sensations are generated on the haptic feedback portion surface of the armrest;

4 - if a zen garden is selected, a virtual "zen garden" is shown in the touchscreen display.

[0041] According Figure 1, if a breathing exercise is selected 2 and a user rests hand on the seat's armrest, hand positioned on top of the haptic surface portion of the armrest, users should breathe in while vibrations become increasingly perceptible, until they stop or users should hold breathe while no vibrations are felt or users should breathe out while vibrations become decreasingly perceptible, until they stop or accompanying visual information is also provided on the display 8. [0042] According Figure 1, if a relaxing touch is selected and the user fingers across surface, the user feels comfortable textures (e.g, silk) while sliding fingers 7.

[0043] According Figure 1, if a zen garden is selected 4 and users slides fingers on either the display orthe haptic surface portion of the armrest, texture of corresponding objects (e.g., sand, rocks) are generated while user's fingers slide across said objects 6 or users can personalise their garden with a variety of elements 5.

[0044] The following example descriptions will focus on use cases inside a vehicle with both a haptic feedback centre stack display, and an external interactive surface interface embedded on the seat's armrest. The application of the present disclosure preferably comprises 3 different activities which can be accessed through the main menu interface of the application - Figure 2.

[0045] The following pertains to a first example, Example 1. Relaxing Breathing - vibrotactile stimuli is transmitted to users through the external interactive surface interface. These vibrations act as guidance during the breathing exercise (vibrations going from less to more perceptible (increasing frequency) - breathe in - Figure 3; no vibration - hold breathe; vibrations going from more to less perceptible (decreasing frequency) - breathe out). Accompanying visual cues are also presented on the display (circle enlarging - breathe in; circle size stable - hold breathe; circle shrinking - breathe out).

[0046] The following pertains to a second example, Example 2. Relaxing Touch - soft and smooth texture sensations are generated on the external interactive surface interface. These are meant to help users relax through the interaction with comfortable, pleasing textures (e.g., silk) - Figure 5. Texture sensations are generated through frictional stimuli. A pre-selected list of different textures is available to the users, of which they can select which to and not to generate. Users can also choose for the allowed textures to be generated at random during the interaction, with switching between textures either manually or automatically triggered, or they can select a particular texture to be generated - Figure 4. [0047] The following pertains to Example 3. Relaxing Garden - A virtual "Zen Garden" is shown on the centre stack touchscreen display- Figure 6. Users can interact with it with their fingers through either the display surface itself or through the external interactive surface interface. During their interactions, users can play with and customize their garden to their liking, moulding the sand - Figure 7, changing the location of objects in the garden, or adding additional objects and elements (e.g., sand pebbles and rocks of different sizes, patches of grass, a water pond). While the user's finger is moving on top of objects/elements, either directly on the display, or by their corresponding location on the external interface, their texture sensations are transmitted to the user.

[0048] According to the technical field, examples of textures that participants subjectively report feeling during interaction with electrode devices include: wood, leather, paper, painted wall, rubber, and viscous liquid (Bau, Olivier, and Ivan Poupyrev. "REVEL: tactile feedback technology for augmented reality." ACM Transactions on Graphics (TOG) 31.4 (2012): 1-11).

[0049] Through the use of an electrode, it is possible to modify the friction that exists between the finger and an actuated surface, when there is movement of one or both parts. Through friction, we can manipulate, for example, the feeling of how smooth or rough a surface is. This, however, is normally limited in two respects, namely how smooth the surface on which the finger slides is (because electrode only creates friction, does not remove it, so the least possible friction to create is the natural friction between the surface and the finger); and, also, how much electrical charge can be given to the surface actuated (the higher the electrical charge, the greater the friction generated between the finger and the surface), up to a certain limit, which is depending on the structure of the device itself and its electric system.

[0050] The term "comprising" whenever used in this document is intended to indicate the presence of stated features, integers, steps, components, but not to preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. [0051] The disclosure should not be seen in any way restricted to the embodiments described and a person with ordinary skill in the art will foresee many possibilities to modifications thereof. The above-described embodiments are combinable. The following claims further set out particular embodiments of the disclosure.

[0052] References

1. Anderson, T., Suresh, M., & Farb, N. A. (2019). Meditation Benefits and Drawbacks: Empirical Codebook and Implications for Teaching. Journal of Cognitive Enhancement, 3(2), 207-220. https://doi.org/10.1007/s41465-018-00119-y

2. Brown, K. W., Ryan, R. M., & Creswell, J. D. (2007). Mindfulness: Theoretical Foundations and Evidence for its Salutary Effects. Psychological Inguiry, 18(4), 211- 237. https://doi.org/10.1080/10478400701598298

3. Khoshkava, v., Cruz-hernandez, j. M., & shah, k. (2019). Haptic Actuator Assembly with a Spring Pre-Load Device (Patent No. EP3582074A1).

4. Olley, M. F. D., Peshkin, M. A., & Colgate, J. E. (2020). Electronic controller haptic display with simultaneous sensing and actuation (Patent No. US10768749B2).

Claims

C L A I M S A device for providing meditation-inducing stimuli for a user in an automotive setting, comprising: a haptic surface comprising actuators for exhibiting tactile textures; a display for displaying images of patterns or objects; and an electronic data processor configured to: display an image comprising a pattern or object on said display; and drive the actuators of the haptic surface to exhibit a tactile texture when the user touches the image of the pattern or object, wherein the texture mimics tactile sensations of the pattern or object for providing the meditation-inducing stimuli. The device for providing meditation-inducing stimuli according to the previous claim wherein the haptic surface is integrated in the display. The device according to any of the previous claims wherein the haptic surface actuators comprise frictional and vibrotactile haptic actuators. The device according to the previous claim wherein the frictional haptic actuators comprise insulative and conductive layers arranged to modulate friction through electrostatic actuation upon said layers. The device according to any of the previous claims wherein the haptic surface is partitioned in two parts, a first part for placing on a display surface of a central stack display of a vehicle, and a second part for placing on a surface of a seat's armrest of the vehicle. The device according to the previous claim, wherein the second part is arranged to provide an external interactive surface interface for the centre stack display device. The device according to any of the previous claims, wherein the haptic surface actuators comprise vibrotactile haptic actuators and the electronic data processor is configured for driving the vibrotactile haptic actuators to vibrate with increasingly more perceptible vibrations, followed by driving the vibrotactile haptic actuators for no vibration and followed by driving the vibrotactile haptic actuators to vibrate with increasingly less perceptible vibrations; wherein the electronic data processor is further configured for displaying images of patterns or objects growing in size when driving the vibrotactile haptic actuators to vibrate with increasingly more perceptible vibrations and configured for displaying images of patterns or objects reducing in size when driving the vibrotactile haptic actuators to vibrate with increasingly less perceptible vibrations. The device according to any of the previous claims, wherein the electronic data processor is configured for cycling along a predetermined list of images of patterns or objects and corresponding tactile textures, in a predetermined order or randomly. The device according to the previous claim wherein the electronic data processor is configured for switching between individual images and textures automatically after a predetermined time interval. The device according to the claim 8 wherein the electronic data processor is configured for switching between individual images and textures automatically upon a manual user trigger. The device according to any of the previous claims wherein said texture is a texture of wood, leather, paper, painted wall, rubber, or viscous liquid. Method of operating the device according to any of the previous claims, comprising using said electronic data processor for: displaying an image comprising a pattern or object on said display; and driving the actuators of the haptic surface to exhibit a tactile texture when the user touches the image of the pattern or object, wherein the texture mimics tactile sensations of the pattern or object for providing the meditation-inducing stimuli.