EP4457594A1 - Armrest keyboard with haptic and thermal feedback - Google Patents

Armrest keyboard with haptic and thermal feedback

Info

Publication number
EP4457594A1
EP4457594A1 EP21854826.1A EP21854826A EP4457594A1 EP 4457594 A1 EP4457594 A1 EP 4457594A1 EP 21854826 A EP21854826 A EP 21854826A EP 4457594 A1 EP4457594 A1 EP 4457594A1
Authority
EP
European Patent Office
Prior art keywords
armrest
keyboard
haptic
interactive surface
feedback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21854826.1A
Other languages
German (de)
French (fr)
Inventor
Pedro Miguel DE SOUSA BERNARDO
Vera Patricia CASTRO VILAS BOAS
Nélson Bruno MARTINS MARQUES COSTA
Manuel Sebastião MARQUES COUTINHO
Adriano Dídimo MACHADO CARVALHO
Rosane SCHONBLUM SAMPAIO
Marina MACHADO
Lisandra Maria ARAÚJO TEIXEIRA
Emanuel TEIXEIRA SILVA
José Pedro CORREIA DIAS
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Universidade do Minho
Bosch Car Multimedia Portugal SA
Original Assignee
Universidade do Minho
Bosch Car Multimedia Portugal SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universidade do Minho, Bosch Car Multimedia Portugal SA filed Critical Universidade do Minho
Publication of EP4457594A1 publication Critical patent/EP4457594A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/50—Instruments characterised by their means of attachment to or integration in the vehicle
    • B60K35/53—Movable instruments, e.g. slidable
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/25—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using haptic output
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202—Constructional details or processes of manufacture of the input device
    • G06F3/0216—Arrangements for ergonomically adjusting the disposition of keys of a keyboard
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/143—Touch sensitive instrument input devices
    • B60K2360/1438—Touch screens
    • B60K2360/1442—Emulation of input devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined

Definitions

  • the present disclosure relates to an interface device comprising a smart surface with haptic feedback to a passenger.
  • Document EP2483104B1 relates generally to travel information systems and more particularly, but not exclusively, to aircraft in-flight entertainment systems for providing an enhanced travel experience.
  • Document US9349552B2 related to a touchpad with capacitive force sensing.
  • the described techniques may determine the point or region of a user-engagement surface contacted by a user.
  • the described techniques may also determine a force of the user's finger press on the user engagement surface using one or more capacitance force sensors.
  • the described techniques may offer active tactile feedback (i.e., haptics) to the user's finger touching the user-engagement surface.
  • a switch panel comprises: a layer having a touch-or proximity-responsive surface and being patterned to indicate defined switch areas of the surface to a user; illumination means for illuminating the patterned layer; and output means for providing an output signal in response to a user interaction with one or more of the defined switch areas, wherein the switch panel is arranged to operate in: (i) an active state, in which the illumination means are arranged to illuminate the patterned layer so as to make the switch areas visible to the user; and (ii) a dormant state, in which the switch areas are substantially not visible to the user, and the output means are arranged to provide the output signal only when the switch areas are visible in the active state.
  • Document US20200264772 discloses a method for providing haptic feedback to an operator of a touch-sensitive display device.
  • the method includes providing an operator interface to be represented in the display device as image data; the operator interface having at least one button assigned to a function to be controlled, graphically displayed in the operator interface, and graphically delimited from the rest of the operator interface; analysing the image data for a presence and a position of shapes for representing a button; determining an intended display region of a shape, which is to be represented and is identified as a button; representing the image data of the operator interface in the touch-sensitive display device; outputting haptic feedback in response to detection of contact with the touch-sensitive display device in the region of a surface of the touch-sensitive display device which is assigned to a display region of a shape identified as a button.
  • an interface device comprising a smart surface with haptic feedback to a passenger.
  • an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to drive the haptic-feedback layer to provide a haptic-feedback; display a first keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard and an operation method thereof.
  • the present disclosure relates to a capacitive haptic feedback surface, herein called smart surface comprising, at least, 4 or 5 layers.
  • the first, top-most layer is an insulative layer, applied to a transparent and conductive electrode sheet layer, which, when charged with an electric current and when in contact with the human skin, produces a frictional stimulus by controlling the electric current.
  • These two layers are, in turn, applied to a capacitive-based touch sensitive layer.
  • Below this layer rests another layer fitted with LED lights, which can produce strong enough lights to be visible through the previous layer, depending on the material of which said layer is made out of (this layer is optional).
  • the fifth and final layer is composed of vibrotactile actuators, which can produce vibrations with enough frequency and amplitude for them to be felt by users while interacting with the top-most layer.
  • Haptic feedback in devices and surfaces has commonly been achieved through vibrotactile stimuli, generated from mechanical actuators (e.g., EP3582074A1). More recently, haptic technologies have emerged that make use of other actuation types, such as electro vibration, to generate other types of tactile feedback beyond just vibrations (e.g., US10768749B2).
  • the technology for creating richer display and surface interactions is available, by delivering different haptic feedback sensations, such as different texture sensations or different vibrations, to users while they interact with the display surface with their fingers. Richer interactions, in the present disclosure, refers to interactions that provide more feedback to users, instead of the usual sensation of just touching a surface.
  • Richer interactions in the present disclosure, refers to interactions that provide more feedback to users, instead of the usual sensation of just touching a surface.
  • any control commands such as increasing or decreasing the strength of an overhead light
  • the software of the centre stack display device would have to be processed by the software of the centre stack display device, although the keyboard area could have some shortcuts associated with some simple actions such as this light control, or media volume control, for example, like it is currently found on most computer keyboards.
  • the smart surface can be used to control those and any other parts. It is only a matter of having a controller which, upon sensing input on the smart surface, is able to actuate (directly or indirectly) on those parts.
  • writing from a comfortable position on a virtual keyboard presented on the center stack display is difficult to achieve, since it requires passenger to bend forward on their seat, to stretch their arm(s), or both at the same time, which quickly becomes uncomfortable to maintain. Additionally, interactions with such virtual keyboards do not normally transmit any haptic feedback to passenger, making the writing process less intuitive.
  • level 5 of autonomous vehicles i.e., in full automation
  • concerns regarding driver distraction are no longer present, as the task of driving the vehicle is taken up by the vehicle itself, and the driver becomes just another passenger in the vehicle. Therefore, more control and interface elements can be added to each seat's armrest, so that passengers can access these controls from a comfortable position of their choosing, and without the interaction with said controls compromising their performance while driving the vehicle, as could occur if this was implemented on non- autonomous vehicles due to the increase of interactable elements possibly distracting the driver while trying to interact with them.
  • said elements no longer need to be simple nobs, switches or on/off buttons, but instead can be more complex and useful controls and interfaces.
  • other technologies such as haptic feedback surfaces, can be used to increase the passenger experience and engagement of passenger with these elements, contributing to a more pleasurable and/or useful commute.
  • the present disclosure improves the driving safety, e.g., by providing haptic feedback of proximity to an obstacle while parking.
  • the present disclosure is employable in level 5 autonomous vehicles.
  • this smart surface can be employed as the interactive surface interface of a device to which it is not physically connected, e.g., touch surface interface communicating wirelessly with a display device in close proximity.
  • the capacitive-based touch sensitive layer can be made of a variety of materials, depending on the intended use case and aesthetic appeal.
  • the capacitive-based touch sensitive layer is made of translucent plastic - interactive surface interface for an external device with LED lights underneath it.
  • the smart surface can generate both frictional and vibrotactile haptic sensations.
  • frictional haptic sensations are generated thanks to the insulative and conductive layers, which allow for friction between the smart surface and the passenger's skin to be modulated through electrostatic actuation, while the skin is in motion.
  • vibrotactile haptic sensations are generated thanks to the vibrotactile actuators, which can generate vibrations strong enough (e.g., 65Hz to 500Hz) to be felt through the passenger's skin, either stationary or in motion, when in direct contact with the smart surface.
  • haptic feedback sensations when the smart surface is used as the interactive interface for an external device, haptic feedback sensations, programmed/controlled by the external device's software, can be generated on it, as long as the haptic actuation technology that is present on the smart surface is both capable of interpreting the software's information and of generating such sensations.
  • the external device's software sends a command to the smart surface, requesting that it generates haptic and/or thermal feedback sensations on the surface layer
  • the command technology/software found on the smart layer should be capable of differentiating between these types of actuations, delegating the request to the actuation technology that controls the actuators capable of generating said feedback.
  • the capacitive and/or haptic feedback sensations of the smart surface are controlled by an external device which can be the same device that the smart surface is controlling (e.g., center stack) or other.
  • the armrest keyboard comprises a 7" display, 7 mm thick, powered through a socket provided by the vehicle specifically for the device, communication with the vehicle via ethernet, and with user devices via Wi-Fi.
  • the present disclosure is equipped on a portion of the surface of the vehicle seat's armrest, where it acts as an external interactive surface interface for the centre stack display device, in the form of a keyboard.
  • the seat's armrest is part of a train carriage, airplane fuselage or other passenger compartment that have seats with armrests.
  • a full haptic feedback keyboard surface actuated through electro vibration and/or vibrotactile actuation, which can be activated by the passenger and accessed on the vehicle seat armrest smart surface.
  • LED lights integrated on their own layer between the capacitive-based touch sensitive layer and the layer of vibrotactile actuators, light up when the keyboard is in use, indicating the location of each specific key on the keyboard. The light from these LED lights should be strong enough to be seen through the capacitive-based touch sensitive layer, which, in turn, should be made of a material, or have a thin enough thickness, that allows for the lights to be clearly visible.
  • the capacitive surface can be made of a material that allows for the LED light to pass through, which can be dependent on how thick said surface is (e.g., certain types of wood can let light pass through when it's thin enough).
  • passenger can use this keyboard to facilitate and speed up their performance on tasks that involve writing, be it for entertainment, educational, or professional purposes, while sitting comfortably inside the vehicle during their commutes, keeping a comfortable posture.
  • the armrest smart surface is embedded on a movable platform which, at the passenger's behest, can be switched into one of two positions, either placed directly on top of the full armrest structure, at the passenger's side, or it can be slid on top of the full armrest structure until it is set horizontally in front of the passenger.
  • the movable platform's apparatus proceeds to move to the other position.
  • This movable platform is placed between the armrest smart surface and the remaining structure of the armrest. This movable platform is connected to the middle and tail-right end of the armrest smart surface.
  • the location where the movable platform connects to the armrest smart surface's middle portion is horizontally curved in its design.
  • the movable platform moves over the length of the armrest structure, until it reaches the front end of it.
  • it is locked in placed, and the movable platform component that is connected to the armrest smart surface's tail-right end begins to move inwards towards the middle portion.
  • the armrest smart surface slides atop the middle portion of the movable platform, curving inwards instead of moving fully forward, until it reaches the "full” or “extended” mode (as seen in Figure 1). If, when the "switch” button is pressed, and the armrest smart surface is in “full” or “extended” mode, the reverse of this process occurs, and instead of the movable platform's component that is connected to the armrest smart surface's tail-right end sliding towards the middle portion of the movable platform, it instead slides away from said portion.
  • the assembly of this structure to a base/normal armrest can be plug and play, can come pre-installed on it, or it can be installed by a knowledgeable person. For the smart surface's components to be powered, it should be connected to any of the vehicle's power supplies or one provided by the user (e.g., batteries), deriving power from it.
  • the keyboard is in compact layout, which is aimed at being used with only one hand, ideally for shorter inputs.
  • the keyboard is in full layout, extended over a wide horizontal portion of the smart surface. This layout is aimed at being used with both hands, ideally for longer inputs.
  • different texture sensations are used to indicate to the passenger, e.g., when the finger is sliding on top of a virtual button (e.g., a different texture sensation is generated for each button, helping the user differentiate between different buttons); when the passenger enter/leaves the location of a virtual button (e.g., a sensation of a "bump" in generated when the skin reaches the edge of a button, and no texture sensation is generated between the gaps of each button); and the location of the index-finger locator keys, usually the F and J keys in QWERTY keyboards (when keyboard is in full mode), by way of noticeably different texture and bump sensations. In other alphabets, these locator keys can be adjusted accordingly.
  • an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising: an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.
  • the armrest and the interactive surface are rotatably and slidably coupled.
  • the interactive surface is arranged to fit in the armrest when the interactive surface and the armrest are oriented parallelly.
  • the armrest keyboard can comprise a wireless connection to communicate wirelessly with an external display device.
  • the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user presses a virtual button of the interactive surface.
  • the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user slides a finger over virtual buttons of the interactive surface.
  • the electronic data processor is further configured to drive the haptic-feedback layer to provide an enhanced haptic-feedback as the user slides a finger over virtual buttons 'F' and 'J' of the interactive surface.
  • the armrest keyboard according to any of the previous claims wherein the first keyboard is longer than the second keyboard.
  • the second keyboard has less virtual buttons than the first keyboard.
  • the capacitive-based touch sensitive layer is made of translucent plastic comprising LEDs underneath it.
  • the armrest keyboard can comprise a frictional haptic- feedback layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations.
  • the armrest keyboard can comprise a vibrotactile haptic layer for providing vibrotactile haptic sensations.
  • an electronic data processor to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.
  • Figure 1A Schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest.
  • Figure IB Schematic representation, in top view, of an embodiment of the haptic full keyboard layout on armrest.
  • Figure 2A Schematic representation, in front view, of an embodiment of the haptic compact keyboard layout on armrest.
  • Figure 2B Schematic representation, in top view, of an embodiment of the haptic compact keyboard layout on armrest.
  • Figure 3 Scheme of the layer's superposition.
  • the present disclosure relates to an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to drive the haptic-feedback layer to provide a haptic-feedback; display a first keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard; and to an operation method thereof.
  • Figure 1A shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 103 represents a full keyboard layout, 105 represents an armrest, and 107 represents a seat.
  • Figure IB shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 103 represents a full keyboard layout, 105 represents an armrest, and 107 represents a seat.
  • an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, can comprise: an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.
  • Figure 2A shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 203 represents a compact keyboard layout, 105 represents an armrest, and 107 represents a seat.
  • Figure 2B shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 203 represents a compact keyboard layout, and 107 represents a seat.
  • Figure 3 shows a scheme of the layer's superposition, wherein A represents an insulative layer; B represents a capacitive-based touch sensitive layer; C represents a vibrotactile actuators layer; D represents a transparent electrode sheet layer and E represents a LED lights layer.
  • KHOSHKAVA V., CRUZ-HERNANDEZ, J. M., & SHAH, K. (2019).

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to drive the haptic-feedback layer to provide a haptic-feedback; display a first keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard. Operation method thereof.

Description

D E S C R I P T I O N
ARMREST KEYBOARD WITH HAPTIC AND THERMAL FEEDBACK
TECH NICAL FI ELD
[0001] The present disclosure relates to an interface device comprising a smart surface with haptic feedback to a passenger.
BACKGROUND
[0002] Document EP2483104B1 relates generally to travel information systems and more particularly, but not exclusively, to aircraft in-flight entertainment systems for providing an enhanced travel experience.
[0003] Document US9349552B2 related to a touchpad with capacitive force sensing. The described techniques may determine the point or region of a user-engagement surface contacted by a user. In addition, the described techniques may also determine a force of the user's finger press on the user engagement surface using one or more capacitance force sensors. Furthermore, the described techniques may offer active tactile feedback (i.e., haptics) to the user's finger touching the user-engagement surface.
[0004] Document W02015/159100A1 discloses a switch panel comprises: a layer having a touch-or proximity-responsive surface and being patterned to indicate defined switch areas of the surface to a user; illumination means for illuminating the patterned layer; and output means for providing an output signal in response to a user interaction with one or more of the defined switch areas, wherein the switch panel is arranged to operate in: (i) an active state, in which the illumination means are arranged to illuminate the patterned layer so as to make the switch areas visible to the user; and (ii) a dormant state, in which the switch areas are substantially not visible to the user, and the output means are arranged to provide the output signal only when the switch areas are visible in the active state.
[0005] Document US20200264772 discloses a method for providing haptic feedback to an operator of a touch-sensitive display device. The method includes providing an operator interface to be represented in the display device as image data; the operator interface having at least one button assigned to a function to be controlled, graphically displayed in the operator interface, and graphically delimited from the rest of the operator interface; analysing the image data for a presence and a position of shapes for representing a button; determining an intended display region of a shape, which is to be represented and is identified as a button; representing the image data of the operator interface in the touch-sensitive display device; outputting haptic feedback in response to detection of contact with the touch-sensitive display device in the region of a surface of the touch-sensitive display device which is assigned to a display region of a shape identified as a button.
[0006] These facts are disclosed in order to illustrate the technical problem addressed by the present disclosure.
GENERAL DESCRIPTION
[0007] The present disclosure relates to an interface device comprising a smart surface with haptic feedback to a passenger. Namely, an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to drive the haptic-feedback layer to provide a haptic-feedback; display a first keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard and an operation method thereof.
[0008] The present disclosure relates to a capacitive haptic feedback surface, herein called smart surface comprising, at least, 4 or 5 layers. The first, top-most layer, is an insulative layer, applied to a transparent and conductive electrode sheet layer, which, when charged with an electric current and when in contact with the human skin, produces a frictional stimulus by controlling the electric current. These two layers are, in turn, applied to a capacitive-based touch sensitive layer. Below this layer rests another layer fitted with LED lights, which can produce strong enough lights to be visible through the previous layer, depending on the material of which said layer is made out of (this layer is optional). The fifth and final layer is composed of vibrotactile actuators, which can produce vibrations with enough frequency and amplitude for them to be felt by users while interacting with the top-most layer.
[0009] The inclusion of control elements and interfaces on the armrests of in-vehicle seats has already been the focus of prior patents (e.g., JP2004262363A; US2017147108A1). These inclusions usually arise from a wish to provide passenger, particularly drivers, with easy access to a myriad of vehicle controls, such as window and radio controls.
[0010] Although interacting with these controls is not necessary for the primary task of driving the vehicle, they can still have an adverse effect on driving by deviating the drivers' attention while they fumble with the different control elements.
[0011] Haptic feedback in devices and surfaces has commonly been achieved through vibrotactile stimuli, generated from mechanical actuators (e.g., EP3582074A1). More recently, haptic technologies have emerged that make use of other actuation types, such as electro vibration, to generate other types of tactile feedback beyond just vibrations (e.g., US10768749B2). The technology for creating richer display and surface interactions is available, by delivering different haptic feedback sensations, such as different texture sensations or different vibrations, to users while they interact with the display surface with their fingers. Richer interactions, in the present disclosure, refers to interactions that provide more feedback to users, instead of the usual sensation of just touching a surface. However, there is a lack of applications that exploit the capabilities of these interfaces to the maximum.
[0012] In an embodiment, any control commands, such as increasing or decreasing the strength of an overhead light, would have to be processed by the software of the centre stack display device, although the keyboard area could have some shortcuts associated with some simple actions such as this light control, or media volume control, for example, like it is currently found on most computer keyboards. [0013] In an embodiment, the smart surface can be used to control those and any other parts. It is only a matter of having a controller which, upon sensing input on the smart surface, is able to actuate (directly or indirectly) on those parts.
[0014] With the expected increase of autonomous vehicles that will become available to the general consumer market, passenger of such vehicles will find themselves with more free time during their commutes. Passengers might choose to engage in a variety of activities to make use of this free time, for leisure or work purposes, such as writing documents, browsing the internet, or looking up information online, among other activities that require them to input written and other information.
[0015] In an embodiment, writing from a comfortable position on a virtual keyboard presented on the center stack display is difficult to achieve, since it requires passenger to bend forward on their seat, to stretch their arm(s), or both at the same time, which quickly becomes uncomfortable to maintain. Additionally, interactions with such virtual keyboards do not normally transmit any haptic feedback to passenger, making the writing process less intuitive.
[0016] In an embodiment, in level 5 of autonomous vehicles, i.e., in full automation, concerns regarding driver distraction are no longer present, as the task of driving the vehicle is taken up by the vehicle itself, and the driver becomes just another passenger in the vehicle. Therefore, more control and interface elements can be added to each seat's armrest, so that passengers can access these controls from a comfortable position of their choosing, and without the interaction with said controls compromising their performance while driving the vehicle, as could occur if this was implemented on non- autonomous vehicles due to the increase of interactable elements possibly distracting the driver while trying to interact with them.
[0017] In an embodiment, it is possible to have more functionalities in non-AV (autonomous vehicle), but the more functionalities, buttons, switches, etc., that you add, the more you increase the risk of the driver getting distracted while trying to interact with the one he wants. Those functionalities do not need to be used by the driver, they can be used by passengers in non-AVs.
[0018] Additionally, said elements no longer need to be simple nobs, switches or on/off buttons, but instead can be more complex and useful controls and interfaces. Furthermore, other technologies, such as haptic feedback surfaces, can be used to increase the passenger experience and engagement of passenger with these elements, contributing to a more pleasurable and/or useful commute.
[0019] As display surface technology develops, more focus is being given to display devices and surfaces that can provide new and innovative ways of enriching the interactions passenger have with them, such as generating richer haptic feedback sensations.
[0020] It is thus disclosed a smart surface, with haptic feedback capabilities, which is capable of acting as a keyboard interface between a user and a system, with the aim of it being used either in level 5 autonomous vehicles, or in passenger compartment that have seats with armrest surfaces.
[0021] The present disclosure improves the driving safety, e.g., by providing haptic feedback of proximity to an obstacle while parking.
[0022] In an embodiment, the present disclosure is employable in level 5 autonomous vehicles.
[0023] In an embodiment, this smart surface can be employed as the interactive surface interface of a device to which it is not physically connected, e.g., touch surface interface communicating wirelessly with a display device in close proximity.
[0024] In an embodiment, the capacitive-based touch sensitive layer can be made of a variety of materials, depending on the intended use case and aesthetic appeal.
[0025] In an embodiment, the capacitive-based touch sensitive layer is made of translucent plastic - interactive surface interface for an external device with LED lights underneath it.
[0026] In the present disclosure, the smart surface can generate both frictional and vibrotactile haptic sensations.
[0027] In an embodiment, frictional haptic sensations, also described as electro vibration, are generated thanks to the insulative and conductive layers, which allow for friction between the smart surface and the passenger's skin to be modulated through electrostatic actuation, while the skin is in motion. [0028] In an embodiment, vibrotactile haptic sensations, in turn, are generated thanks to the vibrotactile actuators, which can generate vibrations strong enough (e.g., 65Hz to 500Hz) to be felt through the passenger's skin, either stationary or in motion, when in direct contact with the smart surface.
[0029] In an embodiment, when the smart surface is used as the interactive interface for an external device, haptic feedback sensations, programmed/controlled by the external device's software, can be generated on it, as long as the haptic actuation technology that is present on the smart surface is both capable of interpreting the software's information and of generating such sensations. When the external device's software sends a command to the smart surface, requesting that it generates haptic and/or thermal feedback sensations on the surface layer, the command technology/software found on the smart layer should be capable of differentiating between these types of actuations, delegating the request to the actuation technology that controls the actuators capable of generating said feedback.
[0030] In an embodiment, the capacitive and/or haptic feedback sensations of the smart surface are controlled by an external device which can be the same device that the smart surface is controlling (e.g., center stack) or other.
[0031] In an embodiment, the armrest keyboard comprises a 7" display, 7 mm thick, powered through a socket provided by the vehicle specifically for the device, communication with the vehicle via ethernet, and with user devices via Wi-Fi.
[0032] In an embodiment, the present disclosure is equipped on a portion of the surface of the vehicle seat's armrest, where it acts as an external interactive surface interface for the centre stack display device, in the form of a keyboard.
[0033] In another embodiment, the seat's armrest is part of a train carriage, airplane fuselage or other passenger compartment that have seats with armrests.
[0034] In an embodiment, a full haptic feedback keyboard surface, actuated through electro vibration and/or vibrotactile actuation, which can be activated by the passenger and accessed on the vehicle seat armrest smart surface. LED lights, integrated on their own layer between the capacitive-based touch sensitive layer and the layer of vibrotactile actuators, light up when the keyboard is in use, indicating the location of each specific key on the keyboard. The light from these LED lights should be strong enough to be seen through the capacitive-based touch sensitive layer, which, in turn, should be made of a material, or have a thin enough thickness, that allows for the lights to be clearly visible.
[0035] In an embodiment, the capacitive surface can be made of a material that allows for the LED light to pass through, which can be dependent on how thick said surface is (e.g., certain types of wood can let light pass through when it's thin enough).
[0036] In an embodiment, passenger can use this keyboard to facilitate and speed up their performance on tasks that involve writing, be it for entertainment, educational, or professional purposes, while sitting comfortably inside the vehicle during their commutes, keeping a comfortable posture.
[0037] In an embodiment, the armrest smart surface is embedded on a movable platform which, at the passenger's behest, can be switched into one of two positions, either placed directly on top of the full armrest structure, at the passenger's side, or it can be slid on top of the full armrest structure until it is set horizontally in front of the passenger. When the user presses the dedicated "switch" button present either on the armrest smart surface, or as key on the keyboard, the movable platform's apparatus proceeds to move to the other position. This movable platform is placed between the armrest smart surface and the remaining structure of the armrest. This movable platform is connected to the middle and tail-right end of the armrest smart surface. The location where the movable platform connects to the armrest smart surface's middle portion is horizontally curved in its design. When the "switch" button is pressed, and the armrest smart surface is in "compact" or "short" mode (as seen in Figure 2), the movable platform moves over the length of the armrest structure, until it reaches the front end of it. When it reaches said area, it is locked in placed, and the movable platform component that is connected to the armrest smart surface's tail-right end begins to move inwards towards the middle portion. Throw this movement, the armrest smart surface slides atop the middle portion of the movable platform, curving inwards instead of moving fully forward, until it reaches the "full" or "extended" mode (as seen in Figure 1). If, when the "switch" button is pressed, and the armrest smart surface is in "full" or "extended" mode, the reverse of this process occurs, and instead of the movable platform's component that is connected to the armrest smart surface's tail-right end sliding towards the middle portion of the movable platform, it instead slides away from said portion. The assembly of this structure to a base/normal armrest can be plug and play, can come pre-installed on it, or it can be installed by a knowledgeable person. For the smart surface's components to be powered, it should be connected to any of the vehicle's power supplies or one provided by the user (e.g., batteries), deriving power from it.
[0038] In the passenger's side embodiment, the keyboard is in compact layout, which is aimed at being used with only one hand, ideally for shorter inputs.
[0039] In the in front of the passenger embodiment, the keyboard is in full layout, extended over a wide horizontal portion of the smart surface. This layout is aimed at being used with both hands, ideally for longer inputs.
[0040] In an embodiment, when a key is pressed, passenger feel a vibrotactile "click" sensation, indicating that a key was pressed.
[0041] In an embodiment, when sliding a finger over the keyboard, different texture sensations are used to indicate to the passenger, e.g., when the finger is sliding on top of a virtual button (e.g., a different texture sensation is generated for each button, helping the user differentiate between different buttons); when the passenger enter/leaves the location of a virtual button (e.g., a sensation of a "bump" in generated when the skin reaches the edge of a button, and no texture sensation is generated between the gaps of each button); and the location of the index-finger locator keys, usually the F and J keys in QWERTY keyboards (when keyboard is in full mode), by way of noticeably different texture and bump sensations. In other alphabets, these locator keys can be adjusted accordingly. However, it is expected that the perception of electrovibration and vibrotactile haptic sensations might be affected by conditions related to the user's hands. For example, the use of gloves can completely negate electrovibration actuation, as the skin of the finger is required to complete the circuit with the insulating layer and the conductive layer of the structure, as well as severely attenuate or even completely mask the vibrations generated by the electrovibration actuators. High finger humidity, in turn, can also negatively impair or outright negate the sensations generated by both electrovibration and vibrotactile actuators. [0042] In an embodiment, it is disclosed an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising: an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.
[0043] In an embodiment, the armrest and the interactive surface are rotatably and slidably coupled.
[0044] In an embodiment, the interactive surface is arranged to fit in the armrest when the interactive surface and the armrest are oriented parallelly.
[0045] In an embodiment, the armrest keyboard can comprise a wireless connection to communicate wirelessly with an external display device.
[0046] In an embodiment, the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user presses a virtual button of the interactive surface.
[0047] In an embodiment, the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user slides a finger over virtual buttons of the interactive surface.
[0048] In an embodiment, the electronic data processor is further configured to drive the haptic-feedback layer to provide an enhanced haptic-feedback as the user slides a finger over virtual buttons 'F' and 'J' of the interactive surface.
[0049] In an embodiment, the armrest keyboard according to any of the previous claims wherein the first keyboard is longer than the second keyboard. [0050] In an embodiment, the second keyboard has less virtual buttons than the first keyboard.
[0051] In an embodiment, the capacitive-based touch sensitive layer is made of translucent plastic comprising LEDs underneath it.
[0052] In an embodiment, the armrest keyboard can comprise a frictional haptic- feedback layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations.
[0053] In an embodiment, the armrest keyboard can comprise a vibrotactile haptic layer for providing vibrotactile haptic sensations.
[0054] It is also disclosed a method of operating an armrest keyboard according to any of the previous embodiments comprising using an electronic data processor to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.
BRIEF DESCRIPTION OF THE DRAWINGS
[0055] The following figures provide preferred embodiments for illustrating the disclosure and should not be seen as limiting the scope of invention.
[0056] Figure 1A: Schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest.
[0057] Figure IB: Schematic representation, in top view, of an embodiment of the haptic full keyboard layout on armrest.
[0058] Figure 2A: Schematic representation, in front view, of an embodiment of the haptic compact keyboard layout on armrest. [0059] Figure 2B: Schematic representation, in top view, of an embodiment of the haptic compact keyboard layout on armrest.
[0060] Figure 3: Scheme of the layer's superposition.
DETAILED DESCRI PTION
[0061] The present disclosure relates to an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to drive the haptic-feedback layer to provide a haptic-feedback; display a first keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard; and to an operation method thereof.
[0062] Figure 1A shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 103 represents a full keyboard layout, 105 represents an armrest, and 107 represents a seat.
[0063] Figure IB shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 103 represents a full keyboard layout, 105 represents an armrest, and 107 represents a seat. [0064] As illustrated in Figure 1A and Figure IB, an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, can comprise: an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.
[0065] Figure 2A shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 203 represents a compact keyboard layout, 105 represents an armrest, and 107 represents a seat.
[0066] Figure 2B shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 203 represents a compact keyboard layout, and 107 represents a seat.
[0067] Figure 3 shows a scheme of the layer's superposition, wherein A represents an insulative layer; B represents a capacitive-based touch sensitive layer; C represents a vibrotactile actuators layer; D represents a transparent electrode sheet layer and E represents a LED lights layer.
[0068] The term "comprising" whenever used in this document is intended to indicate the presence of stated features, integers, steps, components, but not to preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof.
[0069] The disclosure should not be seen in any way restricted to the embodiments described and a person with ordinary skill in the art will foresee many possibilities to modifications thereof. The above-described embodiments are combinable. The following claims further set out particular embodiments of the disclosure.
[0070] References:
1. Junichi, S., & Yukawa, K. (2004). INPUT DEVICE FOR AUTOMOBILE (Patent No.
JP2004262363A).Japan. https://worldwide.espacenet.eom/patent/search/family/033119518/publication/J P2004262363A?q=pn%3DJP2004262363A. KHOSHKAVA, V., CRUZ-HERNANDEZ, J. M., & SHAH, K. (2019). HAPTIC ACTUATOR ASSEMBLY WITH A SPRING PRE-LOAD DEVICE (Patent No. EP3582074A1). https://worldwide.espacenet.com/patent/search?q=pn%3DEP3582074Al. Olley, M. F. D., Peshkin, M. A., & Colgate, J. E. (2020). Electronic controller haptic display with simultaneous sensing and actuation (Patent No. US10768749B2). https://worldwide.espacenet.com/patent/search?q=pn%3DUS10768749B2. SHOU-SHAN, F., LIANG, L., LI, Q., & YU-QUAN, W. (2017). TOUCH CONTROL VEHICLE SEAT AND VEHICLEMOUNTED ENTERTAINMENT SYSTEM (Patent No. US2017147108A1). https://worldwide.espacenet.com/patent/search/family/056660792/publication/ US2017147108Al?q=pn%3DUS2017147108Al.

Claims

C L A I M S An armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising: an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard. The armrest keyboard according to the previous claim wherein the armrest and the interactive surface are rotatably and slidably coupled. The armrest keyboard according to any of the previous claims wherein the interactive surface is arranged to fit in the armrest when the interactive surface and the armrest are oriented parallelly. The armrest keyboard according to any of the previous claims comprising a wireless connection to communicate wirelessly with an external display device. The armrest keyboard according to any of the previous claims wherein the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user presses a virtual button of the interactive surface. The armrest keyboard according to any of the previous claims wherein the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user slides a finger over virtual buttons of the interactive surface. The armrest keyboard according to the previous claims wherein the electronic data processor is further configured to drive the haptic-feedback layer to provide an enhanced haptic-feedback as the user slides a finger over virtual buttons 'F' and 'J' of the interactive surface. The armrest keyboard according to any of the previous claims wherein the first keyboard is longer than the second keyboard. The armrest keyboard according to any of the previous claims wherein the second keyboard has less virtual buttons than the first keyboard. The armrest keyboard according to any of the previous claims wherein the capacitive-based touch sensitive layer is made of translucent plastic comprising LEDs underneath it. The armrest keyboard according to the previous claim comprising a frictional haptic- feedback layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations. The armrest keyboard according to any of the previous claims comprising a vibrotactile haptic layer for providing vibrotactile haptic sensations. Method of operating an armrest keyboard according to any of the previous claims comprising using an electronic data processor to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.
16
EP21854826.1A 2021-12-29 2021-12-30 Armrest keyboard with haptic and thermal feedback Pending EP4457594A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PT11771321 2021-12-29
PCT/IB2021/062475 WO2023126662A1 (en) 2021-12-29 2021-12-30 Armrest keyboard with haptic and thermal feedback

Publications (1)

Publication Number Publication Date
EP4457594A1 true EP4457594A1 (en) 2024-11-06

Family

ID=80222555

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21854826.1A Pending EP4457594A1 (en) 2021-12-29 2021-12-30 Armrest keyboard with haptic and thermal feedback

Country Status (2)

Country Link
EP (1) EP4457594A1 (en)
WO (1) WO2023126662A1 (en)

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8610674B2 (en) * 1995-06-29 2013-12-17 Apple Inc. Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
JP2004262363A (en) 2003-03-03 2004-09-24 Matsushita Electric Ind Co Ltd Automotive input device
US8618720B2 (en) * 2009-10-01 2013-12-31 Blackberry Limited Piezoelectric assembly
US20110141057A1 (en) 2009-10-02 2011-06-16 Panasonic Avionics Corporation System and Method for Interacting with Information Systems
US10068728B2 (en) 2009-10-15 2018-09-04 Synaptics Incorporated Touchpad with capacitive force sensing
JP2013542114A (en) * 2010-09-10 2013-11-21 パナソニック・アビオニクス・コーポレイション Integrated user interface system and method
EP3382512A1 (en) 2014-02-21 2018-10-03 Northwestern University Haptic display with simultaneous sensing and actuation
GB201406938D0 (en) 2014-04-17 2014-06-04 In2Tec Ltd Illuminated touch operated switch panel
US20150363008A1 (en) * 2014-06-11 2015-12-17 Lenovo (Singapore) Pte. Ltd. Displaying a user input modality
CN205468662U (en) 2015-11-24 2016-08-17 清华大学 Touch car seat and on -vehicle infotainment system
DE102017218120A1 (en) 2017-10-11 2019-04-11 Robert Bosch Gmbh A method of providing haptic feedback to an operator of a touch-sensitive display
US10345910B1 (en) 2018-06-15 2019-07-09 Immersion Corporation Haptic actuator assembly with a spring pre-load device

Also Published As

Publication number Publication date
WO2023126662A1 (en) 2023-07-06

Similar Documents

Publication Publication Date Title
US9248742B2 (en) Motor vehicle comprising a driver assistance device and method for operating a motor vehicle
JP2021166058A (en) Gesture-based input system with tactile feedback in the vehicle
US20210349592A1 (en) Method for operating a human-machine interface, and human-machine interface
JP5161303B2 (en) Touch control device
US20180246573A1 (en) Electrostatic Haptic Actuator and User Interface With an Electrostatic Haptic Actuator
CN108367679B (en) Vehicle with an image detection unit and an operating system for operating a device of the vehicle and a method for operating the operating system
US20190212912A1 (en) Method for operating a human-machine interface and human-machine interface
JP2016120890A (en) Vehicular switching device
US20210194483A1 (en) Switch device with integrated touch sensor
JP2010529595A (en) Touch control device with feedback function
JP6749909B2 (en) Vehicle control device and control method
CN105751995B (en) Forward travel device and the user interface for forward travel device
JP2005293512A (en) Finger-worn type data input device
EP4457594A1 (en) Armrest keyboard with haptic and thermal feedback
US20230049900A1 (en) Displaced haptic feedback
JP2004139845A (en) Inner force sense applying type input device
Meschtscherjakov The steering wheel: A design space exploration
CN114555403A (en) Operating system for a vehicle, motor vehicle having an operating system, and method for operating an operating system for a vehicle
JP2004130979A (en) Tactile force applying type input device
US20240351436A1 (en) Reduced operator control device
US11822723B2 (en) Interaction element, control element and motor vehicle
JP6941798B2 (en) Input device
EP4457585A1 (en) Interface and alert device with haptic and thermal feedback for autonomous vehicle
JP2011090628A (en) Softness-presenting device
Lisseman et al. In-Vehicle Touchscreen Concepts Revisited: Approaches and Possibilities

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20240627

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)