CN109144243B

CN109144243B - Method for haptic interaction of user with electronic device and electronic device thereof

Info

Publication number: CN109144243B
Application number: CN201810670141.2A
Authority: CN
Inventors: F·贝鲁施
Original assignee: Robert Bosch GmbH
Current assignee: Robert Bosch GmbH
Priority date: 2017-06-28
Filing date: 2018-06-26
Publication date: 2021-06-22
Anticipated expiration: 2038-06-26
Also published as: CN109144243A; DE102017210958A1; FR3068499B1; FR3068499A1

Abstract

The invention relates to a method for haptic interaction of a user with an electronic device and to an electronic device for carrying out the method, wherein the electronic device has: a user interface; the scanning device is used for generating a scanning signal according to the contact position of the user interface and the operation part; a vibration device for generating a mechanical impulse in a user interface, wherein at least one operating region is arranged on the user interface, wherein the mechanical impulse is generated in the user interface in dependence on a contact of the user interface with an operating member in the operating region, characterized in that a virtual edge is provided in the operating region, which virtual edge is located in front of an edge of the operating region, and that the mechanical impulse is generated to generate a tactilely perceptible edge when a detected position of the operating member is located on the virtual edge.

Description

Method for haptic interaction of user with electronic device and electronic device thereof

Background

In addition to operating elements implemented in hardware (e.g., pressure switches, knobs or sliders), electronic devices often have a mechanically touch-sensitive user interface for their operation, such as a so-called touch panel or a touch-sensitive display or display, a so-called touch screen. The latter is particularly common, for example, in so-called smartphones or tablets. Furthermore, use in motor vehicles and work machines is also conceivable.

Different operating functions relating to the background can be allocated to the hardware operating elements and the touch-sensitive user interface in the operating region. In addition, the user interface may be subdivided into varying sub-regions that are context dependent. The latter is known, for example, from smart phones, in which a touch-sensitive user interface is usually provided as an operating element, wherein, depending on the activated function, sub-areas of the user interface that differ from one another or differ in size are available for operation. The user interface is implemented to detect contact with the scanner and generate a scanning signal based on a location of the contact on the user interface when the contact is sensed.

In the case of a touch screen, the user interface is simultaneously embodied as a display and visually displays an operation area or operation areas, so that the user can control the contact and thus the function based on visual information. Typically, these operating areas (often referred to as icons or soft keys) are for tactile use and have dimensions close to the size of a fingertip. Such an operating member is described, for example, in EP 1964022B 1 or EP 2126678B 1.

Furthermore, it is known, for example from WO2016/082963 a1, to provide a touch-sensitive surface with tactile feedback, i.e. feedback that can be sensed by the user by touch, in order to simplify the interaction with the operating region (here a virtual key, for example a virtual pressure switch) and to achieve an interaction without looking at. To this end, the entire touch-sensitive surface (here the touch-sensitive display) is excited by means of an actuator with mechanical pulses or a sequence of mechanical pulses (i.e. vibrations). Here, the vibration is transmitted by a structured surface in the operating area or key area.

In order to be able to find the operating region without looking through contact, for example, in Pakkanen, t., r., raiamao, j., Salminen, k., and Surakka, v. (2010): "comparison of three designs of the edges of the tactile buttons on a touch screen", the tactile technical seminar' 10,219-225 proposes that when a finger moving on a surface is guided from the background to the operating area or from the operating area back to the background, so-called edge feedback in the sense of touch is output.

This can be used within the scope of the so-called "search and haptic" function. If the user moves his finger over the display, the tactile feedback (here edge feedback) informs him about the limitations of the operating element. With this sensory aid, the user can distinguish, for example, a plurality of virtual buttons without having to look at the display.

If a plurality of operating areas with such edge feedback, i.e. tactile feedback that is perceived to the user as an edge, on the touch-sensitive surface are arranged adjacent to each other, a certain minimum distance must be maintained between the operating areas so that they can be perceived by the user as different.

Disclosure of Invention

The advantage of the invention is that the distance between operating regions with tactile edge feedback on a touch-sensitive user interface, in particular a touch-sensitive display, can be reduced, wherein adjacent operating regions are clearly distinguishable tactilely, so that the risk of incorrect operation due to accidental operation of two adjacent operating regions can be kept low.

Here, edge feedback is understood to mean tactile feedback which feels to the user like a mechanical, i.e. actually present edge on a touch-sensitive user interface.

To this end, the invention proposes providing a virtual edge for generating an edge feedback, wherein the virtual edge is arranged within an operating region shown on the user interface and in front of an operating region edge. The virtual edge and thus the edge feedback are thus not spatially coincident with the edge of the operating region shown, but rather lie within the operating region shown.

To this end, a method for tactile interaction of a user with an electronic device is proposed, wherein the electronic device has a user interface, scanning means for generating a scanning signal as a function of a contact position of the user interface with an operating element in an operating region, vibration means for generating a mechanical impulse in the user interface, wherein at least one operating region is arranged on the user interface, and wherein the mechanical impulse in the user interface is generated as a function of a contact of the user interface with the operating element in the operating region, characterized in that a virtual edge is provided in front of an edge of the operating region in the operating region, and the mechanical impulse for generating a tactilely perceptible edge is generated when a detected position of the operating element is located on the virtual edge.

In this case, the distance of the virtual edge from the operating field edge is advantageously determined as a function of the distance of the operating field edge from a further operating field edge adjacent to the operating field. Thus, the position of the virtual edge may be moved when the distance of the operation regions from each other decreases towards the center of one operation region or a plurality of operation regions with edge feedback.

Preferably, the distance of the virtual edge from the edge of the operating area is determined by the contact surface of the operating element on the user interface.

For example, the distance from the virtual edge to the edge of the operating area can be determined as half the diameter of the contact surface. This ensures that the edge feedback is triggered before or at the latest when the contact surface of the operating element moves over the edge of the operating area displayed on the user interface when the operating area is moved from the inside to the outside. In this way, it is possible in the extreme case to arrange two operating regions next to one another, wherein edge feedback can still be clearly assigned to one of the two operating regions next to one another.

In an advantageous embodiment, it is provided that the contact surface of the operating element on the user interface is determined in the training step. Thus, for example, a training process may be started when the electronic device is first put into use, in which training interval the contact surface of the operating member is determined, approximately the contact surface of a fingertip (e.g. the index finger of a user's hand). Alternatively, the contact surface of a stylus used to operate the electronic device may also be determined. Thereby, an adaptation to the user can be achieved, so that a convenient or more reliable operation can thus be provided for the user.

In an advantageous embodiment, it is further provided that, alternatively or additionally, the contact surface of the operating element on the user interface is determined during normal operation of the electronic device, i.e. also outside the training period. This can also be done continuously. Thereby, for example, a wider user adaptation may be achieved when different users use the electronic device.

Furthermore, an electronic device is proposed, which has a user interface, which further comprises a vibration device for generating a mechanical impulse in the user interface, and wherein the user interface is configured with a scanning device for generating a scanning signal depending on a contact position on the user interface, wherein the electronic apparatus is configured according to the method described above or a modification of the method to perform the method for tactile interaction of a user with the electronic apparatus.

Drawings

Embodiments of the invention are illustrated in the drawings and are explained in detail below. In the drawings, like reference numbers indicate identical or functionally similar elements.

Fig. 1 shows a block diagram of an electronic device for performing the method according to the invention.

Detailed Description

Fig. 1 shows a block diagram of an electronic device 1 adapted to perform the method according to the invention. Here, the electronic device may be a mobile device, such as a smartphone or a tablet computer or a notebook computer. Further, the electronic device 1 may in principle be any other electronic device operable by means of a touch-sensitive surface.

The invention is based on an electronic vehicle device 2 as the electronic device 1, which comprises, for example, an in-vehicle air conditioner, a driver assistance system and a driver information system such as a vehicle navigation and multimedia system, and a vehicle communication device such as a mobile telephone handsfree set.

For the interaction of a vehicle driver or other vehicle occupants with the electronic vehicle device 1, a generic operating device 10 or user Interface 10, also referred to as HMI (Human Machine Interface), is provided.

Here, the operation device 10 includes: a so-called touch display 11, i.e. a display unit 12 or a display 12; and scanning means 13 for detecting contact on the surface facing the user. The display 12 and the scanning device 13 are combined into a common mechanical unit, here a so-called "glued" contact display 11 or touch screen 11. This combination of scanning device 13 and display 12, i.e. contacting display 11, is supported mechanically vibratably. This is achieved by the elastic support. In the case of use in the automotive field, i.e. for example as an HMI in a motor vehicle, the touch display 11 is arranged elastically in a dashboard, for example in the dashboard or similar of the vehicle, preferably in the extended field of view of the driver, but in any case within its reach. The resilient support is indicated by a spring 171 and the abutment in the vehicle is indicated by reference 172. Furthermore, the vibration device 16 is mechanically operatively connected to the touch display 11, i.e. in the present case, for example, glued or otherwise mechanically rigidly connected. The touch display 11 or the touch panel 11 and its elements such as the display unit 12 and the scanning device and the vibrating device 16 are connected to the controller 15 via signal lines.

Thus, the HMI 10 includes the contact display 11, the controller 15, the vibrating device 16, and the vibratable support portion 171, 172 that contacts the display 11.

The controller 15 is preferably implemented in a manner known per se in the form of a processor with a corresponding memory, in which an operating program is stored which is run by the processor to carry out the method according to the invention.

The vibration means 16 serve to deflect the contact display 11, thereby generating a tactile sensation, i.e. a pulse or vibration that can be perceived by means of a tactile sensation in the user interface 121 of the contact display facing the user.

The vibration means 16 may for example be implemented in the form of an electromagnet, wherein a first part is rigidly connected to the touch display 11, while a second part, which is electromagnetically movable with respect to the first part, is free to vibrate. When the electromagnet 16 is loaded with an electrical pulse output by the controller 15, it emits a mechanical pulse which couples into the contact display 11 and deflects it as a whole. This offset is perceptible as a tactile impulse on the surface 121 of the touch display. Here, the deflection of the touch display can be a reciprocating movement, a reciprocating and rotational movement with a rotational component around the perpendicular to the surface 121 or a translational movement parallel to the surface 121, depending on the effective direction of the bearing and the vibration means 16.

By suitable control of the vibration device 16 by means of corresponding pulses, a so-called edge feedback can be generated which can be perceived by the user as an edge on the surface 121 in a tactile manner, i.e. by means of a haptic sensation. For example, in Pakkanen, t., r., Raisamo, j., Salminen, k., and Surakka, V. (2010): "comparison of three designs of tactile button edges on touch screen", details regarding the appropriate control of the vibration device 16 to generate edge feedback are described in the tactile technical seminar' 10,219- "225.

The display unit 12 or display 12 is used to display an operating area visible to a user, here a driver of the vehicle or another passenger of the vehicle, who is viewing the user interface 121 of the display 12, i.e. the display surface 121. The content displayed on the display 12, in particular the operating area and its title here, is transmitted by the controller 15 to the display 12 in a context-dependent manner, i.e. depending on the current operating situation. The operating regions represent virtual operating elements, such as pressure or key switches, knobs or sliders or other operating elements, such as alphanumeric keyboards or keyboard components known from smartphones, such as so-called "icons" or "buttons" or similar operating elements, also known from smartphones.

In the case on which the drawing is based, for example, two

planar operating regions

124 and 125 are shown arranged next to one another, wherein the right edge 1241 of the first operating region 124 is adjacent to the left edge 1251 of the second operating region 125.

The scanning device 13 cooperates with the controller 15 for determining the contact position 131 of the user interface 121 by means of the operating element 3. The operating element 3 may be, for example, the tip of a finger (for example, the index finger of a user's hand). The operating element 3 can also be a stylus, for example, which is held by a user's hand and is guided through the touch-sensitive surface 11 via the user interface 121. The scanning device 13 converts the contact surface 132 into a contact point 131 whose coordinates are here determined as the center of the contact surface 132, with which contact surface 132 the operating element 3 is situated on the touch-sensitive surface 11, i.e. here on the user interface 121.

Contrary to the illustration in fig. 1, the scanning device 13 may also be arranged in the form of a transparent film on the actual display 12. In this case, the user interface 121 is formed by the upper side of the scanning device 13, wherein the operating

areas

124 and 125 can be visualized on the user interface 121 through the scanning device 13.

In order to process the user input by means of the contact of the user interface 121, if the determined contact position of the user interface 121 is located on an edge of the

operating area

124 or 125, for example on the right edge or right edge 1241 of the first operating area 124 or on the left edge or left edge 1251 of the second operating area 125 in the case illustrated in fig. 1, an edge feedback is output in the known solutions according to the prior art.

The invention provides for the addition of an invisible virtual edge 1242 in the case of the first operating region 124. The virtual edge 1242 is arranged within the surface of the first operating region 124 in front of the right edge 1241 of the first operating region 124, which is shown so as to be visible on the display 12. Thereby, the virtual edge 1242 moves into the manipulation area 124 in the direction of the manipulation area center. In the case shown in the figures, a further virtual edge 1252 is preferably likewise provided, which is arranged in the second operating region 125 adjacent to the first operating region 124 and is moved into the operating region 125 in this case relative to the left edge 1251 shown and visible on the display 12.

What can be achieved in this way is that even if the distance of the visibly depicted edges of the operating regions (here the distance of the right edge 1241 of the first operating region 124 from the left edge 1251 of the second operating region) is small, the desired haptic minimum distance, i.e. the minimum distance between the tactilely detectable, i.e. perceptible edges, is fed back by the edges of the two

adjacent operating regions

124 and 125. The average has been determined to be about 10 mm as the minimum distance to touch. Thus, when the

virtual edges

1242 and 1252 are moved forward by, for example, 3 millimeters in the direction of the center of the

respective operation areas

124 and 125, the

edges

1241 and 1252 of the operation surface displayed on the display unit 12 can approach each other to 4 to 5 millimeters, with a tactile minimum distance of 10 millimeters being maintained. If the finger 3 is slid over this virtual edge 1242, edge feedback is output, while no edge feedback is generated for the real visible edge 1241. Similarly, edge feedback is generated when another virtual edge 1252 is slid, but not when the left real edge 1251 of the second operational area 125 is slid.

The virtual edge 1242 may advantageously move the contact face 132 to about half the width of the real edge 1241. It is thereby ensured that, when sliding over virtual edge 1242, i.e. when the resulting contact point 131 is located on virtual edge 1242, the real edge 1241 shown is located within contact face 132, thus creating the illusion to the user that: edge feedback is generated from the real edge 1241. It can be assumed approximately that the width of the contact surface is at least 8mm, so that the virtual edge 1242 can deviate from the real edge 1241 by up to 4mm, i.e. can be moved relative to this in the direction of the center of the operating region 124 by 4 mm.

With an advantageous embodiment of the invention, the scanning device 13 is also configured to provide not only the determined coordinates of the contact point 131, but in addition to that also the dimensions of the contact surface 132. Thus, in normal operation or in a separate operating mode, for example after first activation of the electronic device 1 or in a training mode after commissioning of the electronic device 1 by a new user, the contact faces can be determined, after which the distance of the operating

areas

124, 125 from each other and the distance of the

virtual edges

1242 and 1252 from the

visible edges

1241 and 1251 of the operating

areas

124 and 125 can be set. In addition, the range of the operating region may also be adjusted accordingly.

Claims

1. A method for haptic interaction of a user with an electronic device (1), wherein the electronic device has:

-a user interface (121),

-scanning means (13) for generating a scanning signal depending on a contact position of the user interface (121) with the operating member (3),

-vibration means (16) for generating mechanical pulses in the user interface (121),

wherein a first operating area (124) and a second operating area (125) are arranged next to one another on the user interface (121), wherein a first edge (1241) of the first operating area (124) and a second edge (1251) of the second operating area (125) are spaced apart from one another,

wherein a mechanical impulse is generated in the user interface (121) in dependence on a contact of the user interface (121) with the operating member (3) in the first operating region (124) and/or the second operating region (125),

it is characterized in that the preparation method is characterized in that,

a first virtual edge (1242) is arranged in the first operating area (124) in front of the first edge (1241) of the first operating area (124), and a second virtual edge (1252) is arranged in the second operating area (125) in front of the second edge (1251) of the second operating area (125),

-generating a mechanical impulse to generate a tactilely perceptible edge when the detected position (131) of the operating member (3) is located on the first virtual edge (1242) or the second virtual edge (1252).

2. Method according to claim 1, characterized in that the distance of the first virtual edge (1242) from the first edge (1241) of the first operating area (124) and/or the distance of the second virtual edge (1252) from the second edge (1251) of the second operating area (125) is determined as a function of the distance of the first edge (1241) of the first operating area (124) from the second edge (1251) of the second operating area (125).

3. Method according to claim 1 or 2, characterized in that the distance of the first virtual edge (1242) from the first edge (1241) of the first operating region (124) and/or the distance of the second virtual edge (1252) from the second edge (1251) of the second operating region (125) is determined by a contact surface (132) of the operating part (3) on the user interface (121).

4. Method according to claim 3, characterized in that the distance of the first virtual edge (1242) from the first edge (1241) of the first operating region (124) and/or the distance of the second virtual edge (1252) from the second edge (1251) of the second operating region (125) is determined to be half the diameter of the contact surface (132).

5. A method according to claim 3, characterized in that the contact surface (132) of the operating member (3) on the user interface (121) is determined in a training step or is determined continuously in normal operation.

6. An electronic device (1), wherein the electronic device (1) has a user interface (121), wherein the device (1) further has a vibration means (16) for generating a mechanical impulse in the user interface (121), and wherein the user interface (121) is configured with a scanning means (13) for generating a scanning signal depending on a contact position on the user interface (121),

it is characterized in that the preparation method is characterized in that,

the electronic device (1) is configured to perform a method for haptic interaction of a user with the electronic device (1) according to the method of any of claims 1 to 5.