EP3811194A1 - Method for the tactile interaction of a user with an electronic device, computer program product and electronic device - Google Patents
Method for the tactile interaction of a user with an electronic device, computer program product and electronic deviceInfo
- Publication number
- EP3811194A1 EP3811194A1 EP19718160.5A EP19718160A EP3811194A1 EP 3811194 A1 EP3811194 A1 EP 3811194A1 EP 19718160 A EP19718160 A EP 19718160A EP 3811194 A1 EP3811194 A1 EP 3811194A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- determined
- vibration frequency
- touch
- user interface
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 230000003993 interaction Effects 0.000 title claims abstract description 10
- 238000004590 computer program Methods 0.000 title claims description 5
- 238000005070 sampling Methods 0.000 claims description 20
- 230000001419 dependent effect Effects 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 11
- 239000004575 stone Substances 0.000 description 5
- 230000008447 perception Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 230000018109 developmental process Effects 0.000 description 3
- 239000006059 cover glass Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
Definitions
- the invention relates to a method for the tactile interaction of a user with an electronic device.
- the invention further relates to
- Electronic devices such as smartphones, tablet PCs, and the like.
- Navigation devices car radio devices or game consoles usually have a touch-sensitive user interface, which can be part of a display, which visually displays a control area or control panels for a user, so that a user controls the touch and thus the function of the electronic device based on the visual information can.
- a touch-sensitive user interface which can be part of a display, which visually displays a control area or control panels for a user, so that a user controls the touch and thus the function of the electronic device based on the visual information can.
- these operating areas often referred to as icons or softkeys, are used for tactile use and have sizes that correspond approximately to the size of a fingertip.
- Touchpads for example for laptops, sometimes have separate areas, such as a side scroll bar, which is characterized by a surface structure that differs from the rest of the user interface and thus facilitates haptic orientation. This divergent
- the object of the invention is the development of a method for the tactile interaction of a user with an electronic device and the
- a corresponding electronic device in which the interaction of a user with the electronic device can be expanded based on a tactile detection and a tactile perception of a function by the user.
- the finding of a position or an operating area or an operating field, for example an icon or softkey, on the user interface should be made easier with the aid of tactile perception.
- Signal processing device a change in position of an operating element, in particular a tip of a user's finger, on a
- Touch-sensitive user interface of the electronic device and a detected speed from the change in position
- Control element determined wherein a fundamental vibration frequency is determined from the determined speed, which for determining a
- Vibration frequency is subjected to a frequency variation value, the resulting vibration frequency being transmitted to an actuator which, depending on the vibration frequency determined, outputs a haptic feedback by deflecting the touch-sensitive user interface to the user via the touch-sensitive one
- the control element is preferably a finger of the user, said user preferably touching the control surface with the fingertip of the finger.
- the user's finger is assumed as the operating element below.
- the frequency variation value is preferably applied to the basic vibration frequency by multiplication, that is to say that the
- Vibration frequency is multiplied by the frequency variation value in order to obtain the resulting vibration frequency for controlling the actuator.
- a time-varying random value can also be additively superimposed on the value of the basic vibration frequency, which then results in the resulting vibration frequency.
- the solution of the invention is also carried out with an electronic device which has a touch-sensitive user interface
- Signal processing device by means of which a change in position of an operating element, in particular the tip of a finger of a user, is detected on a touch-sensitive user interface of the electronic device and a speed of the operating element is determined from the detected change in position, a basic vibration frequency being determined from the determined speed, which is used for determination one
- Vibration frequency is applied with a frequency variation value, and has an actuator by means of which a deflection of the
- Touch-sensitive user interface is controllable, the determined vibration frequency being transmitted from the signal processing device to the actuator and the actuator depending on the determined
- Vibration frequency controls an output of a haptic feedback by deflecting the touch-sensitive user interface to the user via the user interface.
- Movement-generated change in position of the finger here and below representative of an operating element.
- the speed of the finger with which the finger is moved along the touch-sensitive surface can be determined from this change in position. From this A basic vibration frequency can be determined at speed. To determine the basic vibration frequency, the speed can be multiplied, for example, by a linear factor, in particular a proportionality factor. This proportionality factor can preferably correspond to the periodicity of the texture visually represented on the user interface, over which the user moves his finger.
- Basic vibration frequency represents a constant vibration frequency, which would give the user a uniform haptic feedback via the actuator, regardless of the surface shown, with a steady movement of the finger along the user interface, so that the user, regardless of the one shown, is visually recognizable to the user
- this basic vibration frequency is not transmitted to the actuator in order to provide haptic feedback, but that this basic vibration frequency is first subjected to a frequency variation value, in particular to be multiplied.
- This frequency variation value is selected as a function of the visually recognizable texture shown on the user interface over which the user moves his finger.
- the value of the basic vibration frequency is determined by adding the
- Frequency variation value refined and thereby more specifically or realistically adapted to the texture visually displayed on the user interface. This makes it possible for different textures to be perceived and thus felt by a user with different haptics when he moves his finger over the user interface or the control panel with the corresponding texture. If, for example, a stone is displayed on the user interface, the user can also feel this stone because the inclusion of the
- the vibration frequency transmitted to the actuator is no longer constant, but is varied accordingly, so that there is a slightly fluctuating vibration frequency even with a constant movement speed of the finger along the user interface.
- This fluctuating vibration frequency transmitted to the actuator enables a slightly fluctuating haptic feedback through a slightly fluctuating vibration frequency
- Deflection of the user interface It can thereby be achieved that the user can feel the visually represented user interface more naturally by the user moving his finger along the User interface felt, haptic impression is adapted to the visual representation.
- the tactile perception can thereby be significantly improved for the user of the electronic device.
- the frequency variation value is preferably in a range between -20% and +20% of the determined basic vibration frequency.
- the frequency variation value can thus be in a range between 0.8 and 1.2, by which the basic vibration frequency is multiplied, in order to determine a vibration frequency that reproduces the visually represented texture of the user interface as naturally as possible. If the frequency variation value lies in a range between -20% and +20% of the determined basic vibration frequency, a particularly realistic tactile perception can be achieved with the user.
- the frequency variation value is preferably determined by means of a random function.
- the random function can be a software-implemented function.
- a random number representing the frequency variation value can be generated by a so-called BASIC function RND ().
- the detection of the change in position of the user's finger is preferably carried out in a continuously repeating sampling interval ts, wherein a vibration frequency can be determined for each sampling interval ts, which can be transmitted to the actuator.
- a basic vibration frequency can thus be determined in the signal processing device for each sampling interval, from which in turn a vibration frequency can be determined for each sampling interval and transmitted to the actuator. Due to the large number of determined vibration frequencies, which are used to control the actuator
- the sampling interval is the frequency with which a signal, here the change in position of the finger, is sampled, that is measured and converted into a time-discrete signal, in a predetermined time.
- the frequency variation value is also preferably redetermined after each sampling interval. This can be achieved with a uniform Movement of the finger from a constant fundamental vibration frequency, a frequency is determined which can change after each sampling interval.
- the sampling interval ts is preferably ⁇ 20 ms, particularly preferably the sampling interval ts ⁇ 10 ms. With this sampling interval, a particularly good reaction to the movement of the finger can be achieved, as a result of which the tactile
- the object of the invention is also achieved with a
- Computer program product which has program parts for executing a method which has been developed and developed as described above.
- Fig. 1 is a schematic representation of an electronic device according to the invention.
- Fig. 2 is a schematic representation of a method according to the invention.
- FIG. 1 schematically shows an electronic device 100 which can be operated by a user.
- the electronic device 100 has a touch-sensitive user interface 10, along which a user can execute a movement with his finger F in order to control and operate the electronic device 100.
- the touch-sensitive user interface 10 is part of a display 11 on which the user is visually shown control panels 12, such as icons or softkeys. These control panels 12 can have different visually represented textures.
- the touch sensitive user interface 10 is part of a display 11 on which the user is visually shown control panels 12, such as icons or softkeys. These control panels 12 can have different visually represented textures.
- User interface 10 is arranged on a base body 13 of the display 11 and has a so-called touch surface 14 and a cover glass 15.
- the display 11 can display context-dependent control panels 12, which can have different optical textures, such as rough stone surfaces, which can be generated by a signal processing device 16.
- the signal processing device 16 is connected to the display 11, so that signals from the display 11 to the
- Signal processing device 16 and vice versa can be transmitted.
- the touch-sensitive user interface 10, in particular the touch surface 14 of the touch-sensitive user interface 10, can be used to determine the position of the finger F of the user.
- the position change determined in this way is detected by the signal processing device 16 and processed further in such a way that the signal processing device 16 controls an actuator 17 in such a way that it in turn controls, in particular deflects, the touch-sensitive user interface 10 in such a way that the user uses the visually perceived texture of the control panel 12 he moves his finger F, can also perceive it haptically according to its texture, so that the user can not only perceive a rough stone surface visually, but can also perceive and feel it haptically.
- Touch-sensitive user interface 10 as indicated by the arrow, the X and Y coordinates of the movement of the finger F are determined to determine the position of the finger F.
- the distance between the X and Y coordinates is determined and converted accordingly.
- the speed of the finger F during the movement of the finger F along the user interface 10 is determined from the detected change in position of the finger F, the speed being determined from the change in position in relation to the time. If, for example, a 7-inch display is used, which corresponds to a length of 18 cm, the finger F, if it moves quickly, crosses the distance of 18 cm in a time of 0.5 s. This results in a maximum
- the determined speed of the finger F becomes one
- Basic vibration frequency determined.
- the speed of the finger F is converted into a basic vibration frequency using a factor, in particular a proportionality factor, which corresponds to the periodicity of the visually represented texture. For example, if you have a visual texture with a
- the signal processing device 16 determines a periodicity of 2 mm at a speed of the finger F of 50 mm / s
- a basic vibration frequency to be determined is preferably between 10 Hz and 300 Hz, since this range is well perceptible to the touch and one
- the determined basic vibration frequency is multiplied by a frequency variation value as a function of the visually represented texture over which the finger F is moved.
- This frequency variation value lies in a range between -20% and +20% of the basic vibration frequency. For example, with a rough stone surface, a frequency variation value of +20% of one
- the frequency variation value varies with each sampling interval in a range between -20% and +20% of the basic vibration frequency.
- the frequency variation value is generated by a random function.
- This random function can be configured such that it outputs random values in the range from 0.8 to 1.2 by which the fundamental vibration frequency is multiplied.
- the position of the finger F is determined in a large number of successive sampling intervals ts, so that a vibration fundamental frequency and thus also a vibration frequency are determined for each sampling interval ts becomes.
- the frequency variation value is redetermined, as can be seen in FIG. 2. It can thereby be achieved that, with a uniform movement of the finger, a constant fundamental vibration frequency becomes a frequency which can change after each sampling interval.
- the signal processing device 16 then multiplies each
- Vibration basic frequency value which is output at a time interval of 7 ms with that determined by the random function per sampling interval
- the vibration frequency determined in each case is transmitted to the actuator 17, which controls and stimulates the display 11 and in particular the touch-sensitive user interface 10 of the display 11 accordingly, so that the user receives a corresponding, as realistic as possible haptic feedback via which visually represented control panel 12 he moves his finger F.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102018209963.4A DE102018209963A1 (en) | 2018-06-20 | 2018-06-20 | Method for tactile interaction of a user with an electronic device and a computer program product and an electronic device |
PCT/EP2019/059740 WO2019242908A1 (en) | 2018-06-20 | 2019-04-16 | Method for the tactile interaction of a user with an electronic device, computer program product and electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3811194A1 true EP3811194A1 (en) | 2021-04-28 |
Family
ID=66218108
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19718160.5A Pending EP3811194A1 (en) | 2018-06-20 | 2019-04-16 | Method for the tactile interaction of a user with an electronic device, computer program product and electronic device |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3811194A1 (en) |
DE (1) | DE102018209963A1 (en) |
WO (1) | WO2019242908A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111338468B (en) * | 2020-02-05 | 2022-01-28 | 吉林大学 | Mobile terminal touch target operating system and method based on cross paradigm |
CN113323515B (en) * | 2021-06-07 | 2022-07-22 | 北京京东方技术开发有限公司 | Password output device based on tactile feedback, identity authentication device and method thereof |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8098235B2 (en) * | 2007-09-28 | 2012-01-17 | Immersion Corporation | Multi-touch device having dynamic haptic effects |
US8253686B2 (en) * | 2007-11-26 | 2012-08-28 | Electronics And Telecommunications Research Institute | Pointing apparatus capable of providing haptic feedback, and haptic interaction system and method using the same |
EP2811374B1 (en) * | 2012-01-31 | 2018-01-10 | Panasonic Intellectual Property Management Co., Ltd. | Tactile-feel presentation device and method for presenting tactile feel |
DE102014224102A1 (en) * | 2014-11-26 | 2016-06-02 | Robert Bosch Gmbh | A method for tactile interaction of a user with an electronic device and electronic device thereto |
-
2018
- 2018-06-20 DE DE102018209963.4A patent/DE102018209963A1/en active Pending
-
2019
- 2019-04-16 EP EP19718160.5A patent/EP3811194A1/en active Pending
- 2019-04-16 WO PCT/EP2019/059740 patent/WO2019242908A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
WO2019242908A1 (en) | 2019-12-26 |
DE102018209963A1 (en) | 2019-12-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE69534404T2 (en) | Method for compensating for unintentional movements in a touchpad on a touch sensor surface | |
DE102011017251B4 (en) | Use of random sampling technique to reduce finger-locked noise | |
DE112017006335T5 (en) | Tactile and auditory sense presentation device | |
DE112012003889T5 (en) | Method, apparatus and computer program for pointing to an object | |
EP3234756A1 (en) | Method for operating an operator control device of a motor vehicle in multi-finger operation | |
EP3811194A1 (en) | Method for the tactile interaction of a user with an electronic device, computer program product and electronic device | |
DE102013215742A1 (en) | Method and operating device for operating an electronic device via a touchscreen | |
DE112019002726T5 (en) | Control system for a vehicle | |
EP3224695B1 (en) | Method for tactile user interaction with an electronic device, and an electronic device for same | |
DE102014219602B4 (en) | Electronic device and information processing method | |
WO2013053529A1 (en) | Operating system and method for displaying an operating area | |
EP3224696B1 (en) | Method for tactile user interaction with an electronic device, and an electronic device for same | |
DE112017004621T5 (en) | Tastempfindungs presentation device | |
EP1850305A2 (en) | Display device for tactile recordable display elements and display system with such a display device | |
DE102018215213A1 (en) | Device for generating acoustic feedback when operating an operating element and method for generating acoustic feedback when operating an operating element | |
DE102016011365A1 (en) | Method for controlling a motor vehicle module and motor vehicle module | |
WO2016142378A1 (en) | Method for specifically selecting displayed elements on a touch-sensitive display | |
EP3281098B1 (en) | Gesture-sensitive screen and computer with gesture-sensitive screen | |
WO2019110575A1 (en) | Mobile device | |
EP2607999B1 (en) | Method for controlling an electric device, in particular a portable electric device, electric device, computer program and computer program product | |
DE102020201735A1 (en) | Device and method for recognizing touch commands | |
DE102015117386B4 (en) | Method and device for activating an input area on a capacitive input area | |
DE10011085A1 (en) | Signal evaluation method of computer keyboard, involves generating a signal corresponding to stroke of key being operated | |
WO2019023725A1 (en) | Industrial operating panel | |
WO2011060848A1 (en) | Device for controlling a unit via the sensor screen thereof by means of switch elements |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20210120 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20240102 |