WO2021139864A2

WO2021139864A2 - Tactile proactive guidance solution in touchscreens

Info

Publication number: WO2021139864A2
Application number: PCT/DK2021/050004
Authority: WO
Inventors: Christina Agger
Original assignee: Camar Aps
Priority date: 2020-01-06
Filing date: 2021-01-05
Publication date: 2021-07-15
Also published as: WO2021139864A3

Abstract

The present invention relates to provide a proactive guidance structure using proactive vibration patterns in touch screens where user with a finger feels the location of a software key application or/and function in e.g. the everyday touch sensitive device before or while e.g. an application or feature is triggered. Instead of using a neutral reactive solution this invention provides a proactive guidance for users thus able to differentiate the software keys, also referred as softkeys, and areas from each other and locate where each key or predefined areas are placed, only by using the touch sense in e.g. a finger.

Description

TACTILE PROACTIVE GUIDANCE SOLUTION IN TOUCHSCREENS

FIELD OF THE INVENTION

The present invention relates to provide a proactive guidance structure using proactive vibration patterns in touch screens where user with a finger feels the location of a software key application or/and function in e.g. the everyday touch sensitive device before or while e.g. an application or feature is triggered. Instead of using a neutral reactive solution this invention provides a proactive guidance for users thus able to differentiate the software keys, also referred as softkeys, and areas from each other and locate where each key or predefined areas are placed, only by using the touch sense in e.g. a finger. In addition, the invention provides Feedforward methods using proactive color/light guidance (red, green, flashes, etc.) where it obtains rising or falling color light before e.g. a finger reaches a softkey or defined area and thereby peripherally perceives by the colors intensity how far your finger is from reaching to the softkey button or defined area where proactive vibrations are implemented and e.g. also could target data of User Behavior. In addition, the invention provides edge detection so you can adjust the thickness of the edges/lines for each softkey, icons, sliders, areas, etc. and thereby when sliding a finger over the touchscreen feel various thickness and thereby various intensity/power of each edge/line by the proactive haptic feedback.

BACKGROUND OF THE INVENTION

For the last ten years touchscreens have become an omnipresent technology, making its way into smartphones, tablets, computers, cars, airplanes, alarms, household appliances, high-tech machinery, ATM's, kiosks, ticket vending machines etc. Touch screens have offered a huge potential to interact and navigate with hardware in ways not seen before often improving the user experience. However, the use of touch screens has also created a fundamental challenge in situations where operating control functions from touchscreens can lead to a lack of attention on the primary activity since the user cannot feel with a finger any structure other than just a glass plate when touching the touch- sensitive display of the electronic device. With this invention a user may obtain multiple features, either as a stand-alone feature or combination to make it possible to keep a user's attention on more important things while using functions from a touch screen, e.g. like driving, operating high-tech machinery, gaming etc. To launch an application, the user generally tabs and release the softkey corresponding to a particular application. From the uses perspective the touch screen is only felt like a glass plate and the icons/softkeys representing applications may be difficult to find without looking at the touch-sensitive display of the electronic device.

To enable navigation of an application, many electronic devices allow the user to navigate among one or several pages of icons/softkeys/defined areas however this can only be fulfilled by looking on the touch-sensitive display of the electronic device.

Furthermore, the last years a lot of control functions have been converted from physical hardware like a physical button to being operated from a software driven touch-sensitive display of the electronic device. The physical buttons provided the user a noticeable physical surface to feel with a finger various surfaces, among others edges and textures thereby using the sense of touch to navigate a control function device, without having to use the sight to e.g. operating control functions. From the user's perspective, this means that there is a lost in the ability to feel physical buttons or other physical surfaces with just a finger and thereby operating basic control functions without continuously looking on a touch-sensitive display. From the user's perspective this means that there is a lost in the ability of having the attention on another activity while at the same time is operating and navigating control functions.

As the number of applications installed on electronic devices grows, the increase in number of these available to the user complicates the process of launching a particular application. Moreover, it takes time to navigate the control function ^'s softkeys and it may be hard to remember where on the page the application is located. While search options are available on some electronic devices, they require writing at least part of the name of the desired application, which may also be a time-consuming process. While vibration motors are built into many devices to counter this problem, they only provide a reactive feedback solution with a rudimentary level of feedback after an action has been made. Haptic feedback in the form of a reactive feedback is an old, well-known technology, found today in virtually every touch screen, and provides rudimentary feedback AFTER an application has been triggered. This omits a guided structure for users.

DE 10 2015 009 028 A1 2017.01.12 discloses a device characterized in that a feedback device is provided, by means of when the Control element, in particular haptic, feedback signal to the driver can be spent. Device characterized in that the control element can first be actuated by a push-button and is formed, it preferably being provided that the push-button has a defined pressure force stroke course as a haptic feedback signal. Device characterized in that the control element is formed by a button which can be actuated by touch, wherein it is preferably provided that the haptic feedback Signal formed by a vibration signal is.

Thus a reactive solution, without a proactive guidance for users.

US 2015/0309573 A1 discloses a haptic texture system has an electrode disposed across the touchscreen display and a signal generator generating an oscillating signal to produce a potential difference between the finger and the electrode resulting in a corresponding perceived texture as the finger slides over the touchscreen.

Hence, this invention is based as an addition of hardware on top of a standard touch screen to provide tactile feedback

US 2016/0195989 Aldiscloses a method and an apparatus, particularly in a motor vehicle, for input of data with haptic feedback. The method includes sensing a touch position on a user programmable touch-sensitive display device, selecting a function via the touch position, sensing of a contact pressure force on the user programmable touch-sensitive display device, initiating the selected function when a first force threshold is exceeded, and outputting a haptic feedback item. Also disclosed is an associated apparatus. Definition of at least one first initiation region, definition of at least one second initiation region and first in the third phase a temporal and local sensing of at least one touch position sensing of a contact pressure force. Combination of temporally and locally adjacent touch positions to form touch traces. Classification of the touch traces into touch gestures. OBJECT OF AND SOLUTIONS PROVIDED BY THE INVENTION

It is an object of embodiments of the invention to provide a computer- implemented method of controlling an electronic device comprising a touch- sensitive display in a time efficient and convenient manner without depending on using the sight.

It is a further object of embodiments of the invention to provide a computer- implemented method of controlling an electronic device comprising a touch- sensitive display. According to the invention, such object(s) is suggested to be met in a manner which enables navigating in a sequence of a guidance structure. By using proactive vibration patterns or proactive texture surface patterns represented by e.g. each softkey and launch an application associated with a particular vibration or texture surface. In that way the user may initially have the ability to reach e.g. the softkey, long press the softkey, and finally tab, or release to trigger, the softkey representing the desired application without depending on using the sight.

It is a further object of embodiments of the invention to provide a computer- implemented method of controlling an electronic device comprising a touch- sensitive display. According to the invention, such object(s) is suggested to be met in a manner which enables navigating in a sequence of a guidance structure by using feedforward with proactive light and/or color to provide visual guidance for location of a softkey or other functions or within a defined area using proactive color lights from e.g. the outline/edge of the touch device to the outer or inner perimeter of a target softkey or defined area. While contacting the touch-sensitive display, the electronic device recognises this as a movement before contact to e.g. a softkey area where colors light appears intensified rising or falling the closer e.g. a finger gets to the outer or inner perimeter of a softkey or other defined areas. It is an even further object of embodiments of the invention to provide a computer-implemented method of controlling an electronic device comprising a touch-sensitive display, allowing an element to be selected without visual contact with the touch-sensitive display.

It is an even further object of embodiments of the invention to provide an electronic device comprising a touch-sensitive display, which can be controlled in a time efficient and convenient manner.

It is an even further object of embodiments of the invention to provide an electronic device comprising a touch-sensitive display, which can be controlled without visual contact with the touch-sensitive display.

SUMMARY OF THE INVENTION

The invention relates in first aspect to a computer-implemented method of controlling an electronic device, the electronic device comprising a touch-sensitive display and the method comprising: providing a visual presentation on the touch-sensitive display of a software key comprising an outer perimeter and an inner perimeter located inside the outer perimeter; a first tactile area located in between said perimeters and having assigned a first specific first tactile feedback to be provided by the touch screen upon touch of the first tactile area; a key-press area located inside the inner perimeter and having assigned a second specific first tactile feedback to be provided by the touch screen upon touch of the key-press area; recording a touch position, if any, on the touch-sensitive display and determining the position of the touch relatively to the first tactile area and the key-press area, and if the touch position coincide with: the first tactile area providing the first specific tactile feedback the key-press area providing the second specific tactile feedback. Thus, in preferred embodiments of the invention, a user may recognize a software-key by the tactile feedback without the user activating the function of the software- key.

The first specific tactile feedback may occur with identic feedback pattern as e.g. the second tactile feedback but can also occur with different feedback patterns. For example, first tactile area with its perimeters, which may form a frame may have the identic feedback pattern as key-press area, or they can have different feedback patterns.

According to a second aspect the invention provides a computer-implemented method of controlling an electronic device comprising a touch-sensitive display, the method comprising the steps of: detecting contact with the touch-sensitive display, detecting continuous proactive vibrations or texture surface movement by the contact along a horizontal direction, detecting continuous proactive vibrations or texture surface movement by the contact along a vertical direction, detecting a library in settings with various vibration patterns, examples given but not only, a short vibration tick, a double vibration tick or multiple tick vibrations, detecting a library in settings with various texture surface patterns, examples given but not only, spaced lines, muddy sand or a flat surface, in response to the detected proactive vibrations movement of the contact along the horizontal or vertical direction, the electronic device presenting a sequence of a vibration representations of software key of elements, such as softkeys, on the touch-sensitive display, in response to the detected proactive texture surface movement of the contact along the horizontal or vertical direction, the electronic device presenting a sequence of a vibration representations of software key of elements, such as softkeys, on the touch-sensitive display, detecting a change of the contact from the area without software key in a touch-sensitive display where it is felt like glass to the area with software key is providing proactive various tactile feedback from the area without software key, in response to the detected proactive guidance of vibration movement of the contact, the user feel e.g. with a finger the presented software key of elements, such as softkeys, on the touch-sensitive display as either proactive vibration tactile or texture tactile feedback, wherein the method further comprises the step of the electronic device providing tactile feedback in response to contact along the horizontal direction and/or along the vertical direction when entering an outer perimeter or an inner perimeter of an software key area.

Preferred embodiments may also comprise detecting an area outside a predefined feature or function e.g. defined softkey or area where colors light changes and/or intensifies in intensity the closer or further away e.g. the finger is at the point or in an area of a desired softkey or area (function).

The computer-implemented method according to the first and/or second aspect of the invention is for controlling an electronic device comprising a touch-sensitive display.

In the present context the term "electronic device" should be interpreted to mean any electronic device which is either portable or non-portable. Examples of common portable electronic devices comprising a touch-sensitive display are smartphones, tablets, watches and laptops. However, here portable should be interpreted in the broadest possible sense so that the invention may also apply to other kinds of electronic devices, such as remote controls, car user interfaces, etc., comprising a touch-sensitive display. Examples of common non-portable electronic devices comprising a touch-sensitive display are touch panels, PC and integrated touch screens. However, here non-portable should be interpreted in the broadest possible sense so that the invention may also apply to other kinds of electronic devices, such as flight or car user interfaces, etc., comprising a touch- sensitive display.

"Release to trigger" as used herein is preferably used to reference that an action assigned to a softkey is invoked when the softkey is released, e.g. by no longer being touched. The terms "softkey" and "software key" are used interchangeably herein". By "softkeys" is preferably meant a key on an electronical touch device which may have context-sensitive or user-programmable functions. In general a softkey is used to reference a key which is programmable so that it may invoke by programming more than one function. Unlike the physical keyboard which cannot be reprogrammed and are therefore considered as hard keys, softkeys can change function. Further, a softkey may also be an Icon.

By "area" is preferably meant a region on a touch device, which region is a programmed or programmable, to invoke a function when touched, surface in applications to the electronic touch device. The amount of space inside the boundary of a flat (2-dimensional) object such as a triangle or circle, or surface of a solid (3-dimensional) object, meaning any particular extent of space or surface; part: the outer face, outside, or exterior boundary of a thing; outermost or uppermost layer or area. By "icon" is preferably meant a picture, image or symbol that appears on a screen and is used to represent a file, account, application, etc.

Proactive, as used herein, is preferably meant to refer to that a tactile/haptic feedback is provided

- before an action is executed, e.g. a user feels by his finger the position of a softkey when the user browses (move his finger) across a touch sensitive device, resulting in that the user obtains guidance as to position of function, softkeys, icons etc, and/or

- while a user executes an action.

In the present context the term "touch-sensitive display" should preferably be interpreted to mean a display which allows navigation by means of a user touching the display. For instance, the touch-sensitive display may apply a capacitive technology, wire resistive, Surface capacitive, Projected Capacitive, SAW (Surface Acoustic Wave), Infrared etc. By "capacitive technology" is preferably meant in electrical engineering, capacitive sensing (or capacitance sensing) based on capacitive coupling, that can detect and measure anything that is conductive or has a dielectric different from air. A capacitive touch screen is a control display that uses the conductive touch of a human finger or a specialized device for input.

According to the method of the first and/or second aspect of the invention, contact with the touch-sensitive display is initially detected. Thus, it is initially detected that a user is touching the touch-sensitive display, e.g. by means of a finger, or by means of a suitable input device, such as a stylo.

Subsequently, a movement of the contact along either horizontal and/or vertical direction is detected. In the present context the term "continuous movement of the contact" should be interpreted to mean that the user moves the point of contact with the touch-sensitive display, e.g. a finger, across the touch-sensitive display, without interrupting the contact with the touch-sensitive display, i.e. without removing, e.g., the finger from the touch-sensitive display.

The vertical or horizontal direction is a direction along the touch-sensitive display when reaching the software key area, i.e. relative to the outline of the outer perimeter and in inner perimeter of a software key or defined area, which has been defined previously or in a defined area. Accordingly, when the user moves, e.g. a finger, substantially along this predefined direction, while contacting the touch-sensitive display, the electronic device recognises this as a movement of a contact to e.g. a software key area.

The vertical or horizontal direction is preferably a direction along the touch- sensitive display when reaching a defined area outside the software key area or other functions, i.e. relative to the outline/edge of the touch screen to the outer perimeter of a software key or defined area, which has been defined previously. Accordingly, when the user moves, e.g. a finger, substantially along this predefined direction e.g. outline/edge of the touch screen, while contacting the touch-sensitive display, the electronic device recognises this as a movement before contact to e.g. a software key area where colors light appears.

By vertical and horisontal are preferably meant two directions preferably being perpendicular to each other. With reference to a display vertical is preferably the direction up-down as viewed by a user and horizontal is preferably side-to-side as viewed by a user

In response to detecting movement of a contact along the software key area, the electronic device consecutively presents a sequence of proactive tactile feedback either as vibrations or texture surface representations of e.g. physical button elements on the touch-sensitive display.

In response to which proactive tactile pattern each icon/ key appears as, the user may select individually this from a detected library in the setting menu.

Thus, proactive vibration tactile representations may be defined from the user's perspective on a detecting library one e.g. categorized as texture surface tactile elements, another as e.g. a vibration tactile element presented in the library on the touch-sensitive display, one after the other.

For instance, the proactive tactile feedback representations of the vibrations and texture surfaces may be presented one at a time, in a predefined order the user select from the library to a page with various software keys. Number one software key may e.g. occur with a single vibration tick, number two may e.g. occur with a spaced line texture surface, number three software key may e.g. occur with a double vibration tick.

Thus, the user may differentiate between the software key(s) elements from each other on a page on the touch-sensitive display by the touch sense in e.g. a finger.

As an alternative, the outer perimeter and/or first tactile area may be presented in such a manner that it occurs as a short tick vibration when e.g. a finger is moving across the touch-sensitive display, e.g. linearly, along a circle or a square or in any other suitable pattern in every software key on the touch-sensitive display. The preference for this may be defined by the user and be selected in the library. The proactive tactile feedback representations of the software key may, e.g., be or comprise icons and/or written names associated with e.g. the respective applications already implemented.

At least some of the proactive tactile feedback elements may be user defined and/or at least some of the proactive tactile feedback elements may be predefined and/or at least some of the proactive tactile feedback elements may be defined by the electronic device. In the present context the term "define" should be interpreted to mean assigning one or more elements to a given software key.

For instance, a given page may have a number of elements of the same or similar kind assigned thereto. Alternatively, or additionally, one of the pages may have only one of the proactive tactile feedback elements which have been accessed or activated most recently assigned thereto.

The elements as a software keys may, e.g., be applications or functions available on the electronic device. As an alternative, at least some of the proactive tactile feedback elements may be settings of the electronic device, programs available on the electronic device, a list of content, such as radio, contacts, navigation, control menus, menu or/and up- and down, right- and left, open- or close functions etc., or any other suitable kind of elements. Furthermore, the elements may be in the form of data, symbols or the like to be input on the electronic device. For instance, keys in a keyboard may be grouped into software key categories, or the alphabet may be divided into categories to provide easy access to a dictionary.

The elements as an area may, e.g., be predefined areas in applications or functions available on the electronic device. As an alternative, at least some of the proactive tactile feedback elements may be settings of the electronic device, programs available on the electronic device, a list of content, such as predefined areas in games or for surgery etc. For example, in a mobile car game where the area outside the lane is imposed proactive guidance so one e.g. with the finger notice that you are about to drive out of the lane.

The elements as an area are preferably meant as programmed areas in applications or functions such as predefined areas in games or other applications. For example, in a mobile car game where the area outside the lane is imposed proactive guidance so one e.g. receives vibrations in the finger indicating that you are about to drive out of the lane.

In some embodiments, the invention may be characterised by, before and while operating the control functions in a touch-sensitive display user^'s sense of touch seeks to provide a guidance structure with various proactive vibration tactile feedback or/and texture surfaces. The vibration tactiles and/or texture surfaces are proactive enabled to be felt with e.g. a finger before and while users trigger on a software key and represented by each software key on one or several pages in a touch-sensitive display. Before launch, an application is a software key associated with a particular vibration or texture surface. Thus, the user has the ability to reach the software key without trigger it and long press the software key representing the desired application without having to look at the device.

In a third aspect, the invention relates to an apparatus configured to execute the computer implements method of the first and/or second aspect, so as to provide proactive guidance solution for users imitating among others the sense of a physical hardware key and the process to trig the keys.

The invention relates in some embodiment to cohesion of a touch screen, panel or a pad. Uses standard technology of touch-sensitive displays and hardware materials enabling haptic software e.g. in the form of a vibration or a texture surface, to provide a structed guidance in touch devices by detecting a proactive tactile feedback and thereby reducing the need to look at a screen while having your attention on a primary activity.

The present invention may be a computer-implemented method into a touch panel or pad of various sizes in various material and is providing basic functionalities in e.g. vehicles as a substitute of the conventional physical mechanicals keys which takes a lot of space, cost full and are inflexible in adapting new functionalities after installation.

The invention is also made as a safety improvement to use basic functionalities as it reduces the need of having user sight on the panel or pad while navigating through the content. The invention provides a guided structure BEFORE action is taken by using proactive tactile feedback and increases safety in situations where operating touchscreens can lead to a lack of attention on the primary activity (e.g. switch radio stations while driving).

The invention is particularly, but not exclusively, advantageous for obtaining physical human interaction feeling where e.g. a finger is going on a touch screen and imitating the sense of feel of a physical hardware key with a detection of outer perimeter and/or inner perimeter and/or sliding over a frame (as defined herein) in e.g. a softkey on e.g. a page in a touch screen device.

Furthermore, it discloses various proactive patterns of both various proactive vibration tactile feedback patterns or/and texture surface patterns for users to build its own suitable preferences using e.g. sensors and engines from an everyday device.

These aspects of the invention are particularly, but not exclusively, advantageous in that the present invention may be accomplished by a computer program product enabling a computer system to carry out the operations of the apparatus/system of the method aspects of the invention when down- or uploaded into the computer system. Such a computer program product may be provided on any kind of computer readable medium, or through a network.

The individual aspects of the present invention may each be combined with any of the other aspects. These and other aspects of the invention will be apparent from the following description with reference to the described embodiments.

BRIEF DESCRIPTION OF THE FIGURES

The present invention and in particular preferred embodiments thereof including proactive guidance invention with various tactile feedback providing physical human interaction imitating among others the sense of a physical hardware key and the process to trig the keys according to the invention will now be described in more detail with regard to the accompanying figures. The figures show ways of implementing the present invention and are not to be construed as being limiting to other possible embodiments falling within the scope of the attached claim set. Fig. 1 schematically illustrates an example of a software key where the outer edges can be detected as tactile feedback; in fig. IB where the outer edges is omitted or limited, the key-press area is detected as tactile feedback;

Fig. 2 is a schematic view of a user interface in a touch-sensitive display showing examples of control functionalities as a main screen page with two submenu pages without any guidance solution.

Fig. 3 is a schematic view illustrating the invention where proactive guidance begins in the outer perimeter compared to an example of what is used today.

Fig. 4 is a schematic view an illustrating of different texture surfaces to be selected from e.g. a library to keys e.g. in the inner perimeter, the key onLong press area, and occurs as soon as e.g. a finger touches the area while and before users trigger the application to provide a guidance structure for the user

Fig. 5 is a schematic view an illustrating of different vibration feedback to be selected from e.g. a library to keys e.g. in the inner perimeter, the key onLong press area, and occurs as soon as e.g. a finger touches the area while and before users trigger the application to provide a guidance structure for the user

Fig. 6 is a schematic view of onLongClick handler. Provides different vibration pattern while and before a user triggers the application to provide a guidance structure for the user and indicates confirmation of an action.

Fig. 7 is a schematic view of the invention's patterns library and application setting key where users select preferable texture surfaces and/or vibration feedback pattern to differentiate the keys from each other.

Fig. 8 is a flow chart illustrating a method according to an embodiment of the invention.

Fig. 9A is showing feedforward in five images with guiding lights here in a red color variant and the effect of how the sliding with a finger over the touch screen changes color or strength of a color so that touch controls can be observed, seen, and operated from the human's peripheral field of view. Kindly note that the change in color in the figure is represented by varying gray shades.

Fig. 9B is showing feedforward in split and zone divisions with guiding lights and the effect of pre-trigger touch controls within divided splits or zones so that touch controls better can be observed, seen, and operated from the human's peripheral field of view. When e.g., a finger touches an area within the predefined Y and X axis ^'s, a color appears to provide proactive guideline for the user. Kindly note that the change in color in the figure is represented by varying gray shades.

Fig. 10 shows the flexibility and expansion of the thickness of a frame when moving the slider function from left to right to which the vibration in the outer edge becomes larger / expanded and can fill / replace the entire inner area of e.g. a softkey if required. Kindly note that the change in color in the figure is represented by varying black shades.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS The invention is in an embodiment among others a software imitation of a mechanical key. The "keys" are ordinary keys in software applications or software features with the addition of e.g. strict outer lines and a notably center (or middle) in the keys, similar to physical hardware keys. This invention is only based using the hardware from an everyday used touch screen device.

The outer edges provide a notably space in the keys outer edge area and provides a tactile feedback when user crosses the border of the key. Short vibration time "tick" applies to the entire border. The shape of the key itself is not essential as it can be adapted to varying shapes.

In addition to the imitation of a physical hardware key, various feeling methods are combined to make it more convenient for users to differentiate between keys when they smoothly touch its surface with e.g. a finger over more than one application. Each difference on the surface helps guide users to optimizing the memory and quicker remember what each key's function contains before it is activated. It is an object of embodiments of the invention to provide a computer- implemented method of proactively controlling an electronic device comprising a touch-sensitive display providing a guided structure in a time efficient and convenient manner for basic functionalities.

In some embodiments, the invention relates to a computer-implemented method of proactively controlling an electronic device comprising a touch-sensitive display providing an imitation of a key with outer edges, center surfaces or other functionalities similar to a physical hardware key and be felt when a finger touches ("hovering/browse") its surface of applications in touch screens in a time efficient and convenient manner for physical finding the locations of applications.

In some embodiments, when a user has located the desired application and wants to activate it, he/she perform a long click on the application to open/activate, instead of activating it on a finger release. By long click used herein is typically meant that the user touches the same position for an extended period of time sufficient to distinguish between movement and stillness (no movement). The long click can be implemented by identifying a long click as a no movement in a given period. This period can be varied and e.g. implemented to last 0.25 seconds, 0.5 seconds, 0.75 seconds etc.

An example

Reference is made to fig. 1 schematically illustrating an example of outer edges of a software key, also referred to as a softkey or a key, 1 being detected as tactile feedback providing users guided proactive precisions. The invention provides a notable space in the keys outer edge area.

The softkey 1 shown is an example on an area of a touch screen which when touched by a human finger results in an input to a software acting upon touch. In the embodiment shown, the action of the software is not specified but can be any kind action initiated by a user touching the key.

As illustrated, the softkey 1 has an outer perimeter 2 defining by a rectangle. Inside the outer perimeter 2 an inner perimeter 3 is present. As illustrated, there is a first tactile area 4 preferably defining a frame around the interior of the softkey. By "frame" is preferable meant an area in between the inner and outer perimeters, here as in 2, 3. By this, the first tactile area 4 is between the inner and outer perimeters 2,3 The dimensions of the software key 1 is chosen so that it is tactile distinguishable by a finger, that is of a dimension that is flexible and easily adapted for e.g. the user interface designers. It is noted that in this way, the inner and outer perimeters 2, 3, are preferably considered not to have any width since they may be viewed as defining the inner and outer borders of the first tactile area 4.

The software controlling the software is configured to provide a tactile feedback when a finger touches the first tactile area 4. Thereby, when a user swipes across the screen with his finger, the software that registers that a user touches the screen records the position of the user's finger and if the finger is recorded to be present in the first tactile area 4, a control signal is given to the vibrational element 10 (not illustrated, and it typically implemented as a standard component in many touch screen appliances). This control signal comprises information as to frequency of the vibrations to be provided and this frequency is unique for the first tactile area 4.

Inside the inner perimeter 3, a key-press area 5 is located. That is in order for the computer to register that the key is pressed by a user touching the key 1, the user should touch an area inside the inner perimeter 3. As disclosed below, the key-pressed area may be applied with a different tactile feedback.

In order to distinguish between the first tactile area 4 and the key-pressed area 5, a distance between the key-pressed area and the first tactile area 4 is or may be provided as a so-called void space 6. In some embodiments, the key-pressed area 5 may take-up all the available space inside the frame 3 (inside the inner perimeter 3) as illustrated in figure 1A.

Furthermore, it combines another guided proactive tactile feedback having another surface feeling detected in the middle, referring to key-pressed area 5. Alternatively, the key-press area may take-up all the avaiable space limiting or omitting the inner and outer perimeters, so that only tactile feedback only occurs in key-press area as illustrated in figure IB.

Since the key is implemented by software, the middle/center of the key 5 would be applied to different surface textures or vibrational patterns as the user himself decides. This means that if there are multiple keys in one application, each of the keys could, if requested, provide a different feeling to a finger when a user smoothly touches its surface, but without having to activate the key.

In some embodiments, the invention comprises the following four features:

I. The First tactile area 3 (outer perimeter) : A physical mechanical key function is imitated as having a noticeable outer edge or so-called perimeter in the "key".

The first tactile area provides a notably space in the keys outer perimeter area and provides a tactile feedback when user crosses the border of the key. E.g. a short vibration time of a one-click "tick" applies to the entire first tactile area 3. The first tactile area 2 then gives e.g. a one-click "tick" when e.g. a finger is softly moving over the outer perimeter and enter the key ^'s center and in the key ^'s press area 5 and provides e.g. a one-click "tick" again when you are moving the finger away from the key ^'s press area 5 out to the first tactile area 3. Alternatively, it can just give one one-click vibration if the frame e.g. is thin and it does not give effect to have two notifications in both outer and inner perimeter.

The shape of the key itself is not essential as it can be adapted to varying shapes.

II. The key-press area 5: Is inside the inner perimeter 3 and often takes up a larger area of a key or takes-up the whole area limiting or omitting the inner perimeter. The invention detects the users to distinguish the touch sense by e.g. a finger when it is entering the inner perimeter to the key-press area 5 or when entering directly limiting or omitting the inner perimeter to the key-press area 5 where users have access to On-Long click (also referred to herein as "long click") and trigger the application. Furthermore, to distinguish the key-press areas 5 of the keys from each other some, or each of the centers can provide various tactile feedback. That way user is able to recognize where e.g. the finger is located on the screen.

III. Activation of keys: To activate the keys e.g. to open an application/features in touchscreens is devised a specific activation function (On-LongClick) to allow users to tag a key on your screen proactively without activating it on the way to find the desired key.

Each key has onLongClick handler function set up in e.g. a key-press area of a key, so users can surf around the User Interface on one or several pages while feeling shapes of tactile feedback patterns representing a key ^'s outer perimeter and/or inner perimeter, and/or key-press area or other functions or areas but without trigger e.g. an application. Only when the user through the touch sense of the finger feel that it is landed on the selected e.g. application the finger remains in the key-press area and On-LongClick to trigger the selected one. The user behavior structure to trigger the application and/or a function and/or a feature etc. imitates the human interacting of using a physical mechanical key. Alternatively, a ReleaseToTrigger function can also trigger the selected one.

IV. Library: A user can either select various vibration patterns or various surface textures or a combination and which user select from a library. The "library" is e.g. located in a setting menu containing many various tactile vibration feedbacks and e.g. the middle part can be changed according to individual user preferences and behavior. Since users have different touch of feeling sense and use touch devices in various environments, the invention provides flexibility for users. The invention is structured so it is user-determined which pattern guidance for e.g. the key-press area key produce.

To exemplify, a real-world example of basic control functions is shown in the Figure 2. This application is designed to control various controls in a car (e.g. windows, doors, mirrors etc.). The way users interact with the controls nowadays is only by looking where the functions are located and only then interact with it.

At the figure 2, (2.1) is showcasing side mirror adjustment controls. There is an L (left) function, R (Right), a symbol for a lock and a joystick (2.2). The keys L and R is to select between left and right mirrors. The lock symbol to close/open function of mirrors and the joystick to adjust the mirror position. Below the mirror control functions are located four window controls (2.3) and a lock symbol. The top two are used for the front seats, the bottoms below are for the windows at the rear seats. On the right side of the window controls, seat heater controls are shown (2.4). On/off indicators show state of the seat heater. At the bottom of the main menu are 4 locking symbols (2.5) and a slider (2.6). The four lock symbols function as open/lock functions of the doors. The slider function is used if the user wants to lock / open all the doors at the same time. The two underlying drawings illustrate the features but in each separate submenu.

Application tend to have various user interfaces and how they access specific controls, however location of the elements is not essential to the invention as it is possible to enable tactile feedback on each specific surface area.

Each key in the figures represent a control function where user cannot feel with a finger where it is going without having to look at the screen. There is no proactive guidance in any of these control functions keys and the user can only feel the glass plate and therefore cannot differentiate the keys apart either.

In Figure 3, details are illustrated by two examples of two keys and the difference between today's keys and the way you trigger functions in relation to the present invention. Figure 3A: Numeral 3.1: Illustrating the invention of a default softkey of an outer and inner perimeter in a circular and square key where tactile feedback occurs proactively meaning as soon as e.g. a finger touches the area and before and while a user trigger e.g. an application. Numeral 3.2: An example of a standard softkey without proactive guidance in either inner or our perimeter. Figure 3B: 3.3: Invention of a default softkey illustrating the outer perimeter in a circular and square key where it provides proactive tactile feedback in e.g. a finger when reaching the area and occurs the moment it touches the area

As described in figure 1 it is an illustrating of outer edges of our invention of a key being detected as tactile feedback providing users guided proactive precisions.

The invention provides a notable space in the softkeys outer perimeter area. By edge detection is preferably meant that a first tactile 4 area is touched. Figure 3 illustrates two examples of different forms of a key according to the invention compared to today's key design. In the invention there is inserted a border (first tactile area 4) to the edge for the outer perimeter 4 which is placed in each control function and provides proactively tactile feedback for a user to feel a haptic guidance structure when e.g. a finger is softly moving and "hoovering" / sliding over a touch screen. It provides proactively e.g. one-click tick in e.g. a finger when it crosses the border of the outer perimeter 2 of a key, illustrated as a red dot (in the figure, the red dot is shown as a black dot in the first tactile are 4).

Figure 4 illustrates the key-press area 5 with different tactile texture feedback where the feedback proactively manipulates with the sense area in the finger. Numeral 4.1: Example of key press area where a user with e.g. a finger proactively feel different surfaces that occurs as soon it touches the area while and before you trigger e.g. an application. Numeral 4.2: Illustrating different texture surfaces which can be selected from e.g. a software library and inserted into softkeys e.g. In the inner perimeter of a softkey that occurs as soon as e.g. a finger touches the area while and before user trigger e.g. an application. It illustrates various examples of texture surfaces. One key press area may feel like sand, another like bumpy rock, a third one as spaced line etc. and using different texture surfaces for each key or some part of the keys it provides a guidance structure for users in differentiating between the software keys when a user is operating in a touch sensible screen. Thereby the different tactile texture feedback makes it easier to remember which texture surface representing each key and therefore, before user selects and triggers e.g. a control function find each key location, only by using the touch sense in e.g. a finger.

Figure 5 illustrates the key-press area with different tactile vibration feedback where the proactive vibration feedback is sensible for the finger. Numeral 5.1: Void space area. The void space area can be minimized to zero. Numeral 5.2: An example of a schematic view of a key enabled with a One tick vibration pattern occurs as soon as e.g., a finger touches the area before and while you trigger the application. Furthermore, the Key onLong press area. Numeral 5.3: An example of a schematic view of a key enabled with a Double tick vibration pattern occurs as soon as e.g. a finger touches the area before and while you trigger the application. Furthermore, the Key onLong press area. Numeral 5.4: An example of a schematic view of a key enabled with a Tripple vibration pattern occurs as soon as e.g. a finger touches the area before and while you trigger the application. Furthermore, the Key onLong press area.

It illustrates various examples of various vibration pattern feedback. One key e.g. provides two clicks, another one a buzzy click and a third one with triple clicks etc. and using different proactive vibration patterns for each key or some part of the keys it provides a guidance structure for users in differentiating between the software keys when a user is operating in a touch sensible screen. Thereby the different proactive vibration feedback makes it easier to remember which vibration pattern representing each key and therefore, before user selects and triggers e.g. a control function find each key location, only by using the touch sense in e.g. a finger.

Figure 6 illustrates the onLongClick as part of the invention. After the user has found the required control function or application etc. on the touch screen, user onLongClick on the software key to make it trigger or ReleaseToTrigger. The difference between release and long press is typically several milliseconds and may be crucial to the end user experience. The onLongClick provides a reactive feedback after you have pressed to provide user a confirmation.

Figure 7 illustrates a human users control functionalities in many various circumstances and the optimal user behaviours depends e.g. at the environment where using e.g. the control functionalities or how person perceive emotions in the finger. Numeral 7.1: Pattens library where from the ability to apply different vibration feedback and texture surfaces patterns on different user interface pages for different icons/softkeys/areas etc. Numeral 7.2: An example of a menu setting button in an application from which the pattern library e.g. can be accessed. Numeral 7.3: An example of three softkeys in an application illustrates a texture and two vibration patterns feedback.

Therefore figure 7 illustrates a library (7.1) of various vibration patterns/textures which user can choose for his tactile feedback in the inner part (key press area 5) of the key (3). E.g. in a phone application user can apply a proactive one-click vibration feedback for the first key, a proactive triple vibration in the second key and e.g. a sand texture surface feedback in the third key. This allows to provide a unique identifier for each key.

Fig. 8 is a flow chart illustrating a method according to an embodiment of the invention. It illustrates a state diagram - process from where user places a finger on a touch screen and reaches the edge of a key / outer perimeter 2. When e.g. a finger crosses the outer perimeter 2, it provides a tick vibration, and user knows that an edge of the key is reached. If the outer perimeter is not crossed it continues to vibrate until user reaches the key-press area where user gets a proactive tactile feedback either as texture surfaces or vibration feedback. If desired control function is located then user is able to open/launch it by activating onLongClick trigger or ReleaseToTrigger, which will launch corresponding application/ functionality. If desired application is not reached, user keeps moving his finger until he reaches the edge of a key again. It indicates that user is about to leave the triggering area. Alternatively, the outer-, and inner perimeters and frames can be omitted altogether and instead enter directly to the key-pressure area vibration. If e.g. a finger is lifted from the touch screen state is reset. In case desired location was reached and onLongClick listener or ReleaseToTrigger was triggered user is redirected to the corresponding application/function/ submenu etc.

Figure 9A shows an example of feedforward by guiding colors such as color/light modulation and the impact of this provides the user a helping guidance in the peripheral point of view when doing more important things than constantly looking at the screen. By feedforward is preferably meant that visual appearance of the display gradually change into a target visual appearance as closer a user is to a touch target, such as an icon and/or a softkey, by this feeding the user forward towards a target.

This figure shows five images where a finger in a starting position is placed on or near the edge of a touch device and each image indicates how the red color very quickly changes, the closer the finger reaches to the touch target (in fig. 9A the color is shown by gray shades. This can also be graduated in reverse and colors could also be green, blue, purple, black etc. As an example, the method of proactive feedforward could be deep red when e.g., a finger is on the softkey/area or close to, and white when the finger is very far from the element that is closer = brighter and clearer, further away = shady and less clear, or vice versa.

In a preferred embodiment, the control unit controlling the feedforward gathers information on the location of the touch target and the touch position, and calculates the smallest d calculated between the outer perimeter 2 of the touch target and the touch position and this smallest distance is used to determine the actual color to be displayed.

Figure 9B discloses other kinds of interactions feed-forward by color/light modulation as e.g. a Split or Zone division, based on knowing what the user intends to do of action when the finger touch defined places on a touch screen as predefined forms in e.g. Y and X axis ^'s on the screen e.g. on a right side or on a left side of the screen. An interaction / action that does not necessarily have to be linked to a specific element. In addition, it also demonstrates several examples of feed-forward / confirmation through the use of colors that as shown in 9A can change when the finger reaches a touch control. The Split concept simulates an interface where a user by splitting up the functions on the screen can focus and highlight touch control actions such as turn up and down for e.g. volume and temperature. The interface can e.g. be divided vertically or horizontally and depending on which side of the screen a user first set a finger on, the interface knows based on a predefined coordinate system in a two-dimensional number line of X and Y axis which part a user wants to interact with. The background on the page thus gets a color that indicates what action the user is about to take. If a user holds the finder relatively still for a predefined time e.g. for 2 seconds, a user will feel an "activation" vibration, after which a user can adjust the sound or temperature by moving a finger up and down. The figure discloses that by the touch of an area within the Y and X axis ^'s, color appears that provide proactive guideline for the user and when the user reaches the outer edge of a touch control a vibration occurs to mark that it has been reached.

The Zone concept is based on same principles as the Split concept in the figure showing an interface for touch controls adjusting sound volume- and temperature volume. The interface is divided into zones as four zones within a X and Y axes, and each part, maps to one of the zones. The interface knows based on a predefined coordinate system in a two-dimensional number line of X and Y axis which action the user want to perform based on where on the screen user start the interaction. Setting a finger within the defined zone but outside a touch control e.g., the upper right corner, it can pre-trigger the touch control function before the finger is reaching the touch control softkey. Feed-forward in the form of the background color is now the thickness of distance from the finger to the "temperature +" button. If a user holds a finger relatively still for a predefined time e.g. for 2 seconds, the user will feel an "activation" vibration, after which the action the user is requesting by pressing the key will be performed as long as the user holds a finger still. The action can be performed whether a user holds a finger over the button or elsewhere on the screen.

Figure 10 is showing a preferred embodiment of an edge detection feature according to the invention. Here the the embodiment is shown as a slider function on the top of the images having proactive haptic feedback to adjust the width and hence the vibration length of the outer first area. This adjustment of the edge detection frame size can also be set from a setting menu instead of on top of a side. From the very thin outer edge with a limited proactive vibration feedback where the frame fills predominantly, the outer edge in the figure shows how it graduately can be adjusted as shown in the next images. An increased continuity of the frame is shown where in the end there is only one large frame field of vibration without any inner perimeter. The thicker the frame, the longer the vibration occurs, and thus the feeling of vibration is intensified / amplified. The four images illustrate an increasing of thickness in a frame that goes from 1/4 contour type which increases continuously to 14 contour type that covers the entire area of the softkey. By contour type is preferrable meant a line joining points on a surface.

The technique as to texture

When moving a finger across a surface, user feels the texture through the sensory receptors in the finger, the Meissner's corpuscles and the Pacinian corpuscles which are sensitive to 30-80hz and 250-350Hz respectively. It is the crevices in the textured surface which create a vibration in the skin when a finger is moved over the surface, and thus the velocity of the movement is crucial for the perception of the surface. The movement creates vibration, whose frequency can be computed through: f=pulsesdistance-distancetime=pulsestime. (Pulse / distance = granularity, distance between teeth on a comb if you stroke it with a finger).

In another approach, frequency of vibration to produce a certain texture is obtained experimentally. In such experiments, the frequency of the vibrations is varied while one or more users touches the vibrating screen, and the one or more users provide their feedback as to their tactile experience. This can then be stored in a database for later use.

The proactive tactile vibration created by the movement of the finger over the surface, can be recreated using vibrotactile devices. Thus, in order to recreate the surfaces, the frequencies emitted by the vibrotactile devices are adjusted, to mimic the surface frequency. In addition, the velocity of the finger is measured as the velocity should be coupled with the frequency to mimic the surface. This relationship is modelled for every surface.

The technique of tactile vibration feedbacks and edge detection (figure 10)

The tactile proactive vibration feedback as e.g. either a "one-click tick", "double click", "two shots" "triple click", "Buzzy click" etc. uses the frequencies and amplitudes and the strength would depend on the type of engine motor; and the dimension of the edge, we e.g. detect up to a single pixel. This is mostly as x and y coordinates. In the solution there is same space between trigger area and triggering part of the key, so that vibration don't overlap right away.

The method of the edge detection preferably comprising a flexible and adjustable thickness of the frame and thereby the width of the first tactile area, and the outer edge vibration overrules the vibrations in the inner perimeter in step with the outer edge expansion and a consequent expansion in strength and length of outer edge feedback is felt in, for example, a finger sliding across the screen. Flexible is meant as susceptible of modification or adaptation by the user. Adjustable is meant as it can be changed to different positions or sizes. The technique of tactile texture surfaces feedbacks

The tactile texture surfaces feedback is for example but not only variables of roughness, bumpiness, sharpness, and adhesiveness. Adhesion as a measure of various stickiness. Roughness as various type of sandpapers. Bumpiness as a stone which had several bumpy features and is expected to capture macro roughness. Sharpness as 'the potential of the texture to scratch' as the notches of a comb.

The invention uses familiar components from e.g. a standard touch screen device of a vibration motor, sound frequencies and sensor as they each deliver noticeable differences to the finger so users can distinguish the keys from each other.

The invention can be implemented by means of hardware, software, firmware or any combination of these. The invention or some of the features thereof can also be implemented as software running on one or more data processors and/or digital signal processors.

The individual elements of an embodiment of the invention may be physically, functionally, and logically implemented in any suitable way such as in a single unit, in a plurality of units or as part of separate functional units. The invention may be implemented in a single unit or be both physically and functionally distributed between different units and processors.

The technique of feedforward. This function can be implemented by use a touch screen in data communication with control unit. The control unit receives information from the touch screen as to a current touch position on the touch screen. The control unit having information on the location of the touch target (in figure 9A, the touch target is identifiable be the wording "Touch Target" and calculates the distance D between edge of the touch target and the touch position. Since the edge represent a line, the distance d calculated is the smallest distance from the edge and the touch position.

The color to be displayed is typically calculated by use of an arithmetic function which in symbolic form may be written as: color = F(d) where

F(d = 0) = color_t and F(d = D) = color₂ where D is the ... total distance One such example could be a linear function: color (d) = color₁D — d) + color₂(d).

While this illustrate one example, other functions can be applied such as power functions.

Itemized list of preferred embodiments

Item 1. A computer-implemented method of controlling an electronic device comprising a touch-sensitive display, the method comprising the steps of:

• detecting contact with the touch-sensitive display,

• detecting continuous proactive vibrations or texture surface movement of the contact along a horizontal direction,

• detecting continuous proactive vibrations or texture surface movement of the contact along a vertical direction,

• detecting a library in settings with various vibration patterns, examples given but not only, a short vibration tick, a double vibration tick or multiple tick vibrations,

• detecting a library in settings with various texture surface patterns, examples given but not only, spaced lines, muddy sand or a flat surface,

• in response to the detected proactive vibrations movement of the contact along the horizontal or vertical direction, the electronic device presenting a sequence of a vibration representations of software key of elements on the touch-sensitive display,

• in response to the detected proactive texture surface movement of the contact along the horizontal or vertical direction, the electronic device presenting a sequence of a vibration representations of software key of elements on the touch-sensitive display,

• detecting a change of the contact from the area without software key in a touch-sensitive display where it is felt like glass to the area with software key is providing proactive various tactile feedback from the area without software key,

• in response to the detected proactive guidance of vibration movement of the contact, the user feel e.g. with a finger the presented software key of elements on the touch-sensitive display as either proactive vibration tactile or texture tactile feedback, wherein the method further comprises the step of the electronic device providing tactile feedback in response to contact along the horizontal direction and/or along the vertical direction when entering an outer perimeter or an inner perimeter of an software key area.

Item 2. The computer-implemented method according to item 1 for controlling an electronic device comprising a touch-sensitive display. Item 3. The computer-implemented method according to item 1 or 2, wherein contact with the touch-sensitive display is initially detected, thereby it is initially detected that a user is touching the touch-sensitive display, e.g. by means of a finger, or by means of a suitable input device, such as a stylo.

Item 4. The computer-implemented method according to item 3, further comprising a movement of the contact along either horizontal or vertical direction is detected, wherein (continuous) movement of the contact preferably refer to that the user moves the point of contact with the touch-sensitive display, e.g. a finger, across the touch-sensitive display, without interrupting the contact with the touch-sensitive display, i.e. without removing, e.g., the finger from the touch- sensitive display.

Item 5. The computer-implemented method according to any one of the preceding items, further comprising in response to detecting movement of a contact along the software key area, the electronic device consecutively presents a sequence of proactive tactile feedback either as vibrations or texture surface representations of e.g. physical button elements on the touch-sensitive display.

Item 6. The computer-implemented method according to any one of the preceding items, further comprising in response to which proactive tactile pattern each icon/key appears as, the user selects individually this from a detected library in the setting menu.

Item 7. The computer-implemented method according to any one of the preceding items, wherein proactive vibration tactile representations are defined from the user's perspective on a detecting library one e.g. categorized as texture surface tactile elements, another as e.g. a vibration tactile element presented in the library on the touch-sensitive display, one after the other, such as the proactive tactile feedback representations of the vibrations and texture surfaces may be presented one at a time, in a predefined order the user select from the library to a page with various software keys, such as number one software key may e.g. occur with a single vibration tick, number two may e.g. occur with a spaced line texture surface, number three software key may e.g. occur with a double vibration tick, such that the user may differentiate between the software key elements from each other on a page on the touch-sensitive display by the touch sense in e.g. a finger.

Item 8. The computer-implemented method according to any one of the preceding items, wherein the outer perimeter may always be presented in such a manner that it occurs as a short tick vibration when e.g. a finger is moving across the touch-sensitive display, e.g. linearly, along a circle or a square or in any other suitable pattern in every software key on the touch-sensitive display, wherein the preference for this may be defined by the user and be selected in the library.

Item 9. The computer-implemented method according to any one of the preceding items, wherein the proactive tactile feedback representations of the software key may, e.g., be or comprise icons and/or written names associated with e.g. the respective applications already implemented.

Item 10. The computer-implemented method according to any one of the preceding items, wherein at least some of the proactive tactile feedback elements may be user defined and/or at least some of the proactive tactile feedback elements may be predefined and/or at least some of the proactive tactile feedback elements may be defined by the electronic device, wherein define preferably may be interpreted to mean assigning one or more elements to a given software key.

Item 11. The computer-implemented method according to any one of the preceding items, wherein a given page may have a number of elements of the same or similar kind assigned thereto and/or, preferably additionally, one of the pages may have only one of the proactive tactile feedback elements which have been accessed or activated most recently assigned thereto.

Item 12. The computer-implemented method according to any one of the preceding items, wherein the elements as a software keys may, e.g., be applications or functions available on the electronic device, and/or at least some of the proactive tactile feedback elements may be settings of the electronic device, programs available on the electronic device, a list of content, such as radio, contacts, navigation, menu or/and up- and down, right- and left, open- or close functions etc., or any other suitable kind of elements, preferably, the elements may be in the form of data, symbols or the like to be input on the electronic device, such as keys in a keyboard may be grouped into software key categories, or the alphabet may be divided into categories to provide easy access to a dictionary.

Item 13. The computer-implemented method according to any one of the preceding items characterised by, before and while operating the control functions in a touch-sensitive display user^'s sense of touch seeks to provide a guidance structure with various proactive vibration tactile feedback or/and texture surfaces, wherein the vibration tactiles and/or texture surfaces preferably are proactive enabled to be felt with e.g. a finger before and while users trigger on a software key and represented by each software key on one or several pages in a touch- sensitive display, preferably, before launch an application is a software key associated with a particular vibration or texture surface, thereby the user may have has the ability to reach the software key without trigger it and long press the software key representing the desired application without having to look at the device.

Item 14. An apparatus configured to execute the computer implements method of any one of items 1-13, preferably so as to provide proactive guidance solution for users imitating among others the sense of a physical hardware key and the process to trig the keys.

Item 15. A cohesion of a touch screen, panel or a pad, preferably using standard technology of touch-sensitive displays and hardware materials enabling haptic software e.g. in the form of a vibration or a texture surface, to provide a structed guidance in touch devices by detecting a proactive tactile feedback and thereby reducing the need to look at a screen while having your attention on a primary activity.

Item 16. A computer-implemented method into a touch panel or pad of various sizes in various material and is providing basic functionalities in e.g. vehicles as a substitute of the conventional physical mechanicals keys which takes a lot of space, cost full and are inflexible in adapting new functionalities after installation. Item 17. A safety improvement to use basic functionalities by use of any of items 1-16 as it reduces the need of having user sight on the panel or pad while navigating through the content, preferably the improvement provides a guided structure before action is taken by using proactive tactile feedback and increases safety in situations where operating touchscreens can lead to a lack of attention on the primary activity (e.g. switch radio stations while driving).

Item 18. A computer implemented method, the method comprising:

- providing a visual feedforward presentation on the touch-sensitive display assigned to a touch target such as a software key and/or icon, wherein a target color is assigned to be displayed when the target is touched by a user, said visual feedforward comprising

- providing guiding color(s) such as red, green, blue and/or yellow, said guiding color(s) is(are) either constant or flashing in time outside an outer perimeter of the touch target in a touch-sensitive display, and;

- wherein the guiding colors gradually changes into the target color as closer a touch comes to the touch target. the guiding colors/lights can emerge from a predefined point in a touch sensible display, and occur when e.g. a one finger touches the edge or the center or a corner or touches anywhere else on a touch sensible display.

Item 19. A computer-implemented method of controlling an electronic device, the electronic device comprising a touch-sensitive display and the method comprising: providing a visual presentation on the touch-sensitive display of a software key comprising a key-press area located inside a perimeter and having assigned a specific tactile feedback to be provided by the touch screen upon touch of the key-press area; recording a touch position, if any, on the touch-sensitive display and determining the position of the touch relatively to key-press area, and if the touch position coincide with the key-press area providing the specific tactile feedback. Although the present invention has been described in connection with the specified embodiments, it should not be construed as being in any way limited to the presented examples. The scope of the present invention is to be interpreted in the light of the accompanying claim set. In the context of the claims, the terms "comprising" or "comprises" do not exclude other possible elements or steps. Also, the mentioning of references such as "a" or "an" etc. should not be construed as excluding a plurality. The use of reference signs in the claims with respect to elements indicated in the figures shall also not be construed as limiting the scope of the invention. Furthermore, individual features mentioned in different claims, may possibly be advantageously combined, and the mentioning of these features in different claims does not exclude that a combination of features is not possible and advantageous.

List of reference numbers used:

1 software key, softkey, icon, target touch, area.

2 Outer perimeter

3 Inner perimeter

4 First tactile area

5 Key- press area

6 Void space

10 Vibrational element

2.1 Side mirror control section

2.2 Joystick to adjust mirrors

2.3 Windows control section

2.4 Seat heat control section

2.5 Door lock section

2.6 Unlock door switch

2.7 Side mirror control section

2.8 Joystick to adjust mirrors

2.9 Windows control section

2.9.1 Seat heat control section

2.9.2 Seat heat button - controls on/off state

2.9.3 Seat heater indicator (on/off)

7.1 Pattens library

7.2 Menu setting button Fig.10 Frame

Claims

1. A computer-implemented method of controlling an electronic device, the electronic device comprising a touch-sensitive display and the method comprising: - providing a visual presentation on the touch-sensitive display of a software key comprising an outer perimeter (2) and an inner perimeter (3) located inside the outer perimeter; a first tactile area (4) located in between said perimeters (2, 3) and having assigned a first specific first tactile feedback to be provided by the touch screen upon touch of the first tactile area (4); a key-press area (5) located inside the inner perimeter (3) and having assigned a second specific first tactile feedback to be provided by the touch screen upon touch of the key-press area (5); - recording a touch position, if any, on the touch-sensitive display and determining the position of the touch relatively to the first tactile area (4) and the key-press area (5), and if the touch position coincide with: the first tactile area (4) providing the first specific tactile feedback the key-press area (5) providing the second specific tactile feedback.

2. A computer implement method according to claim 1, wherein the method further comprising providing a voice signal representing a function assigned to be executed if the key-pressed area (5) is pressed.

3. A computer implemented method according to claim 1 or 2, wherein the method comprising a plurality of said software keys, each having a specific function assigned to be executed if the key-pressed (5) area is pressed.

4. A method according to any one of the preceding claims, wherein the inner and outer perimeter is limited or omitted, and a touch is provided on the key-press area (5).

5. A method according to any one of the preceding claims, wherein the time during which a touch is provided on the key-press area (5) is recorded and if the time exceed a preselected time frame, the touch is recorded as the key being pressed (onLongclicking).

6. A method according to claim 5, wherein said time frame is adjustable, setable in intervals, such as slow timer to trigger, middle timer to trigger or quick timer to trigger wherein slow timer is longer than middle time, which is longer than quick timer, and wherein quick timer preferably is selected with duration of 0.1-0.25 seconds, middle timer preferably is selected with a duration of 0.26-0.5 seconds and slow time preferably selected with a duration of 0.51-1.0, such as 2.5 seconds.

7. A method according to any one of the preceding claims 1-4, wherein the software key (1) is recorded as being pressed when a finger touching the key press area (5) is released from the key-press area (5). (ReleaseToTrigger).

8. A computer implemented method according to any one of the preceding claims, the method comprising:

- providing guiding color(s) such as red, green, blue and/or yellow, said guiding color(s) is(are) either constant or flashing in time outside an outer perimeter of the touch target in a touch-sensitive display, and; wherein the guiding colors gradually changes into the target color as closer a touch comes to the touch target preferably the guiding colors/lights can emerge from a predefined point in a touch sensible display, and e.g., occur when e.g., a one finger touches the edge or the center or a corner or anywhere else on a touch sensible display.

9. A computer implemented method according to claim 8, wherein the method estimates user behavior and what action the user is about to perform based on the direction of touch movement and provide proactive color guidance to feedforward based thereon; e.g., adjusting air-condition in a car versus adjusting speaker volume

10. A computer implemented method according to any one of the preceding claims, wherein the method further comprises: providing a proactive haptic feedback in response to a user sliding with e.g., a finger, over the touch device presenting on the touch- sensitive display a softkey, the proactive haptic feedback comprising varying thickness of the frame, defined as the area in-between the inner and outer perimeters comprising proactive haptic feedback when sliding with e.g., a finger over these differentiating the feedback differentiation in the frame in accordance with the wider area, the more powerful or instant the proactive haptic feedback occurs in the frame, and the wider area of the frame the less proactive feedback elicits from the key- press area wherein the thickness in a frame is adjustable, preferably e.g. increase from 1/4 contour type continuously to 14 contour type, and/or vice versa, and may cover the entire area of the softkey, icon etc. with a selective proactive vibration pattern feedback.

11. A method according to any one of the preceding claims, wherein the preselected time frame is 0.5 seconds, such as 1.0 seconds, preferably 1.5 seconds, such as 2.0 seconds, preferably 2.5 seconds.

12. A method according to any one of the preceding claims, wherein the first specific tactile feedback is a short vibration time tick, such as a vibration duration less than 2.0 seconds, preferably less than 1.5 seconds, such as less than 1.0 second and larger than 0.25 seconds, wherein the first specific tactile feedback is provided as a one-click tick when the touch position is determined to coincide with the outer perimeter (2).

13. A method according to claim 12, wherein a tick is a vibration with a frequency between 30-80 Hz or between 250-350 Hz.

14. A method according to any one of the preceding claims, wherein the first specific tactile feedback is no longer provided when the touch position no longer coincides with the outer perimeter (2).

15. A method according to any one of the preceding claims, wherein the first specific tactile feedback is different from the second specific tactile feedback.

16. A method according to any one of the preceding claims, wherein a plurality of various tactile feedbacks in the form of different vibration patterns are predefined and accessible by a user, and wherein the method is configured so that a user can select from the plurality of tactile feedbacks a specific tactile feedback and assign the selected tactile feedback to be the first specific feedback and/or the second specific feedback.

17. A method according to claim 16, wherein the different vibration patterns are different from each other by frequency and/or amplitude.

18. A method according to any one of the preceding claims, wherein first specific tactile feedback and/or the second specific feedback is/are frequency modulated to have a time varying frequency.

19. A method according to any one of the preceding claims, wherein first specific tactile feedback and/or the second specific feedback is/are amplitude modulated to have a time varying amplitude.

20. A method according to any on eof the preceding claims, wherein first specific tactile feedback and/or the second specific feedback has/have a constant frequency.

21. A method according to any one of the preceding claims, wherein first specific tactile feedback and/or the second specific feedback has/have a constant amplitude.

22. A method according to any one of the preceding claims, wherein the method is implemented in control device for controlling operations of a vehicle, airplane or ship.

23. A method of trigger a software application in a computer device, such as a smartphone, tablet or any touch panel with a vibration engine, said software application is assigned to a softkey and the method is utilizing a method according to any of the preceding claims, the method comprising: recording whether a user touches the outer perimeter (2) of a softkey and in confirmative case providing, the first specific tactile feedback until the user no longer touches the outer perimeter (2); recording whether a user subsequently to touching the outer perimeter (2) touches the key-press area (5) and in confirmative case: providing the second specific tactile feedback, - recording the time the user touches the key-press area (5) and if the time exceed the preselected time frame according to claim 3, trigger the software application assigned to the softkey.