WO2020151775A1 - Electronic device, method for controlling an electronic device, and one or more computer-readable media with instructions that can be executed by a computer - Google Patents

Abstract

The invention relates to an electronic device (1) with a screen (10), a contact sensor (2), which has a touch-sensitive sensing surface (21) arranged in a sensor plane and is designed to capture movements of one or two controlling fingertip(s) (41) of a hand on the sensing surface (21), while further, holding fingertips (42) of the same hand are being used to fix (43) the controlling fingers over the sensing surface (21). A control system (3) is designed to compare the captured movement of the controlling fingertip(s) (41) with a reference line (5) running in the sensing surface (21) and stored in a memory and to generate the control commands as a function of a movement, thus determined, of the fingertip(s) (41) relative to the reference line (5).

Description

Electronic device, method for controlling an electronic device and one or more computer-readable media with one

Computer Executable Instructions Description:

The invention relates to an electronic device, a method for controlling an electronic device and one or more

computer readable media with instructions executable by a computer. In particular, the invention relates to an electronic device with a screen, a method for controlling the electronic device and one or more computer-readable media with instructions that can be executed by a computer and which, when executed, implement the method. An electronic device with a screen, such as a small computer, for example a cell phone, is usually operated manually by a user. There are also such electronic devices that have a touch sensor in addition to the screen, which one in one

Has touch-sensitive sensor surface arranged on the sensor plane and is designed to detect movements of one or two controlling fingertip (s) of a hand on the sensor surface, while further, holding fingertips of the same hand are used to fix the controlling fingers over the sensor surface. In this electronic device, the screen and the touch sensor are connected to a controller, which is designed to generate control commands depending on the detected movement of the controlling fingertips and those on the screen

control displayed information according to the control commands.

In this case, the touch sensor and the screen, for example the small computer, are arranged on one side of the electronic device in accordance with a prior art which is not documented in printed form. If the user wants to operate the electronic device with one hand, his hand takes an unergonomic hand that can lead to tendinitis. Therefore the electronic device is usually not held and controlled by the same hand. Rather, the user holds the electronic device in one hand and operates it with the other.

The main uses of such electronic devices such as small computers are "viewing" HTML documents in browsers, as well as messenger, telephone and email programs. What all programs have in common is that the user moves through large amounts of information which, because the small computer is relatively small, are arranged among one another in lists or text blocks. The user uses a finger to push data through the small computer either from top to bottom or from bottom to top or from right to left or vice versa and leads through it

Tax movements.

The control commands for the control movements are embedded in a context that originates from the starting or starting point, i.e. the

Touch point at which the controlling fingertip is placed on the touch sensor by the user first, and the type of gesture of the user. This embodiment, however, has considerable disadvantages, especially if only one hand can be used for operation, but also when used with both hands. Control movements are misunderstood by the small computer and interpreted differently than what the user wants. For example, the user only wants to move a text displayed on the screen in a browser for further reading and makes a corresponding gesture, but instead a link is opened because the gesture was interpreted by the small computer as clicking a link. This type of error is particularly common when only a single hand is available to control and hold the small computer. The movement of the one finger controlling the gesture influences the movements of the holding hand and thus the essay takes place slightly next to the desired location, or a planned tap is simply a wiping by an unwanted, slight shift, which is sufficient to be interpreted by the small computer as a tap and does not trigger the desired link. Another serious disadvantage that the starting point of a gesture determines the action is that the user must physically reach positions on the screen that he cannot reach when holding the electronic device with one hand. Sometimes the user can reach the positions by moving them around, but sometimes even that is difficult. When reaching around or after reaching around, the electronic device is generally held poorly (so that there is a considerable risk that the user loses the electronic device from his hand and thereby damages it.

Attaching the electronic device in a holder is also not a good alternative for the user. There are two variants for operation with a holder. In one variant, the electronic device is well positioned in the field of vision, but then operation is difficult and tiring for the user's arms, which is permanently precise, fine motor

Movements very difficult. The user selects a position that

is ergonomic for the hand / fingers, it is usually difficult to read the screen, or the electronic device is positioned so that the primary task can no longer be carried out safely enough.

Binding the gesture of the user to the touched information has another disadvantage. The speed of movement of information on the screen is coupled to the speed of the user's finger movement. This intuitive behavior is undoubtedly very cheap

Learn how to use it. However, this speed binding will

lifted when the finger ends at the end of a quick movement

Touch sensor is lifted off. Then the movement of the information on the screen is practically “pushed” and rolls on like on rails and slowly loses momentum over time. This fast mode is used when displaying information. But the movement is there uncontrolled. It can be stopped but not slowed down. To the

It is very helpful to skim over texts.

Of course, when reading information, the speed of movement is relatively slow and because of the synchronism of finger movement and information movement, much more finger movements are performed by the user than would be necessary. The sensitivity of the

The touch sensor can be selected to be very fine, so that even the slightest movements of the user's controlling finger lead to stronger movements of the information. Because usually the index finger of the

Even if the user is in an ergonomic position and the thumb and ring finger hold the device securely, even the smallest movements can be easily controlled. The user can thus generate relatively large movements on the screen with relatively small movements of the index finger via the touch sensor. Neither the direction of the movement nor the speed

to match. In addition, the selection of individual characters from a displayed text, e.g. B. to copy them into another application, sometimes relatively difficult. With one finger between two characters

maneuvering is difficult. First, the user sees the position poorly, secondly, it is difficult especially at the edge of the screen, especially if the user inserts a protective cover for the electronic device.

It is therefore problematic to operate the electronic device with one hand. This is necessary, however, when a user's hands are not as free to operate and hold the electronic device as the user may want. For example, a user who is driving a car or bicycle cannot move his hands as freely as a user who is in the office or at home. There is therefore a need for an electronic one

Device that has increased user friendliness and better usability.

It is an object of the invention to provide an electronic device

Method for operating an electronic device and one or to provide a plurality of computer-readable media with instructions which can be executed by a computer and which have simple operation of the electronic device in as many situations and situations as possible. In particular, the electronic device, the method and the one or more computer-readable media should be operable or executable with one hand.

According to the invention, this object is achieved by an electronic device with the features of claim 1, a method with the features of claim 10 and one or more computer-readable media with instructions that can be executed by a computer with the features of

Claim 1 1 solved. Advantageous refinements and developments of the invention result from the following subclaims.

According to the invention, it is provided that the control is designed to compare the detected movement of the controlling fingertip (s) with a reference line stored in a memory and running in the sensor area and to generate the control commands as a function of a relative movement of the fingertip with respect to the reference line determined in this way.

This enables sensory control of the electronic device, which considerably improves its handling in many everyday situations. I.e. , The complex operation of the electronic device becomes significantly more ergonomic, safer and therefore more comfortable. A particular advantage of the electronic device is that it enables one-handed control, so that a second hand of the user remains free during operation. The electronic device can always be stable in the hand of the user during operation. The user can reach all positions on the touch sensor, ergonomically moving the fingers.

In the sense of the invention, the electronic device is a device that allows autonomous control with its own computer (s). The electronic device preferably has one or more internal computers. The electronic device is preferred as a computer, more preferably a small computer such as a notebook, laptop, tablet, mobile phone,

Navigation device or data glasses trained. It is most preferably designed as a mobile phone. The electronic device is preferably designed to carry out applications.

In the sense of the invention, it can also be a fingertip

Act fingertip. The user's hand, which operates the electronic device alone, is divided into holding fingers and controlling fingers.

Holding fingers are fingers that hold the electronic device or at least the touch sensor, while a controlling finger is a finger that touches the touch sensor in such a way that control commands are triggered by the control using the touch or movement detected by the touch sensor. One or the controlling fingers is preferably the index and / or middle finger. Holding fingers are preferably the thumb, the little finger and the ring finger. If the user only holds the touch sensor in one hand, there is a root point in the hand that represents a hand rest point and influences the hand position.

In the sense of the invention, the reference line is also a

Reference line. The reference line can also be referred to as the zero line or rest line, because it preferably describes a line in which the controlling finger and the index finger are in a rest position, without muscles being tensed for lateral movement. Through this line there is a fixed reference line for all further interactions of the user on the touch sensor. The controller is preferably designed to implement movements parallel to the reference line on the screen as up and down movements. The position of the controlling finger, for example of the index finger, preferably specifies the reference line of the movement. The is preferred

Control device designed, when the controlling finger moves up or down, for example the index finger on the touch sensor by bending or stretching, to correspondingly move a content shown on the screen up or down, regardless of how inclined the controlling one is Fingers actually in relation to the touch sensor or too

Moving outer edges of the electronic device. The controller is preferably designed to correspondingly implement a displacement or an oblique angle, which is detected by the touch sensor, on the screen.

The reference line can preferably vary, and the control is preferably designed to determine the reference line based on the handedness and hand position of the user's hand.

The reference line running in the sensor surface preferably has one

Resting point on. The controller is preferably designed to determine the point of rest on the basis of a finger position detected by the touch sensor. The controller is preferably designed to determine a relative movement of the controlling fingertip (s) with respect to the point of rest.

In a preferred embodiment, the control is designed to convert a movement of the controlling fingertip (s) detected by the touch sensor as a function of a movement direction to the reference line into a main movement direction assigned to this movement on the screen.

The control is preferably designed to detect a movement of the controlling fingertip (s), detected by the touch sensor, parallel to the reference line in the main direction of movement on the screen (generally from time to time)

to implement. The controller is preferably designed, one of which

Touch sensor to detect movement perpendicular to the reference line transverse to the main direction of movement. The control is preferably designed to be any inclined position detected by the touch sensor

Movement, to convert into an oblique movement on the screen, which result from corresponding oblique movement in relation to the reference line.

The control system is preferably designed to make a movement carried out on the screen or the screen content stronger than the movement of the controlling fingertip (s) detected by the touch sensor. In the sense of the invention, a control command is a gesture carried out by the user on the touch sensor, which preferably controls applications within control states and can also trigger state changes, for example. Depending on the determined relative movement to the reference line, the control command preferably triggers a control command assigned to it. The control within the control states can preferably be implemented in that several applications are each in a predetermined control state, which is designed to ensure an interpretation of the gesture selection used by the user, which thus best meets the special requirements of the respective control state. So gestures can be used relatively extensively overall. Because the same gesture can be used differently depending on the control status. And because the user's control finger is positioned so that it is particularly easy and ergonomic to use, there are a multitude of options. The control states are designed in such a way that they limit the use and only a state-specific one

Allow gesture control.

The controller is preferably designed to provide the context for the

Touch gestures to map usable gestures via the control states. The controller is preferably designed to display an active control state on the screen. For example, the controller is designed to have an active control state in a status line on the edge of the screen

display. Control states are, for example: the read or

Viewing state, the navigation or command or command selection state, the selection state, the input state, the movement state and / or the changing state.

A description of the respective control status is stored in the memory as to how standardized commands of the controlling fingertip are used in order to control the applications differently in each case.

The operation of the electronic device is safe because the movements are tailored to the context and the user in addition to the sensory Control also has visual control, because the chosen starting point of the gesture is no longer covered by inserted fingers. A final advantage that arises when reading and operating the electronic device with one hand is that the full surface of the screen is always visible because parts of the screen are not covered by the user's finger.

In a preferred embodiment, the reference line stored in the memory runs obliquely to a side boundary of the sensor surface. As a result, the touch sensor can be matched to the hand of the user used to operate the electronic device, the use of the electronic device being supported by right-handed and left-handed people alike. This is based on the geometry of the finger insert, because left and right of the reference line from the “finger point of view” with the left hand is exactly opposite to a movement of the right hand.

The control is preferably designed, the control commands for a

Generate lateral guidance of a page generated on the screen and / or for cursor guidance of a cursor generated on the screen, wherein a detected movement parallel to the reference line leads to lateral guidance and / or cursor guidance along a main axis of the screen. The cursor is basically a kind of fingertip pointer in analogy to a mouse pointer. The cursor preferably represents a mouse pointer, such as from

commercially available computers, in which the mouse pointer is known

can usually have a point cursor or a text cursor.

The latter describes a flashing line where the text is entered, while a point cursor is defined by an arrow head of the cursor.

The controller is preferably designed to allow the cursor to make a precise selection, which is always an advantage over the selection of small letters with a wide fingertip, especially because the controlling finger does not cover the contents to be selected. This embodiment is for example in the navigation or command selection state and / or in

Selection state advantageous.

The control state, which is changeable, is preferred. from the

is changed, the reading or viewing state. The reading state or viewing state is preferably a basic mode of most applications.

Here, information presented on the screen is recorded by the user, the expression “reading” also including the recording of graphic information. Often more information is offered than the screen can display. On the part of the presenting application, it is customary today to adapt the content, that is to say the information displayed, to the width of the screen. If there is more information than can be displayed on a screen, the user will preferably bring the excess information into a viewing area of the screen first by moving down and later moving up, if necessary. This is

for example in browser applications such as Chrome, Edge, Firefox and Safari but also in telephone contact applications, email programs and

Messenger applications like WhatsApp common. In the browser you have a web page, in Messenger either the chat overview or the individual

Chat history.

Information which is displayed in such a flexible manner always contains information which leads to further (detailed) displays or specific actions. In the browser, these parts are the embedded links. In the contacts, it is the details about the contact. In WhatsApp, depending on the context displayed, different types of links are included in the page. If the user wants to access a link contained, he must preferably leave the reading state and in the

Change navigation or command status. This change is made with a control command. Within the command state, at least the up and down movement for controlling the text is preferably possible as a gesture. In particular, gestures such as left-right shifts and / or swipes are useful in order to move content on the side into the viewing area. Besides, is a zoom function, i.e. putting two fingers on and sliding them together or apart, makes sense as a gesture.

The navigation or command selection state causes changes through an action in an application program that is open on the screen. For example, a different page is displayed on the screen of a browser or a Javascript is executed, a chat is selected from an overview in Messenger to be processed further, or a command is executed within a chat to forward or delete a post, to quote or copy. Menus can also be displayed on the screen or opened and closed or buttons pressed, or apps started on a home screen and / or widgets controlled. The control is preferably designed such that when the user selects an input field, the selection changes to the input state.

The control is preferably designed in the navigation and

Command selection state to consider all parts that represent buttons. Applications that do not actively control the state require control with the cursor. The buttons preferably have a minimum size that is matched to the controlling fingertip used on the touch sensor. The minimum size preferably corresponds to at least one height of a line of text. The buttons are preferably also color-coded. As a result, they are more visible and can be moved faster. The controller can be designed to make the cursor jump from one screen line to the next screen line, up or down, to the right or left, and also diagonally in any desired direction until the desired zone is reached, with minimal movements of the controlling fingertip on the touch sensor .

The control system is preferably designed to let the user define a zone in which this cursor moves when the state changes

Command status shows. The user can thus get the button very close to one Introduce a point in order to be able to carry out the desired action particularly quickly after changing the state to the command state.

The application programs are preferably designed to know the command state. The controller is preferably designed to register the potential buttons when the state changes to the command state. These are preferably visually highlighted on the screen. For example, they are identified as areas marked in color or otherwise optically highlighted (in analogy to areas on a map). The user can control the desired button with the touching fingertip using the touch sensor, whereby the next area in the direction is “jumped” and marked in color as “selected”. If the desired button was not selected when the surfaces were selected, the controlling fingertip on the touch sensor is simply (minimally) pushed further in the direction where the desired button is located, whereby the next button in the direction is jumped to, with the controller preferring is trained to implement the process described above. This can include "jumping back" if you accidentally choose the one you want

Button was controlled. In any case, the control is quick and absolutely clear. The risk that the user accidentally taps next to the desired button because two buttons are too close together and / or the user has hit the wrong button due to the lack of a view of the selected point is prevented or at least reduced.

Are preferred in the controller for triggering the action in the

Command state deposited two variants, a slow one for inexperienced

Users and a quick one for experienced users. The control is preferably designed such that when the desired button is reached, the associated action is started by tapping on the touch sensor with the controlling fingertip. Is a menu linked to the button that offers further options the control system is preferably designed to be selected and displayed by tapping and holding using the controlling fingertip. The fact that the screen is touch-free prevents or at least reduces the risk of confusion with other actions.

The controller is preferably designed to end the command state when an action is triggered. The controller is preferably designed to

End the command state by triggering an action and switch back to the reading or viewing state. As an alternative, the control system is preferably designed such that when the application programs know the command state and consider it useful in terms of content

Maintain command state.

The selection state is used to let the user mark parts of the information presented by an application on the screen. The focus is on transferring selected data from one application to other applications, or to use the selected data elsewhere in the same application. Control is preferred

trained to mark the user in the selection state for applications, for example in the browser and for e-mail applications, letters, a line of text up to the entire web page, for messengers such as WhatsApp select one or more messages, such as parts of text from individual messages e.g. can be used as a quote in an answer, or have a placemark placed on a route on Google Maps. With the selection state in the electronic device according to the invention, the selection becomes relatively safe because it can send unique signals to make a selection.

The controller is preferably designed to let the cursor be used in the selection state, such as in the command state, in order to make a selection on the screen by means of the touch sensor. This makes operation relatively safe and after a failed attempt it has

Users saved the time to find the starting position again. The controller is preferably designed to have the cursor shifted with the controlling fingertip on the touch sensor with up-down-left-right movements for the selection.

The user can select a "point" when the appropriate position has been reached by simply tapping with the steering one

Fingertip done. Then a second point can be activated again in the same way. This allows the user to take off and

Put his steering fingertip back on even over long distances. But it does not have to be the distance on the screen with the distance of the controlling finger on the touch sensor

to match. The movement of the steering finger on the

Touch sensor can be significantly smaller than the movement of the cursor on the screen. The controller is preferably designed to have relatively slow movements near the point of rest lead to relatively slow, targeted movements of the cursor, while it is also designed, in the case of fast movements on the touch sensor, a technique of

Lets use the wiping fingertip as described above in connection with the reading or viewing state

is described.

The controller is preferably designed to end the selection state with an action that is offered for selection in the form of a menu on the screen. The offers are, for example, "Copy", "Cut", "Reply", "Forward" or the like. The control system is preferably designed to display the menu either directly at the end of the selection (if the selection items are fixed (for example to two) ) or by placing the controlling fingertip, for example the middle finger, and tapping another controlling fingertip, for example the index finger. The controller is preferably designed to return to the previous control state after the selection has ended. This can be the reading or viewing status or the input status. The electronic device can be formed in one or more parts. That is, the screen, the touch sensor and the controller can be integrated into one device or can be designed as a plurality of devices which, taken together, form the electronic device. That is, the touch sensor itself can be attached to the device to be controlled which has the screen, on the other hand it is also conceivable that the touch sensor is attached separately or additionally separately from the device having the screen.

The controller can also be integrated into the device having the screen and / or the device having the touch sensor or can be embodied in a separate device. The control commands can be transmitted wirelessly to the device to be controlled using the screen. One and the same touch sensor can also be used in order to be linked to different devices to be controlled, each of which has a screen, in order then to make these devices temporarily operable. The device or devices to be controlled are the device or devices that each have a screen. The control commands can be transmitted via any wireless transmission standard but also via cable if, for. B. in

Environments with medical equipment additional radiation is not desirable.

Position and direction information relate to the operational installation position of the respective device, the screen, the

Contains touch sensor and / or the controller.

The touch sensor can have one or more sensor units with one or more sensor surfaces. The touch sensor is preferably placed at a location on the electronic device where the hands of the

Be used during a job or activity anyway.

The touch sensor is preferably integrated into the electronic device in such a way that a preferably two controlling fingertips can be freely and safely freely positioned, while the holding fingers ensure a fine granularity of the movement. This position can be when the electronic device is used in the car or in other machines where the hand position is or can be relatively static and at least temporarily freeing control fingers such as the index finger and the middle finger of the hand of the user. A preferred embodiment is an integration of the touch sensor in the steering wheel in motor vehicles, the electronic device

for example, is a cell phone. For example, the user can conveniently receive messages from the vehicle when standing at the traffic lights

Check messenger or email on the screen without going against the

To violate road traffic regulations because his hands remain on the steering wheel. In addition, there is a significant time advantage when standing with the motor vehicle at a traffic light when using the device according to the invention. Today, when the engine of the motor vehicle is switched off, the

Pick up your mobile phone at the traffic lights and then put it away again safely. Both cost a lot of the short stopping time, which can be used much better with the integrated touch sensor on the steering wheel and its control there. The screen can be in a holder

be arranged that is well within the user's field of vision without obstructing the view of the road.

Such an arrangement is also possible with a bicycle in which

Touch sensor can be integrated into a handlebar of the bicycle, and the screen can be arranged in the user's field of vision.

Just as it is possible with the touch sensor on the steering wheel of the

Controlling the screen of a mobile phone in a motor vehicle is at

Integration of the touch sensor in a mobile phone can also control a television. This results in a universal form of remote control, whereby the control can be integrated into simple, self-explanatory HTML documents. The electronic device can be used virtually for all devices and has further technical advantages. Regardless of the arrangement of the touch sensor on and / or on the electronic device, the touch sensor preferably does not occupy the area of the screen. That is, the screen is preferably designed without touch sensors.

In a preferred embodiment, the electronic device also has a mobile housing, the screen on a

The front of the housing and the touch sensor are arranged on a rear of the mobile housing. The touch sensor is preferably arranged on the back so that it is most practical for reaching with the index finger. As a result, the electronic device, for example, the mobile phone can be comfortably held in one hand while it is being operated, it being held securely and thus not being able to slip out of the hand. With this rear-side touch sensor, in particular the entire control can essentially be reduced to simple movements of the index finger. When steering over the back, the index finger is preferably used in its natural position for a straight up and down movement. The finger movements required for control are preferably defined in such a way that the controlling finger or fingers as often as possible in its natural position and in its predetermined position

Direction of movement is or will be used.

The touch sensor is preferred as a touchpad or touchscreen

educated. This eliminates the need for additional input devices such as a mouse. In addition, touchpads and touchscreens can be built compactly and can be integrated with the screen in a device, particularly in the housing.

In a preferred embodiment, the controller is designed to carry out a calibration or calibration in which the basic movement of the fingertip on the fingertip is detected by means of the touch sensor

Sensor surface, the reference line is determined and stored in the memory. After reaching around the electronic device or device into which the Touch sensor is integrated, this perceives the reaching around, so that the control is initiated to carry out the calibration and to identify the position of the controlling fingertip on the basis of movements transmitted by the touch sensor.

The controller is preferably designed to carry out an automatic calibration, in which the sensor is detected by means of the touch sensor

Information on the position of the hand and / or on the support position (s) of the controlling fingertip (s) and / or by means of motion sensors

determined information on the orientation of the touch sensor

Reference line and rest point are determined and stored in the memory.

If the control system is not able to perform the (automatic) calibration, the control system is preferably designed to have the user prompted by a display on the screen after the

Grasp the hand and / or finger position again to calibrate. The controller is therefore able to perform a new calibration if the (automatic) calibration cannot be carried out.

The control is preferably designed to recalibrate on the basis of a position of two fingers on the touch sensor and a flexion of one of the two fingers, i.e. using a so-called swipe gesture. For example, in order to carry out the recalibration, the user places two fingers, such as the index finger and middle finger, on the touch sensor and then bends the index finger, as is required for the swiping gesture, in order to carry out the new one

Perform calibration. The two-finger rest with the diffraction has the important effect that from the two support points and the well-known

Movement the reference line can be set. Every calibration, ie determination of the reference line, is carried out directly by an operating system of the electronic device, so that an application program is independent of the calibration. There is preferably an on the reference line determined in each calibration

Resting point. The rest point describes the zero point of the touch sensor coordinate system and results from the rest position of the controlling one

Fingers. It is preferably a point at which the controlling finger relaxes, that is to say neither bends nor stretches, on the touch sensor.

This provides a coordinate system that also allows absolute positioning, as e.g. is required when using the on-screen keyboard. The controller is preferably designed to convert movements detected by the touch sensor so that they are horizontal and vertical

Limitations of the screen.

The controller is preferably designed to operate the electronic device in a command mode from the time of the calibration of the touch sensor. In command mode, the controller converts movements of the user's control finger detected by the touch sensor into control commands. In a preferred embodiment, the control is designed to support a plurality of control states in such a way that the control commands in

Depending on the determined relative movement of the fingertip and depending on a control state. The control state can be the changing state, for example. The state of change arises from the necessity of the essential ones

To map the basic functions of the systems and there are some standard buttons in the state of the art, which is not documented in printed form

On-screen keyboard established that can be used at all times and must therefore also be accessible at all times on the touch sensor without causing difficulties with existing applications. The changing state makes it clear how the possibilities of the control can be expanded by states. The change state is a technical transition state, which can preferably be controlled by the control when the touch sensor detects a double tap with two controlling fingertips, so that predefined keys shown on the screen, also called “special keys”, are activated, which are printed not used state of the art in Android have the functions "back", "home" and "app selection". When the touch sensor detects the double tap, a menu is shown on the screen as a control aid, which is shown in Table 1:

Table 1 :

With a simple tap of a controlling fingertip, for example of the index finger on an area of the sensor surface assigned to the special button, the user can preferably carry out the back function (<), with a tap of a further controlling fingertip, for example of the

The middle function on another area of the sensor surface assigned to the further special key prefers the home function (o). With a swipe down, the user prefers to return to where he came from. By stretching a controlling fingertip, for example the index finger on the touch sensor, the user can preferably quickly control other functions in the menu. The control is preferably designed such that the user can expand the menu with his own entries. This means that the entries can be reached quickly at any time. The user can preferably be guided optically at various points by additional displays (such as the menu here). This can make control easier.

The touch sensor is preferably designed by means of the controlling one

To detect finger tip (s) gestures carried out on the sensor surface, the controller being designed to change from a control state to a further control state as a function of the detected gestures. A The change of state can preferably be triggered by placing a finger on the touch sensor and tapping another finger. If, for example, the middle finger is put on and tapped with the index finger, a change is made, for example, from the reading or viewing state to the navigation or command selection state. When placing the index finger and tapping with the middle finger, for example, a menu is offered for selection that contains further options, for example the change to the selection and / or movement state.

The input status deals with the input via a keyboard displayed on the screen, hereinafter also referred to as an on-screen keyboard. The input status is used in particular if

Keyboard input on mobile devices cannot be made via voice input or a voice input should be corrected. The device according to the invention is suitable for ensuring safe operation of the keyboard with only one hand.

When entering the keyboard, the screen is preferably divided into three areas:

• an area that receives the entered data.

• a zone in which word suggestions are offered.

• Another area in which letters, numbers and special characters are offered for selection.

When entering data, the key is quick and reliable selection. The control system is preferably designed to calculate the point of rest of the controlling fingertip and to use it as the zero point which reflects a center of the keyboard. The control is preferably designed in such a way that the controlling fingertip does not have to be explicitly moved under the buttons shown on the screen. The control is rather designed in such a way that the center of the displayed keyboard is moved over the resting point of the finger. This makes the electronic

Device designed as if the user would work with a glass keyboard, which is arranged around the point of rest of the index finger. The glass keyboard preferably has printed letters that are selectable. The keys can be relatively close together, much closer than would be possible with an optical selection. This is the case for two reasons. Firstly, because an incorrect selection is easy to correct and secondly, because the optical control is actually done on the screen and not directly on the glass keyboard. In this way, a transformation from small distances on the touch sensor to large distances for the optical control can be carried out. The controller can therefore quickly learn which letters the user wanted to select at which position and thus quickly optimize itself. It is preferably self-learning

educated. In the sense of the invention, letters also include numbers and special characters, which can be selected depending on the input context.

The letter selection is described in detail below: The control is preferably designed if the controlling fingertip is moved from the rest point in a predetermined direction, for example to the left, and then placed on the touch sensor, depending on the distance from the rest point, the letters on the left of the keyboard head for. The control system is designed to “calculate” a potential letter when it is put on. The control system is preferably designed to mark the calculated letter as selected, for example with a color background. The controller is preferably designed to correct the selection with minimal displacements of the controlling fingertip, if necessary.

The control is preferably designed, with the selection of one

Let letters jump to the next or from one row of letters to the next. The controller is preferably designed to accept the marked letters as input in the case of the identification of the selected letter and when the controlling fingertip is lifted from the touch sensor. This preferably represents a standard mode, the movement of the controlling fingertip not having to match a stored optics of the letters. This allows the user to jump from one letter to the next with relatively small movements. The Selection is therefore very quick and reliable and visual control is better because the selection is not covered by one or more fingers.

The control system is preferably designed to open expansion menus for (special) characters in another way, i.e. to be displayed separately on the screen so that movement there can be distinguished from the movement in the main area of the keyboard. The control is preferably designed to take into account a further controlling fingertip in addition to the originally controlling fingertip when opening the expansion menu. The control is preferably designed to display the extension menu on the screen in the case of a selected marked letter and tapping the touch sensor with the further controlling fingertip.

The controller is preferably designed to position a selection in this expansion menu in exactly the same way as was possible in the main area. The selection is much easier here because the controlling finger does not have to be dragged over the extension menu without losing contact. Rather, the control system is preferably designed such that the (special) character to be selected can be jumped to again directly on the basis of its position. If the desired character has not been made immediately, the selection is corrected by making the smallest movements as in the main area. Of course, with full visual control through labeling such as the color background described. The control is also preferably designed to take over the selected character when the controlling fingertip is detected to be lifted off the touch sensor.

The control is preferably designed, the following special functions

to execute

• a selection of word suggestions,

• a change between lower and upper case letters, and / or

• a change of keyboard layout (letters / special characters / numbers or language) The control preferably requires two controlling fingertips to carry out the special function (s). Preferably, two controlling fingertips of the user on the touch sensor are used in common for all three special functions. The controller is preferably designed to select the special function, for example, the middle finger, via an application zone of a controlling fingertip and as soon as two controlling fingertips are on the

Touch sensor can be detected, optically marked on the screen, for example by means of a colored background, and thus displayed.

The control is preferably designed, the touch sensor in three

Subdivide sections, each section being assigned a special function. I.e. when you touch the respective assigned section, the special function is selected in this state. For example, the controller is designed to stretch the one fingertip controlling the middle finger, for example, and to rest it somewhere else

Touch sensor in a section assigned to the selection of word suggestions, for example an upper section of the screen and / or the keyboard, to make the selection of word suggestions. The control is preferably designed when a further region of the

Sensor surface, which is assigned to a further section of the screen and / or the keyboard, for example a middle section, to make a change from lower and upper case letters. Furthermore, the control is designed when a further area of the is touched

Sensor area of a still further section of the screen

for example, is assigned to a lower area of the screen and / or the keyboard, for example to change keyboard layouts with the middle finger bent. The control is preferably designed to correspond to a selection of the special functions at a position

Orient items that appear on the screen.

A difference between the selection of a special character menu by tapping with the controlling finger like the middle finger and the three special functions is that the controlling finger is like that Middle finger rests on the touch sensor and is not used for typing, and the touch sensor is designed to detect this accordingly, and the controller is designed to control this accordingly. The control system is preferably designed to use a selected special function

Shift the control finger like the middle finger (e.g. up / down) to switch if the user has not hit the desired section immediately. This can be easily checked using the visual display.

The control is preferably designed to let the user select word suggestions. The control is preferably designed to let the user select the word suggestions by means of two controlling fingertips. For example, the word suggestions can be selected by placing or shifting two controlling fingertips on the sensor surface, the middle finger, for example, pointing upwards, that is to say being higher or stretched than the index finger. Direction and position information refer to the operational position of the touch sensor. By placing the two controlling fingertips for the first time, for example, the middle word suggestion is marked as selected. The controller is preferably designed to accept the selected word suggestion and to control the screen content accordingly when the touch sensor detects that the two controlling fingertips are lifted off. If, for example, the index finger is moved as a controlling finger, its direction of movement reflects the shift in the selection (the word suggestion) on the screen. For example, if the index finger is moved to the right, the selection is moved to the right or vice versa to the left. So you can switch between right and left until the desired selection is displayed. If both controlling fingertips are lifted, the

Proposed word in the input.

Furthermore, the control is preferably designed to display a word suggestion menu on the screen that goes beyond the - for example three - directly visible suggestions. This can be done, for example, by diffraction of the index finger (movement downwards). The selection within this word suggestion menu is made as if the words offered were only letters. The selection of letters is above

described.

Even if the control is designed to select a change between uppercase and lowercase letters, the automatic change between large and small letters may not always take place as desired. The control is preferably designed to have such a proposal corrected. For this purpose, both controlling fingertips are in a predetermined section of the touch sensor, for example in the middle section

(in parallel). The control system is preferably designed to color-code a specific key, such as the shift key, on the screen in order to enable visual control. This happens when both controlling fingertips are placed in the above-mentioned, for example middle section of the touch sensor. The control system is preferably designed to select small letters when the two controlling fingertips are pushed together or when pushing one controlling fingertip, for example the index finger to the other controlling fingertip, for example the middle finger, and when pushing or pushing the index finger away from the middle finger, large letters are selected . This

The procedure is analogous to the well-known zoom function,

push together ==> reduce, push apart ==> enlarge. As is known, the visual control is carried out by displaying the corresponding letter size on the keyboard on the screen.

The control is preferably designed to determine the capitalization when the touch sensor detects that the controlling fingertips are briefly wiped down together before lifting off. The optical check is carried out as above. The control of the

Electronic device according to the invention advantageous because a final state is controlled directly and does not have to be generated by a laborious change from one to the other state. The control is preferably designed to allow the keyboard layout to be changed when the touch sensor detects that the middle finger is bent more than the index finger and is thus placed lower.

When changing the keyboard layout, a distinction is made between two variants.

• A choice between special characters / letters and possibly numbers

• A choice between different country-specific layouts, which takes into account the choice of word suggestions in addition to the special characters.

If both controlling fingers are bent and placed on the touch sensor or moved to the lower area after placing, the selection is preferably made via the movement of one of the two controlling fingers.

The control device is preferably designed so that a selection is made in the assigned section of the screen, for example in the lower area, and the keys for changing the keyboard layout are identified, for example with a color background. This serves for optical control. The change between the different special character layouts and the letters takes place, for example, by shifting the control fingers from left to right, while the language is changed, for example, by shifting the control fingers up or down. The controller is preferably designed to change the layouts in rows, so to speak, in a circle. Assuming the keyboard offers three languages, DE (German), ES (Spanish) and EN English), for example, moving the control fingers down will change from DE to ES to EN and back to DE to ES etc. and when you move to above from DE to EN to ES to DE to EN. The optical control is preferably carried out as described above.

The control device is preferably designed to abort an input. Regardless of which input the user makes, the controlling finger or fingers lie on the touch sensor and the acceptance of the input is done by lifting the controlling finger or fingers from the touch sensor. If the user determines that he does not want to make the entry in this way, for example because lowercase letters are selected instead of uppercase letters, the touch sensor is preferably configured to

jerky wiping (for example downwards) and subsequent lifting of the controlling finger or fingers, and the controller is preferably designed to abort the input in such a detection. In this way, incorrect entries that would then have to be corrected are avoided. This is an advantageous additional function that can offer additional comfort, as described below.

The controller is preferably designed to execute a character correction mode, which is initiated when the touch sensor detects that the user has placed two controlling fingers in its central area. In the character correction mode, as described above, the change between uppercase and lowercase letters is carried out, the user moving his two controlling fingers against one another, if the user moves the two controlling fingers together with one another instead, the input is corrected by deleting the characters when the user moves the two controlling fingers together against the writing direction. The same effect is achieved as when pressing a correction key. The controller is preferably designed to stop the deletion when the touch sensor detects that the user is lifting the two controlling fingers from it. Furthermore, the control is preferably designed to continue the deletion when the touch sensor detects that the user allows the two controlling fingers to remain in the position that initiated the deletion. Furthermore, the control is preferably designed to insert the deleted characters again when the touch sensor detects a movement of the two controlling fingers of the user in the other direction of the deletion direction. This allows the user to re-insert too many deleted letters or words so that the correction can be corrected. The controller is preferably designed to end the input of characters by the user and / or to start an action desired by the user, such as a search process. The controller is preferably designed to end the input of characters when the touch sensor touches a predetermined key of the keyboard on the screen with one or more controlling fingertips. The predetermined key is preferably given a name such as “go”, “search” or “continue”

featured. The user can preferably select the predetermined key in the same manner as described above when selecting letters. As an alternative or in addition, the control is furthermore designed to end the input of characters when the touch sensor double-clicks with a controlling fingertip, for example the

Index finger and a simultaneous resting of the other controlling

Finger tip of the middle finger captured on it, for example. Depending on the software integrated in the electronic device, a search process is started or the input is ended. If the predetermined key is assigned a line change, the control is preferably designed

Let the user select the key in the same way as the special character. Then the user can double-click with one fingertip, for example the index finger e.g. use to send a search, which also ends the entry, but this has nothing to do with the keyboard displayed on the screen.

The controller is preferably designed to shift an input position and / or to select a character. The controller is preferably designed to display a menu for selection on the screen when the touch sensor detects the placement of a controlling fingertip, for example the index finger, and a double tap of a further controlling fingertip, for example the middle finger. The menu for selection preferably comprises one or more selections, each of which shows “moving” (the entry position), “marking”, “marking all”, deleting all and / or other program-specific offers. The controller is preferably designed to switch to the selection state when the touch sensor detects a controlling fingertip at a position that is associated with a position on the screen that corresponds to the selection “move” and / or “mark”. The cursor can be used with a steering

The fingertip can be moved specifically in the input area. This achieves an effect which corresponds to the actuation and holding of the space key in the prior art not documented in printed form. But in the state of the art only a left-right shift is offered, which is really only suitable for a few characters, but does not allow the user to edit multi-line texts. The controller is preferably designed to return to the input state at the end of the selection state.

The controller is preferably designed to move the screen content in a movement state. This is advantageous, for example, in card applications. The controller is preferably designed to slide a card through under a screen section as desired. The controller is preferably designed to have these movements carried out only upwards and downwards or to the right and left in the reading or viewing state, diagonal movements being prevented. As a result, clear instructions can be given to the programs after the transformation, even if the

Movements on the touch sensor itself are not carried out as precisely. Any movement can be carried out in the movement state or, for example, a card with two controlling ones

Fingertips are rotated or zoomed by pushing together and apart two controlling fingertips in the map view, the touch sensor detects the controlling fingertips. in the

The control system therefore has virtually no control over the state of motion. The control lies rather with the application, because all movements on the

Touch sensor passed to the controller as if they were entered on the screen, but the controller is preferably designed to transform the movements according to the reference line.

The invention further relates to a method for controlling an electronic device with a screen, a touch sensor, which a has a touch-sensitive sensor surface arranged at a sensor level, comprising the following method steps:

- detecting movement of a fingertip on the sensor surface;

- Comparison of the detected movement of the fingertip with a movement in the sensor area stored in a memory

Reference line, and from it determining a relative movement of the

Fingertip opposite the reference line;

- Generation of control commands depending on the determined

Relative movement of the fingertip; and

- Control information displayed on the screen

according to the control commands.

Comments made on the electronic device apply to the

Procedures corresponding to and statements made regarding the procedure apply accordingly to the electronic device.

The electronic device has the screen, the touch sensor with the touch-sensitive sensor surface arranged in the sensor plane and the control. To operate the electronic device, the hand of the user used to operate the electronic device is preferably freely positioned over the touch sensor, the holding fingers being used to stably fix one or more controlling fingertips over the touch sensor. This ensures a finely granular, precise control at all times. In order to optimally convert the hand position defined by the fixation point into control commands, the reference line is preferably stored with the rest point in the memory. As a result, the movements of the controlling fingertips on the sensor surface relative to the reference line with rest point can be represented in movements on the screen in relation to the main axis with a freely positionable fixed point. Known one and two finger gestures such as moving and zooming are preferably imaged on the touch sensor by the controller directly on the screen, while the user can use certain two-finger gestures to influence the controller and the Differentiate mapping of movements on the touch sensor so that on the screen almost complete control of all

necessary screen operations is enabled. To carry out the method, it is not necessary for the user's hand to hold the touch sensor. It is sufficient if the hand is fixed over the touch sensor so that the controlling finger or fingers are stabilized so that they can work in a correspondingly fine granular manner. This is particularly important in conditions where only one hand is available, because it is precisely other physical activity that causes restlessness.

The invention further relates to one or more computer-readable media with instructions which can be executed by a computer and which, when executed, implement a method with the following method steps:

- Detect movement of a fingertip on one in one

Sensor level arranged touch-sensitive sensor surface of a touch sensor;

- Comparison of the detected movement of the fingertip with a movement in the sensor area stored in a memory

Reference line, and from it determining a relative movement of the

Fingertip opposite the reference line;

- Generation of control commands depending on the determined

Relative movement of the fingertip; and

- Control information displayed on a screen

according to the control commands.

The statements made regarding the electronic device and the method apply accordingly to the one or more computer-readable media. Exemplary embodiments of the invention are shown purely schematically in the figures and are described in more detail below. It shows schematically and not to scale 1 shows a plan view of an electronic device according to a first embodiment;

2 shows a plan view of an electronic device according to a second embodiment; and

Fig. 3 is a plan view of an electronic device according to a third embodiment.

1 shows a top view of an electronic device according to a first embodiment. The electronic device has a screen 10 and a touch sensor 2 with a touch-sensitive sensor surface 21 arranged in a sensor plane. The touch sensor 2 is designed to detect movements of one or two controlling fingertip (s) 41 of a hand 4 of the user (not shown) of the electronic device on the sensor surface 21. Further, holding fingertips 42 of the same hand 4 are used at the same time to fix the controlling finger 43 over the sensor surface 21. The electronic device also has a controller 3, which is connected to the screen 10 and the touch sensor 2 wirelessly or by cable. The controller 3 is designed to generate control commands depending on the detected movement and the information displayed on the screen 10 in accordance with the

Control commands. Furthermore, the controller 3 is designed to compare the detected movement of the controlling fingertips 41 with a reference line 5 stored in a memory (not shown) running in the sensor surface 21, and to compare the control commands as a function of a relative movement of the fingertip 41 relative to the reference line 5 determined in this way to create.

The electronic device is constructed in several parts and has several devices. One device is designed as the screen 10, which is equipped with the required electronics (not shown). The screen 10 is

trained to be insensitive to touch. Another device is than that

Touch sensor 2 formed, which is equipped with the required electronics (not shown) and has one or more sensor units. Yet another device is designed as the controller 3, which with the required hardware and software. In addition to their stated function, all of the devices mentioned can have further functions and can accordingly be further configured. For example, the device having the controller 3 is designed as a computer which has one or more computer-readable media with instructions which can be executed by the computer and which, when executed, implement the following method.

In operation, the following procedure is used to control the electronic

Device performed: First, a movement of the controlling

Finger tip 41 detected on the sensor surface 21. Then the detected movement of the controlling fingertip 41 with that in a memory

reference line 5 stored in the sensor surface is compared and a relative movement of the controlling fingertip 41 with respect to the reference line 5 is determined therefrom. Control commands are then generated as a function of the determined relative movement of the controlling fingertip 41. Then, information displayed on the screen 10 is controlled according to the control commands.

During the execution of the method, the holding fingertips 42 of the hand 4 are used to control the finger 43 over the sensor surface

21 to fix. They are bent except for an index finger, which can mutate into a controlling finger during the operation of the electronic device, so that the controlling fingertip 41 is fixed above the sensor surface 21. This enables the user to perform movements in a more granular manner.

2 shows a top view of an electronic device according to a second embodiment. The electronic device shown in FIG. 2 corresponds to the electronic device shown in FIG. 1 with the

Difference that the screen 10, the touch sensor 2 and the controller 3 are integrated in a device that is designed as a mobile phone. The

Mobile phone has a mobile housing (not shown). The screen 10 is on a front side of the housing and the touch sensor 2 on one

Arranged rear of the mobile housing. In contrast to that in FIG. 1 In the device shown, the user (not shown) operates the mobile phone with two controlling fingertips 41, namely the index finger and a middle finger.

3 shows a top view of an electronic device according to a third embodiment. The electronic device shown in FIG. 3 corresponds to the electronic device shown in FIG. 1 with the

Difference that the user holds the touch sensor 2 in the hand 4, so that the holding fingers 42, the touch sensor 2 embrace and thus the controlling fingers 43 in the form of the index and middle fingers above the

Fix sensor surface 21.

In addition, the controller 3 is designed to carry out an automatic calibration, in which information on the position of the hand 4 and / or on (r) support position (s) of the controlling fingertip (s) 41 and / or on the basis of information acquired by means of the touch sensor 2 and / or by means of motion sensors determined information for the orientation of the touch sensor 2, the reference line 5 and a rest point 6 are determined and stored in the memory (not shown). The controller 3 is also designed to generate the control commands for a page guidance of a page generated on the screen 10 and / or for a cursor guidance of a cursor (not shown) generated on the screen 10, wherein a detected movement parallel to the reference line 5 to one Lateral guidance and / or cursor guidance leads along a main axis 11 of the screen 10.

Finally, the movements of the controlling fingertips 41 on the sensor surface 21 relative to the reference line 5 with the rest point 6 are free in movements on the screen in relation to the main axis 11

positionable fixed point 12 shown. This allows known one and two-finger gestures such as moving and zooming on the

Touch sensor 2 are mapped directly on the screen 10 by the controller 3. Furthermore, a root point 44 of the hand 4 is shown in FIG. 3, which represents a hand rest point and influences the hand position.

Reference symbol list:

1 device

10 screen

1 1 main axis

12 fixed point

2 touch sensor

21 sensor surface

3 control module

4 hand

41 controlling fingertip

42 holding fingertip

43 controlling fingers

44 root point

5 reference line

6 resting point

Claims

Claims:

1. Electronic device (1) with a screen (10), one

Touch sensor (2) which has a touch-sensitive sensor surface (21) arranged in a sensor plane and is designed to detect movements of one or two controlling fingertip (s) (41) of a hand on the sensor surface (21), while other, holding fingertips (42) of the same hand can be used to fix the controlling fingers (43) over the sensor surface (21), and a controller (3), which is connected to the screen (10) and the touch sensor (2), and which is designed to generate control commands from the detected movement and to control the information displayed on the screen (10) in accordance with the control commands, characterized in that the controller (3) is designed to record the detected movement of the controlling fingertips (41) with a stored in a memory in the sensor surface (21) extending reference line (5) and compare the control commands depending on such a

determined relative movement of the fingertip (41) relative to the

Generate reference line (5).

2. Electronic device (1) according to claim 1, characterized in that the reference line (5) stored in the memory extends obliquely to a side boundary of the sensor surface (21).

3. Electronic device (1) according to claim 1, characterized in that the controller (3) is formed, the control commands for a

Generate lateral guidance of a page generated on the screen (10) and / or for cursor guidance of a cursor generated on the screen (10), wherein a detected movement parallel to the reference line for lateral guidance and / or cursor guidance along a main axis (11) of the Screen (10) leads.

4. Electronic device (1) according to one of the preceding claims, characterized by a mobile housing, wherein the screen (10) on a housing front and the touch sensor (2) on one

Housing rear of the mobile housing is arranged.

5. Electronic device (1) according to one of the preceding claims, characterized in that the touch sensor (2) is designed as a touchpad or touchscreen.

6. Electronic device (1) according to one of the preceding claims, characterized in that the controller (3) is designed to carry out a calibration, in which a means of

The basic movement of the fingertip (41) on the sensor surface (21), the reference line (5) is determined and stored in the memory.

7. Electronic device (1) according to one of the preceding claims, characterized in that the controller (3) is designed to carry out an automatic calibration in which information on the position of the hand and / or on () detected by means of the touch sensor (2) r) support position (s) of the controlling fingertip (s) (41) and / or the reference line (5) and resting point (6) determined from information determined by means of movement sensors for orienting the touch sensor (2) and stored in the memory.

8. Electronic device (1) according to one of the preceding claims, characterized in that the controller (3) is designed to support a plurality of control states in such a way that the control commands as a function of the determined relative movement of the fingertip (41) and as a function of one Control state are generated.

9. Electronic device (1) according to claim 9, characterized in that the touch sensor (2) is designed by means of the controlling Finger tip (s) (41) on the sensor surface (21) to detect gestures, the controller (3) being designed as a function of the detected gestures from one control state to another

Change control state.

10. Method for controlling an electronic device (1) with a screen (10), a touch sensor (2), which has a touch-sensitive sensor surface (21) arranged in a sensor plane, comprising the following method steps:

- Detecting a movement of a fingertip (41) on the sensor surface

(21);

- Comparing the detected movement of the finger tip (41) with a reference line (5) stored in a memory in the sensor surface (21), and determining a relative movement of the finger tip (41) with respect to the reference line (5);

- Generation of control commands depending on the determined

Relative movement of the fingertip (41); and

- Control information displayed on the screen (10) according to the control commands.

1 1. One or more computer readable media from a computer

executable instructions which, when executed, implement a method with the following method steps:

- Detecting a movement of a fingertip (41) on a touch-sensitive sensor surface (21) of a touch sensor (2) arranged in a sensor plane;

- Comparing the detected movement of the finger tip (41) with a reference line (5) stored in a memory in the sensor surface (21), and determining a relative movement of the finger tip (41) with respect to the reference line (5);

- Generation of control commands depending on the determined

Relative movement of the fingertip (41); and - Control information displayed on a screen (10) according to the control commands.