AT519427A1 - Method for controlling a data processing system - Google Patents

Abstract

The invention relates to a method for controlling a data processing system (5) with a position-resolving touch-sensitive input surface (1) and any number and type of input objects, wherein at least one input object is an input device (2) comprising a contact sensor (3) and an inertial sensor (3). 4).

Description

description

The invention relates to a method for controlling a data processing system with a position-resolving touch-sensitive input surface and any number and type of input objects, at least one input object being an input device which has a contact sensor and an inertial sensor.

A data processing system in the sense of this document is a device which processes input signals from input devices and uses them to generate data or output signals for output devices.

An input surface in the sense of this document is a device that is touch-sensitive, that is, senses touches or approaches of objects, and is position-resolving, that is, detects the positions at which the objects are approached, or the touches take place, and this information in the form of a signal sends a data processing system.

An input object in the sense of this writing is any object whose contact or approach is perceived by the input surface.

An input device in the sense of this document is any object, the contact or approach of which is perceived by the input surface and which additionally has a contact sensor and an inertial sensor.

A contact sensor in the sense of this document is a sensor that already detects the approach of the input device to a surface or only detects the touch of the surface by the input device.

An inertial sensor in the sense of this document is a sensor that detects the relative movement of the input device in space in or around at least one spatial direction, for example in the form of acceleration.

/ 39

page 1

J 582

US2016139690A1 shows an input device, in the form of an input pen, which can have, among other things, a contact sensor and an inertial sensor, the input device being able to be used on a position-resolving touch-sensitive input surface for data input. Paragraph [0069] states that multiple styluses can be used to communicate with the sensor data of the inertial sensors or devices

To be able to control applications. However, US2016139690A1 does not describe a solution as to how a distinction can be made in the case of input with several input objects on a position-resolving touch-sensitive input surface, which input object is responsible for which touch point on the input surface.

US2014146021A1 also shows an input device in

Form of a stylus, which includes a contact sensor and a

Can have inertial sensor. Paragraph [0031] states that multiple styluses can be used to transmit data to a display device. In the

US2014146021A1 also does not describe a solution, as in

Entry with several

Input objects on a position-sensitive touch sensitive

Input area can be distinguished, which input object for which

Touch point on the input surface is responsible.

US2015049022A1 describes a method for

Typing of

Data on a position-sensitive touch sensitive

Input surface with an input device in the form of a computer mouse, that is to say an input device which detects the two-dimensional movement of itself along a surface. It is proposed to compare the absolute two-dimensional movement signal of a point of contact on the input surface and the relative two-dimensional movement signal of the computer mouse to determine whether these movements are identical.

A disadvantage of using an input device in the form of a

Computer mouse, both in the case of an optical mouse or one

Ball mouse, is that its sensor for detecting the relative / 39

Page 2

J 582

Movement is prone to damage or soiling and / or some surfaces fail to accurately capture the

Allow relative movement.

The object on which the invention is based is to create a method based on US2015049022A1 to enable the simultaneous use and differentiation of several identical input devices when controlling a data processing system with any position-resolving touch-sensitive input surface, ident in this context meaning that whose identity cannot be determined solely from the signals of the position-resolving touch-sensitive input surface, without having to equip the input devices with the functionality of a computer mouse as suggested in US2015049022A1.

To solve the problem, it is proposed to equip each input device with a contact sensor, for example mechanically, capacitively or optically, and inertial sensor, preferably in or near a tip of the input device, and to continuously send the data from these sensors to the data processing system, with the positions also of all touch points which the position-resolving touch-sensitive input surface perceives, are continuously sent by it to the data processing system and for each perceived touch point and for the data sent by an input device, the probability with which this data is correlated is calculated, first determining whether there is a temporal correlation of the occurrence of a signal from the contact sensor of one or more input devices with the occurrence of one or more contact points and, if so, with what probability the course of a calculus is determined guide point on the position-resolution touch-sensitive input surface and the course of the detected from the inertial motion of a spatial / 39

Page 3

J 582

Input devices the same or

describe a correlating movement.

The assignment of input objects and

Input devices can be made according to the following scheme:

As soon as the data processing system shows up a

Perceives contact point on an input surface, this determines whether within a short time before or after

If the contact point appears, the contact sensors of one or more input devices have been or are becoming active. If so, the possible combinations of points of contact on the

Input area and touch signals from contact sensors saved. The following options are available:

There is no temporal correlation of a touch signal from a contact sensor with the appearance of a touch point, then the touch point is treated as a "no-pen touch", that is to say as not caused by an input device.

The appearance of exactly one point of contact on the input surfaces correlates in time with exactly one touch signal from a contact sensor, then this point of contact can be treated as a “pen touch”, that is to say as caused by an input device.

If there are several temporal correlations between the appearance of touch points on the input surface and the appearance of touch signals from contact sensors, every possible correlation combination becomes one

Probability value assigned, which indicates how likely it is that an input device with the

Correlation combination associated contact sensor a

Input surface on the

Touched the place where the

Correlation combination associated

Point of contact has appeared. In this

In this case, steps a-c are carried out.

a. The probability value of each correlation combination is subsequently in very short, for example / 39

page 4

J 582 updated regularly, intervals. For this purpose, on the one hand the data of the contact sensor belonging to the correlation combination are compared with the activity of the contact point belonging to the correlation combination, on the other hand the movement data of the inertial sensor belonging to the correlation combination is compared with the movement trajectory of the contact point belonging to the correlation combination. If there is a high match of the matched data, the probability value of the correlation combination increases, otherwise it decreases.

b. After each update of the probability values for all occurring at a time

Correlation combinations will be every possible

Correlation combination whose value drops below a certain threshold is deleted and / or the point of contact of that correlation combination whose

Probability value increases by a certain factor above the probability value of all competing correlation combinations, treated as "pen touch", as well as the competing ones

Correlation combinations deleted.

c. It is then checked for each contact point whether there are still possible correlation combinations. In the event that there is none, the point of contact is treated as a “no-pen touch”. If there is exactly one, the point of contact is treated as a “pen touch”.

Correlation combination is to be understood as a possible combination of input device and contact point. The number of correlation combinations results from the number of touch points multiplied by the number of touch signals whose occurrence correlates in time.

With a time correlation of the occurrence of three

Points of contact on the input surface and two / 39

page 5

J 582

Touch signals from input devices are six possible correlation combinations.

competing

Are correlation combinations

Correlation combinations, which are an input device or a

Have a point of contact in common, so that they compete

Exclude correlation combinations from each other.

For example, one of two possible

Input devices one of three possible

Points of contact assigned as "pen-touch" then stand for the second

Input devices only two possible

Points of contact to

Available. One correlation combination was therefore confirmed and three competing ones

Correlation combinations deleted, leaving only two possible

Correlation combinations remain.

Advantageous of the figurative

Invention is that the

Input devices, even if they do not have the functionality of a

Have computer mouse, with each other and from others

Input objects can be distinguished.

The

Input devices can therefore be of a simpler construction than one

Computer mouse, especially a closed and therefore dirt-resistant

Housing.

The present invention thus advantageously enables

Differentiation of input devices, such as from the

US2016139690A1 and US2014146021A1 known, among themselves and from other input objects when inputting one or more input surfaces and therefore the different treatment of the inputs of different input devices and input objects.

The invention is illustrated with the aid of drawings of exemplary embodiment variants according to the invention:

Fig. 1: shows schematically the components that are required to implement the method according to the invention.

Fig. 2: schematically illustrates the inventive

Procedure in which the signals are represented using / 39

page 6

J 582 which the data processing system assigns input devices to points of contact.

Fig. 3: shows schematically the through the

Data processing system assigned assignment of input devices to points of contact, based on the signals obtained in FIG. 2.

Fig. 4: shows schematically three occurring simultaneously

Touch points on the input surface and the signals of the touch sensors from two input devices at the time of the occurrence.

5: shows schematically the times of the disappearance of the three simultaneous contact points on the input surface and the signals of the touch sensors from

two input devices Points of contact. according to Versc hwinden all Fig. 6: shows schematically the by the Data processing system made assignment of

Input devices for points of contact, based on the signals obtained in FIGS. 3 and 4.

7: shows schematically a variant using an optical sensor in the input device.

1 schematically shows the system which is required to implement the method according to the invention. The system comprises a touch-sensitive, position-resolving input surface 1, which can be in the form of a touchpad or a touchscreen. The input surface 1 is capable of recognizing several touch events at the same time. Such an input area is referred to as a multi-touchable input area. The touch event can be triggered when an object touches the input surface, or as soon as the object approaches if the object is less than a certain distance from the input surface.

The system further comprises an input device 2, which has at least one touch sensor 3 and at least one inertial sensor 4/39

Page 7

J 582. The contact sensor 3 supplies a signal which indicates that the input device 2 is resting on a surface at the end at which the contact sensor 3 is arranged. As an alternative or in addition, the contact sensor 3 can already provide a signal before touching it, which indicates that the input device 2 is in the immediate vicinity of a surface, that is to say it is less than a certain distance from the surface. The contact sensor 3 can work, for example, according to the mechanical, capacitive or optical principle.

The inertial sensor or at least

Accelerations records accelerations or rotation rates in a spatial axis. The inertial sensor 6 detects in at least one preferably two or particularly preferably all three spatial directions. The inertial sensor 6 preferably also detects

Yaw rates by at least one, preferably at least two or particularly preferably all three

Spatial directions. The inertial sensor 6 can particularly preferably be used as an inertial sensor

Measuring unit for recording the six possible kinematic

There are degrees of freedom, comprising three orthogonal to each other

Acceleration sensors (translation sensors) for the detection of translational

Movement in x or y or z axis and three orthogonal to each other

Rotation rate sensors (gyroscopic

Sensors) for the detection of rotating (circular) movements in x or y or z-axis.

The inertial sensor 6 is preferably located as close as possible to the end or tip with which the input device 2 contacts the input surface 1, so that the movement perceived by the inertial sensor 6 corresponds as exactly as possible to the movement of the tip of the input device 2 and thus that of the input surface 1 corresponds to the detected movement of the point of contact.

The system further comprises a data processing system 5, which receives and processes the signals from the input surface 1 and the input devices 2.

The system can preferably also have at least one additional one

Include input device 6, which like the input device 2/39

page 8

J 582 at least one contact sensor 7 and at least one

Has inertial sensor 8.

In addition, the system can include any number of further input objects, which can also be equipped with sensors or can be present without sensors and which are perceived by the touch-sensitive, position-resolving input surface 1 when touched or approached. These further input objects include in particular the fingers of users of the system.

A trajectory 9 of a point of contact is shown on the input surface 1. The problem on which the present invention is based is that the data processing system 5 cannot determine which input object caused the movement path without further information. This problem is irrelevant for the known control of applications, since this does not assign different meanings to the input with different input objects. For example, it makes no difference whether a file is opened on a touch screen with a stylus or with a finger.

The solution to the problem according to the invention provides that an input device 2 is used for the input, which has a contact sensor 3 as a proximity or touch sensor and a sensor for detecting relative movements in space, for example at least one inertial sensor 4, the data processing system 5 being used for assignment first checks whether the movement path 9 has appeared on the input surface 1 at the same time as the signal from the touch sensor 3. Since even in this case an incorrect assignment is possible, namely if the input device 2 is placed on any surface at the same time as another input object on the input surface 1, the second step is to check whether the movement path of the input device 2 is identical to the movement path 9 can be what the signal of the inertial sensor 4 and the signal of the input surface 1 are compared. When using only one / 39

Page 9

J 582

Input device 2 could be omitted from the second step, since it seems unlikely that input device 2 will be placed on another surface at the same time as any input object on input surface 1. However, the second step is in any case for a clear assignment of input device 2 to one Touch point is particularly valuable if a large number of input objects are used simultaneously for data input on the input surface 1, since in this case it can often happen that input objects are placed on the input surface 1 at the same time or in a timely manner.

FIG. 2 illustrates a situation in which two input devices 2, 6 are used, which send the data of their contact sensors 3, 7 and the data of their inertial sensors 4, 8 to the data processing system 5. In addition, an input surface 1 is used, which sends the position data of contact points to the data processing system 5.

In the example of FIG. 2, the input surface 1 detects three contact points that occur simultaneously at the time t ₀ . Due to the temporal correlation of the occurrence of three touch points on the input surface and two touch signals from input devices, the number of possible correlation combinations is six. The objects are shifted differently (in terms of acceleration, speed and / or direction) up to the point in time of the snapshot in FIG. 2 along the surface of the input surface 1. The displacement of the touching objects on the input surface 1 results in a displacement of the touch points, which results in a movement path 9, 10, 11 in the plane of the input surface 1 for each touch point. Since the input surface 1 only transmits the trajectories 9, 10, 11 of the points of contact, the data processing system 5 cannot determine which object has caused which point of contact.

By using the input devices 2, 6, the data processing system 5 also receives the movement data of the inertial sensors 4, 8 of the respective input device 2, 6. The / 39

Page 10

J 582

Input device 2 covers, for example, a movement path 12 in space, the inertial sensor 4 detecting at least the acceleration along a direction of the input device 2. The second input device 6 covers, for example, a path of motion 13 in space, the inertial sensor 8 detecting at least the acceleration along a direction of the second input device 6. The inertial sensors 4, 8 detect, for example, at least accelerations in a spatial direction, which is shown by the arrow, starting from the respective inertial sensor 4, 8. If the inertial sensors 4, 8 measure accelerations in only one or two spatial directions, these spatial directions are preferably in a plane at an angle of 90 ° to the longitudinal direction of the input device 2, 6, which extends from the tip to the end thereof. Since the longitudinal direction of the input device 2, 6 is at least not aligned at an angle when touching a surface, there is a reference of the sensor signal of the inertial sensor 4, 8 along the spatial direction mentioned and the movement path of contact points detected by the input surface 1.

In addition, the data processing system 5 receives the signals from the contact sensors 3, 7 of the two input devices 6. These also, for example, also deliver a signal at the time t ₀ , after which they touch a surface, that is to say at the same time as the contact points on the input surface 1.

The data processing system 5 is not able to uniquely assign an input device 2, 6 to a touch point at the time t0, since each input device 2, 6, whose contact sensor 3, 7 supplies a touch signal at the time t0, could be placed at every touch point occurring at the time t0 ,

In the method according to the invention, when at least one touch point occurs on the position-resolving touch-sensitive input surface 1 and / or each time a touch signal from a contact sensor 3, 7 occurs, one or more input devices 2, 6 occurs in the first step / 39

Page 11

J 582 determined whether a temporal correlation of the occurrence of a

Touch signal of a contact sensor 3, 7 one or more

Input devices 2, 6 with the occurrence of one or more

Touch points are present on the position-resolving touch-sensitive input surface 1.

Since this requirement is met, in a second step it is determined for all signals that have occurred at very short intervals, with what probability the temporal course of a touch point, i.e. the respective movement path 9, 10, 11, on the position-resolving touch-sensitive input surface 1 and the course of a movement detected by an inertial sensor 4, 8, i.e. a spatial movement path 12, 13 of an input device 2, 6 or at least a component thereof, describe the same or a correlating movement, or in other words, a probability value is determined for each possible correlation combination in very short time intervals and compared with the probability values of all other correlation combinations.

In the third step, an input device is assigned to a point of contact if the probability that the time course of a point of contact, i.e. the respective trajectory 9, 10, 11, and the course of the movement detected by the inertial sensor 4, 8, i.e. a trajectory 12, 13 of one Input device 2 describe the same or a correlating movement, exceeds a threshold value, or the probability value of a correlation combination is a certain threshold value greater than that of all competing correlation combinations.

In the example in FIG. 2, the movement path 9 on the input surface 1 correlates with the spatial movement path 12 of the input device 2 from the starting time t ₀ , so that the data processing system 5 can uniquely assign the input device 2 to the point of contact with the movement path 9.

In the example in FIG. 2, the movement path 10 correlates on the / 39

page 12

J 582

Input surface 1 with the spatial trajectory 13 of

Input device 6 in

Space so that the data processing system 5 can clearly assign the input device to the point of contact with the movement path 10. The time at which this is unique

Allocation can be done is variable and depends on

Course of

Signals and the calculated from them

Probability values of all possible

Correlation combinations.

Since none of the spatial trajectories 12 with which

Movement path 11 correlated on the input surface 1, this is

Path of motion 11 through the data processing system 1

Assigned meaning of any input object 14, which of the touch events by

Input devices 2, 6 can be clearly distinguished.

If there are several points of contact due to any further input objects 14 which themselves have no sensors, the data processing system cannot distinguish which of these input objects 14 is located at which position. However, the input devices 2, 6 and each further input device 2, 6 can still be uniquely assigned to a touch event.

By unambiguously assigning input devices 2, 6, ie a meaning “pen touch to touch paths 9, 10 and assigning the meaning“ touch or not caused by input devices, or “no-pen touch to all further touch paths 11,” the data processing system according to FIG. 3 determine the actual arrangement of objects on the input surface 1 and thus assign a different meaning to the inputs of each input device 2, 6.

For example, the first input device 2, through a control rule stored in the data processing system 5, can be assigned to a first user, to whom the data processing system has a different function than the user to which the data processing system 5 assigns the second input device 6. In addition, of course, to / 39

Page 13

J 582

Input devices 2, 6 and other input objects 14 have different control rules stored in the data processing system 5, so that, for example, inputs can only be made with input devices 2, 6 and inputs with other input objects 14 are ignored by the data processing systems 5. In this way, incorrect entries can advantageously be recognized and avoided by unintentionally touching the input surface 1. An example of this is the unintentional touch by the ball of the hand (palm touch), which can be clearly distinguished from inputs with input devices 2, 6 by the present invention.

4 to 6 show an additional identification option, which advantageously takes place in parallel or in addition to the identification described above. For each touch event, in addition to the start time t _{0 of} the touch with the end time of the touch, there is another characteristic time which can be used to identify the input devices 2, 6. This is particularly helpful when short-term entries are made without moving the input objects, as is the case, for example, when clicking on icons or buttons. In this case, the input surface 1 registers no movement of the touch point. 4, if several contact points 15, 16, 17 occur on the input surface 1 at the same time as the time to and one or more contact sensors 3, 7 give a signal at the time t ₀ , after which they are on a surface, then at time t ₀ for the data processing system 5 it is not recognizable whether one and which one

Input device 2, 6 has caused a contact point 15, 16, 17. Detect neither the input surface 1 nor the

Inertial sensor 4, one or both input devices 2, 6 subsequently one

Movement, then no assignment can be made.

In this case, the

Assignment of input devices

2, 6 to

Points of contact 15, 16, 17 over the respective

The point in time at which the contact points 15, / 39

Page 14

J 582

16, 17 and the touch signals of the touch sensors 3, 7 disappear again. 5 shows the signal curve of the contact sensors 3, 7 of two input devices 2, 6 below the input surface 1. In the example of FIG. 5, the touch signal of the touch sensor 3 of the first input device 2 disappears and the touch point 17 disappears at the time t ₁ . The disappearance of the touch signal of the touch sensor 7 of the second input device 6 and the disappearance of the touch point 16 take place at the same time t ₃ . The disappearance of the touch point 15 does not coincide with the disappearance of a touch signal from a touch sensor 3, 7. As shown in FIG. 6, the data processing system 5 can assign the input device 2 to the contact point 17 from the time t ₁ and an input object 14, which is not defined in more detail, from the time t _{2 to} the touch point 15. From the time t2, the input device 6 can with high probability Touch point 16 are assigned, wherein the simultaneous disappearance of the touch signal of the touch sensor 7 of the second input device 6 and the disappearance of the touch point 16 can be used as confirmation of the assignment that may have already taken place.

It should be noted that in the example of FIGS. 4-6, too, the movement path of the touch point 17 detected by the input surface 1 correlates with the movement path of the input device 2 and the movement path of the touch point 16 detected by the input surface 1 correlates with the movement path of the second input device 6 correlated. However, the spatial trajectories of the input devices 2, 6 correlate with each of the trajectories of the contact points 15, 16, 17 up to a certain point in time t ₁ .

However, the correlation of the movement path of the input device 2 with the movement paths of the contact points 15 and 16 ends at any time t ₁ , the correlation of the movement path of the second input device 6 with the movement path / 39

Page 15

J 582 of the contact point 17 ends at time t ₁ . Specifically, the inertial sensor 4 of the input device 2 registers a movement at the time t ₁ , while the contact points 15 and 16 do not continue to move, so that the input device 2 can also be clearly assigned to the contact point 17 on the basis of the movement registered by the inertial sensor 4.

In general, it can therefore be stated that the trajectories of all points of contact on the input surface 1 occurring at the same time are compared with the trajectories of all input devices 2, 6 applied to a surface at the same time until a contact point is assigned to each input device 2, 6 with sufficient probability can, or with sufficient probability, the correlation with each point of contact can be excluded. If no assignment has been made until a contact point disappears, the further course of the signal of the inertial sensor 4, 8 and / or the absence of the touch signal of the contact sensor 3, 7 can be used to subsequently determine the correlation or to confirm the absence of a correlation , Which touch events are evaluated as simultaneous depends largely on the measurement frequency and transmission rate of the input surface 1 and the input devices 2, 6, so that all touch points of the input surface 1 and touch signals of the contact sensors 3, 7 occurring within a certain time period are treated as simultaneous. All touch points and touch signals occurring within a period of time, which potentially reflect the same touch event, are said to be time-correlating.

A preferred embodiment variant provides that a plurality of input surfaces 1 are present, wherein a plurality of input surfaces 1 can be connected to a data processing system 5, or each input surface 1 has its own data processing system 5, these data processing systems 5 advantageously / 39

Page 16

J 582 are connected to each other via intranet or internet, radio, LAN or WLAN.

The inventive method is one or more

Data processing systems can determine which

Input area 1 from which input device

2, 6 is touched.

Should be several

Data processing systems are present, it is advantageous if the input device 2, the

Signals their

Inertial sensors 4, 8 and their touch sensor

3, 7 transmit wirelessly to the data processing systems 5, for example

For example yours with radio or WLAN. in addition to the signals touch sensor 3, 7 a

Serial number or data processing equipment 5

Data processing systems 5

Control regulation can assign meaning to everyone. Input devices 2 the meaning can be input devices 2, 6

Inertial sensors 4, 8 and their unique identifier are transmitted to the like a digital signature, so that according to a stored input device 2, 6 an individual

For example, one of an administrator input device can be assigned, with which of all existing ones

Data processing systems 5 by simply touching or moving the input device 2 on the input surface 1, registration and full access to all functions can take place. On the other hand, a conventional user can be assigned to an input device 2, so that this user can, for example, provide full access to his data processing system 5 and only has the functions and / or drives released for him available in other data processing systems 5.

It is advantageously possible to record and store which inputs 2, 6 with which inputs on which

Data processing systems 5 were made.

On each data processing system 5, applications or

Programs are executed that have both inputs with a

Input device 2, as well as inputs by any unidentifiable

Process input objects and treat them differently.

For example, / 39

Page 17

J 582

Input devices 2, 6 can be used to draw or free

Hand writing while other icons or input objects

Can select objects and / or can rotate or zoom views or objects.

Any input device

2, 6 can further sensors,

Button or

Have switches so that the data of the sensors and states of the buttons or

Switch a touch point on the

Input area 1 can be assigned. For example, by pressing a button on the input device 2, a virtual color can be selected with which the

Input device 2 is drawn on the input surface 1.

For example, an input device

2, 6 a biometric

Have a sensor like a fingerprint scanner, so that this itself

Can identify users or

the

Data processing system 5 from the data of the biometric

Sensor can determine the user.

Preferably at

Using a

Touchscreens as

An individual input area 1 after identification or assignment of the input devices 2 to points of contact

Input marking (cursor or mouse pointer) for each

Input device at the respective

Point of contact appear for visual control of the

Allow assignment by the user. With short

The individual can

Entry mark over the

Duration of

Input can be displayed. When controlling any screen with a

Touchpad as input surface 1 can be the am

Input markings shown on the screen, which represent touch positions of input devices 2 on the touchpad, are shown individually for the input devices 2 or for the users assigned to the input devices 2.

In the figures, the input device 2, 4 is illustrated purely by way of example, this being any one

Can have shape, it being advantageous that end or

Ends with which the input surface 1 with contact sensors

3, 7 is to be touched as a tip. In the event that capacitive / 39

Page 18

J 582

Input surface are used, it is advantageous ends of the

Input device 2, on which there are contact sensors 3, 7, to be made somewhat larger, since very small peaks with a capacitive input surface are difficult to detect.

In the event that an inductive input surface should also be usable, the tip of the

Input device 2 a coil or

Conductor loop can be integrated.

If the input device rounds a wide, such as shown,

Has head with an inserted coil, this can both for

Input to capacitive

Input areas as well as for input to inductive input areas can be used. Any input objects are suitable for input on optical input surfaces (for example using total internal reflection), pressure-sensitive input surfaces or resistive input surfaces, so that the method according to the invention can be used with an input device 2 with a larger head and coil on all customary input surfaces 1.

Both the inertial sensor 4 and the contact sensor 3 are preferably mounted in a closed housing of the input device 2. The contact sensor 3 can be an inductive or capacitive distance sensor. As an alternative to the detection of touches, the contact sensor 3 can also perceive forces, for example by including strain gauges or piezo elements. The contact sensor 3 can be a button. The contact sensor 3 can be or comprise an optical sensor, for example an optical distance sensor or an intensity sensor, which is preferably mounted behind a transparent or at least partially transparent section of the housing of the input device 2.

If the input device 2 has at least one optical sensor, this can, for example, perceive the light intensity or the color of the surface to which the input device 2 is directed or on which it is applied, these data being used on a touch screen with the / 39

Page 19

J 582

Light intensity or the color of the pixels on the detected

Touch points on the touchscreen can be adjusted. For example, a distinction can be made as to whether the input device 2 is on a touchscreen. In addition, the or another surface can be used

Assignment of an input device 2 to one

Point of contact about the correlation of the

Course of

Light intensity and / or color are carried out by determining at repeated short intervals whether the

Course of the intensity or perceived by the optical sensor

Color with the

Course of the pixels shown on the touchscreen along the

Trajectory of a

Point of contact on

Touchscreen matches. The same can be done for everyone who occurs at the same time

Signals from optical sensors from input devices 2 and for all occurring simultaneously

Touch points on the touchscreen

Probability value for each possible correlation combination, which indicates which one

Probability of

Course of light intensity or

Course of the color value of an optical sensor with the

Light intensity or that

Course of

Color value on

Point of contact or along its path of movement on the touchscreen.

The assignment of the meaning “pen touch and“ nopen touch is done according to the ones already described

Criteria, depending on the increase and decrease of the

Probability values of

Correlation combinations or depending on the number of possible correlation combinations remaining after recalculation of the probability values.

This embodiment variant with an optical sensor can advantageously be implemented in addition to the method protected in the claims. For example, however, the contact sensor 3 can also be designed as such an optical sensor, so that in addition to approximation it can also acquire further information about the detected surface or can even receive signals from the detected surface.

Since, as illustrated in FIG. 7, the embodiment variant with an optical sensor 20 on the input device 21, 22 and / 39

Page 20

J 582 at least one touch screen 18 as input surface 1 is also suitable for solving the task according to the invention by itself, the applicant reserves the right to submit it at a later date as a divisional application. This embodiment variant is advantageous since each input device 21, 22 only has to have an optical sensor 20, that is to say does not need to have an inertial sensor 4 or a contact sensor 3. Instead of perceiving intensities or colors selectively with the optical sensor 20, the latter can also record a small image section, that is to say several pixels in the form of an image, the course of this image with the corresponding image sections at the positions of the contact points 15, 16, 17 on the touchscreen 18 is compared.

From the scaling of the image, this can also be done if necessary

Distance of the optical sensor 20 to the touch screen 18 can be determined. Advantageously, as shown in FIG. 17,

Detection of one or more contact points 15, 16, 17 am

Touchscreen 18 from the data processing system 5 on each

An individual light signal 19 (e.g. intensity, color, two-dimensional pattern or its temporal course) can be displayed at the contact point 15, 16, 17. The light signals 19 are detected by the optical sensors 20 of the input devices 21, 22 and sent back to the data processing system 5. Since the data processing system 5 knows which one

Touch point 15, 16, from the touch screen 18, which

Light signal 19 was shown, this can be the

input devices

21, the quick and easy way

Points of contact 15,

16, on

Assign touchscreen 18.

For example, the

Data processing system 5, the input device 21 dem

Clearly assign touch point 15, since the time profile of the signal sent from input device 21 to data processing system 5 only coincides with the time profile of light signal 19 at contact point 15. Individual light-dark, / 39 are particularly suitable as light signals 19 at the points of contact 15, 16, 17 on the touchscreen 18

Page 21

J 582 or white-black change of the pixels at the contact point 15, 16, or in a certain radius around the contact point 15, 16, or approach point, since this can be detected particularly reliably by a simple photodiode or another intensity sensor as a binary signal. The individual light signals 19 can be transmitted so subtly or briefly that they cannot be perceived by the human eye. Each touch point 15, 16, 17 can preferably be assigned an input mark (= cursor) with an individual color, so that the input markings can be distinguished both by suitable optical sensors 20 of the input devices 21, 22 and by the users.

A disadvantage of a variant with only an optical sensor 20 in the input device 21, 22 is that it can only be identified on touch screens 18 and not on touch pads. The detection of the movement or a movement component of the input device 2 in space by at least one inertial sensor 4 is therefore also useful in this variant.

In particular, the signals of the inertial sensor 4 can be used to track the movement of the input device 2 away from the input surface 1, so that after the first identification of the input device 2 at a point of contact with an input surface 1, the absolute position of the input device 2 in space can be determined or estimated, so that the extent and or the direction of the movement of the input device 2 in space can be determined or estimated whether the input device 2 can be responsible for a later point of contact on the same or a different input surface 1. For example, if the input device 2 has been assigned to a first point of contact on the input surface 1 and subsequently only acceleration in a direction of approx.

90 ° to the surface of the input surface 1 learns then is it probably, that another point of contact this Input device 2 only in near the first point of contact can occur. To the Movement of the Input device 2 in the room 23/39 Page 22

To detect J 582 as precisely as possible, it is advantageous to design the inertial sensor 4, 8 as an inertial measuring unit and, if necessary, to additionally equip it with further sensors in order to detect the orientation of the input device 2 in space in addition to relative movements. With the contact points, the input surface 1 advantageously provides the absolute position of the input device 2 at certain times, as a result of which the relative position data of the inertial measuring unit can be continuously converted into absolute positions in space in relation to the input surface 1.

/ 39

Page 23

J 582 for controlling at least one with at least one

Claims (2)

Expectations 1. Procedure Data processing system (5) Input surface (1), which is position-sensitive and touch-sensitive and of any number and type of input objects, at least one input object being an input device (2), which has a contact sensor (3) and an inertial sensor (4) and the data of these sensors is continuously on sends at least one data processing system (5), whereby the positions of all touch points that an input surface (1) perceives are continuously sent by it to at least one data processing system (5), characterized in that each time at least one touch point occurs on an input surface ( 1) and / or each time a touch signal of a contact sensor (3) of one or more input devices (2) occurs, it is determined in the first step whether a temporal correlation of the occurrence of a touch signal of the contact sensor (3) of one or more input devices (2) the occurrence of one or more points of contact on one or several input surfaces (1) is present and in a second step it is determined for all signals which have occurred at the same time, with what probability the temporal course of a contact point on an input area (1) and the course of at least one movement component of the spatial movement detected by an inertial sensor (4) Input device (2) and / or the signal curve detected by the contact sensor (3) describe the same or a correlating movement, with an input device (2) in the third step Touch point is assigned when the probability 25/39 Page 24 J 582 exceeds a threshold value that the time course of a contact point on an input surface (1) and the time course of the movement of an input device (2) detected by the inertial sensor (4) describe the same or a correlating movement. 2. The method according to claim 1, characterized in that it is further determined whether there is a temporal correlation between the disappearance of a touch signal from the contact sensor (3) of one or more input devices (2) and the disappearance of one or more touch points on an input surface (1). wherein an input device (2) is assigned to a touch point if the occurrence and disappearance of exactly one touch signal and exactly one touch point occur simultaneously. Third A method according to claim 1, characterized in that a Point of contact on the Input surface (1) as a “no-pen touch”, that is, as not through an input device 2) evoked, treated if no temporal Correlation of a Touch signal one Contact sensor (3) with the appearance of a contact point on the input surface (1). 4. The method according to claim 1, characterized in that the Appearance of exactly one touch point on one Input surfaces (1) as a "pen touch", that is, as through a Caused input device is treated, if this correlates in time only with the appearance of exactly one touch signal of a contact sensor (3) of an input device (2). 5. The method according to claim 1, characterized in that with several temporal correlations between the appearance of touch points on an input surface (1) and the appearance of touch signals from contact sensors (3) of input devices (2), any possible correlation combination 26/39 Page 25 J 582 is assigned a probability value which indicates how likely it is that an input device (2) with the contact sensor (3) belonging to the correlation combination has touched the input surface (1) at the point at which the contact point belonging to the correlation combination has appeared , whereby this probability value is subsequently updated in very short time intervals for each correlation combination, for this on the one hand the data of the contact sensor (3) associated with the correlation combination with the activity of the contact point associated with the correlation combination and on the other hand the movement data of the Correlation combination of the associated inertial sensor (4) can be compared with the movement trajectory of the point of contact associated with the correlation combination, the probability value of a correlation combination increasing if there is a high match of the compared data and otherwise it decreases. 6. The method according to claim 5, characterized in that after each update of the probability values for all correlation combinations occurring at a point in time, every possible correlation combination, the value of which drops below a certain threshold, is deleted. 7. The method according to claim 5, characterized in that after each update of the probability values for all correlation combinations occurring at a point in time, that correlation combination whose probability value increases by a certain factor above the probability values of all competing correlation combinations is treated as a “pen touch” and the competing correlation combinations to be deleted. 8. The method according to any one of claims 6 or 7, characterized in that subsequently for each point of contact 27/39 Page 26 J 582 it is checked whether possible correlation combinations present being a point of contact as "No-pen touch treated will if none available and as "pen touch treated will, if overall still exactly one possible correlation combination is present. 9. Procedure after one of claims 1 till 8, thereby characterized in that at least two input devices (2, 6) of identical construction are used for the simultaneous input of data on at least one input surface (1). 10. The method according to any one of claims 1 to 9, characterized in that a plurality of input surfaces (1) are present, the method according to the invention determining which input surface (1) is touched at which position by which input device (2). 11. The method according to any one of claims 1 to 10, characterized in that the contact sensor (3) of the input device (2) is an optical sensor (20) which the Detected light intensity or color of the surface on which the input device (2) rests with it or the input device (2) has such an optical sensor (20) in addition to the contact sensor (3). 12. The method according to claim 11, characterized in that the input surface (1) is a touchscreen (18) and the data processing system (5) at each contact point detected by the touchscreen (18) represents an individual light signal (19) which is emitted by the optical sensor ( 20) can be detected and the input device (2) sends the signal detected by the optical sensor (20) to the data processing system (5). 13. The method according to claim 12, characterized in that the data processing system (5) assigns an input device (2) to a point of contact on the touch screen (18), if that of 28/39 Page 27 J 582 optical sensor (20) detected and sent by the input device (2) to the data processing system (5) matches the light signal (19) exactly one point of contact. 14. The method according to any one of claims 1 to 13, characterized in that after the initial assignment of an input device (2) to a point of contact on the input surface (1), the location of the next point of contact occurring in time by the same input device (2) on the input surface ( 1) whose inertial sensor (4) is at least approximately determined based on the sensor signals, for which purpose the inertial sensor (4) is preferably an inertial measuring unit. 29/39 Page 28 J 582