EP1468353A2

EP1468353A2 - Flexible computer input

Info

Publication number: EP1468353A2
Application number: EP02795267A
Authority: EP
Inventors: Ralf Trachte
Original assignee: Individual
Current assignee: Individual
Priority date: 2001-12-21
Filing date: 2002-12-21
Publication date: 2004-10-20
Also published as: US7352365B2; WO2003054680A3; US20050024344A1; AU2002360079A1; WO2003054680A2; CN1606728A; CN100350363C

Abstract

The invention relates to a 'Flexible Computer Input', determined from the data from a touch-sensitive input surface for fingertip positions and pressure trigger regions in comparison with a stored topography for the input signal of a computer. The base topography (base positions of the fingertips) and the layout topography (arrangement of the target pressure points) determined therefrom, can be changed and can thus be adjusted to ergonomically match individual hands and working practices. Said topography may be dynamically altered: progressive changes may be made (for example displacements of the hands, reductions in the average separations) and allowed for, such that a matching of the inputs to individual practices occurs. (See fig 1) An input surface which is as transparent as possible displays layouts or objects and works like a touchscreen or visualised touch area . An optional fine-motor feedback can be achieved by means of a surface of elastic construction with a determined geometry. The input is suitable for simplifying various tasks by the simultaneous recognition of two (or more) fingers.

Description

Title: Flexible computer input

The "flexible computer input" described here is characterized in that it determines the final signals or characters for a computer from information about a basic position of the fingertips and from measurement data of a sensitive input surface on which the operating fingertips are located adapts individually and dynamically to hands and work habits.

The usual computer input keyboards require a discipline to hit the keys in certain lines and thus to maintain certain distances. In fact, the input of data can be adapted to individual hands and work habits, because it is only about the basic existence of distances that can be changed and adapted individually and dynamically (or gradually) while working. This results in ergonomic advantages. Especially for different hand shapes and typing habits, a quasi continuously extended touch-sensitive surface is easy and intuitive to use. With an individual and dynamically adapting occupancy topography, e.g. smaller and faster typing movements possible.

The "flexible computer input" described here consists (not of conventional keys, but) of a sensitive surface (ie an input surface consisting of a large number of input surface areas) and a software concept (ie a method). The arrangement determines the characters ( eg letter or control signals) especially in typing mode from the basic positions of the 10 fingertips ("basic topography") and from the completed printing locations. This means that due to the hand positions and hand movements or pressure triggering on a relatively smooth, sensitive input surface, the associated characters are obtained by comparison with a temporarily applicable "occupancy topography". The handling (in relation to the basic topography) is in the dynamic typing Mode, in particular, almost automatically adaptable to individual hand dimensions and typing habits, insofar as it makes ergonomic sense. (The sensitive surface can optionally also be used as a (large) trackpad, i.e. replace a mouse.)

There are three product visions, for example:

(I) Firstly, a currently common touchscreen (eg that of a "tablet PC"), which basically can only differentiate between one pressure point at a time, can be upgraded with the appropriate software to include this flexible input system (see also below, end of the description). It requires the user a certain discipline to put your fingers on one after the other.

("Simple touch-screen vision")

(II) Secondly, a touchscreen (for example that of a "tablet PC") can be supplemented in the lower area by a flat sensor that can process several finger positions at the same time Optical quality is somewhat deteriorated there by adding, for example, a fine sensor matrix, but is sufficient to display the occupancy topography. (Because these light, small PC types usually don't have a conventional keyboard anyway, they can also use this ergonomically and individually adaptable, flexible input.) ("Touch-screen-like vision")

(III) Thirdly, a relatively smooth sensitive input surface can be used as a separate keyboard or Input unit can be used to the computer. A certain translucency of the surface is sufficient to display the occupancy topography (or the objects). Optionally, fine motor feedback e.g. are produced by the elasticity of the control surface with a certain cross-sectional profile (use of toggle lever effects) ("visualizing-touch-surface vision")

This "flexible computer input" is characterized, among other things, by the fact that the processor has a "basic topography" of the fingertips, from which a "occupancy topography" can first be inferred by scale-like projection, and that each measured pressure trigger location (or actuated input area) is compared with the temporarily applicable "occupancy topography". From this relation, the intended sign either results directly. Or it may be necessary (e.g. if the sensitive input surface is only raster-meshed) to identify (by processor) the active finger and the associated character (or the associated command) can then be determined. This relation or identification to be queried relates primarily to the hand topography (or fingertip topography, shown as 10 circles in Figure 1).

Certain inputs, which are processed by a microprocessor or a corresponding EDP unit, are used to trigger the signal for a specific character (e.g. alphanumeric or control characters). For the final triggering of the character signal or control signal, the processor uses in particular the information (a) for triggering pressure or actuation of the input surface areas, (b) for identifying the location of the fingertips and (c) for the basic and occupancy topography.

(a) The actuation or pressure release with certain force and speed characteristics can be measured on a quasi-continuous (e.g. mechanical, electro-mechanical, electrostatic, electronic or magnetic) sensitive area. - (This means in particular that the time gradients of the signals analogous to the force and the signals analogous to the speed should reach values. This means, for example, that unintentional support with fingers other than the currently active finger can be filtered out, because this would result in a relative static value) ,

(b) The identification of the location of the print trigger on the sensitive surface leads, for example, to the location description using a grid of coordinates. Such coordinates can be determined for several fingers at the same time, for example on the basis of a technically modified sensitive surface (possibly using two different sensitive methods, for example a video image of the contours). The current positions of additional fingers can thus be determined. (Technical possibilities exist, for example, through a touchscreen, touchpad, foil surfaces, other mechanically, electrically, electrostatically or magnetically sensitive surfaces. An existing "5-wire resistance technology" could, for example, by a "6-wire resistance technology" Development and additional information about pressure point and finger positions. Development work may have to be invested in this, see below for technical feasibility. While the pressure triggering only has to be localized for one finger, the positions of the other fingers should be determined quasi-simultaneously or in one triggered query procedures (eg 5 times per second for the area) can be determined).

(c) The processor always has a basic topography (or “template”) of the 10 fingertips available, which represents a basic posture of the hand. This topography is in particular in the form of the coordinates of the 10 fingertips. (There are several options for this The topography can be defined individually for each user and, on top of that, it can be dynamically adjusted. The (primary) basic topography results in a (secondary) occupancy topography that assigns certain characters to the input area areas.

The print trigger location (or the actuated input area) must be compared with the current, temporarily saved occupancy topography. From this relation, the intended sign either results directly. Or it may be necessary (e.g. in the case of indistinct work or if the input area is only roughly meshed) to optimize (by processor) the decision (compare below) or to identify the currently active finger (e.g. left hand, middle finger) and this is the reason then the associated character (or the associated command) can be determined.

This relation or identification to be queried thus relates to the occupancy topography. However, the basic topography (or fingertip topography, shown as 10 circles in Figure 1) initially provides the basis for developing a secondary occupancy topography (secondary) through scale-like projection. This occupancy topography can be described as sectors or input surface areas designated by coordinates which are assigned to a respective character or command location. The basic topography covers or determines exactly the signs of the usual basic position (for the 8 non-thumb fingers these are traditionally "A, S, D, F, J, K, L, Ö"). The next subsequent pressure point positions require a certain small deviation (shown as arrows in the drawing) in order to reach the corresponding characters. The direction of this deviation can be clearly separated for middle and ring fingers. The coordinates for index finger and little finger must be distinguished more precisely because it (in the sense of the usual system) there are several options (compare drawing). The thumb could be given a new role (eg important command functions) because it is actually underchallenged in the sense of the usual system. The further assignments are to be assigned in the sense of the assignment topography (see points C. and D. below.) A hand topography (with the adjustable limit values) always results in an occupancy topography. This "flexible input" is optionally characterized in that the positions and pressure releases of several fingers are determined and evaluated simultaneously on a sensitive input surface (see claim 2). This enables easier and flexible adjustments for the individual user. - The "flexible input" mentioned here is characterized in that it not only determines the position of one finger, but the positions of several fingers (at the same time) and, based on the positions, movements and (more or less fast) pressure releases of one, two, three or up to ten fingers on a (relatively) smooth, sensitive surface generates corresponding control signals or determines associated characters. The handling can be adapted to special tasks and thus be simplified, ergonomically sensible and “intuitively appropriate”.

The deviation of an executed printing location (or an actuated input surface area) from the starting position (corresponding to the initialized or currently stored hand topography, see Figure 1) can be interpreted in the following way and ultimately to an optimized decision for a specific signal to lead:

A.) The deviation is smaller than an (adjustable) limit (e.g. 7 mm). The location is interpreted as the starting point of the finger. There is a certain character (e.g. for the left middle finger "D")

B.) The deviation is greater than the limit. The direction of the deviation is to be interpreted on the basis of the current template (in the sense of the starting position) as an activity associated with a specific finger. If the direction e.g. deviates more than 7 mm upwards from the starting point, there is the sign "E" above the middle finger of the left hand.

C.) If the deviation (for example upwards) is still greater than a second (adjustable) limit (for example 22 mm), this is regarded as skipping a line of characters and thus leads to access to the digits (for example "3") or special commands ( which are, for example, also to the side and below the basic position.) With this mode it is sufficient to roughly hit the sector, the deviation only has to differ sufficiently from the line in front of it.

D.) The (largely) uniformly drawn input surface should have a certain transparency, if possible, to use projections or LED elements to roughly represent the current template of the local occupancy (occupancy topography). This enables the user to coordinate finger movements with the eye for more distant or hard-to-remember assignments (e.g. for special characters or commands). - This corresponds to the following decision in the processor: An operation that hits the outer locations of the current template (special characters, commands and the like) is always interpreted as a hit of these special characters.

E.) It can also in "one-finger" or "two-finger mode" (popularly "eagle search system") with this input is worked or typed, ie that the ten-finger system is exited. This can be seen when a (repeated) "transfer" of a finger to a "foreign" occupancy area takes place, which is therefore actually not assigned to this finger. Or this mode is activated if the current hand position is unclear for the processor. In this mode, the previously agreed or saved template simply applies to assign the occupancy mark to an operation, regardless of the identity of the currently active finger. (It is usually necessary to look.)

F.) Any locations that are pressed simultaneously (with two or more fingers) can be decided in the processor according to predefined probabilities or priorities ("filter options").

G.) Locations or input surface areas that are possibly indistinctly hit (for example when hitting a boundary line) can nevertheless be implemented with a high degree of probability into the intended signals or signs due to the (usually ascertainable) identity of the respective active finger. (For example, a middle finger that is moved 10 mm upwards and pushing can only mean a certain sign, even if there is lateral uncertainty).

An essential quality of this flexible input is the adaptability to individual and dynamic writing habits (compare in particular claims 1, 3, 7, 9 and 12). The temporarily stored basic topography (as a primary reference) (and thus also the resulting temporarily stored occupancy topography as a secondary reference) can be determined in the following way:

The topography could also correspond to a simple straight-line grid in the sense of conventional standard keyboards. It can e.g. can be easily varied in their longitudinal and transverse dimensions.

The topography could also be ergonomically adapted to an average hand shape through curved lines, i.e. the assignments are grouped around an average relaxed hand. In particular, this corresponds to the different lengths and possibilities of movement of the 10 fingers (see Figure 1).

Individual adjustment: The topography can, in particular, be individually determined and saved for each user by relaxed laying on of the fingers and can therefore be called up. For this purpose, all 10 fingers should be placed comfortably and calmly on the surface once (for example, for two seconds simultaneously as an initiating symbol for the calibration. This applies to the technically more complex variant, which can record several pressure points simultaneously). - In the technically simple variant, which can basically only record one pressure point location at a time (as is currently the case with touchscreens), all 10 fingers should be typed one after the other roughly into the basic position for calibration. - From this "basic topography", a "scale topography" also results in the "occupancy topography", for example, in that the distances to the other lines of the "occupancy topography" are proportional to the distances between the fingertips of the "basic topography"" be determined. Dynamic adjustment: The topography (basic and occupancy topography) as well as the work parameters and limit values can be adjusted gradually or dynamically, especially while working. In other words, in this mode, the average location or pressure points realized by the fingers, ie the average basic positions of the 10 fingers or the occupancy topography, are continuously recorded. Any gradual shifts and possible gradual changes in the average line distances are noticed and corrected if necessary. (For example, measurements can be taken five times per second and averaged over the last 20 seconds or averaged over the last 20 keystrokes of a certain input area). As a result, the user can gradually vary their personal hand position, writing and typing habits. In this sense, several working parameters and limit values used by the processor can be changed gradually or dynamically (especially those to distinguish the geometric deviations from the basic position or, for example, to distinguish between deliberate pressure triggering from a strip that is too fast or from a support that is too static) , In particular, the average distance to the other occupancy lines and the average stroke impulses (time gradient) are determined and corrected if necessary. The type of projection from a basic topography to occupancy topography can also be changed. That means you can finally trigger the appropriate characters with very small (or idiosyncratic) hand movements. Typing or entering tax data can thus be reduced to person-dependent minimal tax movements or pressure triggers. (With reduced limit values, the size or areal extent of the occupancy topography also shrinks.)

In this respect, this input system is "capable of learning". This arrangement makes 10-finger typing more attractive by adapting to natural hand shapes and individual movements.

With this combination of (relatively smooth) input surface and flexible occupancy topography, it is possible to work comfortably and quickly, which, thanks to filter functions, also forgives certain errors. The adaptation to individual hand shapes and handling methods happens almost independently. (The surface with a slight bulge in the middle could meet other ergonomic requirements of the hand.) With the current trend towards light and intuitively operated interfaces, this ergonomically pleasing and flexible concept has a special marketing opportunity.

The technical feasibility of position determination (PosB) or input surface area actuation or pressure release determination (DruB) of several fingers consists, for example, of the following suggestions:

A (more or less fine) grid of conductive material in the input area allows the finger positions to be determined by measuring resistance or capacitance. Capacity.

The input surface is broken down into materially manifest quasi-point elements in the form of a grid. In terms of a certain resolution of the (e.g. 70 x 150) point-like elements, the measurement data of all these elements changed by touching the fingers can be made available to the processor in a capacitive measurement in order at best to determine the position (to be distinguished from the pressure triggering) and in to calculate the pressure trigger determination (DruB) of several fingers in each case. - For example, vapor-deposited conductor tracks and insulation layers can provide the feed to the point-like sensors.

Or the technical feasibility for the "touch-screen-like vision" can be established, for example, by replacing or superimposing certain visual pixels in the sensitive zone with pressure sensors (which act analogously to the force) (for example, every fifth pixel row would have every fifth Pixels or, for example, to replace an area of 2 by 2 pixels with a pressure sensor).

The input surface is broken down into materially manifest strip-shaped conductor elements. In the sense of a certain resolution of the (e.g. 150) strip-shaped elements, the measurement data of these elements changed by finger touching can be made available to the processor in a capacitive measurement in order at best to determine the position (PosB) (to be distinguished from the pressure triggering) and in any case the Calculate pressure trigger determination (DruB) of several fingers.

Materially manifest conductors running in 5 or 6 directions (compare also existing 5-thread technology or the proposed 6-thread technology) provide clear positions or pressure release locations of the fingers through the combination of the incoming signals.

The existing (e.g. using resistors, capacitors, field effects) methods of touch screens are expanded: From the edges, the area is not only developed in the x or y direction, but e.g. developed in 3 different axes (ie from 6 different "perspectives"). A clear differentiation for the evaluation could be achieved by appropriate (depending on the direction) differently modulated frequencies.

The computer input is optionally characterized in that the sensorium for simultaneous measurement of several finger positions e.g. can also be detected by an electric field that is built up in several directions (several times per second), that is to say quasi-circumferentially, (especially for two fingers). (Compare claim 11 and Figure 6)

The existing (e.g. with resistors, capacitors, field effects) methods of touch screens are expanded: From the edges, the area with the influences of the fingers is not only measured in the x or y direction, but e.g. 10 times per Second in, for example, 6 different axes, that is, from 12 different "viewing angles" (comparable to a watch sheet, from which one takes 12 views of the interior) in order to obtain data about finger positions. This is a circumferential sensor field structure (an inside, so to speak) directed, "circumferential scanning" on the surface edge (compare Figure 6). Out Based on this data, the overlaps of the points found can be interpreted as fingertips. (Compare also the evaluation methods of seismological investigations). For example, a certain direction with a particularly strong bridging effect results for two fingers placed at the same time, that is the direction that both fingers form with one another. (The direction orthogonal to this shows a minimal bridging effect).

The input surface is optionally characterized (cf. claim 5) in that it provides fine motor feedback for actuation or pressure release with a noticeable exceeding of a release force by using an elastic (if possible still translucent) surface with a certain geometric structure (the surface is supported by transverse, almost flat slender struts), which is characterized in that it uses the toggle effect and the buckling effect at the same time and can be produced in particular by an extrusion process. The toggle effect and the buckling effect cause the resistance to rise to a certain maximum value when the pressure is actuated, and when this maximum value is exceeded, the resistance breaks down (because the slim cross struts buckle) and lets the surface sink in by a certain distance (eg by 3 mm) to trigger the control signal.

The technical feasibility of position determination (PosB) and actuation or pressure release determination (DruB) of several fingers with fine motor feedback thus exists, for example, by the following suggestion: The input surface (the “touch field”) is structured as follows: the one on the upper side is relatively smooth Surface is made of an elastic and transparent (or translucent) material and has a certain geometry of the cross-section, so that it can be pressed in with a certain force by the fingers.This certain resistance is due to toggle lever effects with a certain geometry (in particular from two flanks) or only single-flanked or only single-flanked but two-parted toggle-lever elements (see Figures 2, 4 and 5) so that when they are pushed in, they initially rise slightly, then reach a maximum and then the resistance decreases again, so that the triggering Element the area underneath surface (especially a printed circuit board) safely and noticeably. There is a desirable fine motor feedback for the finger movements.

This input surface, which works with toggle lever and buckling effects, is characterized in particular by the fact that it can be produced by extrusion (see Figures 2, 4 and 5). Then you can (a) leave the complex area in itself, (b) cut open this product from the underside so that the surface running through it is preserved or (c) in this product (e.g. by hot profile cutting or LASER Cut) a certain profile from the underside (the surface running through it remains intact) so that the toggle lever supports are separated from each other in the transverse direction, so they hardly influence each other in their impression behavior (see Figure 3). In the case of (c), additional volume is created under the surface in which LEDs can be accommodated. In a further step, certain contact zones on the underside can be produced by printing conductive (and at the same time elastic) material. In the last step, this product can be clicked on a circuit board can be glued on. This circuit board can in particular cross conductors to the

Wear strands of the toggle support (to determine the points of the press releases by measuring resistance or capacity and to transmit them as a signal). And the circuit board can in particular carry LED (or LCD) elements that are visible through the transparent or translucent surface. - e.g. a corrugation of the elastic input surface reduces the horizontal tensions. For example, Partially slitting or cutting out this surface structure from below and parallel to the extruded profile (i.e. transverse to the extrusion direction) improves the independent deflection of the different sections and creates space e.g. for LED. The single-flanked and two-part version of a toggle support system (Figure 5) is slightly easier to push in and offers more volume for e.g. LED elements.

This computer input is further characterized by the fact that it can take on additional tasks that make it easier and more intuitive to work, in particular by distinguishing two (or more) fingers simultaneously (apart from working in the sense of a “QWERT keyboard”).

For example, there are possibilities for machine or game controls by using (e.g. with 2 index fingers and 2 thumbs) the input surface as an analog control for (then e.g. 4 by 2, ie 8, due to the x and y direction) simultaneous control signals can use.

With this repertoire, for example, the following facilitations and applications are possible: a) Two fingers at the same time (e.g. longer than 0.6 seconds) put on and shifted control the scroll function of the screen display. Through this grazing movement, the representation is shifted in the direct grip of both fingers. b) Press two fingers at the same time (e.g. longer than 0.3 seconds and with a minimum distance of 6 mm) and move against each other controls a zoom function / change in scale of the display. c) Press three fingers at the same time (e.g. longer than 0.3 seconds, up to 0.6 seconds) switches on the next menu level, for example.

Other applications of this computer input are:

Keyboards for cell phones, handheld computers or other devices with only relatively small displays or input fields (to be adjusted, adjusted and modified by the user) (cell phones can then simply have a flexible screen instead of display + keypad, which allows different functions, especially the Quick access to the displayed objects similar to a mouse click. The scroll and zoom functions enable even a small screen to make certain amounts of data quickly accessible.)

Input devices for machines and customer information and guidance systems

Screens in vehicles (e.g. with map displays), where the screen area can also be used as an (associative, symbolically clear) input area.

CAD workstations

Keyboards for synthesizers This system facilitates one-handed operation.

Said computer input (especially in terms of its ergonomic and dynamic adaptation to individual hand shapes and typing habits) can also be installed on an input surface or hardware that can only process one actuated point (or input surface area) at the same time (e.g. for conventional touchscreens, compare the above-mentioned product vision (I)). To do this, the initial calibration to the individual hand or basic topography (initialization) must be done by tapping with the 10 fingers one after the other. And then you have to type one after the other, if possible, without touching several fingers at the same time. Any simultaneous touches that may occur can be detected and sorted out using filter functions (e.g. change too slow = only supported statically or change too fast = only touched fleetingly).

For example, the use of the computer input described here on conventional touchscreens can also be facilitated by applying (e.g. in the lower area of the screen) a mesh-like fabric (or a layer that is smooth on the top but finely nubbed on the bottom). The tissue (or layer) lies on the screen only with certain points (e.g. every 2 millimeters in the x and y directions). As a result, the fingers (if the screen is appropriately calibrated) can in principle be laid on loosely without the touchscreen evaluating this as a pressure release (actuation), and only if a certain pressure force is exceeded - if possible only with one finger at a time - then the small point of contact increases the point force (or pressure) to the triggering signal.

This idea can in principle be combined with the idea of fine motor feedback through a specific structure of the surface lying on it (compare claim 5).

Claims

Patent claims

1. Computer input device with a touch-sensitive input surface having a plurality of input surface areas, and a control unit which is coupled to the input surface, whereby a character, in particular a letter, a number or another control character, is assigned to a specific input surface area characterized in that the control device dynamically adjusts the input surface area assigned to a character during operation.

2. Computer input device according to claim 1, characterized in that the control device is designed to detect multiple touches of the input surface simultaneously.

3. Computer input device according to claim 1 or 2, characterized in that the control device assigns an input area to each character in an initialization phase, this assignment taking place depending on a hand topography of the user.

4. Computer input device according to claim 1 or 2, characterized in that the control device in an initialization phase assigns each character to an input surface area according to a defined scheme, the scheme corresponding to a normal key assignment of a keyboard.

5. Computer input device according to one of the preceding claims or according to claim 12, characterized in that the input surface areas are coupled to mechanically operating switches, in particular with a plurality of toggle lever elements which are extended laterally to the surface and which can be produced in particular by an extrusion process To make actuation of the input area noticeable.

6. Computer input device according to one of claims 1 to 5, characterized in that the input surface areas are assigned electro-mechanical, electrostatic, electronic and / or magnetic sensors for detecting an actuation.

7. The method for operating a computer input device, in particular according to one of claims 1 to 6, characterized in that in a first phase (initialization phase) an input surface area of a touch-sensitive input surface is assigned to a character to be entered, and in a second phase (operating phase) Assignment of characters to input area is dynamically adjusted.

8. The method according to claim 7, characterized in that the assignment in the first phase is carried out according to a predetermined scheme, preferably according to a conventional key assignment of a computer keyboard.

9. The method according to claim 7, characterized in that the assignment in the first phase is carried out depending on a hand topography of the user by first placing the fingers for this purpose in the input / starting position on the input surface, in particular simultaneously or in succession then the finger positions are recorded and characters are assigned to the corresponding input surface areas, and finally the other characters are assigned to the other input surface areas on the basis of the recorded finger positions.

10. The method according to any one of claims 7 to 9, characterized in that the character assigned to an input surface area is optically displayed to the user, so that the user can recognize the assignment of all characters.

11. Computer input device according to one of claims 1 to 6, characterized in that the actuations of the input surface areas by means of an electrical field built up in rapid succession in different directions above the input surface, which in particular is built up several times per second in a different direction, for several in particular are distinguishable for two fingers at the same time.

12. Computer input device with a touch-sensitive input surface having a plurality of input surface areas, and a control unit that is coupled to the input surface, whereby a character, in particular a letter, a number or another control character, is assigned to a specific input surface area characterized in that the control device adjusts the input surface area assigned to a character to a hand topography of the user.

13. Computer input device according to claim 12 and one or more of claims 1 to 6 or 11.