WO2001015067A1 - Method and device for inputting control signals - Google Patents

Method and device for inputting control signals Download PDF

Info

Publication number
WO2001015067A1
WO2001015067A1 PCT/DE2000/002858 DE0002858W WO0115067A1 WO 2001015067 A1 WO2001015067 A1 WO 2001015067A1 DE 0002858 W DE0002858 W DE 0002858W WO 0115067 A1 WO0115067 A1 WO 0115067A1
Authority
WO
WIPO (PCT)
Prior art keywords
finger
vector
sen
control signals
vek
Prior art date
Application number
PCT/DE2000/002858
Other languages
German (de)
French (fr)
Inventor
Eckhard Meissner
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Publication of WO2001015067A1 publication Critical patent/WO2001015067A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033—Indexing scheme relating to G06F3/033
    • G06F2203/0338—Fingerprint track pad, i.e. fingerprint sensor used as pointing device tracking the fingertip image

Definitions

  • the invention relates to a method and an arrangement for entering control signals, in particular for controlling a graphically represented marker, such as a pointer or cursor, which is shown on a graphic display of a communication terminal, such as a mobile radio telephone, or a computer monitor.
  • a graphically represented marker such as a pointer or cursor
  • the touchpad in particular is characterized by annoying impairments caused by the hand of the user, the capacitive effect of which often overlaps that of the finger and can thus lead to disruptive changes to the cursor control.
  • a mouse proves to be an extremely impractical solution, especially for mobile applications.
  • the invention is based on the problem of specifying methods and arrangements which enable reliable and user-friendly input of control signals.
  • the invention is therefore based on the idea of determining a vector from the position of a finger lying on a sensor device and a predetermined reference point and of further processing this vector at least as part of an input control signal.
  • pictorial features of the surface of a finger can be detected by means of suitable sensors and the position of the surface of a finger placed on the sensor device can be determined from this by comparing them with corresponding stored features.
  • An evaluation of the minutia features of the finger surface takes about 100 ms for certain sensor devices, which is too long for reliable finger movement detection in the case of dynamic input of control signals in which the control signals are based on a change in position of the finger.
  • 100 ms evaluation times are sufficient, since the controlling movements take place comparatively slowly.
  • the position of a finger for example by determining the sensor elements covered by the surface of the finger, to determine the surface of the finger placed on the sensor and from this, for example by calculating the center of gravity of this area, the position of the finger to investigate.
  • the evaluation time can be shortened by not extracting minutia features, but by determining the position of the point representing the finger position only on the basis of the surface placed on it.
  • an arrangement for inputting control signals which has a sensor device and a processor device, the processor device being designed such that it is particularly suitable for carrying out the method according to the invention or one of its developments.
  • Figure 1 is used, which is a block diagram of an embodiment of an arrangement according to the invention.
  • FIG. 1 shows a processor unit PE, which can in particular be contained in a communication device, such as a mobile phone or a portable computer. It contains a control device STE, which essentially consists of a program-controlled microcontroller, and a processing device VE, which consists of a processor, in particular a digital signal processor, both of which have write and read access to memory modules SPE.
  • a control device STE which essentially consists of a program-controlled microcontroller
  • VE which consists of a processor, in particular a digital signal processor, both of which have write and read access to memory modules SPE.
  • the microcontroller STE controls and monitors all essential elements and functions of a functional unit which contains the processor unit PE.
  • the digital signal processor VE, part of the digital signal processor or a special Processor is for performing image recognition and
  • An input / output interface I / O serves for the input / output of useful or control signal data, for example to / from an operating unit MMI which, in addition to a keyboard (not shown) and a display DPL, contains a fingerprint sensor SEN.
  • the arrangement as shown in FIG. 1, comprises a planar arrangement of suitable sensors SEN.
  • pictorial features of the surface of a finger are detected by means of the sensors SEN and fed to a processor device PE, in particular a processing device VE, such as a signal processor, for determining a point FIN representing its finger position or its position.
  • a processor device PE in particular a processing device VE, such as a signal processor
  • Methods for determining features of the surface of a finger, in particular by evaluating the minutia features of the finger surface, by means of suitable sensors are compared using different methods which are generally known from electronic image processing by comparing pictorial features (for example individual image points or groups of image points, etc.) or by comparing derived features (DCT-transformed image, edge image, etc.).
  • the marker After switching on the device to be controlled, the marker can be displayed at a predetermined point on the display DPL, for example in the center of the display DPL, and the user can be asked to put his finger at a point on the sensor SEN which is the one for him corresponds to the current position of the marker CUR.
  • the position of the finger or certain features of the finger surface are then determined and a reference point REF is determined from their position and stored for further control.
  • control signals are entered by detecting pictorial features of the finger stored on the sensor device SEN and the resulting determination of the current position FIN of the finger or certain above-mentioned features of the finger surface.
  • a further development provides a fixed reference point REF, such as the center of the sensor device SEN.
  • the area of the sensor device covered by the surface of the finger is first detected, for example by determining covered sensor elements, and corresponding information is transmitted to the processor device PE.
  • the processor device PE determines a point FIN or its position representing the finger position.
  • a reference point can be determined in accordance with the method explained above. Continuing education sees in contrast, a fixed reference point REF, such as the center of the sensor device SEN.
  • a vector VEK can be formed from the reference point REF and the instantaneous position of the finger FIN, the base point of which is formed by the reference point REF and the tip of which is formed by the current position FIN of the finger.
  • This vector VEK can now be converted into a movement of the marker, for example by the amount of the vector determining the speed of movement of the graphically represented marker CUR and the direction of the vector VEK determining the direction of movement of the graphically represented marker CUR.
  • a particularly advantageous implementation of the invention is possible with the aid of a fingerprint sensor. This is often already available in many devices to identify or authenticate an authorized user.
  • Another embodiment variant of the invention provides that the relationship between the length of the vector VEK and the speed at which the marker CUR is moved can be set by the user or can be selected from a plurality of predefined variants. For example, be a linear relationship or any non-linear relationship, such as square relationships. It is particularly useful if the movement of the cursor is slower with a small amount of vector VEK and automatically increases disproportionately with larger distances.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

According to the inventive method for inputting control signals, pictorial characteristics of the surface of a finger are detected and used to determine the position of the finger. The movement of a graphically represented marker is then determined by the relative position of the finger to a predetermined reference point.

Description

Beschreibungdescription
Verfahren und Anordnung zur Eingabe von SteuersignalenMethod and arrangement for entering control signals
Die Erfindung betrifft ein Verfahren und eine Anordnung zur Eingabe von Steuersignalen, insbesondere zur Steuerung eines graphisch dargestellten Markers, wie beispielsweise einen Zeiger oder Cursor, der auf einem Graphikdisplay eines Kommunikationsendgerätes, wie beispielsweise einem Mobilfunktele- fon, oder einem Computermonitor dargestellt ist.The invention relates to a method and an arrangement for entering control signals, in particular for controlling a graphically represented marker, such as a pointer or cursor, which is shown on a graphic display of a communication terminal, such as a mobile radio telephone, or a computer monitor.
Mit der Einführung graphischer Benutzeroberflächen für Computer und andere Kommunikationsendgeräte haben Anordnungen zur Eingabe von Steuersignalen für solche Geräte, die besonders an solche graphischen Benutzeroberflächen angepaßt sind, stark an Bedeutung gewonnen. Die bis heute am weitesten verbreitete Vorrichtung dieser Art ist die Maus. Daneben ist in letzter Zeit, besonders für mobile Anwendungen, das Touchpad getreten.With the introduction of graphical user interfaces for computers and other communication terminals, arrangements for inputting control signals for such devices, which are particularly adapted to such graphical user interfaces, have become increasingly important. The most widely used device of this type to date is the mouse. In addition, the touchpad has recently been used, especially for mobile applications.
Beide Anordnungen sind aufgrund ihrer physikalischen Funktionsprinzipien in ihrer Auflösung begrenzt. Besonders das Touchpad ist von störenden Beeinträchtigungen durch die Hand des Benutzers geprägt, deren kapazitive Wirkung die des Fin- gers häufig spürbar überlagert und so zu störenden Veränderungen der Cursor-Steuerung führen kann. Insbesondere für mobile Anwendungszwecke erweist sich eine Maus als äußerst unpraktische Lösung.Both arrangements are limited in their resolution due to their physical functional principles. The touchpad in particular is characterized by annoying impairments caused by the hand of the user, the capacitive effect of which often overlaps that of the finger and can thus lead to disruptive changes to the cursor control. A mouse proves to be an extremely impractical solution, especially for mobile applications.
Der Erfindung liegt nun das Problem zugrunde, Verfahren und Anordnungen anzugeben, die eine zuverlässige und benutzerfreundliche Eingabe von Steuersignalen ermöglichen.The invention is based on the problem of specifying methods and arrangements which enable reliable and user-friendly input of control signals.
Diese Aufgabe wird erfindungsgemäß durch die Merkmale der un- abhängigen Patentansprüche gelöst. Vorteilhafte Weiterbildungen sind den Unteransprüchen zu entnehmen. Die Erfindung beruht demnach auf dem Gedanken, aus der Position eines auf einer Sensoreinrichtung liegenden Fingers und einem vorgegebenen Referenzpunkt einen Vektor zu ermitteln und diesen Vektor zumindest als Teil eines eingegebenen Steu- ersignals weiterzuverarbeiten.This object is achieved according to the invention by the features of the independent claims. Advantageous further developments can be found in the subclaims. The invention is therefore based on the idea of determining a vector from the position of a finger lying on a sensor device and a predetermined reference point and of further processing this vector at least as part of an input control signal.
Beispielsweise können zu diesem Zweck mittels geeigneter Sensoren bildhafte Merkmale der Oberfläche eines Fingers erfaßt werden und daraus, durch einen Vergleich mit entsprechenden abgespeicherten Merkmalen, die Lage der auf die Sensoreinrichtung aufgelegten Oberfläche eines Fingers ermittelt werden. Eine dazu beispielsweise durchzuführende Auswertung der Minutienmerkmale der Fingeroberfläche dauert bei bestimmten Sensoreinrichtungen ca. 100 ms, was im Falle einer dynami- sehen Eingabe von Steuersignalen, bei der die Steuersignale auf einer Lageänderung des Fingers basieren, für eine zuverlässige Fingerbewegungsdetektion zu lange ist. Für die vorgeschlagene statische Eingabe von Steuersignalen durch die Ermittlung der Fingerposition relativ zu einem festen Referenz- punkt reichen 100 ms Auswertezeiten aus, da die steuernden Bewegungen vergleichsweise langsam erfolgen.For this purpose, for example, pictorial features of the surface of a finger can be detected by means of suitable sensors and the position of the surface of a finger placed on the sensor device can be determined from this by comparing them with corresponding stored features. An evaluation of the minutia features of the finger surface, for example to be carried out for this purpose, takes about 100 ms for certain sensor devices, which is too long for reliable finger movement detection in the case of dynamic input of control signals in which the control signals are based on a change in position of the finger. For the proposed static input of control signals by determining the finger position relative to a fixed reference point, 100 ms evaluation times are sufficient, since the controlling movements take place comparatively slowly.
Alternativ dazu ist es beispielsweise möglich zur Erfassung der Lage eines Fingers, beispielsweise durch die Ermittlung der durch die Oberfläche des Fingers abgedeckten Sensorelemente, die auf den Sensor aufgelegte Oberfläche des Fingers zu ermitteln und daraus beispielsweise durch die Berechnung des Schwerpunktes dieser Fläche die Position des Fingers zu ermitteln. So kann die Auswertezeit verkürzt werden, indem nicht Minutienmerkmale extrahiert werden, sondern die Lage des die Fingerposition repräsentierenden Punktes lediglich auf der Basis der aufgelegten Oberfläche ermittelt wird.As an alternative to this, it is possible, for example, to determine the position of a finger, for example by determining the sensor elements covered by the surface of the finger, to determine the surface of the finger placed on the sensor and from this, for example by calculating the center of gravity of this area, the position of the finger to investigate. The evaluation time can be shortened by not extracting minutia features, but by determining the position of the point representing the finger position only on the basis of the surface placed on it.
Da die physikalische Größe häufig eingesetzter Fingerabdruck- sensoren, insbesondere bei mobilen Anwendungen, eine Fläche von 1 bis 3 Quadratzentimeter aufweist, sind darauf nur sehr eingeschränkte Bewegungen der Fingerspitze möglich. Insbeson- dere große Wege oder schnelle Bewegungen eines graphisch dargestellten Markers sind daher schwierig einzugeben. Die vorgeschlagene statische Bedienung ist dagegen vom Benutzer auch auf kleinen Fingerabdrucksensoren zuverlässig und praktikabel durchführbar.Since the physical size of frequently used fingerprint sensors, especially in mobile applications, has an area of 1 to 3 square centimeters, only very limited movements of the fingertip are possible. par- long distances or fast movements of a graphically represented marker are therefore difficult to enter. The proposed static operation, on the other hand, can be carried out reliably and practically by the user even on small fingerprint sensors.
Weiterbildungen sehen vor, bestimmte, als besonders zweckmäßig angesehene, Größen der Relativlage des Fingers zur Beschreibung der Bewegung eines graphisch dargestellten Markers heranzuziehen.Further developments envisage using certain variables of the relative position of the finger, which are regarded as particularly expedient, to describe the movement of a graphically represented marker.
Zur Lösung der Aufgabe wird ferner eine Anordnung zur Eingabe von Steuersignalen angegeben, welche eine Sensoreinrichtung und eine Prozessoreinrichtung aufweist, wobei die Prozes- soreinrichtung derart ausgestaltet ist, daß sie insbesondere zur Durchführung des erfindungsgemäßen Verfahrens oder einer seiner Weiterbildungen geeignet ist.To achieve the object, an arrangement for inputting control signals is also provided, which has a sensor device and a processor device, the processor device being designed such that it is particularly suitable for carrying out the method according to the invention or one of its developments.
Die Erfindung wird im folgenden anhand bevorzugter Ausfüh- rungsbeispiele näher beschrieben, zu deren Erläuterung dieThe invention is described in more detail below with the aid of preferred exemplary embodiments, for the explanation of which the
Figur 1 dient, welche ein Blockschaltbild einer Ausführungsform einer erfindungsgemäßen Anordnung darstellt.Figure 1 is used, which is a block diagram of an embodiment of an arrangement according to the invention.
Figur 1 zeigt eine Prozessoreinheit PE, die insbesondere in einer Kommunikationseinrichtung, wie einem Mobiltelefon oder einem tragbaren Computer, enthalten sein kann. Sie enthält eine Steuereinrichtung STE, die im wesentlichen aus einem programmgesteuerten MikroController besteht, und eine Verarbeitungseinrichtung VE, die aus einem Prozessor, insbesondere einem digitalen Signalprozessor besteht, die beide schreibend und lesend auf Speicherbausteine SPE zugreifen können.FIG. 1 shows a processor unit PE, which can in particular be contained in a communication device, such as a mobile phone or a portable computer. It contains a control device STE, which essentially consists of a program-controlled microcontroller, and a processing device VE, which consists of a processor, in particular a digital signal processor, both of which have write and read access to memory modules SPE.
Der Mikrocontroller STE steuert und kontrolliert alle wesentlichen Elemente und Funktionen einer Funktionseinheit, welche die Prozessoreinheit PE enthält. Der digitale Signalprozessor VE, ein Teil des digitalen Signalprozessors oder ein speziel- ler Prozessor ist für die Durchführung der Bilderkennung undThe microcontroller STE controls and monitors all essential elements and functions of a functional unit which contains the processor unit PE. The digital signal processor VE, part of the digital signal processor or a special Processor is for performing image recognition and
Codierungs-, Vergleichs- und Merkmalsextrahierungsverfahren zuständig.Coding, comparison and feature extraction procedures responsible.
Eine Input/Output-Schnittstelle I/O, dient der Ein/Ausgabe von Nutz- oder Steuesignaldaten, beispielsweise an eine/von einer Bedieneinheit MMI, die neben einer Tastatur (nicht gezeigt) und einem Display DPL einen Fingerabdrucksensor SEN enthält.An input / output interface I / O serves for the input / output of useful or control signal data, for example to / from an operating unit MMI which, in addition to a keyboard (not shown) and a display DPL, contains a fingerprint sensor SEN.
Im Gegensatz zu bekannten Anordnungen dieser Art umfaßt die Anordnung, wie in der Figur 1 gezeigt wird, eine flächenhafte Anordnung geeigneter Sensoren SEN.In contrast to known arrangements of this type, the arrangement, as shown in FIG. 1, comprises a planar arrangement of suitable sensors SEN.
Gemäß einer ersten Ausführungsvariante der Erfindung werden mittels der Sensoren SEN bildhafte Merkmale der Oberfläche eines Fingers erfaßt und einer Prozessoreinrichtung PE, insbesondere einer Verarbeitungseinrichtung VE, wie beispielsweise einem Signalprozessor, zur Bestimmung eines die Finger- position repräsentierenden Punktes FIN bzw. seiner Position zugeführt. Verfahren zur Ermittlung von Merkmalen der Oberfläche eines Fingers, insbesondere durch die Auswertung der Minutienmerkmale der Fingeroberfläche, mittels geeigneter Sensoren werden mit Hilfe unterschiedlicher, aus der elektro- nischen Bildverarbeitung allgemein bekannter Verfahren durch einen Vergleich bildhafter Merkmale (z.B. einzelen Bildpunkten oder Gruppen von Bildpunkten, etc.) oder durch einen Vergleich daraus abgeleiteter Merkmale (DCT-transformiertes Bild, Kantenbild, etc.) bestimmt. Diese Verfahren laufen auf unterschiedlichen, in der Literatur beschriebenen Datenverarbeitungseinrichtungen ab, die in Form dedizierter digitaler Schaltungen oder in Form von Schaltungen auf der Basis von Prozessoren vorliegen können. Es bedarf hier weder der Erläuterung dieser Verfahren noch derartiger Datenverarbeitungs- einrichtungen, weil alle diese Bestandteile der erfindungsgemäßen Vorrichtung dem Fachmann bekannt sind. Die Bestimmung der Positionsdaten kann leicht durch eine einfache Korrelation der zweidi ensionalen Bilddaten des Fingerabdruckes des aufliegenden Fingers mit einem entsprechenden abgespeicherten Daten erfolgen. Anstelle des Bildes selbst kommen zur Abspei- cherung und zum Vergleich auch extrahierte Bildmerkmale (Kanten, Ecken, etc.) in Frage.According to a first embodiment variant of the invention, pictorial features of the surface of a finger are detected by means of the sensors SEN and fed to a processor device PE, in particular a processing device VE, such as a signal processor, for determining a point FIN representing its finger position or its position. Methods for determining features of the surface of a finger, in particular by evaluating the minutia features of the finger surface, by means of suitable sensors are compared using different methods which are generally known from electronic image processing by comparing pictorial features (for example individual image points or groups of image points, etc.) or by comparing derived features (DCT-transformed image, edge image, etc.). These methods run on different data processing devices described in the literature, which can be in the form of dedicated digital circuits or in the form of circuits based on processors. There is no need to explain these methods or such data processing devices here because all these components of the device according to the invention are known to the person skilled in the art. The determination the position data can easily be obtained by simply correlating the two-dimensional image data of the fingerprint of the finger lying on it with a corresponding stored data. Instead of the image itself, extracted image features (edges, corners, etc.) can be used for saving and comparison.
Nach dem Einschalten des zu steuernden Gerätes kann der Marker an einem fest vorgegebenen Punkt des Displays DPL, wie beispielsweise im Zentrum des Displays DPL angezeigt werden, und der Benutzer aufgefordert werden, seinen Finger an eine Stelle des Sensors SEN zu legen, der für ihn der momentanen Position des Markers CUR entspricht. Darauf wird die Position des Fingers bzw. bestimmte Merkmale der Fingeroberfläche er- mittelt und aus deren Position ein Referenzpunkt REF bestimmt und für die weitere Steuerung abgespeichert. Im weiteren erfolgt die Eingabe von Steuersignalen durch das Erfassen bildhafter Merkmale des auf der Sensoreinrichtung SEN abgelegten Fingers und der daraus resultierenden Ermittlung der momenta- nen Position FIN des Fingers bzw. bestimmter oben erwähnter Merkmale der Fingeroberfläche.After switching on the device to be controlled, the marker can be displayed at a predetermined point on the display DPL, for example in the center of the display DPL, and the user can be asked to put his finger at a point on the sensor SEN which is the one for him corresponds to the current position of the marker CUR. The position of the finger or certain features of the finger surface are then determined and a reference point REF is determined from their position and stored for further control. In addition, control signals are entered by detecting pictorial features of the finger stored on the sensor device SEN and the resulting determination of the current position FIN of the finger or certain above-mentioned features of the finger surface.
Eine Weiterbildung sieht einen festen Referenzpunkt REF, wie beispielsweise das Zentrum der Sensoreinrichtung SEN vor.A further development provides a fixed reference point REF, such as the center of the sensor device SEN.
Gemäß einer zweiten Ausführungsvariante der Erfindung wird zunächst die durch die Oberfläche des Fingers abgedeckte Fläche der Sensoreinrichtung, beispielsweise durch die Ermittlung abgedeckter Sensorelemente, erfaßt, und entsprechende Informationen an die Prozessoreinrichtung PE übermittelt.According to a second embodiment of the invention, the area of the sensor device covered by the surface of the finger is first detected, for example by determining covered sensor elements, and corresponding information is transmitted to the processor device PE.
Beispielsweise durch die Berechnung des Schwerpunktes dieser Fläche ermittelt die Prozessoreinrichtung PE, insbesondere eine Verarbeitungseinrichtung VE, daraus einen die Fingerposition repräsentierenden Punkt FIN bzw. seiner Position.For example, by calculating the center of gravity of this area, the processor device PE, in particular a processing device VE, determines a point FIN or its position representing the finger position.
Die Ermittlung eines Referenzpunktes kann entsprechend dem oben erläuterte Verfahren erfolgen. Eine Weiterbildung sieht dagegen einen festen Referenzpunkt REF, wie beispielsweise das Zentrum der Sensoreinrichtung SEN, vor.A reference point can be determined in accordance with the method explained above. Continuing education sees in contrast, a fixed reference point REF, such as the center of the sensor device SEN.
In beiden Ausführungsbeispielen kann aus dem Referenzpunkt REF und der augenblicklichen Position des Fingers FIN ein Vektor VEK gebildet werden, dessen Fußpunkt durch den Referenzpunkt REF, und dessen Spitze durch die aktuelle Position FIN des Fingers gebildet ist. Dieser Vektor VEK kann nun in eine Bewegung des Markers umgesetzt werden, indem beispiels- weise der Betrag des Vektors die Geschwindigkeit der Bewegung des graphisch dargestellten Markers CUR bestimmt, und die Richtung des Vektors VEK die Richtung der Bewegung des graphisch dargestellten Markers CUR bestimmt.In both exemplary embodiments, a vector VEK can be formed from the reference point REF and the instantaneous position of the finger FIN, the base point of which is formed by the reference point REF and the tip of which is formed by the current position FIN of the finger. This vector VEK can now be converted into a movement of the marker, for example by the amount of the vector determining the speed of movement of the graphically represented marker CUR and the direction of the vector VEK determining the direction of movement of the graphically represented marker CUR.
Eine besonders vorteilhafte Realisierung der Erfindung ist mit Hilfe eines Fingerabdruck-Sensors möglich. Dieser ist in vielen Geräten oft ohnehin schon zur Identifizierung oder Au- thentifikation eines berechtigten Nutzers vorhanden.A particularly advantageous implementation of the invention is possible with the aid of a fingerprint sensor. This is often already available in many devices to identify or authenticate an authorized user.
Eine andere Ausführungsvariante der Erfindung sieht vor, daß der Zusammenhang zwischen der Länge des Vektors VEK und der Geschwindigkeit, mit welcher der Marker CUR bewegt wird, vom Nutzer einstellbar bzw. aus mehreren vorgegebenen Varianten wählbar ist. So kann es sich dabei z.B. um einen linearen Zu- sammenhang oder beliebige nichtlineare, wie beispielsweise quadratische Zusammenhänge, handeln. Besonders zweckmäßig ist es, wenn bei kleinem Betrag des Vektors VEK die Bewegung des Cursors langsamer ist und mit größeren Abständen automatisch überproportional zunimmt. Another embodiment variant of the invention provides that the relationship between the length of the vector VEK and the speed at which the marker CUR is moved can be set by the user or can be selected from a plurality of predefined variants. For example, be a linear relationship or any non-linear relationship, such as square relationships. It is particularly useful if the movement of the cursor is slower with a small amount of vector VEK and automatically increases disproportionately with larger distances.

Claims

Patentansprüche claims
1. Verfahren zur Eingabe von Steuersignalen, bei dem1. Procedure for entering control signals, in which
- mittels einer Sensoreinrichtung (SEN) die Lage der auf die Sensoreinrichtung (SEN) aufgelegten Oberfläche eines Fingers erfaßt wird,the position of the surface of a finger placed on the sensor device (SEN) is detected by means of a sensor device (SEN),
- mittels einer Prozessoreinrichtung (PE) aus der Lage der auf die Sensoreinrichtung (SEN) aufgelegten Oberfläche eines Fingers ein die Position des Fingers repräsentierender Punkt (FIN) ermittelt wird, und- A processor (PE) is used to determine a point (FIN) representing the position of the finger from the position of the surface of a finger placed on the sensor device (SEN), and
- ein Vektor (VEK) zwischen dem die Position des Fingers repräsentierenden Punkt (FIN) und einem Referenzpunkt (REF) bestimmt wird.- A vector (VEK) is determined between the point (FIN) representing the position of the finger and a reference point (REF).
2. Verfahren nach Anspruch 1, bei dem2. The method according to claim 1, wherein
- der Betrag des Vektors (VEK) die Geschwindigkeit der Bewegung eines grafisch dargestellten Markers (CUR) bestimmt.- The amount of the vector (VEK) determines the speed of movement of a graphically represented marker (CUR).
3. Verfahren nach einem der vorhergehenden Ansprüche, bei dem - die Richtung des Vektors (VEK) die Richtung der Bewegung eines grafisch dargestellten Markers (CUR) bestimmt.3. The method according to any one of the preceding claims, wherein - the direction of the vector (VEK) determines the direction of movement of a graphically represented marker (CUR).
4. Anordnung zur Eingabe von Steuersignalen, mit -einer Sensoreinrichtung (SEN) zur Erfassung der Lage der auf die Sensoreinrichtung (SEN) aufgelegten Oberfläche eines Fingers, und4. Arrangement for inputting control signals, with a sensor device (SEN) for detecting the position of the surface of a finger placed on the sensor device (SEN), and
-einer Prozessoreinrichtung (PE) die derart eingerichtet ist, daß -aus der Lage der auf die Sensoreinrichtung (SEN) aufgeleg- ten Oberfläche eines Fingers ein die Position des Fingers repräsentierender Punkt (FIN) ermittelt wird, unda processor device (PE) which is set up in such a way that a point (FIN) representing the position of the finger is determined from the position of the surface of a finger placed on the sensor device (SEN), and
- zwischen dem die Position des Fingers repräsentierenden Punkt (FIN) und einem Referenzpunkt (REF) ein Vektor (VEK) bestimmbar ist.- A vector (VEK) can be determined between the point (FIN) representing the position of the finger and a reference point (REF).
5. Anordnung nach Anspruch 4, bei welcher -der Betrag des Vektors (VEK) die Geschwindigkeit der Bewegung eines grafisch dargestellten Markers (CUR) bestimmt.5. Arrangement according to claim 4, in which -The amount of the vector (VEK) determines the speed of movement of a graphically represented marker (CUR).
6. Anordnung nach einem der Ansprüche 4 oder 5, bei welcher - die Richtung des Vektors (VEK) die Richtung der Bewegung eines grafisch dargestellten Markers (CUR) bestimmt. 6. Arrangement according to one of claims 4 or 5, wherein - the direction of the vector (VEK) determines the direction of movement of a graphically represented marker (CUR).
PCT/DE2000/002858 1999-08-23 2000-08-22 Method and device for inputting control signals WO2001015067A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE19939855 1999-08-23
DE19939855.0 1999-08-23

Publications (1)

Publication Number Publication Date
WO2001015067A1 true WO2001015067A1 (en) 2001-03-01

Family

ID=7919275

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2000/002858 WO2001015067A1 (en) 1999-08-23 2000-08-22 Method and device for inputting control signals

Country Status (1)

Country Link
WO (1) WO2001015067A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005083554A2 (en) * 2004-02-20 2005-09-09 Sony Ericcson Mobile Communications Ab Thumb-operable man-machine interfaces (mmi) for portable electronic devices, portable electronic devices including the same and methods of operating the same
CN100349103C (en) * 2003-08-05 2007-11-14 捷讯研究有限公司 Mobile device with on-screen optical navigation
EP2605118A3 (en) * 2011-12-16 2017-10-25 BANDAI NAMCO Entertainment Inc. Input direction determination system, terminal, server, network system, and input direction determination method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997036225A1 (en) * 1996-03-28 1997-10-02 Synaptics, Inc. Object position detector with edge motion feature and gesture recognition
JPH10275233A (en) * 1997-03-31 1998-10-13 Yamatake:Kk Information processing system, pointing device and information processor
WO2000042493A1 (en) * 1999-01-14 2000-07-20 Siemens Aktiengesellschaft Input or control unit for devices and method for generating control signals for devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997036225A1 (en) * 1996-03-28 1997-10-02 Synaptics, Inc. Object position detector with edge motion feature and gesture recognition
JPH10275233A (en) * 1997-03-31 1998-10-13 Yamatake:Kk Information processing system, pointing device and information processor
WO2000042493A1 (en) * 1999-01-14 2000-07-20 Siemens Aktiengesellschaft Input or control unit for devices and method for generating control signals for devices

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DATABASE WPI Section EI Week 199851, Derwent World Patents Index; Class T01, AN 1998-604773 *
PATENT ABSTRACTS OF JAPAN vol. 1999, no. 01 29 January 1999 (1999-01-29) *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100349103C (en) * 2003-08-05 2007-11-14 捷讯研究有限公司 Mobile device with on-screen optical navigation
WO2005083554A2 (en) * 2004-02-20 2005-09-09 Sony Ericcson Mobile Communications Ab Thumb-operable man-machine interfaces (mmi) for portable electronic devices, portable electronic devices including the same and methods of operating the same
WO2005083554A3 (en) * 2004-02-20 2006-02-16 Sony Ericcson Mobile Comm Ab Thumb-operable man-machine interfaces (mmi) for portable electronic devices, portable electronic devices including the same and methods of operating the same
EP2605118A3 (en) * 2011-12-16 2017-10-25 BANDAI NAMCO Entertainment Inc. Input direction determination system, terminal, server, network system, and input direction determination method

Similar Documents

Publication Publication Date Title
DE69225550T2 (en) Method and device for reducing the operating effort for a touch-sensitive screen
DE69613656T2 (en) Operation of a touch screen
DE4406668C2 (en) Method and device for operating a touch-sensitive display device
DE69024094T2 (en) Touch sensor matrix systems and display systems that include them
DE102006060068B4 (en) Display device and method adapted for small handheld devices
DE3413114A1 (en) INPUT AND CONTROL UNIT FOR A DIGITAL COMPUTER SYSTEM
DE102010027732A1 (en) Two-dimensional position sensor
EP0309685A2 (en) Device for input and treatment of characters and graphics
DE112013006066T5 (en) Emulate the pressure sensitivity on multi-touch units
DE112016006646T5 (en) COORDINATE CORRECTION DEVICE, COORDINATE CORRECTION PROCESS, AND COORDINATE CORRECTION PROGRAM
DE3540626A1 (en) Electronic device for the input and display of hand-written characters
DE202008005342U1 (en) Electronic device
DE69026516T2 (en) DIGITIZED TABLET WITH TWO-WAY RUNNER / MOUSE
DE69221204T2 (en) Data processing device for window position control
DE102015120864A1 (en) Mobile electronic device, method for displaying the user interface and recording medium therefor
DE102011016391A1 (en) Multi-mode prosthetic device for facilitating the detection of multi-level touch screens
DE102014000214B4 (en) Controlling a control parameter through gesture recognition
WO2001015067A1 (en) Method and device for inputting control signals
WO1988002522A1 (en) Process and device for entering letters in apparatus having a digital keyboard
DE69615107T2 (en) LOW-PASS FILTER FOR A GRAPHIC PANEL WITH A LIMIT FREQUENCY THAT IS LOWER THAN THE SCAN FREQUENCY
WO2019242908A1 (en) Method for the tactile interaction of a user with an electronic device, computer program product and electronic device
DE112018005555T5 (en) MINIMUM CONTROL OF TRANSMITTERS FOR INCREASING FLOOD DETECTION
DE102005047837A1 (en) Tactile display for use by blind and sight-impaired people has position motors movable between working and rest positions, sensor arrangement for interaction with user's fingers
WO2000042493A1 (en) Input or control unit for devices and method for generating control signals for devices
DE19739284A1 (en) System for capturing and processing user input

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CN HU IN JP KR US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP