DE102008053537A1 - Evaluation of the movement of objects with a field of at least two light-emitting diodes - Google Patents

Abstract

The invention relates to a system (1) for evaluating the movement of an object (2) with a field of at least two light emitting diodes (11, 12), wherein at least one light emitting diode (11) is provided for light emission (21) and at least one light emitting diode (12 ) is provided for sensing and evaluating the light immission of the light emitted by the object (2) back emitted light (22). Furthermore, the invention relates to a method for determining the position of at least one object (2) in front of such a system (1).

Description

The The invention relates to a system for evaluating the movement of objects with a field of at least two light-emitting diodes and a method for Determining the position of at least one object in front of a system of arranged in an array LEDs.

The Operation of modern electronic devices is still mostly of complicated and awkward to be operated remotes and input devices.

The Digitization and convergence in the living room is progressing. A Set of device types with increasing functionality crowd into the living room to the Favor of consumers to fight. These devices can be classified into different categories. In addition to the TV VCRs, set-top boxes, Hi-Fi amplifiers, game consoles, Media Center PC and similar equipment Moving into the living room.

The Variety of these devices offers a possibility Operation by external input devices provided to the user the possibility give the device to use without the control options on the device perceive. An external input device for controlling consumer electronics mentioned above equipment is typically called remote control.

These Input devices provide as a user interface to the controller the functionalities a combination of switches, buttons, wheels, motion detection sensors, Joysticks, etc. The controls are typically arranged on top of the input device.

The Assignment of keys is mostly in direct relation to one functionality of the device to be controlled. This implies that an increasing number of directly to be driven functionalities an increasing number of switches and buttons result.

By the mobile application is the size of the input devices one for the user critical element. exceeds An input device of a certain size is not accepted by the user. This implies that the previous remote controls the increasing Number of functionalities can no longer operate intuitively if they are ergonomic accepted limits of the user (form factor, number of keys) do not exceed.

The options All about classic television are expanding significantly these days with digital recording devices, like digital video recorders (storage of broadcast program content) or so-called "video on demand "services (Streaming / - or download services using a suitable set-top box be made visible on the TV) With the introduction of the new device classes expand the functionalities those with input devices to be controlled. In contrast to the operating model of a traditional analog TV, mainly via number keys, as well as direct selection of the functions via function keys became new devices typically over hierarchical menu controls navigated. The novel user interfaces are used for display of media content mostly the list-like visualization of multiple elements. This can be both horizontal and vertical respectively. Control by external input devices are typically arrow keys used in a computer keyboard. This possibility the operation restricts However, the use of the user interface, as the control via arrow keys only two states allows: Pressed / Not pressed. It is not possible to enter intermediate values. It is thus a binary one Type of operation. However, this is for intuitive operation new graphical user interface not suitable. insofar there is a need to develop a novel graduated possibility for operation.

The equipment Consumer electronics have been in the past few years too powerful Mini-computers designed to work in performance with early PCs are to be compared. This technical development allows the use operating systems and complex software to control functionality.

It is to be expected that the abilities of devices significantly expand consumer electronics in the coming years become. This concerns, among other things, the computing power, the capabilities for the representation of graphic elements as well as the possibilities of the data storage in persistent and non-persistent storage elements.

These Performance enhancement of devices The maintenance electronics will lead to functionalities that mainly today running on the PC (Internet applications, e-mail, games, etc), even on one Device of Consumer electronics available to stand. The operation of such functions is, however, with the existing input devices not or only partially available.

In computers have to control a keyboard in addition to input devices such as touchpads, mouse, trackballs, Writepads and the like puts. In applications where the input and monitor coincide, a "trend" develops via touch screen input and gesture control. However, this is not suitable for remote screen control. Input devices that allow similarly complex and flexible modes of operation are not yet available for consumer electronics devices.

Consequently there is a need to develop an input device which touchpad-based operation of remote devices allows to enable the operation of novel user interfaces.

task The invention is an apparatus and a method for improved Input of commands available to provide, in which the operation is simplified.

These Task is performed by a system for evaluating the movement of objects according to the features of claim 1 and a method for determining the position of at least one object according to the features of the claim 9 solved.

According to the invention is a System for evaluating the movement of objects with a field of at least two LEDs proposed in which at least one Light emitting diode is provided for emitting light and at least one Light-emitting diode for evaluating the light immission of the object back scattered emitted light is provided.

The Novelty in the invention is thus the newly enabled use of gestures to control a remote device. The control takes place over it an "Eyeless Control "control. This means that given a control of the input device must be without having to look at the input device itself. While the user's point of view is directed to the screen is it so possible for him to establish direct contact with the surface of the system with the fingers to perform gestures, which are used to control the graphical user interface. The gestures can are typically done by the thumb. But it is also one Operation with other fingers possible. Likewise, gestures are possible which executed with several fingers become. The device is alike operable with the left and right hands.

gestures are directed movements that are exercised with the finger can and thereby a functionality in the graphical user interface trigger. These gestures can have linear as well as curved character. Likewise is a sequence of gestures possible to complex gestures to generate. It is both a juxtaposition of gestures with and without interrupting the direct contact of the finger to the surface of the Sensor field possible.

in the Contrary to classical control over arrow keys, which only one binary control option deliver, allows the invention a gradation of the inputs by the speed with the gestures performed become. this makes possible a much more accurate and intuitive operation of the graphical User interfaces.

The Invention allows besides detecting a direct contact of a finger with the sensor surface as well the recognition of an approach a finger to the surface. Thus it is possible a functionality through the approach a finger to a defined distance from the surface. As well can mentioned above Gestures performed will not touch without the touchpad surface. This also activates a functionality of the device. This proximity-sensitive Behavior allows a novel way of operating graphical user interfaces and the associated Equipment.

application for the Invention is the operation of all devices the possibility provide a remote operation. Typically this is around devices which is based on a graphical user guide own a screen. However, by means of defined gestures is also a control of devices without screen-based user guidance possible.

typical Applications include televisions, set-top boxes, DVD recorders, media Center PCs, as well as all devices which serve to display and / or receive audiovisual content. Likewise, the applications include devices that represent Internet-based Serve all kinds of content. This also applies to the control of systems for the automated control of electronic devices (Home Automation).

As well the invention is suitable as a control for video-based games to serve.

The gestures that are performed on or above the sensor field serve to control various elements. The gestures allow a complete replacement of previous remote controls. It is possible to operate list-like elements, as well as to make number entries via defined gestures. Likewise, any functions (such as color keys, playback / rewind / jump functions) can be linked with gestures. The direct contact, as well as the approach to the sensor field is also suitable for to move any object on the screen (for example, a cursor), or to move the displayed content on the screen. It is also possible to operate a virtual keyboard via touch or proximity gestures.

To A particularly preferred embodiment of the invention is provided, in that the light emitting diode serving for evaluation of the light emission first is reversed, thereby charging the junction capacitance After that, the discharge time affected by the incident light becomes the junction capacity measured by a measuring unit.

preferably, For example, a plurality of light-emitting diodes are arranged in an array.

From Advantage will be one or more light emitting diodes for the evaluation of Light immission switched.

A Another embodiment provides that the light-emitting diodes dynamic alternating to the light emission or to the evaluation of the light immission be switched.

From The advantage is the light-emitting diodes of all the same type.

A Another embodiment of the invention provides that the light-emitting diodes form the matrix of a screen.

According to one Further development of the invention, it is provided that the light-emitting diodes arranged behind a light-transmitting surface forming touch panel are and together form a touchscreen (tactile screen).

• – Messung der individuellen Entladungszeiten jeder einzelnen Leuchtdiode, insbesondere durch mehrfache Bestimmung der Entladungszeiten jeder einzelnen Leuchtdiode,
• – Bestimmung der Entladungszeiten der einzelnen Leuchtdioden, wobei bei Unterschreitung eines Schwellwertes einer Leuchtdiode davon ausgegangen wird, dass sich vor derjenigen Leuchtdiode ein Objekt befindet,
• – es wird eine Matrix mit n mal n Leuchtdioden um die Leuchtdiode in der eine Unterschreitung festgestellt worden ist als Feld ausgewählt,
• – das Feld und dessen Messwerte wird rechnerisch auf eine (n + (n – 1)) mal (n + (n – 1)) Matrix erweitert und die neuen Zwischenwerte aus den vorher ermittelten Messwerten interpoliert, wobei insbesondere für die diagonal interpolierten Werte ein Abschlag von ca. 10% vorgenommen wird,
• – die Ermittlung der Position wird durch eine Bestimmung der Minimalwerte in dem interpolierten Feld vorgenommen.

According to a further aspect of the invention, a method for determining the position of at least one object in front of a system of light emitting diodes arranged in an array according to one of claims 1 to 8 is proposed, which is characterized by the method steps:

• Measurement of the individual discharge times of each individual light-emitting diode, in particular by multiple determination of the discharge times of each individual light-emitting diode,
• Determination of the discharge times of the individual light-emitting diodes, wherein, when a threshold value of a light-emitting diode is undershot, it is assumed that an object is located in front of that light-emitting diode,
• A matrix with n times n light-emitting diodes around the light-emitting diode in which an undershoot has been detected is selected as the field,
• The field and its measured values are computationally extended to a (n + (n-1)) times (n + (n-1)) matrix and the new intermediate values are interpolated from the previously determined measured values, in particular for the diagonally interpolated values Discount of about 10% is made,
• - The determination of the position is made by a determination of the minimum values in the interpolated field.

A Embodiment of the method suggests that multiple measurements performed in succession and so on a movement and / or the speed of the / Objects relative to the system can be detected.

From Advantage is relative to the determined speed and movement calculated to the system a touch dynamics of a virtual keyboard.

advantageously, become the sequentially determined discharge times of a light emitting diode compared to each other and from the difference of the same is on the changing one Removal of objects closed.

Further advantageous embodiments will become apparent from the other dependent claims or their possible Subcombinations.

following the invention will be further explained with reference to the drawings. in the Individual shows the schematic representation in:

1 a schematic representation of an arrangement of a system of two light emitting diodes,

2 the system off 1 wherein one of the light emitting diodes is reverse-connected,

3 the system off 1 wherein the discharge time of one of the light-emitting diodes is measured,

4 the system off 1 wherein the discharge time of one of the light-emitting diodes is measured as a function of backscattered light,

5 the schematic course of ideal and real LED,

6 a schematic representation of the system with amplifier,

7 the schematic course of ideal and real LED, with amplification of the signal,

8th an exemplary array of light emitting diodes,

9 the array off 8th , where a first Group of light emitting diodes is switched for sensing,

10 the array off 8th wherein a second group of light emitting diodes is connected for sensing,

11 the array off 8th , wherein a third group of light emitting diodes is connected for sensing,

12 an exemplary flowchart of the method according to the invention,

13 a table of measured values,

14 the tabular measurement table 13 with interpolations,

15 the tabular measurement table 13 after further calculations, and

16 a schematic representation of an application of an inventive system in a screen with touch panel (touch screen).

The in the figures, the same reference numerals designate the same or the same acting elements.

In the 1 to 3 is a system 1 of two light-emitting diodes, for evaluating the movement of an object 2 with a field of at least two light-emitting diodes 11 shown and explained in principle.

1 shows the adjacently arranged, suitable for light emission LEDs. The currently for the evaluation of the light immission 22 serving light emitting diode 12 For this purpose, it is first switched in reverse direction A ( 2 ), whereby the junction capacitance is charged, thereafter the discharge time of the junction capacitance influenced by the incident light is detected by a measuring unit 3 measured ( 3 ).

Is exploited in 5 schematic difference shown between the course of ideal and real LED, caused by the capacity of the LED.

Is located as in 4 shown, an LED's 11 emitted light 21 reflective object 2 in the measuring range, so will light 22 on the serving for the evaluation of the light emission LED 12 reflected, which discharges faster than when no light has been interspersed.

This is a detection of the object 2 allows.

In 6 an embodiment of the invention is shown in which the signal of the light emitting diode used for detection 12 by means of an amplifier circuit 6 is raised. As a result, the course of the discharge curve, as in 7 shown schematically, slightly raised, making it better readable.

In 8th is an exemplary array 5 of light emitting diodes 11 shown, wherein each of the light-emitting diodes can be switched as to the detection of the backscattered light. For this purpose, all anodes of the respective column and all cathodes of the respective row were connected to one another. With an (n × n) LED matrix, this leads to n columns and n rows which have to be controlled. The advantage of this arrangement is the small number of control line, the disadvantage in the insufficient illumination of the LED to be measured. If, for example, the middle LED is measured for a 3 × 3 matrix and thus column 2 is grounded, row 2 is at Vdd (see 10 ), all the LEDs of the row and column 2 are switched off and only the diagonal LED to be measured is switched on. Particularly bad here is the measurement of the corner LED 'possible, as in 9 clarified.

However, a control in groups is possible, as in 11 shown.

Also here all the anodes of a column are connected to each other, however be for the cathodes used twice as many control lines, the first control line for all cathodes are located in odd columns, the second for all cathodes are in straight columns. This is achieved that when switching to the measurement state not the entire Row must be turned off and so always in addition to the diagonal LEDs also the two right and left of the LED to be measured available LED can be used for lighting.

In 12 is an exemplary flowchart of a method for determining the position of at least one object in front of a system of light emitting diodes arranged in an array.

Here is the first measurement 71 to determine the distance of an object above a light emitting diode performed on all light emitting diodes of the LED matrix. The measured value which has been determined is stored in a matrix which contains exactly as many elements as the actual LED matrix. After it has been determined that all LEDs have been measured once 72 , checks whether one or more measured values is below the previously defined threshold value 73 , If the measured value of even one LED is below a threshold value, this is set to Close the object above the LED and start calculating the position. For this purpose, as in 13 schematically using a matrix 81 The table showing the first measured (n × n) matrix on a (n + (n-1)) × (n + (n-1)) matrix 82 (please refer 14 ) and the new intermediate values are interpolated from the previously determined measured values 74 ,

When Special feature exists for the diagonally interpolated values are a discount of z. B. 10% of the common Sum to give a clear even with 4 equal values To obtain mean value.

In order to determine the position, essentially the minimum values are determined within the interpolated field 75 ,

to Coordinate conversion is the first coarse determination of the column and number of detected minima multiplied by 10.

For fine determination is as in 15 shown a 3 × 3 matrix with one of the minima from the matrix 82 cut out, interpolated again 83 and here again the minimum determined.

For coordinate conversion, the column and row of the determined minimums are multiplied by 2 as fine determination and added to the coordinate value previously determined during the coarse determination 76 ,

Finally, the position can be determined on the basis of the obtained values 77 ,

In 16 is an application of an inventive system shown. In this case, the light-emitting diodes form 11 . 12 the matrix also used for display 41 a screen 4 ,

In addition, the LEDs are 11 . 12 behind a touch panel forming a light passage surface 42 arranged together and form a touch screen (tactile screen).

1

system

11 12

led

11

led to the light emission

12

led for sensing

2

object

21

light emission

22

light pollution

3

measuring unit

31

ideal course

32

real course

33

course with reinforcement

4

screen

41

matrix a screen

42

Touch panel

5

array

6

amplifier

71 to 77

steps

81 to 83

Measurement tables

Claims (12)

System ( 1 ) for evaluating the movement of an object ( 2 ) with a field of at least two light-emitting diodes ( 11 . 12 ), wherein at least one light emitting diode ( 11 ) for light emission ( 21 ) is provided and at least one light emitting diode ( 12 ) for sensing and evaluating the light immission of the object ( 2 ) back scattered emitted light ( 22 ) is provided. System according to claim 1, characterized in that the for evaluation of the light immission ( 22 ) serving light emitting diode ( 12 ) is initially reverse biased (A) thereby charging the junction capacitance, then the discharge time of the junction capacitance affected by the incident light is detected by a measuring unit (A). 3 ). System according to claim 1 or 2, characterized in that a plurality of light-emitting diodes ( 11 . 12 ) in an array ( 5 ) are arranged. System according to one of claims 1 to 3, characterized in that one or more light-emitting diodes ( 12 ) for the evaluation of the light immission ( 22 ). System according to one of claims 1 to 4, characterized in that the light-emitting diodes ( 11 . 12 ) are switched dynamically alternately to the light emission or to the evaluation of the light immission. System according to one of claims 1 to 5, characterized in that the light-emitting diodes ( 11 . 12 ) are all of the same type. System according to one of claims 3 to 6, characterized in that the light-emitting diodes ( 11 . 12 ) the matrix ( 41 ) of a screen ( 4 ) form. System according to one of the preceding claims, characterized in that the light-emitting diodes ( 11 . 12 ) behind a light transmission surface forming touch panel ( 42 ) are arranged together and form a touch screen (tactile screen). Method for determining the position of at least one object ( 2 ) in front of a system ( 1 ) arranged in an array light-emitting diodes according to any one of claims 1 to 8, characterized by the method steps: measurement of the individual discharge times of each individual light-emitting diode, in particular by multiple determination of the discharge times of each individual light-emitting diode, determination of the discharge times of the individual light-emitting diodes, if below a threshold value of a light-emitting diode it is assumed that an object precedes that light-emitting diode - a matrix with n times n light-emitting diodes around the light-emitting diode in which an undershoot has been detected is selected as a field, - the field and its measured values are calculated to be one (n + (n-1)) times (n + ( n - 1)) matrix and the new intermediate values are interpolated from the previously determined measured values, in particular for the diagonally interpolated values a reduction of approximately 10% being made, the position being determined by a determination of the minimum values in the interpolated field performed. Method according to claim 9, characterized in that that several measurements are carried out one after the other and thus a movement and / or the speed of the object (s) relative to the system is detected can. Method according to claim 10, characterized in that that from the determined speed and movement relative to System a touch dynamics in particular a virtual keyboard is calculated. Method according to claim 10 or 11, characterized that the successively determined discharge times of a light-emitting diode be compared with each other and from the difference of the same the changing one Removal of objects is closed.