ES2600310B1 - System and procedure for mouse emulation by light beam - Google Patents

Abstract

System and method for mouse emulation using a light beam. # This invention allows the use of a light beam, which can be a laser pointer, projected directly on the computer screen, to emulate the use of the mouse. A software, based on the image provided by a pickup element, calculates the coordinates of the point where the beam of light strikes and causes the computer cursor to follow the evolutions thereof. # You can also, by some operations emulate the pulsation of the mouse buttons. # With the use of virtual keyboards you can enter texts with which the control of the computer is practically complete. # With this system, users with certain disabilities can use any standard software without special adaptations.

Description

DESCRIPTION

System and procedure for mouse emulation by light beam.

INDICATION OF THE SECTOR AND STATE OF THE TECHNIQUE 5

The most popular human input interfaces in computer equipment are the keyboard and mouse.

The computer systems present the information, text or graphic, to the user and this by means of mouse movements moves a cursor on the screen, allowing him to point different elements presented therein. With the buttons that the mouse has, it can trigger the execution of different actions, normally related to the pointed element. For the introduction of text elements the user has the keyboard.

There are circumstances that make it impossible for certain users to handle these 15 devices preventing them or at least making it difficult for them to use the computer.

EXPLANATION OF THE INVENTION

 twenty

This invention allows the projection of a beam of light, which can be a laser pointer, to emulate the operation of the mouse. If the user retains some mobility in some part of his body, the pointer can be attached to it, and in this way it will be enabled for the use of the computer. 25

The operation is simple. The user moves the light emitting element (2), which can be a laser pointer, through the screen (1) and the cursor follows the evolution of this allowing him to point out the different elements shown therein. By fulfilling certain conditions, which are explained below, the user can also emulate the mouse buttons.

By emulating the mouse the user is also able to enter the text elements. This will be enough with the use of virtual keyboards on the screen.

If a user with disabilities retains some mobility in some part of his body we can fix the pointer. For example: a front, a bracelet ... This way you can make use of the computer without practically restrictions.

As shown in Figure 1, a light emitting element (2) sends a beam of light (4), which can be laser, on the screen (1) of the computer equipment. A pickup element (3), which can be a webcam, captures

the image of the screen and by means of software (9) executed in the computer equipment (8) the position of impact of the beam on the screen is determined. This software (9) is capable of, based on this position and its movements, performing operations such as moving the cursor, emulating mouse button presses, executing certain 5 operations and using virtual keyboards, making keyboard inputs , thus allowing us full control of the equipment.

One of the main difficulties is to discriminate the beam point on the screen (1) and the image that is represented on it and calculate the coordinates 10 in which it is located. To facilitate this discrimination, it is convenient to separate the image presented on the screen from the light spot projected by the light emitting element (2).

BRIEF DESCRIPTION OF THE DRAWINGS 15

Figure 1: Representation of system blocks.

Figure 2: Representation of system blocks in their polarization version.

Figure 3: Representation of system blocks in their 20 reflection version.

Figure 4: Representation of cursor tracking zones (option 1).

Figure 5: Representation of cursor tracking zones (option 2).

Figure 6: Example of holding and using the pointer.

 25

PREFERRED EMBODIMENT OF THE INVENTION

To solve the problem, described above, of identifying the point where the beam of light strikes, the following embodiments are proposed:

 30

Polarizing option, shown in Figure 2:

LCD screens, very common in computer equipment, emit polarized light. With the use of a polarizing filter (5) we can, properly oriented, make the image presented on the screen disappear, however seeing all the rest including the light spot caused by the light beam 35. Putting the polarizing filter (5), properly oriented, in front of the camera, it will capture an image of the screen and its surroundings including the light beam but without the image shown on it. In this way the camera obtains an image similar to that which would be obtained with the screen turned off, the location of the luminous point 40 being very simplified and therefore the software (9).

Reflection option, shown in Figure 3:

When the previous option cannot be used, or in other cases that is convenient, a flat and transparent element (6), for example glass, can be placed between the user and the screen as presented in Figure 5 3, in such a way Let the pointer beam be divided in two. One part continues to be projected on the screen allowing its tracking to the user and another part is reflected projecting on a surface (7). A sensor element (3), which can be a webcam, collects the image of the point, produced by the light emitting element (2), projected on the surface 10 (7) and the software (9) performs the calculations and precise operations . (Depending on the position of the camera the surface should be translucent). In this way, the image delivered by the sensor element (3) only contains the light point created by the light emitting element (2), which also simplifies the calculation. fifteen

The invention includes procedures for tracking the cursor and selecting and executing different operations.

There are two problems to solve: The selection of the operation to execute 20 (example. Right click, double click ...) and the execution of this operation being the only tool available the beam of light.

Operation selection: A pop-up menu that, to avoid unnecessary occupation of a screen space, appears and disappears according to specified conditions. Example: appears when the luminous point 25 is taken out of the camera's capture space ... Through this menu the user can select which operation (Double click ...) will be performed when the execution condition is met. Similarly you can select the appearance of the virtual keyboard, mouse wheel simulator ...

Execution of the operation: You can set a condition that will be the 30 that triggers the execution of the selected operation. Example: When the user remains with the beam without displacing it for a period of time. (it is considered no displacement to be in the vicinity of a point during that period of time). Other conditions may occur as described below. 35

If the tracking of the cursor to the light point becomes precise (the cursor is positioned in the place where the beam is) it is difficult to point at small objects, and even harder to stay on top of them. To achieve greater accuracy and less dependence on the stability of the pointer, different algorithms can be used. The one described in figure 4 for example

It establishes several zones around the cursor and different behavior for each of them.

Zone A: the permanence of the beam in this zone triggers the execution of the selected operation according to some procedure like the one described above. 5

Zone B: While the beam is in this zone no operation is performed.

Zone C: The cursor will move in the direction of the beam at reduced speed.

Zone D: The cursor will move in the direction of the beam at high speed.

In this way the user can move the cursor quickly to the destination area. Position precisely and trigger the desired operation 10 by placing the beam on the cursor. Having one zone of inactivity and another to trigger the operation gives you greater control when executing commands or operations.

Zones C and D can be unified into one as proposed in Figure 5 15 (E) where the cursor travel speed is variable depending on the distance between the cursor and the light beam.

This tracking implies that the capture of the beam should also be carried out outside the image area of the screen as clearly seen in Figure 6 20

Everything described above requires a calibration process to establish the relationship between the coordinates of the light spot in the image provided by the camera and the corresponding coordinates on the screen. As an example, within the multiple possible methods for that purpose, the software (9) can request the user to point the beam at points known as the four corners of the screen and memorize their values.

Claims (1)

1 Mouse emulation system using a light beam comprising:  Light emitting element (2), preferably collimated, which can be laser.  Capture element (3) of the screen image (1) and surroundings.  Software element (9) that calculates the coordinates of the light spot, which produces the light beam on the screen and / or surroundings, and performs the relevant actions. 10 Characterized by a beam of light emitted by the light emitting element (2), preferably collimated, which projected on the screen (1) of a computer equipment (8) is captured by a sensor element (3), which can be a webcam , and that by means of the software (9) it allows the positioning of the cursor and execution of operations and 15 commands in said equipment. 2 The system of claim 1; characterized by a polarizer (5) that interposes between the screen (1) and the sensor element (3) so that properly oriented eliminate the image presented by it, 20 thereby isolating the light spot produced by the light emitting element ( 2). 3 The system of claim 1; characterized by a flat and transparent element (6) that interposes between the user and the screen and allows the reflection of the beam on a translucent surface and the capture of this image that contains only the luminous point facilitating the calculations. 4 Procedure for mouse emulation by light beam, using the system of claims 1, 2, 3. Characterized in that the user moves the light beam through the screen (1) and the cursor follows this displacement. When it stops the movement and remains in the same position for a set period of time, the execution of the preselected operation 35 is triggered. 5 Procedure for mouse emulation by light beam, using the system of claims 1, 2, 3, characterized by tracking the cursor, based on the establishment of zones 40 according to the distance of the cursor and the luminous point, in this case the area of capture of the luminous point is extended to the areas bordering the screen. The user moves the light spot across the screen and bordering areas. 5 When the user keeps the light point in the area closest to the cursor (A), during a certain time, it triggers the execution of the preselected operation. While the user moves the light point over the zone (B) no activity occurs, over the area (C) there is a slow movement of the cursor 10 in the direction of the light point and if it does over the area (D) it occurs a quick movement of the cursor towards the luminous point. 6 Procedure for mouse emulation by light beam according to claim 5; characterized in that the last two zones are unified and the behavior in this new zone is the movement of the cursor in the direction of the luminous point at a speed that depends on the distance between them. Method for mouse emulation using a light beam according to claims 4, 5, 6; characterized by the acquisition of parameters such as coordinates, screen resolution ... with or without user intervention. 8 Method for mouse emulation by light beam according to claims 4, 5, 6; characterized by automatic parameterization based on the image received by the sensor. Method for mouse emulation using a light beam according to claims 4, 5, 6; characterized by the memorization of 30 all the necessary parameters for the calculation of coordinates, operations and any other necessary data or that facilitates the execution of the software (9)