KR101179584B1 - Virtual mouse display method on touchscreen and computer readable recording medium storing program performing the method - Google Patents

Abstract

The present invention displays a cursor linked to the movement of a pressing point or a touch point on a touch screen, and moves the cursor to a moving and stationary state according to whether the pressure point or the contact is detected. By activating or inactivating the cursor according to an event such as the number of detected points or the number of detected points simultaneously, the same convenience as using a mouse can be provided without a separate input tool. It would be.
Through the present invention, by improving the operation convenience of the information communication device to which the touch screen is applied can improve the input, output and processing performance that can be implemented by the device to ensure the performance as well as the diversity of the associated application program, Increasing the utilization of the device and creating new demand can activate the industry.

Description

VIRTUAL MOUSE DISPLAY METHOD ON TOUCHSCREEN AND COMPUTER READABLE RECORDING MEDIUM STORING PROGRAM PERFORMING THE METHOD}

The present invention displays a cursor linked to the movement of a pressing point or a touch point on a touch screen, and moves the cursor to a moving and stationary state according to whether the pressure point or the contact is detected. By activating or inactivating the cursor according to an event such as the number of detected points or the number of detected points simultaneously, the same convenience as using a mouse can be provided without a separate input tool. It would be.

Touch screen which can input information and visual output at the same time does not need a separate input device, and the operation method is intuitive and simple, so it can be used for various portable devices such as mobile phones and navigation systems, as well as multi-use devices such as cash dispensers and ticket vending machines, and industrial devices. It is used for various purposes such as an operation panel of a device and an operation panel of various home appliances.

Such a touch screen is constructed by stacking a touch sensing means such as a pressure-sensitive lattice on a screen on a display device such as an LCD (Liquid Crystal Display), which is somewhat different depending on the type of the touch sensing means. It may be, but by detecting the contact and pressure of the human body or object to output the position on the screen of the point.

FIG. 1 illustrates a basic input method of the touch screen 10 and illustrates a screen of a high-performance mobile communication terminal called a smart phone.

In the case of a portable information device such as a smart phone, it is necessary to aggregate necessary input and output devices in a narrow space, so most of the touch screen 10 is applied. (drag) to perform the required operation.

However, it is not only very difficult and inconvenient to touch or drag a small icon accurately on a narrow screen, but also causes a lot of inconvenience to the user due to a high possibility of misoperation such as touching another icon or point adjacent to the operation.

In addition, as soon as the finger touches a specific point in the touch screen 10, the point is hidden as well as the surrounding area, which makes the operability very inferior to that of a general personal computer having a large screen, and is particularly agile when performing complicated operations. Since operation is fundamentally impossible, operation takes a lot of time, and thus, there is a serious problem that the input / output and processing performance of the loaded application program must be limited.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and in the method of acquiring the coordinates of the cursor 11 displayed on the touchscreen 10, the coordinates Xc and Yc of the cursor 11 are Activation step (S10) is set to the initial value (Xc0, Yc0) and the cursor 11 is activated, and when the pressing point of the touch screen 10 is detected, the coordinates (Xf, Yf) of the corresponding pressure point is read (讀Calculation step of calculating the variance ΔX and ΔY between the read step S20 to be read and the pressure point coordinates Xf and Yf to be read and the pressure point coordinates Xf0 and Yf0 before the time increment Δt of the read period ( S31 and an interlocking step (S32) in which the variable (ΔX, ΔY) is added to the coordinates (Xc, Yc) of the cursor 11 and set to a new cursor (11) coordinates (Xc, Yc). This is how to implement virtual mouse in touch screen.

In addition, in the coordinate acquisition method of the cursor 11 displayed on the touchscreen 10, the coordinates Xc, Yc of the cursor 11 are set to initial values Xc0, Yc0, and scale (Sx, Sy) is set, the activation step (S10a) that the cursor 11 is activated, and when the pressing point (pressing point) of the touch screen 10 is detected, the coordinates (Xf, Yf) of the corresponding pressure point is read (讀Calculation step of calculating the variance ΔX and ΔY between the read step S20 to be read and the pressure point coordinates Xf and Yf to be read and the pressure point coordinates Xf0 and Yf0 before the time increment Δt of the read period ( S31 and an interlocking step of adding the product of the scales Sx, Sy and the variable ΔX, ΔY to the coordinates Xc, Yc of the cursor 11 to set the new cursor 11 coordinates Xc, Yc. A computer-readable recording medium recording a method for implementing a virtual mouse in a touch screen and a method for implementing the virtual mouse in a touch screen, characterized in that (S32a).

Through the present invention, the operation convenience of the information communication device to which the touch screen is applied is greatly improved, and the accuracy and speed of the input are also significantly improved.

This improves the input, output, and processing performance that can be achieved with touch screen information and communication devices, thereby ensuring the performance as well as the diversity of related applications.Increasing the utilization of the information and communication devices and creating new demands in related industries The effect of activating can be obtained.

1 is a view illustrating a conventional touch screen operation method
Figure 2 is an exemplary view of the touch screen operation method of the present invention
3 is an explanatory diagram of a virtual mouse cursor operating method according to the present invention;
4 is an explanatory diagram of a virtual mouse cursor movement method of the present invention;
5 is an explanatory diagram of a virtual mouse cursor movement method of the present invention according to discontinuous contact and movement
6 is a flow chart of the present invention.
7 is an explanatory diagram of a virtual mouse cursor movement method of the present invention to which a scale is applied;
8 is a flowchart of the FIG. 7 embodiment.
9 is a diagram illustrating an embodiment of a method of operation of the present invention to which a virtual boundary is applied;
10 is a diagram illustrating an embodiment of a method of operation of the present invention to which a virtual button is applied;

Detailed implementation of the present invention will be described with reference to the accompanying drawings.

First, as shown in FIG. 2 schematically illustrating an operation method of the touch screen 10 to which the present invention is applied, the cursor 11 is displayed on the touch screen 10, but the cursor 11 touches the touch screen 10. In order to move even when the user is in contact with the screen 10, such as a user's finger or a touch pen (touch pen).

That is, if the finger 11 is moved in a state where the finger is in contact with any part of the screen without directly touching the part where the cursor 11 is displayed on the touch screen 10, the cursor 11 is also moved correspondingly. By moving the cursor 11 to a desired position and then touching an arbitrary part of the screen of the touch screen 10, an event such as a mouse click is generated, whereby the user of the touch screen 10 You can get the convenience of a virtual mouse on the screen.

3 illustrates a series of processes for displaying and manipulating the cursor 11 of the virtual mouse. When the user selects the virtual mouse function, the screen of the touch screen 10 is once displayed as shown in the left screen of the figure. The cursor 11 in an inactivation state is displayed.

As such, when the cursor 11 is in an inactive state, the cursor 11 does not respond even if the user touches or moves to the touched state, thereby preventing misoperation.

Subsequently, when a user generates a specific event such as rapidly repeatedly touching the screen of the touch screen 10 or simultaneously touching two or more fingers, the cursor 11 is activated as shown in the center screen of FIG. 3.

In the state where the cursor 11 is activated, when the user touches and moves a finger at an arbitrary point in the touch screen 10, the cursor 11 also moves in conjunction with the user's movement as shown in the right screen of FIG. 3. It can be seen that the cursor 11 moves to the same trajectory as the user's finger in the contact state.

4 and 5 illustrate the interlocking process of the cursor 11 in detail. Coordinates (Xf0, Yf0) to (Xf3, Yf3) displayed on the user's finger movement path in the contacted state in FIGS. 4 and 5 are illustrated. The points of X denote the positions of the pressing points or touch points periodically read, and the points of the coordinates Xc0 and Yc0 to the coordinates Xc3 and Yc3 displayed on the movement path of the cursor 11. The position of the cursor 11 calculated in conjunction with the pressure point or the contact point is displayed.

That is, as shown in the illustrated screen example, once the cursor 11 is activated, even if the user's finger touches and moves to any point on the screen of the touch screen 10, the cursor 11 moves to the same trajectory. In this way, the user can operate extremely intuitive and simple, such as operating by placing a small mouse on the screen of the touch screen 10.

In the screens illustrated in FIGS. 4 and 5, the movement path of the cursor 11 is displayed as a continuous line segment while the trajectory of the user's finger is smoothly curved, which means that the conventional touch screen 10 detects the pressure point. It is not because it is performed continuously, but because it is performed periodically. Since the actual user's operation trajectory is composed of infinite points, it cannot be read out and processed. The touch screen 10 has a constant time increment Δt. The coordinates Xf and Yf of the pressure point are repeatedly read. Therefore, the coordinates Xc and Yc of the cursor 11 calculated based on the read pressure points form the nodes of the continuous line segments.

The path of the cursor 11 illustrated in the drawing exaggerates the time increment Δt for clarity, and in practice, since the micro time increment Δt is applied, the trace of the finger and the cursor 11 are visible to the naked eye. It is not possible to distinguish the difference in the movement route.

5 illustrates a movement path of the cursor 11 displayed as the finger touches the touchscreen and then touches and moves again. When the touched finger is removed from the touch screen 10, the cursor 11 Since it does not react, when using a general mouse, when it is necessary to move the mouse pointer relatively far, it is possible to obtain an operation effect such as removing the mouse from the table and touching it again.

That is, the implementation of the virtual mouse cursor 11 of the present invention is not a dimension to solve the inconvenience, such as the finger covering the screen by simply spaced apart the cursor 11 from the finger in contact with the touch screen 10 screen, In the overall operation of the cursor 11, such as the adjustment of the movement state and the movement path, the convenience is maximized by providing almost the same operation environment as the mouse of the desktop computer that general users are familiar with.

6 is a flowchart illustrating a specific process of displaying the above-described virtual mouse cursor 11 on the touch screen 10 and interlocking with a user's operation. Is the same as

First, when a user calls a virtual mouse function of the present invention by operating a specific function key of an information device to which the touch screen 10 is applied or touching a specific icon on the screen, the user deactivates the touch screen 10 once. The cursor 11 in the state is displayed.

Thereafter, when the user generates an activation event such as rapidly touching the screen of the touch screen 10 or touching two or more fingers simultaneously, the cursor 11 is activated and the coordinates Xc and Yc of the cursor 11 are initialized. An activation step S10 set to Xc and Yc) is performed.

When the cursor 11 is activated, the touch screen 10 waits for the user's input, that is, the user's touch screen 10 contacts, and when the user's contact is made and a pressing point of the touch screen 10 is detected, the touch screen 10 corresponds to the touch screen 10. A reading step S20 is performed in which the coordinates Xf and Yf of the pressure point are read.

After that, the difference between the pressure point coordinates (ΔX, ΔY) is calculated by calculating the difference between the pressure point coordinates (Xf, Yf) read and the pressure point coordinates before the read period time increment (Δt), that is, the pressure point coordinates (Xf0, Yf0) immediately read. ) Is calculated and the interlocking step (S32) in which the variable (ΔX, ΔY) is added to the coordinates (Xc, Yc) of the cursor 11 and set as the new cursor (11) coordinates (Xc, Yc). Cursor 11 is displayed in conjunction with the pressure point.

Here, since the previous pressure point coordinates cannot exist during the first reading of the pressure point coordinates Xf and Yf, the time t is repeatedly erased or initialized (t = 0) before the detection of the pressure point, and the reading step S20 to the interlocking step are performed. After (S32), it is determined whether or not the first reading of the pressure point coordinates (Xf, Yf) by increasing the time (t), and the first pressure point coordinates (Xf0, Yf0) to the previous pressure point coordinates (Xf, Yf) The error can be prevented by setting the same as Xf, Yf so that the coordinate variables ΔX and ΔY are zero.

As described above, by repeating the reading step S20 to the interlocking step S32, the cursor 11 can move in association with the user's finger trajectory as shown in FIG. 4, and as shown in FIG. 6, the pressure point When the detection of the pressing point is stopped (off), the time t is cleared or initialized again (t = 0), and then the above-described reading step S20 to interlocking step S32 are resumed depending on whether the pressure point is detected. And by repeating, as shown in FIG. 5, the cursor 11 continuously reacts and moves even when the user releases his finger, touches it again, and moves.

7 and 8 illustrate screens and flowcharts of embodiments in which a scale is applied to apply a kind of scale between the pressure point and the movement of the cursor 11, and as can be seen from the drawings, the contact state By increasing or reducing the user's finger movement speed and the movement speed of the cursor 11 at a constant ratio, more efficient and convenient operation is possible.

That is, as illustrated in FIGS. 7 and 8, when the scales Sx and Sy are set to 0.5, the cursor 11 moves at a speed corresponding to 0.5 times the moving speed of the user's finger, thereby enabling more precise manipulation. If more than 1 scale is set, faster operation is possible.

As described above, in the present invention, the cursor 11 can be continuously moved even when the user releases his / her finger in the activated state of the cursor 11 and then touches it again. The long distance movement of the cursor 11 is possible through the operation of removing a finger and then touching it again.

For this processing, as shown in FIG. 8, the coordinates of the cursor 11 are set to initial values Xc0 and Yc0 as well as an activation step S10a for setting the scales Sx and Sy, and the coordinates of the cursor 11. An interlocking step S32a is performed in which a product of the scales Sx and Sy and the variables ΔX and ΔY is summed to set the new cursor 11 coordinates Xc and Yc.

9 and 10 illustrate a screen that can be implemented using the characteristics of the present invention in operating the touch screen 10 to which the present invention is applied. First, FIG. 9 illustrates a virtual boundary 12 on the screen of the touch screen 10. ) To move the screen when it is difficult to display the entire contents on one screen.

That is, as shown in FIG. 9, when the cursor 11 in progress reaches the virtual boundary 12 set on the screen of the touch screen 10, the screen is moved when an additional movement of the pressure point in the advancing direction occurs. In the prior art of setting a touch point of a user's finger as a pointer, not the virtual mouse cursor 11 of the present invention, since the touch point pointer cannot escape the screen of the touch screen 10, the setting of the virtual boundary 12 and It is fundamentally impossible to use.

In addition, FIG. 10 is a button similar to a general mouse is displayed on the lower part of the screen of the touch screen 10. The left, center, and right screens of the mouse are respectively displayed on the left button, the right button, and the scroll wheel. The situation in which the corresponding operation is performed is shown, and the shape of the activation state cursor 11 also changes in the operation of each button.

10: touchscreen
11: cursor
12: virtual boundary
13: virtual button
S10: activation step
S20: reading stage
S31: calculating step
S32: Interlocking Step

Claims (3)

delete In the method of acquiring the coordinates of the cursor 11 displayed on a single touchscreen 10 capable of simultaneously inputting and visually outputting information,
The coordinates Xc and Yc of the cursor 11 on the touch screen 10 are set to initial values Xc0 and Yc0, the scales Sx and Sy are set, and the cursor 11 is activated. Step S10a;
A reading step S20 of reading coordinates Xf and Yf of the corresponding pressure point when a pressing point of the touch screen 10 is detected;
A calculation step (S31) of calculating the variation (ΔX, ΔY) between the read pressure point coordinates (Xf, Yf) and the pressure point coordinates (Xf0, Yf0) before the time increment (Δt) of the read period;
In the interlocking step (S32a) in which the product of the scale (Sx, Sy) and the variable (ΔX, ΔY) is added to the coordinates (Xc, Yc) of the cursor 11 and set to a new cursor (11) coordinates (Xc, Yc). Virtual mouse implementation method in the touch screen, characterized in that made.
A computer-readable recording medium having recorded thereon a program for performing a method for implementing a virtual mouse in a touch screen of claim 2.

Images