TWI478013B - Click, double click with the drag action identification method and touch device controller - Google Patents

Description

Click, double click and drag action recognition method and controller of touch device

The invention relates to an action recognition method for simulating a mouse button and a controller thereof, in particular to a click, double-click and drag action recognition method and a controller of the touch device.

The Graphic User Interface (GUI) is the program interface that was first introduced by the Quantum PARC Lab. It can be used with a pointing device such as a mouse. The user only needs to visually The moving mouse and the click action can easily complete the action that you want to perform, effectively solving the inconvenience caused by the complicated input of the previous text mode. Therefore, the Windows interface has been adopted by Apple Computer and Microsoft (Microsoft), becoming the mainstream mode of all operating systems. In electronic devices that use the Windows interface system, such as desktop computers, notebook computers, tablets, personal digital assistants (PDAs), etc., the pointing device has become a basic device.

Currently, the pointing device includes a mouse for an external device, a trackball and a touch pad built on a portable computer system, and a touch panel combined with a screen, among which the mouse is the earliest. Introduced pointing device. Take the mouse as an example to illustrate the function of the pointing device. The mouse can control the pointer on the screen of the electronic device, where the mouse moves, where the indicator moves, and then the target to be executed on the screen. Press the control button to issue an execution command to the electronic device. However, the current design of electronic devices is moving toward a short and light, such as notebook computers. Gradually replacing the shipment of desktop computers, resulting in a small touch device (such as a touchpad) has gradually become the mainstream of the device.

At present, the technology of touch devices generally includes capacitive, resistive, electromagnetic, pressure, inductive, surface acoustic wave, ultrasonic, optical, and the like. When an object such as a finger moves on the touch device, the indicator can be moved in the direction in which the object moves. However, in addition to controlling the movement of the indicator, the pointing device also has the function of issuing an execution instruction.

For example, when the pointer moves to the target to be activated (such as a program or a file), if the mouse button is pressed once (Clicking, the system is preset to the left mouse button), the target can be selected; If you press the Double Clicking button twice, you can select the target and turn it on. If you continue to press the mouse button (such as the left button) and move the mouse, you can drag the target to another location. However, in the case of a touch device such as a touch panel, an action gesture of the object on the touch device can be defined to achieve the same purpose as the operation of the mouse.

Referring to Figures 1A-1C, a conventional touch device simulates mouse click, double click, and drag actions, such as US Patent Publication No. US6380931 "OBJECT POSITION DETECTOR WITH EDGE MOTION FEATURE AND GESTURE RECOGNITION" and US6414671 "OBJECT POSITION DETECTOR WITH EDGE MOTION FEATURE AND GESTURE RECOGNITION", using multiple timers to calculate the complex time interval of an object appearing on a touch device, and using these time intervals to calculate the click, double click, and drag actions. In the case of the click action program of FIG. 1A, the time interval T _down needs to be smaller than a first maximum reference time interval T _{max_1} . In the case of the double-click action program of FIG. 1B, the time interval T _down-1 needs to be smaller than the first maximum reference time interval T _{max_1} , and the time interval T _up-1 needs to be smaller than a second maximum reference time interval T _{max_2} , and the time interval T _down-2 needs to be less than a third maximum reference time interval T _{max — 3} . In the case of the drag operation procedure of FIG. 1C, the time interval T _down-1 needs to be smaller than the first maximum reference time interval T _{max_1} , and the time interval T _up-1 needs to be smaller than the second maximum reference time interval T _{max_2} . However, these conventional inventions have a relatively high cost of construction of logic circuits because of the complexity and complexity of the combination and comparison of time intervals. In addition, due to the personal difference of the user, each person performs a double-click and drag gesture on the touch device, and the time interval of each step may be different, resulting in a situation in which the conventional method is prone to misjudgment.

Referring to Figures 2A-2C, another conventional touch device simulates a mouse click, double click, and drag action, such as US Patent Publication No. US7180506 "METHOD FOR IDENTIFYING A MOVEMENT OF SINGLE TAP ON A TOUCH DEVICE", US7190356 "METHOD" FIG aND CONTROLLER FOR IDENTIFYING DOUBLE TAP GESTURES "and US7184031" METHOD aND CONTROLLER FOR IDENTIFYING a DRAG GESTURE ", the use of such conventional invention from a detection time T _detect, when analyzed from the detection object T _detect a touch of When a touch device is touched, the waveform of the touch signal is generated and terminated to correspondingly generate an operation signal representing an action of clicking, double clicking, and dragging. The detection time interval T _detect is the same length of time. The conventional invention effectively solves the shortcomings of the prior art judgment method by using the simple judgment rule of the prior art, but also because the click is started after the detection time T _detect , Double-clicking and dragging actions cannot quickly respond to user actions.

As described above, in order to improve the reaction time of performing the click, double click, and drag actions, and still maintaining a simple judgment rule to reduce the construction cost of the logic circuit, it is necessary to seek a solution.

Accordingly, it is a primary object of the present invention to provide a method for identifying a click motion.

Therefore, the click action recognition method of the present invention is used for recognizing an action of an object touching a touch device, and the identification method includes the following steps: (a) detecting that the object touches the touch device occurs, and (b) detecting whether an object contacts the touch device and leaving within a first reference time interval; (c) if the detection result of the step (b) is YES, then the first reference An operation signal is generated to indicate a touch start action after the end of the time interval; (d) after the first reference time interval ends, detecting whether the object is in contact for a second time within a second reference time interval The action of the touch device occurs, wherein the operation signal indicating the touch start action is maintained during the second reference time interval; and (e) if the result of the (d) step is no, then the second reference time interval ends The operation signal is terminated to indicate a touch end action to complete a one click action.

Further, a second object of the present invention is to provide a controller for a touch device.

Therefore, the controller of the touch device of the present invention is used for recognizing an object on the touch device. The controller includes: a contact detecting unit for detecting that the object touches the touch every time. When the action of the device occurs Corresponding to generate a touch pressure signal; a timing unit for timing when the object contacts the touch device, and ending timing when the object does not touch the touch device; and a gesture operation unit for The result of the detection by the contact detecting unit during a first reference time interval determines whether an operation signal is generated from the end of the first reference time interval to indicate a touch start action, and then according to the contact detection unit. As a result of the detection in a second reference time interval, determining whether the object contacts the touch device for a second time within the second reference time interval, wherein the indicating touch activation action is maintained within the second reference time interval An operation signal, if the object does not contact the touch device for a second time within the second reference time interval, terminating the operation signal from the end of the second reference time interval to indicate a touch end action to complete a Click on the action.

Furthermore, a third object of the present invention is to provide a double tap motion recognition method.

Therefore, the double-click motion recognition method of the present invention is used for recognizing an action of an object touching a touch device, and the identification method includes the following steps: (a) detecting that the object touches the touch device occurs, and starts (b) detecting whether the object contacts the touch device and leaving within a first reference time interval; (c) if the detection result of the step (b) is YES, then the first reference An operation signal is generated to indicate a touch start action after the end of the time interval; (d) after the end of the first reference time interval, detecting whether the object is in contact for a second time within a second reference time interval The action of the touch device occurs and the action ends; and (e) if the detection result of the step (d) is YES, the operation signal is terminated from the end of the second reference time interval to indicate the end of a touch Action, regenerating and ending another operation signal to indicate another tap start action and Touch to end the action to complete a double click action.

Further, a fourth object of the present invention is to provide a controller for a touch device.

Therefore, the controller of the touch device of the present invention is used for recognizing an object on the touch device. The controller includes: a contact detecting unit for detecting that the object touches the touch every time. When the action of the device occurs, a touch signal is generated correspondingly; a timing unit is used for timing when the object contacts the touch device, and ends when the object does not touch the touch device; and a gesture operation The unit is configured to determine, according to a result detected by the contact detecting unit within a first reference time interval, whether an operation signal is generated from the end of the first reference time interval to indicate a touch start action, and then according to the The result of the detection by the contact detecting unit within a second reference time interval determines whether the object touches the touch device a second time within the second reference time interval, and if so, from the second reference time interval The operation signal is terminated to indicate a touch end action, and another operation signal is generated and terminated to indicate another tap start and end action to complete a double tap action.

Furthermore, a fifth object of the present invention is to provide a drag motion recognition method.

Therefore, the method for identifying the drag action of the present invention is for recognizing an action of an object touching a touch device, and the method includes the following steps: (a) detecting that the object touches the touch device occurs, and starts (b) detecting whether the object contacts the touch device and leaving within a first reference time interval; (c) if the detection result of the step (b) is YES, then the first reference An operation signal is generated from the end of the time interval to indicate a touch start action; (d) after the end of the first reference time interval, detecting whether an action of the second contact with the touch device occurs and the action ends within a second reference time interval; and (e) if the The detection result of the step is: detecting that the second contact of the object with the touch device occurs, but the second reference time interval is not completed when the object touches the touch device for the second time. At the end, a continuous operation signal is generated until the operation of detecting the second contact of the object to the touch device is terminated to terminate the operation signal to complete a drag operation.

Further, a sixth object of the present invention is to provide a controller for a touch device.

Therefore, the controller of the touch device of the present invention recognizes the action of an object touching the touch device, and the controller includes: a contact detecting unit for detecting that the object touches the touch device each time When the action occurs, a touch signal is generated correspondingly; a timing unit is used for timing when the object contacts the touch device, and ends when the object does not touch the touch device; and a gesture operation unit And determining, according to the result detected by the contact detecting unit within a first reference time interval, whether an operation signal is generated from the end of the first reference time interval to indicate a touch start action, and then according to the contact The detecting unit detects whether the object contacts the touch device for a second time within the second reference time interval but does not leave the result of the second reference time interval. If yes, the second reference time interval At the end, a continuous operation signal is generated until the end of the action of detecting that the object touches the touch device for a second time to terminate the operation signal to complete a drag operation.

The utility model has the advantages of providing a better click, double click and drag motion recognition method of the touch device to improve the actions of performing click, double click and drag. The reaction time, and still maintain a simple decision rule to reduce the cost of logic circuit construction.

The above and other technical contents, features and advantages of the present invention will be apparent from the following detailed description of the preferred embodiments.

Referring to FIG. 4, the preferred embodiment of the present invention is applicable to an electronic device including a touch device 3, which can be used to recognize an object 2 on the touch device 3. To send an operation signal corresponding to the action to a host 4. It should be noted that the touch device 3 can be generally referred to as a capacitive, inductive, and other similar touch device 3. In the preferred embodiment, a capacitive touch device 3 is particularly referred to.

The object 2 is used for contacting the touch device 3, that is, according to the action of the object 2 on the touch device 3, the controller 1 sends a corresponding operation signal indicating the action to the host 4, generally these operation signals It can be divided into coordinates change, click, double click, drag, move, scroll, left button, right button, middle button, etc. to further simulate the behavior of the mouse and keyboard. Of course, the object 2 needs to cooperate with the touch device 3, such as the capacitive touch device 3, so the object 2 is a human finger or other kind of conductor.

The mainframe 4 refers to various electronic devices, such as a desktop computer, a notebook computer, a tablet computer, a personal digital assistant (PDA), a mobile phone, a remote control for various electrical appliances, or the like. An electronic device as an input device.

A preferred embodiment of the controller 1 of the touch device includes an analog/digital conversion The unit 11 , the coordinate calculation unit 12 , a contact detection unit 13 , a gesture operation unit 14 , an encoding unit 15 , a transmission interface unit 16 , and a timing unit 17 .

Since the touch device 3 has a plurality of wires distributed in the X and Y directions, when the object 2 touches the touch device 3, the capacitance value changes on the touch device 3, so that the voltage can be measured. The amount of change is used to calculate values such as coordinate values.

The analog/digital conversion unit 11 is connected to the touch device 3 and is capable of converting different voltage levels into corresponding digital signals for subsequent processing. After receiving the digital signal transmitted from the analog/digital conversion unit 11, the coordinate calculation unit 12 decodes the digital signal into a corresponding absolute coordinate value (X, Y).

The contact detecting unit 13 can detect whether the touch device 3 is pressed by the object 2, that is, according to the X and Y voltage signals transmitted by the touch device 3, the object 2 can be detected to contact the touch device 3, Correspondingly, a touch signal is generated. That is, when the contact detecting unit 13 detects the pressing, a touch signal is generated, as shown in FIG. 5, the waveform of the first time interval T ₁ and the second time interval shown in FIG. 6 and FIG. The waveform of T ₂ . That is, in the present invention, the time lengths of the first time interval T ₁ and the second time interval T ₂ are not calculated, but only the finger touches of the first time interval T ₁ and the second time interval T ₂ are calculated. The waveform changes, and in the present invention, other filtering noise modes (Low Pass Filter) and algorithms are used to avoid noise interference to the contact detecting unit 13.

The gesture calculation unit 14 is connected to the coordinate calculation unit 12 and the contact detection unit 13. The gesture operation unit 14 is mainly capable of detecting the result detected by the contact detection unit 13, and supplemented by the judgment logic built in the gesture operation unit 14. Determine whether the action performed by the user meets the conditions of click, double click, drag, and the like. The judging logic uses a first reference time interval T _LB1 and a second reference time interval T _LB2 as shown in FIG. 5 to match the timing of the occurrence and end of the touch signal, and the first reference time interval T _LB1 and the second The reference time interval T _LB2 is calculated by the same timer. This section will be described in detail below.

In addition to the determination of the action, the gesture operation unit 14 can also provide a relative amount of movement, that is, when a plurality of sets of absolute coordinate values are sequentially transmitted to the gesture operation unit 14, the gesture operation unit 14 can also calculate the difference according to different coordinates before and after. The relative movement amount of the object 2 on the touch device 3, even the parameters such as speed, direction, distance, etc., is to transfer the absolute coordinates or the relative movement amount to the host 4, depending on the application requirements on the host 4.

The encoding unit 15 is connected to the gesture computing unit 14, and thus can receive the absolute coordinate signal generated by the gesture computing unit 14, the relative movement amount signal, or the operation signal (including click, double click, drag, etc.). The encoding unit 15 encodes different signals into a handwritten input protocol or a standard mouse protocol for processing by the host 4 operating system, such as the mouse standard protocol of Microsoft Corporation, and the PS/2 mouse standard protocol of IBM Corporation.

The transmission interface unit 16 is configured to transmit the signal encoded by the encoding unit 15 to the host computer 4 in a serial manner. For example, the desktop computer is transmitted to the keyboard controller (not shown) or the south bridge. On the chip (not shown), in order to issue an Interrupt Request (IRQ) to the processor in the host 4, the host 4 can further obtain the coordinate position. Set and execute the necessary parameters such as actions to further move the cursor, select the program, or execute the program.

Referring to FIG. 3 and FIG. 4, the click, double-click and drag motion recognition methods of the present invention are applicable to the controller 1 described above, and include the following steps. First, as shown in step 51, the contact detecting unit 13 detects that the object 2 is in contact with The action on the touch device 3 occurs, and a touch signal is generated correspondingly. As shown in FIG. 5, the positive edge of the waveform of the first time interval T ₁ in the touch signal (the transient transition between the low level and the high level) refers to the occurrence of the contact action. At the same time, the gesture arithmetic unit 14 controls the timing unit 17 to start timing.

Next, as shown in step 52, the gesture operation unit 14 monitors whether the contact detecting unit 13 detects that the object 2 is in contact with the touch device 3 in the first reference time interval T _LB1 . If not, the contact detecting unit 13 re-detects that the action of the object 2 contacting the touch device 3 occurs as shown in step 51.

Conversely, if the detected object 2 in contact with the touch operation end 3 of the apparatus, as indicated in step 53 and 5, when the first gesture operation unit 14 calculates the timing unit 17 through the finger from the touch within _a period of T The waveform changes and produces a negative edge of the first time interval T ₁ waveform as shown in FIG. 5 (the high level transitions to a transient between the low levels), and an operation is generated from the end of the first reference time interval T _LB1 A signal to indicate a touch start action.

Then, as shown in step 54, the gesture operation unit 14 according to the detection unit 13 from contacting the T _LB2 at the time of a detection result of the second reference, determining whether the object 2 within the time T _LB2 from the second reference The touch device 3 is contacted for the second time, wherein the operation signal indicating the touch start action is maintained in the second reference time interval T _LB2 .

If the object 2 does not contact the touch device 3 for the second time in the second reference time from the T _LB2 , as shown in step 55, the operation signal is terminated from the end of the second reference time interval T _LB2 to indicate a Touch to end the action to complete a one-click action.

It should be noted that although the gesture operation unit 14 sends an operation signal to indicate the click action, the gesture operation unit 14 detects the first reference time interval T _LB1 and the second reference time interval T _LB2 , and the object 2 touches the touch. All the actions of the device 3 are used as the basis for the overall determination. Therefore, if the contact detecting unit 13 detects other touch signals in the second reference time interval T _LB2 (the detection result in step 54 is YES), then the above The operational signal will be extended to a double click (step 56) or a drag action (step 57) as described below.

As shown in step 56 and FIG. 6, the gesture computing unit 14 determines that the object 2 touches the touch device 3 a second time within the second reference time interval T _LB2 and leaves. Then, the gesture operation unit 14 terminates the operation signal from the end of the second reference time interval T _LB2 to indicate the touch end action, and generates and ends another operation signal to indicate another touch start and end action to complete. A double click action.

In another case, the detection result of the step 54 is YES. As shown in step 57 and FIG. 7, the gesture operation unit 14 determines that the object 2 touches the second time within the second reference time T _LB2 . The touch device 3 does not leave yet (not leaving before the end of the second reference time T _LB2 ), and generates a continuous operation signal from the end of the second reference time T _LB2 until the second object is detected. The operation signal is terminated after the end of the action of contacting the touch device to complete a dragging action.

In summary, the present invention has the following advantages: 1. Compared with the first prior art, the present invention does not need to set a multi-array timer, and the judgment condition is simpler, and accordingly the corresponding circuit design is less complicated and effectively reduced. production cost.

2. For the click action identification, compared with the click action recognition of the second prior art, if the detection time is the same as the T _detect time, the operation signal of the present invention is earlier than the second reference time interval T _LB2 time.

3. In the double-click motion recognition, compared with the double-click motion recognition of the second prior art, if the detection time is the same as the T _detect time, the present invention outputs the first operation signal early, reducing one signal transmission. time.

4. For the identification of the drag action, the present invention compares the time of the first reference time interval T _LB1 with the T _detect time when the detection time is the same as the T _detect time of the second _prior art. The second, third and fourth points above show that the present invention effectively improves the reaction speed when the touch device 3 is operated.

The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent.

1‧‧‧ controller

11‧‧‧ Analog/Digital Conversion Unit

12‧‧‧ coordinate calculation unit

13‧‧‧Contact detection unit

14‧‧‧ gesture arithmetic unit

15‧‧‧ coding unit

16‧‧‧Transport interface unit

17‧‧‧Time unit

2‧‧‧ objects

3‧‧‧ touch device

4‧‧‧Host

T ₁ ‧‧‧first time interval

T ₂ ‧‧‧second time interval

T _2a ‧‧‧ first half

T ₃ ‧‧‧ interval

T _LB1 ‧‧‧First reference time interval

T _LB2 ‧‧‧second reference time interval

T _X1 ‧‧‧ first time

T _X2 ‧‧‧ second time

51~57‧‧‧Steps

FIG. 1A is a timing diagram illustrating a conventional click action recognition method for generating a corresponding operation signal according to a click action; FIG. 1B is a timing chart illustrating that a conventional double click motion recognition method is generated according to a double click action. Corresponding operation signal; FIG. 1C is a timing diagram illustrating a conventional drag gesture recognition method for generating a corresponding operation signal according to a drag action; FIG. 2A is a timing diagram illustrating another conventional click motion recognition method according to a click action. A corresponding timing signal is generated; FIG. 2B is a timing diagram illustrating another conventional double-click motion recognition method for generating a corresponding operation signal according to a double-click motion; FIG. 2C is a timing diagram illustrating another conventional drag motion recognition. The method generates a corresponding operation signal according to the dragging action; FIG. 3 is a flowchart illustrating a preferred embodiment of the method for identifying click, double-click and drag actions of the present invention; FIG. 4 is a block diagram illustrating the present invention. A preferred embodiment of the controller of the touch device; FIG. 5 is a timing diagram illustrating that the click action recognition method of the preferred embodiment generates a corresponding operation signal according to the click action; FIG. 6 is a timing chart. The double-click motion recognition method of the preferred embodiment generates a corresponding operation signal according to the double-click action; and FIG. 7 is a timing diagram illustrating the drag operation of the preferred embodiment. The identification method generates a corresponding operation signal according to the drag action.

51~57‧‧‧Steps

Claims (6)

A click action recognition method is used for identifying a click action of an object touching a touch device. The identification method includes the following steps: (a) detecting that the object touches the touch device occurs, and starts a timing of a first reference time interval; (b) detecting whether the object leaves the touch device within the first reference time interval; (c) if the detection result of the step (b) is YES, then At the end of the first reference time interval, an operation signal for indicating a touch start action is generated, and a second reference time interval is started; (d) detecting whether the object is within the second reference time interval Performing a second contact action on the touch device, wherein the operation signal indicating the touch start action is maintained during the second reference time interval; and (e) if the result of the (d) step is no, then The operation signal is terminated when the second reference time interval ends to indicate a touch end action to complete a one click action. A controller for a touch device for recognizing a click operation of an object on the touch device, the controller comprising: a contact detecting unit for detecting when the object contacts and leaves the touch device a first touch signal and a second touch signal are generated; a timing unit is configured to measure a time at which the first touch signal generated by the object contacting and leaving the touch device occurs; and a gesture computing unit connected to the contact detecting unit and the meter a time unit, and calculating a result detected by the contact detecting unit within a first reference time interval and a second reference time interval, wherein when the first touch signal occurs in the first reference time zone, The gesture operation unit is configured to generate an operation signal to indicate a touch start action and start calculating the second reference time interval when the first reference time interval ends, when the contact detection unit is not in the second reference time interval Detecting the second touch signal of the object to the touch device, the gesture operation unit terminates the operation signal from the end of the second reference time interval to indicate a touch end action to complete a click operation. A double-click motion recognition method is used for identifying a double-click action of an object touching a touch device. The identification method includes the following steps: (a) detecting that the object touches the touch device occurs, and starts a first (b) detecting whether the object leaves the touch device within the first reference time interval; (c) if the detection result of the step (b) is YES, then At the end of a reference time interval, an operation signal for indicating a touch start action is generated, and a second reference time interval is started; (d) detecting whether the object is within the second reference time interval for the The touch device generates a second touch activation and the operation ends; and (e) if the detection result of the (d) step is YES, the operation signal is terminated from the end of the second reference time interval to indicate At the end of the touch action, another operation signal is generated and terminated to indicate another touch start action and a touch end action to complete a double tap action. A controller for a touch device for recognizing a double-clicking action of an object on the touch device, the controller comprising: a contact detecting unit configured to detect when the object contacts and leaves the touch device a first touch signal and a second touch signal are generated; a timing unit starts measuring time when the first touch signal occurs; and a gesture computing unit is connected to the touch detection unit a unit and the timing unit, and calculating a result detected by the contact detecting unit within a first reference time interval and a second reference time interval, wherein the first touch signal occurs in the first reference time zone The gesture operation unit is configured to generate an operation signal to indicate a touch start action and start calculating the second reference time interval when the first reference time interval ends, when the contact detection unit is at the second reference time interval. Detecting that the object generates and ends the second touch signal for the touch device, the gesture operation unit terminates the operation signal from the end of the second reference time interval to indicate a touch end action, and then Generate and Another beam striking operation signal to indicate the beginning and end of another operation, in order to complete a double click action. A method for identifying a drag action is used to identify an action of an object touching a touch device. The method includes the following steps: (a) detecting that the object touches the touch device occurs, and starts a first (b) detecting whether the object is away from the touch device within the first reference time interval; (c) if the detection result of the step (b) is YES, an operation signal for indicating a touch start action is generated from the end of the first reference time interval, and timing of a second reference time interval is started. (d) detecting whether the object has a second contact with the touch device during the second reference time and the action is completed; and (e) if the object is detected in the step (d) The second contact with the touch device occurs, but if the second touch of the object is not completed, the operation signal of the step (b) is continued from the end of the second reference time interval until the detection is completed. The operation signal is terminated when the object touches the end of the touch device for a second time to complete a dragging action. A controller for a touch device is configured to recognize an object that is touched by the touch device. The controller includes: a contact detecting unit configured to detect when the object contacts and leaves the touch device. Generating a first touch signal and a second touch signal; a timing unit that starts measuring time when the first touch signal occurs; and a gesture computing unit connected to the contact detecting unit And the timing unit, and calculating a result detected by the contact detecting unit within a first reference time interval and a second reference time interval, wherein the first touch signal occurs in the first reference time zone The gesture operation unit is configured to generate an operation signal to indicate a touch start action and start calculating the second reference time interval when the first reference time interval ends, when the contact detection unit is within the second reference time interval. Detecting that the object generates the second strike signal, When the second touch signal is not detected, the gesture operation unit continues to send the operation signal from the end of the second reference time interval until detecting that the object touches the touch device for the second time. The operation signal is terminated at the end of the action to complete a drag action.