JPH09237149A - Portable terminal equipment and its short cut processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability by depressing a button on a pointing device, detecting the locus of a cursor from the start point of dragging, and when the detected locus coincides with a prescribed locus, executing corresponding short cut. SOLUTION: In the case of previously registering short cut processing, a registration start signal is inputted from the external, a detection means 2 executes time division processing for a locus obtained from the start of dragging up to its release by the use of a detection timer 3, vectorizes a group of points formed by the time division in a cursor moving direction and registers the vectorized information in a processing registering means 5. Then the detection means 2 detects a coordinate position pointed by the pointing device to be an input means 1 by the timer 3 at each fixed time and an analyzing means 4 analyzes the vector of a locus found out from the coordinate position. A judging means 6 judges whether the previously registered locus coincides with the analytical result or not, and at the time of judging the coincidence of the locus, a processing means 7 executes short cut.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile terminal device that performs shortcut processing.

[0002]

2. Description of the Related Art Conventionally, as a portable terminal device mainly for handwriting input in a computer or the like, a handwriting input device such as a pen is used to recognize characters and gestures written on a display device, and a gesture registered in advance is recognized. Those that perform corresponding processing are known.

[0003]

However, processing by handwriting recognition is not common in computers and the like that do not mainly handle handwriting input. Therefore, the present invention is based on the recent G
A mouse, a trackpad, a trackball, which is generally used on the display screen of a computer, which mainly has a graphic user interface called UI.
In a mobile terminal device and a mobile terminal device capable of recognizing a coordinate group through which a cursor passes on a display device of a computer using a pointing device such as a track point and realizing a shortcut operation using a vector of a required trajectory. An object is to provide a shortcut processing method.

[0004]

To this end, the portable terminal device of the present invention has an input means which is a pointing device, a detection means which detects a coordinate position pointed to by the pointing device on a display screen, and a trajectory vector. A timer means for detecting the coordinate position for every constant time for obtaining, a analyzing means for analyzing the vector of the locus obtained from the displayed coordinate position, and a process registration means for registering the process corresponding to the previously registered locus. , A determination means for determining whether the content of the registered trajectory matches the analyzed content, a processing means for actually performing a shortcut when the content of the trajectory matches as a result of the determination, and a time for tracking the trajectory. And the whole timer means which defined.

Further, the step of vectorizing the locus input by the input means, the step of analyzing the obtained vector, the step of judging the transition of the change of the entire locus, and the degree of ambiguity in the vector obtained in said step In consideration of the above, the step of comparing with the matching pattern of the pre-registered locus and the step of executing the shortcut when it is determined that there is a matching result of the determination, the shortcut processing in the mobile terminal device is performed. Configured method.

[0006]

According to the configuration of the present invention, the trajectory of the cursor is detected and registered in advance from the time when the process called dragging, which is usually carried by a pointing device and is moved, is started. When the content of the trajectory matches, the shortcut corresponding to the content can be performed.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of a mobile terminal device according to an embodiment of the present invention, FIG. 2 is an embodiment diagram of time division of the same trajectory, FIG. 3 is a diagram of vectorization of the trajectory, and FIG. The state transition diagram of the same registration, FIG. 5 is the state transition diagram of the same determination, FIG. 6 is a grouping diagram of the same vector, FIG. 7 is a diagram considering the magnitude of the same vector, and FIG. 8 is considering the inclination of the same vector. It is a figure.

In FIG. 1, reference numeral 1 is an input means such as a pointing device such as a mouse, 2 is a detection means for detecting a coordinate position of a computer display screen pointed to by the input means 1, and 3 is an input means 1. Is a detection timer for detecting the coordinate position pointed by the input means 1 at fixed time intervals in order to follow the movement of the position pointed by on the display screen. Further, 4 is an analyzing means for analyzing the vector of the locus obtained from the coordinate position, 5 is a processing registering means for registering a shortcut process corresponding to the previously registered locus, and 6 is the contents of the previously registered locus and the analyzed contents. It is a determination means for determining whether they match. Further, 7 is a processing means for actually executing the processing registered by the processing registration means 5 when it is recognized as the same trajectory as a result of the determination, 8
Is an overall timer that determines the time for tracking the trajectory in order to obtain a highly reliable gesture function.

Regarding the registration of the locus of the point pointed by the pointing device which is registered in advance, the locus obtained from the input means 1, the detection means 2, the detection timer 3, the analysis means 4 and the whole timer 8 is registered as a matching pattern. I'll do it.

FIG. 2 shows an example in which the locus obtained by the input means is time-divided by a timer. (1) of FIG. 2 shows the direction in which the cursor advances, and is shown by a solid line for easy understanding. (2) of FIG. 2 is a time-divided trajectory, in which the cursor position is shown as dots at regular time intervals.

When a shortcut process to be registered is registered in advance, a signal (signal) for starting registration is externally input, and dragging (movement with the button of the pointing device pressed) is started and released. Time-division processing is performed by using the detection timer 3 on the locus between them. This processing is performed by the detection means 2 in FIG. Further, the timer interval can be changed arbitrarily, the individual difference in input can be reduced, and the setting of the recognition degree can be changed.

FIG. 3 shows the vector of the inclination to the next point in the direction in which the cursor moves in the set of points formed by time division in FIG. (1) of FIG. 3 is shown in FIG.
This is the same as (2) in (2) above, but the trajectory is time-divided.
In (2) of FIG. 3, the points of the locus are connected by arrows. The vectorized information is registered in advance, whereas the shortcut processing to be actually realized is registered by the processing registration means 5.

FIG. 4 is a state transition diagram showing the operation when a shortcut is registered. When the registration start is determined (state 1), dragging is started (state 2), the coordinates of the trajectory are detected (state 3), and the drag state is determined (state 4). Is time-divided (state 5). This processing is performed by the detection means 2 in FIG. The detection timer in state 5 corresponds to the detection timer 3 in FIG.
Also, from the drag determination in state 4, vectorization of the locus in state 6 is performed at the time when the dragging ends, and this state 6 corresponds to the analysis unit 4 in FIG. The state 7 in which the locus obtained from the above processes is registered corresponds to the processing means 7 in FIG. The time division and vectorization of the loci shown in FIGS. 2 and 3 are also performed when the desired shortcut is actually realized.

Here, the problem is that it is impossible to draw exactly the same trajectory as the information of the trajectory registered in advance and the trajectory when actually performing a shortcut. Although the position of the locus can be solved by making the locus into a vector, it is necessary to determine with respect to the size of the locus and the distortion of the locus by setting a certain limit frame. Specifically, it is necessary to make a determination with a certain error with respect to the inclination angle of the locus obtained by the vector of the locus. Further, since it is difficult to make the speed of drawing the locus the same, it is necessary to perform processing based on the change of the locus vector.

FIG. 5 is a state transition diagram showing the operation of the determination of the trajectory obtained from the input means when realizing the shortcut considering the ambiguity to some extent. First, the input locus is vectorized (state 8), the obtained total vector is analyzed (state 9), and the transition of the change of the entire locus is determined (state 10). The state transitions from state 10 to state 11, the ambiguity is taken into consideration, the practical problem that the shapes of the trajectories cannot completely match is avoided, and comparison is made with a matching pattern of trajectories registered in advance (state 14) is performed, and the state is changed to 12. The processing so far corresponds to the determination means 6 in FIG.

When it is determined from the shortcut registration table in the state 15 that there is a match in the determination result, the state shifts to the state 13 to execute the corresponding shortcut. This corresponds to the processing means 7 in FIG.

FIG. 6 shows a vector group formed by grouping the vector groups according to the degree of change. Further, FIGS. 7 and 8 are examples of giving ambiguity. In FIG. 7, the size of each vector is enlarged or reduced from the size of the entire locus so that the grouped vectors have ambiguity. In FIG. 7, 9 is the original vector, 10 is the vector minimization, and 11 is the vector maximization. As a result, when the shapes of the gestures drawn by the loci are the same, they are considered to be the same regardless of the size. FIG. 8 takes into account the slope within a certain range so that the grouped vectors have ambiguity. Reference numeral 9 is the original vector, 12 is the counterclockwise tilt of the vector, and 13 is the clockwise tilt. This makes it possible to ignore gesture distortion within a certain range.

By taking into account these vector magnitudes and inclinations, comparison with the previously registered matching data is performed, and if the result of the determination is that it is the same as the matching data, then it corresponds to the matching data. Make a shortcut to

[0019]

As described above, according to the portable terminal device of the present invention, it is possible to realize a shortcut from the locus passed by the pointing device, so that the operability of the computer is improved.

[Brief description of drawings]

FIG. 1 is a configuration block diagram of a mobile terminal device according to an embodiment of the present invention.

FIG. 2 is an embodiment diagram of time division of a trajectory of a mobile terminal device according to an embodiment of the present invention.

FIG. 3 is a form diagram of making a trajectory of a mobile terminal device into a vector according to an embodiment of the present invention.

FIG. 4 is a state transition diagram of registration of the mobile terminal device according to the embodiment of the present invention.

FIG. 5 is a state transition diagram of determination of the mobile terminal device according to the embodiment of the present invention.

FIG. 6 is a grouping diagram of vectors of the mobile terminal device according to the embodiment of the present invention.

FIG. 7 is a diagram in consideration of vector magnitude of the mobile terminal device according to the embodiment of the present invention.

FIG. 8 is a diagram in which a vector inclination of the mobile terminal device according to the embodiment of the present invention is considered.

[Explanation of symbols]

 1 Input Means 2 Detecting Means 3 Detecting Timers 4 Analyzing Means 5 Processing Registering Means 6 Judging Means 7 Processing Means 8 Overall Timers 9 Original (original) Vectors 10 Minimizing Vectors 11 Maximizing Vectors 12 Counterclockwise Slanting 13 Sloping vector clockwise

Claims (2)

[Claims] 1. An input means which is a pointing device, a detection means which detects a coordinate position pointed to by a pointing device on a display screen, and a timer means which detects the coordinate position at regular time intervals in order to obtain a trajectory vector. , The analysis means for analyzing the trajectory vector obtained from the displayed coordinate position, the processing registration means for registering the process corresponding to the previously registered trajectory, and the content of the registered trajectory and the analyzed content match. A determination means for determining whether or not, as a result of the determination, a processing means for actually performing a shortcut when the contents of the loci match, and an overall timer means for setting a time for tracking the locus, Mobile terminal device. 2. A step of vectorizing the locus input by the input means, a step of analyzing the obtained vector, a step of determining the transition of the change of the entire locus, and an ambiguous vector obtained in the step. The step of comparing with a matching pattern of a pre-registered trajectory after considering the degree, and performing a shortcut if it is determined that there is a matching result of the determination, Shortcut processing method in mobile terminal device.