WO2010134725A2

WO2010134725A2 - Gesture-based user interface system and method for same

Info

Publication number: WO2010134725A2
Application number: PCT/KR2010/003073
Authority: WO
Inventors: 문태훈
Original assignee: 팅크웨어(주)
Priority date: 2009-05-21
Filing date: 2010-05-14
Publication date: 2010-11-25
Also published as: KR20100125703A; CN102483648A; WO2010134725A3; KR101094636B1

Abstract

Disclosed are a gesture-based user interface system and a method for same. The user interface system comprises: a coordinate extraction unit which extracts a start point and an end point from coordinate data obtained by an input event, and at least one peak between the start point and the end point; and a gesture recognition unit which recognizes at least one gesture from the shape of the line connecting the start point and the end point through the peak.

Description

Gesture based user interface system and method

Embodiments of the present invention relate to a gesture-based user interface system and method for improving convenience and variety of operation.

Early user interfaces were designed as text-based interfaces for interacting with computers. This allowed ordinary users to enter commands using the keyboard, which was very difficult for ordinary users who did not know this command system.

Later, with the introduction of a mouse-like input mechanism, the user interface developed into an icon-based menu. Not only did this increase the use of the computer, it was also easily accessible for beginners using the computer for the first time. However, with the development of computer environment, various devices and technologies are developed and user's needs are complicated, and new interface technology is required.

Human-computer interface (HCI) is a field of research to address these needs. More specifically, human-computer interface (HCI) is a more intuitive way of interacting with computers through various human-centered interfaces such as visual, auditory, and tactile. It is a field that deals with how to communicate. In particular, among the current HCI technology, voice recognition technology and gesture recognition technology are used as the most convenient interface technology.

Meanwhile, the navigation system receives a destination from a user and guides the way to the corresponding destination. Most navigation systems receive GPS signals from GPS satellites, calculate location information of the vehicle being driven, calculate the shortest distance to the destination, and display or voice guidance on the map.

As the functions of the navigation system become more diverse and complicated, it is difficult to control the navigation terminal by only general button operations. Furthermore, in view of the fact that the navigation terminal is used while driving, a user interface that is easy to operate is required.

One embodiment of the present invention provides a user interface system and method for recognizing a new type of gesture.

One embodiment of the present invention provides a gesture-based user interface system and a method for allowing a user to easily determine whether a gesture is applied.

According to an aspect of the present invention, there is provided a gesture-based user interface system including: a coordinate extractor configured to extract a start point and an end point and at least one vertex between the start point and the end point from coordinate data according to an input event; And a gesture recognition unit recognizing at least one gesture from a form of a line connecting the start point and the end point via the vertex.

In one embodiment of the present invention, the coordinate extracting unit determines coordinate data having a vertical distance of a line segment connecting the start point and the end point from the coordinate data existing between the start point and the end point as the vertex.

In one embodiment of the present invention, the gesture recognition unit determines the position of the vertex from a vector product of a start vector which is a direction vector from the vertex to the start point and an end vector which is a direction vector from the vertex to the end point. User interface system.

In one embodiment of the present invention, the gesture is set a function related to the control of the map screen being displayed in the navigation system, or a function related to movement to a menu provided by the navigation system.

A gesture-based user interface system according to an embodiment of the present invention includes a gesture display unit for displaying the movement path of the recognized gesture; And a symbol display unit that displays a symbol related to the gesture.

In one embodiment of the present invention, the gesture display unit maps a texture representing the movement path to a position corresponding to the coordinate data, or an animation using a sprite image having a different position of an image for each frame at a position corresponding to the coordinate data. Display.

In a gesture-based user interface method according to an embodiment of the present invention, a gesture-based user interface method of a user interface system including a coordinate extractor, a gesture recognition unit, and a function execution unit, coordinates by an input event in the coordinate extractor Extracting a start point and an end point from data and at least one vertex between the start point and the end point; And recognizing, by the gesture recognition unit, at least one gesture from a form of a line connecting the start point and the end point via the vertex.

A gesture-based user interface method according to an embodiment of the present invention includes the steps of executing a function corresponding to the recognized gesture in the function execution unit; Displaying a movement path of the gesture in the function execution unit; And displaying a symbol related to the gesture in the function execution unit.

According to an embodiment of the present invention, by providing a user interface capable of recognizing a new type of gesture, various functions can be set and used in the gesture, and the use of the user interface can be further expanded.

According to an embodiment of the present invention, by providing a gesture display function for displaying the movement path and the symbol of the gesture input by the user, it is easy to check the form and the application of the gesture input by the user.

According to an embodiment of the present invention, by applying a user interface for recognizing a new type of gesture to a navigation system, a function related to moving to a menu is set to a new type of gesture, thereby enabling easy and quick access to frequently used functions. This allows safe use of the user interface while driving.

1 is a diagram illustrating an internal configuration of a gesture-based user interface system according to an embodiment of the present invention.

2 is a view for explaining the form of a new gesture.

3 to 5 are diagrams for explaining an example of a gesture recognition process.

6 is a view for explaining another example of a gesture recognition process.

7 and 8 are views for explaining an example of the movement path display of the gesture.

9 is a view for explaining another example of the movement path display of the gesture.

10 and 11 illustrate an example of displaying a movement path and a symbol of a gesture in a navigation system.

12 is a diagram illustrating the entire process of a gesture-based user interface method according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. Like reference numerals in the drawings denote like elements.

The user interface system according to an embodiment of the present invention refers to an input means to which gesture recognition technology is applied.

Referring to FIG. 1, the gesture-based user interface system includes a coordinate extractor 110, a gesture recognition unit 130, and a function execution unit 150. The function execution unit 150 includes a gesture display unit 151 and a symbol display unit 153.

The coordinate extractor 110 detects an input event by the input gesture when the user inputs a gesture by using a finger or a stylus. That is, the coordinate extractor 110 detects coordinate data by the input event. The coordinate extractor 110 may refer to a touch-based input device such as a touch screen or a touch pad that detects a user's touch position at a predetermined time interval, but is not limited thereto. Other input devices such as a mouse may be employed. Can be.

One embodiment of the present invention is not only a linear or curved gesture (hereinafter, referred to as a 'general gesture') that can be recognized using a starting point and an ending point such as ←, →, ↑, ↓, but also <,>, ∧, ∨. A technique for recognizing a straight or curved gesture (hereinafter, referred to as a "bent gesture") including an angled point (that is, a vertex) is proposed.

The coordinate extractor 110 extracts at least one vertex from among coordinate data existing between the start point and the end point and the start point and the end point from the coordinate data of the input event.

2 is a view for explaining the form of the bending gesture.

When analyzing the coordinate data through the bent gesture input by the actual user, as shown in Figure 2 it can be seen that consists of at least three points. In this case, since the input direction of the gesture is not related to gesture recognition, there is no limitation. By simplifying the coordinate data of the break gesture, it is possible to recognize that the same gesture shape is the same for the same gesture.

The Ramer Douglas Peucker algorithm can be applied to simplify the coordinate data of the break gesture. Ramer Douglas Peucker's algorithm is based on the segmentation approach, and uses the vertex data of the curve to simplify the curve by reducing the input vertex data while maintaining the original shape of the curve.

A typical Ramer Douglas Peucker algorithm is as follows.

Referring to FIG. 3, in the coordinate data, the segment 305 is connected to each point between the start point 301 and the end point 305 as the line segment 305 and exists between the start point 301 and the end point 305. Find the vertical distance from In this case, a point having the largest vertical distance with the line segment 305 among the coordinate data existing between the start point 301 and the end point 305 is selected as the vertex 307. At this time, if the vertical distance with the line segment 305 with respect to the vertex 307 is less than the constant distance constant value, it is determined as a vertex included in the simplification of the curve and stored in the vertex list. On the other hand, when the vertical distance with the line segment 305 with respect to the vertex 307 is greater than a constant distance constant value, the coordinate data between the start point 301 and the vertex 307, the vertex 307 and the end point 303 The above process is repeated for the coordinate data in between to search for a new vertex.

An embodiment of the present invention may recognize a break gesture by finding a start point, an end point, and one vertex. That is, in the Ramer Douglas Peucker algorithm, only the first process, that is, the process of finding one vertex between a start point and an end point, may be performed to recognize a break gesture from a form of three points.

Referring to FIG. 4, the coordinate extractor 110 extracts a start point 401 and an end point 403 from coordinate data by an input event, and then coordinates existing between the start point 401 and the end point 403. Among the data, the maximum point, that is, the vertex 407, of the vertical distance D between the line segment 405 connecting the start point 401 and the end point 403 is extracted. In this case, the coordinate extractor 110 determines that the vertex 407 is a vertex that can be used to recognize the bending gesture when the vertical distance D with the line segment 405 is greater than a predetermined distance constant value. On the other hand, the coordinate extractor 110 determines that the vertex 407 is a vertex that cannot be used to recognize the bending gesture when the vertical distance D of the vertex 407 is smaller than a predetermined distance constant value. It ignores and uses the start point 401 and the end point 403 to recognize a general gesture.

The gesture recognition unit 130 performs a role of recognizing the shape of the bending gesture from the start point, the end point, and the vertex extracted from the coordinate extractor 110. The gesture recognition unit 130 may recognize the shape of the bending gesture according to the shape of the line connecting the start point and the end point through the vertex. In order to recognize the shape of the gesture, a bent gesture having a form of <,>, ∧, ∨ may be recognized according to where the vertex is located based on the start point and the end point.

Referring to FIG. 5, the gesture recognition unit 130 may include a direction vector (hereinafter, referred to as a 'start vector') from the vertex M to the start point S, and an end point at the vertex M. A direction vector (hereinafter referred to as an end vector) B directed to E) is obtained. Subsequently, the gesture recognition unit 130 obtains the vector product C of the start vector A and the end vector B, and then the vector value Cx for the x-axis or the vector for the y-axis in the vector product C. The position (left, right, up, down) of the vertex M may be determined according to the value Cy. The gesture recognition unit 130 may recognize the shape (<,>, ∧, ∨) of the folding gesture by determining the position of the vertex M.

The function execution unit 150 executes a function corresponding to the gesture recognized by the gesture recognition unit 130. One embodiment of the present invention after distinguishing the normal gesture of the form where the vertex does not exist, such as ←, →, ↑, ↓ and the bending gesture of the form where the vertex exists, such as <,>, ,, ∧ A function corresponding to a recognized type of gesture may be performed.

In the process of applying the break gesture, a different gesture may occur depending on the type or performance of the system. FIG. 6 illustrates coordinate data of an input event by a bent gesture in the form of a bevel. Here, 'Down' means an event indicating the start point of the coordinate data, 'Up' means an event indicating the end point of the coordinate data, and 'Move' means an event indicating points existing between the start point and the end point.

If the down / move / up events are clearly distinguished, gesture recognition is performed in the up event, but in a system using a forced touch method, an unwanted up event may occur in the middle of a gesture input.

In FIG. 6, the coordinate data of the left side (case 1) and the right side (case 2) have the same form of a folding gesture. However, case 1 is recognized as a bent gesture because the Up event does not occur during gesture input. On the other hand, in case 2, since an unwanted Up event occurs during the gesture input, it may be recognized as a gesture for the first Up event and a gesture for the second Up event, that is, two types of gestures. In order to solve this problem, an embodiment of the present invention accumulates the recognized gesture using the priority of the gestures after accumulating the recognized gesture until the final Up event without applying the recognized gesture at the time of the first Up event. Applicable

If the gesture of the first up event is in the form of a general gesture and the gesture of the second up event is in the form of a bend gesture, the gesture of the second up event is finally recognized. It determines the gesture and performs the function corresponding to the gesture of the second Up event.

An embodiment of the present invention performs a gesture display function of displaying a movement path of a gesture recognized by the gesture recognition unit 130 and a symbol related to the gesture so that a user may confirm whether the gesture input by the user is applied.

The gesture display unit 151 may display a movement path of the gesture, and the symbol display unit 153 may display a symbol related to a gesture or a symbol related to a function corresponding to the gesture. In particular, the gesture display unit 151 displays the movement path of the gesture on the coordinate data by the input event using a texture mapping technique or an animation technique.

The gesture display process by the texture mapping technique is as follows.

The gesture display unit 151 generates a polygon between two adjacent points in the coordinate data of the input event, and then maps a texture composed of a plurality of images to the generated polygon to indicate a movement path of the gesture. Referring to FIG. 7, in order to generate a polygon, two adjacent points, that is, coordinate data of a previous position (hereinafter, referred to as a line point) 701 and coordinate data of a current position (hereinafter, referred to as a “post point”) 703 is used. First, it is determined whether the polygon is generated through the distance between the line point 701 and the after point 703. For example, when one image constituting the texture has a size of 32 * 32, it is determined whether the polygon is generated. The distance to do may be determined to be 32 pixels. That is, when the distance between the line point 701 and the back point 703 is more than a predetermined distance, it is determined to generate a polygon between the line point 701 and the back point 703. Subsequently, a unit direction vector is obtained from the line point 701 to the rear point 703, and then rotated 90 degrees by the unit direction vector at the line point 701 and the rear point 703, respectively. At this time, four points can be obtained at the top and bottom of the coordinate data of the point rotated 90 degrees by the unit direction vector, that is, the line point 701 and the rear point 703, and the polygon 705 is formed using the four points. Can be configured. Then, the gesture display unit 151 maps the texture in a pattern manner according to the width of the polygon generated through the above process. For example, when using the texture 801 composed of five images of 32 * 32 as shown in FIG. 8, the image of the texture 801 is applied to the polygon generated on the coordinate data by the input event according to the direction of the gesture. Map sequentially. At this time, the gesture display unit 151 sequentially changes the image of the mapped texture according to the survival time of the polygon. Polygon 1 has the longest survival time and shortens the polygon's survival time as it progresses toward the progress of the gesture. According to an embodiment of the present invention, by changing the image of the texture according to the time when the polygon is generated and elapsed, that is, the survival time, the texture representing the movement path of the gesture may be gradually disappeared over time. According to an embodiment of the present invention, whether the gesture is applied or not and the result of the gesture should be performed quickly, the time required to execute the result should be the same, so that the display of the movement path of the gesture is performed by using a survival time. do.

The gesture display process by the animation technique is as follows.

The gesture display unit 151 may display the movement path of the gesture in a manner that is normally used to give an animation effect in a game. Referring to FIG. 9, an embodiment of the present invention may use a sprite image 901 having a different position of an image for each frame as an animation for representing a movement path of a gesture. As illustrated in FIG. 9, the gesture display unit 151 may perform display of a movement path of a gesture by differently applying coordinates of an image for each frame to one object in coordinate data by an input event.

The gesture-based user interface system according to an embodiment of the present invention may be applied as an input means of the navigation system. The navigation system can be used by adding a new type of bend gestures (<,>, ∧, ∨) to the conventional gestures (←, →, ↑, ↓, touch). The general gesture may be set for functions related to control of the map screen being displayed, for example, map position shift (touch), map zoom (↓) / reduction (↑), and current position shift (←, →). have. In addition, the break gesture may be a function related to moving to a menu provided by the navigation system, for example, a function such as returning home, a favorite place, a recent destination (<), and canceling a route (>). Can be set. In the case of the folding gesture, a menu frequently used by the user may be set, particularly a menu related to setting / canceling / changing a path. One embodiment of the present invention may adjust the execution time of the recognition result (function corresponding to the gesture) according to the characteristics of the gesture. The general gesture recognizes the gesture and simultaneously executes the recognition result, and the break gesture executes the recognition result after the gesture recognition is completed.

The gesture-based user interface system applied to the navigation system may define the priority among the gestures as shown in Table 1.

Table 1

Function (Gesture Type)	Priority
Menu functions (<,>, ∧, ∨)	0
Move current location (←, →)	One
Map Zoom In (↑) / Map Zoom Out (↓)	2
Move map location (touch)	3
None	4

As described with reference to FIG. 6, the gesture-based user interface system applied to the navigation system has a higher priority by comparing the priority of the gestures when two or more gestures are input due to an unwanted Up event in the process of recognizing a gesture. Determine the gesture as the final gesture. That is, because the unwanted gesture is frequently recognized as a normal gesture due to an unwanted Up event in the process of inputting the gesture, the folded gesture is set to have a higher priority than the normal gesture.

The navigation system to which the gesture-based user interface system is applied according to an embodiment of the present invention may display the movement path and the symbol of the gesture in the process of recognizing the gesture.

Referring to FIG. 10, when a user inputs a general gesture, the movement path 101 of the general gesture input from the user and a symbol 103 related to the function of the general gesture may be displayed on the navigation screen. In addition, referring to FIG. 11, when a user inputs a bend gesture, a movement path 111 of the bent gesture input from the user and a symbol 113 related to the function of the bent gesture may be displayed on the navigation screen. The movement path of the gesture may be displayed on the coordinate data by the input event, and a symbol related to the function of the gesture may be displayed at a position adjacent to the movement path of the gesture.

12 is a diagram illustrating the entire process of a gesture-based user interface method according to an embodiment of the present invention. Here, the gesture-based user interface method may be executed by the user interface system shown in FIG.

The gesture-based user interface method according to an embodiment of the present invention extracts coordinate data by a gesture-based input event through the coordinate extractor 110 (S1201). In particular, in one embodiment of the present invention after extracting the start point and the end point from the coordinate data by the input event, the vertical distance between the line connecting the start point and the end point is the most among the coordinate data existing between the start point and the end point. Extract large vertices

In the gesture-based user interface method according to an embodiment of the present invention, the gesture recognition unit 130 recognizes the shape of the gesture input by the user from the form of a line connecting the start point and the end point through a vertex (S1202). . An embodiment of the present invention may recognize a new form of bent gesture (<,>, ∧, ∨) depending on where the vertex is located based on the line connecting the start point and the end point.

The gesture-based user interface method according to an embodiment of the present invention performs a function corresponding to the recognized gesture through the function execution unit 150 (S1203). In addition, an embodiment of the present invention may perform a process of recognizing a gesture (S1202) so that a user may confirm whether the gesture input by the user is applied, and simultaneously display a movement path of the gesture. An embodiment of the present invention may display a movement path of a gesture by mapping a texture or an animation image onto coordinate data by an input event using a texture mapping technique or an animation technique. In addition, an embodiment of the present invention may display a symbol associated with a function corresponding to a gesture together with the movement path so that a user can easily check the function of the gesture input by the user.

Therefore, an embodiment of the present invention can provide a user interface that can recognize a new type of gesture, thereby enabling a variety of functions to be set and used. In addition, an embodiment of the present invention can easily determine the type and application of the gesture input by the user by providing a gesture display function for displaying the movement path and the symbol of the gesture input by the user.

Embodiments of the invention include a computer readable medium containing program instructions for performing various computer-implemented operations. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The medium or program instructions may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine code, such as produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

In the present invention as described above has been described by the specific embodiments, such as specific components and limited embodiments and drawings, but this is provided to help a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations are possible from these descriptions.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and all the things that are equivalent to or equivalent to the claims as well as the following claims will belong to the scope of the present invention. .

According to the present invention, it is possible to provide a gesture-based user interface system and a method thereof, which can recognize a new type of gesture and can easily check whether a gesture is applied.

Claims

A coordinate extraction unit for extracting a start point and an end point and at least one vertex between the start point and the end point from coordinate data generated by an input event; And,

Gesture recognition unit for recognizing at least one gesture from the form of a line connecting the start point and the end point via the vertex

Gesture based user interface system comprising a.
The method of claim 1,

The coordinate extraction unit,

The coordinate-based user interface system of the coordinate data existing between the start point and the end point is determined as the vertex coordinate data that the vertical distance between the line connecting the start point and the end point is a predetermined distance or more.
The method of claim 1,

The gesture recognition unit,

And recognize the gesture according to the position of the vertex relative to the start point and end point.
The method of claim 3,

The gesture recognition unit,

And determine the position of the vertex from a vector product of a start vector that is a direction vector from the vertex to a start point and an end vector that is a direction vector from the vertex to an end point.
The method of claim 1,

And a function execution unit that executes a function corresponding to the recognized gesture.
The method of claim 5,

The gesture is,

A function related to control of a map screen being displayed in a navigation system, or a function related to moving to a menu provided by the navigation system, is set.
The method of claim 1,

And a gesture display unit for displaying a movement path of the recognized gesture.
The method of claim 7, wherein

The gesture display unit,

And a texture representing the movement path to a location corresponding to the coordinate data.
The method of claim 7, wherein

The gesture display unit,

And displaying an animation using a sprite image having a different position of an image for each frame to indicate the movement path at a position corresponding to the coordinate data.
The method of claim 1,

And a symbol indicator for displaying a symbol associated with the recognized gesture.
A coordinate extraction unit for extracting coordinate data by a gesture-based input event; And,

Gesture display unit for displaying the movement path of the gesture on the extracted coordinate data

Gesture based user interface system comprising a.
The method of claim 11,

The gesture display unit,

And a texture representing the movement path to a location corresponding to the coordinate data.
The method of claim 11,

The gesture display unit,

And generating a polygon between two adjacent points in the coordinate data, respectively, and then mapping a texture composed of a plurality of images to the generated polygon to represent the movement path.
The method of claim 13,

The gesture display unit,

And generate the polygon if the distance between two adjacent points is greater than or equal to a predetermined distance.
The method of claim 13,

The gesture display unit,

After obtaining a unit direction vector from two adjacent points to a later point from a line point, four unit points are obtained by rotating the unit direction vector 90 degrees up and down at the line point and the later point, respectively. A gesture based user interface system for constructing the polygon.
The method of claim 13,

The gesture display unit,

And the image of the mapped texture is changed in accordance with the polygon's survival time.
The method of claim 11,

The gesture display unit,

And displaying an animation using a sprite image having a different position of an image for each frame to indicate the movement path at a position corresponding to the coordinate data.
The method of claim 11,

And a symbol display for displaying a symbol associated with the gesture.
In the gesture-based user interface method of the user interface system comprising a coordinate extractor, a gesture recognition unit, and a function execution unit,

Extracting a start point and an end point and at least one vertex between the start point and the end point from the coordinate data of the input event in the coordinate extracting unit; And,

Recognizing at least one gesture from the form of a line connecting the start point and the end point through the vertex in the gesture recognition unit

Gesture-based user interface method comprising a.
The method of claim 19,

Extracting the vertex,

And determining, as the vertex, coordinate data whose vertical distance between the line connecting the start point and the end point is equal to or greater than a predetermined distance among the coordinate data existing between the start point and the end point.
The method of claim 19,

Recognizing the gesture,

And recognizing the gesture according to the position of the vertex with respect to the start point and the end point.
The method of claim 21,

Recognizing the gesture,

And determining the position of the vertex from a vector product of a start vector that is a direction vector from the vertex to a start point and an end vector that is a direction vector from the vertex to the end point.
The method of claim 19,

And executing the function corresponding to the recognized gesture by the function execution unit.
The method of claim 23, wherein

The gesture is,

And a function related to control of a map screen being displayed in a navigation system, or a function related to moving to a menu provided by the navigation system.
The method of claim 19,

And displaying the movement path of the recognized gesture by the function execution unit.
The method of claim 25,

The displaying of the movement path of the gesture may include:

And a texture representing the movement path to a position corresponding to the coordinate data.
The method of claim 25,

The displaying of the movement path of the gesture may include:

And displaying an animation using a sprite image having a different position of an image for each frame to indicate the movement path at a position corresponding to the coordinate data.
The method of claim 19,

And displaying a symbol associated with the recognized gesture by the function execution unit.
In the gesture-based user interface method of the user interface system consisting of a coordinate extractor, a gesture display unit, and a symbol display unit,

Extracting coordinate data by a gesture-based input event from the coordinate extractor; And,

Displaying a movement path of the gesture on the extracted coordinate data by the gesture display unit;

Gesture-based user interface method comprising a.
The method of claim 29,

The displaying of the movement path of the gesture may include:

And a texture representing the movement path to a position corresponding to the coordinate data.
The method of claim 29,

The displaying of the movement path of the gesture may include:

Generating polygons between two adjacent points in the coordinate data;

Mapping a texture consisting of a plurality of images to the generated polygon to represent the movement path.
The method of claim 31, wherein

Generating the polygon,

And generating the polygon when the distance between two adjacent points is greater than or equal to a predetermined distance.
The method of claim 31, wherein

Generating the polygon,

Obtaining a unit direction vector heading from a line point to a later point among two adjacent points;

Obtaining four points by rotating the unit direction vector 90 degrees up and down at the line point and the post point, respectively;

And constructing the polygon from the four points.
The method of claim 31, wherein

The displaying of the movement path of the gesture may include:

And changing the image of the mapped texture according to the survival time of the polygon.
The method of claim 29,

The displaying of the movement path of the gesture may include:

And displaying an animation using a sprite image having a different position of an image for each frame to indicate the movement path at a position corresponding to the coordinate data.
The method of claim 29,

And displaying a symbol associated with the gesture in the symbol display unit.
A computer-readable recording medium having recorded thereon a program for performing the method of claim 19.