KR20190131417A - Apparatus for providing macro function using gesture recognition and method thereof - Google Patents

Abstract

Disclosed are a device for providing a macro function using hand gesture recognition and a method thereof according to an embodiment of the present invention. The device comprises: a communication unit receiving a data packet including a sensing value measured according to hand movement of a user wearing a motion glove; a control unit determining whether a macro function is executed using the sensing value included in the data packet and recognizing the hand gesture of the user by using the sensing value when the macro function is executed as a result of the determination to execute a macro function matching the recognized hand gesture of the user; and a display unit displaying a screen in which the macro function is executed.

Description

Apparatus and method for providing macro function using hand gesture recognition {APPARATUS FOR PROVIDING MACRO FUNCTION USING GESTURE RECOGNITION AND METHOD THEREOF}

The embodiment relates to a hand gesture recognition technology, and more particularly, to an apparatus and a method for providing a macro function using hand gesture recognition.

The motion capture technique is an imaging technique that generates a natural motion image by applying three-dimensional data obtained by extracting movements of a person or an animal to a character modeled by a computer. To this end, when a person or the like attaches an optical sensor or a magnetic sensor to the body and operates, each sensor records a position and an angle. The sensing data is applied to the 3D character to implement the character's motion.

The motion capture technique is primarily aimed at implementing motions similar to body movements. In order to achieve this purpose, it is important to accurately measure the joint movement of the body. In other words, how accurately and precisely the body joint movement is measured is a key to the natural motion.

However, it is also important not only to implement a system for capturing the movement of a user's hand gesture, but also to what hand gesture a user is currently performing and a specific function corresponding thereto.

In particular, since the user cannot see the surroundings while wearing a VR device, the macro function is essential because it is difficult to use a controller such as a mouse. However, there is a need for a technology development for a system or method for executing a predetermined macro function corresponding to a user's specific hand gesture.

Patent Application Publication No. 10-1385601 Patent Registration No. 10-1781999

The embodiment can provide an apparatus and a method for providing a macro function using hand gesture recognition.

An apparatus for providing a macro function according to an embodiment of the present invention includes a communication unit for receiving a data packet including a sensing value measured according to a hand gesture of a user wearing a motion glove; It is determined whether the macro function is executed by using the sensing value included in the data packet, and when the macro function is executed as the determined result, the hand gesture of the user is recognized by using the sensing value to recognize the hand gesture of the user. A controller for executing a macro function matched to; And a display unit for displaying a screen on which the macro function is executed.

The sensing value includes a first sensing value indicating an acceleration value according to the hand gesture of the user, a second sensing value indicating a value according to the user's wrist rotation, and a third sensing value indicating a value according to the user's finger bending. can do.

The controller determines whether the macro function is executed by the user's hand gesture using the first sensing value, and if it is determined that the macro function is executed, the controller uses the second sensing value and the third sensing value. The hand gesture of the user may be recognized.

The controller calculates a threshold value for determining whether to execute the macro function using the first sensing value, and if the calculated threshold value is within a predetermined threshold range, a timer is measured to measure a holding time. If the measured holding time is greater than or equal to a predetermined threshold time, it may be determined that the macro function is executed by the user's hand gesture.

에 의해 산출되고, a_x, a_y, a_z는 각각 3축 가속도 센서의 의해 측정된 x축, y축, z축의 값을 의미할 수 있다.The threshold value is

It is calculated by, and a _x , a _y , a _z may mean values of the x-axis, y-axis, and z-axis respectively measured by the 3-axis acceleration sensor.

The controller calculates a point value corresponding to a fingertip angle using the second sensing value, calculates a joint angle for each finger joint by applying the calculated point value to a finger joint angle calculation model, and calculates the calculated finger value. The user's hand gesture may be recognized using the joint angle of each joint and the third sensing value.

According to another aspect of the present invention, there is provided a method for providing a macro function, including: receiving a data packet including a sensing value measured according to a hand gesture of a user wearing a motion glove; It is determined whether the macro function is executed by using the sensing value included in the data packet, and when the macro function is executed as the determined result, the hand gesture of the user is recognized by using the sensing value to recognize the hand gesture of the user. Executing a macro function matched to; And displaying a screen on which the macro function is executed.

The sensing value includes a first sensing value indicating an acceleration value according to the hand gesture of the user, a second sensing value indicating a value according to the user's wrist rotation, and a third sensing value indicating a value according to the user's finger bending. can do.

In the executing step, it is determined whether the macro function is executed by the user's hand gesture using the first sensing value, and when it is determined that the macro function is executed, the second sensing value and the third sensing value are determined. The user's hand gesture may be recognized.

In the executing step, the threshold value for determining whether to execute the macro function is calculated using the first sensing value. When the calculated threshold value is within a predetermined threshold range, a timer is measured to measure a holding time. When the measured holding time is greater than or equal to a predetermined threshold time, it may be determined that the macro function is executed by the user's hand gesture.

에 의해 산출되고, a_x, a_y, a_z는 각각 3축 가속도 센서의 의해 측정된 x축, y축, z축의 값을 의미할 수 있다.The threshold value is

It is calculated by, and a _x , a _y , a _z may mean values of the x-axis, y-axis, and z-axis respectively measured by the 3-axis acceleration sensor.

In the performing of the step, a point value corresponding to the fingertip angle is calculated using the second sensing value, and the joint angle for each finger joint is calculated by applying the calculated point value to a finger joint angle calculation model. The user's hand gesture may be recognized by using the joint angle of each finger of the finger and the third sensing value.

According to an embodiment, upon receiving a data packet including a first sensing value, a second sensing value, and a third sensing value measured from a motion glove, it is determined whether a macro function is executed using the received first sensing value. When it is determined that the macro function is to be executed, the user recognizes the hand gesture using the second and third sensing values, determines a macro function matching the hand gesture, and executes the determined macro function. The macro function can be easily implemented.

According to an embodiment, since a user distinguishes between a specific action and a general motion state, an accurate macro function having a high recognition rate may be implemented.

According to the embodiment, since a macro function corresponding to the user's specific hand gesture is easily implemented, the convenience of the user using the content can be improved.

1 is a view showing the configuration of an entire system according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a detailed configuration of the motion glove shown in FIG. 1.
3 is a diagram illustrating a format of a data packet according to an embodiment of the present invention.
4 is a diagram illustrating a detailed configuration of a user terminal illustrated in FIG. 1.
5 is a diagram illustrating a method for providing a macro function according to an embodiment of the present invention.
6 is a diagram illustrating a process of determining whether to execute a macro function illustrated in FIG. 5.
7 is a diagram illustrating a motion maintenance time display screen according to an embodiment of the present invention.
FIG. 8 is a diagram illustrating a hand gesture recognition process illustrated in FIG. 5.
9 is a view for explaining a finger joint angle calculation model according to an embodiment of the present invention.
10 is a graph illustrating a finger joint angle calculation model according to an embodiment of the present invention in a graph form.
11 is a view for explaining the principle of calculating the angle of each joint of the finger according to an embodiment of the present invention.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated and described in the drawings. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers, such as second and first, may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be given the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted.

In an embodiment, upon receiving a data packet including the first sensing value, the second sensing value, and the third sensing value measured from the motion glove, it is determined whether the macro function is to be executed using the received first sensing value. If it is determined that the macro function is to be executed, the present invention proposes a new method of recognizing a hand gesture using a second sensing value and a third sensing value to determine a macro function matching the hand gesture and executing the determined macro function.

1 is a view showing the configuration of an entire system according to an embodiment of the present invention.

Referring to FIG. 1, a system for providing a macro function using a gesture recognition technology according to an embodiment of the present invention may include a motion glove 100 and a user terminal 200.

The motion glove 100 may detect a user's movement and output a first sensing value, a second sensing value, and a third sensing value according to the detected result. The motion glove 100 may generate and output a data packet including a first sensing value, a second sensing value, and a third sensing value.

The user terminal 200 may receive a data packet from the motion glove 100 and recognize the hand gesture of the user using the received data packet to execute a macro function.

The user terminal 200 extracts the first sensing value, the second sensing value, and the third sensing value included in the data packet, and determines whether to execute the macro function by using the extracted first sensing value, and determines the second sensing value and the second sensing value. The macro function may be executed by recognizing the hand gesture using the third sensing value.

The user terminal 200 is an electronic device including a communication module, a processor, a display, a memory, and the like, and may include, for example, a smartphone, a tablet, a notebook, and a desktop.

FIG. 2 is a diagram illustrating a detailed configuration of the motion glove shown in FIG. 1.

Referring to FIG. 2, the motion glove 100 according to an embodiment of the present invention includes a glove 110, a flexible sensor 120, a pocket 130, and a motion sensor. sensor) 140 may be configured.

The glove 110 may be formed in a shape that the user can wear on the hand. Here, the glove 110 is shown worn on the left hand, but this is only an example, and may be a glove worn on the right hand. The glove 110 may use a stretchable material so that the user can grasp the hand after wearing it.

The flexible sensor 120 may be disposed on each of a thumb, an index, a middle finger, a ring, and a pinky. Therefore, the flexible sensor 120 is formed corresponding to the finger length of the glove 110. For example, the length of the flexible sensor 125 formed on the holding portion may be shorter than the length of the flexible sensor 123 formed on the middle finger. The flexible sensor 120 may be bent according to a user's finger movement, and may generate another output value according to the degree of bending and output the same.

The pocket 130 may be attached to the inside of the finger portion of the glove 110. The pocket 130 may have a space capable of moving in the longitudinal direction of the finger after the flexible sensor 120 is inserted. Therefore, since the flexible sensor 120 inserted into the pocket 130 may move back and forth within the pocket 130, the wire connected to the flexible sensor 120 may be prevented from being broken even if the user keeps his fist or moves. can do.

The motion sensor 140 is formed on the back of the hand of the glove 110 and can measure the rotation of the wrist of the user. The motion sensor 140 may be connected to the flexible sensor 120 by a wire, collect an output value of the flexible sensor 120, and transmit the collected value to the user terminal 200.

The motion sensor 140 is used as a means for distinguishing whether the user is taking a macro action. The motion sensor 140 generally includes a gyro, an acceleration, and a geomagnetic sensor, in which a three-axis acceleration sensor value is used to distinguish whether the user has taken a macro action. Therefore, according to the present invention, the classification of whether the motion or the macro motion is performed is used by the acceleration sensor value, and each macro motion is recognized by the wrist joint angle estimated by the motion sensor and the angle of each finger joint.

3 is a diagram illustrating a format of a data packet according to an embodiment of the present invention.

Referring to FIG. 3, the motion sensor 140 according to an embodiment of the present invention may generate a data packet including a motion value, an acceleration value, and an output value of the flexible sensor, which measure the rotation of the user's wrist.

These data packets can be broadly classified into a header field, a data field, and a tailer field. The data field includes motion values measured by a motion sensor, acceleration values, and output values measured by a flexible sensor. It may be configured to include.

4 is a diagram illustrating a detailed configuration of a user terminal illustrated in FIG. 1.

Referring to FIG. 4, the user terminal 200 according to an embodiment of the present invention may include a communication unit 210, an input unit 220, a control unit 230, a display unit 240, and a storage unit 250. .

The communication unit 210 may receive a data packet including a first sensing value measured by the motion sensor, a second sensing value, and a third sensing value measured by the flexible sensor in cooperation with the motion sensor of the motion glove.

The input unit 220 may receive information according to a user's key or menu operation.

The controller 230 extracts the first sensing value, the second sensing value, and the third sensing value measured by the flexible sensor, which are measured by the motion sensor included in the data packet, and extracts the macro by using the extracted first sensing value. If it is determined whether the function is to be executed, and if it is determined that the macro function is to be executed, the macro function may be determined and executed using the second and third sensing values.

The controller 230 may recognize the hand gesture using the second and third sensing values, determine a macro function matching the recognized hand gesture, and execute the determined macro function.

The display unit 240 may display the recognized gesture of the user while displaying the content.

The storage unit 250 may store various types of information necessary for executing content and macro functions, for example, a user's hand gesture and a predetermined macro function corresponding to the hand gesture.

5 is a diagram illustrating a method for providing a macro function according to an embodiment of the present invention.

Referring to FIG. 5, an apparatus for providing a macro function according to an embodiment of the present invention (hereinafter, referred to as a providing apparatus) may receive a data packet from a motion glove (S510).

Next, the providing apparatus may analyze the received data packet and extract the first sensing value, the second sensing value, and the third sensing value measured from the flexible sensor as a result of the analysis (S520). .

Next, the providing apparatus may determine whether to execute the macro function by using the extracted first sensing value (S530). The first sensing value may be an acceleration sensor value measured by the acceleration sensor included in the motion sensor. This first sensing value may be used to distinguish whether the user takes a general motion or a macro motion.

Next, the providing apparatus may recognize the hand gesture using the second sensing value and the third sensing value (S540). Here, the second sensing value may be a motion value measured by the motion sensor. The second sensing value may have a different value depending on the degree of wrist rotation or the wrist joint angle of the user wearing the motion glove. The third sensing value may be a value measured by the flexible sensor. The third sensing value may have a different value according to the finger bending information of the user wearing the motion glove.

Next, the providing apparatus may determine a macro function matching the recognized hand gesture and execute the determined macro function (S550). In this case, the providing apparatus may preset and change a pair of macro functions corresponding to the predetermined hand gesture and the predetermined hand gesture by the user.

In this case, the present invention determines whether to execute the macro function by using the acceleration value of the motion sensor when producing the realistic content. In general, when the macro function is implemented, it is considered that the hand motion is stopped for several seconds, and it is determined whether the motion is stopped by the acceleration value of 3 axes.

6 is a diagram illustrating a process of determining whether to execute a macro function illustrated in FIG. 5.

Referring to FIG. 6, the providing apparatus may calculate a threshold value using the first sensing value (S531). The threshold value is a value for determining whether or not a macro function is to be executed. Same as

[Equation 1]

Here, ax, ay, and az mean values of the x-axis, y-axis, and z-axis respectively measured by the 3-axis acceleration sensor.

At this time, the three-axis acceleration sensor is 0 when perpendicular to the direction of gravity, and maximum 1 when measured in the direction of gravity. Since the 3-axis acceleration sensor detects only the gravity acceleration when no linear acceleration is detected, when the value of the 3-axis acceleration sensor is calculated by [Equation 1], the threshold value is 1, and when the linear acceleration is detected, the threshold is always Results in a value greater than 1.

Next, the providing apparatus may check whether the calculated threshold value is within a predetermined threshold range (S532). Here, the predetermined threshold range refers to the range of 1-α to 1+ α.

Next, if the threshold value is within the threshold range as a result of the checking, the providing apparatus may determine whether the holding time measured by the timer is greater than or equal to the threshold time (S534).

7 is a diagram illustrating a motion maintenance time display screen according to an embodiment of the present invention.

Referring to FIG. 7, the time is always displayed in the form of a gauge on one upper side of the screen displaying the content so that the user maintains motion for a predetermined time so that the macro function can be executed.

In this case, the time may be used in the form of a circle, a bar, and the like as well as the gauge form.

Next, as a result of the checking, if the holding time is longer than the threshold time, the providing apparatus may terminate the timer (S535) and determine that a predetermined macro function by the user's hand gesture is to be executed (S536).

On the other hand, if the holding time is less than the threshold time as a result of the check, the providing apparatus may determine that the predetermined macro function by the user's hand gesture is not executed (S537).

FIG. 8 is a diagram illustrating a hand gesture recognition process illustrated in FIG. 5.

Referring to FIG. 8, the providing apparatus may calculate a point value corresponding to the fingertip angle using the second sensing value. At this time, the point value P _{finger 수} can be obtained using Equation 2 below (S541).

[Equation 2]

Here, F is the second sensing value, Fmin is the minimum output value of the flexible sensor, Fmax is the maximum output value of the flexible sensor, Mmax is the maximum matching value. In this case, the maximum matching value may mean a maximum value that the fingertip angle may have as a preset value.

For example, it is assumed that the minimum output value of the flexible sensor is 800, the maximum output value of the flexible sensor is 8000, and the maximum matching value is 100. In this case, if the second sensing value is 4400, 50 may be calculated as the end angle Pfinger∠ of the finger through Equation 2.

As shown in Equation 2, the present invention may calculate a point value corresponding to the fingertip angle by using a ratio between the difference between the second sensing value and the minimum output value and the difference between the maximum output value and the minimum output value.

In this case, the providing apparatus may preset the maximum output value and the minimum output value of the flexible sensor. That is, the providing apparatus may set the maximum value and the minimum value among the output values generated by measuring the finger movement of the user wearing the motion glove for a predetermined time, respectively.

For example, when a user wearing a motion glove moves a finger for 10 seconds, the providing device detects the maximum and minimum values of the second sensor output values collected for 10 seconds, sets the detected maximum value as the maximum output value of the flexible sensor. , Set the minimum value to the minimum output value.

In this case, the user's finger movement is preferably a movement in the maximum range. For example, if the user repeatedly performs the movement of extending the finger and the movement of the fist for a predetermined time, the providing device may generate an output value by measuring the movement.

Next, the providing apparatus may calculate a joint angle for each finger joint by applying a point value corresponding to the finger tip angle to the finger joint angle calculation model (S542). That is, the fingertip angle may be used to calculate the angle of each joint of the finger.

The finger joint angle calculation model may be generated by modeling a joint motion range of each joint of the finger with respect to the entire motion range of the fingertip. And the joint movement range of each joint may be set differently. Specifically, the joint movement range for each joint may be set differently for all finger joints or may be set differently according to the position of the joint in each finger.

9 is a diagram illustrating a finger joint angle calculation model according to an embodiment of the present invention, FIG. 10 is a diagram illustrating a finger joint angle calculation model according to an embodiment of the present invention in a graph form, and FIG. 10 is a view for explaining the principle of calculating the angle of each joint of the finger according to an embodiment of the present invention.

Referring to FIG. 9, a finger is composed of five parts such as a thumb, an index, a middle finger, a ring, and a pinky. Each finger is composed of a plurality of nodes and a plurality of joints.

Specifically, the index finger, middle finger, ring finger, and the branch are composed of a proximal node (l_ⓕ_proximal), a middle node (l_ⓕ_middle), and a terminal node (l_ⓕ_distal), respectively. The thumb is composed of a proximal node (l_thumb_proximal) and a circular node (l_thumb_distal).

The index finger, middle finger, ring finger, and branch are composed of distal interphalangeal (DIP) joints, proximal interphalangeal (PIP) joints, and metacarpal phalangea (MCP) joints. . The thumb consists of distal interphalangeal (DIP) and metacarpal phalangeal (MCP) joints.

As shown above, the distal interdigital joint (DIP) joint, proximal intercondylar joint (PIP) joint, and metacarpophalangeal joint (MCP) joint exist between different nodes, so even the same user may have a different range of motion. Therefore, the finger joint angle calculation model according to an embodiment of the present invention is modeled by setting different joint movement ranges for each joint. For example, the finger joint angle calculation model may include 0 to 90 degrees for the DIP joint of each finger, 0 to 100 degrees for the PIP joint, and 0 to 100 degrees for the metacarpophalangeal joint (MCP). A range of joint motion of 10 degrees to 90 degrees can be set and modeled.

On the other hand, in the case of the thumb-to-resin joint (CMC, carpometacarpal) joint has a small range of movement as a joint connected to the wrist, the joint may not be considered when modeling.

In this way, by setting the joint angle range for each finger joint, abnormal breaks or rotations can be made. In addition, by matching the output value of the flexible sensor, which varies depending on the size of the human hand and the degree of bending, it is possible to implement a natural hand motion.

Referring to FIG. 10, when modeling joint ranges for each joint of a finger with respect to the entire range of motions of the fingertips, the finger joint angle calculation model may be modeled as the first to fifth sections.

The first section is a section in which the joint angle of the metacarpophalangeal joint (MCP) joint changes linearly. In the first section, the PIP joint and the DIP joint may have a minimum angle value.

The second section is a section in which the joint angles of the metacarpal joint (MCP) joint and the proximal joint joint (PIP) joint change linearly. In the second section, the distal interdigital joint (DIP) joint may have a minimum angle value.

The third section is a section in which the joint angle of the PIP joint changes linearly. In the third section, the metacarpophalangeal joint (MCP) joint may have a maximum angle value, and the distal limb joint (DIP) joint may have a minimum angle value.

The fourth section is a section in which the joint angles of the PIP joint and the DIP joint vary linearly. In the fourth section, the metacarpophalangeal joint (MCP) joint may have a maximum angle value.

The fifth section is a section in which the joint angle of the distal interdigital joint (DIP) joint changes linearly. In the fifth section, the metacarpophalangeal joint (MCP) joint and the proximal phalangeal joint (PIP) joint may have a maximum angle value.

Referring to FIG. 11, when the user moves as shown in (a), the point value corresponding to the tip angle of the finger may be a. Then, the point value a is applied to the finger joint angle calculation model, and the point value a is included in the first section. Accordingly, the angle value according to the linear change is calculated for the metacarpophalangeal joint (MCP) joint, and the minimum angle value is calculated for the PIP joint and the distal limb joint (DIP) joint.

When the user moves as shown in (b), the point value corresponding to the tip angle of the finger may be b. Then, the point value b is applied to the finger joint angle calculation model, and the point value b is included in the fourth section. Therefore, the angle value according to the linear change is calculated for the PIP joint and the distal interhepatic joint (DIP) joint, and the maximum angle value is calculated for the MCP joint.

When the user moves as shown in (c), the point value corresponding to the tip angle of the finger may be c. Then, the point value c is applied to the finger joint angle calculation model, and the point value c is included in the first section. Therefore, the angle value according to the linear change for the distal interhepatic joint (DIP) joint is calculated, and the maximum angle value is calculated for the metacarpal joint (MCP) joint and the proximal phalanx (PIP) joint.

In addition, the position matching error that can occur in motion capture can be used by the collider to take a pre-stored motion when approaching a certain distance, and to return to the original motion when the distance is dropped by a certain distance. At this time, the content developer can set a delay time to return to the original motion. For example, when the thumb and the index finger are in contact with each other in an actual motion, for example, when the hand is ok, the motion of the content may not be in contact. Therefore, in order to reduce the motion and matching error of the actual motion and content, when the thumb and the index finger are moved closer by a certain distance (when the collider on the thumb and the index finger touches), the two fingers may be contacted.

Next, the providing apparatus may recognize a user's hand motion using the joint angle of each finger and the third sensing value (S543). For example, the providing apparatus may implement a hand gesture by applying a joint angle of each finger joint and a third sensing value to the character model. In another embodiment, the providing apparatus may implement a hand gesture by applying a joint angle of each finger joint and a third sensing value to an application such as a presentation control program.

The term '~ part' used in the present embodiment refers to software or a hardware component such as a field-programmable gate array (FPGA) or an ASIC, and '~ part' performs certain roles. However, '~' is not meant to be limited to software or hardware. '~ Portion' may be configured to be in an addressable storage medium or may be configured to play one or more processors. Thus, as an example, '~' means components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and the like. Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and the 'parts' may be combined into a smaller number of components and the 'parts' or further separated into additional components and the 'parts'. In addition, the components and '~' may be implemented to play one or more CPUs in the device or secure multimedia card.

Although described above with reference to a preferred embodiment of the present invention, those skilled in the art will be variously modified and changed within the scope of the invention without departing from the spirit and scope of the invention described in the claims below I can understand that you can.

100: motion glove
200: user terminal
210: communication unit
220: input unit
230: control unit
240: display unit
250: storage

Claims (12)

A communication unit receiving a data packet including a sensing value measured according to a hand gesture of a user wearing a motion glove;
It is determined whether the macro function is executed by using the sensing value included in the data packet, and when the macro function is executed as the determined result, the hand gesture of the user is recognized by using the sensing value to recognize the hand gesture of the user. A control unit which executes a macro function matched to; And
And a display unit for displaying a screen on which the macro function is executed. The method of claim 1,
The sensing value is
A macro function including a first sensing value indicating an acceleration value according to the hand gesture of the user, a second sensing value indicating a value according to the user's wrist rotation, and a third sensing value indicating a value according to the user's finger bending Device for providing a. The method of claim 2,
The control unit,
It is determined whether the macro function is executed by the user's hand gesture using the first sensing value,
And when it is determined that the macro function is executed, recognizing a hand gesture of the user by using the second and third sensing values. The method of claim 3,
The control unit,
Calculating a threshold value for determining whether to execute the macro function using the first sensing value,
If the calculated threshold value is within a predetermined threshold range, a timer is measured to measure a holding time,
And determining that the macro function is executed by the hand gesture of the user when the measured holding time is equal to or greater than a predetermined threshold time. The method of claim 4, wherein
The threshold is
Equation

And a _x , a _y , a _z denote values of the x-axis, y-axis, and z-axis respectively measured by the 3-axis acceleration sensor. The method of claim 3,
The control unit,
The point value corresponding to the fingertip angle is calculated using the second sensing value,
Applying the calculated point value to the finger joint angle calculation model to calculate the joint angle for each finger joint,
And recognizing a user's hand gesture using the calculated joint angle of each finger of the finger and the third sensing value. Receiving a data packet including a sensing value measured according to a hand gesture of a user wearing a motion glove;
It is determined whether the macro function is executed by using the sensing value included in the data packet, and when the macro function is executed as the determined result, the hand gesture of the user is recognized by using the sensing value to recognize the hand gesture of the user. Executing a macro function matched to; And
Displaying a screen on which the macro function is executed. The method of claim 7, wherein
The sensing value is
A macro function including a first sensing value indicating an acceleration value according to the hand gesture of the user, a second sensing value indicating a value according to the user's wrist rotation, and a third sensing value indicating a value according to the user's finger bending Method for providing. The method of claim 8,
In the executing step,
It is determined whether the macro function is executed by the user's hand gesture using the first sensing value,
And if it is determined that the macro function is executed, recognizing a hand gesture of the user using the second sensing value and the third sensing value. The method of claim 9,
In the executing step,
Calculating a threshold value for determining whether to execute the macro function using the first sensing value,
If the calculated threshold value is within a predetermined threshold range, a timer is measured to measure a holding time,
If the measured holding time is equal to or greater than a predetermined threshold time, determining that the macro function is executed by the user's hand gesture. The method of claim 10,
The threshold is
Equation

And a _x , a _y , a _z denote values of the x-axis, y-axis, and z-axis respectively measured by the 3-axis acceleration sensor. The method of claim 9,
In the executing step,
The point value corresponding to the fingertip angle is calculated using the second sensing value,
Applying the calculated point value to the finger joint angle calculation model to calculate the joint angle for each finger joint,
And recognizing a hand gesture of the user by using the calculated joint angle of each finger of the finger and the third sensing value.

Images