WO2024075958A1

WO2024075958A1 - Taekwondo sparring evaluation method according to user training level using artificial intelligence

Info

Publication number: WO2024075958A1
Application number: PCT/KR2023/011209
Authority: WO
Inventors: 최중구
Original assignee: 주식회사 에이아이태권도
Priority date: 2022-10-07
Filing date: 2023-08-01
Publication date: 2024-04-11
Also published as: KR20240049129A; KR102510014B1

Abstract

An embodiment of the present invention relates to a method for evaluating Taekwondo sparring according a user training level, performed by at least one server, the method characterized by comprising the steps of: obtaining image information comprising sparring movements of a first user; deriving skeleton information corresponding to the sparring movements of first user on the basis of the image information; obtaining first training level information of the first user; determining at least one Taekwondo evaluation target action among a plurality of Taekwondo actions on the basis of the first training level information; determining a performed Taekwondo action performed by the first user among the plurality of Taekwondo actions on the basis of the skeleton information; and determining whether the first user has performed at least some of the at least one Taekwondo evaluation target action on the basis of the performed Taekwondo action and the at least one Taekwondo evaluation target action.

Description

Taekwondo sparring evaluation method according to user training level using artificial intelligence

The present invention relates to a Taekwondo sparring evaluation method and device based on the user's training level using artificial intelligence. More specifically, it relates to a sparring evaluation method and device based on the training level corresponding to the user's skill level using only sparring images without a sensing device. .

Taekwondo is a martial art that attacks or defends using hands and feet without weapons, and is a modern traditional martial art characterized by fast and powerful kicking techniques. It was adopted as a demonstration sport at the 1988 Summer Olympics, and was adopted as an official sport starting at the 2000 Summer Olympics.

Taekwondo can be largely divided into poomsae (form), sparring (sparring), and breaking (training). Taekwondo, which was adopted as an Olympic sport, is a sparring sport in which the winner and loser are determined by scoring points through striking.

In order to accurately judge these sparring events, players attached sensors to their hitting hands or feet, and sensors were attached to the protective gear and protective equipment that were the targets of the hitting.

However, accurate judgments are being overshadowed by misjudgments due to sensor errors, and the nature of Taekwondo sparring is disappearing due to the characteristics of the sensor system that does not consider the strength of the blow.

The purpose of the present invention to solve the above problems is to provide a method for evaluating Taekwondo sparring according to the user's training level using artificial intelligence.

Another purpose of the present invention to solve the above problems is to provide a Taekwondo sparring evaluation device according to the user's training level using artificial intelligence.

The problem to be solved by this application is not limited to the above-mentioned problems, and problems not mentioned can be clearly understood by those skilled in the art from this specification and the attached drawings. .

A Taekwondo sparring evaluation method according to a user's training level performed by at least one server according to an embodiment of the present invention to achieve the above object includes the steps of acquiring image information including a sparring movement of a first user, the image Deriving skeleton information corresponding to the sparring movement of the first user based on information, obtaining first training level information of the first user, and performing a plurality of Taekwondo movements based on the first training level information determining at least one Taekwondo evaluation target motion, determining a Taekwondo execution motion performed by a first user among the plurality of Taekwondo motions based on the skeleton information, and determining the Taekwondo execution motion and the at least one Taekwondo motion. It may include determining whether the first user has performed at least some of the at least one Taekwondo evaluation target movement based on the evaluation target movement.

Here, the method may further include determining the number of movements of the first user corresponding to each of the at least one Taekwondo evaluation target movement based on the Taekwondo performance action and the at least one Taekwondo evaluation target action.

Here, the technique used by the first user based on the number of movements of the first user corresponding to each of the at least one Taekwondo evaluation target movement and the type information of the movement corresponding to the Taekwondo performance movement among the plurality of Taekwondo movements. A step of determining diversity information may be further included.

Here, determining the number of attack movements of the first user and the number of defense movements of the first user based on information on the type of movement corresponding to the Taekwondo performance movement among the plurality of Taekwondo movements, and the attack movement It may further include determining attack/defense ratio information of the first user based on the number of and the number of defense actions.

Here, the image information further includes a sparring movement of a second user who is a sparring opponent of the first user, and a first body region for the first user and a second body region for the second user are determined from the video information. determining whether a strike of the first user to the second user is effective based on the first body region, the second body region, and the skeleton information; among the plurality of Taekwondo movements, the Determining a hitting motion corresponding to the sparring movement of the first user at the time when the hitting is determined to be effective based on skeleton information, first body information of the first user and second body information of the second user Obtaining, correcting the hitting motion based on the first body information and the second body information, and the corrected hitting motion and the sparring movement of the first user at the time when the hitting is determined to be effective. It may further include determining the first user's evaluation value for the hitting motion based on the hitting motion.

An electronic device that performs a Taekwondo sparring evaluation method according to a user's training level according to an embodiment of the present invention for achieving the above other object includes a processor and a memory that stores at least one command executed by the processor. memory), wherein the at least one command is executed to obtain image information including the sparring movement of the first user, and to derive skeleton information corresponding to the sparring movement of the first user based on the image information. is executed to obtain first training level information of the first user, and is executed to determine at least one Taekwondo evaluation target movement among a plurality of Taekwondo movements based on the first training level information, and the skeleton information Based on the plurality of Taekwondo movements, the Taekwondo movement performed by the first user is determined, and the first user performs the at least one Taekwondo movement based on the Taekwondo movement and the at least one Taekwondo evaluation target movement. It may be executed to determine whether at least some of the movements subject to Taekwondo evaluation have been performed.

The solution to the problem is not limited to the above-mentioned solution, and the solution not mentioned can be clearly understood by those skilled in the art from this specification and the attached drawings. .

According to the present invention, sparring evaluation can be conducted without players using equipment with separate sensors attached.

According to the present invention, since the sensor is not used, the possibility of misjudgment due to malfunction of the sensor can be prevented.

According to the present invention, the user's training level (level, poom, dan, etc.) can be viewed only through images: how many times the movements that must be performed in a sparring match were performed, how accurately they were performed, what the degree of attack and defense was, and how many different techniques were used. You can see overall whether it has been used.

According to various embodiments, the effects are not limited to the effects described above, and effects not mentioned can be clearly understood by those skilled in the art from this specification and the attached drawings. .

1 is a block diagram of an electronic device that performs a Taekwondo sparring evaluation method according to the user training level using artificial intelligence according to an embodiment of the present invention.

Figure 2 is a conceptual diagram illustrating a method for evaluating Taekwondo sparring according to the user training level using artificial intelligence according to an embodiment of the present invention.

Figure 3 is a flow chart of a Taekwondo sparring evaluation method according to the user training level using artificial intelligence according to an embodiment of the present invention.

Figure 4 is a diagram showing key points used to recognize a user's movement from an image according to an embodiment of the present invention.

Figure 5 is a diagram for explaining a configuration in which Taekwondo evaluation target movements are determined according to the training level according to an embodiment of the present invention.

Figure 6 is a diagram illustrating a configuration in which the number of user movements for each Taekwondo evaluation target movement is counted according to an embodiment of the present invention.

Figure 7 is a diagram illustrating a configuration for correcting a movement subject to Taekwondo evaluation based on the other person's body information according to an embodiment of the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention. While describing each drawing, similar reference numerals are used for similar components.

Terms such as first, second, A, B, etc. may be used to describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention. The term “and/or” includes any of a plurality of related stated items or a combination of a plurality of related stated items.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the attached drawings. In order to facilitate overall understanding when describing the present invention, the same reference numerals are used for the same components in the drawings, and duplicate descriptions for the same components are omitted.

Referring to FIG. 1, an electronic device 100 that performs a Taekwondo sparring evaluation method according to the user training level using artificial intelligence according to an embodiment of the present invention includes at least one processor 110, a memory 120, and a transmission/reception device. It may be configured to include a device 130. Additionally, the electronic device 100 may further include at least one of an input interface device 140, an output interface device 150, and a storage device 160.

For example, the at least one processor 110 may be a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to embodiments of the present invention are performed. It can mean. Each of the memory 120 and the storage device 160 may be comprised of at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory 120 may be one of read only memory (ROM) and random access memory (RAM), and the storage device 160 may be flash memory. , a hard disk drive (HDD), a solid state drive (SSD), or various memory cards (eg, micro SD card).

In addition, the transceiver 130 can communicate through a wireless network, and each component included in the electronic device 100 is connected by a bus 170 to communicate with each other. can do.

For example, the memory 120 may store at least one instruction performed by the processor 110, and the at least one instruction may be used in a Taekwondo sparring evaluation method according to the user training level using artificial intelligence, which will be described later. It can be executed to perform at least some action.

Referring to FIG. 2, the electronic device 100 that performs a Taekwondo sparring evaluation method according to the user training level using artificial intelligence according to an embodiment of the present invention is configured to evaluate the sparring movements of the first user and/or the sparring of the first user. Image information including the sparring movements of the second user, the opponent, can be acquired, and the sparring movements can be analyzed and evaluated based on the acquired video information.

Here, the electronic device 100 may represent at least one server. Alternatively, the electronic device 100 may be referred to as a Taekwondo sparring evaluation server. The electronic device 100 may perform a Taekwondo sparring evaluation method by transmitting and receiving information with the user terminal 200 through wired or wireless communication.

For example, the user terminal 200 may be a communication capable desktop computer, laptop computer, laptop, smart phone, tablet PC, or mobile phone. ), smart watch, smart glass, digital camera, digital video recorder, digital video player, PDA (Personal Digital Assistant), etc. , but is not limited thereto, and may include all electronic devices capable of computing.

For example, wireless communications include LTE, LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), Wireless Broadband (WiBro), and Global System for GSM (GSM). Mobile Communications), wireless fidelity (WiFi), Bluetooth, Bluetooth Low Energy (BLE), Zigbee, near field communication (NFC), Magnetic Secure Transmission, Radio Frequency (RF), or body area network ( BAN), etc., but is not limited thereto. Alternatively, the wired communication may include at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), power line communication, or plain old telephone service (POTS).

Alternatively, according to another embodiment, the user terminal 200 may analyze and evaluate Taekwondo sparring actions based on image information acquired by itself without transmitting or receiving information to or from the electronic device 100. In other words, depending on the implementation method of the Taekwondo sparring motion evaluation method, analysis and evaluation may be performed in the user terminal 200 itself, and after the electronic device 100 acquires image information from the user terminal 200, analysis and evaluation are performed. is performed, and result information may be provided to the user terminal 200.

A more detailed description of the Taekwondo sparring evaluation method according to the embodiments will be described later.

Referring to FIG. 3, in operation S310, one embodiment may obtain image information including the sparring movement of the first user. For example, image information may represent information about a moving image or a plurality of still images. Alternatively, the image information may include a plurality of image information acquired at different times, and the plurality of image information may be arranged in chronological order. The video information may include information about at least a portion of the video from the start to the end of the sparring match or evaluation.

In operation S320, one embodiment may derive skeleton information corresponding to the sparring movement of the first user based on image information. The configuration of deriving skeleton information corresponding to sparring movements will be explained in more detail with Figure 4.

Referring to FIG. 4, in one embodiment, skeleton information may be derived using a skeleton extraction model previously learned from Taekwondo movements. Here, the skeleton information may include a plurality of key points and information about the line between the two key points. For example, there may be 30 key points, and each key point may be named from 0 to 30.

For example, key point 0 may represent a part corresponding to the nose (or philtrum), and key point 1 may indicate a part corresponding to the left ear (or temple). Key point number 2 may represent the corresponding part corresponding to the left eye, key point number 3 may represent the portion corresponding to the right eye, and key point number 4 may represent the portion corresponding to the right ear (or temple). can indicate. Key point number 5 may represent the part corresponding to the tip of the chin, and key point number 6 may represent the part corresponding to the center of the neck or the ulna bone.

Key point number 7 may represent a part corresponding to the left shoulder. Key point number 8 may represent the part corresponding to the left elbow. Key point number 9 may represent a part corresponding to the left wrist, key point number 10 may indicate a part corresponding to the tip of the left thumb, and key point number 11 may indicate a part corresponding to the tip of the left middle finger.

Key point 12 may represent a part corresponding to the right shoulder, key point 13 may indicate a part corresponding to the right elbow, and key point 14 may indicate a part corresponding to the right wrist. Key point number 15 may represent the part corresponding to the tip of the right thumb, and key point number 16 may indicate the part corresponding to the tip of the right middle finger.

Key point number 17 may represent the part corresponding to the center of the chest (or solar plexus), and key point number 18 may represent the part corresponding to the center of the waist (or danjeon).

Key point 19 may represent the part corresponding to the center of the left pelvis (or hip), key point 20 may indicate the part corresponding to the left knee, and key point 21 may represent the part corresponding to the left ankle. It can be expressed. Key point number 22 may represent the part corresponding to the heel of the left foot, key point number 23 may represent the part corresponding to the tip of the left big toe, and key point number 24 may represent the part corresponding to the tip of the left little toe. .

Key point number 25 may represent the part corresponding to the center of the right pelvis (or buttocks). Key point No. 26 may represent a portion corresponding to the right knee, key point No. 27 may represent a portion corresponding to the right ankle, and key point No. 28 may represent a portion corresponding to the heel of the right foot. Key point number 29 may represent the part corresponding to the tip of the right big toe, and key point number 30 may represent the part corresponding to the tip of the right little toe. Here, the key point may be expressed as an edge.

For example, information about a specific key point may include at least one of the part indicated by the specific key point, movement information of the specific key point, and location information of the specific key point in the image.

Here, the skeleton extraction model can be learned through machine learning by configuring training image information about motion and learning skeleton information corresponding to the learning image information into a learning data set, and the algorithm used for machine learning is DNN (deep neural network). network), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), and Deep Belief Network (DBN) algorithms. may be used, but is not limited to this, and other more efficient algorithms may be used. Since each algorithm is well-known, description is omitted.

Referring again to FIG. 3, in operation S330, one embodiment may obtain first training level information of the first user, and in operation S340, one embodiment may perform a plurality of Taekwondo movements based on the first training level information. At least one movement subject to Taekwondo evaluation can be determined. The configuration that determines the movements subject to Taekwondo evaluation according to the level of training will be explained in more detail with Figure 5.

Referring to Figure 5, Taekwondo evaluation target movements may be preset according to each training level. For example, the training level may represent one of grade, rank, and dan, but is not limited to these. In other words, the movements subject to Taekwondo evaluation when the trainee is a 1st class and the movements subject to Taekwondo evaluation when the trainee is a 2nd class may all be different from each other, or only some of them may be different and the rest may be the same. This may vary depending on promotion regulations, promotion regulations, promotion regulations, or user settings.

If the first user is 2nd class, he/she must perform at least some of the Taekwondo evaluation target movements corresponding to 2nd class during a sparring match, and evaluation can be made accordingly.

Referring again to FIG. 3, in operation S350, one embodiment may determine a Taekwondo performance performed by the first user among a plurality of Taekwondo movements based on skeleton information. That is, one embodiment may determine or determine which of several Taekwondo movements the first user performed based on skeleton information.

One embodiment may compare skeleton information corresponding to the sparring movement of the first user with a plurality of skeleton information corresponding to a plurality of preset Taekwondo movements to determine the Taekwondo movement performed by the user, and the skeleton information of the first user may be compared. The similarity between the information and the plurality of skeleton information can be derived, and the Taekwondo movement corresponding to the skeleton information with the highest similarity among the plurality of skeleton information can be derived and determined as the Taekwondo movement performed by the user.

In operation S360, an embodiment may determine whether the first user has performed at least some of the at least one Taekwondo evaluation target movement based on the Taekwondo performance action and the at least one Taekwondo evaluation target action. That is, in one embodiment, in order to evaluate the movement corresponding to the training level of the first user, it may be determined whether the Taekwondo performance movement of the first user is included in the Taekwondo evaluation target movement corresponding to the first user's training level.

Referring to FIG. 6, in one embodiment, based on the Taekwondo performance movement of the first user and the at least one Taekwondo evaluation target movement corresponding to the training level, a first evaluation is performed for each of the at least one Taekwondo evaluation target movement corresponding to the training level. It is possible to count how many times the user has performed the game, and when the sparring match is over, the number of movements of the first user for each movement subject to Taekwondo evaluation during the sparring game can be determined and provided.

In addition, in one embodiment, the first user's technique diversity information may be determined based on the number of movements of the first user for each of the taekwondo evaluation target movements.

Or, in one embodiment, the first user's usage technique diversity information is based on the number of movements of the first user for each of the Taekwondo evaluation target movements and the type information of movements that are not Taekwondo evaluation target movements among the plurality of Taekwondo movements. can also be judged. Alternatively, in one embodiment, the number of movements of the first user for each of the Taekwondo evaluation target movements of the first user and the type information and number of movements for each type of movements that are not Taekwondo evaluation target movements among a plurality of Taekwondo movements may be performed by the first user. You can also determine the technology diversity information used.

For example, the technology diversity information used may include a technology diversity score. In this case, the technical diversity score may be judged higher as the number of types of movements performed by the user increases, and may be judged higher as the difference in the number of times for each movement is small. In addition, the technology diversity information in use may be determined only by the Taekwondo evaluation target motion, but in terms of technology utilization, the usage technology diversity information may be determined by considering not only the Taekwondo evaluation target motion but also a plurality of Taekwondo movements.

Additionally, one embodiment may determine attack/defense ratio information based on the Taekwondo performance performed by the first user. For example, in one embodiment, the number of attack movements of the first user and the number of defense movements of the first user are determined based on information on the type of movement corresponding to the Taekwondo performance performed by the first user among a plurality of Taekwondo movements. It can be calculated and judged, and information on the attack/defense ratio of the first user in a sparring match can be determined and provided based on the number of attack moves and the number of defense moves.

Referring to FIG. 7, in one embodiment, when evaluating the first user's sparring movement for a Taekwondo evaluation target movement, a variable standard considering body information may be used rather than a single standard.

In this case, in one embodiment, when evaluating a user's sparring movements, only movements in which a strike is effective may be evaluated, but movements in which a strike is not valid may also be evaluated including movements in which a strike is not valid.

For example, when evaluating a hit including an invalid movement, one embodiment may obtain first body information of the first user and second body information of the second user who is the target of the first user's competition, The height of the correct blow can be adjusted based on the first body information and the second body information. In other words, in one embodiment, it may be determined whether the first user accurately performed an action toward the height of a specific part considering the height of the second user using body information including height information.

For example, the user's body information may include at least one of the user's height information, weight information, and body shape information, and the body shape information may include at least one of upper body length information, lower body length information, and upper and lower body ratio information. . Additionally, the user's body information may include skeletal information. Skeleton information may include length information and head circumference information of the skeleton corresponding to a specific part of the body.

Or, for example, when evaluating only effective striking movements, one embodiment includes both the sparring movements of the first user and the sparring movements of the second user, who is the first user's sparring opponent, in order to determine whether the hitting is effective. image information may be obtained, and a first body area for the first user and a second body area for the second user may be determined from the image information, based on the first body area, the second body area, and the skeleton information. It is possible to determine whether the first user's blow to the second user is effective. For example, the body area may be determined based on the outline or body shape of the user's body in image information. Information about body areas can be used to determine whether the bodies of users are touching or hitting each other.

For example, in one embodiment, when the first body region of the first user touches the second body region of the second user, the key point corresponding to the touched region among the plurality of key points of the skeleton information is used as the attack key point. You can decide. Then, in one embodiment, it may be determined whether the attack key point is included in the effective key point corresponding to the body part where the attack is effective among the plurality of key points, and if the attack key point is included in the valid key point, the attack key point can be determined as the hitting key point, and in this case, the hitting can be determined to be effective.

For example, if the key point that touches the second user's second body area is key point number 19, which is the part corresponding to the center of the left pelvis (or buttocks), key point number 19 is not a body part where an attack is effective. It is not included in the valid key points, and accordingly, key point number 19 may not be determined as a hitting key point even if it touches the second body area of the second user. On the other hand, if the key point that touches the second body area of the second user is key point number 29, which is the part corresponding to the tip of the right big toe, key point number 29 is a body part where the attack is effective, so it is included in the effective key point. Accordingly, key point number 29 that touches the second body area of the second user may be determined as the hitting key point.

In one embodiment, when the striking is determined to be effective, a striking motion corresponding to the sparring movement of the first user at the time the striking is determined to be effective may be determined based on skeleton information among a plurality of Taekwondo movements, and the first user The first body information of the user and the second body information of the second user may be obtained, and the striking motion may be corrected based on the obtained first body information and the second body information. In other words, the hitting height of the Taekwondo action (hitting action) corresponding to the action of hitting the second user can be corrected based on the second user's body information.

The hitting motion corrected as described above may represent the optimal motion in the current situation of the first user in which the first body information of the first user and the second body information of the second user are reflected, and the hitting motion corrected in this way And the first user's evaluation value for the hitting motion may be determined based on the first user's sparring movement at the time when the hitting is determined to be effective.

For example, the evaluation value is based on the location information of a plurality of key points corresponding to the corrected striking motion and the plurality of key point location information of the skeleton information corresponding to the sparring movement of the first user at the time when the hitting is judged to be effective. It can be derived as: Alternatively, the evaluation value is calculated by calculating the position difference information of the same part based on the corrected hitting motion and the plurality of key point position information of the first user's sparring movement at the time when the hitting is judged to be effective, and then evaluating the evaluation value based on this. can also be derived. Here, the evaluation value may represent an evaluation value regarding accuracy.

For example, one embodiment may determine proficiency information of the first user. Here, the skill information may include at least one of distance control information, strength information, and movement continuity information. For example, skill information may be determined according to different ratios or weights between distance control information, force intensity information, and motion continuity information, but may also be determined at the same ratio or weight. These ratios or weights may vary depending on settings and may change automatically depending on the level of training.

In one embodiment, weights for each evaluation item may be set differently depending on the training level of the first user.

When the first user performs a specific action, the distance control information may be obtained based on information on the optimal distance to the other person for the action. For example, in one embodiment, when the Taekwondo performance movement of the first user is determined, reference distance information with a preset sparring opponent corresponding to the Taekwondo performance movement may be obtained, and the first user's first body information and Based on the second body information of the second user, the sparring opponent, the reference distance information can be corrected to match the actual bodies of the sparring subjects.

Thereafter, in one embodiment, movement performance distance information between the first user and the second user at the time when the first user determines the Taekwondo performance movement may be derived through image information, and the derived movement performance distance information and the corrected reference distance Based on the information, distance adjustment information regarding whether the first user performed the operation at an appropriate distance may be determined. For example, the distance adjustment information may be determined based on the differences between the operation performance distance information and the corrected reference distance information for each of the operations performed by the user, but is not limited to this.

Information on strength and weakness can be obtained based on how much force is applied to the first user's blow, that is, the intensity of the blow. To this end, in one embodiment, when it is determined that the first user's hit is valid, time-dependent location information of a key point corresponding to the hit key point among a plurality of key points can be obtained through image information, Acceleration information of the hitting key point can be derived based on the location information. Thereafter, in one embodiment, the intensity of the blow may be determined based on the first body information and acceleration information of the first user, and strength information may be determined based on the intensity of the blow for each blow.

Movement continuity information may indicate whether the first user used several Taekwondo movements consecutively. For example, in one embodiment, temporal difference information between the points in time when the first user's Taekwondo performance movement is determined may be derived, and movement continuity information may be determined based on this. For example, if the difference in time between the first Taekwondo performance action and the next second Taekwondo performance action is less than or equal to the critical time, the first Taekwondo performance action and the second Taekwondo performance action may be determined to be continuous actions, and the continuous action Operations determined as can be clustered into one continuous operation. For example, in one embodiment, continuity information of motion may be determined based on the number of clustered continuous motions and the number of motions within the continuous motion consisting of the largest number of motions among the clustered continuous motions, but the present invention is not limited thereto.

Also, for example, one embodiment may determine expressiveness information of the first user. Here, the expressiveness information may include at least one of spirit information and creative technology information. For example, expressiveness information may be determined according to different ratios or weights between spirit information and creative technology information, but may also be determined at the same ratio or weight. These ratios or weights may vary depending on settings and may change automatically depending on the level of training.

In one embodiment, audio information corresponding to image information may be acquired, and audio information at the time of action corresponding to the time when the first user's Taekwondo performance movement is determined or the time when the strike is determined to be effective may be derived from the audio information. . Here, the time when the first user's Taekwondo performance movement is determined or the time when the strike is determined to be effective may be referred to as the audio extraction reference time.

The operation time audio information may include audio information from a start point located before the audio extraction reference point to an end point located after the audio extraction reference point, and the first temporal difference between the audio extraction reference point and the start point. and a second temporal difference between the audio extraction reference point and the end point, respectively, may be preset and may be different from each other. One embodiment may determine spirit information based on audio information at the time of operation.

The creative technique information may represent information about the first user's creative sparring movements rather than a plurality of preset Taekwondo movements. Creative technology information can be obtained through an evaluator terminal connected in advance through a network, and the evaluator terminal can transmit creative technology information including the creative technology score entered by the evaluator.

One embodiment may determine comprehensive evaluation information for the first user. For example, the comprehensive evaluation information may include a comprehensive evaluation value and may be determined based on at least one of accuracy information, proficiency information, expressiveness information, skill diversity information, and attack/defense information, and each piece of information is referred to as an evaluation item. It can be expressed. Here, the accuracy information may include an evaluation value regarding accuracy, the technology diversity information may include the technology diversity information used, and the attack/defense information may include attack/defense ratio information.

For example, in one embodiment, weights for each evaluation item may be set differently depending on the training level of the first user. For example, when the first user is ranked 1st, the ratio of accuracy information in the comprehensive evaluation information may be different from the rate occupied by the accuracy information in the comprehensive evaluation information when the first user is ranked 2nd. In other words, some items may have the same ratio or weight depending on the training level of the first user, but the ratio or weight may be set differently for all items.

Thereafter, one embodiment may provide the determined comprehensive evaluation information of the first user to the user terminal or another terminal connected through a network. Alternatively, in one embodiment, if the comprehensive evaluation value included in the comprehensive evaluation information is greater than or equal to the passing threshold, the first user's sparring evaluation result may be judged as passing, and the current training level is raised one level to increase the first user's training level. It can be updated.

Operations according to embodiments of the present specification can be implemented as a computer-readable program or code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system. Additionally, computer-readable recording media can be distributed across networked computer systems so that computer-readable programs or codes can be stored and executed in a distributed manner.

When the embodiment is implemented in software, the above-described techniques may be implemented as modules (processes, functions, etc.) that perform the above-described functions. Modules are stored in memory and can be executed by a processor. Memory may be internal or external to the processor and may be connected to the processor by a variety of well-known means.

Additionally, computer-readable recording media may include hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Program instructions may include not only machine language code such as that created by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc.

Although some aspects of the invention have been described in the context of an apparatus, it may also refer to a corresponding method description, where a block or device corresponds to a method step or feature of a method step. Similarly, aspects described in the context of a method may also be represented by corresponding blocks or items or features of a corresponding device. Some or all of the method steps may be performed by (or using) a hardware device, such as a microprocessor, programmable computer, or electronic circuit, for example. In some embodiments, one or more of the most important method steps may be performed by such an apparatus.

In embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functionality of the methods described herein. In embodiments, a field programmable gate array may operate in conjunction with a microprocessor to perform one of the methods described herein. In general, the methods are preferably performed by some hardware device.

Although the present invention has been described above with reference to preferred embodiments, those skilled in the art may make various modifications and changes to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that you can do it.

Claims

In a method for evaluating Taekwondo sparring according to user training level performed by at least one server,

Obtaining image information including a sparring movement of a first user;

Deriving skeleton information corresponding to the sparring movement of the first user based on the image information;

Obtaining first training level information of the first user;

determining at least one Taekwondo evaluation target movement among a plurality of Taekwondo movements based on the first training level information;

determining a Taekwondo movement performed by a first user among the plurality of Taekwondo movements based on the skeleton information; and

Taekwondo sparring evaluation according to user training level, comprising determining whether the first user has performed at least some of the at least one Taekwondo evaluation target movement based on the Taekwondo performance movement and the at least one Taekwondo evaluation target movement. method.
In claim 1,

Taekwondo according to user training level, further comprising determining the number of movements of the first user corresponding to each of the at least one Taekwondo evaluation target movement based on the Taekwondo performance action and the at least one Taekwondo evaluation target action. How to evaluate sparring.
In claim 2,

The first user's usage technique diversity information based on the number of movements of the first user corresponding to each of the at least one Taekwondo evaluation target movement and the type information of the movement corresponding to the Taekwondo performance movement among the plurality of Taekwondo movements. A Taekwondo sparring evaluation method according to the user training level, further comprising the step of determining.
In claim 3,

determining the number of attack movements of the first user and the number of defense movements of the first user based on information on the type of movement corresponding to the Taekwondo performance movement among the plurality of Taekwondo movements; and

Taekwondo sparring evaluation method according to user training level, further comprising determining attack/defense ratio information of the first user based on the number of attack movements and the number of defense movements.
In claim 1,

The image information further includes sparring movements of a second user who is a sparring opponent of the first user,

determining a first body region for the first user and a second body region for the second user from the image information;

determining whether the first user's blow to the second user is effective based on the first body region, the second body region, and the skeleton information;

Among the plurality of Taekwondo movements, determining a striking movement corresponding to the sparring movement of the first user at a time when the striking is determined to be effective based on the skeleton information;

Obtaining first body information of the first user and second body information of the second user;

Correcting the striking motion based on the first body information and the second body information; and

Further comprising determining an evaluation value of the first user for the hitting action based on the corrected hitting action and the sparring movement of the first user at the time when the hitting is determined to be effective, according to the user training level. Taekwondo sparring evaluation method.
In an electronic device that performs a Taekwondo sparring evaluation method according to the user's training level,

processor; and

Includes a memory that stores at least one instruction performed by the processor,

The at least one command is:

Executed to obtain image information including the sparring movements of the first user,

Executed to derive skeleton information corresponding to the sparring movement of the first user based on the image information,

Executed to obtain first training level information of the first user,

Executed to determine at least one Taekwondo evaluation target movement among a plurality of Taekwondo movements based on the first training level information,

Executed to determine a Taekwondo performance performed by the first user among the plurality of Taekwondo movements based on the skeleton information,

An electronic device configured to determine whether the first user has performed at least some of the at least one Taekwondo evaluation target movement based on the Taekwondo performance action and the at least one Taekwondo evaluation target action.