KR20240068451A - Metaverse movement lesson system - Google Patents

Abstract

The present invention implements the target user's motion and the golf instructor's motion as an avatar image in a virtual space, reduces costs by enabling non-face-to-face golf lessons in this virtual space, and eliminates location restrictions, thereby reducing the number of people around the world. It is about the Metaverse operation lesson system that allows you to select a good instructor among instructors and take lessons.

Description

Metaverse movement lesson system {Metaverse movement lesson system}

The present invention relates to a golf simulation system using an avatar, and more specifically, to a metaverse action lesson system in which an instructor avatar and a student avatar meet in a non-face-to-face virtual space to view and teach each other's actions and communicate by voice. will be.

The number of golf lovers in Korea reaches 2 million, and considering the performances of LPGA players such as Se-ri Pak and Mi-hyun Kim and the increase in golf broadcast time on public and cable broadcasting stations, the general public's interest in golf is increasing further, and the number of golf enthusiasts is increasing. There will be more. Meanwhile, a way for general enthusiasts to enjoy golf is to visit a golf driving range and play in person. Existing golf driving ranges calculate the cost of lessons and playing separately, so most people who feel the cost burden do not want to take lessons, even though continuous lessons are necessary due to the nature of the sport.

In addition, in the case of existing face-to-face lessons as shown in Figure 3, the instructor's tenure is very short, and continuity of lessons cannot be secured except for the customers in charge of multiple instructors working together. Because of this, scientific, systematic, and continuous golf lessons are not being provided.

To address these problems, various golf assistance systems have been developed.

For example, various golf swing analysis software using cameras are used in various ways, such as overlapping one's golf swing and a professional golfer's golf swing to express it in one scene, or linking it with a smartphone application. However, in the case of the existing video-based golf posture correction system developed in a specific space, the recorded video is loaded and analyzed by an expert with several inputs, so golf posture analysis takes a long time and the analysis data The accuracy was low, making it difficult for the general public to use.

In addition, the existing online golf swing posture correction market only consists of watching a golf swing video, sending an image to correct posture with a drawing pen, and sending a simple comment text message, which lacks user interest and reliability. There was a problem that was getting worse.

In order to improve this problem, Patent Document 1 (Korean Patent Publication No. 10-1829879) states that videos and voices of professional golfers can be displayed in real time on a smart device in live form, and that a live golf posture correction application module is provided. While controlling 1:1 cash payment, the live golf posture correction application module for which cash payment has been completed is marked with a drawing pen for golf posture, the current golf posture correction value compared to the standard golf posture, and the corresponding Videos of professional golfers' standard golf postures and voices of professional golfers can be delivered, and through live voice calls, you can connect with professional golfers and experts to receive golf lessons, regardless of time and place. Through this, you can directly receive drills for your incorrect swing and insufficient practice areas from a professional golfer, and through primary analysis and systematic swing correction using artificial intelligence, the professional golfer goes beyond simple swing analysis and relates to individual swing problems. Provides an artificial intelligence live golf posture correction device and method through professional golfer audio and video that can receive feedback on complementary practice drills and exercise method prescriptions that include video and audio.

Meanwhile, in order to compensate for the shortcomings of golf sports, which have great physical limitations, golf simulation systems that allow people to enjoy or practice golf indoors have become popular. For example, even if a user does not play a round of golf at an outdoor golf course, he or she can enjoy a golf game through a golf measurement system or screen golf system used at an indoor driving range. In particular, the screen golf system uses a screen and a projector to provide virtual reality as if the user is on an outdoor golf course. This screen golf system provides a virtual golf course image to the user, and when the user swings a golf club and hits a golf ball, it outputs an image of the golf ball moving on the virtual golf course in real time and shows the landing of the golf ball hit by the user. You can check your virtual location. In general, a screen golf system includes a display device to output a golf game screen, various sensors such as cameras installed on the side or front to detect the movement speed and direction of the golf ball or golf club hit by the user, and the sensed information. It consists of an analysis processing module that analyzes and proceeds with the golf game. Although physical restrictions have been reduced compared to golf games played in outdoor spaces, improvements are still needed in that golf games must be played in limited locations. In other words, the number of users who can play at the same time is limited, and improvements are needed to make it difficult for competitive games to proceed when multiple players are not connected to the screen golf system at the same time.

In addition, as offline social distance increases, the number of users who enjoy meetings or sports services in virtual spaces such as online is increasing. Accordingly, the need for services that provide golf competitions between multiple users or between a single user and a virtual avatar using a golf simulation system that provides a virtual golf rounding environment such as existing screen golf is increasing.

Patent Document 2 (Korean Patent Publication No. 10-2342778) provides a golf simulation device and method of operation that provide personalized avatars for each user and increase the opportunity for users to play golf matches using the provided avatars. do. That is, the golf simulation method of Patent Document 1 includes the steps of: generating a personalized user avatar for a first user based on golf skill information of the first user; Matching the user avatar with a match avatar for a golf match from among a plurality of previously created avatars, based on the level information of the user avatar, the plurality of previously generated avatars including avatars of other users who are offline; determining whether a second user corresponding to the matched match avatar is offline; When the second user is offline, generating play information of a competition avatar based on golf skill information of the second user; collecting play information of a first user about a golf match; Simulating a golf match based on the play information of the match avatar and the play information of the first user; and updating each of the point information of the user avatar and the point information of the competition avatar based on the simulation results of the golf match.

KR 10-1829879 B1 KR 10-2342778 B1

The first technical task of the present invention is to synchronize the motion of the participant and the motion of the avatar in virtual space.

In addition, the present invention reduces costs by enabling non-face-to-face golf lessons in a virtual space, and the second technical challenge is to enable people to take lessons by selecting a good instructor from around the world by eliminating location restrictions. Do this.

In addition, the third technical task of the present invention is to enable users to receive lessons at any time at a low cost by learning the standard movements of a professional instructor through artificial intelligence (AI) and enabling the artificial intelligence model to provide lessons to users.

The metaverse operation lesson system as the first aspect of the present invention for achieving the above-described purpose is a system including a plurality of cameras installed around the target user and the golf instructor, a control unit, and a display unit, wherein the control unit controls the camera. an image detection unit that analyzes the captured image using a pre-stored image processing program and detects the front, rear, left, and right images of the target user or golf instructor from the captured image; The front, back, left, and right images of the target user or golf instructor detected by the image detection unit are combined with preset avatar model information to generate a user 3D avatar image and an instructor 3D avatar image expressing the target user's movements. Avatar creation unit; and analyzing the movements of the 3D avatar images of the user and the instructor generated by the avatar creation unit, storing the movements of the analyzed 3D avatar images in a data storage unit, and sending the user 3D avatar image to the instructor 3. It is characterized by including a simulation analysis unit that calculates information about the degree of performance of the lesson by comparing it with the dimensional avatar image.

Another second aspect of the present invention is that in the metaverse operation lesson system of the first aspect, the simulation analysis unit is a golf lesson AI model that deep learns motion data of numerous instructors as learning data, and this golf lesson AI model It is characterized by rendering the user's motion movements on the instructor's 3D avatar image to create a state as if the user had received a lesson through the movements of an actual golf instructor.

According to the present invention, by enabling non-face-to-face golf lessons in a virtual space, it is possible to take lessons by selecting a good instructor from around the world without location or time constraints.

In addition, the present invention teaches artificial intelligence (AI) the standard movements of a professional instructor and allows the artificial intelligence model to provide lessons to users, allowing users to receive lessons at any time at a low cost.

The following drawings attached to this specification illustrate preferred embodiments of the present invention, and serve to further understand the technical idea of the present invention together with the detailed description of the invention described later, so the present invention includes the matters described in such drawings. It should not be interpreted as limited to only .
1 is a schematic diagram of a metaverse operation lesson system according to a preferred embodiment of the present invention.
Figure 2 is a diagram explaining the process of capturing motion using a multi-camera.
Figure 3 is a state diagram showing a conventional sports lesson state.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be.

On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

The terms used herein are merely used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, processes, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, processes, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as having an ideal or excessively formal meaning unless explicitly defined in the present application. No.

Terms or words used in this specification and claims should not be construed as limited to their common or dictionary meanings, and the inventor may appropriately define the concept of terms in order to explain his or her invention in the best way. Based on the principle that there is, it must be interpreted with a meaning and concept consistent with the technical idea of the present invention. In addition, if there is no other definition in the technical and scientific terms used, they have meanings commonly understood by those skilled in the art to which this invention pertains, and the gist of the present invention is summarized in the following description and accompanying drawings. Descriptions of known functions and configurations that may be unnecessarily obscure are omitted. The drawings introduced below are provided as examples so that the idea of the present invention can be sufficiently conveyed to those skilled in the art. Accordingly, the present invention is not limited to the drawings presented below and may be embodied in other forms. Additionally, like reference numerals refer to like elements throughout the specification. It should be noted that like elements in the drawings are represented by like symbols wherever possible.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. The accompanying drawings are not drawn to scale, and like reference numbers in each drawing refer to like elements.

1 is a schematic diagram of a metaverse operation lesson system according to a preferred embodiment of the present invention.

Referring to FIG. 1, the metaverse motion lesson system according to the present invention captures motion acquired through the target user's golf motion through a plurality of cameras (4 to 8 cameras) installed around the target user, Using the target user's motion image captured in this way, a 3D avatar image of the target user is created and displayed. In addition, the motion of the golf instructor's lesson movements is captured through multiple cameras (4 to 8 cameras) installed around the golf instructor matched with the target user, and the golf instructor's lesson motion image captured in this way is used. A 3D avatar image of the golf instructor is created and displayed.

To this end, the metaverse operation lesson system of the present invention is configured to include a plurality of cameras installed around the target user and golf instructor, a control unit, and a display unit.

The cameras are installed in all directions at a certain distance from the point where the target user and golf instructor are located, and capture and output front images of the user and instructor, rear images of the golfer and instructor, left and right images, and rear images. .

Referring to FIG. 2, the control unit detects the front image, back image, left image, and right image of the golfer and instructor from the captured images taken by the camera, and controls the detected front, rear, left, and right images. A 3D avatar image is generated by combining it with preset avatar model information, and the movement of the 3D avatar image thus generated is analyzed and output, comprising an image detection unit, an avatar creation unit, a simulation analysis unit, and data storage. It consists of wealth.

The image detection unit analyzes the captured image captured by the camera through a pre-stored image processing program and detects the front, rear, left, and right images of the target user or golf instructor from the captured image.

The avatar creation unit combines the front, back, left, and right images of the target user or golf instructor detected by the image detection unit with preset avatar model information to create a user 3D avatar image and an instructor 3D avatar that express the target user's movements. Create an image. That is, the avatar creation unit matches the front, back, left, and right images to a 3D avatar model preset to have a certain shape, thereby generating 3D avatar images of the user and instructor.

The simulation analysis unit analyzes the movements of the 3D avatar images of the user and the instructor generated by the avatar creation unit, and stores the movements of the analyzed 3D avatar images in the data storage unit.

The simulation analysis unit outputs the movements of the instructor's 3D avatar image reflecting the golfer's swing movements such as address, backswing, downswing, impact, follow throw, and putting, as well as the bending of the golf club being swung and impact with the floor to the display unit. So that the target user determines his/her own movement motion and executes the movement based on the instructor's 3D avatar image and the instructor's voice.

The target user's motion motion is also generated and output as the user's 3D avatar image through the image detection unit and the avatar creation unit, and the simulation analysis unit compares the user's 3D avatar image with the instructor's 3D avatar image to provide a lesson. Provides information on the level of performance.

In other words, the degree of performance of the lesson is expressed as a percentage of how close the motion of the user's 3D avatar image is to the motion of the instructor's 3D avatar image. Therefore, if the level of performance of the lesson is 90% or more, it can be determined that the user has sufficiently mastered the movements learned from the instructor.

The simulation analysis unit may be implemented as an artificial intelligence model using deep learning. In other words, a golf lesson AI model is built by deep learning the motion data of numerous instructors as learning data, and the motion movements of this golf lesson AI model are rendered on the instructor's 3D avatar image, allowing the user to mimic the movements of a real golf instructor. You can implement the same state as if you had received the lesson.

The display unit displays the 3D avatar image generated by the control unit.

Although the present invention has been described above with limited examples and drawings, the present invention is not limited thereto, and the technical idea of the present invention and the description below will be understood by those skilled in the art to which the present invention pertains. Of course, various modifications and variations are possible within the scope of equivalence of the patent claims.

Claims (2)

In the Metaverse operation lesson system, which includes a plurality of cameras installed around the target user and golf instructor, a control unit, and a display unit,
The control unit,
an image detection unit that analyzes the captured image captured by the camera using a pre-stored image processing program to detect front, rear, left, and right images of the target user or golf instructor from the captured image;
The front, back, left, and right images of the target user or golf instructor detected by the image detection unit are combined with preset avatar model information to generate a user 3D avatar image and an instructor 3D avatar image expressing the target user's movements. Avatar creation unit; and
Analyzes the movements of the 3D avatar images of the user and instructor generated by the avatar creation unit, stores the movements of the analyzed 3D avatar images in a data storage unit, and stores the user 3D avatar image in the instructor 3D. A metaverse operation lesson system comprising a simulation analysis unit that calculates information about the degree of lesson performance by comparing it with the avatar image. According to claim 1,
The simulation analysis unit is a golf lesson AI model that deep learns motion data from numerous instructors as learning data,
A metaverse motion lesson system that renders the motion of this golf lesson AI model on the instructor's 3D avatar image to make the user feel as if they had received a lesson through the motion of an actual golf instructor.